{"id":8437,"date":"2013-12-12T12:36:46","date_gmt":"2013-12-12T17:36:46","guid":{"rendered":"http:\/\/www.patheos.com\/blogs\/unequallyyoked\/?p=8437"},"modified":"2013-12-12T13:04:00","modified_gmt":"2013-12-12T18:04:00","slug":"design-a-new-ideological-turing-test-for-a-much-improved-instrument","status":"publish","type":"post","link":"https:\/\/www.patheos.com\/blogs\/unequallyyoked\/2013\/12\/design-a-new-ideological-turing-test-for-a-much-improved-instrument.html","title":{"rendered":"Design a new Ideological Turing Test for a much improved instrument"},"content":{"rendered":"\n<\/head>

\"\"<\/a><\/p>\n

Every summer, when I run the Ideological Turing Test, I end up making very grumpy faces at Google Forms. \u00a0If I want to free people from the obligation to answer every single entry, I can\u2019t link up responses across entries to see how people scored on the whole. \u00a0But when I make a separate form for each essay, I have to re-ask the demographic question each time, which is tedious for you and limits how many I can ask. \u00a0And there\u2019s always a big drop in sample size from the first entry to the last entry.<\/p>\n

But, my friend Spencer Greenberg<\/a> (creator of the classes at ClearerThinking.org<\/a>) has coded me a solution. \u00a0He wrote a program, Guided Track<\/a>, that\u2019s meant to help people write classes of their own, and he\u2019s graciously put together a Turing Test demo for me. \u00a0So, under the new system, here\u2019s how taking a test would work:<\/p>\n

You click the link and see entries in\u00a0randomized\u00a0<\/em>order. \u00a0After you read each essay, you guess the true beliefs of the author and answer any other questions about the piece. \u00a0(Last year, I asked you how about how well you felt the argument held together, and how interested you were in talking to the author). \u00a0Then you decide if you\u2019re all tuckered out or if you\u2019d like to rate another entry.<\/p>\n

You keep going until you\u2019ve exhausted all the essays on tap or until you just don\u2019t feel like reading and judging anymore. \u00a0Once you\u2019re done judging, you answer the demographic questions\u00a0once<\/em> and you\u2019re all finished.<\/p>\n

I\u2019m quite excited to give Spencer\u2019s program a whirl, so I\u2019d like to try a mini Turing Test in late January. \u00a0At the Fare Forward<\/a> Summer Symposium, there were folks who expressed interest in a Catholic vs Protestant test, which might be of less interest to the atheists in the audience, but could possibly disentangle some of the differences between the sects. \u00a0We could also do a straight political one this time or a deontologist\/utilitarian\/virtue-ethicist three way, with moral dilemmas of your choice. \u00a0Or I could crib examples from Jonathan Haidt\u2019s research for the questions, and we could see how his moral foundations<\/a> map onto the division of your choosing.<\/p>\n

So, what ideas do you favor, and what suggestions do you have?<\/p>\n

Also, keep in mind that if there\u2019s a feature you think has been lacking from the surveys, it\u2019s a lot more likely that I can add it now, so make requests, and we\u2019ll see what Santa Spencer and I can do with your lists.<\/p>\n

\u00a0<\/p>\n

I\u2019m on (a belated) day eight of\u00a0a novena to St. Isidore<\/a>,\u00a0my saint for the month<\/a>, and readers are welcome to join me.<\/em><\/p>\n<\/body><\/html>\n","protected":false},"excerpt":{"rendered":"

Every summer, when I run the Ideological Turing Test, I end up making very grumpy faces at Google Forms. \u00a0If I want to free people from the obligation to answer every single entry, I can\u2019t link up responses across entries to see how people scored on the whole. \u00a0But when I make a separate form […]<\/p>\n","protected":false},"author":127,"featured_media":8438,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[4],"tags":[],"class_list":["post-8437","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-housekeeping"],"yoast_head":"\nDesign a new Ideological Turing Test for a much improved instrument<\/title>\n<meta name=\"description\" content=\"Every summer, when I run the Ideological Turing Test, I end up making very grumpy faces at Google Forms. \u00a0If I want to free people from the obligation to\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.patheos.com\/blogs\/unequallyyoked\/2013\/12\/design-a-new-ideological-turing-test-for-a-much-improved-instrument.html\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Design a new Ideological Turing Test for a much improved instrument\" \/>\n<meta property=\"og:description\" content=\"Every summer, when I run the Ideological Turing Test, I end up making very grumpy faces at Google Forms. \u00a0If I want to free people from the obligation to\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.patheos.com\/blogs\/unequallyyoked\/2013\/12\/design-a-new-ideological-turing-test-for-a-much-improved-instrument.html\" \/>\n<meta property=\"og:site_name\" content=\"Unequally Yoked\" \/>\n<meta property=\"article:published_time\" content=\"2013-12-12T17:36:46+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2013-12-12T18:04:00+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/wp-media.patheos.com\/blogs\/sites\/84\/2013\/12\/scantron.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"742\" \/>\n\t<meta property=\"og:image:height\" content=\"286\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Leah Libresco\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Leah Libresco\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.patheos.com\/blogs\/unequallyyoked\/2013\/12\/design-a-new-ideological-turing-test-for-a-much-improved-instrument.html\",\"url\":\"https:\/\/www.patheos.com\/blogs\/unequallyyoked\/2013\/12\/design-a-new-ideological-turing-test-for-a-much-improved-instrument.html\",\"name\":\"Design a new Ideological Turing Test for a much improved instrument\",\"isPartOf\":{\"@id\":\"https:\/\/www.patheos.com\/blogs\/unequallyyoked\/#website\"},\"datePublished\":\"2013-12-12T17:36:46+00:00\",\"dateModified\":\"2013-12-12T18:04:00+00:00\",\"author\":{\"@id\":\"https:\/\/www.patheos.com\/blogs\/unequallyyoked\/#\/schema\/person\/17ee17592b35b40040d5f5f7ea5ab464\"},\"description\":\"Every summer, when I run the Ideological Turing Test, I end up making very grumpy faces at Google Forms. \u00a0If I want to free people from the obligation to\",\"breadcrumb\":{\"@id\":\"https:\/\/www.patheos.com\/blogs\/unequallyyoked\/2013\/12\/design-a-new-ideological-turing-test-for-a-much-improved-instrument.html#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.patheos.com\/blogs\/unequallyyoked\/2013\/12\/design-a-new-ideological-turing-test-for-a-much-improved-instrument.html\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.patheos.com\/blogs\/unequallyyoked\/2013\/12\/design-a-new-ideological-turing-test-for-a-much-improved-instrument.html#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.patheos.com\/blogs\/unequallyyoked\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Design a new Ideological Turing Test for a much improved instrument\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.patheos.com\/blogs\/unequallyyoked\/#website\",\"url\":\"https:\/\/www.patheos.com\/blogs\/unequallyyoked\/\",\"name\":\"Unequally Yoked\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.patheos.com\/blogs\/unequallyyoked\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.patheos.com\/blogs\/unequallyyoked\/#\/schema\/person\/17ee17592b35b40040d5f5f7ea5ab464\",\"name\":\"Leah Libresco\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.patheos.com\/blogs\/unequallyyoked\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/20e1e6a3a94c4e7928687804a41d888d?s=96&d=mm&r=r\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/20e1e6a3a94c4e7928687804a41d888d?s=96&d=mm&r=r\",\"caption\":\"Leah Libresco\"},\"description\":\"Leah is the author of Arriving at Amen and Building the Benedict Option. Her further writing can be found at leahlibresco.com.\",\"url\":\"https:\/\/www.patheos.com\/blogs\/unequallyyoked\/author\/leahlibresco\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Design a new Ideological Turing Test for a much improved instrument","description":"Every summer, when I run the Ideological Turing Test, I end up making very grumpy faces at Google Forms. \u00a0If I want to free people from the obligation to","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.patheos.com\/blogs\/unequallyyoked\/2013\/12\/design-a-new-ideological-turing-test-for-a-much-improved-instrument.html","og_locale":"en_US","og_type":"article","og_title":"Design a new Ideological Turing Test for a much improved instrument","og_description":"Every summer, when I run the Ideological Turing Test, I end up making very grumpy faces at Google Forms. \u00a0If I want to free people from the obligation to","og_url":"https:\/\/www.patheos.com\/blogs\/unequallyyoked\/2013\/12\/design-a-new-ideological-turing-test-for-a-much-improved-instrument.html","og_site_name":"Unequally Yoked","article_published_time":"2013-12-12T17:36:46+00:00","article_modified_time":"2013-12-12T18:04:00+00:00","og_image":[{"width":"742","height":"286","url":"https:\/\/wp-media.patheos.com\/blogs\/sites\/84\/2013\/12\/scantron.jpg","type":"image\/jpeg"}],"author":"Leah Libresco","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Leah Libresco","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.patheos.com\/blogs\/unequallyyoked\/2013\/12\/design-a-new-ideological-turing-test-for-a-much-improved-instrument.html","url":"https:\/\/www.patheos.com\/blogs\/unequallyyoked\/2013\/12\/design-a-new-ideological-turing-test-for-a-much-improved-instrument.html","name":"Design a new Ideological Turing Test for a much improved instrument","isPartOf":{"@id":"https:\/\/www.patheos.com\/blogs\/unequallyyoked\/#website"},"datePublished":"2013-12-12T17:36:46+00:00","dateModified":"2013-12-12T18:04:00+00:00","author":{"@id":"https:\/\/www.patheos.com\/blogs\/unequallyyoked\/#\/schema\/person\/17ee17592b35b40040d5f5f7ea5ab464"},"description":"Every summer, when I run the Ideological Turing Test, I end up making very grumpy faces at Google Forms. \u00a0If I want to free people from the obligation to","breadcrumb":{"@id":"https:\/\/www.patheos.com\/blogs\/unequallyyoked\/2013\/12\/design-a-new-ideological-turing-test-for-a-much-improved-instrument.html#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.patheos.com\/blogs\/unequallyyoked\/2013\/12\/design-a-new-ideological-turing-test-for-a-much-improved-instrument.html"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.patheos.com\/blogs\/unequallyyoked\/2013\/12\/design-a-new-ideological-turing-test-for-a-much-improved-instrument.html#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.patheos.com\/blogs\/unequallyyoked"},{"@type":"ListItem","position":2,"name":"Design a new Ideological Turing Test for a much improved instrument"}]},{"@type":"WebSite","@id":"https:\/\/www.patheos.com\/blogs\/unequallyyoked\/#website","url":"https:\/\/www.patheos.com\/blogs\/unequallyyoked\/","name":"Unequally Yoked","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.patheos.com\/blogs\/unequallyyoked\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/www.patheos.com\/blogs\/unequallyyoked\/#\/schema\/person\/17ee17592b35b40040d5f5f7ea5ab464","name":"Leah Libresco","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.patheos.com\/blogs\/unequallyyoked\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/20e1e6a3a94c4e7928687804a41d888d?s=96&d=mm&r=r","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/20e1e6a3a94c4e7928687804a41d888d?s=96&d=mm&r=r","caption":"Leah Libresco"},"description":"Leah is the author of Arriving at Amen and Building the Benedict Option. Her further writing can be found at leahlibresco.com.","url":"https:\/\/www.patheos.com\/blogs\/unequallyyoked\/author\/leahlibresco"}]}},"_links":{"self":[{"href":"https:\/\/www.patheos.com\/blogs\/unequallyyoked\/wp-json\/wp\/v2\/posts\/8437","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.patheos.com\/blogs\/unequallyyoked\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.patheos.com\/blogs\/unequallyyoked\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.patheos.com\/blogs\/unequallyyoked\/wp-json\/wp\/v2\/users\/127"}],"replies":[{"embeddable":true,"href":"https:\/\/www.patheos.com\/blogs\/unequallyyoked\/wp-json\/wp\/v2\/comments?post=8437"}],"version-history":[{"count":0,"href":"https:\/\/www.patheos.com\/blogs\/unequallyyoked\/wp-json\/wp\/v2\/posts\/8437\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.patheos.com\/blogs\/unequallyyoked\/wp-json\/wp\/v2\/media\/8438"}],"wp:attachment":[{"href":"https:\/\/www.patheos.com\/blogs\/unequallyyoked\/wp-json\/wp\/v2\/media?parent=8437"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.patheos.com\/blogs\/unequallyyoked\/wp-json\/wp\/v2\/categories?post=8437"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.patheos.com\/blogs\/unequallyyoked\/wp-json\/wp\/v2\/tags?post=8437"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}