{"id":22365,"date":"2015-10-13T05:30:39","date_gmt":"2015-10-13T09:30:39","guid":{"rendered":"http:\/\/admin.patheos.com\/blogs\/geneveith\/?p=22365"},"modified":"2015-10-12T18:11:12","modified_gmt":"2015-10-12T22:11:12","slug":"the-problem-with-polls","status":"publish","type":"post","link":"https:\/\/www.patheos.com\/blogs\/geneveith\/2015\/10\/the-problem-with-polls\/","title":{"rendered":"The problem with polls"},"content":{"rendered":"\n<\/head>

Today\u2019s politics rely a great deal on polls.\u00a0 The problem is, election polling\u2013which has had some spectacular failures lately\u2013is faced with two huge problems:<\/p>\n

(1) Cell phone usage has shot up, to the point that 47% of the population no longer has a land line.\u00a0 And robo-calling of cell phone numbers is illegal.<\/p>\n

(2)\u00a0 The response rate to polls has plummeted.\u00a0 In the 1970s, the percentage of people who responded to pollster\u2019s surveys was 80%.\u00a0 Today, it is 8%.<\/p>\n

Thus, a recent national political poll conducted by NBC was based on just 236 responses!<\/p>\n

From Cliff Zukin, What\u2019s the Matter With Polling? \u2013 The New York Times<\/a>:<\/p>\n

Election polling is in near crisis, and we pollsters know. Two trends are driving the increasing unreliability of election and other polling in the United States: the growth of cellphones and the decline in people willing to answer surveys. Coupled, they have made high-quality research much more expensive to do, so there is less of it. This has opened the door for less scientifically based, less well-tested techniques. To top it off, a perennial election polling problem, how to identify \u201clikely voters,\u201d has become even thornier.<\/p>\n

\n

In terms of speed, the growth of cellphones is like few innovations in our history. About 10 years ago, opinion researchers began taking seriously the threat that the advent of cellphones posed to our established practice of polling people by calling landline phone numbers generated at random. At that time, the National Health Interview Survey, a high-quality government survey conducted through in-home interviews, estimated that about 6 percent of the public used only cellphones. The N.H.I.S. estimate for the first half of 2014 found that this had grown to 43 percent, with another 17 percent \u201cmostly\u201d using cellphones. In other words, a landline-only sample conducted for the 2014 elections would miss about three-fifths of the American public, almost three times as many as it would have missed in 2008.<\/p>\n

Since cellphones generally have separate exchanges from landlines, statisticians have solved the problem of finding them for our samples by using what we call \u201cdual sampling frames\u201d \u2014 separate random samples of cell and landline exchanges. The problem is that the 1991 Telephone Consumer Protection Act has been interpreted by the Federal Communications Commission to prohibit the calling of cellphones through automatic dialers, in which calls are passed to live interviewers only after a person picks up the phone. To complete a 1,000-person survey, it\u2019s not unusual to have to dial more than 20,000 random numbers, most of which do not go to actual working telephone numbers. Dialing manually for cellphones takes a great deal of paid interviewer time, and pollsters also compensate cellphone respondents with as much as $10 for their lost minutes.<\/p>\n

THE best survey organizations, like the Pew Research Center, complete about two of the more expensive cellphone interviews for every one on a landline. For many organizations, this is a budget buster that leads to compromises in sampling and interviewing.<\/p>\n

The second unsettling trend is the rapidly declining response rate. When I first started doing telephone surveys in New Jersey in the late 1970s, we considered an 80 percent response rate acceptable, and even then we worried if the 20 percent we missed were different in attitudes and behaviors than the 80 percent we got. Enter answering machines and other technologies. By 1997, Pew\u2019s response rate was 36 percent, and the decline has accelerated. By 2014 the response rate had fallen to 8 percent. As Nate Silver of fivethirtyeight.com recently observed, \u201cThe problem is simple but daunting. The foundation of opinion research has historically been the ability to draw a random sample of the population. That\u2019s become much harder to do.\u201d<\/p>\n

[Keep reading. . .]<\/a><\/p>\n

For another good article on the subject, see\u00a0 this<\/a>.<\/p><\/div>\n<\/blockquote><\/body><\/html>\n","protected":false},"excerpt":{"rendered":"

Today\u2019s politics rely a great deal on polls.\u00a0 The problem is, election polling\u2013which has had some spectacular failures lately\u2013is faced with two huge problems: (1) Cell phone usage has shot up, to the point that 47% of the population no longer has a land line.\u00a0 And robo-calling of cell phone numbers is illegal. (2)\u00a0 The […]<\/p>\n","protected":false},"author":1281,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[36,42],"tags":[1640],"class_list":["post-22365","post","type-post","status-publish","format-standard","hentry","category-politics","category-social-science","tag-opinion-polls"],"yoast_head":"\nThe problem with polls<\/title>\n<meta name=\"description\" content=\"Today's politics rely a great deal on polls.\u00a0 The problem is, election polling--which has had some spectacular failures lately--is faced with two huge\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.patheos.com\/blogs\/geneveith\/2015\/10\/the-problem-with-polls\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"The problem with polls\" \/>\n<meta property=\"og:description\" content=\"Today's politics rely a great deal on polls.\u00a0 The problem is, election polling--which has had some spectacular failures lately--is faced with two huge\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.patheos.com\/blogs\/geneveith\/2015\/10\/the-problem-with-polls\/\" \/>\n<meta property=\"og:site_name\" content=\"Cranach\" \/>\n<meta property=\"article:author\" content=\"https:\/\/www.facebook.com\/cranachblog\/\" \/>\n<meta property=\"article:published_time\" content=\"2015-10-13T09:30:39+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2015-10-12T22:11:12+00:00\" \/>\n<meta name=\"author\" content=\"Gene Veith\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Gene Veith\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.patheos.com\/blogs\/geneveith\/2015\/10\/the-problem-with-polls\/\",\"url\":\"https:\/\/www.patheos.com\/blogs\/geneveith\/2015\/10\/the-problem-with-polls\/\",\"name\":\"The problem with polls\",\"isPartOf\":{\"@id\":\"https:\/\/www.patheos.com\/blogs\/geneveith\/#website\"},\"datePublished\":\"2015-10-13T09:30:39+00:00\",\"dateModified\":\"2015-10-12T22:11:12+00:00\",\"author\":{\"@id\":\"https:\/\/www.patheos.com\/blogs\/geneveith\/#\/schema\/person\/f9ca8670bcc51908a78994c0484dbfa1\"},\"description\":\"Today's politics rely a great deal on polls.\u00a0 The problem is, election polling--which has had some spectacular failures lately--is faced with two huge\",\"breadcrumb\":{\"@id\":\"https:\/\/www.patheos.com\/blogs\/geneveith\/2015\/10\/the-problem-with-polls\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.patheos.com\/blogs\/geneveith\/2015\/10\/the-problem-with-polls\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.patheos.com\/blogs\/geneveith\/2015\/10\/the-problem-with-polls\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.patheos.com\/blogs\/geneveith\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"The problem with polls\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.patheos.com\/blogs\/geneveith\/#website\",\"url\":\"https:\/\/www.patheos.com\/blogs\/geneveith\/\",\"name\":\"Cranach\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.patheos.com\/blogs\/geneveith\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.patheos.com\/blogs\/geneveith\/#\/schema\/person\/f9ca8670bcc51908a78994c0484dbfa1\",\"name\":\"Gene Veith\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.patheos.com\/blogs\/geneveith\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/054d79faea5d476edd8f99e5f14fb17f?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/054d79faea5d476edd8f99e5f14fb17f?s=96&d=mm&r=g\",\"caption\":\"Gene Veith\"},\"description\":\"Gene Edward Veith, Jr. is a writer and retired literature professor, serving as Provost Emeritus at Patrick Henry College. He has authored over 25 books on Christianity and culture, literature, classical education, and theology. Dr. Veith previously held academic and editorial roles at Concordia University Wisconsin and WORLD Magazine. A respected voice in Lutheran and classical education circles, he holds a Ph.D. in English and several honorary doctorates. He and his wife, Jackquelyn, live in St. Louis and have three children and twelve grandchildren.\",\"sameAs\":[\"https:\/\/www.facebook.com\/cranachblog\/\",\"https:\/\/en.wikipedia.org\/wiki\/Gene_Edward_Veith\"],\"url\":\"https:\/\/www.patheos.com\/blogs\/geneveith\/author\/geneveith\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"The problem with polls","description":"Today's politics rely a great deal on polls.\u00a0 The problem is, election polling--which has had some spectacular failures lately--is faced with two huge","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.patheos.com\/blogs\/geneveith\/2015\/10\/the-problem-with-polls\/","og_locale":"en_US","og_type":"article","og_title":"The problem with polls","og_description":"Today's politics rely a great deal on polls.\u00a0 The problem is, election polling--which has had some spectacular failures lately--is faced with two huge","og_url":"https:\/\/www.patheos.com\/blogs\/geneveith\/2015\/10\/the-problem-with-polls\/","og_site_name":"Cranach","article_author":"https:\/\/www.facebook.com\/cranachblog\/","article_published_time":"2015-10-13T09:30:39+00:00","article_modified_time":"2015-10-12T22:11:12+00:00","author":"Gene Veith","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Gene Veith","Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.patheos.com\/blogs\/geneveith\/2015\/10\/the-problem-with-polls\/","url":"https:\/\/www.patheos.com\/blogs\/geneveith\/2015\/10\/the-problem-with-polls\/","name":"The problem with polls","isPartOf":{"@id":"https:\/\/www.patheos.com\/blogs\/geneveith\/#website"},"datePublished":"2015-10-13T09:30:39+00:00","dateModified":"2015-10-12T22:11:12+00:00","author":{"@id":"https:\/\/www.patheos.com\/blogs\/geneveith\/#\/schema\/person\/f9ca8670bcc51908a78994c0484dbfa1"},"description":"Today's politics rely a great deal on polls.\u00a0 The problem is, election polling--which has had some spectacular failures lately--is faced with two huge","breadcrumb":{"@id":"https:\/\/www.patheos.com\/blogs\/geneveith\/2015\/10\/the-problem-with-polls\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.patheos.com\/blogs\/geneveith\/2015\/10\/the-problem-with-polls\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.patheos.com\/blogs\/geneveith\/2015\/10\/the-problem-with-polls\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.patheos.com\/blogs\/geneveith\/"},{"@type":"ListItem","position":2,"name":"The problem with polls"}]},{"@type":"WebSite","@id":"https:\/\/www.patheos.com\/blogs\/geneveith\/#website","url":"https:\/\/www.patheos.com\/blogs\/geneveith\/","name":"Cranach","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.patheos.com\/blogs\/geneveith\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/www.patheos.com\/blogs\/geneveith\/#\/schema\/person\/f9ca8670bcc51908a78994c0484dbfa1","name":"Gene Veith","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.patheos.com\/blogs\/geneveith\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/054d79faea5d476edd8f99e5f14fb17f?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/054d79faea5d476edd8f99e5f14fb17f?s=96&d=mm&r=g","caption":"Gene Veith"},"description":"Gene Edward Veith, Jr. is a writer and retired literature professor, serving as Provost Emeritus at Patrick Henry College. He has authored over 25 books on Christianity and culture, literature, classical education, and theology. Dr. Veith previously held academic and editorial roles at Concordia University Wisconsin and WORLD Magazine. A respected voice in Lutheran and classical education circles, he holds a Ph.D. in English and several honorary doctorates. He and his wife, Jackquelyn, live in St. Louis and have three children and twelve grandchildren.","sameAs":["https:\/\/www.facebook.com\/cranachblog\/","https:\/\/en.wikipedia.org\/wiki\/Gene_Edward_Veith"],"url":"https:\/\/www.patheos.com\/blogs\/geneveith\/author\/geneveith\/"}]}},"_links":{"self":[{"href":"https:\/\/www.patheos.com\/blogs\/geneveith\/wp-json\/wp\/v2\/posts\/22365","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.patheos.com\/blogs\/geneveith\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.patheos.com\/blogs\/geneveith\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.patheos.com\/blogs\/geneveith\/wp-json\/wp\/v2\/users\/1281"}],"replies":[{"embeddable":true,"href":"https:\/\/www.patheos.com\/blogs\/geneveith\/wp-json\/wp\/v2\/comments?post=22365"}],"version-history":[{"count":0,"href":"https:\/\/www.patheos.com\/blogs\/geneveith\/wp-json\/wp\/v2\/posts\/22365\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.patheos.com\/blogs\/geneveith\/wp-json\/wp\/v2\/media?parent=22365"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.patheos.com\/blogs\/geneveith\/wp-json\/wp\/v2\/categories?post=22365"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.patheos.com\/blogs\/geneveith\/wp-json\/wp\/v2\/tags?post=22365"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}