{"id":418,"date":"2009-04-14T22:57:00","date_gmt":"2009-04-14T21:57:00","guid":{"rendered":"http:\/\/admin.patheos.com\/blogs\/epiphenom\/2009\/04\/the-problem-with-studies-on-the-social-effects-of-religion.html"},"modified":"2014-11-13T18:32:14","modified_gmt":"2014-11-13T17:32:14","slug":"problem-with-studies-on-social-effects","status":"publish","type":"post","link":"https:\/\/www.patheos.com\/blogs\/epiphenom\/2009\/04\/problem-with-studies-on-social-effects.html","title":{"rendered":"The problem with studies on the social effects of religion&#8230;"},"content":{"rendered":"<!DOCTYPE html PUBLIC \"-\/\/W3C\/\/DTD HTML 4.0 Transitional\/\/EN\" \"http:\/\/www.w3.org\/TR\/REC-html40\/loose.dtd\">\n<html><head><meta http-equiv=\"content-type\" content=\"text\/html; charset=utf-8\"><meta http-equiv=\"content-type\" content=\"text\/html; charset=utf-8\"><\/head><body><p>One of the many newspaper columns published over the weekend was <a href=\"http:\/\/www.miamiherald.com\/news\/southflorida\/story\/995989.html\" class=\" decorated-link\" target=\"_blank\" rel=\"nofollow\">this one<\/a>, in The Miami Herald, on the alleged beneficial effects of religion. Most of it was drawn from the work of <a href=\"http:\/\/www.psy.miami.edu\/faculty\/mmccullough\/\" class=\" decorated-link\" target=\"_blank\">Mike McCullough<\/a>, a psychologist at the University of Miami.<\/p>\n<blockquote><p>McCullough\u2019s research suggests that religious people of all faiths, by sizable margins, do better in school, live longer, have more satisfying marriages and are generally happier than their nonbelieving peers.<\/p><\/blockquote>\n<p>Yes well, that\u2019s all true enough, but does it justify the claim that religions <span style=\"font-style: italic\">causes<\/span> all these effects? In fact, the evidence is surprisingly weak. Take, for example, McCullough\u2019s recent study, quoted in the article:<\/p>\n<blockquote><p>In the Journal of Drug Issues, he reported that in neighborhoods plagued by alcoholism, church attendance helps more than Alcoholics Anonymous.<\/p><\/blockquote>\n<p>In fact, what they showed was that women who say that they go to Church once a week (or more) also say that they rarely binge drink. This doesn\u2019t really prove that Church attendance reduces binge drinking.<\/p>\n<p>But this study does very nicely exemplify all of the problems that bedevil research into the social effects of religion (all of which McCullough acknowledges):<\/p>\n<p><span style=\"font-weight: bold\">What people say they do and what they actually do are different things.<\/span><br>Most studies into the effects of religion rely on self-reported behaviour. The subjects fill in a questionnaire reporting how often they go to church, and (in this case) how often they get drunk.<\/p>\n<p>But we know that how people want to see themselves strongly influences what they put in these sorts of surveys. How many people are going to put down that they both go to Church regularly and get drunk regularly, when they know that the two together are highly socially unacceptable.<\/p>\n<p><span style=\"font-weight: bold\">Correlation is not causation.<\/span><span style=\"font-weight: bold\"><span style=\"font-weight: bold\"> <\/span><\/span><br>Religious people are different to non-religious. Hard drinkers are likely to avoid going to Church for a variety of reasons. Almost all studies are purely cross-sectional. That is, they look at people at a single point in time. But that really proves nothing, especially if you don\u2019t control for personality type.<\/p>\n<p>Even longitudinal studies are suspect. Suppose it works like this. A drunkard decides to turn her life around. They start going to go to the church (because, in the US, that\u2019s the premier source of support networks), and with the help of their new friends, they start to turn their life around. Is this really a story of religion causing temperance?<\/p>\n<p><span style=\"font-weight: bold\">There\u2019s no such thing as \u2018religion\u2019.<\/span><br>OK, this will probably come as a surprise to many. But religion is a nebulous concept, and the reason is that it\u2019s actually a label applied to a bunch of different things \u2013 most notably participating in ritual activities, and a variety of supernatural beliefs.<\/p>\n<p>Mixing the two up should be verboten. And yet that is exactly what McCullough does in this study. He begins by theorizing why religion should reduce binge drinking \u2013 because it contravenes religious beliefs in a variety of ways. And then goes on to look at how church <span style=\"font-style: italic\">attendance, <\/span>not religious belief, is linked to less drinking. There\u2019s lots of reasons why people go to church \u2013 and only some of them have anything to do with religious beliefs.<\/p>\n<p>So is there any practical way of untangling this sticky mess? I think there is, and there is a limited amount of data out there that\u2019s highly suggestive.<\/p>\n<p>Firstly, if you want to make the arguments that McCullough is making, that adopting a religion helps people who would otherwise get into trouble, then you really need to do an interventional study.<\/p>\n<p>This means getting a group of people and giving half of them religious instruction, and the other half some secular alternative \u2013 like engagement in a support group. Amazingly, given the amount of money spent on religion, and the widespread belief that it is effective, these sorts of studies are almost never done!<\/p>\n<p>However, there are two recent examples. A study that looked to see whether <a href=\"http:\/\/bhascience.blogspot.com\/2008\/12\/virginity-pledges-are-worse-than.html\" class=\" decorated-link\" target=\"_blank\" rel=\"nofollow\">virginity pledges were effective<\/a>. And a study that looked at whether <a href=\"http:\/\/bhascience.blogspot.com\/2008\/12\/virginity-pledges-are-worse-than.html\" class=\" decorated-link\" target=\"_blank\" rel=\"nofollow\">spiritual guidance helps drug addicts<\/a>. Neither showed any benefit.<\/p>\n<p>Secondly, you could do research in populations where the religious are in the minority. That would help sort out whether it\u2019s just a socialization effect. In other words, people who want to conform and have the willpower to participate in wider society will turn to religious groups in a religious society, and non-religious groups in a secular one.<\/p>\n<p>This also is an under-researched area (there just isn\u2019t the interest in non-religious countries). But <a href=\"http:\/\/bhascience.blogspot.com\/2009\/03\/religion-and-losing-virginity-no.html\" class=\" decorated-link\" target=\"_blank\" rel=\"nofollow\">one recent study<\/a>, in Scottish teens who were mostly non religious, found that religiosity did not affect sexual behaviour.<\/p>\n<p>And finally, you can get a reality check on whether encouraging religion is really a useful way to focus society\u2019s energy by looking at non-religious countries. Across a wide range of outcomes, less religious countries are happier, healthier and more secure than religious ones.<\/p>\n<p>If you want to make the world a better place, then worrying about religion is not the place to start.<\/p>\n<p>_____________________________________________________________________________________<\/p>\n<p><span style=\"padding: 5px;float: right\"><a href=\"http:\/\/www.researchblogging.org\/\" class=\" decorated-link\" target=\"_blank\" rel=\"nofollow\"><img decoding=\"async\" alt=\"ResearchBlogging.org\" src=\"https:\/\/www.researchblogging.org\/public\/citation_icons\/rb2_large_gray.png\" style=\"border: 0pt none\"><\/a><\/span><span class=\"Z3988\" title=\"ctx_ver=Z39.88-2004&amp;rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&amp;rft.jtitle=Journal+of+Drug+Issues&amp;rft_id=info%3Adoi%2F&amp;rfr_id=info%3Asid%2Fresearchblogging.org&amp;rft.atitle=Religious+Involvement+and+the+Intoxication+Trajectories+of+Low+Income+Urban+Women&amp;rft.issn=&amp;rft.date=2008&amp;rft.volume=38&amp;rft.issue=3&amp;rft.spage=&amp;rft.epage=&amp;rft.artnum=http%3A%2F%2Fwww2.criminology.fsu.edu%2F%257Ejdi%2Fjournal%2F2008%2Fhill.pdf&amp;rft.au=Terrence+D.+Hill&amp;rft.au=Michael+E.+McCullough&amp;rfe_dat=bpr3.included=1;bpr3.tags=Social+Science%2CReligion%2C+Drug+Abuse%2C+Alcoholism\">Terrence D. Hill, &amp; Michael E. McCullough (2008). Religious Involvement and the Intoxication Trajectories of Low Income Urban Women <span style=\"font-style: italic\">Journal of Drug Issues, 38<\/span> (3)<\/span><\/p>\n<\/body><\/html>\n","protected":false},"excerpt":{"rendered":"<p>One of the many newspaper columns published over the weekend was this one, in The Miami Herald, on the alleged beneficial effects of religion. Most of it was drawn from the work of Mike McCullough, a psychologist at the University of Miami. McCullough\u2019s research suggests that religious people of all faiths, by sizable margins, do [&hellip;]<\/p>\n","protected":false},"author":2091,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-418","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v21.1 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>The problem with studies on the social effects of religion...<\/title>\n<meta name=\"description\" content=\"One of the many newspaper columns published over the weekend was this one, in The Miami Herald, on the alleged beneficial effects of religion. Most of it\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.patheos.com\/blogs\/epiphenom\/2009\/04\/problem-with-studies-on-social-effects.html\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"The problem with studies on the social effects of religion...\" \/>\n<meta property=\"og:description\" content=\"One of the many newspaper columns published over the weekend was this one, in The Miami Herald, on the alleged beneficial effects of religion. Most of it\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.patheos.com\/blogs\/epiphenom\/2009\/04\/problem-with-studies-on-social-effects.html\" \/>\n<meta property=\"og:site_name\" content=\"Epiphenom\" \/>\n<meta property=\"article:published_time\" content=\"2009-04-14T21:57:00+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2014-11-13T17:32:14+00:00\" \/>\n<meta property=\"og:image\" content=\"http:\/\/www.researchblogging.org\/public\/citation_icons\/rb2_large_gray.png\" \/>\n<meta name=\"author\" content=\"Epiphenom\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Epiphenom\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"4 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.patheos.com\/blogs\/epiphenom\/2009\/04\/problem-with-studies-on-social-effects.html\",\"url\":\"https:\/\/www.patheos.com\/blogs\/epiphenom\/2009\/04\/problem-with-studies-on-social-effects.html\",\"name\":\"The problem with studies on the social effects of religion...\",\"isPartOf\":{\"@id\":\"https:\/\/www.patheos.com\/blogs\/epiphenom\/#website\"},\"datePublished\":\"2009-04-14T21:57:00+00:00\",\"dateModified\":\"2014-11-13T17:32:14+00:00\",\"author\":{\"@id\":\"https:\/\/www.patheos.com\/blogs\/epiphenom\/#\/schema\/person\/98b4bf21daa886d9eb1d5f0e99643ad1\"},\"description\":\"One of the many newspaper columns published over the weekend was this one, in The Miami Herald, on the alleged beneficial effects of religion. Most of it\",\"breadcrumb\":{\"@id\":\"https:\/\/www.patheos.com\/blogs\/epiphenom\/2009\/04\/problem-with-studies-on-social-effects.html#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.patheos.com\/blogs\/epiphenom\/2009\/04\/problem-with-studies-on-social-effects.html\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.patheos.com\/blogs\/epiphenom\/2009\/04\/problem-with-studies-on-social-effects.html#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.patheos.com\/blogs\/epiphenom\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"The problem with studies on the social effects of religion&#8230;\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.patheos.com\/blogs\/epiphenom\/#website\",\"url\":\"https:\/\/www.patheos.com\/blogs\/epiphenom\/\",\"name\":\"Epiphenom\",\"description\":\"The science of religion and non-belief\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.patheos.com\/blogs\/epiphenom\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.patheos.com\/blogs\/epiphenom\/#\/schema\/person\/98b4bf21daa886d9eb1d5f0e99643ad1\",\"name\":\"Epiphenom\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.patheos.com\/blogs\/epiphenom\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/a9abb71dca9f11ec59b77b1fffa487fa?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/a9abb71dca9f11ec59b77b1fffa487fa?s=96&d=mm&r=g\",\"caption\":\"Epiphenom\"},\"url\":\"https:\/\/www.patheos.com\/blogs\/epiphenom\/author\/trees\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"The problem with studies on the social effects of religion...","description":"One of the many newspaper columns published over the weekend was this one, in The Miami Herald, on the alleged beneficial effects of religion. Most of it","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.patheos.com\/blogs\/epiphenom\/2009\/04\/problem-with-studies-on-social-effects.html","og_locale":"en_US","og_type":"article","og_title":"The problem with studies on the social effects of religion...","og_description":"One of the many newspaper columns published over the weekend was this one, in The Miami Herald, on the alleged beneficial effects of religion. Most of it","og_url":"https:\/\/www.patheos.com\/blogs\/epiphenom\/2009\/04\/problem-with-studies-on-social-effects.html","og_site_name":"Epiphenom","article_published_time":"2009-04-14T21:57:00+00:00","article_modified_time":"2014-11-13T17:32:14+00:00","og_image":[{"url":"http:\/\/www.researchblogging.org\/public\/citation_icons\/rb2_large_gray.png"}],"author":"Epiphenom","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Epiphenom","Est. reading time":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.patheos.com\/blogs\/epiphenom\/2009\/04\/problem-with-studies-on-social-effects.html","url":"https:\/\/www.patheos.com\/blogs\/epiphenom\/2009\/04\/problem-with-studies-on-social-effects.html","name":"The problem with studies on the social effects of religion...","isPartOf":{"@id":"https:\/\/www.patheos.com\/blogs\/epiphenom\/#website"},"datePublished":"2009-04-14T21:57:00+00:00","dateModified":"2014-11-13T17:32:14+00:00","author":{"@id":"https:\/\/www.patheos.com\/blogs\/epiphenom\/#\/schema\/person\/98b4bf21daa886d9eb1d5f0e99643ad1"},"description":"One of the many newspaper columns published over the weekend was this one, in The Miami Herald, on the alleged beneficial effects of religion. Most of it","breadcrumb":{"@id":"https:\/\/www.patheos.com\/blogs\/epiphenom\/2009\/04\/problem-with-studies-on-social-effects.html#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.patheos.com\/blogs\/epiphenom\/2009\/04\/problem-with-studies-on-social-effects.html"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.patheos.com\/blogs\/epiphenom\/2009\/04\/problem-with-studies-on-social-effects.html#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.patheos.com\/blogs\/epiphenom"},{"@type":"ListItem","position":2,"name":"The problem with studies on the social effects of religion&#8230;"}]},{"@type":"WebSite","@id":"https:\/\/www.patheos.com\/blogs\/epiphenom\/#website","url":"https:\/\/www.patheos.com\/blogs\/epiphenom\/","name":"Epiphenom","description":"The science of religion and non-belief","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.patheos.com\/blogs\/epiphenom\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/www.patheos.com\/blogs\/epiphenom\/#\/schema\/person\/98b4bf21daa886d9eb1d5f0e99643ad1","name":"Epiphenom","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.patheos.com\/blogs\/epiphenom\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/a9abb71dca9f11ec59b77b1fffa487fa?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/a9abb71dca9f11ec59b77b1fffa487fa?s=96&d=mm&r=g","caption":"Epiphenom"},"url":"https:\/\/www.patheos.com\/blogs\/epiphenom\/author\/trees"}]}},"_links":{"self":[{"href":"https:\/\/www.patheos.com\/blogs\/epiphenom\/wp-json\/wp\/v2\/posts\/418","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.patheos.com\/blogs\/epiphenom\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.patheos.com\/blogs\/epiphenom\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.patheos.com\/blogs\/epiphenom\/wp-json\/wp\/v2\/users\/2091"}],"replies":[{"embeddable":true,"href":"https:\/\/www.patheos.com\/blogs\/epiphenom\/wp-json\/wp\/v2\/comments?post=418"}],"version-history":[{"count":0,"href":"https:\/\/www.patheos.com\/blogs\/epiphenom\/wp-json\/wp\/v2\/posts\/418\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.patheos.com\/blogs\/epiphenom\/wp-json\/wp\/v2\/media?parent=418"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.patheos.com\/blogs\/epiphenom\/wp-json\/wp\/v2\/categories?post=418"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.patheos.com\/blogs\/epiphenom\/wp-json\/wp\/v2\/tags?post=418"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}