Growing up, I read HSLDA\u2019s Home School Court Report<\/em> and various other homeschool newsletters. I attended homechool conferences and listened to my parents praise the virtues of homeschooling to people they met. I came away believing that homeschooling in and of itself causes kids to excel academically\u2014and that studies had proven this. I heard over and over again that homechoolers scored in the 80th percentile, and listened raptly to stories of homeschoolers getting into Harvard or starting college at age 12. So I\u2019m not surprised that as I\u2019ve addressed homeschooling over the past few weeks commenters have been repeating all of this back to me once again. But when it comes down to it, all of this was wrong\u2014propaganda<\/em>.<\/p>\n Let me start by quoting from the International Center for Home Education Research<\/a>\u00a0(ICHER), a nonpartisan group of scholars who share a common interest in studying homeschooling.<\/p>\n How does U.S. homeschoolers\u2019 academic performance compare with other students?<\/strong><\/p>\n Evidence regarding this question has been fraught with controversy because most of the studies that have received widest attention have been interpreted to say something they do not and cannot. We simply can\u2019t draw any conclusions about the academic performance of the \u201caverage homeschooler,\u201d because none of the studies so often cited employ random samples representing the full range of homeschoolers.<\/p>\n For example, two large U.S. studies (Rudner, 1999; Ray, 2009) are frequently cited as definitive evidence that homeschoolers academically outperform public and private school students. But in both cases, the homeschool participants were volunteers responding to an invitation by the nation\u2019s most prominent advocacy organization to contribute test scores (on tests usually administered by parents in the child\u2019s own home). The demographics of these samples were far whiter, more religious, more married, better educated, and wealthier than national averages. And yet these test score results were compared to average public school scores that included children from all income levels and family backgrounds. Not surprisingly, wealthy homeschoolers from stable two-parent families who take tests administered by their parents in the comfort of their own homes outscore the average public school child by large margins.<\/p>\n The simple fact is that no studies of academic achievement exist that draw from a representative, nationwide sample of homeschoolers and control for background variables like socio-economic or marital status. It is thus impossible to say whether or not homeschooling as such has any impact on the sort of academic achievement measured by standardized tests.<\/p><\/blockquote>\n Read these three paragraphs carefully and reread them if you need to. They\u2019re very concise and to the point and also very important. And before anyone starts suggesting that ICHER is biased against homeschooling, allow me to point out that one of the ICHER\u2019s two founders (Milton Gaither) is himself a homeschool father.<\/p>\n The basic gist of the above paragraphs is that studies of homeschoolers\u2019 academic performance have two problems: First, they are voluntary (and usually recruited by HSLDA, explicitly touting them as opportunities to showcase homeschoolers\u2019 academic success), meaning they do not employ random samples and therefore are not representative. Second, homeschool advocates compare the results of these studies to the public school average without correcting for things like race, income, and family background, which means that the statistics as reported and commonly touted don\u2019t actually say anything other than that students from white, two-parent, middle class families\u00a0do better academically than\u00a0the average student, which shouldn\u2019t be a surprise to anyone<\/em>.<\/p>\n Think about it like this. If an advocacy group devoted to supporting and promoting public schools conducted a study, drawing voluntary participants from their mailing list and promoting the study as a way to prove that public schools are the best academic option, would we assume that the results as representative of all public school students? No.<\/em> Similarly, if a private school whose students are from families with higher incomes than average boasts about its high test scores, isn\u2019t it worth pointing out that comparing its students\u2019 scores with the public school average without correcting for their higher incomes is unfair, and that its students, being wealthier than average, would likely score above average in public school as well? To accurately examine what the that private school\u2019s test scores show, you would need to compare its students with students who are demographically matched, not with the average public school student<\/em>. These are the things I never thought about or asked myself when I was told that \u201cstudies show\u201d that homeschoolers score in the 80th percentile\u2014and these are the things HSLDA and other homeschool advocacy groups and leaders counted on me not understanding. (I also never thought about the fact that for every anecdote I heard of homechooling success, there might also be an anecdote of homechooling failure\u2014I simply wasn\u2019t hearing that one.)<\/p>\n ICHER co-founder, education scholar, and homeschool father Milton Gaither, who has written the seminal work<\/a> on the history of the homeschool movement, did a two-part post on Brian Ray\u2019s research organization, the National Home Education Research Institute (NHERI). Both parts are well worth reading for anyone interested in this subject.<\/p>\n Brian D. Ray and NHERI, part\u00a01<\/a><\/p>\n Brian D. Ray and NHERI, part\u00a02<\/a><\/p>\n Let\u2019s look briefly at the 1999 Rudner study. The study was commissioned by HSLDA but was conducted by a nonpartisan researcher and used scores from the Bob Jones testing service popular with homeschoolers (rather than simply recruiting volunteers from HSLDA\u2019s membership and affiliated homeschool groups, as is typically done). Finally, while the study was volunteer-based, parents didn\u2019t see their students\u2019 scores before deciding whether to participate. The interesting thing is that while HSLDA and other homeschool groups have touted this study to high heaven as proof of homeschoolers\u2019 superior academic achievement, in the actual study Rudner himself was very clear that this was not<\/em>\u00a0what the study showed:<\/p>\n This study does not demonstrate that home schooling is superior to public or private schools. It should not be cited as evidence that our public schools are failing. It does not indicate that children will perform better academically if they are home schooled.<\/p><\/blockquote>\n Those sentences were in the actual study<\/em>. Did anyone actually bother to read them? In the years since the study was conducted, Rudner himself has been appalled by homeschool advocacy groups\u2019 misuse of his study\u2019s results. \u201cI made the case that if you took the same kids and the same parents and put them in public schools, these kids would probably do exceptionally well,\u201d he explained. (For more on Rudner, see this academic paper<\/a>\u00a0and\u00a0this newspaper article<\/a>\u00a0and this web post<\/a>.)<\/p>\n Correcting for Variables<\/strong><\/p>\n Let me say few more words on correcting for variables. Some years ago, I was holding up my own academic success to my husband once again as proof that homeschooling turns out kids who are higher quality academically than other academic options. He responded with a simple question:<\/p>\n With your parents and socio-economic status, don\u2019t you think you would have done above average if you had gone to your local public schools too? How much of your academic success do you think is really due to being homeschooled?<\/p><\/blockquote>\n I was taken aback. I had never thought to ask that. Like me, my husband grew up in a well-educated two-parent upper middle class white family. Like me, he excelled academically, went to college on scholarships, and was extremely successful there\u2014but unlike me he attended public school from kindergarten through high school. I realized in that moment that my academic success needed to be compared to his<\/em> academic success, not to the academic success of the averaged public school student.<\/p>\n When you compare homeschool test scores to public school test scores without controlling for background variables, you aren\u2019t actually measuring the results of being homeschooled, you\u2019re measuring the results of being in a demographic that is, to quote from the ICHER FAQ, \u201cwhiter, more religious, more married, better educated, and wealthier than national averages.\u201d<\/strong><\/p>\n Do we have any numbers that control for these factors? As it so happens, while we don\u2019t have any statistics on homeschoolers\u2019 academic success that aren\u2019t drawn from volunteer or self-selected samples, we do have some that correct for background variables. (I am now drawing on information from Milton Gaither and Robert Kunzman\u2019s recent survey of the literature and studies on homeschooling\u2014you can read it in full here<\/a>.)<\/p>\n In 2005, Belfield conducted a study of homeschoolers\u2019 SAT scores, controlling for family background variables, and found that homeschoolers scored slightly better than predicted on the verbal section and slightly worse than predicted on the math section. A 2004 study of the ACT scores of 127 seniors at a diverse suburban public high school found that those who reported the highest level of parental involvement scored quite a bit above average and just as well as homeschoolers taking the ACT (before controlling for other background variables). A 2011 study (Martin-Chang, Gould, and Meuse) looked at 37 homeschoolers and 37 institutionally schooled children who were demographically paired. The study found that some of the homeschool students did better than their institutionally schooled peers while others did worse.<\/p>\n Volunteer-Based Studies<\/strong><\/p>\n And now we need to switch back to the other key topic here: The fact that studies of homeschoolers are drawn from volunteers or self-selecting groups. The last study I mentioned above, which found that some of the homeschoolers in its sample did better than those who attended institutional schools while others did worse, was not based on a random sample. It was composed of volunteers drawn from homeschool groups and mailing lists. This means that it is not actually representative of all homeschoolers\u2014after all, homeschool parents who are not putting in an effort to educate their children aren\u2019t going to participate in a study like that\u2014and homeschool parents not involved in homeschool groups and organizations would not even hear of it. To put it another way, using volunteers for a study like this almost certainly selects for dedicated and involved parents.<\/p>\n Even the SAT study where homeschoolers, when background factors were controlled for, did better on the verbal and worse on the math suffers from this problem: It naturally selects for college-bound homeschool students. What about those who are not college bound? It\u2019s interesting to note that that very study found that while homeschoolers made up 1.5% of students, they only made up 0.5% of those taking the SAT. Where were the rest of the homeschoolers? It\u2019s possible that some homeschoolers who use correspondence programs or umbrella schools put down that they were actually private school students, so the discrepancy alone is not proof that homeschoolers are less likely to take the SAT (and thus to be college bound) than are public or private school students, but it does point out just how much we don\u2019t know about those homeschoolers who aren\u2019t<\/em> college bound. (It\u2019s worth mentioning here that some organizations popular among many Christian homeschoolers, including No Greater Joy, Vision Forum, and Advanced Training Institute, explicitly advise parents against sending their children to college.)<\/p>\n Beside the basic information provided by the National Center for Education Statistics (which does not touch on academic performance and can be found here<\/a> and here<\/a>), the only thing we have that uses a random sample is the Cardus Education Survey (for a good summary, see this article<\/a>). The Cardus survey examines different methods of religious education, comparing young adults who grew up in religious homechool families (in this case, those who were homeschooled by mothers who attended church regularly) with young adults who attended Christian schools. The survey found that the homeschooled students did worse on their SATs and were considerably less ready for college than the Christian school students. The study also found that homeschoolers scored below average on a number of quality of life measures. Of course, this survey only looked at homeschoolers with religious mothers, not at all homeschoolers, and it looked at individuals who were adults in 2011, meaning that it isn\u2019t necessarily predictive of how current homechoolers will turn out. Still, it\u2019s enough to suggest that there may be more to the story than the rosy picture painted by HSLDA and other homeschool advocacy groups.<\/p>\n