{"id":174448,"date":"2022-02-05T00:00:00","date_gmt":"2022-02-05T00:00:00","guid":{"rendered":"https:\/\/ceotudent.com\/?p=174448"},"modified":"2026-08-23T11:30:00","modified_gmt":"2026-08-23T08:30:00","slug":"a-social-experiment-with-surprising-results-sesame-street","status":"publish","type":"post","link":"https:\/\/ceotudent.com\/en\/a-social-experiment-with-surprising-results-sesame-street","title":{"rendered":"Sesame Street: The Largest Learning Experiment in History and What Economists Measured Fifty Years Later"},"content":{"rendered":"<p><strong>TL;DR:<\/strong> By design, Sesame Street was less an entertainment programme than a learning experiment. The production team and education researchers worked inside the same process, episodes were measured on children before they aired, and the results changed the next episode. That loop was later named the CTW model, and the programme&rsquo;s first two seasons were separately evaluated by an independent body, the Educational Testing Service. The strongest evidence for the experiment, however, arrived fifty years later from an unexpected direction. A study by Melissa Kearney and Phillip Levine, published in the American Economic Journal: Applied Economics in January 2019, used a technical accident that made the 1969 broadcast receivable in some areas and not others, the difference between UHF and VHF transmission, as a natural experiment. In areas where the signal reached, preschool-age children were 16 percent less likely to fall behind grade level in elementary and middle school. The effect was strongest among boys and among children in economically disadvantaged areas. The same study states plainly that its estimates for long-term educational and labour market outcomes are imprecise. Below: the design of the experiment, a table of verified findings, and an original map of lessons for anyone building their own learning system.<\/p>\n<p>It seems odd for a children&rsquo;s programme to be among the most heavily researched productions ever made. For Sesame Street it is not odd. It was the design.<\/p>\n<p>When the programme was being prepared in the late 1960s, the team was deliberately split in two. On one side were experienced television producers. On the other were sociologists, pedagogues, psychologists and researchers who studied learning. Having those two groups work inside the same production process was unusual for the period, and it was the programme&rsquo;s real innovation.<\/p>\n<p>The purpose behind the project was not entertainment either. Children from families without economic means could not access preschool education and were therefore starting school behind. Sesame Street was an attempt to close that gap with a broadcast signal.<\/p>\n<div id=\"ez-toc-container\" class=\"ez-toc-v2_0_84 counter-hierarchy ez-toc-counter ez-toc-grey ez-toc-container-direction\">\n<div class=\"ez-toc-title-container\">\n<p class=\"ez-toc-title\" style=\"cursor:inherit\">Table of Contents<\/p>\n<span class=\"ez-toc-title-toggle\"><a href=\"#\" class=\"ez-toc-pull-right ez-toc-btn ez-toc-btn-xs ez-toc-btn-default ez-toc-toggle\" aria-label=\"Toggle Table of Content\"><span class=\"ez-toc-js-icon-con\"><span class=\"\"><span class=\"eztoc-hide\" style=\"display:none;\">Toggle<\/span><span class=\"ez-toc-icon-toggle-span\"><svg style=\"fill: #999;color:#999\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"list-377408\" width=\"20px\" height=\"20px\" viewBox=\"0 0 24 24\" fill=\"none\"><path d=\"M6 6H4v2h2V6zm14 0H8v2h12V6zM4 11h2v2H4v-2zm16 0H8v2h12v-2zM4 16h2v2H4v-2zm16 0H8v2h12v-2z\" fill=\"currentColor\"><\/path><\/svg><svg style=\"fill: #999;color:#999\" class=\"arrow-unsorted-368013\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"10px\" height=\"10px\" viewBox=\"0 0 24 24\" version=\"1.2\" baseProfile=\"tiny\"><path d=\"M18.2 9.3l-6.2-6.3-6.2 6.3c-.2.2-.3.4-.3.7s.1.5.3.7c.2.2.4.3.7.3h11c.3 0 .5-.1.7-.3.2-.2.3-.5.3-.7s-.1-.5-.3-.7zM5.8 14.7l6.2 6.3 6.2-6.3c.2-.2.3-.5.3-.7s-.1-.5-.3-.7c-.2-.2-.4-.3-.7-.3h-11c-.3 0-.5.1-.7.3-.2.2-.3.5-.3.7s.1.5.3.7z\"\/><\/svg><\/span><\/span><\/span><\/a><\/span><\/div>\n<nav><ul class='ez-toc-list ez-toc-list-level-1 ' ><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/ceotudent.com\/en\/a-social-experiment-with-surprising-results-sesame-street\/#The-real-design-a-loop-that-measured-and-changed\" >The real design: a loop that measured and changed<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-2\" href=\"https:\/\/ceotudent.com\/en\/a-social-experiment-with-surprising-results-sesame-street\/#The-evidence-that-arrived-fifty-years-later\" >The evidence that arrived fifty years later<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-3\" href=\"https:\/\/ceotudent.com\/en\/a-social-experiment-with-surprising-results-sesame-street\/#What-this-gives-someone-designing-their-own-learning-today\" >What this gives someone designing their own learning today<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-4\" href=\"https:\/\/ceotudent.com\/en\/a-social-experiment-with-surprising-results-sesame-street\/#The-CEO-and-student-read\" >The CEO and student read<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-5\" href=\"https:\/\/ceotudent.com\/en\/a-social-experiment-with-surprising-results-sesame-street\/#Frequently-asked-questions\" >Frequently asked questions<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-6\" href=\"https:\/\/ceotudent.com\/en\/a-social-experiment-with-surprising-results-sesame-street\/#Sources\" >Sources<\/a><\/li><\/ul><\/nav><\/div>\n<h2 id=\"the-real-design-a-loop-that-measured-and-changed\"><span class=\"ez-toc-section\" id=\"The-real-design-a-loop-that-measured-and-changed\"><\/span>The real design: a loop that measured and changed<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>The way of working that emerged by the end of the first season was later called the CTW model. It combined planning, production and evaluation in a single loop: researchers and early childhood educators worked in the same process as the writers and directors.<\/p>\n<p>That model had two legs, and it matters not to confuse them.<\/p>\n<p>The first was in-house formative research. Its purpose was to make the episode better. Researchers invented their own tools to measure how much attention young viewers gave the screen. If a scene did not hold attention, the scene changed.<\/p>\n<p>The second was independent summative evaluation. Its purpose was to judge from outside whether the programme worked at all. That job went to the Educational Testing Service for the first two seasons. The first-year evaluation prepared by Samuel Ball and Gerry Ann Bogatz was published in 1970; the second followed in 1971.<\/p>\n<p>That distinction is directly useful to anyone designing their own learning. Feedback that improves the material and measurement that judges whether the material worked are not the same thing, and both degrade when the same person does both.<\/p>\n<h2 id=\"the-evidence-that-arrived-fifty-years-later\"><span class=\"ez-toc-section\" id=\"The-evidence-that-arrived-fifty-years-later\"><\/span>The evidence that arrived fifty years later<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>The early evaluations were positive but could not answer one question: might the children who watched simply have come from different families? Was the observed difference caused by the programme, or by the characteristics of the families who tuned in?<\/p>\n<p>In 2019 two economists resolved that question using an accident nobody had planned.<\/p>\n<p>In 1969, Sesame Street could not be received at the same quality everywhere. In some areas the broadcast came over VHF; in others it came over UHF, which the televisions of the period received far worse. Signal quality varied by geography and technology, not by a family&rsquo;s income, education or interest. That was exactly the kind of natural experiment researchers want.<\/p>\n<p><strong>Table 1. Verified research findings on Sesame Street<\/strong><\/p>\n<table>\n<thead>\n<tr>\n<th>Finding<\/th>\n<th>Verified content<\/th>\n<th>Source<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>Method<\/td>\n<td>Geographic variation in reception arising from UHF versus VHF transmission, matched to Census data<\/td>\n<td>Kearney and Levine, AEJ: Applied Economics, volume 11, issue 1, January 2019, pages 318-350<\/td>\n<\/tr>\n<tr>\n<td>Main result<\/td>\n<td>School performance improved where the programme could be received, particularly for boys<\/td>\n<td>Same study<\/td>\n<\/tr>\n<tr>\n<td>Size of the effect<\/td>\n<td>A 16 percent reduction in the likelihood that children would fall behind in elementary and middle school<\/td>\n<td>Kearney, AEA research interview<\/td>\n<\/tr>\n<tr>\n<td>Honest caveat<\/td>\n<td>Point estimates for long-term educational and labour market outcomes are generally imprecise<\/td>\n<td>Kearney and Levine, article abstract<\/td>\n<\/tr>\n<tr>\n<td>Reach<\/td>\n<td>In any given week, half of two- to five-year-olds were watching the show<\/td>\n<td>Kearney, AEA research interview<\/td>\n<\/tr>\n<tr>\n<td>Reach in disadvantaged areas<\/td>\n<td>Nearly 90 percent of children were watching<\/td>\n<td>Kearney, AEA research interview<\/td>\n<\/tr>\n<tr>\n<td>Comparison<\/td>\n<td>Early evaluations found literacy and numeracy benefits on par with Head Start, though Head Start also provided comprehensive services beyond educational content<\/td>\n<td>Kearney, AEA research interview<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p>Do not skip the fourth row. The study itself says its estimates for long-term outcomes are imprecise. Sesame Street improved school readiness; a sentence like &ldquo;children who watched went on to earn more years later&rdquo; does not come out of this data. Not loading a finding with more than it can carry matters as much as the finding itself.<\/p>\n<p>The reach figures are striking in their own right. We are talking about a programme watched by nearly 90 percent of children in disadvantaged neighbourhoods. An educational intervention with reach that wide produces a large aggregate difference even with a modest individual effect. It is one of the cleanest illustrations available of the relationship between scale and effect size.<\/p>\n<h2 id=\"what-this-gives-someone-designing-their-own-learning-today\"><span class=\"ez-toc-section\" id=\"What-this-gives-someone-designing-their-own-learning-today\"><\/span>What this gives someone designing their own learning today<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>The table below is this piece&rsquo;s original contribution. On the left is the design principle from the experiment, on the right its translation to individual learning and the typical error that appears when the principle is violated.<\/p>\n<p><strong>Table 2. From the Sesame Street experiment to principles of individual learning (CEOtudent editorial framework)<\/strong><\/p>\n<table>\n<thead>\n<tr>\n<th>#<\/th>\n<th>Principle from the experiment<\/th>\n<th>Individual equivalent<\/th>\n<th>Error when violated<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>1<\/td>\n<td>Producers and researchers worked in the same process<\/td>\n<td>The learning plan and the measure of success are defined at the same moment<\/td>\n<td>Discovering what you learned much later, often never<\/td>\n<\/tr>\n<tr>\n<td>2<\/td>\n<td>Formative research was separated from summative evaluation<\/td>\n<td>Feedback that improves the material is kept apart from the test of whether it worked<\/td>\n<td>Mistaking practice for a test and overrating your own performance<\/td>\n<\/tr>\n<tr>\n<td>3<\/td>\n<td>Attention was measured and scenes changed accordingly<\/td>\n<td>Record where concentration breaks, and rebuild the working method around it<\/td>\n<td>Treating lost focus as a willpower problem and repeating the same method<\/td>\n<\/tr>\n<tr>\n<td>4<\/td>\n<td>Evaluation was contracted to an outside body<\/td>\n<td>What has been learned is tested against an external, independent standard<\/td>\n<td>Grading yourself and finding yourself sufficient<\/td>\n<\/tr>\n<tr>\n<td>5<\/td>\n<td>Reach came before effect<\/td>\n<td>Establish a sustainable repetition frequency before hunting for the perfect method<\/td>\n<td>Never starting while trying to build the flawless system<\/td>\n<\/tr>\n<tr>\n<td>6<\/td>\n<td>The target audience was those who needed it most<\/td>\n<td>Effort is directed at the weakest link, not the most enjoyable subject<\/td>\n<td>The false sense of progress from restudying what you already know<\/td>\n<\/tr>\n<tr>\n<td>7<\/td>\n<td>Results kept being measured for fifty years<\/td>\n<td>Results are re-checked at long intervals, not in a single test<\/td>\n<td>Mistaking short-term recall for durable learning<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p>Rows two and four should be read together. The most common error in learning is not failing to test yourself, but testing yourself with the wrong thing. Rereading a text and finding it familiar, then treating that familiarity as knowledge, is exactly the substitution of formative feedback for summative evaluation. The Sesame Street team separated the two institutionally; an individual can separate them by calendar.<\/p>\n<p>Row five draws the most resistance. Sesame Street&rsquo;s effect came less from the perfection of individual episodes than from reaching nearly every child. The individual equivalent: a mediocre session done five times a week beats a flawless session done once a month almost every time.<\/p>\n<h2 id=\"the-ceo-and-student-read\"><span class=\"ez-toc-section\" id=\"The-CEO-and-student-read\"><\/span>The CEO and student read<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>The CEO half is measurement discipline. What made Sesame Street distinctive was not the content but the fact that the content was measured and the measurement changed the production. For someone running themselves like a company, the question is not &ldquo;what am I learning&rdquo; but &ldquo;how do I measure what I learned, and what does the measurement change&rdquo;. A system that does not measure is a well-intentioned habit; a system that measures is a system that improves.<\/p>\n<p>The student half is honesty. The most important line in this piece is not the most impressive one: the study itself says the long-term estimates are imprecise. Not loading evidence with more than it can carry is the hardest and most valuable part of learning. If some questions remain open even in a programme measured for fifty years, it is worth reconsidering how much your three-week impression of your own progress can carry.<\/p>\n<h2 id=\"frequently-asked-questions\"><span class=\"ez-toc-section\" id=\"Frequently-asked-questions\"><\/span>Frequently asked questions<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><strong>Was Sesame Street really an experiment?<\/strong><br \/>\nNot a randomised experiment in the classic sense. But the production process rested on continuous measurement, and the 2019 study used the geographic distribution of the broadcast signal as a natural experiment. That is a design constructed after the fact, but methodologically strong.<\/p>\n<p><strong>What exactly does the 16 percent reduction refer to?<\/strong><br \/>\nIt refers to the reduction in the likelihood that preschool-age children in reception areas would fall behind the grade appropriate for their age in elementary and middle school. It is not a grade average or an intelligence measure; it is an indicator of falling behind at the grade level.<\/p>\n<p><strong>Did the programme raise income or educational attainment in the long run?<\/strong><br \/>\nThe study cannot show this clearly, and says so itself. Point estimates for long-term educational and labour market outcomes are imprecise. An effect on school readiness and an effect on lifetime outcomes are different claims.<\/p>\n<p><strong>Does this contradict current screen-time advice?<\/strong><br \/>\nThe finding here concerns a specific kind of educational content, designed through measurement with explicit learning objectives and age-appropriate structure, not screen time in general. Generalising it to all screen use draws a conclusion the data does not carry.<\/p>\n<p><strong>What is the most practical individual lesson from this experiment?<\/strong><br \/>\nRow two of Table 2: separate your practice from your test. If the material you learn with and the standard you test yourself against are the same, what you are measuring is familiarity, not learning.<\/p>\n<h2 id=\"sources\"><span class=\"ez-toc-section\" id=\"Sources\"><\/span>Sources<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>Melissa S. Kearney and Phillip B. Levine, Early Childhood Education by Television: Lessons from Sesame Street, American Economic Journal: Applied Economics, volume 11, issue 1, January 2019, pages 318-350.<\/p>\n<p>American Economic Association, Learning from Sesame Street, research interview with Melissa Kearney.<\/p>\n<p>Samuel Ball and Gerry Ann Bogatz, The First Year of Sesame Street: An Evaluation, Educational Testing Service program report, 1970.<\/p>\n<p>Gerry Ann Bogatz and Samuel Ball, The Second Year of Sesame Street: A Continuing Evaluation, Educational Testing Service, 1971.<\/p>\n<p>Children&rsquo;s Television Workshop, institutional documentation on formative research and the production model, 1970s.<\/p>\n<hr>\n<p><em>This content was compiled with the support of AI following in-depth research, then written and prepared for publication by the CEOtudent editorial team.<\/em><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Sesame Street was not a children&#8217;s programme so much as a controlled learning experiment: a method that put producers and education researchers around one table and put every episode through measurement. The most surprising result arrived fifty years later. Two economists used a technical accident of 1969 broadcasting to separate the regions where the programme could actually be received, and found that children in reception areas were 16 percent less likely to fall behind grade level at school. Below: the real design of the experiment, the verified findings, the honest caveats, and an original table of lessons for anyone designing their own learning today.<\/p>\n","protected":false},"author":1625,"featured_media":138056,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[17211],"tags":[],"class_list":["post-174448","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-life"],"_links":{"self":[{"href":"https:\/\/ceotudent.com\/en\/wp-json\/wp\/v2\/posts\/174448","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/ceotudent.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/ceotudent.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/ceotudent.com\/en\/wp-json\/wp\/v2\/users\/1625"}],"replies":[{"embeddable":true,"href":"https:\/\/ceotudent.com\/en\/wp-json\/wp\/v2\/comments?post=174448"}],"version-history":[{"count":0,"href":"https:\/\/ceotudent.com\/en\/wp-json\/wp\/v2\/posts\/174448\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/ceotudent.com\/en\/wp-json\/wp\/v2\/media\/138056"}],"wp:attachment":[{"href":"https:\/\/ceotudent.com\/en\/wp-json\/wp\/v2\/media?parent=174448"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/ceotudent.com\/en\/wp-json\/wp\/v2\/categories?post=174448"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/ceotudent.com\/en\/wp-json\/wp\/v2\/tags?post=174448"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}