{"id":54,"date":"2023-01-19T17:09:47","date_gmt":"2023-01-19T17:09:47","guid":{"rendered":"https:\/\/content.one.lumenlearning.com\/introductiontopsychology\/chapter\/2-6-1-learn-it\/"},"modified":"2025-11-03T21:33:12","modified_gmt":"2025-11-03T21:33:12","slug":"2-6-1-learn-it","status":"publish","type":"chapter","link":"https:\/\/content.one.lumenlearning.com\/introductiontopsychology\/chapter\/2-6-1-learn-it\/","title":{"raw":"The Replication Crisis: Learn It 1\u2014Examining Psychological Research","rendered":"The Replication Crisis: Learn It 1\u2014Examining Psychological Research"},"content":{"raw":"<section class=\"textbox learningGoals\">\r\n<ul>\r\n\t<li>Examine the McCabe and Castel study<\/li>\r\n\t<li>Explain the replication crisis<\/li>\r\n<\/ul>\r\n<\/section>\r\n<h2>Examining Psychological Research<\/h2>\r\n<p>Let's practice our research skills by looking at an example of some research. First, read an excerpt from this article and think about the claims made by the research:<\/p>\r\n<section class=\"textbox example\">\r\n<h3>Watching TV is Related to Math Ability<\/h3>\r\n\r\n[caption id=\"attachment_4747\" align=\"alignleft\" width=\"240\"]<a href=\"https:\/\/s3-us-west-2.amazonaws.com\/courses-images\/wp-content\/uploads\/sites\/855\/2017\/07\/03123719\/Screen-Shot-2017-08-03-at-7.32.47-AM1.png\"><img class=\"wp-image-4747 size-medium\" src=\"https:\/\/s3-us-west-2.amazonaws.com\/courses-images\/wp-content\/uploads\/sites\/855\/2017\/07\/03123719\/Screen-Shot-2017-08-03-at-7.32.47-AM1-240x300.png\" alt=\"Two images of brain fMRI scans. The top image shows red areas of activation in three different regions on the back of the head, and he bottom scan shows activation in two similar areas. A bar showing the intensity of the activation from red (2) to yellow (10) is shown next to the brain scans.\" width=\"240\" height=\"300\" \/><\/a> Figure 1.[\/caption]\r\n\r\n<p>Researchers Ian McAtee and Leo Geraci at Harvard University did some research to examine if TV watching might have beneficial effects on cognition. The approach was fairly simple. Children between the ages of 12-14 were either asked to watch a television sitcom or do arithmetic problems, and while they were doing these activities, images of their brains were recorded using fMRI (functional magnetic resonance imaging). This technique measures the flow of blood to specific parts of the brain during performance, allowing scientists to create images of the areas that are activated during cognition.<\/p>\r\n<p>Results revealed that similar areas of the parietal lobes were active during TV watching (the red area of the brain image on the top in Figure 1) and during arithmetic problem-solving (the red area of the brain image on the bottom). This area of the brain has been implicated in other research as being important for abstract thought, suggesting that both TV watching and arithmetic processing may have beneficial effects on cognition.<\/p>\r\n<p>\"We were somewhat surprised that TV watching would activate brain areas involved in higher-order thought processes because TV watching is typically considered a passive activity,\" said McAtee. Added Geraci, \"The next step is to see what specific content on the TV show led to the pattern of activation that mimicked math performance, so we need to better understand that aspect of the data. We also need to compare TV watching to other types of cognitive skills, like reading comprehension and writing.\"<\/p>\r\n<\/section>\r\n<p>Okay, let's pause here. Would you say that the article above was well-written? Do you think the title, \u201cWatching TV is Related to Math Ability\u201d was a good description of the results? Do you think the scientific argument makes sense?<\/p>\r\n<p>It would be pretty surprising to learn that watching television can improve your math ability...<\/p>\r\n<p>But can it?<\/p>\r\n<h2>Surprise!<\/h2>\r\n<p>The article you just read was <em>not<\/em> an account of real research. Ian McAtee and Leo Geraci are not real people, and the study discussed was never conducted. The article was written by psychologists David McCabe and Alan Castel for a study they published in 2008.[footnote]David P. McCabe &amp; Alan D. Castel (2008). Seeing is believing: The effect of brain images on judgments of scientific reasoning. <em>Cognition<\/em>, 107, 343-352.[\/footnote] They asked people to do exactly what you just did: read this article and two others and rate them.<\/p>\r\n<p>McCabe and Castel wondered if people\u2019s biases about science influence the way they judge the information they read. In other words, if what you are reading <em>looks<\/em> more scientific, do you assume it is better science? Did you notice the pictures of the brain next to the article that you just read? Do you think that picture had any influence on your evaluation of\u00a0the scientific quality of the article? The brain pictures actually added no new information that was not already in the article itself other than showing you exactly where in the brain the relevant part of the parietal lobe is located. The red marks are in the same locations in both brain pictures, but we already knew that \u201cResults revealed that similar areas in the parietal lobes were active during TV watching\u2026and during arithmetic solving.\u201d<\/p>\r\n<h2>McCabe &amp; Castel Experiment<\/h2>\r\n<p>McCabe and Castel wrote three short, fake, scientific articles that appeared to be typical reports like those you might find in a textbook or news source, all with brain activity as part of the story. In addition to the one you read (\u201cWatching TV is related to math ability \u201c) others had these titles:<\/p>\r\n<ul>\r\n\t<li>\u201cMeditation enhances creative thought\u201d<\/li>\r\n\t<li>\u201cPlaying video games benefits attention.\u201d<\/li>\r\n<\/ul>\r\n<p>All of the articles had flawed scientific reasoning.<\/p>\r\n<p>In the \u201cWatching TV is Related to Math Ability\u201d article that you read, the only \u201cresult\u201d that is reported is that a particular brain area (a part of the parietal lobe) is active when a person is watching TV and when they are working on math. The highlighted part of the next sentence is where the article goes too far: \u201cThis area of the brain has been implicated in other research as being important for abstract thought,<strong> suggesting that both TV watching and arithmetic processing may have beneficial effects on cognition<\/strong>.\u201d<\/p>\r\n<p>The fact that the same area of the brain is active for two different activities does <em>not<\/em> \u201csuggest\u201d that either one is beneficial or that there is any interesting similarity in mental or brain activity between the processes. The final part of the article goes on and on about how this supposedly surprising finding is intriguing and deserves extensive exploration. This is a classic case of \"correlation is not causation.\"<\/p>\r\n<p>McCabe and Castel hypothesized that seeing a brain image next to a poorly-written academic article would increase its legitimacy and make people think it made a more convincing argument.<\/p>","rendered":"<section class=\"textbox learningGoals\">\n<ul>\n<li>Examine the McCabe and Castel study<\/li>\n<li>Explain the replication crisis<\/li>\n<\/ul>\n<\/section>\n<h2>Examining Psychological Research<\/h2>\n<p>Let&#8217;s practice our research skills by looking at an example of some research. First, read an excerpt from this article and think about the claims made by the research:<\/p>\n<section class=\"textbox example\">\n<h3>Watching TV is Related to Math Ability<\/h3>\n<figure id=\"attachment_4747\" aria-describedby=\"caption-attachment-4747\" style=\"width: 240px\" class=\"wp-caption alignleft\"><a href=\"https:\/\/s3-us-west-2.amazonaws.com\/courses-images\/wp-content\/uploads\/sites\/855\/2017\/07\/03123719\/Screen-Shot-2017-08-03-at-7.32.47-AM1.png\"><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-4747 size-medium\" src=\"https:\/\/s3-us-west-2.amazonaws.com\/courses-images\/wp-content\/uploads\/sites\/855\/2017\/07\/03123719\/Screen-Shot-2017-08-03-at-7.32.47-AM1-240x300.png\" alt=\"Two images of brain fMRI scans. The top image shows red areas of activation in three different regions on the back of the head, and he bottom scan shows activation in two similar areas. A bar showing the intensity of the activation from red (2) to yellow (10) is shown next to the brain scans.\" width=\"240\" height=\"300\" \/><\/a><figcaption id=\"caption-attachment-4747\" class=\"wp-caption-text\">Figure 1.<\/figcaption><\/figure>\n<p>Researchers Ian McAtee and Leo Geraci at Harvard University did some research to examine if TV watching might have beneficial effects on cognition. The approach was fairly simple. Children between the ages of 12-14 were either asked to watch a television sitcom or do arithmetic problems, and while they were doing these activities, images of their brains were recorded using fMRI (functional magnetic resonance imaging). This technique measures the flow of blood to specific parts of the brain during performance, allowing scientists to create images of the areas that are activated during cognition.<\/p>\n<p>Results revealed that similar areas of the parietal lobes were active during TV watching (the red area of the brain image on the top in Figure 1) and during arithmetic problem-solving (the red area of the brain image on the bottom). This area of the brain has been implicated in other research as being important for abstract thought, suggesting that both TV watching and arithmetic processing may have beneficial effects on cognition.<\/p>\n<p>&#8220;We were somewhat surprised that TV watching would activate brain areas involved in higher-order thought processes because TV watching is typically considered a passive activity,&#8221; said McAtee. Added Geraci, &#8220;The next step is to see what specific content on the TV show led to the pattern of activation that mimicked math performance, so we need to better understand that aspect of the data. We also need to compare TV watching to other types of cognitive skills, like reading comprehension and writing.&#8221;<\/p>\n<\/section>\n<p>Okay, let&#8217;s pause here. Would you say that the article above was well-written? Do you think the title, \u201cWatching TV is Related to Math Ability\u201d was a good description of the results? Do you think the scientific argument makes sense?<\/p>\n<p>It would be pretty surprising to learn that watching television can improve your math ability&#8230;<\/p>\n<p>But can it?<\/p>\n<h2>Surprise!<\/h2>\n<p>The article you just read was <em>not<\/em> an account of real research. Ian McAtee and Leo Geraci are not real people, and the study discussed was never conducted. The article was written by psychologists David McCabe and Alan Castel for a study they published in 2008.<a class=\"footnote\" title=\"David P. McCabe &amp; Alan D. Castel (2008). Seeing is believing: The effect of brain images on judgments of scientific reasoning. Cognition, 107, 343-352.\" id=\"return-footnote-54-1\" href=\"#footnote-54-1\" aria-label=\"Footnote 1\"><sup class=\"footnote\">[1]<\/sup><\/a> They asked people to do exactly what you just did: read this article and two others and rate them.<\/p>\n<p>McCabe and Castel wondered if people\u2019s biases about science influence the way they judge the information they read. In other words, if what you are reading <em>looks<\/em> more scientific, do you assume it is better science? Did you notice the pictures of the brain next to the article that you just read? Do you think that picture had any influence on your evaluation of\u00a0the scientific quality of the article? The brain pictures actually added no new information that was not already in the article itself other than showing you exactly where in the brain the relevant part of the parietal lobe is located. The red marks are in the same locations in both brain pictures, but we already knew that \u201cResults revealed that similar areas in the parietal lobes were active during TV watching\u2026and during arithmetic solving.\u201d<\/p>\n<h2>McCabe &amp; Castel Experiment<\/h2>\n<p>McCabe and Castel wrote three short, fake, scientific articles that appeared to be typical reports like those you might find in a textbook or news source, all with brain activity as part of the story. In addition to the one you read (\u201cWatching TV is related to math ability \u201c) others had these titles:<\/p>\n<ul>\n<li>\u201cMeditation enhances creative thought\u201d<\/li>\n<li>\u201cPlaying video games benefits attention.\u201d<\/li>\n<\/ul>\n<p>All of the articles had flawed scientific reasoning.<\/p>\n<p>In the \u201cWatching TV is Related to Math Ability\u201d article that you read, the only \u201cresult\u201d that is reported is that a particular brain area (a part of the parietal lobe) is active when a person is watching TV and when they are working on math. The highlighted part of the next sentence is where the article goes too far: \u201cThis area of the brain has been implicated in other research as being important for abstract thought,<strong> suggesting that both TV watching and arithmetic processing may have beneficial effects on cognition<\/strong>.\u201d<\/p>\n<p>The fact that the same area of the brain is active for two different activities does <em>not<\/em> \u201csuggest\u201d that either one is beneficial or that there is any interesting similarity in mental or brain activity between the processes. The final part of the article goes on and on about how this supposedly surprising finding is intriguing and deserves extensive exploration. This is a classic case of &#8220;correlation is not causation.&#8221;<\/p>\n<p>McCabe and Castel hypothesized that seeing a brain image next to a poorly-written academic article would increase its legitimacy and make people think it made a more convincing argument.<\/p>\n<hr class=\"before-footnotes clear\" \/><div class=\"footnotes\"><ol><li id=\"footnote-54-1\">David P. McCabe &amp; Alan D. Castel (2008). Seeing is believing: The effect of brain images on judgments of scientific reasoning. <em>Cognition<\/em>, 107, 343-352. <a href=\"#return-footnote-54-1\" class=\"return-footnote\" aria-label=\"Return to footnote 1\">&crarr;<\/a><\/li><\/ol><\/div>","protected":false},"author":20,"menu_order":30,"template":"","meta":{"_candela_citation":"[{\"type\":\"cc\",\"description\":\"Psych in Real Life-Brain Imaging and Messy Science\",\"author\":\"Patrick Carroll for Lumen Learning\",\"organization\":\"Lumen Learning\",\"url\":\"\",\"project\":\"\",\"license\":\"cc-by\",\"license_terms\":\"\"}]","pb_show_title":"on","pb_short_title":"","pb_subtitle":"","pb_authors":[],"pb_section_license":""},"chapter-type":[],"contributor":[],"license":[],"part":22,"module-header":"learn_it","content_attributions":[{"type":"cc","description":"Psych in Real Life-Brain Imaging and Messy Science","author":"Patrick Carroll for Lumen Learning","organization":"Lumen Learning","url":"","project":"","license":"cc-by","license_terms":""}],"internal_book_links":[],"video_content":null,"cc_video_embed_content":{"cc_scripts":"","media_targets":[]},"try_it_collection":null,"_links":{"self":[{"href":"https:\/\/content.one.lumenlearning.com\/introductiontopsychology\/wp-json\/pressbooks\/v2\/chapters\/54"}],"collection":[{"href":"https:\/\/content.one.lumenlearning.com\/introductiontopsychology\/wp-json\/pressbooks\/v2\/chapters"}],"about":[{"href":"https:\/\/content.one.lumenlearning.com\/introductiontopsychology\/wp-json\/wp\/v2\/types\/chapter"}],"author":[{"embeddable":true,"href":"https:\/\/content.one.lumenlearning.com\/introductiontopsychology\/wp-json\/wp\/v2\/users\/20"}],"version-history":[{"count":11,"href":"https:\/\/content.one.lumenlearning.com\/introductiontopsychology\/wp-json\/pressbooks\/v2\/chapters\/54\/revisions"}],"predecessor-version":[{"id":7061,"href":"https:\/\/content.one.lumenlearning.com\/introductiontopsychology\/wp-json\/pressbooks\/v2\/chapters\/54\/revisions\/7061"}],"part":[{"href":"https:\/\/content.one.lumenlearning.com\/introductiontopsychology\/wp-json\/pressbooks\/v2\/parts\/22"}],"metadata":[{"href":"https:\/\/content.one.lumenlearning.com\/introductiontopsychology\/wp-json\/pressbooks\/v2\/chapters\/54\/metadata\/"}],"wp:attachment":[{"href":"https:\/\/content.one.lumenlearning.com\/introductiontopsychology\/wp-json\/wp\/v2\/media?parent=54"}],"wp:term":[{"taxonomy":"chapter-type","embeddable":true,"href":"https:\/\/content.one.lumenlearning.com\/introductiontopsychology\/wp-json\/pressbooks\/v2\/chapter-type?post=54"},{"taxonomy":"contributor","embeddable":true,"href":"https:\/\/content.one.lumenlearning.com\/introductiontopsychology\/wp-json\/wp\/v2\/contributor?post=54"},{"taxonomy":"license","embeddable":true,"href":"https:\/\/content.one.lumenlearning.com\/introductiontopsychology\/wp-json\/wp\/v2\/license?post=54"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}