{"id":50,"date":"2023-01-19T17:09:46","date_gmt":"2023-01-19T17:09:46","guid":{"rendered":"https:\/\/content.one.lumenlearning.com\/introductiontopsychology\/chapter\/learn-it-reliability-and-validity\/"},"modified":"2025-10-31T17:56:32","modified_gmt":"2025-10-31T17:56:32","slug":"learn-it-reliability-and-validity","status":"publish","type":"chapter","link":"https:\/\/content.one.lumenlearning.com\/introductiontopsychology\/chapter\/learn-it-reliability-and-validity\/","title":{"raw":"Statistical Thinking: Learn It 3\u2014Reliability and Validity","rendered":"Statistical Thinking: Learn It 3\u2014Reliability and Validity"},"content":{"raw":"<h2>Reliability and Validity<\/h2>\r\n<p>Reliability and validity are two important considerations that must be made with any type of data collection.<\/p>\r\n<section class=\"textbox keyTakeaway\">\r\n<h3>reliability<\/h3>\r\n<p><strong>Reliability<\/strong> refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways. There are a number of different types of reliability. Some of these include:<\/p>\r\n<ul>\r\n\t<li><strong>inter-rater reliability: <\/strong>the degree to which two or more different observers agree on what has been observed<\/li>\r\n\t<li><strong>internal consistency:<\/strong> the degree to which different items on a survey that measure the same thing correlate with one another<\/li>\r\n\t<li><strong>test-retest reliability: <\/strong>the degree to which the outcomes of a particular measure remain consistent over multiple administrations<\/li>\r\n<\/ul>\r\n<\/section>\r\n<p>Unfortunately, being consistent in measurement does not necessarily mean that you have measured something correctly. To illustrate this concept, consider a kitchen scale that would be used to measure the weight of cereal that you eat in the morning. If the scale is not properly calibrated, it may consistently under- or overestimate the amount of cereal that\u2019s being measured. While the scale is highly reliable in producing consistent results (e.g., the same amount of cereal poured onto the scale produces the same reading each time), those results are incorrect. This is where validity comes into play.<\/p>\r\n<section class=\"textbox keyTakeaway\">\r\n<h3>validity<\/h3>\r\n<p><strong>Validity<\/strong> refers to the extent to which a given instrument or tool accurately measures what it\u2019s supposed to measure, and once again, there are a number of ways in which validity can be expressed. A few types of validity that researchers consider are below (though there are lots more!):<\/p>\r\n<ul>\r\n\t<li><span style=\"font-size: 1rem; orphans: 1; text-align: initial; background-color: initial; word-spacing: normal;\">criterion validity: the degree to which the results actually measure the outcome they were designed to measure (results are often compared with other outcomes)<\/span><\/li>\r\n\t<li><span style=\"font-size: 1rem; orphans: 1; text-align: initial; background-color: initial; word-spacing: normal;\"> ecological validity: the degree to which research results generalize to real-world applications (for example, was the setting of the experiment close enough to the real-world setting?)<\/span><\/li>\r\n<\/ul>\r\n<\/section>\r\n<p><span style=\"font-size: 1rem; orphans: 1; text-align: initial; background-color: initial; word-spacing: normal;\">While any valid measure is by necessity reliable, the reverse is not necessarily true. Researchers strive to use instruments that are both highly reliable and valid.<\/span><\/p>\r\n<section class=\"textbox interact\"><iframe src=\"https:\/\/lumenlearning.h5p.com\/content\/1290477372809028568\/embed\" width=\"1088\" height=\"637\" frameborder=\"0\" allowfullscreen=\"allowfullscreen\" aria-label=\"Psych - Reliability and Validity\"><\/iframe><\/section>\r\n<section data-depth=\"1\">\r\n<section class=\"textbox tryIt\">[ohm2_question height=\"1000\"]3430[\/ohm2_question]<\/section>\r\n<\/section>","rendered":"<h2>Reliability and Validity<\/h2>\n<p>Reliability and validity are two important considerations that must be made with any type of data collection.<\/p>\n<section class=\"textbox keyTakeaway\">\n<h3>reliability<\/h3>\n<p><strong>Reliability<\/strong> refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways. There are a number of different types of reliability. Some of these include:<\/p>\n<ul>\n<li><strong>inter-rater reliability: <\/strong>the degree to which two or more different observers agree on what has been observed<\/li>\n<li><strong>internal consistency:<\/strong> the degree to which different items on a survey that measure the same thing correlate with one another<\/li>\n<li><strong>test-retest reliability: <\/strong>the degree to which the outcomes of a particular measure remain consistent over multiple administrations<\/li>\n<\/ul>\n<\/section>\n<p>Unfortunately, being consistent in measurement does not necessarily mean that you have measured something correctly. To illustrate this concept, consider a kitchen scale that would be used to measure the weight of cereal that you eat in the morning. If the scale is not properly calibrated, it may consistently under- or overestimate the amount of cereal that\u2019s being measured. While the scale is highly reliable in producing consistent results (e.g., the same amount of cereal poured onto the scale produces the same reading each time), those results are incorrect. This is where validity comes into play.<\/p>\n<section class=\"textbox keyTakeaway\">\n<h3>validity<\/h3>\n<p><strong>Validity<\/strong> refers to the extent to which a given instrument or tool accurately measures what it\u2019s supposed to measure, and once again, there are a number of ways in which validity can be expressed. A few types of validity that researchers consider are below (though there are lots more!):<\/p>\n<ul>\n<li><span style=\"font-size: 1rem; orphans: 1; text-align: initial; background-color: initial; word-spacing: normal;\">criterion validity: the degree to which the results actually measure the outcome they were designed to measure (results are often compared with other outcomes)<\/span><\/li>\n<li><span style=\"font-size: 1rem; orphans: 1; text-align: initial; background-color: initial; word-spacing: normal;\"> ecological validity: the degree to which research results generalize to real-world applications (for example, was the setting of the experiment close enough to the real-world setting?)<\/span><\/li>\n<\/ul>\n<\/section>\n<p><span style=\"font-size: 1rem; orphans: 1; text-align: initial; background-color: initial; word-spacing: normal;\">While any valid measure is by necessity reliable, the reverse is not necessarily true. Researchers strive to use instruments that are both highly reliable and valid.<\/span><\/p>\n<section class=\"textbox interact\"><iframe loading=\"lazy\" src=\"https:\/\/lumenlearning.h5p.com\/content\/1290477372809028568\/embed\" width=\"1088\" height=\"637\" frameborder=\"0\" allowfullscreen=\"allowfullscreen\" aria-label=\"Psych - Reliability and Validity\"><\/iframe><\/section>\n<section data-depth=\"1\">\n<section class=\"textbox tryIt\"><iframe loading=\"lazy\" id=\"ohm3430\" class=\"resizable\" src=\"https:\/\/ohm.one.lumenlearning.com\/multiembedq.php?id=3430&theme=lumen&iframe_resize_id=ohm3430&source=tnh&show_question_numbers\" width=\"100%\" height=\"1000\"><\/iframe><\/section>\n<\/section>\n","protected":false},"author":20,"menu_order":26,"template":"","meta":{"_candela_citation":"[{\"type\":\"cc\",\"description\":\"Analyzing Findings\",\"author\":\"\",\"organization\":\"OpenStax\",\"url\":\"https:\/\/openstax.org\/books\/psychology-2e\/pages\/2-3-analyzing-findings\",\"project\":\"\",\"license\":\"cc-by\",\"license_terms\":\"Access for free at https:\/\/openstax.org\/books\/psychology-2e\/pages\/1-introduction\"}]","pb_show_title":"on","pb_short_title":"","pb_subtitle":"","pb_authors":[],"pb_section_license":""},"chapter-type":[],"contributor":[],"license":[],"part":22,"module-header":"learn_it","content_attributions":[{"type":"cc","description":"Analyzing Findings","author":"","organization":"OpenStax","url":"https:\/\/openstax.org\/books\/psychology-2e\/pages\/2-3-analyzing-findings","project":"","license":"cc-by","license_terms":"Access for free at https:\/\/openstax.org\/books\/psychology-2e\/pages\/1-introduction"}],"internal_book_links":[],"video_content":null,"cc_video_embed_content":{"cc_scripts":"","media_targets":[]},"try_it_collection":null,"_links":{"self":[{"href":"https:\/\/content.one.lumenlearning.com\/introductiontopsychology\/wp-json\/pressbooks\/v2\/chapters\/50"}],"collection":[{"href":"https:\/\/content.one.lumenlearning.com\/introductiontopsychology\/wp-json\/pressbooks\/v2\/chapters"}],"about":[{"href":"https:\/\/content.one.lumenlearning.com\/introductiontopsychology\/wp-json\/wp\/v2\/types\/chapter"}],"author":[{"embeddable":true,"href":"https:\/\/content.one.lumenlearning.com\/introductiontopsychology\/wp-json\/wp\/v2\/users\/20"}],"version-history":[{"count":11,"href":"https:\/\/content.one.lumenlearning.com\/introductiontopsychology\/wp-json\/pressbooks\/v2\/chapters\/50\/revisions"}],"predecessor-version":[{"id":7056,"href":"https:\/\/content.one.lumenlearning.com\/introductiontopsychology\/wp-json\/pressbooks\/v2\/chapters\/50\/revisions\/7056"}],"part":[{"href":"https:\/\/content.one.lumenlearning.com\/introductiontopsychology\/wp-json\/pressbooks\/v2\/parts\/22"}],"metadata":[{"href":"https:\/\/content.one.lumenlearning.com\/introductiontopsychology\/wp-json\/pressbooks\/v2\/chapters\/50\/metadata\/"}],"wp:attachment":[{"href":"https:\/\/content.one.lumenlearning.com\/introductiontopsychology\/wp-json\/wp\/v2\/media?parent=50"}],"wp:term":[{"taxonomy":"chapter-type","embeddable":true,"href":"https:\/\/content.one.lumenlearning.com\/introductiontopsychology\/wp-json\/pressbooks\/v2\/chapter-type?post=50"},{"taxonomy":"contributor","embeddable":true,"href":"https:\/\/content.one.lumenlearning.com\/introductiontopsychology\/wp-json\/wp\/v2\/contributor?post=50"},{"taxonomy":"license","embeddable":true,"href":"https:\/\/content.one.lumenlearning.com\/introductiontopsychology\/wp-json\/wp\/v2\/license?post=50"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}