{"id":1842,"date":"2023-04-14T15:08:06","date_gmt":"2023-04-14T15:08:06","guid":{"rendered":"https:\/\/content.one.lumenlearning.com\/quantitativereasoning\/?post_type=chapter&#038;p=1842"},"modified":"2024-10-18T20:54:41","modified_gmt":"2024-10-18T20:54:41","slug":"sampling-and-experimentation-learn-it-4","status":"web-only","type":"chapter","link":"https:\/\/content.one.lumenlearning.com\/quantitativereasoning\/chapter\/sampling-and-experimentation-learn-it-4\/","title":{"raw":"Sampling and Experimentation: Learn It 4","rendered":"Sampling and Experimentation: Learn It 4"},"content":{"raw":"<h2>Sources of Bias<\/h2>\r\n<p>There are number of ways that a study can be ruined before you even start collecting data. The first we have already explored \u2013 <strong>sampling <\/strong>or<strong> selection bias<\/strong>, which is when the sample is not representative of the population. Another example of this is <strong>voluntary response bias<\/strong>, which is bias introduced by only collecting data from those who volunteer to participate. But these are not the only potential sources of bias.<\/p>\r\n<section class=\"textbox keyTakeaway\">\r\n<div>\r\n<h3>sources of bias<\/h3>\r\n<ul>\r\n\t<li><strong>Sampling bias<\/strong> \u2013 when the sample is not representative of the population<\/li>\r\n\t<li><strong>Voluntary response bias<\/strong> \u2013 the sampling bias that often occurs when the sample is volunteers<\/li>\r\n\t<li><strong>Self-interest study<\/strong> \u2013 bias that can occur when the researchers have an interest in the outcome<\/li>\r\n\t<li><strong>Response bias<\/strong> \u2013 when the responder gives inaccurate responses for any reason<\/li>\r\n\t<li><strong>Perceived lack of anonymity<\/strong> \u2013 when the responder fears giving an honest answer might negatively affect them<\/li>\r\n\t<li><strong>Loaded questions<\/strong> \u2013 when the question wording influences the responses<\/li>\r\n\t<li><strong>Non-response bias<\/strong> \u2013 when people refusing to participate in the study can influence the validity of the outcome<\/li>\r\n\t<li><strong>Undercoverage<\/strong>\u00a0occurs when some groups of the population are left out of the sampling process.<\/li>\r\n<\/ul>\r\n<\/div>\r\n<\/section>\r\n<section class=\"textbox example\">Consider a recent study which found that chewing gum may raise math grades in teenagers.[footnote]Reuters. https:\/\/www.reuters.com\/article\/us-gum-learning\/chewing-gum-may-raise-math-grades-in-teens-idUSTRE53L79320090422 . Retrieved 4\/5\/2020[\/footnote] This study was funded by the Wrigley Science Institute, a branch of the Wrigley chewing gum company. Identify the type of sampling bias found in this example.<br \/>\r\n[reveal-answer q=\"561139\"]Show Solution[\/reveal-answer]<br \/>\r\n[hidden-answer a=\"561139\"]This is an example of a <strong>self-interest study<\/strong>; one in which the researchers have a vested interest in the outcome of the study. While this does not necessarily ensure that the study was biased, it certainly suggests that we should subject the study to extra scrutiny.[\/hidden-answer]\r\n\r\n<div>\r\n<hr \/>\r\n<p>A survey asks people \u201cwhen was the last time you visited your doctor?\u201d What type of sampling bias might this lead to?<br \/>\r\n[reveal-answer q=\"965739\"]Show Solution[\/reveal-answer]<br \/>\r\n[hidden-answer a=\"965739\"]<\/p>\r\n<div>\r\n<p>This might suffer from <strong>response bias<\/strong>, since many people might not remember exactly when they last saw a doctor and give inaccurate responses.<\/p>\r\n<\/div>\r\n<p>Sources of response bias may be innocent, such as bad memory, or as intentional as pressuring by the pollster. Consider, for example, how many voting initiative petitions people sign without even reading them.<\/p>\r\n<p>[\/hidden-answer]<\/p>\r\n<\/div>\r\n<hr \/>\r\n<p>A survey asks participants a question about their interactions with members of other races. Which sampling bias might occur for this survey strategy?<br \/>\r\n[reveal-answer q=\"610809\"]Show Solution[\/reveal-answer]<br \/>\r\n[hidden-answer a=\"610809\"]Here, a <strong>perceived lack of anonymity<\/strong> could influence the outcome. The respondent might not want to be perceived as racist even if they are, and give an untruthful answer.[\/hidden-answer]<\/p>\r\n<hr \/>\r\n<p>An employer puts out a survey asking their employees if they have a drug abuse problem and need treatment help. Which sampling bias may occur in this scenario?<br \/>\r\n[reveal-answer q=\"801450\"]Show Solution[\/reveal-answer]<br \/>\r\n[hidden-answer a=\"801450\"]Here, answering truthfully might have consequences; responses might not be accurate if the employees do not feel their responses are anonymous or fear retribution from their employer. This survey has the\u00a0potential for\u00a0<strong>perceived lack of anonymity<\/strong>.[\/hidden-answer]<\/p>\r\n<div>\r\n<hr \/>\r\n<p>A survey asks \u201cdo you support funding research of alternative energy sources to reduce our reliance on high-polluting fossil fuels?\u201d Which sampling bias may result from this survey?<br \/>\r\n[reveal-answer q=\"464953\"]Show Solution[\/reveal-answer]<br \/>\r\n[hidden-answer a=\"464953\"]<\/p>\r\n<div>\r\n<p>This is an example of a <strong>loaded <\/strong>or<strong> leading question<\/strong> \u2013 questions whose wording leads the respondent towards an answer.<\/p>\r\n<\/div>\r\n<p>Loaded questions can be used intentionally by pollsters with an agenda, or accidentally through poor question wording. Another concern is <strong>question order<\/strong>, where the order of questions changes the results. A psychology researcher provides an example:[footnote]Swartz, Norbert. http:\/\/www.umich.edu\/~newsinfo\/MT\/01\/Fal01\/mt6f01.html . Retrieved 3\/31\/2009[\/footnote]<\/p>\r\n<blockquote>\r\n<p>\u201cMy favorite finding is this: we did a study where we asked students, 'How satisfied are you with your life? How often do you have a date?' The two answers were not statistically related - you would conclude that there is no relationship between dating frequency and life satisfaction. But when we reversed the order and asked, 'How often do you have a date? How satisfied are you with your life?' the statistical relationship was a strong one. You would now conclude that there is nothing as important in a student's life as dating frequency.\u201d<\/p>\r\n<\/blockquote>\r\n<p>[\/hidden-answer]<\/p>\r\n<\/div>\r\n<hr \/>\r\n<p>A telephone poll asks the question \u201cDo you often have time to relax and read a book?\u201d, and [latex]50\\%[\/latex] of the people called refused to answer the survey. Which sampling bias is represented by this survey?<br \/>\r\n[reveal-answer q=\"782411\"]Show Solution[\/reveal-answer]<br \/>\r\n[hidden-answer a=\"782411\"]It is unlikely that the results will be representative of the entire population. This is an example of <strong>non-response bias<\/strong>, introduced by people refusing to participate in a study or dropping out of an experiment. When people refuse to participate, we can no longer be so certain that our sample is representative of the population.[\/hidden-answer]<\/p>\r\n<\/section>\r\n<section class=\"textbox tryIt\">[ohm2_question hide_question_numbers=1]689[\/ohm2_question]<\/section>\r\n<section class=\"textbox tryIt\">[ohm2_question hide_question_numbers=1]690[\/ohm2_question]<\/section>\r\n<section class=\"textbox tryIt\">[ohm2_question hide_question_numbers=1]6912[\/ohm2_question]<\/section>","rendered":"<h2>Sources of Bias<\/h2>\n<p>There are number of ways that a study can be ruined before you even start collecting data. The first we have already explored \u2013 <strong>sampling <\/strong>or<strong> selection bias<\/strong>, which is when the sample is not representative of the population. Another example of this is <strong>voluntary response bias<\/strong>, which is bias introduced by only collecting data from those who volunteer to participate. But these are not the only potential sources of bias.<\/p>\n<section class=\"textbox keyTakeaway\">\n<div>\n<h3>sources of bias<\/h3>\n<ul>\n<li><strong>Sampling bias<\/strong> \u2013 when the sample is not representative of the population<\/li>\n<li><strong>Voluntary response bias<\/strong> \u2013 the sampling bias that often occurs when the sample is volunteers<\/li>\n<li><strong>Self-interest study<\/strong> \u2013 bias that can occur when the researchers have an interest in the outcome<\/li>\n<li><strong>Response bias<\/strong> \u2013 when the responder gives inaccurate responses for any reason<\/li>\n<li><strong>Perceived lack of anonymity<\/strong> \u2013 when the responder fears giving an honest answer might negatively affect them<\/li>\n<li><strong>Loaded questions<\/strong> \u2013 when the question wording influences the responses<\/li>\n<li><strong>Non-response bias<\/strong> \u2013 when people refusing to participate in the study can influence the validity of the outcome<\/li>\n<li><strong>Undercoverage<\/strong>\u00a0occurs when some groups of the population are left out of the sampling process.<\/li>\n<\/ul>\n<\/div>\n<\/section>\n<section class=\"textbox example\">Consider a recent study which found that chewing gum may raise math grades in teenagers.<a class=\"footnote\" title=\"Reuters. https:\/\/www.reuters.com\/article\/us-gum-learning\/chewing-gum-may-raise-math-grades-in-teens-idUSTRE53L79320090422 . Retrieved 4\/5\/2020\" id=\"return-footnote-1842-1\" href=\"#footnote-1842-1\" aria-label=\"Footnote 1\"><sup class=\"footnote\">[1]<\/sup><\/a> This study was funded by the Wrigley Science Institute, a branch of the Wrigley chewing gum company. Identify the type of sampling bias found in this example.<\/p>\n<div class=\"qa-wrapper\" style=\"display: block\"><button class=\"show-answer show-answer-button collapsed\" data-target=\"q561139\">Show Solution<\/button><\/p>\n<div id=\"q561139\" class=\"hidden-answer\" style=\"display: none\">This is an example of a <strong>self-interest study<\/strong>; one in which the researchers have a vested interest in the outcome of the study. While this does not necessarily ensure that the study was biased, it certainly suggests that we should subject the study to extra scrutiny.<\/div>\n<\/div>\n<div>\n<hr \/>\n<p>A survey asks people \u201cwhen was the last time you visited your doctor?\u201d What type of sampling bias might this lead to?<\/p>\n<div class=\"qa-wrapper\" style=\"display: block\"><button class=\"show-answer show-answer-button collapsed\" data-target=\"q965739\">Show Solution<\/button><\/p>\n<div id=\"q965739\" class=\"hidden-answer\" style=\"display: none\">\n<div>\n<p>This might suffer from <strong>response bias<\/strong>, since many people might not remember exactly when they last saw a doctor and give inaccurate responses.<\/p>\n<\/div>\n<p>Sources of response bias may be innocent, such as bad memory, or as intentional as pressuring by the pollster. Consider, for example, how many voting initiative petitions people sign without even reading them.<\/p>\n<\/div>\n<\/div>\n<\/div>\n<hr \/>\n<p>A survey asks participants a question about their interactions with members of other races. Which sampling bias might occur for this survey strategy?<\/p>\n<div class=\"qa-wrapper\" style=\"display: block\"><button class=\"show-answer show-answer-button collapsed\" data-target=\"q610809\">Show Solution<\/button><\/p>\n<div id=\"q610809\" class=\"hidden-answer\" style=\"display: none\">Here, a <strong>perceived lack of anonymity<\/strong> could influence the outcome. The respondent might not want to be perceived as racist even if they are, and give an untruthful answer.<\/div>\n<\/div>\n<hr \/>\n<p>An employer puts out a survey asking their employees if they have a drug abuse problem and need treatment help. Which sampling bias may occur in this scenario?<\/p>\n<div class=\"qa-wrapper\" style=\"display: block\"><button class=\"show-answer show-answer-button collapsed\" data-target=\"q801450\">Show Solution<\/button><\/p>\n<div id=\"q801450\" class=\"hidden-answer\" style=\"display: none\">Here, answering truthfully might have consequences; responses might not be accurate if the employees do not feel their responses are anonymous or fear retribution from their employer. This survey has the\u00a0potential for\u00a0<strong>perceived lack of anonymity<\/strong>.<\/div>\n<\/div>\n<div>\n<hr \/>\n<p>A survey asks \u201cdo you support funding research of alternative energy sources to reduce our reliance on high-polluting fossil fuels?\u201d Which sampling bias may result from this survey?<\/p>\n<div class=\"qa-wrapper\" style=\"display: block\"><button class=\"show-answer show-answer-button collapsed\" data-target=\"q464953\">Show Solution<\/button><\/p>\n<div id=\"q464953\" class=\"hidden-answer\" style=\"display: none\">\n<div>\n<p>This is an example of a <strong>loaded <\/strong>or<strong> leading question<\/strong> \u2013 questions whose wording leads the respondent towards an answer.<\/p>\n<\/div>\n<p>Loaded questions can be used intentionally by pollsters with an agenda, or accidentally through poor question wording. Another concern is <strong>question order<\/strong>, where the order of questions changes the results. A psychology researcher provides an example:<a class=\"footnote\" title=\"Swartz, Norbert. http:\/\/www.umich.edu\/~newsinfo\/MT\/01\/Fal01\/mt6f01.html . Retrieved 3\/31\/2009\" id=\"return-footnote-1842-2\" href=\"#footnote-1842-2\" aria-label=\"Footnote 2\"><sup class=\"footnote\">[2]<\/sup><\/a><\/p>\n<blockquote>\n<p>\u201cMy favorite finding is this: we did a study where we asked students, &#8216;How satisfied are you with your life? How often do you have a date?&#8217; The two answers were not statistically related &#8211; you would conclude that there is no relationship between dating frequency and life satisfaction. But when we reversed the order and asked, &#8216;How often do you have a date? How satisfied are you with your life?&#8217; the statistical relationship was a strong one. You would now conclude that there is nothing as important in a student&#8217;s life as dating frequency.\u201d<\/p>\n<\/blockquote>\n<\/div>\n<\/div>\n<\/div>\n<hr \/>\n<p>A telephone poll asks the question \u201cDo you often have time to relax and read a book?\u201d, and [latex]50\\%[\/latex] of the people called refused to answer the survey. Which sampling bias is represented by this survey?<\/p>\n<div class=\"qa-wrapper\" style=\"display: block\"><button class=\"show-answer show-answer-button collapsed\" data-target=\"q782411\">Show Solution<\/button><\/p>\n<div id=\"q782411\" class=\"hidden-answer\" style=\"display: none\">It is unlikely that the results will be representative of the entire population. This is an example of <strong>non-response bias<\/strong>, introduced by people refusing to participate in a study or dropping out of an experiment. When people refuse to participate, we can no longer be so certain that our sample is representative of the population.<\/div>\n<\/div>\n<\/section>\n<section class=\"textbox tryIt\"><iframe loading=\"lazy\" id=\"ohm689\" class=\"resizable\" src=\"https:\/\/ohm.one.lumenlearning.com\/multiembedq.php?id=689&theme=lumen&iframe_resize_id=ohm689&source=tnh\" width=\"100%\" height=\"150\"><\/iframe><\/section>\n<section class=\"textbox tryIt\"><iframe loading=\"lazy\" id=\"ohm690\" class=\"resizable\" src=\"https:\/\/ohm.one.lumenlearning.com\/multiembedq.php?id=690&theme=lumen&iframe_resize_id=ohm690&source=tnh\" width=\"100%\" height=\"150\"><\/iframe><\/section>\n<section class=\"textbox tryIt\"><iframe loading=\"lazy\" id=\"ohm6912\" class=\"resizable\" src=\"https:\/\/ohm.one.lumenlearning.com\/multiembedq.php?id=6912&theme=lumen&iframe_resize_id=ohm6912&source=tnh\" width=\"100%\" height=\"150\"><\/iframe><\/section>\n<hr class=\"before-footnotes clear\" \/><div class=\"footnotes\"><ol><li id=\"footnote-1842-1\">Reuters. https:\/\/www.reuters.com\/article\/us-gum-learning\/chewing-gum-may-raise-math-grades-in-teens-idUSTRE53L79320090422 . Retrieved 4\/5\/2020 <a href=\"#return-footnote-1842-1\" class=\"return-footnote\" aria-label=\"Return to footnote 1\">&crarr;<\/a><\/li><li id=\"footnote-1842-2\">Swartz, Norbert. http:\/\/www.umich.edu\/~newsinfo\/MT\/01\/Fal01\/mt6f01.html . Retrieved 3\/31\/2009 <a href=\"#return-footnote-1842-2\" class=\"return-footnote\" aria-label=\"Return to footnote 2\">&crarr;<\/a><\/li><\/ol><\/div>","protected":false},"author":15,"menu_order":13,"template":"","meta":{"_candela_citation":"[]","pb_show_title":"on","pb_short_title":"","pb_subtitle":"","pb_authors":[],"pb_section_license":""},"chapter-type":[],"contributor":[],"license":[],"part":86,"module-header":"learn_it","content_attributions":[],"internal_book_links":[],"video_content":null,"cc_video_embed_content":{"cc_scripts":"","media_targets":[]},"try_it_collection":null,"_links":{"self":[{"href":"https:\/\/content.one.lumenlearning.com\/quantitativereasoning\/wp-json\/pressbooks\/v2\/chapters\/1842"}],"collection":[{"href":"https:\/\/content.one.lumenlearning.com\/quantitativereasoning\/wp-json\/pressbooks\/v2\/chapters"}],"about":[{"href":"https:\/\/content.one.lumenlearning.com\/quantitativereasoning\/wp-json\/wp\/v2\/types\/chapter"}],"author":[{"embeddable":true,"href":"https:\/\/content.one.lumenlearning.com\/quantitativereasoning\/wp-json\/wp\/v2\/users\/15"}],"version-history":[{"count":30,"href":"https:\/\/content.one.lumenlearning.com\/quantitativereasoning\/wp-json\/pressbooks\/v2\/chapters\/1842\/revisions"}],"predecessor-version":[{"id":14581,"href":"https:\/\/content.one.lumenlearning.com\/quantitativereasoning\/wp-json\/pressbooks\/v2\/chapters\/1842\/revisions\/14581"}],"part":[{"href":"https:\/\/content.one.lumenlearning.com\/quantitativereasoning\/wp-json\/pressbooks\/v2\/parts\/86"}],"metadata":[{"href":"https:\/\/content.one.lumenlearning.com\/quantitativereasoning\/wp-json\/pressbooks\/v2\/chapters\/1842\/metadata\/"}],"wp:attachment":[{"href":"https:\/\/content.one.lumenlearning.com\/quantitativereasoning\/wp-json\/wp\/v2\/media?parent=1842"}],"wp:term":[{"taxonomy":"chapter-type","embeddable":true,"href":"https:\/\/content.one.lumenlearning.com\/quantitativereasoning\/wp-json\/pressbooks\/v2\/chapter-type?post=1842"},{"taxonomy":"contributor","embeddable":true,"href":"https:\/\/content.one.lumenlearning.com\/quantitativereasoning\/wp-json\/wp\/v2\/contributor?post=1842"},{"taxonomy":"license","embeddable":true,"href":"https:\/\/content.one.lumenlearning.com\/quantitativereasoning\/wp-json\/wp\/v2\/license?post=1842"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}