{"id":1187,"date":"2023-03-31T17:37:31","date_gmt":"2023-03-31T17:37:31","guid":{"rendered":"https:\/\/content.one.lumenlearning.com\/introductiontopsychology\/chapter\/11-4-apply-it\/"},"modified":"2026-01-13T14:29:37","modified_gmt":"2026-01-13T14:29:37","slug":"11-4-apply-it","status":"publish","type":"chapter","link":"https:\/\/content.one.lumenlearning.com\/introductiontopsychology\/chapter\/11-4-apply-it\/","title":{"raw":"Measuring Personality: Apply It","rendered":"Measuring Personality: Apply It"},"content":{"raw":"<section>\r\n<section class=\"textbox learningGoals\">\r\n<ul>\r\n\t<li>Describe various personality tests<\/li>\r\n\t<li>Understand the development of personality tests<\/li>\r\n\t<li>Understand how validity is measured and why it's important<\/li>\r\n<\/ul>\r\n<\/section>\r\n<\/section>\r\n<section class=\"textbox recall\">There are multiple types of validity:\r\n\r\n<ul>\r\n\t<li><strong>convergent validity<\/strong>: compare the test results with other personality tests of similar traits (convergent validity)<\/li>\r\n\t<li><strong>discriminant validity<\/strong>: compare the test results with other dissimilar tests (discriminant validity)<\/li>\r\n\t<li><strong>criterion validity<\/strong>: compare the results of the BLIRT test to real-world outcomes<\/li>\r\n\t<li><strong>predictive validity<\/strong>: see if the results work to predict people\u2019s behavior in certain situations<\/li>\r\n<\/ul>\r\n<\/section>\r\n<p>You learned about the challenges in designing a personality test and how to measure that test to ensure that it is valid, meaning that it tests what it is supposed to test. In our example, we wanted to ensure that the BLIRT test actually tested blirtatiousness. Let's review some of the types of validity here.<\/p>\r\n<h3>\u00a0<\/h3>\r\n<section class=\"textbox tryIt\">\r\n<h3>Culture and Blirtatiousness<\/h3>\r\n\r\nThe researchers chose to use some generalized cultural norms to test the validity of the blirt test. They hypothesized that due to cultural differences, an American person with an Asian cultural background would be less likely to blirt than someone with a European cultural background. Although we shouldn\u2019t overstate the difference, Asian cultures tend to emphasize restraint of emotional expression, while European cultures are more likely to encourage direct and rapid expression.<br \/>\r\n<br \/>\r\nThe researchers were able to get BLIRT scores from 2,800 students from European-American cultures and 698 students from Asian-American cultures. Use the bar graph below to adjust the bars based on their prediction about who will be more blirtatious. Then click the link below to see if your prediction is correct.<center><iframe src=\"https:\/\/s3-us-west-2.amazonaws.com\/oerfiles\/Psychology\/interactives\/blirt_graph2.html\" width=\"600\" height=\"370\" data-mce-fragment=\"1\"><\/iframe><\/center>[reveal-answer q=\"358689\"]Click here to see the results.[\/reveal-answer]<br \/>\r\n[hidden-answer a=\"358689\"]<img class=\"aligncenter wp-image-5208\" src=\"https:\/\/s3-us-west-2.amazonaws.com\/courses-images\/wp-content\/uploads\/sites\/855\/2018\/03\/01033238\/blirt_cultural_norms.png\" alt=\"Bar Graph showing European Americans with a BLIRT score of 24 and Asian Americans with a BLIRT score of 22\" width=\"578\" height=\"401\" \/>[\/hidden-answer]As you can see, the results were consistent with the researchers\u2019 expectations. The difference between the groups was small (just two points), but statistically significant. The small difference indicates that we shouldn\u2019t turn these modest differences into cultural stereotypes, but the statistically significant difference suggests that cultural experiences may have a real\u2014if modest\u2014effect on people\u2019s blirtatiousness.<\/section>\r\n<section class=\"textbox tryIt\">What type of validity was measured by comparing the test results between European and Asian American students?[reveal-answer q=\"172003\"]Show Answer[\/reveal-answer]<br \/>\r\n[hidden-answer a=\"172003\"]This is another example of criterion validity, because the researchers are comparing the results of their test against a real-world outcome. Oftentimes, criterion validity has researchers compare their test to another similar test to compare it against a benchmark or \"gold standard\" (for example, comparing a new college entrance exam to the SAT). In this instance, there was no comparison for the Blirt test, so researchers compared it to other criteria, such as jobs (salespeople or librarians) and cultural background.[\/hidden-answer]<\/section>\r\n<section class=\"textbox tryIt\">\r\n<h3>Blirtatiousness and Likability<\/h3>\r\n<br \/>\r\nLet's revisit the example of measuring the validity of the test by asking students to chat with strangers on the phone and decide how likable they are. The researchers hoped to see if those who were high blisters would be perceived as more likable. Make your prediction for each one, and then check out the results.<br \/>\r\n<br \/>\r\nWho was rated as more likable?\r\n\r\n<ul>\r\n\t<li>high blirter<\/li>\r\n\t<li>low blirter<\/li>\r\n\t<li>no difference<\/li>\r\n<\/ul>\r\n<p>[reveal-answer q=\"496449\"]Show Answer[\/reveal-answer]<br \/>\r\n[hidden-answer a=\"496449\"]<img class=\"aligncenter wp-image-5219 size-full\" src=\"https:\/\/s3-us-west-2.amazonaws.com\/courses-images\/wp-content\/uploads\/sites\/855\/2018\/03\/01035836\/blirt_likeable.png\" alt=\"bar graph showing how participants were rated by their partners on the likeable personality measure. High blirters were rated 5.8 and low blirters 5.5.\" width=\"355\" height=\"212\" \/>[\/hidden-answer]<\/p>\r\n<p>Who was rated as someone who \"I'd like to be friends with?\"<\/p>\r\n<ul>\r\n\t<li>high blirter<\/li>\r\n\t<li>low blirter<\/li>\r\n\t<li>no difference<\/li>\r\n<\/ul>\r\n<p>[reveal-answer q=\"882535\"]Show Answer[\/reveal-answer]<br \/>\r\n[hidden-answer a=\"882535\"]<img class=\"aligncenter wp-image-5220 size-full\" src=\"https:\/\/s3-us-west-2.amazonaws.com\/courses-images\/wp-content\/uploads\/sites\/855\/2018\/03\/01035855\/blirt_friends.png\" alt=\"bar graph showing how participants were rated by their partners on the friends personality measure. High blirters were rated 5.5 and low blirters 4.7.\" width=\"362\" height=\"209\" \/>[\/hidden-answer]<\/p>\r\n<p>Who was rated as more intelligent?<\/p>\r\n<ul>\r\n\t<li>high blirter<\/li>\r\n\t<li>low blirter<\/li>\r\n\t<li>no difference<\/li>\r\n<\/ul>\r\n<p>[reveal-answer q=\"560766\"]Show Answer[\/reveal-answer]<br \/>\r\n[hidden-answer a=\"560766\"]<img class=\"aligncenter wp-image-5221 size-full\" src=\"https:\/\/s3-us-west-2.amazonaws.com\/courses-images\/wp-content\/uploads\/sites\/855\/2018\/03\/01035913\/blirt_intelligent.png\" alt=\"bar graph showing how participants were rated by their partners on the intelligent personality measure. High blirters were rated 5.5 and low blirters 5.\" width=\"353\" height=\"208\" \/>[\/hidden-answer]<\/p>\r\n<\/section>\r\n<section class=\"textbox tryIt\">What type of validity was measured when researchers compared the results of the blirt test to see who was found to be more likable?[reveal-answer q=\"955993\"]Show Answer[\/reveal-answer]<br \/>\r\n[hidden-answer a=\"955993\"]This is predictive validity. Recall that one way to assess validity of the BLIRT scale is to see if it predicts people\u2019s behavior in specific situations. In this example, researchers wanted to predict if those who are more blirtatious are also predictably more outgoing and more likely to make better first impressions than those who are not blirtatious.You don't need to worry much about discriminating between the types of validity here! You could also make the argument in this example that that if the researchers had designed this instead as a test of \"outgoingness\" or \"talkativeness\", it would be an example of convergent validity, when the researcher looks for other traits that are similar to (but not identical to) the trait they are measuring. If the goal weren't to predict behavior, you could also argue that this is an example of criterion validity, as the researchers were comparing the results of the blirt test to a real-world outcome (in this case, initial likability).[\/hidden-answer]<\/section>\r\n<section class=\"textbox connectIt\">Can you think of another way, not mentioned in the reading, that experimenters could test the validity of the Blirt test? What type of validity would you be testing? What would you expect the results of your validity test to be?<\/section>\r\n<p>&nbsp;<\/p>","rendered":"<section>\n<section class=\"textbox learningGoals\">\n<ul>\n<li>Describe various personality tests<\/li>\n<li>Understand the development of personality tests<\/li>\n<li>Understand how validity is measured and why it&#8217;s important<\/li>\n<\/ul>\n<\/section>\n<\/section>\n<section class=\"textbox recall\">There are multiple types of validity:<\/p>\n<ul>\n<li><strong>convergent validity<\/strong>: compare the test results with other personality tests of similar traits (convergent validity)<\/li>\n<li><strong>discriminant validity<\/strong>: compare the test results with other dissimilar tests (discriminant validity)<\/li>\n<li><strong>criterion validity<\/strong>: compare the results of the BLIRT test to real-world outcomes<\/li>\n<li><strong>predictive validity<\/strong>: see if the results work to predict people\u2019s behavior in certain situations<\/li>\n<\/ul>\n<\/section>\n<p>You learned about the challenges in designing a personality test and how to measure that test to ensure that it is valid, meaning that it tests what it is supposed to test. In our example, we wanted to ensure that the BLIRT test actually tested blirtatiousness. Let&#8217;s review some of the types of validity here.<\/p>\n<h3>\u00a0<\/h3>\n<section class=\"textbox tryIt\">\n<h3>Culture and Blirtatiousness<\/h3>\n<p>The researchers chose to use some generalized cultural norms to test the validity of the blirt test. They hypothesized that due to cultural differences, an American person with an Asian cultural background would be less likely to blirt than someone with a European cultural background. Although we shouldn\u2019t overstate the difference, Asian cultures tend to emphasize restraint of emotional expression, while European cultures are more likely to encourage direct and rapid expression.<\/p>\n<p>The researchers were able to get BLIRT scores from 2,800 students from European-American cultures and 698 students from Asian-American cultures. Use the bar graph below to adjust the bars based on their prediction about who will be more blirtatious. Then click the link below to see if your prediction is correct.<\/p>\n<div style=\"text-align: center;\"><iframe loading=\"lazy\" src=\"https:\/\/s3-us-west-2.amazonaws.com\/oerfiles\/Psychology\/interactives\/blirt_graph2.html\" width=\"600\" height=\"370\" data-mce-fragment=\"1\"><\/iframe><\/div>\n<div class=\"qa-wrapper\" style=\"display: block\"><button class=\"show-answer show-answer-button collapsed\" data-target=\"q358689\">Click here to see the results.<\/button><\/p>\n<div id=\"q358689\" class=\"hidden-answer\" style=\"display: none\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-5208\" src=\"https:\/\/s3-us-west-2.amazonaws.com\/courses-images\/wp-content\/uploads\/sites\/855\/2018\/03\/01033238\/blirt_cultural_norms.png\" alt=\"Bar Graph showing European Americans with a BLIRT score of 24 and Asian Americans with a BLIRT score of 22\" width=\"578\" height=\"401\" \/><\/div>\n<\/div>\n<p>As you can see, the results were consistent with the researchers\u2019 expectations. The difference between the groups was small (just two points), but statistically significant. The small difference indicates that we shouldn\u2019t turn these modest differences into cultural stereotypes, but the statistically significant difference suggests that cultural experiences may have a real\u2014if modest\u2014effect on people\u2019s blirtatiousness.<\/section>\n<section class=\"textbox tryIt\">What type of validity was measured by comparing the test results between European and Asian American students?<\/p>\n<div class=\"qa-wrapper\" style=\"display: block\"><button class=\"show-answer show-answer-button collapsed\" data-target=\"q172003\">Show Answer<\/button><\/p>\n<div id=\"q172003\" class=\"hidden-answer\" style=\"display: none\">This is another example of criterion validity, because the researchers are comparing the results of their test against a real-world outcome. Oftentimes, criterion validity has researchers compare their test to another similar test to compare it against a benchmark or &#8220;gold standard&#8221; (for example, comparing a new college entrance exam to the SAT). In this instance, there was no comparison for the Blirt test, so researchers compared it to other criteria, such as jobs (salespeople or librarians) and cultural background.<\/div>\n<\/div>\n<\/section>\n<section class=\"textbox tryIt\">\n<h3>Blirtatiousness and Likability<\/h3>\n<p>\nLet&#8217;s revisit the example of measuring the validity of the test by asking students to chat with strangers on the phone and decide how likable they are. The researchers hoped to see if those who were high blisters would be perceived as more likable. Make your prediction for each one, and then check out the results.<\/p>\n<p>Who was rated as more likable?<\/p>\n<ul>\n<li>high blirter<\/li>\n<li>low blirter<\/li>\n<li>no difference<\/li>\n<\/ul>\n<p><div class=\"qa-wrapper\" style=\"display: block\"><button class=\"show-answer show-answer-button collapsed\" data-target=\"q496449\">Show Answer<\/button><\/p>\n<div id=\"q496449\" class=\"hidden-answer\" style=\"display: none\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-5219 size-full\" src=\"https:\/\/s3-us-west-2.amazonaws.com\/courses-images\/wp-content\/uploads\/sites\/855\/2018\/03\/01035836\/blirt_likeable.png\" alt=\"bar graph showing how participants were rated by their partners on the likeable personality measure. High blirters were rated 5.8 and low blirters 5.5.\" width=\"355\" height=\"212\" \/><\/div>\n<\/div>\n<p>Who was rated as someone who &#8220;I&#8217;d like to be friends with?&#8221;<\/p>\n<ul>\n<li>high blirter<\/li>\n<li>low blirter<\/li>\n<li>no difference<\/li>\n<\/ul>\n<p><div class=\"qa-wrapper\" style=\"display: block\"><button class=\"show-answer show-answer-button collapsed\" data-target=\"q882535\">Show Answer<\/button><\/p>\n<div id=\"q882535\" class=\"hidden-answer\" style=\"display: none\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-5220 size-full\" src=\"https:\/\/s3-us-west-2.amazonaws.com\/courses-images\/wp-content\/uploads\/sites\/855\/2018\/03\/01035855\/blirt_friends.png\" alt=\"bar graph showing how participants were rated by their partners on the friends personality measure. High blirters were rated 5.5 and low blirters 4.7.\" width=\"362\" height=\"209\" \/><\/div>\n<\/div>\n<p>Who was rated as more intelligent?<\/p>\n<ul>\n<li>high blirter<\/li>\n<li>low blirter<\/li>\n<li>no difference<\/li>\n<\/ul>\n<p><div class=\"qa-wrapper\" style=\"display: block\"><button class=\"show-answer show-answer-button collapsed\" data-target=\"q560766\">Show Answer<\/button><\/p>\n<div id=\"q560766\" class=\"hidden-answer\" style=\"display: none\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-5221 size-full\" src=\"https:\/\/s3-us-west-2.amazonaws.com\/courses-images\/wp-content\/uploads\/sites\/855\/2018\/03\/01035913\/blirt_intelligent.png\" alt=\"bar graph showing how participants were rated by their partners on the intelligent personality measure. High blirters were rated 5.5 and low blirters 5.\" width=\"353\" height=\"208\" \/><\/div>\n<\/div>\n<\/section>\n<section class=\"textbox tryIt\">What type of validity was measured when researchers compared the results of the blirt test to see who was found to be more likable?<\/p>\n<div class=\"qa-wrapper\" style=\"display: block\"><button class=\"show-answer show-answer-button collapsed\" data-target=\"q955993\">Show Answer<\/button><\/p>\n<div id=\"q955993\" class=\"hidden-answer\" style=\"display: none\">This is predictive validity. Recall that one way to assess validity of the BLIRT scale is to see if it predicts people\u2019s behavior in specific situations. In this example, researchers wanted to predict if those who are more blirtatious are also predictably more outgoing and more likely to make better first impressions than those who are not blirtatious.You don&#8217;t need to worry much about discriminating between the types of validity here! You could also make the argument in this example that that if the researchers had designed this instead as a test of &#8220;outgoingness&#8221; or &#8220;talkativeness&#8221;, it would be an example of convergent validity, when the researcher looks for other traits that are similar to (but not identical to) the trait they are measuring. If the goal weren&#8217;t to predict behavior, you could also argue that this is an example of criterion validity, as the researchers were comparing the results of the blirt test to a real-world outcome (in this case, initial likability).<\/div>\n<\/div>\n<\/section>\n<section class=\"textbox connectIt\">Can you think of another way, not mentioned in the reading, that experimenters could test the validity of the Blirt test? What type of validity would you be testing? What would you expect the results of your validity test to be?<\/section>\n<p>&nbsp;<\/p>\n","protected":false},"author":20,"menu_order":31,"template":"","meta":{"_candela_citation":"[{\"type\":\"cc\",\"description\":\"Psychology in Real Life: Blirtatiousness, Questionnaires, and Validity\",\"author\":\"Patrick Carroll for Lumen Learning\",\"organization\":\"Lumen Learning\",\"url\":\"\",\"project\":\"\",\"license\":\"pd\",\"license_terms\":\"\"}]","pb_show_title":"on","pb_short_title":"","pb_subtitle":"","pb_authors":[],"pb_section_license":""},"chapter-type":[],"contributor":[],"license":[],"part":1158,"module-header":"apply_it","content_attributions":[{"type":"cc","description":"Psychology in Real Life: Blirtatiousness, Questionnaires, and Validity","author":"Patrick Carroll for Lumen Learning","organization":"Lumen Learning","url":"","project":"","license":"pd","license_terms":""}],"internal_book_links":[],"video_content":null,"cc_video_embed_content":{"cc_scripts":"","media_targets":[]},"try_it_collection":null,"_links":{"self":[{"href":"https:\/\/content.one.lumenlearning.com\/introductiontopsychology\/wp-json\/pressbooks\/v2\/chapters\/1187"}],"collection":[{"href":"https:\/\/content.one.lumenlearning.com\/introductiontopsychology\/wp-json\/pressbooks\/v2\/chapters"}],"about":[{"href":"https:\/\/content.one.lumenlearning.com\/introductiontopsychology\/wp-json\/wp\/v2\/types\/chapter"}],"author":[{"embeddable":true,"href":"https:\/\/content.one.lumenlearning.com\/introductiontopsychology\/wp-json\/wp\/v2\/users\/20"}],"version-history":[{"count":15,"href":"https:\/\/content.one.lumenlearning.com\/introductiontopsychology\/wp-json\/pressbooks\/v2\/chapters\/1187\/revisions"}],"predecessor-version":[{"id":7469,"href":"https:\/\/content.one.lumenlearning.com\/introductiontopsychology\/wp-json\/pressbooks\/v2\/chapters\/1187\/revisions\/7469"}],"part":[{"href":"https:\/\/content.one.lumenlearning.com\/introductiontopsychology\/wp-json\/pressbooks\/v2\/parts\/1158"}],"metadata":[{"href":"https:\/\/content.one.lumenlearning.com\/introductiontopsychology\/wp-json\/pressbooks\/v2\/chapters\/1187\/metadata\/"}],"wp:attachment":[{"href":"https:\/\/content.one.lumenlearning.com\/introductiontopsychology\/wp-json\/wp\/v2\/media?parent=1187"}],"wp:term":[{"taxonomy":"chapter-type","embeddable":true,"href":"https:\/\/content.one.lumenlearning.com\/introductiontopsychology\/wp-json\/pressbooks\/v2\/chapter-type?post=1187"},{"taxonomy":"contributor","embeddable":true,"href":"https:\/\/content.one.lumenlearning.com\/introductiontopsychology\/wp-json\/wp\/v2\/contributor?post=1187"},{"taxonomy":"license","embeddable":true,"href":"https:\/\/content.one.lumenlearning.com\/introductiontopsychology\/wp-json\/wp\/v2\/license?post=1187"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}