And why these mess up classical intelligence tests, such as IQ-tests.
First of all, what does these mean?
Priming
Lets start by explaining priming. One good example of priming is some studies conducted by two dutch scientists and released in 1998. In these studies, they let test subjects be exposed for a priming session, with the stereotype of either a professor or a soccer hooligan (in one of the tests they were also subjected to the traits of intelligence and stupid), the test subjects then proceeded to complete a general knowledge test. The test, the subjects had to complete, was created by choosing questions from the board game; trivial pursuit.
The theoretic background to these test were that priming a subject with a stereotype or a specific trait would lead to an observable complex behavior in line with the stereotype or trait. This means, as the study shows, that subjects being primed with the stereotype of professors or the trait of intelligence will consequently provide a better result at a test measuring general knowledge. Likewise test subjects that were exposed with the negative stereotype of a soccer hooligan or the trait of stupid expressed a significantly worse result at a similar general knowledge test.
In the studies the priming procedure the subjects were exposed to, worked like this; The subjects received a blank paper and were asked to list behavior, lifestyle and appearance attributes of either a professor or a soccer hooligan for a preset amount of minutes (the number of minutes the subjects did this varied over the four experiments conducted in order to see if it made a difference). The same sort of priming procedure were conducted with the traits of intelligent and stupid.
The results of these studies confirmed the predefined theory, that this in fact lead to different results at a general knowledge test. Now before we go to deep into the results of the studies, we must first state that the general knowledge test were changed in all of the studies. The questions were all taken from trivial pursuit, but the amount of questions and the time to answer each question varied in between studies. But to give some examples of how great this test were; In study number 2 (of a total of 4 studies) they let the test subjects to be in either a control group (no priming), a 2 minute priming group or a 9 minute priming group. The two primed groups were all primed the professor stereotype. The results is as follow:
No prime = 45.2% correct answers
2-min prime = 51.8% correct answers
9-min prime = 58.9% correct answers
Now as we can see the results presented in this article shows that a priming effect can result in actual differences at a test. As the discussion follows, they reason that the test subjects didn't receive new knowledge as a result of the priming result, it is reasoned that the test subjects achieved a state of mind were they more easily could remember or more easily find the correct answer.
Stereotype threat
Now lets have a look at another know phenomenon, namely stereotype threat. This is a phenomenon that is closely related to priming and it might be very treacherous for psychologist conducting tests.
Stereotype threat was first described in 1995 by Claude Steele and Joshua Aronson. And it is described as "..being at risk of confirming, as self-characteristic, a negative stereotype about one's group". As they explain in their study the reason that black Americans have a stereotype of being unintelligent or dumb. Therefore, if they are presented with a test that is a to test their intelligence this will invoke a stereotype threat, since they have a risk of performing bad, therefore confirming the stereotype. This have several effects on the result, as it shows in their test.
What it shows is that it seems to have similar results to priming. Here the stereotype threat activates the knowledge of the stereotype. And that itself is enough to give significant results to a test. There is no need for a priming session here as in previously described, since the black americans is already well aware of the stereotypes and have been primed prematurely, before the test. The stereotype threat simply invokes the stereotype and it affects the test subjects , making them behave in line with the stereotype.
Now, in their article from 1995 they presented 4 studies. Lets present two of them. One of their tests (study 2 of you read the original source) were conducted as follow. Black and white female American students took a test, they all took the same test under the same conditions, the independent variable here being the way the test were presented. Half of the black and half of the white students were told that this test were to test their intellectual abilities. The other half of the students were told that the test were simply a tool in a larger study to understand problem solving. This leads to 4 groups.
The results of this study may be shocking. The black students in the group that thought their intellectual ability were tested, performed significantly worse than any of the other groups. To keep the information simply; this study showed that if you tell a black woman that her intellectual ability is being tested, she will perform worse than a black woman who weren't told the same, and she will also perform worse than a white woman no matter what the white woman were told about the test. This is a serious issue to take into consideration, I will talk more about that later in this blog post.
The other study I want to mention is one that has been very famous. It is for instance cited in the popular book Blink by Malcolm Gladwell. Where he writes that a test showed that by simply letting black students check a box to state whether they are black or not they only managed to score half the point of black Americans that didn't do so. And shockingly enough, he is correct. The people who did the test, both black and white were given a questionnaire, where some got told to cross out what skin color they had. Black Americans that had to do this scored worse than white Americans that did this and worse than Black Americans who didn't have to do this. By simply reminding them of their skin color they got primed by the stereotypes of black Americans and scored worse.
Now what does all this tells us?
From these two articles we have scientific proof that if you let a black person state their skin color before doing a test, chances are that the will get a significant lower score because of that.
Chances are that if you explain to a black person that they will do a intelligence test, that might lead to a worse score.
By explaining to a professor, that they will be tested as a professor, you might prime them into another state of mind that leads to another score that they would otherwise get.
These are facts that is important to understand for a lot of people in this world, either if you are a scientist that is designing a new test and have to avoid involuntary stereotype threat and priming, or if you are an outsider that reads a scientific article about a test. If they didn't accounted for stereotype threat while designing a test, chances are that it is a bad test.
About IQ-tests: On a global scale, different IQ-tests differs and most of them can not avoid effects by the previously explained phenomenons. We have proof that if a black students faces a test that should test his intellectual abilities he will get a significantly worse score simply by knowing this. This creates a big trouble, damaging the credibility of the majority of IQ-tests conducted on black people over the entire world. We know so much that indicates that intelligence at a given more often is about a state of mind rather than a general intelligence regarding the individual. As these facts stacks we know more and more that IQ-tests is a very inaccurate way of testing intelligence.
The articles mentioned in this blogpost:
The Relation Between Perception and Behavior, or How to Win a Game of Trivial Pursuit, By Ap Dijksterhuis and Ad van Knippenberg, 1998.
Stereotype Threat and the Intellectual Test Performance of African Americans, by Claude M. Steele and Joshua Aronson, 1995