Sunday, March 1, 2020

Understanding Scaled Scores on Standardized Tests

Understanding Scaled Scores on Standardized Tests Scaled scores are a type of exam score. They are commonly used by testing companies that administer high stakes exams, such as admissions, certification and licensure exams. Scaled scores are also used for K-12 Common Core testing and other exams that assess student skills and evaluate learning progress. Raw Scores vs. Scaled Scores The first step to understanding scaled scores is to learn how they differ from raw scores. A raw score represents the number of exam questions you answer correctly. For example, if an exam has 100 questions, and you get 80 of them correct, your raw score is 80. Your percent-correct score, which is a type of raw score, is 80%, and your grade is a B-. A scaled score is a raw score that has been adjusted and converted to a standardized scale. If your raw score is 80 (because you got 80 out of 100 questions correct), that score is adjusted and converted into a scaled score. Raw scores can be converted linearly or nonlinearly. Scaled Score Example The ACT is an example of an exam that uses linear transformation to convert raw scores to scaled scores. The following conversation chart shows how raw scores from each section of the ACT are transformed into scaled scores.   Raw Score English Raw Score Math Raw Score Reading Raw Score Science Scaled Score 75 60 40 40 36 72-74 58-59 39 39 35 71 57 38 38 34 70 55-56 37 37 33 68-69 54 35-36 - 32 67 52-53 34 36 31 66 50-51 33 35 30 65 48-49 32 34 29 63-64 45-47 31 33 28 62 43-44 30 32 27 60-61 40-42 29 30-31 26 58-59 38-39 28 28-29 25 56-57 36-37 27 26-27 24 53-55 34-35 25-26 24-25 23 51-52 32-33 24 22-23 22 48-50 30-31 22-23 21 21 45-47 29 21 19-20 20 43-44 27-28 19-20 17-18 19 41-42 24-26 18 16 18 39-40 21-23 17 14-15 17 36-38 17-20 15-16 13 16 32-35 13-16 14 12 15 29-31 11-12 12-13 11 14 27-28 8-10 11 10 13 25-26 7 9-10 9 12 23-24 5-6 8 8 11 20-22 4 6-7 7 10 18-19 - - 5-6 9 15-17 3 5 - 8 12-14 - 4 4 7 10-11 2 3 3 6 8-9 - - 2 5 6-7 1 2 - 4 4-5 - - 1 3 2-3 - 1 - 2 0-1 0 0 0 1 Source: ACT.org The Equating Process The scaling process creates a base scale that serves as a reference for another process known as equating. The equating process is necessary to account for differences between multiple versions of the same test. Although test makers try to keep the difficulty level of a test the same from one version to the next, differences are inevitable. Equating allows the test maker to statistically adjust scores so that the average performance on version one of the test is equal to average performance on version two of the test, version three of the test and so on. After undergoing both scaling and equating, scaled scores should be interchangeable and easily comparable no matter which version of the test was taken.   Equating Example Lets look at an example to see how the equating process can impact scaled scores on standardized tests.  Imagine that say you and a friend are taking the SAT. You will both be taking the exam at the same test center, but you will be taking the test in January, and your friend will be taking the test in February. You have different testing dates, and there is no guarantee that you will both take the same version of the SAT. You may see one form of the test, while your friend sees another. Although both tests have similar content, the questions are not exactly the same. After taking the SAT, you and your friend get together and compare your results. You both got a raw score of 50 on the math section, but your scaled score is 710 and your friends scaled score is 700. Your pal wonders what happened since both of you got the same number of questions correct. But the explanation is pretty simple; you each took a different version of the test, and your version was more difficult than his. To get the same scaled score on the SAT, he would have needed to answer more questions correctly than you. Test makers that use an equating process use a different formula to create a unique scale for each version of the exam. This means that there is no one raw-to-scale-score conversion chart that can be used for every version of the exam. That is why, in our previous example, a raw score of 50 was converted into 710 on one day and 700 on another day. Keep this in mind as you are taking practice tests and using conversion charts to transform your raw score into a scaled score. Purpose of Scaled Scores Raw scores are definitely easier to calculate than scaled scores. But testing companies want to make sure that test scores can be fairly and accurately compared even if test takers take different versions, or forms, of the test on different dates. Scaled scores allow for accurate comparisons and ensure that people who took a more difficult test are not penalized, and people who took a less difficult test are not given an unfair advantage.

No comments:

Post a Comment

Note: Only a member of this blog may post a comment.