by StaceyKoprince Mon Sep 21, 2009 12:24 pm
The paper-based tests use a completely different scoring methodology than the CATs. Do NOT base your understanding of the CAT algorithm on the paper tests! :)
As a general rule, CATs are not scored based on percentage correct. The algorithm is much more complex, and the "weighting" applied to a question depends upon many other factors. (It's not really a weighting - that's not what's happening on the test.)
Some things to keep in mind:
- the effective per-question penalty increases if you have a string of wrong answers in a row; the longer the string, the higher the per-question penalty
- the effective penalty for a wrong answer is higher if the question is below the level at which the test currently expects you to perform (based on your performance until that point); the lower the rating of the question, the higher the effective penalty if you get it wrong
- while the test does follow the "give a harder question if you get the previous question right" rule, the "harder question" is NOT just based on the previous question; eg, if the previous question was a 650 level, that doesn't necessarily mean the next one will be higher than 650. Rather, the test will give you something harder than your collective performance to that point. That last question may have been a 650, but your collective performance may be only a 600, so the next question will just be higher than 600, not 650. (And it doesn't even work exactly this way - the questions are not rated based upon the numbers I just gave, but the way they are rated is too complicated to explain in a forum post.)
Anyway, you're right that you shouldn't worry about this too much, but you should understand the basic fact that the test is NOT rated based upon percentage correct, so you should NOT be trying to get every problem right (the way you would on a paper-based test). That strategy will typically cause your score to be lower than it could be (because, when people try to get everything right, they spend too much time, and the penalty for running out of time or getting strings of questions wrong in a row is severe).
Stacey Koprince
Instructor
Director, Content & Curriculum
ManhattanPrep