Glaring differences between MGMAT and GMAT Prep scores

[sandipfloyd]

Hi,

So I'm roughly 5 weeks into my GMAT prep and I've given 3 MGMAT CATs and 1 GMAT Prep CAT with the following results:

1. MGMAT CAT 1: 570 (Q: 36 , V: 32)

2. MGMAT CAT 2: 630 (Q: 45 , V: 32 , IR: 5.06)

3. MGMAT CAT 3: 580 (Q: 38 , V: 32 , IR: 5.27)

4. GMAT Prep CAT 1: 730 (Q: 50 , V: 40 , IR: 8)

I am a little stumped by the vast differences in the scores. Especially the MGMAT CAT 3 where the average difficult of both right and wrong answers was 700+ in all categories. I was unable to finish the Quant sections in CAT 1 and CAT 3 which presumably contribute to the very low scores. I'm just concerned about the effectiveness of using MGMAT CAT's as a reliable indicator of my current standing. Maybe someone else who's also encountered similar results might care to chip in with some words of wisdom?

Cheers,
S

[StaceyKoprince]

I haven't seen someone with that big of a jump (from your test 3 to test 4) before - at least it's going in the right direction. :)

Your comment that you ran out of time on test 3 is a big clue. The GMAT is a "where you end is what you get" test. Your average performance throughout the section doesn't matter. You could be at the 99th percentile mid-way through but if your score drops to 50th percentile at the end, then that's your final score - where you end is what you get.

For your GMATPrep test, did you take it under 100% official conditions? (I see you did IR; did you also do the essay?) Did you take just 2 breaks, limited to 8 minutes each?

Had you seen any of the questions in advance? (People will sometimes read articles / browse forums and expose themselves to GMATPrep questions in advance.)

If you took that test under official conditions and all of the questions were new, then yay! You did a great job.

You'll just want to watch out for the timing issues that caused you to be unable to finish tests 1 and 3. If that problem isn't fixed, then it could happen again - and you obviously don't want that to happen on the real test.

Now that you know that the GMAT is a "where you end is what you get" test, how does that change the way that you think you should approach both taking it and studying for it?

I've got some ideas for you, of course, but you'll internalize it better if you also think about it for yourself. :)

Read these:
https://www.manhattangmat.com/blog/inde ... lly-tests/
http://www.manhattangmat.com/blog/index ... -the-gmat/

And then these for time management:
http://www.manhattangmat.com/blog/index ... -to-do-it/
http://www.manhattangmat.com/blog/index ... nt-part-1/

[kleinron]

I'm looking for an explanation on the discrepancies too. I think the MGMAT CAT intentionally inflates to harder problems. Before I started studying I got a 690 on the GMATPrep Test #1 then I got a 720. I just scored a 640 on the first MGMAT CAT after taking those two. There is clearly a large variance in the difficulty of problems.

I guess I don't really mind since I'll be getting good at the harder problems.

The thing I worry about is if MGMAT is intentionally inflating the earlier tests with harder questions to make it look like you need so much help - and buy more materials. Then when you score way better than their first CAT on the last few it makes it seem like MGMAT is the sole reason for your triumph and you recommend them to friends. Actually I'm talking myself into this being the exact thing that's happening.

[StaceyKoprince]

We don't do that (not intentionally, at least!). We really do try to mimic the real test as much as we can.

It *is* true that a lot of people have a tougher time managing their time on our quant sections - some of our questions are on the more computation-intensive side. Most people also find it tougher (than GMATPrep) to manage time during the real test, too, though - at the high end, GMATPrep doesn't have a huge number of really difficult problems.

Also, the testing "engine" is identical for every test of ours - there is only the one piece of software and the tests are pulling from the same database of questions. There isn't even a way for us to make test 4 easier (or harder) than test 1, or anything similar. The algorithm itself has no idea what test number you're on - only the website knows in order to display the information correctly.

[sandipfloyd]

Hi Stacey,

Thanks for your reply and feedback.

I took the GMATPrep CAT under official conditions, starting at 13:30h, with the essay + IR. Took two 6 min breaks after IR and Quant. Same story with all MGMAT CATs. I guess for MGMAT CAT #3 I was not in peak condition (bad hangover and a heavy lunch :|), so that could well account for the drop in my score from 630 to 580.

Starting from the 2nd MGMAT CAT, I consciously started skipping 2-3 difficult questions in quant in order to be able to finish the test on time. So, considering CAT #3 to be an anomaly, my scores have jumped from 570 -> 630 -> 680. However, these are still too low compared to the GMAT Prep CAT! (my target GMAT score is 730+).

I gave the fourth MGMAT CAT last Sunday and got a 680 (Q:46, V:36) so at least my scores are trending upwards. But still, there's a big difference between 680 and 730. I'm just not sure where I really stand and am now considering other Mock exams just to get a clearer picture of my true level.

Any further comments/advice is much appreciated. Thanks!

[StaceyKoprince]

Those scores (680 and 730) actually are within the standard deviation of these kinds of tests. Standardized tests are unfortunately not as precise as we would like to think they are.

The standard deviation on our own tests is approx. 50 points. The standard deviation on the real test is approx. 30 points. (In other words, roughly speaking, scores within those ranges are not statistically different / someone with the same ability can expect to score in that range, not just the exact same score every time.)

So you do already have a clear picture of your current scoring range: it is in the high 600s / low 700s. That's about as precise as you're going to get with the GMAT.

If your MGMAT scores are at the lower end of your range (and GMATPrep at the higher end), then you may have some timing or mental stamina issues. In that case, you'd want to focus on beefing up those areas before you take the real test.

It sounds like you are already moving in the right direction on timing (letting go of certain problems), though you may have a little further to go. Most people should do this on 4-7 problems in each section. This is true even at top scoring levels. In January, a student of mine scored a 51 on quant - the top quant score - and she skipped* 4 questions in the quant section.

*skipped = guessed almost immediately and moved on (since you can't actually skip!)

The articles that I linked in an earlier post will also help with this.

For mental stamina, first, recognize that you have a finite amount. As you make decisions about when to keep going vs. when to guess and move on, don't just think about this problem. Also think about whether there are better places to use the time and mental energy that you're proposing to use on this one.

Also, on a more granular level, this article on decision fatigue can help:
http://www.manhattangmat.com/blog/index ... you-crazy/

If you'd like to get more detailed timing and content advice, use the below to analyze your most recent MGMAT CAT (this should take you a minimum of 1 hour):
https://www.manhattangmat.com/blog/inde ... ts-part-1/

Figure out your strengths and weaknesses as well as what you think you should do based on that analysis. Then come back here and tell us; we'll tell you whether we agree and advise you further. (Note: do share an analysis with us, not just the raw data. Part of getting better is developing your ability to analyze your results - figure out what they mean and what you think you should do about them!)