The Variability of Performance

Table of Contents

Occasionally a student’s SAT or ACT scores will stay the same or, in rarer cases, decrease from one test to the next.  Why?  And how can we avoid flat or lower scores?

In some cases, low quality prep is to blame for a lack of score increase.  For our students, however, who have an average score increase of 180 points on the SAT and 6 points on the ACT and literally the most well-trained tutors, that possibility is impossible.  Here are the other reasons a lack of increase or a decrease can occur:

A bad day

We all know that sometimes athletes have good and bad days.  Even performance on very straight-forward sports with no influence from factors of direct competition varies from one day to the next.  For example, one could presume that runners would have the exact same time every race (except maybe with gradual improvement over time) when controlling for racing conditions.  Yet even the top runners vary roughly 2% in performance from one race to the next (on the ACT, a 2% variance would equate to almost a full composite point difference on each test).  Male, younger, and slower runners vary the most in performance from one race to the next.¹

We also know from our personal experience that some days we are just mentally quicker than others.  The same is true for students on standardized tests.  Some days they will do better than others (and some days will be really good days on which a student performs better than usual).

A bad test

By “bad” test, I simply mean a test that does not fit a student’s knowledge base as well.  Unlike in running in which all tracks are the same, on the SAT and ACT there is also variance in content from one test to the next (if there wasn’t, each test would be so predictable that students could prep so easily for them that everyone would get a perfect score).  To avoid complete predictability, there are 140 different topics tested just on the Math section of the ACT.  Some topics, such as exponents and percentages, are tested on every exam; but, after students have learned the frequently tested topics, they will be forced to learn increasingly infrequent (and difficult) topics if they want to increase their score.  Thus, they will have to learn topics tested on only 1 in 2 tests, then those tested on 1 in 4 tests, then those on 1 in 10 tests, etc.  Because of this variance in content from one test to the next, some tests may have content that suits a student significantly better or worse than other tests and leads to unexpectedly large increases or lack thereof.

Imperfect Equating

Every SAT and ACT is “equated” to ensure that a hard test has a more generous curve and vice versa (so that students’ scores do not fluctuate simply because they got lucky or unlucky with the difficulty of the test they took). However, the equating process is not perfect. Kristen Mattern, Senior Director in Research at ACT, states in an interview with Tests and the Rest, “The tests are very reliable, but they’re not perfectly reliable. That means that there’s some measurement error, so, every time you take a section, your score may be a little higher than your true ability level or may be a little lower.” For example, historically, the September ACT has had one of the most generous curves of the year, closely followed by the October test. However, this year (2019), the October test was delayed and went through an extra equating process; it ended up having an abysmal curve (literally almost every one of my personal students went down in score from September to October — but saw a jump on the December and kept increasing thereafter). Even as the test makers admit: the tests are very reliable, but not perfectly reliable. Students can get lucky or unlucky with a better or worse curve, so their score could go down through no fault of their own.

Taking Breaks

As we wrote about here, the detriment of taking breaks is surprisingly large.  Students who do not take breaks achieve 50% higher score increases (6 points as opposed to 4 points on the ACT) than those who do take breaks.  Thus, breaks in-between tests can cause students to yo-yo: they improve but then regress back to where they were originally, improve and then regress, etc, which makes it look like they were not improving.

The solution

Most problems in life have the same solution: hard-work.  The SAT and ACT are no exception.  The more students practice, the less variance there is in their scores.  In foot races, the experienced runners have more predictable times.  The same holds true on the SAT and ACT: the more experienced test takers are less likely to panic and more likely, because of practice, to execute with consistency.  And, the more topics a student learns, the less variance in scores because they know more and more of even the infrequently tested topics. Finally, students should plan to take the tests multiple times; in the event they have a bad day, a test that does not fit their content knowledge, or get unlucky with an unfavorable curve, they will want to have multiple opportunities to instead have a good day, with a test that fits them well, and a generous curve.

The key to success in life is hard-work.  The same is true on standardized tests.  With practice and quality prep, even if a student has an unlucky test, they will succeed in the long-run — as hard-workers always do.

  1. https://journals.lww.com/acsm-msse/Fulltext/2001/09000/Variability_of_competitive_performance_of_distance.23.aspx
  2. Episode 75 of the “Tests and the Rest” podcast. Title: ACT Superscoring and Section Retesting episode of Tests and the Rest
    https://open.spotify.com/episode/3pWeFmoOdTxAHDADhMpSlE?si=Ky48dLBOQ7WjmMha0rbVpw

Need a tutor?

Contact us for a free consultation at no risk.

Recent Posts

Reviews

Margie B.
Read More
I can’t thank david for all his hard work and getting my son the score he was aiming for!! Summit prep is an unbelievable place to get your kids ready for their college prep Act and SAT courses!!! Thanks again for making this year end with a bang!!
Thomas S.
Read More
The entire experience from start to finish was excellent. The process was clearly outlined and understood. Scheduling was a breeze and our teacher come not have been more flexible.
Georgia B.
Read More
Eva was wonderful. With her help I was able to get into my top school and receive and scholarship. I loved her help and spending time studying.
Jeanine L.
Read More
We were lucky enough to be referred to David at Summit Prep! My son enjoyed working with David as he felt that he really helped him prepare for the ACT. He explained concepts covered on the test as well as the test itself. My son felt confident taking the test and did so well that he only had to take it once!
Ben H.
Read More
David helped me improve my SAT from a 1480 to a 1570 over the course of about 2 months. Each session made me feel more and more confident.
Jill B.
Read More
Eva took on an almost impossible task and seriously worked a miracle! We found out we were moving, and our son had to take the ISEE exam asap. From his practice test to the exam, his scores went up exponentially. We give her 5 enthusiastic stars!
Rachel F.
Read More
My twins have had a wonderful experience with Summit Prep preparing for the ACT. David is extremely knowledgeable and connects individually in a very relatable and helpful manner for each student. I highly recommend Summit Prep!
Janice B.
Read More
All three of my children have used Summit Prep for their test prep and, I believe, reached their full potential as a result of the outstanding guidance of David and Ryan. His ongoing support went above and beyond. Many thanks!
Kwesi A.
Read More
My son just got accepted into MIddlebury!! He could not have gotten a better tutor than Eva!!! She is the best!
Arlene S.
Read More
Summit Prep are professional, enthusiastic, encouraging and most importantly successful in helping our son achieve his goals. We would strongly recommend using David and his team and want to convey our thanks for all of their help!
Previous
Next

Contact us for a free strategy consultation