The SAT Keeps Making Mistakes

Table of Contents

I am a huge fan of standardized tests (if I were in front of a crowd, I can just imagine the chorus of booing and hissing that would immediately follow that opening statement).  But, I think they test valuable knowledge (what students learn in school), and I think they are necessary in order to evaluate students by objective, standardized criteria so that colleges can see through the smoke-screen of grade-inflation and the widely different educational quality of over 40,000 high schools in the U.S., not to mention evaluating home-schooled and international students.¹

However, although I see enormous value to standardized tests, the SAT is still finding itself since it revamped its test in 2016 (and it shifted its test development from ETS – Educational Testing Services – to its own in-house test development).  In the interim, the quality of this test has plummeted.

Here are some examples of mistakes it has made, followed by why they matter:

  • The October 2018 test had three questions (#24, #25, and #30) on the Reading section that directed students to look at the incorrect lines in the passage. An astute student would look around those given lines and still probably find the correct answer, but providing the wrong line numbers to students on a national test is indicative of the SAT’s (sorry/not sorry to say) sloppy approach to its tests.  Here’s why it’s so indicative: every student who takes this exam realizes the mistakes.  So how did the SAT not realize them?  The only logical conclusion is that they only had one person write the questions for that reading passage and that no one else even proof-read it.  That’s astounding for a national test.  Additionally, as even my students have noticed, #27 on the same passage of that Reading section has arguably two correct answers, and #28 requires an unjustifiable inference.  The Reading section would be difficult enough to decipher, yet, add in the SAT’s own mistakes, and a perfect score or even score of 1500+ can become a roll of the dice.
  • The August 2018 SAT given in the U.S. re-used portions of the October 2017 SAT that was given overseas. That would be fine, except that the SAT knew and was warned in advance that the October 2017 international SAT had been leaked online.  The leaking of this exam in advance gave students who looked up the leaked exams (the leaked exams are readily available on websites originating in other countries) a massive, unfair advantage.  The makers of the SAT are currently being sued for using this leaked exam.²
  • The SAT had to throw out 4 of the 96 questions on its Verbal section on the June 2018 exam because of the poor quality of these questions (given all the mistakes in questions that they haven’t thrown out, one can only imagine the mistakes that must have been in those questions). Thus, they had to throw out over 4% of the entire Verbal section.  If the results are accurate with only 92 questions, then why would students ever have to do 96?  Additionally, just 6 questions wrong on the Math section of this test brought students down a shocking 130 points (to a 670).  Compare that to the January 2017 Math curve when 6 wrong was a 770.  Thus, for the same number of questions incorrect, there can be a 100 point swing in score.  That doesn’t sound very standardized to me.  Clearly they are not doing enough to determine the difficulty and scoring in advance through pre-testing.
  • On the October 2016 SAT, there is no correct answer for #21 of the Reading section.
  • Potentially all of the unreleased U.S. SAT’s that will be used overseas have been leaked or recreated in advance of being administered overseas. The following article does a fantastic job of illuminating the rampant cheating on the SAT overseas (which could be easily avoided if the SAT simply did not reuse previously administered SATs): https://www.reuters.com/investigates/special-report/college-sat-one/

Given all the issues with the SAT, should any students still take it?  Yes, absolutely.  The SAT will still be the best test for some students.  For example, a small percentage of students will not be able to get over the hurdle of the difficult time constraint on the ACT; for those students, the SAT will likely fit them better.  And, for most students (who are scoring below a 1400), the few bad questions on the Reading and sometimes Grammar sections will have little effect on their scores.  Thus, most students that score better on the SAT should stick with this test as opposed to avoiding it on account of the ambiguous questions that might only be a deciding factor for students scoring above a 700 on the Verbal section.

It is neither too late nor too difficult for the SAT to improve itself.  If the SAT put a bit more effort into the quality of its Verbal section and chose not to reuse exams, it would literally solve all of its current problems.  And, the stakes are too high not to do so.  These exams, just 3 hours, have a massive impact on where students can be admitted to college and can have ripple effects for the rest of their lives.  The tests are too important not to do everything to make them as good as possible.

 

  1. https://nces.ed.gov/programs/digest/d17/tables/dt17_105.50.asp
  2. https://www.washingtonpost.com/education/2018/09/06/college-board-sued-over-allegedly-recycled-sat-test-questions/?utm_term=.aadf8fd54ad2

Reviews

Margie B.
Read More
I can’t thank david for all his hard work and getting my son the score he was aiming for!! Summit prep is an unbelievable place to get your kids ready for their college prep Act and SAT courses!!! Thanks again for making this year end with a bang!!
Thomas S.
Read More
The entire experience from start to finish was excellent. The process was clearly outlined and understood. Scheduling was a breeze and our teacher come not have been more flexible.
Georgia B.
Read More
Eva was wonderful. With her help I was able to get into my top school and receive and scholarship. I loved her help and spending time studying.
Jeanine L.
Read More
We were lucky enough to be referred to David at Summit Prep! My son enjoyed working with David as he felt that he really helped him prepare for the ACT. He explained concepts covered on the test as well as the test itself. My son felt confident taking the test and did so well that he only had to take it once!
Ben H.
Read More
David helped me improve my SAT from a 1480 to a 1570 over the course of about 2 months. Each session made me feel more and more confident.
Jill B.
Read More
Eva took on an almost impossible task and seriously worked a miracle! We found out we were moving, and our son had to take the ISEE exam asap. From his practice test to the exam, his scores went up exponentially. We give her 5 enthusiastic stars!
Rachel F.
Read More
My twins have had a wonderful experience with Summit Prep preparing for the ACT. David is extremely knowledgeable and connects individually in a very relatable and helpful manner for each student. I highly recommend Summit Prep!
Janice B.
Read More
All three of my children have used Summit Prep for their test prep and, I believe, reached their full potential as a result of the outstanding guidance of David and Ryan. His ongoing support went above and beyond. Many thanks!
Kwesi A.
Read More
My son just got accepted into MIddlebury!! He could not have gotten a better tutor than Eva!!! She is the best!
Arlene S.
Read More
Summit Prep are professional, enthusiastic, encouraging and most importantly successful in helping our son achieve his goals. We would strongly recommend using David and his team and want to convey our thanks for all of their help!
Previous
Next

Want to stay up to date on our resources?

Sign up for our newsletter.