fbpx

ACT a Runaway Favorite over New SAT. Why?

Runaway-ACT2

Nearly three years ago, the College Board announced plans for a major redesign of the SAT. In less than three months, the new SAT will finally make its debut.

Tickets to the premiere are not selling well. Compass families — typically thoughtful and thorough when assessing their testing options — are overwhelmingly saying “No thanks!” and booking a seat for the ACT instead. A late surge in demand for the new SAT is unlikely at this point. By December of 11th grade, most Compass clients have solidified plans for the important spring testing window. The February ACT is out-polling the March SAT 20 to 1. By comparison, when the SAT last changed in 2005, the SAT was preferred 10 to 1.

Why the shift? As you’d expect from a group of savvy decision-makers, the rationales are both practical and insightful. A common theme is not fear but caution. The content of the new exam and the effort required to boost performance on the skills it assesses are well understood. Rather, a combination of logistical complications, inconvenient delays, and unfinished scaling of the tests are to blame for the new SAT’s poor reception. Families looking to remove stress from the standardized testing process tend to shy away from uncertainty.

The timing headache of the new SAT rollout in early March is the easiest problem to explain and appreciate. March has normally been a very popular test date among juniors. Students could receive PSAT scores in December, prepare for 2-3 months, receive their first SAT scores by the end of March, and plan the rest of the school year accordingly. In 2016, March scores are expected no sooner than mid-May. Waiting ten weeks for scores is awkward for 11th graders trying to make plans for re-testing, select a Subject Test date, firm up their college lists, and prepare for APs.

Further, a mid-May release of March scores is probably a best-case scenario. The College Board has struggled to meet their announced deadlines throughout this major transition; indeed, we learned today that the online release of PSAT scores — long slated for mid-December — has been delayed until January 7 due to technical problems. Students will not receive paper reports until January 29.

The turnaround of May and June scores is expected to improve to six weeks. This delayed reporting is still less than ideal, though, as most students will be into their summer break and will have less access to their school advisors when they finally receive their scores.

ACT’s menu of spring test dates – February 6, April 9, and June 11 – offers students a range of timing options, and ACT scores are expected to be released within the customary 2-3 week window. One caveat is that ACT had its own scoring fiasco in September because of problems associated with its new essay.

Delayed reporting is a nuisance but it alone is not enough to drive so many students from the SAT to the ACT. For many students, the more important factor is the respective portfolios of available practice tests and the integrity of the scales (scores) attached to the tests. College Board has more than a century of experience in grading college admission tests, so it is expected that they will “get it right” with the new SAT. However, it is difficult for families to trust a score that lacks context. Please watch your step as you follow me into the weeds of test construction.

Standardized tests like the SAT and ACT are intended to provide useful comparisons between students without regard to the particular form taken by a group of students on a particular test date. While it’s true that the raw difficulty of tests and the pool of testers varies slightly from test date to test date, the equating and norming processes employed in test development and scoring smooth away any differences. This is why you’ll never hear colleges saying “the March test was harder so scores from that date get more weight” or “the May test had a weaker pool of testers so we’re discounting those scores.” (You will occasionally hear this silliness from so-called test prep experts…but I digress.)

For the new SAT, the finalized scale cannot be published until the first administrations of the official test are complete and scores are released. This means that until mid-May, nobody (not even the College Board) really knows how a raw score on a particular form for the new SAT maps to a scaled score on the 200-800 range. We also can’t be sure yet that the distribution of scores will closely match the familiar bell-shaped historical distribution, as depicted below.

Screen Shot 2015-12-11 at 11.23.02 AM

We will be shocked (and college admission officers would be dismayed) if the distribution shifts dramatically and 400 or 600 or 700 becomes the new mean. 500’s on the new test will probably be as commonplace as 500’s on the old test. The concern for students has less to do with an inability to perfectly compare the new SAT to the old SAT but rather how that uncertainty flows through to comparisons between the new SAT and the ACT.

Students should choose between tests based on a careful assessment of which test suits them better. This assessment is informed by a number of factors – some qualitative and some indirectly related to the test itself – but most crucially by a quantitative evaluation of practice test results. Ongoing practice tests then become a critical component of the test prep regimen.

For current 12th graders, this assessment was straightforward. They took well-established and reliable practice tests for the ACT and the old SAT and then compared their performance using the concordance table that was developed years ago through collaboration by the ACT and College Board. A student in the sample scenario depicted below had a solid, reliable indicator that the ACT suited her better.

Screen Shot 2015-12-11 at 11.29.10 AM

Notice that the column for the new SAT is empty until May 2016. And even in May, the relationship between new SAT scores and ACT scores will have to be derived by comparing each to the most closely corresponding old SAT score. This synthetic form of concordance is the best we’ll have until roughly 2019 when the first studies are completed that are actually based on a cohort of college freshmen who took both the ACT and the new SAT while in high school.

This means that the only way right now to even try to compare a score on a new SAT practice test to an ACT score is to first make a questionable assumption that a new SAT score of, say, 530 is the same as a 530 on the old SAT, and then use the old concordance table above to compare that 530 to the ACT.

Such a comparison is further flawed by the speculative nature of the 530 from the new SAT practice test in the first place. The College Board released four practice tests last spring for the new SAT. These were beta tests, and the rough scales (score conversion tables) provided were preliminary, as well. The mock tests and tentative scales from the College Board are certainly more useful than the junk (I’m being kind) that’s been put out by third party publishers, but as test prep resources, the College Board materials are simply not as robust or reliable as the live exams released by ACT over the last two decades.

A student choosing the new SAT over the ACT is relying on a series of steps with interrelated and shaky assumptions:

  1. Take a “beta” practice test for new SAT and a released live exam for ACT
  2. Estimate score for new SAT based on preliminary practice test scales
  3. Take a leap-of-faith that new SAT score aligns with score on old SAT
  4. Use a concordance table designed for the old SAT to compare the faith-based score with ACT
  5. Decide that estimated new SAT score is so much stronger than ACT score that it’s worth accepting the uncertainties and compromises around new SAT

Having read this far, you can probably appreciate why fewer than 1 in 20 Compass students have run these numbers and concluded that the new SAT is the better choice. Some uncertainty will be addressed by the release of the scores for the PSAT that juniors took back in October. PSAT scores were supposed to be released by mid-December but have been delayed until Jan 7. Return to this blog then for a detailed assessment of what is revealed — the distribution of scores in particular. It’s likely that the pendulum will start to swing back slightly towards the SAT after students see their PSAT scores and start to feel more comfortable with what they’re facing.

Meanwhile, who are the students who are already choosing the new SAT over the ACT in spite of the drawbacks? The rationales vary widely and tend to be very specific.

  • The student with learning differences who received approval of special accommodations by the College Board but was denied them by the ACT.
  • The student with unavoidable conflicts with the ACT dates.
  • The student with overwhelmingly strong evidence from practice tests that the new SAT is a better fit.
  • The student who is toxicologically allergic to the ACT Science.
  • The student for whom reading and comprehension speed is such an overriding factor that the slightly reduced pacing of the new SAT swings the decision.

These types of individual concerns can be identified and examined and may tip the scales, but they are the exceptions. Students taking the ACT are, in most cases, making the tactically correct decision. We are happy to help you make sure you are making the right choice too.

Adam Ingersoll

About Adam Ingersoll

Adam began his career in test prep in 1993 while at the University of Southern California, where he was a student-athlete on the basketball team, worked in the admission office, and graduated magna cum laude. Over the last two decades he has guided thousands of families to successful experiences with standardized tests and has mentored hundreds of the industry's most sought-after tutors. Adam is known nationally as a leading expert on college admission testing and is a frequent presenter at higher ed conferences, faculty development workshops, and school seminars.

6 Comments

  • Avatar JL Gomez says:

    My daughter is in the class of 2018. I’m wondering how the National Merit Scholar process is affected by this recommendation to lean towards the ACT. Doesn’t the NMS program require an SAT to be a finalist? Without some commensurate adjustment on their part, how is the process.. well, FAIR?

    • Avatar Art Sawyer says:

      NMSC and College Board have long worked together, so the SAT is almost certain to remain the sole route in coming years to “confirming” a PSAT/NMSQT for the purpose of becoming a National Merit Finalist. The good news for your daughter is that many of the reasons to favor the ACT this spring will no longer apply. The first new SAT scores and concordances will be published in the next few weeks. College Board will release the March and June SATs — with more to come. Students will be able to make more informed decisions about which test is right for them. Although we saw a dramatic shift to the ACT for spring testers — especially those needing to make decisions before the January release of PSAT scores — the pendulum is slowly shifting back. Many of the students within striking distance of National Merit honors did decide to stick with the SAT, and others are finding that they perform better on the new SAT than on the ACT.

      ACT students have long been disadvantaged by NMSC’s snub, and in some states, the vast majority of students have traditionally taken the ACT. The use of the SAT made sense several decades ago, because the differences between SAT and ACT were too large to make fair comparisons. That is no longer the case. An argument could be made that few Semifinalists miss out on Finalist status because of the lack of confirming scores, so the “SAT tax” is low. You are correct, though, it would be nice to eliminate the tax entirely.

  • Avatar Andy Oberst says:

    My daughter is in the class of 2018. Do you expect that in the next year, the issues favoring the ACT will diminish? As a sophomore, my daughter scored 2020 (700, 700, 620) on the PSAT, but only 27 on a practice ACT, causing us to think she should focus on the SAT. Your thoughts?

    • Avatar Matt Steiner says:

      Hi Andy,

      My first question is: which iteration of the PSAT did your daughter take? The ‘old’ PSAT was scored on a scale from 60-240, which was comprised of three subscores in Critical Reading (20-80), Writing (20-80), and Math (20-80). The new PSAT administered in October of 2015 adopted the new scale from 320-1520, which consisted of an Evidence-Based Reading and Writing score (160-760) and Math (160-760). The scores you provided actually coincide with the old full-length SAT – not the old or new PSAT. Did your daughter sit for a full-length ‘old SAT’ practice test? Or perhaps she sat for a formal administration of the old SAT before it was discontinued in January?

      All of those questions aside, by using the concordance between the old SAT and the ACT, your daughter’s SAT score is stronger than her ACT score of 27. Still, to be certain that she has an affinity for the new SAT, I recommend that she sit for a full-length new SAT practice test and compare those results with her ACT, OR, compare the results of a new PSAT administration with her ACT score.

      If there is no discernible difference between your daughter’s new SAT/PSAT results and her ACT results, she may still want to go the route of the ACT – especially if she opts for test prep, ACT’s library of practice material and exams is more robust than the new SAT’s existing prep material.

      Please give our directors a call if you’d like to discuss your situation in greater detail. 🙂

  • Avatar Srinivas says:

    I belong to a class of 2017. Will the colleges allow scores of old SAT scores instead of new SAT scores for admissions in 2017. Please advise

    Thank you
    Srinivasa

    • Avatar Art Sawyer says:

      There has been almost universal consensus that class of 2017 can submit old or new SAT scores without prejudice. Virginia Tech is one of the only schools in the country that has decided to buck the trend and require the redesigned SAT.

Leave a Reply