Why Test Scores Alone Cannot Describe a School

Test scores are one of the most visible numbers attached to a school, but they are not a complete description of what a school does or how well it serves students. A standardized test measures a narrow slice of academic performance in tested subjects at a particular moment. It does not measure school climate, safety, student belonging, access to advanced coursework, arts and athletics, counseling, or the quality of teaching and family engagement. Researchers and education writers have long warned that treating a single test score as a verdict on school quality can mislead families and policymakers alike. In New York, as in other states, test results are best understood as one indicator among many.

Source-check date: October 12, 2026. This article draws on general research and commentary about standardized testing and school quality; it does not evaluate specific New York schools or current accountability designations.

What a standardized test actually measures

A standardized test is any examination that is administered and scored in a predetermined, standard manner. That standardization is what makes scores comparable across students and schools. There are two major kinds: aptitude tests, which are designed to predict how well students may perform later, and achievement tests, which are intended to measure what students have learned in a subject area. Most school accountability systems rely heavily on standardized achievement tests in reading, mathematics, and sometimes science.

That design has a built-in limit. A standardized achievement test is built to sample performance in specific academic domains. It is not built to capture the full range of experiences, supports, and outcomes that make a school effective. As the ASCD journal Educational Leadership argued in a widely cited 1999 article, using standardized test scores as the chief indicator of a school staff’s success means educational quality is being measured by the wrong yardstick. The article notes that when a school’s scores are high, people tend to assume the staff is effective; when scores are low, they assume the opposite. In either case, the evaluation can be in error because the test is not designed to answer that question.

Why a single score can mislead

Test scores reflect more than what happens in a classroom. They can be influenced by prior schooling, access to books and technology, family income, language background, disability, test anxiety, attendance, and many other factors inside and outside school. That does not make scores meaningless, but it does mean they cannot be read as a direct measure of a school’s effort or quality.

Jack Schneider’s book Beyond Test Scores, published by Harvard University Press, makes a similar point. The book’s publisher notes that test scores are the go-to metric for state policymakers and anxious parents, yet ample research indicates that standardized tests are a poor way to measure a school’s performance. Schneider argues that current debates over school quality need new approaches to educational data that move past a fixation on test scores.

A single average score can also hide wide variation. Two schools might report the same average proficiency rate while serving very different student populations, offering different courses, or producing different patterns of growth among student groups. One school might have strong results for students who have been in the country for years but large gaps for English language learners; another might have lower overall scores but stronger growth for students with disabilities. A single number cannot show those differences.

What test scores can still tell you

Test scores are not useless. They can help answer specific, limited questions:

• Are students in tested grades meeting the state’s academic standards in reading and mathematics?
• Are there gaps between groups of students, such as by race, income, disability status, or English language proficiency?
• Are results improving or declining over several years, rather than in a single year?
• How does a school’s results compare with similar schools serving similar student populations?

Those are useful starting points for conversation. They are not final answers about school quality.

What test scores cannot tell you

Many of the things families care most about are not captured by standardized tests. These include:

• School climate and safety: whether students feel safe, respected, and connected to adults and peers.
• Teaching quality: how teachers plan, give feedback, support struggling students, and challenge advanced learners.
• Access to a broad curriculum: offerings in science, social studies, world languages, art, music, and physical education.
• Extracurricular opportunities: sports, clubs, debate, theater, and other activities that build skills and belonging.
• Support services: counseling, special education, English language development, mental health supports, and services for students experiencing homelessness or food insecurity.
• Family and community engagement: how well the school communicates with families and involves them in decisions.
• Resources and conditions: class sizes, facilities, libraries, technology, teacher turnover, and access to advanced coursework.
• Long-term outcomes: graduation, college and career readiness, civic participation, and well-being after school.

Schneider’s research team used the diverse urban district of Somerville, Massachusetts, as a case study to develop a framework for more fairly and comprehensively assessing educational effectiveness. By adopting a wide range of measures aligned with that framework, the team was able to capture a broader array of school strengths and weaknesses. Their data challenged misconceptions about what makes a good school. The lesson is not that test scores should be ignored, but that they should be placed alongside other evidence.

A better way to think about school quality

School quality is a multi-dimensional idea. A good school helps students learn academic content, but it also helps them feel safe, supported, and challenged. It offers a range of courses and activities. It communicates with families. It uses resources fairly. It identifies students who need extra help and provides it. It also recognizes that different students start from different places and may need different kinds of support to succeed.

That is why many researchers and education leaders recommend using multiple measures. Multiple measures can include test results, student growth over time, attendance and chronic absenteeism, graduation rates, course-taking patterns, school climate surveys, discipline data, access to advanced courses, and parent and student feedback. No single indicator is perfect. Together, they can give a more balanced picture—and help identify where a school needs assistance.

For New York families, this means treating state test results as one part of the official school report card, not the whole story. The State Education Department and local districts publish a range of data, but definitions, data years, and reporting methods can vary. When comparing schools, check whether the numbers cover the same grades, subjects, and student groups. Look for trends over time rather than one year’s results. And remember that a school with lower test scores may still be doing important work that the tests do not capture.

Questions to ask when you look at a school

If you are using test scores as a starting point, pair them with questions that get at the fuller picture:

• What do these test scores measure, and which students are included?
• How have results changed over the past three to five years?
• How do different student groups perform, and what is the school doing to close gaps?
• What does the school offer in arts, music, science, social studies, and world languages?
• How does the school support English language learners, students with disabilities, and students who are behind or ahead?
• What is the school climate like? How are bullying, safety, and belonging addressed?
• How does the school communicate with families? Are there opportunities for input?
• What are class sizes, teacher turnover, and access to counselors and other support staff?
• What do current students and families say about the school?
• What happens to students after they leave—do they graduate, go to college, enter careers, and feel prepared?

Sources and methodology

This article is a general explainer for New York families. It draws on two sources: a 1999 Educational Leadership article from ASCD, “Why Standardized Tests Don’t Measure Educational Quality,” which explains why standardized tests provide a misleading estimate of school staff effectiveness; and the Harvard University Press book page for Jack Schneider’s Beyond Test Scores, which argues that test scores are a poor way to measure school performance and describes a broader framework developed using Somerville, Massachusetts, as a case study. The sources support the general limitations of test scores described here. They do not provide current New York State accountability data or school-level results. Source-check date: October 12, 2026.

This article does not rank or evaluate any specific New York school. Families should consult official school report cards, district data, and school visits for current information.