THE NYC SCHOOL SURVEY: EXAMINING OVER- AND UNDER-PERFORMING SCHOOLS
The purpose of this project is to examine the thoughts and opinions of students and teachers in schools from NYC's five boroughs based on survey data attained from the NYC School Survey. This project particularly focuses on examining differences between Over- and Under- performing Middle and High schools.
INTRODUCTION
All children living in the United States have the right to a free public education. The Constitution requires that all kids be given equal educational opportunity no matter what their race, ethnic background, religion, or sex, or whether they are rich or poor, citizen or non-citizen. However, although all children have the right to a free public education, I wonder if the quality of this education is equal across the board and if not, how are they different? It is no secret that some students, teachers, schools, and school districts perform better than others. Growing up in NYC my entire life and being employed in the educational sector later on in my life, I have first hand experience witnessing differences in attitudes and behaviors for both students and teachers in Under- and Over-performing schools. To examine this question, I thought it would be interesting to look at students and teachers thoughts, behaviors, and attitudes in both under- or over-performing schools.
​
NYC School System
Before diving into this project, I would like to provide some background information on the NYC school system. All introductory background information comes from by WNYC's guide to Understanding New York City Schools.
The New York City Department of Education operates public schools in the city. It's the largest system of schools in the United States. Every New York City school is different and may serve different grades. There are some that serve grades pre-k to 5, while others go up to 8th grade. There are middle schools for grades 6-8 and high schools for 9-12, but also some 6-12 schools. This means a child could attend three different schools between pre-k and high school or just two depending on the grade configuration.
Additionally, the city is divided up into 32 geographic districts. Those districts are then divided into smaller zones which determine the area served by local schools. Each district has its own superintendent and receives guidance from a Community District Education Council made up of parents and local representatives. Some schools are "zoned" meaning they are neighborhood public schools for all students living within a designated geographic area, or zone. Usually this is the public school closest to the student’s home. Zoned schools are commonly found for elementary or middle schools, but some high schools are also zoned. It's also important to remember that some districts do not have any zoned schools. The Department of Education refers to these as "choice districts." Districts 1, 7, and 23 are choice districts. Students living in one of these districts need to rank their preferred schools when applying to schools.
If you would like to learn more about the NYC school system, feel free to click here for a guide provided by WNYC.
Additionally, below is a map, provided by NYC OpenData which visualizes the school districts for each borough.
THE DATA
THE NYC School Survey
Every year, parents, teachers, students in grades 6-12 and select school support staff take the NYC School Survey. The survey helps school leaders understand what key members of their school community think about the learning environment at their school. The information captured by the survey is designed to support a dialogue among all members of the school community about how to make the school a better place to learn.
​
For the purpose of this project, I used survey results from the NYC School Survey from the years 2015-2019, along with data acquired from Greatschools.org.
METHOD
To begin this project, I created a dataset on NYC schools by using a Python script, provided by my professor, to scrape data from GreatSchools.org. GreatSchools is a non-profit organization that provides information on schools that allow parents to make informed decisions about their children's educational directions. For more information on Greatschools.org, please click here.
​
The following data was collected and compiled into a CSV:
-
School Name
-
School District
-
School Type (Public, Private, Charter)
-
Grades in that school
-
Overall School Rating (Defined by GreatSchools)
-
Test scores
-
Equity Scores
-
Low Income Percentage Scores
-
Enrollment Data
-
Students Per Teacher
-
Parental Approval Rating
-
Student Progress Rating
​
The next step of this project was to clean up to the data and determine which schools were considered over-performing and which schools were considered under-performing. Most of the clean up consisted of removing any duplicates that may have existed and creating an additional column to determine what type (elementary, middle, or high) of school each one is based on the grades that are being housed in the schools. This information is easily defined with Elementary housing Pre-K - grade 5, Middle housing grade 6 - 8, and finally High housing grades 9 - 12. There were several schools that housed grades outside of those grade bands, so these schools were placed in bands that houses grades that are most like the other grades. For example, a school that houses grades 5-8, would be defined as a middle school instead of elementary. Decisions were made based on how students and teachers would most likely behave in relation to middle or high school grade bands.
​
Once all duplicated were removed and school placed in their correct grade bands, the next step was to determine the over- and under- performing schools from the dataset consisting of 1,628 public schools. Determining school performance, was solely based on GreatSchools Overall School rating. Any school rated a 10 was defined as an over-performing school and schools that were rated as a 1 were defined as an under-performing school.
​
Their were exactly 25 schools rated as a 10 based on Great Schools Rating and 49 schools rated as 1. To narrow down the under-performing schools to 25 schools, used the average response rating from student and teacher responses. If they were below the average then I dropped the school, which resulted in 28 schools, then I dropped 3 more schools based on the average teacher response rate.
The next step in this process was to download the survey response data from the NYC School Survey for the years 2015-2019 for the both students and teachers and create datasets for both the over- and under- performing schools. The survey format and question had some slight changes over the years, so I had to manually matched up each question from each survey to the 2019 survey. The wording on some questions were slightly changed and some questions did not exist on each survey. To view the 2019 student survey click here. With the teacher survey, I reviewed and pulled certain questions that I thought would be interesting to examine or related to the student survey question. To download a full copy of the teacher survey please click here.
​
All data manipulation and cleaning was conducted using Microsoft Excel and OpenRefine. Once all datasets were created, I used Tableau Public to create visuals for exploratory analysis.
ANALYSIS ANDÂ VISUALS
OVER-PERFORMING SCHOOLS
The below dashboard visualizes some of the basic descriptives of the over-performing schools. Most over-performing schools are located in either Manhattan and Brooklyn. There are are also a near equal number of high school and middle schools. Additionally, there a pretty widely distributed low-income percentage across all the schools. The low-income percentage score reflects state test scores for students at this school who qualify for free or reduced-price lunch compared to all students in the state.
UNDER-PERFORMING SCHOOLS
The dashboard below visualizes some of the basic descriptives for the under-performing schools. Most under-performing schools are In the Bronx, followed by Brooklyn, then Manhattan. Of these schools, most schools are high schools. Finally, the distribution of low income students are negatively skewed, meaning that students at these schools can be described as low-income students.
COMPARING OVER- AND UNDER-PERFORMING SCHOOLS
From the Students Perspective
One of the most interesting findings that I arrived to while exploring the student response data was, that students in over- and under-performing do not have many differences in their thoughts, opinions, or behaviors. Scores between both under- and over- performing were similar on nearly every question. To arrive to that finding, I created several simple bar graphs which compare the average response rates from over- and under-performing schools for every question on the survey. There were only two questions of the survey in which there were significant differences - questions 6 and 8. I categorized question 6 as "students opinions of others" and question 8 as "students opinions toward bullying."
STUDENTS OPINIONS TOWARDS OTHERS
Question 6 on the student survey asks students how much they agree with statements that relate to students attitudes and behaviors while inside the classroom. The chart below compares the average values of the survey results on question 6 from 2015-2019. Students in over-performing schools are more likley to agree with each statement significantly more than students in under-performing schools. These questions indicate that students in over-performing schools are more likely to: listen carefully, follow rules, pay attention, behave, do their work, try hard to get good grades, feel it is important come to school, and think doing homework is important than students in under-performing schools. This finding is interesting because a students opinion of others could be a reflection of how they view themselves. However, in general, this finding is consistent with what is to be expected when comparing over- and under-performing schools.
STUDENTS OPINIONS ON HARASSMENT/BULLYING/INTIMIDATION
This question, I thought, is arguably one of the most important questions on this survey. It is also another agreement statement, but formatted differently  from any of theater questions on the survey. This question asks students "how often are the following things true," followed by severals scenarios relating to harassment, bullying, and intimidation. Statements cover bullying (in-person and online) due to race, religion, ethnicity, gender, sexual orientation, disabilities, weight, and a number of other factors. This question also asks students how often there are physical fights, gang activity, and substance abuse while in school.Â
Students in under-performing schools are twice or even three times as likely to agree with each statement versus their over-performing counterpart. However, it's very interesting to note that the statement that over-performing students are more likely to agree with than any other is statement 8e. Additionally, besides the general harassment, bullying, and intimidation question (8a), students in over-performing schools are also more likely to drink alcohol, use illegal drugs, or abuse prescription drugs more than any of the other scenarios, excluding 8a and 8e.
COMPARING OVER- AND UNDER-PERFORMING SCHOOLS
From the Teachers Perspective
Similar to the student survey responses, there were not many clear differences that existed between the teachers in over- and under-performing schools. Major areas where these difference exist are in overall thoughts and attitudes toward student behavior, thoughts and attitudes towards other adults in school, and some other miscellaneous differences as well.
STUDENT BEHAVIOR
Based on Teacher Survey Response
Although their were not many significant differences between the over- and under-performing schools on the teacher survey, there was some interesting differences that did arise in teachers viewpoints on students behavior in classrooms. Teachers in under-performing schools have a lower agreement score on every statement regarding student behavior in the classroom. For the the two lowest scores, on 21a and 21d, both question revolve around how student communicate in the sense of building off of each other or giving constructive criticism, which could suggest that there is a lack of communication or communicative skills. On the other hand, question 21e asks how many students participate in class discussion, which has the highest agreement among the statements for under-performing schools. This raised the question that maybe students do actively participate but are not able to build on other ideas or provide constructive feedback to their peers because they haven't learned the critical communication skills to do so.
Question 22 on the teacher survey also asks more agreement statements towards students behavior, but some of these questions were on the student survey as well. With the exception of 22f, all the questions below were the same questions as number 6 on the student survey. Unsurprisingly and consistent with student responses, teachers in under-performing schools have lower agreement scores on each statement. Students in lower performing schools are significantly less likely to listen carefully, follow the rules, pay attention, do their work, respond to challenging questions, and behave well in class.
ADULT BEHAVIOR
This question asks teachers agreement statements regarding any other adult in the school and their behavior and attitude toward students. Again, under-performing schools scored lower on every single statement, but there seems to be a similar trend between both over-  and under- performing schools. I was particularly interested in statements 23f and 23g because these questions have the lowest scores. Both statements focus on social-emotional learning and behavior regulation. The top three scores all focus on teaching students skill to complete challenging coursework, telling students that they can achieve high academic standards, and teach critical thinking skills.
OTHER DIFFERENCES
Below are some other questions from the survey that have significant differences. Under-performing schools are less likely to have teachers that help maintain discipline throughout the school, to have order and discipline maintained through the school in general, and have well-defined learning expectations for all students. Teachers from under-performing schools are less likely to recommend their schools to other teachers as a place work and less likely to recommend the school to a parent/guardian seeking a place for their child. They are also significantly more likely to have students that harass, bully, or intimidate each other.
DEEP DIVE: SCHOOL DISTRICT 14
Between the over- and under- performing schools that we are examining, there was only one district that had both over- and under- performing schools. This is district 14, which is located Brooklyn. In this district, there is 1 over- and 2 under- performing schools. The over-performing school is The Brooklyn Latin School and the two under-performing schools are El Puente Academy forJustice and Peace and Lyons Community School. For this section, I will take a closer look at some of the differences between survey responses between the three schools in this district. Please note that all three of these schools are high schools, but house the following grades:
The Brooklyn Latin School - 9-12
El Puente Academy for Justice and Peace - 9-12
Lyons Community School - 6-12
District 14 Quick Stats
Below is an infographic with some descriptive measures of NYC School District 14. All information was obtained from Greatschools.org. The district summary rating examines how well students are performing in this district relative to other districts across the state. The Student progress rating examine how's much students are learning compared to other students across the state. Please note that these metric are descriptive of every school in NYC school district 14, including early elementary and elementary schools, it is not exclusive to middle and high schools.
DISTRICT 14 SCHOOL DESCRIPTIVES
Of the three schools, The Brooklyn Latin School has the highest enrollment at 681 students, as of 2019. The Brooklyn Latin School also has a higher equity overview rating. The equity overview rating looks at how well this school is serving the needs of its disadvantaged students relative to all its students, compared to other schools in the state, based on test scores provided from the state Department of Education. All three schools have a similar Parental approval rating, with El Puente Academy being slightly lower.
SCHOOL COMPARISON
From the Student Perspective
The results of this comparison were quite similar to the previous overall comparison. There were significant differences on both questions, 6 & 8 again. These those two categories are "students opinions of others" and "students opinion towards bullying". However, there was another difference on question 5. I categorized this question as "students opinion towards in-class work".  This is an interesting finding considering the fact that this is a deeper dive into one district. Another finding from this analysis was that, although both El Puente Academy and Lyons Community School are under-performing schools, there are still significant differences that exist between the two.
STUDENT OPINION TOWARD IN-CLASS WORK
The Brooklyn Latin School scores higher on almost every statement except for 5e. This means that students that attend that school are more likely to feel more challenged, asked more difficult questions on tests, asked more difficult questions in class, and work in small groups. However, students in all three schools feel that their teachers want them become better thinks, instead of just being able to memorize information.
STUDENT OPINION OF OTHERS
Consistent with the overall comparison, we see the the over-performing school (The Brooklyn Latin School) scores higher on every statement. Again, this finding is to be expected when comparing over- and under-performing schools. However, there are some significant differences between El Puente Academy and Lyons Community schools even though they are both under-performing schools. On 6e and 6h, so students at El Puente academy are more likely to behave well when the teacher isn't watching and feel that homework is important.
STUDENTS OPINIONS ON HARASSMENT/BULLYING/INTIMIDATION
When drilling down to these three schools specifically, I was surprised at these results. Only one of the under-performing schools follow the previously identified trend of students in under-performing schools to be more likely to agree with these statements. There aren't many significant differences between The Brooklyn Latin School and El Puente Academy, except for 8f. However, students that attend Lyons Community School are two to three times more likely to agree with nearly every statement except for 8g. Students at the Brooklyn Latin School are significantly more likely to drink alcohol, use illegal drugs, or abuse prescription drugs than their under-performing counterparts.
SCHOOL COMPARISON
From the Teacher Perspective
Again, results of this deeper dive into district 14 revealed similar trends to the overall comparison. There were significant differences in questions 21, 22, 23, and a few other miscellaneous questions. Questions 21 and 22 relate to student  behavior and 23 relate to adult behavior within the school. There was also another question that had significant differences as well, question 10. Question 10 is a set of agreement statements that focus on the relationship between teachers/principals and students' parents or families. I categorized this question as "teacher/parent relationships and involvement". Another interesting finding from this analysis, which was consistent with the previous student response deep dive, is that there are some differences between both under-performing schools.
TEACHER/PARENT RELATIONSHIPS AND INVOLVEMENT
Question 10 asks teachers a set of agreement statements that relate to their relationship with student's parents/guardians/families. For every statement, teacher in the under-performing schools were more likely to agree. This indicates that at those schools parents/guardians are more likely to be offered opportunities to visit/observe classrooms, be in regular communication with teachers to learn ways to assist students, and provide feedback to principal/school leaders through regular meetings with teachers. In addition, teachers at the those schools are more likely to understand families problems and concerns and work closely with families to meet student needs.
STUDENT BEHAVIOR
Based on Teacher Survey Response
Question 21 is a set of statements which relate to student behavior in classroom. The results of this analysis are not exactly in line with the previous overall teacher student behavior results. The previous analysis revealed that student in over-performing schools would perform better in classroom when compared to under-performing schools. However, the only statement that has a higher agreement score by The Brooklyn Latin School is on 21c, which says that student show that they respect others' ideas. Otherwise, El Puente Academy has higher scores on every other question. The Lyons community schools follows a similar trend to the overall comparison by consistently scoring lower than The Brooklyn Latin on each statement.
Question 22 is another question that focuses on student behavior, but again some of these questions were asked to students as well. In contrast to the previous question, The Brooklyn Latin has higher scores on each statement except fro the 22g. For statement 22g, students at El Puente academy are more likely to respond to challenging questions in class.
Every statement on this question, except for 22g, was included on the student survey. The higher score for the Brooklyn Latin school are consistent with the higher scores from the student survey as well.
ADULT BEHAVIOR
The trends that arise here are also not consistent with the findings from the overall comparison. Previously, over-performing schools scored higher on every statement, but here it more or less equal with the exceptions of statements 23f and 23g. In both under-performing schools, adults are more likely to recognize disruptive behavior are socio-emotional learning opportunities and teach students the skills the need to regulate their behavior.
OTHER DIFFERENCES
As far as other questions/statements from the survey that had significant differences, there were only a few. Both under-performing schools have higher scores on statements 5b, 12b, and 12e, all of which relate to the principal/school leader. In both schools, teachers are more likely to agree that the principal/school leader is an effective manager, communicates a clear vision, and participates in instructional planning with teams of teachers. However, the over-performing school has the highest possible score on 6e, agreeing that order and discipline are maintained in the school. Finally, question 8 asks teachers about bullying, harassment, and intimidation in the school. The Brooklyn Latin School has a higher score than El Puente Academy, but both schools have significantly lower scores than Lyons Community School.
DISCUSSION
Overall, this has been an incredibly interesting and thought-provoking project. Initially, I figured that there would be a clear distinction between each over- and under- performing schools in regards to their survey responses for every single question and statement. However, that obviously was not the case.
When examining schools, one stark difference that I noticed between the over- and under-performing schools was the distribution of Low Income Students. Most students in the under-performing schools are defined as low-income students, whereas the over-performing schools have a much wider distribution. Additionally, there are over-performing schools spread across all five boroughs and in a number of districts. For the under-performing schools there are less districts and boroughs and more schools in the same districts. This raises a number of questions for me. For example, what are the resources like in these districts? How much does income play a role in these school performances? And who's income has the largest impact on student/teacher performance? Is funding proportionally distributed in districts in the same borough?
​
Nonetheless, there not being many differences between student responses on the survey suggests that students do not really understand how to adequately evaluate their educational experience. When I think more about this, I realized that this does make sense. Students that have attended over- or under-performing schools their entire life only have one perception of education. There is nothing for them to compare it to, to determine whether it is "good" or "bad." Differences in agreement on question 6, suggest that students in over-performing schools are more likely to: listen carefully, follow rules, pay attention, behave, do their work, try hard to get good grades, feel it is important come to school, and think doing homework is important than students in under-performing schools. Again, this is consistent with what is expected of an over-performing school but it's still important to acknowledge that students in the under-performing schools also had high agreement scores on these statements. The teacher agreement scores support these findings as well. Teachers in over-performing schools were more likely to agree with each statement that evaluated students performance in class. Conversely though, question 21e asks how many students participate in class discussion, and this has the highest agreement among the statements for under-performing schools. This raised the question that maybe students do actively want participate but are not able to build on other ideas or provide constructive feedback to their peers because they haven't learned the critical communication skills to do so.
​
One of the most interesting findings for me was the differences in question 8, which surrounds bullying/harassment/intimidation. Students in under-performing schools are two to three times more likely than students in over-performing schools to agree to those statements, indicating that those events take place significantly more often in under-performing schools than over-performing schools. These findings result in me questioning the safety of the students. It also just makes me wonder simply why is this prevalent in under-performing schools? What factors affect these bully/harassment/intimidation situations in schools and how does it affect learning? Personally, I believe that it has a lot to do with socio-emotional intelligence. This time period is critical for SEL (socio-emotional learning) development in children. If students were better able to manage their emotions and behaviors they may be less likely to act in theses negative situations. Question 23 on the teacher survey touches upon this idea. Statements 23f and 23g have the lowest scores in both under- and over-performing schools. Both statements focus on social-emotional learning and behavior regulation. Perhaps if there was more focus on these aspects, that would address some of those issues.
​
There are a number of questions that remained unanswered for me after the overall comparison, so I felt that the district 14 deep dive may be able to shed some light. I figured that focusing in on one single district would eliminate a number of outside factors, one them being specifically the income question. Since these schools were all in one district, I figured that they would have a similar student demographic. However, the deep dive only left me with a number of other questions. From the student perspective, the scores mostly followed the overall trend of over-performing schools performing better than under-performing but the comparison of the two under-performing schools revealed some stark differences in scores. On the other hand, the teacher survey revealed results that contrasted the overall comparison. For example, teachers/principals in under-performing schools are more likely to have greater communication and involvement with parents/guardians/families than in over-performing schools. I would have expected it to be the opposite, but it seems that these under-performing schools attempt to help their students in anyway that can. Moreover, question 21 revealed that one of the under-performing schools (El Puente Academy) performed better than the over-performing school on a number of statements. If El Puente Academy was removed, then a comparison of The Brooklyn Latin School and Lyons Community schools would have followed the previously identified trend of over-performing schools performing better. As far as adult behavior and the other miscellaneous questions, it suggests that there are not clearly identifiable trends, mostly due to the variation of scores between both under-performing schools.
​
I conducted a little more research on schools located in district 14 and one I found that The Brooklyn Latin School is the only over-performing high school in this district, all other high schools have a GreatSchools rating of 5 or below. Additionally, the Brooklyn Latin School is actually one of NYC's specialized high schools. There are nine selective specialized public high schools, all of which are run by the Department of Education, that cater to students that are academically or artistically gifted. To learn about specialized high schools, click here. The fact that The Brooklyn Latin School is a specialized high school raises another set of questions. If students that live in this district would like to attend this school, they must be accepted through the SHSAT. For students that have attended under or lower performing school in this district, this may be incredibly difficult for them. Do students in this district have the same resources as students that attend The Brooklyn Latin School? Are students in this district educationally prepared to score high enough on the SHSAT to be accepted into a specialized high school? Are specialized high school necessary? How are they funded? What districts are they in? Do they require more resources than other schools in their district?
There are number of questions that I have currently in regards to this topic. Again, conducting this analysis was incredibly interesting and revealed some insightful findings. I think that the major takeaway from this research is that students and teachers in both under- and over-performing schools do not have drastically different thoughts, attitudes, and behaviors. It also seems that a school can not simply be defined by a numeric score to determine whether is under- or over-performing. I think that this analysis revealed that there are a number of layers involved in determining performance of schools. It cannot be attributed to simple just the students, teachers, the principals, location, funding, etc. There are obviously a number of different facets that need to be considered when evaluating school performance to understand how and why a gap exist, then how to address issues to close the gap.
Works Cited
Your Right to Equality in Education. Retrieved April 19, 2020, from https://www.aclu.org/other/your-right-equality-education
Jones, C., Ma, L., Fertig, B., & Willens, P. Guide: Understanding New York City Schools: WNYC: New York Public Radio, Podcasts, Live Streaming Radio, News. Retrieved May 7, 2020, from https://www.wnyc.org/schoolbook/guides/understanding/
NYC School Survey. Retrieved February 10, 2020, from https://www.schools.nyc.gov/about-us/reports/school-quality/nyc-school-survey
Nyc Geog District #14 - Brooklyn. Retrieved May 7, 2020, from https://www.greatschools.org/new-york/brooklyn/nyc-geog-district-#14-_-brooklyn/#TopSchools*HighSchools
Specialized High Schools. Retrieved May 10, 2020, from https://www.schools.nyc.gov/enrollment/enroll-grade-by-grade/specialized-high-schools