Skip to main content

 

Summary

Associate Minister of Education, David Seymour wants to cut funding to the Ka Ora, Ka Ako Healthy School Lunch Programme by 30-50%, claiming it does not improve attendance or school achievement. 

In part two of a three-part series, we highlight that the programme evaluations commissioned by the Government have never sought to evaluate impact on school achievement. In the absence of direct impact evaluation, we present findings from three large-scale international studies, describing the compelling relationship between hunger in schools in Aotearoa New Zealand and achievement, linking this back to the need for food poverty interventions like Ka Ora, Ka Ako. This is particularly important for ākonga Māori, who make up half of the students receiving the lunches, and for whom, lower on average achievement is exacerbated by higher rates of food poverty.

Earlier this month the coalition Government announced that the Ka Ora, Ka Ako school lunch programme was under review, with Associate Minister of Education David Seymour announcing that funding may be cut by 30-50% in this year’s budget. The main reasons given for this cut were that evaluations of the programme had not shown any impact on attendance and achievement.

The Nourishing Hawke’s Bay: He wairua tō te kai team has been researching the impact of the school lunches programme since 2020 when it was first introduced in a few pilot schools in three regions. We have reported high rates of students running out of food at home in schools eligible for the programme.1 We have held focus groups with whānau and high school students to document how the programme reduces financial hardship and discussed ways to increase uptake and reduce food waste and food surplus.2 We have interviewed school lunch suppliers reporting the integral role of school staff in programme success3, delved into whether it can be successfully implemented in schools implementing Te Ao Māori approaches,4 documented the broad impacts at the child, whānau, school, community and food systems levels,5 and further demonstrated how a well-implemented programme can enhance policy outcomes across a range of sectors.6

We have also followed closely the Ministry of Education’s interim analysis7, a larger evaluation on attendance, hunger and wellbeing8,9 and the kaupapa Māori evaluation of the iwi and hapu model.10 In all of this time, we have not seen any evaluation by the Ministry of Education on the impact of the lunches on student achievement.

One of the reasons this evaluation would be very hard to do is because of the confounding factors. By definition, schools that receive the lunches are lower advantage than schools that don’t and accordingly, student achievement in these schools is generally lower.  

In the absence of evaluation data directly linking Ka Ora, Ka Ako participation to student achievement, we sought other indicators of the impact of hunger for students in New Zealand on school achievement and found that significant amounts of data exist.

Earlier this month we revealed data from the Programme for International Student Assessment (PISA) showing that students in Aotearoa New Zealand who go hungry due to lack of money, even just once a week, were two to four years behind in their achievement scores compared to students who never go hungry.11

Further analysis of the PISA 2022 results shows that for Māori students, the impact is even more severe with 23.5 % missing meals at least once a week (compared to 14% of students overall), and 9.5% missing meals every day compared to 6.5% overall. Overall, ākonga Māori have, on average, lower achievement in the PISA study compared to NZ as a whole. Ākonga Māori who go hungry are one to three years behind their peers who never go hungry (Figure 1, regression in Appendix). Lower than average PISA achievement for ākonga Māori is well documented,12 but these analyses highlight how low achievement is reduced even further by hunger. This is essential to consider in the context of Ka Ora, Ka Ako, where 50% of students are Māori.

Plot comparing food poverty and PISA scores between Māori and all New Zealanders
Plot comparing food poverty and PISA scores between Māori and all New Zealanders

Figure 1. Proportions of 15-year-olds students in food poverty (overall and for Māori) and associated PISA maths achievement from regression model after socioeconomic advantage held constant. *Category “4-5 times per week” has been removed in this graph due to lack of numbers in this category.

Two further international studies also provide powerful evidence on the impact of hunger on achievement for NZ students.

The Trends in International Mathematics and Science Study (TIMSS) looks at maths and science achievement for Year 5 and Year 9 students every four years across 58 countries.13 In Aotearoa New Zealand, over two thirds of Year 5 and Year 9 students feel hungry at least sometimes when they arrive at school (Figure 2). The gap between the scores for students arriving at school hungry every day or almost every day and those who didn’t feel hungry, was between 43 and 49 score points in maths and science. This was one of the highest gaps in achievement observed internationally. An update to this data with the results for TIMSS 2023 is expected this year.

Figure 2. Percentages of Year 5 and Year 9 students arriving at school hungry in Aotearoa New Zealand
Figure 2. Percentages of Year 5 and Year 9 students arriving at school hungry in Aotearoa New Zealand

Figure 2. Percentages of Year 5 and Year 9 students arriving at school hungry in Aotearoa New Zealand and maths and science achievement (TIMSS 2018/19)

The Progress in International Reading Literacy (PIRLS)14 study measuring Year 5 reading literacy every five years in 58 countries, provides a similar image of declining achievement over categories of increasing hunger; this time in reading. In NZ in 2021, over 80% of students, who have not yet finished primary school, reported feeling hungry on arrival at school and achievement dropped over 55 points for students who feel hungry every day (Figure 3).

PRILS scores and food poverty
PRILS scores and food poverty

Figure 3. Percentages of Year 5 students in Aotearoa New Zealand arriving at school hungry and reading achievement (PIRLS 2021)

The data tell a compelling story. These international large-scale assessments offer a valuable avenue for more in-depth and reliable exploration of the relationship between hunger and direct and comparable measures of achievement across countries.

In preparation for Budget 2024, these are the best available data showing how achievement drops off as student experience of hunger increases, across multiple subject areas and year groups, and reported by several studies. These studies show hunger poses a significant threat to educational achievement and requires immediate action.

Undoubtedly, the school lunch programme needs continuous improvement to ensure the food is high quality and appetising for students. However, the evidence is clear: Ka Ora, Ka Ako alleviates hunger8 and less hunger improves school achievement.

What’s new in this briefing?

  • We report high rates of food poverty for 15-year-old Māori students in the PISA study.
  • PISA, TIMSS and PIRLS now provide compelling evidence for the sizeable impact of hunger on student achievement across different age groups, study years and subject areas.

Implications for public health

  • Hunger is a major threat to public health and educational attainment and needs to be urgently addressed.
  • Hunger and corresponding drops in educational achievement are an equity issue and funding for lunches that address this should not be removed.

Authors details

Dr Pippa McKelvie Sebileau
Dr Renee Railton, Te Kura i Awarua, Eastern Institute of Technology, Napier

 

Competing interests: Authors declare no competing interests. The first author is a founding member of the Nourishing Hawke’s Bay research programme and was previously employed as a data analyst on the Programme for International Student Assessment study at the Australian Council for Educational Research.

Read part one of the series – Evidence for free school lunches: The bigger picture benefits

 

Acknowledgements: We are grateful to the Educational Measurement and Assessment team within the Ministry of Education for their analysis of the PISA data.

Appendices

Regression analysis for ākonga Māori - adjusting for socioeconomic deprivation

A linear regression model was used to estimate the effect that food insecurity (once a week, 2-3 times a week, 4-5 times a week and every or almost every day, reference: never) had on Māori students’ mean PISA maths score, holding the student’s level of socioeconomic deprivation constant (PISA ESCS variable).  

 SAS macro used – detailed here https://www.oecd.org/pisa/pisaproducts/pisadataanalysismanualspssandsassecondedition.htm

 

Variable

Effect size

Estimate

Standard errort value
Intercept434.754.13105.15
Socioeconomic deprivation  - ESCS27.073.278.29
Food insecurity once a week-15.7010.49-1.50
Food insecurity 2-3 times a week-45.3816.03-2.83
Food insecurity 4-5 times a week*-57.3525.85-2.22
Food insecurity every or almost every day-53.739.89-5.43

 *Note limited number of students in this category

 

 

Creative commons

Public Health Expert Briefing (ISSN 2816-1203)

References

  1. McKelvie-Sebileau P, Gerritsen S, Swinburn B, D’Souza E & Tipene-Leach D (2022) Nourishing Hawke’s Bay: He wairua tō te kai – food security, health behaviours and wellbeing in children in regional New Zealand, Journal of the Royal Society of New Zealand, 52:4, 357-375, DOI: 10.1080/03036758.2022.2064519
  2. McKelvie-Sebileau P, Swinburn B, Glassey R, Tipene-Leach D, Gerritsen S. Health, wellbeing and nutritional impacts after 2 years of free school meals in New Zealand. Health Promot Int. 2023;38(4):daad093.
  3. Chote B, Rees D, Swinburn B, McKelvie-Sebileau P, Glassey R, Tipene-Leach D. Systems Mapping of the New Zealand Free and Healthy School Lunch Programme: Perspectives from Lunch Providers. Nutrients. 2022 Oct 17;14(20):4336. doi: 10.3390/nu14204336. PMID: 36297018; PMCID: PMC9609766.
  4. Glassey R. Mātauranga Māori and kai in schools: An exploration of traditional Māori knowledge and food in five primary schools in regional New Zealand [in review]. Food Ethics. 2023.
  5. Garton K, Riddell C, McKelvie-Sebileau P, Glassey R, Leach DT, Rees D, et al. Not Just a Free Lunch a logic model and evidence review for the Ka Ora, Ka Ako | Healthy School Lunch programme. Policy Q. 2023 May 31;19(2):75–87.
  6. McKelvie-Sebileau P, Riddell C, Swinburn B, Rees D, Glassey R, Tipene-Leach D, Garton K. Beyond hunger: How the school lunch programme Ka Ora, Ka Ako could enhance sustainability, education and health goals in Aotearoa New Zealand, submitted to special issue J Royal Society NZ, Jan 2024.
  7. Vermillion Peirce P., Blackie E, Morris M, Jarvis-Child B, Engelbertz S. New Zealand Healthy School Lunch pilot Ka Ora, Ka Ako Interim Evaluation. Wellington; 2021. 
  8. Vermillion Peirce P, Jarvis-Child B, Chu L, Lennox K, Kimber N, Clarke H, et al. Ka Ora, Ka Ako New Zealand Healthy School Lunches Programme Impact Evaluation. Wellington; 2022. 
  9. Standard of Proof Ka Ora, Ka Ako Healthy School Lunches Programme – Supplementary Attendance Analysis for Most Underserved Ākonga (13 March 2024). https://assets.education.govt.nz/public/Documents/our-work/strategies-and-policies/Ka-Ora-Ka-Ako-attendance-18-03-24.pdf
  10. Aikman P, R Y-P. He Kai Kei Aku Ringa: Evaluation of the Iwi and Hapu Social Procurement and Partnership Model, under Ka Ora, Ka Ako | The Healthy School Lunches Programme. 2023;75. 
  11. McKelvie-Sebileau P, Swinburn B (2024) Food poverty for NZ teens creating an achievement lag of up to four years. Public Health Communications Centre Expert briefing. https://www.phcc.org.nz/briefing/food-poverty-nz-teens-creating-achievement-lag-four-years
  12. Ranson C (2023) PISA 2022 Ākonga Māori Summary. Published by Ministry of Education, Wellington. PISA-2022-Akonga-Maori-Summary.pdf (educationcounts.govt.nz)
  13. Mullis I, Martin M, Foy P, Kelly D, and Fishbein B (2020) TIMSS 2019 International Results in Mathematics and Science. TIMSS 2019-International-Results-in-Mathematics-and-Science.pdf (iea.nl)
  14. Reynolds K.A., Komakhidze M., Fishbein B., & von Davier M. (2024). Aspects of Student Well-Being and Reading Achievement in PIRLS 2021 (PIRLS Insights). Boston College, TIMSS & PIRLS International Study Center. https://doi.org/10.6017/lse.tpisc.tr2103.kb1236
  15. Schwartz, A.E. and Rothbart, M.W. (2020), Let Them Eat Lunch: The Impact of Universal Free Meals on Student Performance. J. Pol. Anal. Manage., 39: 376-410. https://doi.org/10.1002/pam.22175

About the Briefing

Public health expert commentary and analysis on the challenges facing Aotearoa New Zealand and evidence-based solutions.

Subscribe

Briefing CTA

Public Health Expert Briefing

Get the latest insights from the public health research community delivered straight to your inbox for free. Subscribe to stay up to date with the latest research, analysis and commentary from the Public Health Expert Briefing.