Te aromihi pouako e puta ai ngā ihu o ngā ākonga Māori

Using evidence in inquiry

A major theme that emerged from the Ruia exploratory study was the importance of schools using data rigorously throughout inquiry to understand the initial situation clearly, to monitor how teachers and students respond to new learning, to find out what has changed during a cycle of inquiry, and to establish priorities for further investigation.

DSC_0008-1

Inquiry is about building knowledge and regulating practice. We need to know what is important to focus on in relation to the outcomes we are working towards. Data is key to understanding what we know now and what we just think we know.

Selecting and analysing data

Currently, many schools collect a great deal of information about their students, but often it isn’t used to drive improvement (Hattie, 2005). Useful data helps teachers and school leaders to understand:

  • what students need in order to achieve outcomes that the school community has identified as important
  • where students stand in relation to national patterns of progress
  • in what areas students need support to catch up with others in their year group.

Collecting data in connection with less tangible (such as sociocultural and affective) outcomes is more difficult, requiring close observation and learning conversations with students, parents, and whānau. 

Schools also collect data about teacher knowledge and practice, and they should be collecting data about their relationships with whānau. The key to using this data effectively within appraisal is to connect it both to data on student goals and outcomes and to data about school-wide needs and priorities.

Bishop and Glynn (1999) remind us that “culture counts”. In deciding on the data to collect, schools need to take into account the aspirations of whānau and the knowledge and skills that they regard as important, including cultural knowledge and practices and language. What are those aspirations, and what is the data you need to collect to find out whether they are being achieved? This may not be the same across different Māori communities and whānau.

INSTEP and data collection and analysis

The Inservice Teacher Education Practice (INSTEP) project (Ministry of Education, 2008) identified three steps in the data collection process:

  1. Deciding what information is needed
  2. Choosing appropriate tools
  3. Using the tools.

To begin, schools need to disaggregate the data for Māori students and for specific cohorts of Māori students (for example, boys versus girls). That data then needs to be organised so that all those with responsibility for student learning, including whānau, can access it and make sense of its implications. Data does not become evidence until it has been analysed for what it reveals about the efficacy of current beliefs and practices about teaching and learning. This analysis requires more than understanding statistics – it means asking where students are, why they are there, and what teachers, leaders, and whānau can do, individually and collectively, to help them do better.

INSTEP further describes the analytical process as one of “making sense” of the data that has been gathered. This needs to be done within an analytical framework.

INSTEP describes three steps in the critical analysis of data:

  1. Drawing initial inferences on the basis of our expectations
  2. Asking deeper, more complex questions in order to make sense of the data
  3. Making decisions about where to go next.

ERO and data collection and analysis

The Education Review Office (2011) describes data collection and analysis in terms of three “levels”:

The first level of analysis is the gathering of raw or aggregated data. Some of the data will be quantitative/numerical and some will be qualitative/narrative. The data describes “what is” or “what is happening”.

The second level of analysis takes data and turns it into information. It allows schools and kura to make key statements or comparisons. It is used to inform people or planning. It describes “what is significant”.

The third level uses this information as evidence to support judgments “how well/to what extent”, to make decisions “if this is so, then we need to …”, and to decide priorities “the most compelling need is …”

page 10

Building confidence with data

The process of selecting and analysing data, which occurs throughout the inquiry cycle, can make people feel vulnerable. A key theme from the Ruia exploratory study was that teachers and school leaders should not be afraid of the data. Rather they should feel supported as they build their confidence in working with data and understanding what it is telling them about the next steps for them and their students.

It is important to keep the data alive as part of the ongoing inquiry. This means organising and storing it so that it is easily accessible and enables students’ progress to be tracked. Increasingly, student management systems are evolving to allow trends and patterns to be studied over time. For example, users can identify attendance patterns and which students are not attending. Teachers, leaders, and whānau can then collaborate to address the issue.

A good way of making the monitoring of progress more manageable for teachers is to select a small group of Māori students in each class as ‘focus students’ for more intensive tracking. This does not mean that other students are ignored; in fact, experience shows that this raises teachers’ awareness of how their practice impacts on all their students.

Schools that are committed to educationally powerful partnerships ensure that parents and whānau can use this tracked information so that they, too, understand their children’s progress and can participate in identifying their next learning steps. (Note, though, that it remains important to respect students’ right to privacy.)

Conducting inquiries

Ki te Aotūroa: Improving Inservice Teacher Educator Learning and Practice is intended primarily for inservice teacher educators (ISTEs) but includes a wealth of useful material for all educators, particularly school leaders. A chapter on the practical aspects of inquiry examines each phase of the inquiry and knowledge-building cycle. The cycle is adapted for ISTEs, but the big ideas that underpin it are true for all inquiry-based learning. Of particular value are the links to cases from actual practice that illustrate ISTEs supporting teachers and school leaders to inquire into and improve their practice.

Return to top