SlideShare una empresa de Scribd logo
1 de 12
i
          Conversations with the mathematics curriculum: testing and teacher
                                    development

                  Karin Brodie, Yael Shalem, Ingrid Sapire, Lynne Manson
          Karin.Brodie@wits.ac.za, Yael.Shalem@wits.ac.za, Ingrid.Sapire@wits.ac.za,
                                 Lynette.Manson@wits.ac.za


This paper addresses the question: how do mathematics teachers make meaning from curriculum
statements in relation to their teaching practices. We report on a teacher development activity in
which teachers mapped test items from an international test against the national curriculum
statement in mathematics. About 50 mathematics teachers across Grades 3-9 worked in small
groups with a graduate student or staff member as a group leader. Drawing on focus group
interviews with the teachers and the group leaders we show that the activity focused the teachers on
the relationships between the intended curriculum and their teaching, i.e. the enacted curriculum, in
four areas: content coverage; cognitive challenge; developing meaning for the assessment
standards; and sequence and progression. We argue that the activity illuminates ways in which
international tests can provide a medium for teacher growth rather than teacher denigration and
alienation.

Introduction
Recent research has identified misalignment between the demands of the curriculum, teaching and
assessment. Classroom research suggests that many teachers simply ignore important aspects of the
new national curriculum statement (NCS) and continue to teach how they taught before; others
support the ideals of the new curriculum but struggle to enact it in practice (Chisholm et al, 2000;
Jansen, 1999), while others create hybrid practices, drawing on the new curriculum as well as their
traditional practices (Brodie, 2007; Brodie, Jina and Modau, 2009). A report submitted to Umalusi
shows “considerable inaccuracy in continuous assessment in South African schools” (Shepherd and
Van der Berg, 2007). The most common finding is that the CASS (continuous assessment) marks
are much higher than the final senior certificate examination. These studies suggest that teachers
struggle to interpret many aspects of the new curriculum.
A number of explanations for teachers’ difficulties have been offered. First, the NCS is
underspecified in both content and progression and therefore cannot act as a guide for teachers
(Muller, 2006, Shalem, 2007). Second, teachers lack strong enough content knowledge (Taylor and
Vinjevold, 1999) to “design down” (South African Qualifications Authority, 2005) tasks, activities
and assessments from the outcomes. Third, “one of the unfortunate effects of the way in which
Outcomes Based Education (OBE) has been interpreted in South Africa is that teachers very rarely
use textbooks, either to prepare lessons, or as a teaching tool during their classes” (Joint Education
Trust, 2008, p.8). The common thread that runs through the above explanations is that the main
problem of the NCS lies in its form: the NCS underspecifies the school subject content and
therefore cannot guide teachers whose content knowledge is weak and who do not use textbooks.
Missing from these explanations is an account of what counts as an interface between the intended
curriculum and teacher knowledge and practice, and what the structure of that interface might be. In
different ways all of these explanations accept uncritically the idea promoted by the South African
Qualifications Authority (SAQA) of “design down” (South African Qualifications Authority, 2005),
assuming a one-way relationship between “the intended curriculum” (the NCS) and “the enacted
curriculum”, the activity of teaching. This paper shows that the process of teachers’ interpretations
of the intended curriculum in mathematics is far more complex than what the idea of “design down”
allows. We present a small case study of mathematics teachers “finding the curriculum”
(Kauffmann et al, 2002), and offer this idea as a better description of the process.
The central question that this paper addresses is how do mathematics teachers come to make
meaning from curriculum statements in relation to their teaching practices. We report on a teacher
development activity in which teachers engaged in conversations as they attempted to map test
items taken from an international test against the NCS in mathematics. We show that this activity
opened up important aspects of the intended curriculum for teachers: content coverage, cognitive
challenge; sequence and progression in the curriculum; and more broadly the deeper meaning of its
assessment standards. We argue that the activity provides a way in which international tests can
provide a medium for teacher growth rather than teacher denigration and alienation.
From the perspective of teacher development we argue that teachers need an artefact, external to the
intended curriculum, which they can use to mediate between the intended curriculum and their
professional knowledge and experience, which shapes the enacted curriculum. In arguing for this
kind of mediating activity we do not refer to curriculum instruments like learning programmes or
textbooks, which flesh out specific content in relation to specific learning outcomes and assessment
standards per grade. Although we acknowledge the importance of this kind of curriculum
technology and join others who advocate the use of textbooks, we argue for a structured process of
interface in which teachers are actively engaged in curriculum translation of the disciplinary
material that is embedded in the curriculum statements. We imagine the interactions as follows:


                              Teachers’ knowledge and experience




                                               Artefact



                                               Interface
               Intended curriculum                                  Examined curriculum



                                         Enacted Curriculum


Our paper fleshes out this diagram. First, we briefly describe the official policy of “design down”,
foregrounding the policy assumptions about the process of translation of the intended curriculum
into practice, i.e. the enacted curriculum. We then describe our teacher development project with
specific reference to one of the teacher learning activities: curriculum mapping. We describe the
structure of the activity, which created the interface between the intended, enacted and examined
curriculum. This is followed by a discussion of the four aspects of the curriculum on which the
teachers reported a better understanding and finally we deduce the four main principles in relation
to teachers “finding the curriculum” which transpire from the analysis of the interface.
The official view of curriculum translation –“Design Down”
SAQA (2005, p.6) presents the “design down” approach as a process that consists of four main
steps. Each step is dependent on the previous one, in that the step that follows provides more
information and requires deeper understanding of the NCS. The following are the steps:
Step One: Analysis of the purpose of the qualification: For mathematics teachers this means an
understanding of the scope and cognitive challenge required for the mathematics learning
programme they develop for the school grade they teach.
Step Two: Analysis of how the purpose can be achieved: What will the learners need to be taught in
order to achieve the purpose?
Step Three: Analysis of what knowledge must be demonstrated and how: What kind of assessment
is appropriate and in what form should it be designed in order to benchmark whether the learners
have achieved the outcomes or not?
Step Four: Analysis of what needs to be done to prepare learners: How to make school knowledge
available for learners’ acquisition, what teaching and learning activities to design in order to
enhance learners’ access to mathematical knowledge?
The success of this process appears to depend mainly on the clarity of the outcomes (step two) and
of the assessment standards (step three) as well as on the sequence and logical progression of the
outcomes and assessment standards within a grade and between grades, across all the phases.
Although all of the steps rely on teachers’ knowledge and their access to other curriculum
documents, steps one and two require that teachers work with their colleagues and recruit from their
collective experience (South African Qualifications Authority, 2005). Thus SAQA presents the
process of “design down” as an interactive process between the intended curriculum and teachers’
professional knowledge and experience. In SAQA wording, the interpretive activity provides two
sequential processes: a planning process or “design down” (as described above) and a delivery
process, which is teaching, defined as “deliver up”, which they describe as “to conduct learning
activities which will prepare your learners for the assessment activities” (ibid). Describing the
process in this way has led researchers to examine the form of the curriculum and teacher
knowledge, and to argue that the limitations are with the curriculum and/or teachers. Very little is
written on the conceptual limitation of the idea itself - “design down/deliver up”. A few comments
on this are due.
The task of working with a curriculum is substantial (Kauffmann et al, 2002). In a study with
teachers in their first and second years of teaching, Kauffmann et al show that some teachers
encountered curricula that consisted of achievement standards without details of content, sequence
or methods, which one teacher called “mindbogglingly comprehensive and vague” (p.290), while
others found only lists of topics and skills, with no guidance as to sequence or method. Given the
lack of time and the range of other demands on the teachers, they tended to respond “frantically and
haphazardly” (p.279), working from day-to-day, instead of developing coherent, long-term plans.
Almost all of the teachers in the study acknowledged this as a weakness and longed for more
specification, from the curriculum, textbooks and colleagues. Kauffmann et al formulate the
teachers’ experience as follows: “They entered the classroom expecting to find a curriculum with
which they would struggle. Instead they struggled to find a curriculum” (p.291).
Finding a curriculum requires a range of skills and knowledge on the part of teachers. Mathematics
teachers need to recognize the progression of content and concepts and of practice in the discipline
of mathematics in the curriculum documents. They need to be able to devise learning activities
which realize the form in which claims are authorized and justified in mathematics (Ford and
Forman, 2006). When teachers interface with the intended curriculum they need to move between
the various assessment standards within and across the grades, in order to bring them together or
separate them in ways that make sense for particular practice and for particular learners. It is not
always easy to recognize epistemological criteria, coverage, sequence and progression through the
intended curriculum (Bernstein, 1999; Schmidt et al, 2005). How the intended curriculum is
mediated for and with teachers is crucial to their developing the recognition and realization rules
(Bernstein, 1996) for appropriate pedagogy - how they see their disciplines in and through the
intended curriculum and how they help learners to enact disciplinary knowledge and action in the
classroom.
Creating the interface: the artefact and activity
Recently there has been substantial investment by different governments around the globe,
including our own, in testing and data collection for benchmarking exercises, which emphasise the
use of data as a policy lever for benchmarking standards and for monitoring performance. So for
example, writing for the United States context, Earl and Fullan state:
    Data has become the vehicle of choice for ensuring accountability. Government mandated reform is
    spearheaded by focus on results, with demands for evidence firmly embedded (Fullan, 2000). Nations,
    states, provinces and school districts have implemented large-scale assessment systems, established
    indicators of effectiveness, set targets, created inspection or review programs, tied rewards and sanctions
    to results and many combinations of the above. (2003, p. 384)
More recently, research has begun to engage with the question of how to use test data beyond
accountability benchmarking (Earl and Fullan, 2003: Earl and Katz, 2005). The key issue is how to
transform data collected from testing into structured learning opportunities for teachers. With
reference to this question, Katz et al (2005) draw an important distinction between two very
different kinds of practices in benchmarking: “accounting”, which is the practice of gathering and
organising of data; and “accountability”, which refers to teacher-led educational conversations
about what the information means and how it can inform teaching and learning.
The activity that this paper reports on is a curriculum mapping activity, which has two interrelated
aims: first, to see the extent to which an international test (the ICAS1 test) reflects the National
Curriculum Statement in mathematics in South Africa, as well as what mathematics teachers
actually teach in their classrooms; and second, to develop teachers’ understanding of the conceptual
demands of the test items in relation to the intended curriculum and their own teaching. The activity
was part of a teacher development project, which aims to create a context for professional
conversations among teachers about what international test data (the examined curriculum) means,
how it aligns with the conceptual demand of the National Curriculum Statement (the intended
curriculum), how it fits with teachers’ professional knowledge and experience, and how can it be
used to make concrete changes in their classroom practice (the enacted curriculum). About 50
mathematics teachers across Grades 3-9 work in groups of about 3-4 teachers (2 groups per grade)
with a graduate student or staff member from our university as a group leader, all of whom have
been or currently are mathematics teachers. Subject facilitators from the Gauteng Department of
Education also participate in the project. The teachers come from schools which wrote the tests and
they have seen the overall results, which are very poor: with the average percentage correct in each
grade in 2006 as follows: Grade 3: 38%; Grade 4: 37%; Grade 5: 35%; Grade 6: 30%; Grade 7:
30%; Grade 8: 25%; Grade 9: 25%.
The curriculum mapping activity involved:


1
  International Competitions and Assessments for Schools (ICAS) tests developed in Australia and used by
the Gauteng Department of Education in a number of schools in Gauteng.
•   Teachers deciding which mathematical concepts or skills were needed in order to find the
    solution to a test item and choosing an assessment standard (or several assessment standards)
    which they thought was/were aligned to the item.
•   Extended discussion about the concepts represented in the assessment standard(s) and whether
    or not the selected assessment standard(s) did or did not fit with the particular concepts tested
    by the item. The teachers needed to explain the reasons for mapping (aligning) the item against
    an assessment standard or against several assessment standards described in the curriculum
    statement.
•   Discussion about when and how the teachers actually teach the concepts and how, if at all, they
    link these concepts to other mathematical areas.
For the mapping activity, each teacher was given a detailed version of the NCS (RADMASTE,
2005). The teachers told us that this version helped them to navigate and refer to the document more
easily. The tabulated NCS has a landscape page setup and matches the assessment standards for
each grade, across the page, using numbers (the example below shows a truncated row, all full rows
in the document go up to Grade 9). This makes it easy to compare the assessment standards across
grades and to see at a glance how concepts are built up in each grade.

1.1.122            2.1.12                       3.1.12                      4.1.12                    5.1.12
Performs mental    Performs mental              Performs mental             Performs mental           Performs mental
calculations       calculations involving:      calculations involving:     calculations involving:   calculations
involving                                                                                             involving:
addition and       • Addition and               • Addition and              • Addition and
subtraction for      subtraction for             subtraction for numbers      subtraction             • Addition and
numbers to at        numbers to at least 20      to at least 50                                         subtraction
                                                                            • Multiplication of
least 10           • Multiplication of          • Multiplication of whole     whole numbers to at     Multiplication of
                     whole numbers with           numbers with solutions      least 10 x 10           whole numbers to
                     solutions to at least 20     to at least 50                                      at least 10 x 10



Teachers’ descriptions of “finding the curriculum”
Data was collected through observations and tape-recording of the teachers’ conversations and
through focus group interviews with the teachers, subject facilitators and the group leaders. In this
paper we use data from the focus group interviews to report on teachers’ reported learning from the
activity. The data was analysed thematically, and four themes were discerned: content coverage;
cognitive challenge; developing meaning for the assessment standards; and sequence and
progression. We discuss these below.
Working with an international test gave the teachers a different perspective on both the intended
and enacted curriculum. What some teachers thought would be a relatively simple “tick the box”
exercise, turned out to generate substantial discussion about the meanings of assessment criteria, the
concepts embedded in the assessment criteria and the test items, and helped the teachers to
understand the sequence and progression of the curriculum. We argue that through this activity
teachers developed stronger understandings of the curriculum and began to consider some reasons
for the learners’ poor performance.
In plotting the ICAS test items against the NCS, the teachers became aware of differences in what
they teach in relation to the intended curriculum. One said, “I began to realise that there is so much
2
  The numbering system works as follow: in 1.1.12, the first 1 refers to the grade, the second 1 to the learning
outcome and the 12 to the assessment standard. The numbering system also gives teachers a useful way to
cross-reference assessment standards.
that we do not do, when you see how much we do not do, we need to start asking, why do we think
our learners are underperforming”. While this teacher was not specific about what is left out, her
statement suggests that she came to realize one of the core problems of the enacted curriculum that
researchers have been pointing out for some time now – too little content is covered, which is why
learners are consistently below grade level (Taylor and Vinjevold, 1999). One teacher said that the
mapping activity showed them how dominant Learning Outcome 1 (number and algebra) is in both
the test and their teaching. This was confirmed by our analysis and it resonates with other evidence
that teachers do not teach difficult (e.g. geometry) or new (e.g. data handling) parts of the
curriculum.
The teachers also came to realize that when they do teach particular content, they often teach it at
too low a level, i.e. the tasks they give learners are not challenging enough. This is a key reason for
the underperformance of South African learners (Taylor and Vinjevold, 1999). A number of
teachers said that through this activity they came to realize that many of the test items presented
greater cognitive challenge than they usually provided for learners. A focus group discussion with
the groups’ leaders (Wits graduate students and staff members) confirmed this:
      Group leader1:     Well one example that comes to mind is when there was a four
                         sided figure in the ICAS item and the teacher had only interpreted
                         four sided figures, or from the curriculum, the squares and
                         rectangles.
      Interviewer:       Okay.
      Group Leader2: So I think that is very similar to what L is saying, is that they [the
                     teachers] just under-interpreted what is there, even when it was in
                     front of them. Oh no, we only do squares and rectangles in grade
                     five, four, without going, oh hold on, there is a whole bunch of
                     other four sided figures.
      Interviewer:       In the curriculum?
      Group Leader3: Yes. The curriculum would say something like four sided figures
                     but they would not read quadrilaterals, they would read squares
                     and rectangles.
What has emerged for us through this activity is a shift from the notion of “accounting” to the
notion of “accountability”. Benchmarking uses the results of tests to make claims about how well
learners are achieving - an accounting process. The mapping activity required the teachers to take
the test items, the learners’ results and the intended curriculum together and through discussion, to
begin to pinpoint areas of the NCS that do not fit with actual teaching or assessment. This began to
develop accountability of what the question in the test and what the stated content of the curriculum
actually mean, bringing the examined and intended curriculum into alignment with each other. This
brings us to the third aspect of the curriculum the teachers found: a deeper conceptual
understanding of the assessment standards.
Teachers spoke about mathematical topics that they teach in a particular grade, but which are not
found in the relevant grade curriculum statement, for example, money and tessellations in the
Intermediate Phase3. This discrepancy between their professional knowledge and the content
coverage by the intended curriculum led to two kinds of responses. The first is where the teachers
critiqued the curriculum for not including important content relevant to the grade. These teachers
expressed surprise that something they have consistently taught is not officially in the NCS. This

3
 Solving “money” problems does feature in a Grade 3 assessment standard, but not in the Intermediate Phase,
except possibly under budgeting.
led teachers to begin to critique the curriculum and develop some deeper curriculum principles (see
below). The second is where through the mapping conversation, the teachers were able to identify
the concept that was required (e.g. decimals), instead of the topic (e.g. money), and to see the topic
as a means to the concept. The following discussion from among the teachers highlights this latter
point:
      Teacher1:     We found in grade four, there was nothing that related specifically in
                    the grade four document to addition of decimals. But when you’re
                    doing R2,20 plus R3,30 for example, which I think most of us do, you
                    are doing addition of decimals. So that was in grade six, that’s when it’s
                    first mentioned
      Teacher2:     Addition of decimals for grade six
      Teacher1:     And there was a question in here [the grade 4 test], which was addition
                    of decimals. We discussed it. When we’re teaching money we are
                    actually teaching addition of decimals at the same time.
The fourth key aspect that the teachers spoke about discovering through the activity is sequence and
progression across the grades. A critique of the original Curriculum 2005 was that progression was
lost at the expense of integration (Chisholm et al, 2000). Muller (2006) argues, and we agree, that in
the NCS, mathematics reintroduced progression of content, whereas some of the other learning
areas did not. What became apparent through the mapping activity was that teachers were not aware
of the progression in the mathematics curriculum and that this activity began to help them to see
progression across grades and phases. This happened particularly when the teachers could not find
an assessment standard for a test item. In these instances the teachers looked at previous and
subsequent grades. A grade 5 teacher said:
      The usefulness of analyzing the tests in that way is that it forced you to go to the
      curriculum or to the assessment standards and say, well alright, just where does it fit
      in, and that helped you to see the grade, does this fit in with the grade 5 level or more
      a grade 6 level, and that forced you to actually look at the progression and say, well
      alright, in grade 5; they could do this grade 5 they handled that; grade 6 they handled
      that; grade 7 they handled that
An important point here is that even though there is progression in the mathematics curriculum
statement, the teachers did not necessarily see it before this activity. A differently formatted
curriculum document, together with an activity that mapped an external test against the intended
curriculum, created a meaningful interface between the intended curriculum, the teachers’
professional knowledge and experience, and the examined curriculum.
Developing meaning in conversations with the intended curriculum
A disconcerting finding from the focus group discussions with the teachers suggests that teachers do
not use any systematic way of making decisions about what to teach and when to teach it. Teachers
offered the following responses to how they work with the intended curriculum, which show that
the notion of design down is a misnomer:
      Many teachers are in survival mode. When another teacher says, here’s a textbook 4;
      here’s my whole pile of worksheets I did last year and the teacher says ‘thank
      goodness!’ and probably looks at this [the NCS] once a year.
4
  Most of the teachers in our project do use textbooks, which is different from JET’s claim above. However,
what this quote suggests is that even the textbook is not enough of a mediating artefact for the intended
curriculum, because teachers don’t use textbooks to help them interpret the NCS nor do they use the NCS to
interpret the textbook.
We normally just go through the textbook – but what are we really doing … that’s
      the kind of thing we’ve got through history, an older teacher will tell a younger
      teacher that’s starting out in maths … this is how we do it, this is how we set it out,
      this is what we need to cover for next year, okay, one teacher passes the experience
      onto the next there is no conversation with the curriculum, that’s the reality, we have
      conversations without the curriculum, that’s how maths is passed along.
This teacher has her finger on the nub of this activity and what it could mean for teachers beyond
this project – teacher conversations are important, but they need to be guided, by artefacts such as
tests and by the intended curriculum. Otherwise teacher conversations run the risk of being driven
by “common sense” and important new ideas in the curriculum run the risk of being ignored. If the
intended curriculum is to be a guide for teaching, teachers need structured ways to interact with it.
The analysis of the teachers “finding the curriculum” through the mapping activity has brought to
light four principles about the interface between the intended curriculum and teachers’ professional
knowledge and experience. We note these principles with the view to showing the complexity
involved when teachers interact with the intended curriculum and by implication the simplicity of
the “design down” idea. These principles are important if teacher educators are serious about
shifting teacher conversations away from “common sense”. The first principle we note is that there
is unlikely to be a one-to-one correspondence between test items and assessment standards. In their
discussions teachers found that sometimes only part of an assessment standard was relevant to a test
item, or that a test item could be mapped onto more than one assessment standard:
      This mapping helps you to see the coordination between ASs and tasks, to see things
      in a more flexible way, you can introduce topics together because there is an
      interrelation … you are not only teaching one thing, you see things working together
      instead of separately.
      We learned … like if we do addition – when we’re teaching them how to add – its
      not only about addition. We’re also learning about place value. Meaning that, the,
      the, the core of addition, the processes of addition and place value …eh …they can
      work together. You cannot say, ‘I am just teaching, add only’.
So teachers began to see conceptual linkages between different parts of the curriculum. While it is
likely that some could see and work with these before they came to our project, what this activity
provided was an explicit way to begin to plot linkages within and across grades and phases.
Second, when the teachers looked at an assessment standard, they tended to look for a mathematical
topic, and in that way missed the deeper conceptual demand of the assessment standard
(misalignment between teacher professional knowledge and the intended curriculum). A subject
facilitator pointed out how the activity helped his group in this way:
      Normally what happens is when, when, educators unpack this stuff they don’t go
      deeper into them. For example, an assessment standard would say, recognise and
      represent, and then talks about either addition or subtraction. They don’t look at the
      verbs, they just get to: ‘oh, that’s addition’. So this exercise made us get right into
      the assessment standards. But I remember in our group we argued a lot – “… but we
      are representing here! No, we are not!” [unclear]. So we really got into the
      assessment standards. It was a good exercise.
This quote is important in two respects, first it shows a subject facilitator coming to understand the
importance of such an activity for teachers learning about the conceptual demand of the assessment
standard. Second, it shows how facilitators can introduce somewhat opaque but crucial elements of
the curriculum into discussions with teachers, in this case the verbs or mathematical practices (Ball,
2003) that the curriculum is trying to develop.
The third important principle that transpired through the discussions is that an interface between the
intended and the examined curriculum can help teachers to gain affirmation for their teaching
(discover alignment between enacted and examined curriculum), and account for their teaching to
others. Two teachers spoke as follows:
    Teacher1: I think also, um, what we realised is a lot of it is mental. Mental operations
              … like, you don’t realise how much it comes in. And so for me, I do the prep
              for our grade … and if a new teacher comes in, for me to sit down and try
              and explain why do we actually do mental operations, like, really, well, we
              sort of just do that. But now, because you can actually see why, and, where it
              comes in, and, how its actually involved in [other] operations, you can
              actually say to them, well, this and this and this, you know, be able to
              interpret it a lot more.
    Teacher2: You’re aware [of mental operations in the curriculum], but not the
              importance of it. When people say to you ‘mental mathematics, mental, they
              need to know if they need to … sometimes you think why do they need to
              know? And if you actually see that so many of these questions need the
              mental operations. So [unclear] we import in the mental operations to many
              of the questions.
    Teacher1: A lot of us realise its importance, but … it makes you put it into words and
              say to somebody that will come in and ask you, why would you now say you
              spend 10 -15 minutes of mental drill a day – and some people will think,
              “why are you doing that?” And you can actually say, explain to them, what
              is the point of the question, someone to tell you the assessment standards
              require them firstly to be able to do their mental operations before they can
              even start to do it.
A final principle that transpired through the discussions is that an artefact like a test can help
teachers develop their assessment practices (alignment between the intended and the examined
curriculum). In conceptualising the activity, the ICAS test items were seen as an artefact, which
would support teachers’ understanding of their learners’ conceptual understandings in relation to the
curriculum. We did not intend for teachers to necessarily learn anything about setting tests, although
from their comments we see that not only did they learn something about this, but they have begun
to see test-setting as driven by and driving the intended curriculum:
      Regarding, like, question setting, when I’m setting a test I’m definitely going to
      consider the assessment standards I’ve covered in my class. I’m gonna look at the cri
      … also have a better understanding of what they did in grade 5, and I’m also going
      to, like, look at that – take all that into consideration; instead of setting tests
      haphazardly perhaps, or under pressure
      The questions were challenging to learners and also to us, we had to look at the
      paper twice. So I tried, when I went back, to make my questions … y’know … you
      must think, y’know, you must not just add. They must add their own thinking – you
      know, what they can do.
Conclusion: Developing accountability
The following extract from the focus group discussion is very telling:
        Researcher: Are you doing these kinds of conversations in your professional life?
        Group:     No (in unison)
Teacher1: Not at all
       Researcher: So how do you interpret the curriculum?
       Teacher2: We just look at the word, like ‘tesselations’
As we noted earlier, Earl and Katz (2005) argue that evidence-based conversations are key to
professional accountability in teaching. We have described an activity where teachers engaged in
conceptual conversations – putting the examined curriculum in conversation with the intended
curriculum and engaging other teachers in conversations about the enacted curriculum in order to do
this. So in conversation with the NCS, these teachers “found” the intended curriculum in important
ways. The interview with the teachers suggest that the teachers developed accountability to four
important aspects of the intended curriculum- content coverage, cognitive challenge (or criteria),
sequence and progression, and conceptual depth of the assessment standards. Their reports on their
experience of the interface show that that they had not previously thought about the intended
curriculum in that way, and that the structured interface helped them to find ways to make the
curriculum more explicit so that their teaching will be better guided by it. The analysis has shown
the conceptual limitation of “design down” and its empirical paralysis and instead has brought to
the fore four guiding principles for an interface that seriously intends that teachers have
conversations with the curriculum rather than without it.
References
Ball, D. L. (2003) Proficiency for all students: Towards a strategic research and development
   program in mathematics education. Santa Monica, CA: Rand Education.
Bernstein, B. (1996) Pedagogy, symbolic control and identity: theory, research, critique. London:
   Taylor and Francis.
Bernstein, B. (1999) Vertical and horizontal discourse: An essay. British Journal of Sociology of
   Education, 20(2): 157-173.
Brodie, K. (2007) Beyond distinctions between traditional and reform. In I. Mutimucuio and M.
   Cherinda (Eds) Proceedings of the 15th Annual Meeting of the Southern African Association for
   Research in Mathematics, Science and Technology Education (SAARMSTE). Maputo: Eduardo
   Mondlane University.
Brodie, K., Jina, Z. and Modau, S. (in press, 2009) Implementing the new curriculum in Grade 10: a
   case-study. African Journal for Research in Mathematics, Science and Technology Education.
Chisholm, L., Volmink, J., Ndhlovu, T., Potenza, E., Mahomed, H., Muller, J., et al. (2000). A
   South African curriculum for the twenty first century. Report of the review committee on
   Curriculum 2005. Pretoria: Department of Education.
Earl, L. and Fullan, M. (2003) “Using data in leadership for learning” Cambridge Journal of
   Education, 33 (3): 383-394
Earl, L and Katz, S. (2005) “Learning From Networked Learning Communities: Phase 2- Key
   Features and Inevitable Tensions” (Aporia Consulting Ltd)”
   http://networkedlearning.ncsl.org.uk/collections/network-research-series/reports/nlg-external-
   evaluation-phase-2-report.pdf
Ford, J M and Forman, E A (2006) “Redefining disciplinary learning in classroom contexts”
   Review of Research in Education, 30, 1-32.
Jansen, J. (1999) A very noisy OBE: The implementation of OBE in Grade 1 classrooms. In Jansen,
   J. and Christie, P. (Eds) Changing curriculum: studies of outcomes based education in South
   Africa (pp.203-217) Cape Town: Juta.
Joint Education Trust (2008) What works in school development? 28 & 29 February 2008;
   Birchwood Hotel & Conference Centre Viewpoint Road, Bartlett, Boksburg Conference Report.
   http://www.jet.org.za/item.php?i_id=260
Katz, S., Sutherland, S., and Earl, L. (2005) “Towards an evaluation habit of mind: Mapping the
journey” Teachers College Record 107 (10): 2326-2350.
Kauffman, D., Johnson, S M., Kardos, S M., Liu, E. and Peske, H G: (2002) “Lost at Sea”: New
   Teachers' Experiences with Curriculum and Assessment. The Teachers College Record 104 (2):
   pp. 273-300.
Muller, J. (2006 ) “Differentiation and progression in the curriculum” in M. Young & J. Gamble
   (eds) Knowledge, Curriculum and Qualifications for South African Further Education (Cape
   Town, HSRC Press).
RADMASTE (2005) Reworked version of Revised National Curriculum Statement. Johannesburg:
   Radmaste
South African Qualifications Authority (2005) Developing Learning Programmes For NQF-
   Registered Qualifications And Unit Standards (Pretoria, SAQA)
Schmidt, W.H., Wang, H.C., et al. (2005). "Curriculum coherence: an examination of US
   mathematics and science content standards from an international perspective." Curriculum
   Studies 37(5): 525-559.
Shalem, Y. (2007) Why does OBE curriculum compromise “systematic learning”. Paper presented
   at Kenton Education Association.
Shepherd, D. and van der Berg, Servaas ( 2007) “An analysis of the accuracy of Continuous
   Assessment (CASS) compared to Matriculation Examination results in South Africa Schools. A
   draft Report to Umalusi.
Taylor, N. and Vinjevold, P. (1999) Getting learning right: Report of the Presidents Education
   Initiative Project. Johannesburg: Joint Education Trust.
i
 This paper was presented at the 2008 Kenton Education Association Conference, held at Magaliesberg
Conference Centre in Broederstroom, Gauteng from 23-26 October, 2008. The paper was then entitled
“In the interface: Mathematics Teachers “finding the Curriculum”?”

Más contenido relacionado

La actualidad más candente

AN EXPLORATION OFFACTORS AFFECTINGTHE PROCESS OF ENGLISH LANGUAGE COURSE DESI...
AN EXPLORATION OFFACTORS AFFECTINGTHE PROCESS OF ENGLISH LANGUAGE COURSE DESI...AN EXPLORATION OFFACTORS AFFECTINGTHE PROCESS OF ENGLISH LANGUAGE COURSE DESI...
AN EXPLORATION OFFACTORS AFFECTINGTHE PROCESS OF ENGLISH LANGUAGE COURSE DESI...ijejournal
 
Outcomnes-based Education
Outcomnes-based EducationOutcomnes-based Education
Outcomnes-based EducationCarlo Magno
 
OUTCOMES-BASED EDUCATION (OBE) OR OUTCOMES-BASED TEACHING AND LEARNING (OBTL)
OUTCOMES-BASED EDUCATION (OBE) OR OUTCOMES-BASED TEACHING AND LEARNING (OBTL)OUTCOMES-BASED EDUCATION (OBE) OR OUTCOMES-BASED TEACHING AND LEARNING (OBTL)
OUTCOMES-BASED EDUCATION (OBE) OR OUTCOMES-BASED TEACHING AND LEARNING (OBTL)JASMIN ROXAS
 
Curriculum evaluation
Curriculum evaluationCurriculum evaluation
Curriculum evaluationHennaAnsari
 
Enhancing Primary Mathematics learning using assessment practices: an initiat...
Enhancing Primary Mathematics learning using assessment practices: an initiat...Enhancing Primary Mathematics learning using assessment practices: an initiat...
Enhancing Primary Mathematics learning using assessment practices: an initiat...inventionjournals
 
Isabela state university obe
Isabela state university obeIsabela state university obe
Isabela state university obeBeverly Marinas
 
Curriculum mapping intro
Curriculum mapping introCurriculum mapping intro
Curriculum mapping introMike Fisher
 
e-Learning: Changes in Teaching and Learning Styles
e-Learning: Changes in Teaching and Learning Stylese-Learning: Changes in Teaching and Learning Styles
e-Learning: Changes in Teaching and Learning StylesGihan Wikramanayake
 
Encouraging Curriculum Change in the Netherlands
Encouraging Curriculum Change in the NetherlandsEncouraging Curriculum Change in the Netherlands
Encouraging Curriculum Change in the NetherlandsLuc Sluijsmans
 
Rubic print format_course codeclass codeassignment titletotal point
Rubic print format_course codeclass codeassignment titletotal pointRubic print format_course codeclass codeassignment titletotal point
Rubic print format_course codeclass codeassignment titletotal pointssusere73ce3
 
Assessment of Feedback Given by Cooperating Teachers to Student-Teachers
Assessment of Feedback Given by Cooperating Teachers to Student-TeachersAssessment of Feedback Given by Cooperating Teachers to Student-Teachers
Assessment of Feedback Given by Cooperating Teachers to Student-TeachersPremier Publishers
 
What We Know
What We KnowWhat We Know
What We Knowsaeel005
 
Curriculum analysis
Curriculum analysisCurriculum analysis
Curriculum analysisasequeir
 
Phases of Administering the Curriculum
Phases of Administering the CurriculumPhases of Administering the Curriculum
Phases of Administering the CurriculumSharon Geroquia
 
AIT National Seminar with Chris Rust Emeritus Professor "Redesigning programm...
AIT National Seminar with Chris Rust Emeritus Professor "Redesigning programm...AIT National Seminar with Chris Rust Emeritus Professor "Redesigning programm...
AIT National Seminar with Chris Rust Emeritus Professor "Redesigning programm...AITLearningandTeaching
 

La actualidad más candente (19)

OBE Syllabus
OBE SyllabusOBE Syllabus
OBE Syllabus
 
Curriculum Development Lesson 3
Curriculum Development Lesson 3Curriculum Development Lesson 3
Curriculum Development Lesson 3
 
AN EXPLORATION OFFACTORS AFFECTINGTHE PROCESS OF ENGLISH LANGUAGE COURSE DESI...
AN EXPLORATION OFFACTORS AFFECTINGTHE PROCESS OF ENGLISH LANGUAGE COURSE DESI...AN EXPLORATION OFFACTORS AFFECTINGTHE PROCESS OF ENGLISH LANGUAGE COURSE DESI...
AN EXPLORATION OFFACTORS AFFECTINGTHE PROCESS OF ENGLISH LANGUAGE COURSE DESI...
 
Outcomnes-based Education
Outcomnes-based EducationOutcomnes-based Education
Outcomnes-based Education
 
OUTCOMES-BASED EDUCATION (OBE) OR OUTCOMES-BASED TEACHING AND LEARNING (OBTL)
OUTCOMES-BASED EDUCATION (OBE) OR OUTCOMES-BASED TEACHING AND LEARNING (OBTL)OUTCOMES-BASED EDUCATION (OBE) OR OUTCOMES-BASED TEACHING AND LEARNING (OBTL)
OUTCOMES-BASED EDUCATION (OBE) OR OUTCOMES-BASED TEACHING AND LEARNING (OBTL)
 
Curriculum evaluation
Curriculum evaluationCurriculum evaluation
Curriculum evaluation
 
Enhancing Primary Mathematics learning using assessment practices: an initiat...
Enhancing Primary Mathematics learning using assessment practices: an initiat...Enhancing Primary Mathematics learning using assessment practices: an initiat...
Enhancing Primary Mathematics learning using assessment practices: an initiat...
 
Isabela state university obe
Isabela state university obeIsabela state university obe
Isabela state university obe
 
Tyler objective model
Tyler objective modelTyler objective model
Tyler objective model
 
Curriculum mapping intro
Curriculum mapping introCurriculum mapping intro
Curriculum mapping intro
 
e-Learning: Changes in Teaching and Learning Styles
e-Learning: Changes in Teaching and Learning Stylese-Learning: Changes in Teaching and Learning Styles
e-Learning: Changes in Teaching and Learning Styles
 
Encouraging Curriculum Change in the Netherlands
Encouraging Curriculum Change in the NetherlandsEncouraging Curriculum Change in the Netherlands
Encouraging Curriculum Change in the Netherlands
 
Cd assignment 1111
Cd assignment 1111Cd assignment 1111
Cd assignment 1111
 
Rubic print format_course codeclass codeassignment titletotal point
Rubic print format_course codeclass codeassignment titletotal pointRubic print format_course codeclass codeassignment titletotal point
Rubic print format_course codeclass codeassignment titletotal point
 
Assessment of Feedback Given by Cooperating Teachers to Student-Teachers
Assessment of Feedback Given by Cooperating Teachers to Student-TeachersAssessment of Feedback Given by Cooperating Teachers to Student-Teachers
Assessment of Feedback Given by Cooperating Teachers to Student-Teachers
 
What We Know
What We KnowWhat We Know
What We Know
 
Curriculum analysis
Curriculum analysisCurriculum analysis
Curriculum analysis
 
Phases of Administering the Curriculum
Phases of Administering the CurriculumPhases of Administering the Curriculum
Phases of Administering the Curriculum
 
AIT National Seminar with Chris Rust Emeritus Professor "Redesigning programm...
AIT National Seminar with Chris Rust Emeritus Professor "Redesigning programm...AIT National Seminar with Chris Rust Emeritus Professor "Redesigning programm...
AIT National Seminar with Chris Rust Emeritus Professor "Redesigning programm...
 

Similar a Conversations with the Mathematics Curriculum: Testing and Teacher Development

Thinking About Curriculum (ASCD)
Thinking About Curriculum (ASCD)Thinking About Curriculum (ASCD)
Thinking About Curriculum (ASCD)rirvan
 
Heliyon d-21-02382 r2 (1)
Heliyon d-21-02382 r2 (1)Heliyon d-21-02382 r2 (1)
Heliyon d-21-02382 r2 (1)Pedro Prestes
 
Framework for teaching evaluation instrument. 2013 edition
Framework for teaching evaluation instrument. 2013 editionFramework for teaching evaluation instrument. 2013 edition
Framework for teaching evaluation instrument. 2013 editionRafael Mireles
 
Charlotte danielson The framework for teaching evaluation instrument 2013 edi...
Charlotte danielson The framework for teaching evaluation instrument 2013 edi...Charlotte danielson The framework for teaching evaluation instrument 2013 edi...
Charlotte danielson The framework for teaching evaluation instrument 2013 edi...Veronica Pereyra Garcia
 
Curriculum and Course Planning_BINALET.pptx
Curriculum and Course Planning_BINALET.pptxCurriculum and Course Planning_BINALET.pptx
Curriculum and Course Planning_BINALET.pptxCedraBinalet1
 
Sequencing and structuring learning modules in instructional design
Sequencing and structuring learning modules in instructional designSequencing and structuring learning modules in instructional design
Sequencing and structuring learning modules in instructional designDedi Yulianto
 
Sawamura assessment
Sawamura assessmentSawamura assessment
Sawamura assessmentHo Thu Ha
 
Objectives, needs and goals
Objectives, needs and goalsObjectives, needs and goals
Objectives, needs and goalsTamer Okumuş
 
Methodology essay rocio muñoz maria lagos (1)
Methodology essay rocio muñoz   maria lagos (1)Methodology essay rocio muñoz   maria lagos (1)
Methodology essay rocio muñoz maria lagos (1)Angy Lagos
 
Lau portfolio a16709
Lau portfolio a16709Lau portfolio a16709
Lau portfolio a16709Jairo Gomez
 
Lau portfolio a16709
Lau portfolio a16709Lau portfolio a16709
Lau portfolio a16709Jairo Gomez
 
Research Proposal on: Teacher’s knowledge & curriculum effect on student’s le...
Research Proposal on: Teacher’s knowledge & curriculum effect on student’s le...Research Proposal on: Teacher’s knowledge & curriculum effect on student’s le...
Research Proposal on: Teacher’s knowledge & curriculum effect on student’s le...Ghulam Mujtaba
 
EL7003-8 Assignment 1: Instructional Design and Engaging E-Learning Activities
EL7003-8 Assignment 1: Instructional Design and Engaging E-Learning ActivitiesEL7003-8 Assignment 1: Instructional Design and Engaging E-Learning Activities
EL7003-8 Assignment 1: Instructional Design and Engaging E-Learning Activitieseckchela
 

Similar a Conversations with the Mathematics Curriculum: Testing and Teacher Development (20)

Thinking About Curriculum (ASCD)
Thinking About Curriculum (ASCD)Thinking About Curriculum (ASCD)
Thinking About Curriculum (ASCD)
 
Syllabus%20 design%20 %20copy
Syllabus%20 design%20 %20copySyllabus%20 design%20 %20copy
Syllabus%20 design%20 %20copy
 
Syllabus design copy
Syllabus design   copySyllabus design   copy
Syllabus design copy
 
Skripsi bab 1
Skripsi bab 1Skripsi bab 1
Skripsi bab 1
 
Heliyon d-21-02382 r2 (1)
Heliyon d-21-02382 r2 (1)Heliyon d-21-02382 r2 (1)
Heliyon d-21-02382 r2 (1)
 
Framework for teaching evaluation instrument. 2013 edition
Framework for teaching evaluation instrument. 2013 editionFramework for teaching evaluation instrument. 2013 edition
Framework for teaching evaluation instrument. 2013 edition
 
Charlotte danielson The framework for teaching evaluation instrument 2013 edi...
Charlotte danielson The framework for teaching evaluation instrument 2013 edi...Charlotte danielson The framework for teaching evaluation instrument 2013 edi...
Charlotte danielson The framework for teaching evaluation instrument 2013 edi...
 
Charlotte Danielson Evaluation Instrument
Charlotte Danielson Evaluation InstrumentCharlotte Danielson Evaluation Instrument
Charlotte Danielson Evaluation Instrument
 
Curriculum and Course Planning_BINALET.pptx
Curriculum and Course Planning_BINALET.pptxCurriculum and Course Planning_BINALET.pptx
Curriculum and Course Planning_BINALET.pptx
 
EL7001-8
EL7001-8EL7001-8
EL7001-8
 
Sequencing and structuring learning modules in instructional design
Sequencing and structuring learning modules in instructional designSequencing and structuring learning modules in instructional design
Sequencing and structuring learning modules in instructional design
 
The Impact of quality of teaching on student outcomes: implications for polic...
The Impact of quality of teaching on student outcomes: implications for polic...The Impact of quality of teaching on student outcomes: implications for polic...
The Impact of quality of teaching on student outcomes: implications for polic...
 
Sawamura assessment
Sawamura assessmentSawamura assessment
Sawamura assessment
 
Objectives, needs and goals
Objectives, needs and goalsObjectives, needs and goals
Objectives, needs and goals
 
Curriculum Development And Change Essay
Curriculum Development And Change EssayCurriculum Development And Change Essay
Curriculum Development And Change Essay
 
Methodology essay rocio muñoz maria lagos (1)
Methodology essay rocio muñoz   maria lagos (1)Methodology essay rocio muñoz   maria lagos (1)
Methodology essay rocio muñoz maria lagos (1)
 
Lau portfolio a16709
Lau portfolio a16709Lau portfolio a16709
Lau portfolio a16709
 
Lau portfolio a16709
Lau portfolio a16709Lau portfolio a16709
Lau portfolio a16709
 
Research Proposal on: Teacher’s knowledge & curriculum effect on student’s le...
Research Proposal on: Teacher’s knowledge & curriculum effect on student’s le...Research Proposal on: Teacher’s knowledge & curriculum effect on student’s le...
Research Proposal on: Teacher’s knowledge & curriculum effect on student’s le...
 
EL7003-8 Assignment 1: Instructional Design and Engaging E-Learning Activities
EL7003-8 Assignment 1: Instructional Design and Engaging E-Learning ActivitiesEL7003-8 Assignment 1: Instructional Design and Engaging E-Learning Activities
EL7003-8 Assignment 1: Instructional Design and Engaging E-Learning Activities
 

Más de Saide OER Africa

Asp openly licensed stories for early reading in africa mar 2015 slideshare
Asp openly licensed stories for early reading in africa mar 2015 slideshareAsp openly licensed stories for early reading in africa mar 2015 slideshare
Asp openly licensed stories for early reading in africa mar 2015 slideshareSaide OER Africa
 
Quality Considerations in eLearning
Quality Considerations in eLearningQuality Considerations in eLearning
Quality Considerations in eLearningSaide OER Africa
 
African Storybook: The First 18 Months of the Project
African Storybook: The First 18 Months of the ProjectAfrican Storybook: The First 18 Months of the Project
African Storybook: The First 18 Months of the ProjectSaide OER Africa
 
Digital Storytelling for Multilingual Literacy Development: Implications for ...
Digital Storytelling for Multilingual Literacy Development: Implications for ...Digital Storytelling for Multilingual Literacy Development: Implications for ...
Digital Storytelling for Multilingual Literacy Development: Implications for ...Saide OER Africa
 
Integrating ICT in TVET for Effective Technology Enabled Learning
Integrating ICT in TVET for Effective Technology Enabled LearningIntegrating ICT in TVET for Effective Technology Enabled Learning
Integrating ICT in TVET for Effective Technology Enabled LearningSaide OER Africa
 
Higher Education Technology Outlook in Africa
Higher Education Technology Outlook in AfricaHigher Education Technology Outlook in Africa
Higher Education Technology Outlook in AfricaSaide OER Africa
 
eLearning or eKnowledge - What are we offering students?
eLearning or eKnowledge - What are we offering students?eLearning or eKnowledge - What are we offering students?
eLearning or eKnowledge - What are we offering students?Saide OER Africa
 
Understand school leadership and governance in the South African context (PDF)
Understand school leadership and governance in the South African context (PDF)Understand school leadership and governance in the South African context (PDF)
Understand school leadership and governance in the South African context (PDF)Saide OER Africa
 
Toolkit: Unit 8 - Developing a school-based care and support plan.
Toolkit: Unit 8 - Developing a school-based care and support plan.Toolkit: Unit 8 - Developing a school-based care and support plan.
Toolkit: Unit 8 - Developing a school-based care and support plan.Saide OER Africa
 
Toolkit: Unit 7 - Counselling support for vulnerable learners.
Toolkit: Unit 7 - Counselling support for vulnerable learners.Toolkit: Unit 7 - Counselling support for vulnerable learners.
Toolkit: Unit 7 - Counselling support for vulnerable learners.Saide OER Africa
 
Toolkit: Unit 6 - School-based aftercare.
Toolkit: Unit 6 - School-based aftercare.Toolkit: Unit 6 - School-based aftercare.
Toolkit: Unit 6 - School-based aftercare.Saide OER Africa
 
Toolkit: Unit 5 - Good nutrition for learning.
Toolkit: Unit 5 - Good nutrition for learning.Toolkit: Unit 5 - Good nutrition for learning.
Toolkit: Unit 5 - Good nutrition for learning.Saide OER Africa
 
Toolkit: Unit 3 - Care for vulnerable learners
Toolkit: Unit 3 - Care for vulnerable learnersToolkit: Unit 3 - Care for vulnerable learners
Toolkit: Unit 3 - Care for vulnerable learnersSaide OER Africa
 
Toolkit: Unit 2 - Schools as centres of care.
Toolkit: Unit 2 - Schools as centres of care.Toolkit: Unit 2 - Schools as centres of care.
Toolkit: Unit 2 - Schools as centres of care.Saide OER Africa
 
Toolkit: Unit 1 - How responsive are schools to the socio-economic challenges...
Toolkit: Unit 1 - How responsive are schools to the socio-economic challenges...Toolkit: Unit 1 - How responsive are schools to the socio-economic challenges...
Toolkit: Unit 1 - How responsive are schools to the socio-economic challenges...Saide OER Africa
 
Reading: Understanding Intrapersonal Characteristics (Word)
Reading: Understanding Intrapersonal Characteristics (Word)Reading: Understanding Intrapersonal Characteristics (Word)
Reading: Understanding Intrapersonal Characteristics (Word)Saide OER Africa
 
Reading: Understanding Intrapersonal Characteristics (pdf)
Reading: Understanding Intrapersonal Characteristics (pdf)Reading: Understanding Intrapersonal Characteristics (pdf)
Reading: Understanding Intrapersonal Characteristics (pdf)Saide OER Africa
 
Reading: Guidelines for Inclusive Learning Programmes (word)
Reading: Guidelines for Inclusive Learning Programmes (word)Reading: Guidelines for Inclusive Learning Programmes (word)
Reading: Guidelines for Inclusive Learning Programmes (word)Saide OER Africa
 
Reading: Guidelines for Inclusive Learning Programmes (pdf)
Reading: Guidelines for Inclusive Learning Programmes (pdf)Reading: Guidelines for Inclusive Learning Programmes (pdf)
Reading: Guidelines for Inclusive Learning Programmes (pdf)Saide OER Africa
 

Más de Saide OER Africa (20)

Asp openly licensed stories for early reading in africa mar 2015 slideshare
Asp openly licensed stories for early reading in africa mar 2015 slideshareAsp openly licensed stories for early reading in africa mar 2015 slideshare
Asp openly licensed stories for early reading in africa mar 2015 slideshare
 
Quality Considerations in eLearning
Quality Considerations in eLearningQuality Considerations in eLearning
Quality Considerations in eLearning
 
African Storybook: The First 18 Months of the Project
African Storybook: The First 18 Months of the ProjectAfrican Storybook: The First 18 Months of the Project
African Storybook: The First 18 Months of the Project
 
Digital Storytelling for Multilingual Literacy Development: Implications for ...
Digital Storytelling for Multilingual Literacy Development: Implications for ...Digital Storytelling for Multilingual Literacy Development: Implications for ...
Digital Storytelling for Multilingual Literacy Development: Implications for ...
 
Integrating ICT in TVET for Effective Technology Enabled Learning
Integrating ICT in TVET for Effective Technology Enabled LearningIntegrating ICT in TVET for Effective Technology Enabled Learning
Integrating ICT in TVET for Effective Technology Enabled Learning
 
Higher Education Technology Outlook in Africa
Higher Education Technology Outlook in AfricaHigher Education Technology Outlook in Africa
Higher Education Technology Outlook in Africa
 
eLearning or eKnowledge - What are we offering students?
eLearning or eKnowledge - What are we offering students?eLearning or eKnowledge - What are we offering students?
eLearning or eKnowledge - What are we offering students?
 
The Rise of MOOCs
The Rise of MOOCsThe Rise of MOOCs
The Rise of MOOCs
 
Understand school leadership and governance in the South African context (PDF)
Understand school leadership and governance in the South African context (PDF)Understand school leadership and governance in the South African context (PDF)
Understand school leadership and governance in the South African context (PDF)
 
Toolkit: Unit 8 - Developing a school-based care and support plan.
Toolkit: Unit 8 - Developing a school-based care and support plan.Toolkit: Unit 8 - Developing a school-based care and support plan.
Toolkit: Unit 8 - Developing a school-based care and support plan.
 
Toolkit: Unit 7 - Counselling support for vulnerable learners.
Toolkit: Unit 7 - Counselling support for vulnerable learners.Toolkit: Unit 7 - Counselling support for vulnerable learners.
Toolkit: Unit 7 - Counselling support for vulnerable learners.
 
Toolkit: Unit 6 - School-based aftercare.
Toolkit: Unit 6 - School-based aftercare.Toolkit: Unit 6 - School-based aftercare.
Toolkit: Unit 6 - School-based aftercare.
 
Toolkit: Unit 5 - Good nutrition for learning.
Toolkit: Unit 5 - Good nutrition for learning.Toolkit: Unit 5 - Good nutrition for learning.
Toolkit: Unit 5 - Good nutrition for learning.
 
Toolkit: Unit 3 - Care for vulnerable learners
Toolkit: Unit 3 - Care for vulnerable learnersToolkit: Unit 3 - Care for vulnerable learners
Toolkit: Unit 3 - Care for vulnerable learners
 
Toolkit: Unit 2 - Schools as centres of care.
Toolkit: Unit 2 - Schools as centres of care.Toolkit: Unit 2 - Schools as centres of care.
Toolkit: Unit 2 - Schools as centres of care.
 
Toolkit: Unit 1 - How responsive are schools to the socio-economic challenges...
Toolkit: Unit 1 - How responsive are schools to the socio-economic challenges...Toolkit: Unit 1 - How responsive are schools to the socio-economic challenges...
Toolkit: Unit 1 - How responsive are schools to the socio-economic challenges...
 
Reading: Understanding Intrapersonal Characteristics (Word)
Reading: Understanding Intrapersonal Characteristics (Word)Reading: Understanding Intrapersonal Characteristics (Word)
Reading: Understanding Intrapersonal Characteristics (Word)
 
Reading: Understanding Intrapersonal Characteristics (pdf)
Reading: Understanding Intrapersonal Characteristics (pdf)Reading: Understanding Intrapersonal Characteristics (pdf)
Reading: Understanding Intrapersonal Characteristics (pdf)
 
Reading: Guidelines for Inclusive Learning Programmes (word)
Reading: Guidelines for Inclusive Learning Programmes (word)Reading: Guidelines for Inclusive Learning Programmes (word)
Reading: Guidelines for Inclusive Learning Programmes (word)
 
Reading: Guidelines for Inclusive Learning Programmes (pdf)
Reading: Guidelines for Inclusive Learning Programmes (pdf)Reading: Guidelines for Inclusive Learning Programmes (pdf)
Reading: Guidelines for Inclusive Learning Programmes (pdf)
 

Último

POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptxPOINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptxSayali Powar
 
mini mental status format.docx
mini    mental       status     format.docxmini    mental       status     format.docx
mini mental status format.docxPoojaSen20
 
URLs and Routing in the Odoo 17 Website App
URLs and Routing in the Odoo 17 Website AppURLs and Routing in the Odoo 17 Website App
URLs and Routing in the Odoo 17 Website AppCeline George
 
CARE OF CHILD IN INCUBATOR..........pptx
CARE OF CHILD IN INCUBATOR..........pptxCARE OF CHILD IN INCUBATOR..........pptx
CARE OF CHILD IN INCUBATOR..........pptxGaneshChakor2
 
Organic Name Reactions for the students and aspirants of Chemistry12th.pptx
Organic Name Reactions  for the students and aspirants of Chemistry12th.pptxOrganic Name Reactions  for the students and aspirants of Chemistry12th.pptx
Organic Name Reactions for the students and aspirants of Chemistry12th.pptxVS Mahajan Coaching Centre
 
A Critique of the Proposed National Education Policy Reform
A Critique of the Proposed National Education Policy ReformA Critique of the Proposed National Education Policy Reform
A Critique of the Proposed National Education Policy ReformChameera Dedduwage
 
Contemporary philippine arts from the regions_PPT_Module_12 [Autosaved] (1).pptx
Contemporary philippine arts from the regions_PPT_Module_12 [Autosaved] (1).pptxContemporary philippine arts from the regions_PPT_Module_12 [Autosaved] (1).pptx
Contemporary philippine arts from the regions_PPT_Module_12 [Autosaved] (1).pptxRoyAbrique
 
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...EduSkills OECD
 
Hybridoma Technology ( Production , Purification , and Application )
Hybridoma Technology  ( Production , Purification , and Application  ) Hybridoma Technology  ( Production , Purification , and Application  )
Hybridoma Technology ( Production , Purification , and Application ) Sakshi Ghasle
 
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...Krashi Coaching
 
Accessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impactAccessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impactdawncurless
 
Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)eniolaolutunde
 
Introduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher EducationIntroduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher Educationpboyjonauth
 
Mastering the Unannounced Regulatory Inspection
Mastering the Unannounced Regulatory InspectionMastering the Unannounced Regulatory Inspection
Mastering the Unannounced Regulatory InspectionSafetyChain Software
 
MENTAL STATUS EXAMINATION format.docx
MENTAL     STATUS EXAMINATION format.docxMENTAL     STATUS EXAMINATION format.docx
MENTAL STATUS EXAMINATION format.docxPoojaSen20
 
Paris 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activityParis 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activityGeoBlogs
 
Science 7 - LAND and SEA BREEZE and its Characteristics
Science 7 - LAND and SEA BREEZE and its CharacteristicsScience 7 - LAND and SEA BREEZE and its Characteristics
Science 7 - LAND and SEA BREEZE and its CharacteristicsKarinaGenton
 

Último (20)

POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptxPOINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
 
mini mental status format.docx
mini    mental       status     format.docxmini    mental       status     format.docx
mini mental status format.docx
 
URLs and Routing in the Odoo 17 Website App
URLs and Routing in the Odoo 17 Website AppURLs and Routing in the Odoo 17 Website App
URLs and Routing in the Odoo 17 Website App
 
CARE OF CHILD IN INCUBATOR..........pptx
CARE OF CHILD IN INCUBATOR..........pptxCARE OF CHILD IN INCUBATOR..........pptx
CARE OF CHILD IN INCUBATOR..........pptx
 
Organic Name Reactions for the students and aspirants of Chemistry12th.pptx
Organic Name Reactions  for the students and aspirants of Chemistry12th.pptxOrganic Name Reactions  for the students and aspirants of Chemistry12th.pptx
Organic Name Reactions for the students and aspirants of Chemistry12th.pptx
 
A Critique of the Proposed National Education Policy Reform
A Critique of the Proposed National Education Policy ReformA Critique of the Proposed National Education Policy Reform
A Critique of the Proposed National Education Policy Reform
 
Contemporary philippine arts from the regions_PPT_Module_12 [Autosaved] (1).pptx
Contemporary philippine arts from the regions_PPT_Module_12 [Autosaved] (1).pptxContemporary philippine arts from the regions_PPT_Module_12 [Autosaved] (1).pptx
Contemporary philippine arts from the regions_PPT_Module_12 [Autosaved] (1).pptx
 
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
 
Hybridoma Technology ( Production , Purification , and Application )
Hybridoma Technology  ( Production , Purification , and Application  ) Hybridoma Technology  ( Production , Purification , and Application  )
Hybridoma Technology ( Production , Purification , and Application )
 
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
 
Accessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impactAccessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impact
 
Staff of Color (SOC) Retention Efforts DDSD
Staff of Color (SOC) Retention Efforts DDSDStaff of Color (SOC) Retention Efforts DDSD
Staff of Color (SOC) Retention Efforts DDSD
 
Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)
 
Model Call Girl in Bikash Puri Delhi reach out to us at 🔝9953056974🔝
Model Call Girl in Bikash Puri  Delhi reach out to us at 🔝9953056974🔝Model Call Girl in Bikash Puri  Delhi reach out to us at 🔝9953056974🔝
Model Call Girl in Bikash Puri Delhi reach out to us at 🔝9953056974🔝
 
Introduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher EducationIntroduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher Education
 
Mastering the Unannounced Regulatory Inspection
Mastering the Unannounced Regulatory InspectionMastering the Unannounced Regulatory Inspection
Mastering the Unannounced Regulatory Inspection
 
MENTAL STATUS EXAMINATION format.docx
MENTAL     STATUS EXAMINATION format.docxMENTAL     STATUS EXAMINATION format.docx
MENTAL STATUS EXAMINATION format.docx
 
Paris 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activityParis 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activity
 
TataKelola dan KamSiber Kecerdasan Buatan v022.pdf
TataKelola dan KamSiber Kecerdasan Buatan v022.pdfTataKelola dan KamSiber Kecerdasan Buatan v022.pdf
TataKelola dan KamSiber Kecerdasan Buatan v022.pdf
 
Science 7 - LAND and SEA BREEZE and its Characteristics
Science 7 - LAND and SEA BREEZE and its CharacteristicsScience 7 - LAND and SEA BREEZE and its Characteristics
Science 7 - LAND and SEA BREEZE and its Characteristics
 

Conversations with the Mathematics Curriculum: Testing and Teacher Development

  • 1. i Conversations with the mathematics curriculum: testing and teacher development Karin Brodie, Yael Shalem, Ingrid Sapire, Lynne Manson Karin.Brodie@wits.ac.za, Yael.Shalem@wits.ac.za, Ingrid.Sapire@wits.ac.za, Lynette.Manson@wits.ac.za This paper addresses the question: how do mathematics teachers make meaning from curriculum statements in relation to their teaching practices. We report on a teacher development activity in which teachers mapped test items from an international test against the national curriculum statement in mathematics. About 50 mathematics teachers across Grades 3-9 worked in small groups with a graduate student or staff member as a group leader. Drawing on focus group interviews with the teachers and the group leaders we show that the activity focused the teachers on the relationships between the intended curriculum and their teaching, i.e. the enacted curriculum, in four areas: content coverage; cognitive challenge; developing meaning for the assessment standards; and sequence and progression. We argue that the activity illuminates ways in which international tests can provide a medium for teacher growth rather than teacher denigration and alienation. Introduction Recent research has identified misalignment between the demands of the curriculum, teaching and assessment. Classroom research suggests that many teachers simply ignore important aspects of the new national curriculum statement (NCS) and continue to teach how they taught before; others support the ideals of the new curriculum but struggle to enact it in practice (Chisholm et al, 2000; Jansen, 1999), while others create hybrid practices, drawing on the new curriculum as well as their traditional practices (Brodie, 2007; Brodie, Jina and Modau, 2009). A report submitted to Umalusi shows “considerable inaccuracy in continuous assessment in South African schools” (Shepherd and Van der Berg, 2007). The most common finding is that the CASS (continuous assessment) marks are much higher than the final senior certificate examination. These studies suggest that teachers struggle to interpret many aspects of the new curriculum. A number of explanations for teachers’ difficulties have been offered. First, the NCS is underspecified in both content and progression and therefore cannot act as a guide for teachers (Muller, 2006, Shalem, 2007). Second, teachers lack strong enough content knowledge (Taylor and Vinjevold, 1999) to “design down” (South African Qualifications Authority, 2005) tasks, activities and assessments from the outcomes. Third, “one of the unfortunate effects of the way in which Outcomes Based Education (OBE) has been interpreted in South Africa is that teachers very rarely use textbooks, either to prepare lessons, or as a teaching tool during their classes” (Joint Education Trust, 2008, p.8). The common thread that runs through the above explanations is that the main problem of the NCS lies in its form: the NCS underspecifies the school subject content and therefore cannot guide teachers whose content knowledge is weak and who do not use textbooks. Missing from these explanations is an account of what counts as an interface between the intended curriculum and teacher knowledge and practice, and what the structure of that interface might be. In different ways all of these explanations accept uncritically the idea promoted by the South African Qualifications Authority (SAQA) of “design down” (South African Qualifications Authority, 2005), assuming a one-way relationship between “the intended curriculum” (the NCS) and “the enacted
  • 2. curriculum”, the activity of teaching. This paper shows that the process of teachers’ interpretations of the intended curriculum in mathematics is far more complex than what the idea of “design down” allows. We present a small case study of mathematics teachers “finding the curriculum” (Kauffmann et al, 2002), and offer this idea as a better description of the process. The central question that this paper addresses is how do mathematics teachers come to make meaning from curriculum statements in relation to their teaching practices. We report on a teacher development activity in which teachers engaged in conversations as they attempted to map test items taken from an international test against the NCS in mathematics. We show that this activity opened up important aspects of the intended curriculum for teachers: content coverage, cognitive challenge; sequence and progression in the curriculum; and more broadly the deeper meaning of its assessment standards. We argue that the activity provides a way in which international tests can provide a medium for teacher growth rather than teacher denigration and alienation. From the perspective of teacher development we argue that teachers need an artefact, external to the intended curriculum, which they can use to mediate between the intended curriculum and their professional knowledge and experience, which shapes the enacted curriculum. In arguing for this kind of mediating activity we do not refer to curriculum instruments like learning programmes or textbooks, which flesh out specific content in relation to specific learning outcomes and assessment standards per grade. Although we acknowledge the importance of this kind of curriculum technology and join others who advocate the use of textbooks, we argue for a structured process of interface in which teachers are actively engaged in curriculum translation of the disciplinary material that is embedded in the curriculum statements. We imagine the interactions as follows: Teachers’ knowledge and experience Artefact Interface Intended curriculum Examined curriculum Enacted Curriculum Our paper fleshes out this diagram. First, we briefly describe the official policy of “design down”, foregrounding the policy assumptions about the process of translation of the intended curriculum into practice, i.e. the enacted curriculum. We then describe our teacher development project with specific reference to one of the teacher learning activities: curriculum mapping. We describe the structure of the activity, which created the interface between the intended, enacted and examined curriculum. This is followed by a discussion of the four aspects of the curriculum on which the teachers reported a better understanding and finally we deduce the four main principles in relation to teachers “finding the curriculum” which transpire from the analysis of the interface.
  • 3. The official view of curriculum translation –“Design Down” SAQA (2005, p.6) presents the “design down” approach as a process that consists of four main steps. Each step is dependent on the previous one, in that the step that follows provides more information and requires deeper understanding of the NCS. The following are the steps: Step One: Analysis of the purpose of the qualification: For mathematics teachers this means an understanding of the scope and cognitive challenge required for the mathematics learning programme they develop for the school grade they teach. Step Two: Analysis of how the purpose can be achieved: What will the learners need to be taught in order to achieve the purpose? Step Three: Analysis of what knowledge must be demonstrated and how: What kind of assessment is appropriate and in what form should it be designed in order to benchmark whether the learners have achieved the outcomes or not? Step Four: Analysis of what needs to be done to prepare learners: How to make school knowledge available for learners’ acquisition, what teaching and learning activities to design in order to enhance learners’ access to mathematical knowledge? The success of this process appears to depend mainly on the clarity of the outcomes (step two) and of the assessment standards (step three) as well as on the sequence and logical progression of the outcomes and assessment standards within a grade and between grades, across all the phases. Although all of the steps rely on teachers’ knowledge and their access to other curriculum documents, steps one and two require that teachers work with their colleagues and recruit from their collective experience (South African Qualifications Authority, 2005). Thus SAQA presents the process of “design down” as an interactive process between the intended curriculum and teachers’ professional knowledge and experience. In SAQA wording, the interpretive activity provides two sequential processes: a planning process or “design down” (as described above) and a delivery process, which is teaching, defined as “deliver up”, which they describe as “to conduct learning activities which will prepare your learners for the assessment activities” (ibid). Describing the process in this way has led researchers to examine the form of the curriculum and teacher knowledge, and to argue that the limitations are with the curriculum and/or teachers. Very little is written on the conceptual limitation of the idea itself - “design down/deliver up”. A few comments on this are due. The task of working with a curriculum is substantial (Kauffmann et al, 2002). In a study with teachers in their first and second years of teaching, Kauffmann et al show that some teachers encountered curricula that consisted of achievement standards without details of content, sequence or methods, which one teacher called “mindbogglingly comprehensive and vague” (p.290), while others found only lists of topics and skills, with no guidance as to sequence or method. Given the lack of time and the range of other demands on the teachers, they tended to respond “frantically and haphazardly” (p.279), working from day-to-day, instead of developing coherent, long-term plans. Almost all of the teachers in the study acknowledged this as a weakness and longed for more specification, from the curriculum, textbooks and colleagues. Kauffmann et al formulate the teachers’ experience as follows: “They entered the classroom expecting to find a curriculum with which they would struggle. Instead they struggled to find a curriculum” (p.291). Finding a curriculum requires a range of skills and knowledge on the part of teachers. Mathematics teachers need to recognize the progression of content and concepts and of practice in the discipline of mathematics in the curriculum documents. They need to be able to devise learning activities which realize the form in which claims are authorized and justified in mathematics (Ford and Forman, 2006). When teachers interface with the intended curriculum they need to move between
  • 4. the various assessment standards within and across the grades, in order to bring them together or separate them in ways that make sense for particular practice and for particular learners. It is not always easy to recognize epistemological criteria, coverage, sequence and progression through the intended curriculum (Bernstein, 1999; Schmidt et al, 2005). How the intended curriculum is mediated for and with teachers is crucial to their developing the recognition and realization rules (Bernstein, 1996) for appropriate pedagogy - how they see their disciplines in and through the intended curriculum and how they help learners to enact disciplinary knowledge and action in the classroom. Creating the interface: the artefact and activity Recently there has been substantial investment by different governments around the globe, including our own, in testing and data collection for benchmarking exercises, which emphasise the use of data as a policy lever for benchmarking standards and for monitoring performance. So for example, writing for the United States context, Earl and Fullan state: Data has become the vehicle of choice for ensuring accountability. Government mandated reform is spearheaded by focus on results, with demands for evidence firmly embedded (Fullan, 2000). Nations, states, provinces and school districts have implemented large-scale assessment systems, established indicators of effectiveness, set targets, created inspection or review programs, tied rewards and sanctions to results and many combinations of the above. (2003, p. 384) More recently, research has begun to engage with the question of how to use test data beyond accountability benchmarking (Earl and Fullan, 2003: Earl and Katz, 2005). The key issue is how to transform data collected from testing into structured learning opportunities for teachers. With reference to this question, Katz et al (2005) draw an important distinction between two very different kinds of practices in benchmarking: “accounting”, which is the practice of gathering and organising of data; and “accountability”, which refers to teacher-led educational conversations about what the information means and how it can inform teaching and learning. The activity that this paper reports on is a curriculum mapping activity, which has two interrelated aims: first, to see the extent to which an international test (the ICAS1 test) reflects the National Curriculum Statement in mathematics in South Africa, as well as what mathematics teachers actually teach in their classrooms; and second, to develop teachers’ understanding of the conceptual demands of the test items in relation to the intended curriculum and their own teaching. The activity was part of a teacher development project, which aims to create a context for professional conversations among teachers about what international test data (the examined curriculum) means, how it aligns with the conceptual demand of the National Curriculum Statement (the intended curriculum), how it fits with teachers’ professional knowledge and experience, and how can it be used to make concrete changes in their classroom practice (the enacted curriculum). About 50 mathematics teachers across Grades 3-9 work in groups of about 3-4 teachers (2 groups per grade) with a graduate student or staff member from our university as a group leader, all of whom have been or currently are mathematics teachers. Subject facilitators from the Gauteng Department of Education also participate in the project. The teachers come from schools which wrote the tests and they have seen the overall results, which are very poor: with the average percentage correct in each grade in 2006 as follows: Grade 3: 38%; Grade 4: 37%; Grade 5: 35%; Grade 6: 30%; Grade 7: 30%; Grade 8: 25%; Grade 9: 25%. The curriculum mapping activity involved: 1 International Competitions and Assessments for Schools (ICAS) tests developed in Australia and used by the Gauteng Department of Education in a number of schools in Gauteng.
  • 5. Teachers deciding which mathematical concepts or skills were needed in order to find the solution to a test item and choosing an assessment standard (or several assessment standards) which they thought was/were aligned to the item. • Extended discussion about the concepts represented in the assessment standard(s) and whether or not the selected assessment standard(s) did or did not fit with the particular concepts tested by the item. The teachers needed to explain the reasons for mapping (aligning) the item against an assessment standard or against several assessment standards described in the curriculum statement. • Discussion about when and how the teachers actually teach the concepts and how, if at all, they link these concepts to other mathematical areas. For the mapping activity, each teacher was given a detailed version of the NCS (RADMASTE, 2005). The teachers told us that this version helped them to navigate and refer to the document more easily. The tabulated NCS has a landscape page setup and matches the assessment standards for each grade, across the page, using numbers (the example below shows a truncated row, all full rows in the document go up to Grade 9). This makes it easy to compare the assessment standards across grades and to see at a glance how concepts are built up in each grade. 1.1.122 2.1.12 3.1.12 4.1.12 5.1.12 Performs mental Performs mental Performs mental Performs mental Performs mental calculations calculations involving: calculations involving: calculations involving: calculations involving involving: addition and • Addition and • Addition and • Addition and subtraction for subtraction for subtraction for numbers subtraction • Addition and numbers to at numbers to at least 20 to at least 50 subtraction • Multiplication of least 10 • Multiplication of • Multiplication of whole whole numbers to at Multiplication of whole numbers with numbers with solutions least 10 x 10 whole numbers to solutions to at least 20 to at least 50 at least 10 x 10 Teachers’ descriptions of “finding the curriculum” Data was collected through observations and tape-recording of the teachers’ conversations and through focus group interviews with the teachers, subject facilitators and the group leaders. In this paper we use data from the focus group interviews to report on teachers’ reported learning from the activity. The data was analysed thematically, and four themes were discerned: content coverage; cognitive challenge; developing meaning for the assessment standards; and sequence and progression. We discuss these below. Working with an international test gave the teachers a different perspective on both the intended and enacted curriculum. What some teachers thought would be a relatively simple “tick the box” exercise, turned out to generate substantial discussion about the meanings of assessment criteria, the concepts embedded in the assessment criteria and the test items, and helped the teachers to understand the sequence and progression of the curriculum. We argue that through this activity teachers developed stronger understandings of the curriculum and began to consider some reasons for the learners’ poor performance. In plotting the ICAS test items against the NCS, the teachers became aware of differences in what they teach in relation to the intended curriculum. One said, “I began to realise that there is so much 2 The numbering system works as follow: in 1.1.12, the first 1 refers to the grade, the second 1 to the learning outcome and the 12 to the assessment standard. The numbering system also gives teachers a useful way to cross-reference assessment standards.
  • 6. that we do not do, when you see how much we do not do, we need to start asking, why do we think our learners are underperforming”. While this teacher was not specific about what is left out, her statement suggests that she came to realize one of the core problems of the enacted curriculum that researchers have been pointing out for some time now – too little content is covered, which is why learners are consistently below grade level (Taylor and Vinjevold, 1999). One teacher said that the mapping activity showed them how dominant Learning Outcome 1 (number and algebra) is in both the test and their teaching. This was confirmed by our analysis and it resonates with other evidence that teachers do not teach difficult (e.g. geometry) or new (e.g. data handling) parts of the curriculum. The teachers also came to realize that when they do teach particular content, they often teach it at too low a level, i.e. the tasks they give learners are not challenging enough. This is a key reason for the underperformance of South African learners (Taylor and Vinjevold, 1999). A number of teachers said that through this activity they came to realize that many of the test items presented greater cognitive challenge than they usually provided for learners. A focus group discussion with the groups’ leaders (Wits graduate students and staff members) confirmed this: Group leader1: Well one example that comes to mind is when there was a four sided figure in the ICAS item and the teacher had only interpreted four sided figures, or from the curriculum, the squares and rectangles. Interviewer: Okay. Group Leader2: So I think that is very similar to what L is saying, is that they [the teachers] just under-interpreted what is there, even when it was in front of them. Oh no, we only do squares and rectangles in grade five, four, without going, oh hold on, there is a whole bunch of other four sided figures. Interviewer: In the curriculum? Group Leader3: Yes. The curriculum would say something like four sided figures but they would not read quadrilaterals, they would read squares and rectangles. What has emerged for us through this activity is a shift from the notion of “accounting” to the notion of “accountability”. Benchmarking uses the results of tests to make claims about how well learners are achieving - an accounting process. The mapping activity required the teachers to take the test items, the learners’ results and the intended curriculum together and through discussion, to begin to pinpoint areas of the NCS that do not fit with actual teaching or assessment. This began to develop accountability of what the question in the test and what the stated content of the curriculum actually mean, bringing the examined and intended curriculum into alignment with each other. This brings us to the third aspect of the curriculum the teachers found: a deeper conceptual understanding of the assessment standards. Teachers spoke about mathematical topics that they teach in a particular grade, but which are not found in the relevant grade curriculum statement, for example, money and tessellations in the Intermediate Phase3. This discrepancy between their professional knowledge and the content coverage by the intended curriculum led to two kinds of responses. The first is where the teachers critiqued the curriculum for not including important content relevant to the grade. These teachers expressed surprise that something they have consistently taught is not officially in the NCS. This 3 Solving “money” problems does feature in a Grade 3 assessment standard, but not in the Intermediate Phase, except possibly under budgeting.
  • 7. led teachers to begin to critique the curriculum and develop some deeper curriculum principles (see below). The second is where through the mapping conversation, the teachers were able to identify the concept that was required (e.g. decimals), instead of the topic (e.g. money), and to see the topic as a means to the concept. The following discussion from among the teachers highlights this latter point: Teacher1: We found in grade four, there was nothing that related specifically in the grade four document to addition of decimals. But when you’re doing R2,20 plus R3,30 for example, which I think most of us do, you are doing addition of decimals. So that was in grade six, that’s when it’s first mentioned Teacher2: Addition of decimals for grade six Teacher1: And there was a question in here [the grade 4 test], which was addition of decimals. We discussed it. When we’re teaching money we are actually teaching addition of decimals at the same time. The fourth key aspect that the teachers spoke about discovering through the activity is sequence and progression across the grades. A critique of the original Curriculum 2005 was that progression was lost at the expense of integration (Chisholm et al, 2000). Muller (2006) argues, and we agree, that in the NCS, mathematics reintroduced progression of content, whereas some of the other learning areas did not. What became apparent through the mapping activity was that teachers were not aware of the progression in the mathematics curriculum and that this activity began to help them to see progression across grades and phases. This happened particularly when the teachers could not find an assessment standard for a test item. In these instances the teachers looked at previous and subsequent grades. A grade 5 teacher said: The usefulness of analyzing the tests in that way is that it forced you to go to the curriculum or to the assessment standards and say, well alright, just where does it fit in, and that helped you to see the grade, does this fit in with the grade 5 level or more a grade 6 level, and that forced you to actually look at the progression and say, well alright, in grade 5; they could do this grade 5 they handled that; grade 6 they handled that; grade 7 they handled that An important point here is that even though there is progression in the mathematics curriculum statement, the teachers did not necessarily see it before this activity. A differently formatted curriculum document, together with an activity that mapped an external test against the intended curriculum, created a meaningful interface between the intended curriculum, the teachers’ professional knowledge and experience, and the examined curriculum. Developing meaning in conversations with the intended curriculum A disconcerting finding from the focus group discussions with the teachers suggests that teachers do not use any systematic way of making decisions about what to teach and when to teach it. Teachers offered the following responses to how they work with the intended curriculum, which show that the notion of design down is a misnomer: Many teachers are in survival mode. When another teacher says, here’s a textbook 4; here’s my whole pile of worksheets I did last year and the teacher says ‘thank goodness!’ and probably looks at this [the NCS] once a year. 4 Most of the teachers in our project do use textbooks, which is different from JET’s claim above. However, what this quote suggests is that even the textbook is not enough of a mediating artefact for the intended curriculum, because teachers don’t use textbooks to help them interpret the NCS nor do they use the NCS to interpret the textbook.
  • 8. We normally just go through the textbook – but what are we really doing … that’s the kind of thing we’ve got through history, an older teacher will tell a younger teacher that’s starting out in maths … this is how we do it, this is how we set it out, this is what we need to cover for next year, okay, one teacher passes the experience onto the next there is no conversation with the curriculum, that’s the reality, we have conversations without the curriculum, that’s how maths is passed along. This teacher has her finger on the nub of this activity and what it could mean for teachers beyond this project – teacher conversations are important, but they need to be guided, by artefacts such as tests and by the intended curriculum. Otherwise teacher conversations run the risk of being driven by “common sense” and important new ideas in the curriculum run the risk of being ignored. If the intended curriculum is to be a guide for teaching, teachers need structured ways to interact with it. The analysis of the teachers “finding the curriculum” through the mapping activity has brought to light four principles about the interface between the intended curriculum and teachers’ professional knowledge and experience. We note these principles with the view to showing the complexity involved when teachers interact with the intended curriculum and by implication the simplicity of the “design down” idea. These principles are important if teacher educators are serious about shifting teacher conversations away from “common sense”. The first principle we note is that there is unlikely to be a one-to-one correspondence between test items and assessment standards. In their discussions teachers found that sometimes only part of an assessment standard was relevant to a test item, or that a test item could be mapped onto more than one assessment standard: This mapping helps you to see the coordination between ASs and tasks, to see things in a more flexible way, you can introduce topics together because there is an interrelation … you are not only teaching one thing, you see things working together instead of separately. We learned … like if we do addition – when we’re teaching them how to add – its not only about addition. We’re also learning about place value. Meaning that, the, the, the core of addition, the processes of addition and place value …eh …they can work together. You cannot say, ‘I am just teaching, add only’. So teachers began to see conceptual linkages between different parts of the curriculum. While it is likely that some could see and work with these before they came to our project, what this activity provided was an explicit way to begin to plot linkages within and across grades and phases. Second, when the teachers looked at an assessment standard, they tended to look for a mathematical topic, and in that way missed the deeper conceptual demand of the assessment standard (misalignment between teacher professional knowledge and the intended curriculum). A subject facilitator pointed out how the activity helped his group in this way: Normally what happens is when, when, educators unpack this stuff they don’t go deeper into them. For example, an assessment standard would say, recognise and represent, and then talks about either addition or subtraction. They don’t look at the verbs, they just get to: ‘oh, that’s addition’. So this exercise made us get right into the assessment standards. But I remember in our group we argued a lot – “… but we are representing here! No, we are not!” [unclear]. So we really got into the assessment standards. It was a good exercise. This quote is important in two respects, first it shows a subject facilitator coming to understand the importance of such an activity for teachers learning about the conceptual demand of the assessment standard. Second, it shows how facilitators can introduce somewhat opaque but crucial elements of the curriculum into discussions with teachers, in this case the verbs or mathematical practices (Ball,
  • 9. 2003) that the curriculum is trying to develop. The third important principle that transpired through the discussions is that an interface between the intended and the examined curriculum can help teachers to gain affirmation for their teaching (discover alignment between enacted and examined curriculum), and account for their teaching to others. Two teachers spoke as follows: Teacher1: I think also, um, what we realised is a lot of it is mental. Mental operations … like, you don’t realise how much it comes in. And so for me, I do the prep for our grade … and if a new teacher comes in, for me to sit down and try and explain why do we actually do mental operations, like, really, well, we sort of just do that. But now, because you can actually see why, and, where it comes in, and, how its actually involved in [other] operations, you can actually say to them, well, this and this and this, you know, be able to interpret it a lot more. Teacher2: You’re aware [of mental operations in the curriculum], but not the importance of it. When people say to you ‘mental mathematics, mental, they need to know if they need to … sometimes you think why do they need to know? And if you actually see that so many of these questions need the mental operations. So [unclear] we import in the mental operations to many of the questions. Teacher1: A lot of us realise its importance, but … it makes you put it into words and say to somebody that will come in and ask you, why would you now say you spend 10 -15 minutes of mental drill a day – and some people will think, “why are you doing that?” And you can actually say, explain to them, what is the point of the question, someone to tell you the assessment standards require them firstly to be able to do their mental operations before they can even start to do it. A final principle that transpired through the discussions is that an artefact like a test can help teachers develop their assessment practices (alignment between the intended and the examined curriculum). In conceptualising the activity, the ICAS test items were seen as an artefact, which would support teachers’ understanding of their learners’ conceptual understandings in relation to the curriculum. We did not intend for teachers to necessarily learn anything about setting tests, although from their comments we see that not only did they learn something about this, but they have begun to see test-setting as driven by and driving the intended curriculum: Regarding, like, question setting, when I’m setting a test I’m definitely going to consider the assessment standards I’ve covered in my class. I’m gonna look at the cri … also have a better understanding of what they did in grade 5, and I’m also going to, like, look at that – take all that into consideration; instead of setting tests haphazardly perhaps, or under pressure The questions were challenging to learners and also to us, we had to look at the paper twice. So I tried, when I went back, to make my questions … y’know … you must think, y’know, you must not just add. They must add their own thinking – you know, what they can do. Conclusion: Developing accountability The following extract from the focus group discussion is very telling: Researcher: Are you doing these kinds of conversations in your professional life? Group: No (in unison)
  • 10. Teacher1: Not at all Researcher: So how do you interpret the curriculum? Teacher2: We just look at the word, like ‘tesselations’ As we noted earlier, Earl and Katz (2005) argue that evidence-based conversations are key to professional accountability in teaching. We have described an activity where teachers engaged in conceptual conversations – putting the examined curriculum in conversation with the intended curriculum and engaging other teachers in conversations about the enacted curriculum in order to do this. So in conversation with the NCS, these teachers “found” the intended curriculum in important ways. The interview with the teachers suggest that the teachers developed accountability to four important aspects of the intended curriculum- content coverage, cognitive challenge (or criteria), sequence and progression, and conceptual depth of the assessment standards. Their reports on their experience of the interface show that that they had not previously thought about the intended curriculum in that way, and that the structured interface helped them to find ways to make the curriculum more explicit so that their teaching will be better guided by it. The analysis has shown the conceptual limitation of “design down” and its empirical paralysis and instead has brought to the fore four guiding principles for an interface that seriously intends that teachers have conversations with the curriculum rather than without it. References Ball, D. L. (2003) Proficiency for all students: Towards a strategic research and development program in mathematics education. Santa Monica, CA: Rand Education. Bernstein, B. (1996) Pedagogy, symbolic control and identity: theory, research, critique. London: Taylor and Francis. Bernstein, B. (1999) Vertical and horizontal discourse: An essay. British Journal of Sociology of Education, 20(2): 157-173. Brodie, K. (2007) Beyond distinctions between traditional and reform. In I. Mutimucuio and M. Cherinda (Eds) Proceedings of the 15th Annual Meeting of the Southern African Association for Research in Mathematics, Science and Technology Education (SAARMSTE). Maputo: Eduardo Mondlane University. Brodie, K., Jina, Z. and Modau, S. (in press, 2009) Implementing the new curriculum in Grade 10: a case-study. African Journal for Research in Mathematics, Science and Technology Education. Chisholm, L., Volmink, J., Ndhlovu, T., Potenza, E., Mahomed, H., Muller, J., et al. (2000). A South African curriculum for the twenty first century. Report of the review committee on Curriculum 2005. Pretoria: Department of Education. Earl, L. and Fullan, M. (2003) “Using data in leadership for learning” Cambridge Journal of Education, 33 (3): 383-394 Earl, L and Katz, S. (2005) “Learning From Networked Learning Communities: Phase 2- Key Features and Inevitable Tensions” (Aporia Consulting Ltd)” http://networkedlearning.ncsl.org.uk/collections/network-research-series/reports/nlg-external- evaluation-phase-2-report.pdf Ford, J M and Forman, E A (2006) “Redefining disciplinary learning in classroom contexts” Review of Research in Education, 30, 1-32. Jansen, J. (1999) A very noisy OBE: The implementation of OBE in Grade 1 classrooms. In Jansen, J. and Christie, P. (Eds) Changing curriculum: studies of outcomes based education in South Africa (pp.203-217) Cape Town: Juta. Joint Education Trust (2008) What works in school development? 28 & 29 February 2008; Birchwood Hotel & Conference Centre Viewpoint Road, Bartlett, Boksburg Conference Report. http://www.jet.org.za/item.php?i_id=260 Katz, S., Sutherland, S., and Earl, L. (2005) “Towards an evaluation habit of mind: Mapping the
  • 11. journey” Teachers College Record 107 (10): 2326-2350. Kauffman, D., Johnson, S M., Kardos, S M., Liu, E. and Peske, H G: (2002) “Lost at Sea”: New Teachers' Experiences with Curriculum and Assessment. The Teachers College Record 104 (2): pp. 273-300. Muller, J. (2006 ) “Differentiation and progression in the curriculum” in M. Young & J. Gamble (eds) Knowledge, Curriculum and Qualifications for South African Further Education (Cape Town, HSRC Press). RADMASTE (2005) Reworked version of Revised National Curriculum Statement. Johannesburg: Radmaste South African Qualifications Authority (2005) Developing Learning Programmes For NQF- Registered Qualifications And Unit Standards (Pretoria, SAQA) Schmidt, W.H., Wang, H.C., et al. (2005). "Curriculum coherence: an examination of US mathematics and science content standards from an international perspective." Curriculum Studies 37(5): 525-559. Shalem, Y. (2007) Why does OBE curriculum compromise “systematic learning”. Paper presented at Kenton Education Association. Shepherd, D. and van der Berg, Servaas ( 2007) “An analysis of the accuracy of Continuous Assessment (CASS) compared to Matriculation Examination results in South Africa Schools. A draft Report to Umalusi. Taylor, N. and Vinjevold, P. (1999) Getting learning right: Report of the Presidents Education Initiative Project. Johannesburg: Joint Education Trust.
  • 12. i This paper was presented at the 2008 Kenton Education Association Conference, held at Magaliesberg Conference Centre in Broederstroom, Gauteng from 23-26 October, 2008. The paper was then entitled “In the interface: Mathematics Teachers “finding the Curriculum”?”