1. ASSESSMENT FOR LEARNING 1
Assessment for Learning: What Assessment Methods Do Teachers of Mathematics Use and Why
Yulia Shadyrya
University of Washington Bothell
2. ASSESSMENT FOR LEARNING 2
Research Topic
In her book What’s Math Got to Do With It?: Helping Children Learn to Love Their
Least Favorite Subject, Jo Boaler describes the gloomy state of mathematics in the United States.
Our country’s ranking in math, when compared to thirty-nine other countries around the world, is
as low as twenty-eighth (and plummets down to fortieth if we take into account the amount of
spending on education). The number of students graduating with a major in mathematics at four-
year colleges has decreased by nineteen percent over the last ten years and almost half of all
master’s degrees and more than a third of all bachelor’s degrees in engineering, mathematics,
and information science are attained by nonresident aliens (2008). Among the main reasons for
such depressing data, the author points out, is the fact that American schools use standardized
high stakes tests and other forms of summative assessment, which is a form of assessment of
learning. Wikipedia’s definition of the assessment of learning is: assessment that is accompanied
by a number or letter grade, assessment that compares one student’s achievement with standards,
and assessment that occurs at the end of the learning unit. Boaler suggests that American
teachers need to learn to practice assessment for learning. The concept of the assessment for
learning ―is based upon the principle that student should have a full and clear sense of what they
are learning, of where they are in the path toward mastery, and of what they have to do to
become successful‖ (p. 98).
In related literature the term assessment for learning is often used interchangeably with
the term formative assessment, which might lead readers to believe that they are the same thing.
However, according to Richard Stiggins, the founder of the Assessment Training Institute of
Pearson Education, Inc. and the author of multiple publications on assessment, assessment for
learning is not limited to formative assessment. In addition to frequent testing and revising their
3. ASSESSMENT FOR LEARNING 3
teaching styles based on testing information, teachers must involve students in the process of
assessment. Stiggins recommends a list of actions to teachers, who want to use the assessment to
advance student learning. These actions include: explaining achievement targets to students,
educating themselves on accurate uses of assessment and on using it to strengthen students’
confidence as learners, translating assessment into frequent feedback, adjusting instruction based
on assessment, engaging students in self-assessment, and teaching students to communicate with
them and with family members regarding their learning progress (2002). Dylan William, the
deputy director of the Institute of Education in London, and education researcher of many years,
who specifically focuses on formative assessment research wrote about very specific techniques
of assessment for learning: rich questioning, feedback, and learner’s role in assessment (1999).
Rich questioning refers to questioning technique that requires students to analyze problem,
instead of just guessing an answer which teacher will like. Mathematical problems that confuse
students are usually avoided by teachers. However ―tricky‖ questions are a valuable part of rich
questioning because they provoke deep thinking, and help teachers in assessing their pupils’ true
understanding of math. Other techniques of rich questioning include: allowing for long
conversations to grow from one student’s question, giving ample time for students to think about
a question, asking students to come up with questions, and framing questions as statements to
provoke discussions. Feedback given to students can take different forms. Based on clear
research, William suggests letting students know what they need to do to improve, instead of
praising them or comparing to others, and design feedback so it instills in students belief that
they can improve their mathematical skills with practice. He also insists that students have an
important role in assessment for learning. Thus, sharing assessment criteria with students and
letting them monitor their own progress is essential.
4. ASSESSMENT FOR LEARNING 4
In addition to the obvious benefits of assessment for learning, in my opinion a major
advantage of assessment for learning lies in relating classroom setting to real life. In real life we
rarely get grades for our actions. Constructive criticism and help is more relevant and useful than
grades. To illustrate my point, I will share an example from my own work experience. Once I
worked at a firm that did not give proper training or any feedback of its employees’ performance.
I was satisfied with my pay and position at that time, and did not wonder why the company
promoted several other workers before me. Luckily, one of the managers was observing my work
for several months. She had a lot of work experience and was a top performer at that company.
Only through conscious observation was she able to notice and truly assess my performance.
After I spent some time training with her, I was able to correct a few mistakes, and master skills
necessary for me to be successful. It turned out that due to poor training and the absence of
feedback, many new employees were underperforming, and, as a result either quit or got fired.
Some employees, who were able to overcome poor reviews, became stuck at the same positions,
and only a few employees moved up the corporate ladder. Needless to say, that the company
morale as well as productivity suffered because of such a poor feedback system. Today, many
students in American schools are stuck in a situation that is not unlike the one described above.
Unlike adults, who have more experience in life, students often do not try to figure out what is
the real reason behind their poor grades, and merely accept the label of being ―stupid in math.‖
Literature Review
The importance of assessment for learning (improved formative assessment) was shown
by Paul J. Black and Dylan William in 1998. Their study is referenced by most authors who
wrote about the subject of assessment for learning. Black and William examined more than 160
journals, 580 articles or chapters on assessment and together with the experts from all over the
5. ASSESSMENT FOR LEARNING 5
world, concluded that a lot of evidence exists to the fact that formative assessment improves
learning standards, that there is room for improvement, and that there is information available on
how to improve formative assessment. The authors illustrate their argument by stating that
improved formative assessment could help an average student to move to the top 35% of their
class and an average ranking country, like the United States, could rise to be in the top 5%.
Moreover, the study also shows that improved formative assessment tends to help lower
achieving students more so than average or high achieving students, which has tremendous
implications for closing the achievement gap present in the United States. One of the two biggest
areas where assessment needs to be improved, that the authors list is the teaching practice, where
currently assessment is proven ineffective and even damaging to students. The study suggests
that in order to make a positive difference, formative assessment needs to be improved by
focusing on the following: self-esteem of pupils, which is improved by moving away from
competitive classroom culture and helping individual students with specific problems; self-
assessment by students, which is only possible and greatly beneficial when students have a clear
picture of where their learning goals are; and the evolution of effective teaching, which involves
revising whole teaching plan instead of just one of its aspects, which is assessment.
The authors emphasize that the strategy for improving formative assessment needs to
focus on the ―inside of the black box,‖ in other words, in the classroom. Neither more traditional
research nor large implementation programs will help with the implementation of assessment for
learning. Rather ―each teacher must find his or her own ways of incorporating the lessons and
ideas set out above into his or her own patterns of classroom work and into the cultural norms
and expectations of a particular school community‖ (1998, p. 12,). Specific steps include
learning from development, which means having plenty of real life examples for teachers on how
6. ASSESSMENT FOR LEARNING 6
to implement assessment for learning, such examples must be specific to subject areas; and
practitioner research, one example of which is investigating ways teachers are dealing with
balancing formative and summative assessment in their classrooms. Moreover, in 1999 William
publishes three studies that describe specific strategies that can be used by teachers in their
classrooms. These studies include rich questioning, feedback, and the learner’s role in
assessment (for more description see introduction). Beyond these recommendations, the author
provides evidence gathered from research. For example, one of the articles references an
experiment done by Ruth Butler, where 200 fifth- and sixth-graders were given four kinds of
assessment: comments, grades, praise, and no feedback. This study showed that the interest as
well as performance of students increased after comments, and stayed the same after grades,
praise, or no feedback (1987).
More current literature suggests that the problem of inadequate assessment still exists in
the United States. Richard Stiggins conveys the urgency of assessment reform in the U.S.A.,
which would balance assessment of learning with assessment for learning (2002). He describes
the attitude of our nation toward assessment as: ―obsessed with the belief that the path to school
improvement is paved with better, more frequent and more intense standardized testing‖ (p. 759).
As a result, he states, there are no resources left to support teachers in ongoing classroom
assessment. Only a small portion of states require teachers to be skilled in assessment, and
almost no states require that of school administration. Stiggins argues that instead of constantly
increasing challenge in attempt to motivate students, the country should balance and improve
assessments of and for learning. He lists relevant position statements from such groups as
American Foundation of Teachers, National Education Association, National Council on
Measurement in Education, American Association of School Administrators, and others.
7. ASSESSMENT FOR LEARNING 7
Popham, W. explains that No child Left Behind (NCLB) and its measurement system of
adequate yearly progress (AYP) pressures teachers to teach to the test, and consequently get in
the way of attempts to instill assessment for learning. The author insists that states needs to
develop instructionally sensitive tests, which measure teaching as well as learning (2006). It
must be noted that although the two sources listed above agree with the urgency of the situation,
they both are focused on the strategies on large scale, which is contrary to the recommendations
of Black and William.
Finally, as described in introduction, the subject of mathematics needs special
consideration when making changes in assessment strategies. Jo Boaler describes that most
mathematics students, who are being evaluated in traditional ways, cannot even describe what
they are learning beyond the names of the chapters in textbook or problem numbers. Those who
suffer the most from the standardized testing are usually children from low income families and
students who are English language learners. Moreover, students who are low achievers in
schools are not being helped, but are instead merely labeled as ―below average,‖ which further
discourages them from learning mathematics (2008). My work experience taught me that having
a mentor skilled in assessment for learning is invaluable. Teachers, who have the opportunity to
observe their students directly and often, are at a perfect position to become such mentors and
empower students to take learning in their own hands.
Research Questions
Here are some aspects connected to assessment that I would like to investigate in the process
of my research: 1) What are the current techniques of assessing students’ knowledge of
mathematics? Are the elements of assessment for learning present? 2) What factors do
8. ASSESSMENT FOR LEARNING 8
mathematics teachers in a particular school consider when developing assessment plans?
According to the section above on literature review, American students are suffering from the
overwhelming presence of judgmental feedback in the form of grades, and would instead benefit
from the presence of meaningful assessment—assessment that could help them take charge of
their learning. Clearly, mathematics is a subject in need of special attention. There is a lot of
information about how to improve formative assessment.. Here are some ways my research
might contribute to theoretical development of the concept of the assessment for learning:
simply raising such important questions might make teachers re-think their assessment
techniques or even their personal teaching philosophies
data gathered in the process can be used in further research of what elements of the
formative assessment American teachers currently practice (if at all), and to compare it to similar
data collected in the past in order to measure the progress(or lack thereof) of the formative
assessment in American classrooms or in a particular school
information about different types of assessment can be used in future practitioner
research projects. One such project could evaluate the effect of different types of assessment on
student learning and self-esteem in a particular school, which in turn might influence school
policies to support teachers with assessment for learning
increase in the assessment for learning in a particular school and whole America, will
lead to overall increase in student learning and to decreasing the achievement gap between low
and high achieving students
Considering the recommendation of Black and William, it is clear that practitioner research is
crucial in implementing assessment for learning in schools. Therefore these research questions
9. ASSESSMENT FOR LEARNING 9
are aimed at investigating assessment situations in one particular school by either a teacher or
someone else, who is able to work with teachers regularly. The combined analysis of both
questions should help mathematics teachers of this particular school in their daily practice,
because it will allow them to see what the overall assessment strategy of the mathematics
department is as a whole, and it will allow them to see what some of the most important
constrains are as perceived by teachers and the administration. It will also help each teacher to
take an objective look at his or her own assessment approaches and to judge whether these
assessment approaches assist student learning. Separate teachers, as well as the whole
mathematics department, will be able to revise assessment strategies if necessary, whether it will
be by adding more elements of the assessment for learning, or by reconstructing the whole
approach based on the most important constrains. Having information about constrains can also
help with releasing potentially damaging findings, according to Robinson and Lai (2006).
Research Setting Design
This research project is designed to be conducted by a group of student-teachers in the
school of their placement. Each student-teacher will primarily collect information on their
cooperating teacher, but in general research, planning, and analysis will be done by these student
teachers as a group. Prior to initiating research, student-teachers will have a discussion meeting
with teachers in order to explain the general purpose of this research. Student-teachers will be
very explicit about what they will do. A question might arise as to whether it is appropriate to tell
teachers that this research focuses on assessment for learning, as it might influence the way
teachers normally evaluate their student. However, in my opinion, one of the great advantages of
practitioner research is that it is able to improve teaching practices in its process. Even if teachers
10. ASSESSMENT FOR LEARNING 10
will start to include elements of assessment for learning, objective descriptions of their
assessment styles with these alterations will still be beneficial, because it is not as important for
us to know past actions of teachers as it is to promote assessment for learning techniques.
Another concern is that teachers might feel like they are being judged by researchers if they
reveal their intention of finding out whether teachers’ assessment techniques are assessment for
learning or not. Explaining that part of research is intended to discover constrains which shape
assessment strategies, might help in relieving this tension.
The student-teacher position fits very well with this type of research, because a lot of
initial responsibility of student-teachers is to observe their cooperating teachers. In addition,
student-teachers will be working in close contact with cooperating teachers and with all the
students, which will give student-teachers better understanding of the set of assessment and
related constrains teachers face. On the other hand, because student-teachers will be new to the
setting, they might have less bias in their assessment of the situation. Putting this research in the
hands of student-teachers is also practical: every student-teacher will have only one cooperating
teacher to follow, which is very helpful with keeping the load of work under control.
Consent forms will need to be signed by parents or guardians of all student participants.
Final and intermediate results will be open to all participating teachers. Any explanations and
corrections will be welcome. In case the research will be published, pseudonyms will be used for
schools and all participants. Preparations for this research will take about two months, including
writing the research proposal, talking to teachers, and collecting consent forms. Therefore,
according to 40-20-40 rule described by Robinson and Lai(2006), the optimal time frame for
data collection should be one month, and for results – two months.
11. ASSESSMENT FOR LEARNING 11
Methods for Collecting Information
1) What are current techniques of assessing students’ knowledge of mathematics? Are the
elements of assessment for learning present?
These questions can be thought of as exploratory in nature, because student-teachers will
be investigating different assessment techniques used by mathematics teachers. However, the
ultimate goal of raising these questions is to encourage teachers to think of assessment as
something that should improve student learning, and, while collecting information, researchers
will look for specific indicators of assessment for learning. For this purpose we will think of
these questions as both exploratory and checking. The process of information collection will start
as exploratory, and as clear patterns of assessment develop, observation notes, questions, and
other inquiries will become checking.
In order to investigate these questions, student-teachers will conduct interviews with all
mathematics teachers, and two or three students from each teacher’s class. Student-teachers will
also conduct observations of each participating classroom once a week throughout the quarter,
and look at examples of assignments (homework, group work, tests, etc). Classroom
observations will be done two class hours a week, alternating days and classes to assure broad
coverage of collected information. One week student-teachers will swap cooperating teachers in
order to increase validity. During classroom observations student-teachers will take notes--
writing down every instance teacher is giving any type of verbal feedback to students or that of
students giving feedback to each other whether prompted or not. Copies of various assignments
will be made for analysis.
Interviews will be conducted after classroom observations are done and assignments
studied, in order to ask teachers and students for any clarifications or elaborations. Interviews
12. ASSESSMENT FOR LEARNING 12
will start with a general question: Please describe way in which you assess your students’
understanding of mathematical concepts? If necessary, more specific questions will follow: What
instruments do you use to assess your student’s knowledge (tests, dialogue, projects, etc)? How
do you give them feedback on each of these instruments (grade, comments, grade and comments,
praise, credit, etc)? How often do you assess each of your students (every day, week, month,
etc)? Do you use such techniques as self-assessment and peer-assessment by students? Students
will be asked some questions that are similar, for example: How often do you receive feedback
from your teacher and what kind of feedback is it (grade, comment, etc)? Some questions will be
quite different, for example: Did your teacher clearly communicate the learning objectives for
this week(unit)? Does your teacher explicitly tell you where you are and what you need to do to
achieve class objectives? Does your teacher encourage you to discuss your learning progress
with your teacher and your family? In order to increase validity, student-teachers will switch
their observed teachers once in two weeks, and audio- or videotape all interviews, and will
transcribe and analyze them together.
2) What factors do mathematics teachers in a particular school need to take into account when
developing assessment plans?
This question will be asked at interviews with teachers and will be also posed to
administrators. All answers will be listed, and a follow-up questionnaire will ask teachers and
administrators to assign significance value to each factor: very important, important, not very
important, or unimportant.
Methods for Analyzing Information
During analysis I will be looking for these elements of assessment for learning: presence
13. ASSESSMENT FOR LEARNING 13
of rich questioning as described by Dylan William(1999); teacher commenting on students’
progress without giving a grade or praise; presence and quality of self and peer assessment by
students; quality of classroom discussions (Does teacher often answer her own questions? Are
students allowed to discuss answers among themselves?); frequency of tests; general openness of
the teacher to discussing students’ learning progress with the student and his or her family.
Transcribed interviews with teachers will be scanned for any information on assessment
tools and classroom observation notes will be analyzed for any evidence of assessment, such as:
teacher taking notes on where her students are, teacher giving evaluative comments to her
students, students evaluating each other with and without prompt from a teacher, and any other
such instances. This information will be organized in portfolios for each separate teacher, in a
form of a time line one quarter in length. In my opinion measuring assessments against time is
relevant, because a crucial part of assessment for learning is giving students timely feedback.
Each instrument of assessment will be listed on timeline with a detailed description of such
things as what the main purpose of the assessment was (reporting to the state, teacher’s insight
to students understanding, letting student know where she stands, etc), feedback to student, and
so on.
Transcribed interviews with students will be analyzed for two things: whether students
are have a feel about where they are in the process of learning based on their teacher’s
assessment and whether or not discussion of their learning process with their teacher and families
is encouraged by their teacher. Depending on how clear the data will be, the data might be
quantified and added to teacher’s portfolios in form of a simple table or if additional information
is discovered, descriptions of how students perceive their assessment. Together with the
14. ASSESSMENT FOR LEARNING 14
information from the teacher, a picture will be formed illustrating what a particular teacher’s
assessment techniques are, and which techniques can be classified as assessment for learning.
One list of constraints on assessment strategies will be developed for all mathematics
teachers and administration separately. All constraints will be marked as: very important,
important, not very important, unimportant. This information should help to see what are the
most important constrains considered in this particular school’s math department. Constraints
perceived as important by teachers might be compared to those perceived important by
administration.
Reflection
The most important realization I have made while working on this research proposal is
how important it is for a teacher to think like a researcher. While I knew that a good teacher must
be reflective, all this meant to me was that a teacher must look critically at his or her own work
and must be open to change. It was difficult for me to imagine how I would measure the
effectiveness of my teaching and to know what criteria I would use to gauge myself. While I
knew that it is important for a teacher to work in collaboration with other teachers, I could not
imagine the process of collaboration to be anything more than discussing student related
problems. Working on this project gave me an idea of how practitioner research might establish a
framework for self-reflection as well as for collaboration with other teachers.
When working on developing research questions, I realized that knowing what you want
to research is only one part of research preparation. The way research questions are formed
defines what the research project will have a potential to accomplish. In my case, I was very
interested in researching something relating to assessment for learning, since I was convinced
15. ASSESSMENT FOR LEARNING 15
that this approach can really influence student learning. However, when deciding on what
exactly can and should be researched, I realized how many factors needed to be considered. First,
I had to do preliminary research of relevant literature and somehow classify all available
information deciding which to consider when developing research questions. It was very
important for me to imagine a situation that was possible, and for this proposal to be for
practitioner research. Therefore, I picked a realistic setting: student-teaching placement; and
designed research considering such details as practicality, ethics, and validity. I asked myself
such questions as: How much time can I dedicate to this research? How can I discuss this
research with a cooperating teachers without offending him or her? What can I do in my position
of student-teacher? Forming research questions with all these questions in mind was,
surprisingly, the most difficult part of this proposal.
Searching for relevant information, I came across some great and not-so-great projects. I
realized that a valid topic, well formed research questions, and a solid research design can lead to
a study that many teacher researches will find useful. Being in the position of student teacher
means having access to great data and knowing what research topics are significant. Learning
about and practicing research means being able to design a study that will bring useful results.
However, in such setting researchers must be very careful about preparing, conducting, and
analyzing their research. They need to remember that they are new in the school; and before
starting any such activity it is necessary to study school’s environment. I learned that even if all
participants are eager to help, it is important to know that information provided by them is only
their perception. In my research project, I tried to establish a process of triangulation, where I
look at one issue from the eyes of teachers, administration, students, and researchers. Finally,
preparing this proposal, I imagined how much different information will be gathered in the
16. ASSESSMENT FOR LEARNING 16
process, and how important it is to collect it using appropriate research techniques, which could
make the difference between groundbreaking revelations and ―oops, never mind‖ kind of
research
References
Black, P., & Wiliam, D. (1998). Inside the black box: Raising standards through classroom
assessment. The Phi Delta Kappan, 80(2), 139-148. Retrieved
from http://www.jstor.org/stable/20439383
Boaler, J. (2008). What’s math got to do with it?: Helping children learn to love their least
favorite subject –and why it’s important for America. London: Penguin Group.
Butler, R. (1987). Task-involving and ego-involving properties of evaluation: Effects of different
feedback conditions on motivational perceptions, interest, and performance. Journal of
Educational Psychology, 79(4), 474-482. doi:10.1037/0022-0663.79.4.474.
Doganay, A., & Bal, A. P. (2010). The measurement of students' achievement in teaching
primary school fifth year mathematics classes. Educational Sciences: Theory and
Practice, 10(1), 199-215. Retrieved
from http://search.ebscohost.com/login.aspx?direct=true&db=eric&AN=EJ882727&site=
ehost-live
Popham, W. (2006). Assessment for Learning: An Endangered
Species? Educational Leadership, 63(5), 82-3. Retrieved from
17. ASSESSMENT FOR LEARNING 17
http://vnweb.hwwilsonweb.com.offcampus.lib.washington.edu/hww/results/getResults.jh
tml?_DARGS=/hww/results/results_common.jhtml.33
Stiggins, R. J. (2002). Assessment crisis: The absence of assessment FOR learning. The Phi
Delta Kappan, 83(10), 758-765. Retrieved fromhttp://www.jstor.org/stable/20440249
William, D. (1999) Formative assessment in mathematics. Part 1: Rich questioning. Equals:
Mathematics and special educational needs, 5(2). Retrieved from
http://eprints.ioe.ac.uk/1150/1/Wiliam1999Formativepart115.pdf.
William, D. (1999) Formative assessment in mathematics. Part 2: Feedback. Equals:
Mathematics and special educational needs, 5(3). Retrieved from
https://docs.google.com/viewer?url=http://eprints.ioe.ac.uk/1148/1/Wiliam1999Formativ
epart2_8.pdf
William, D. (1999) Formative assessment in mathematics. Part 3: The learner’s role. Equals:
Mathematics and special educational needs, 6(1). Retrieved from
http://eprints.ioe.ac.uk/1149/1/Wiliam1999Formativepart3_19.pdf.