SlideShare una empresa de Scribd logo
1 de 39
Descargar para leer sin conexión
Practical Perspectives on
Measuring Student Success
Leonardo A. Mercado, M.Ed., M.B.A.
“The Big Picture”
Why is assessment SO important?
Proficiency Targets
Standards
• CEFR:
Can introduce him/herself and others and can ask and answer
questions about personal details such as where he/she lives,
people he/she knows and things he/she has.
• WIDA
Grades 1 – 2, Speaking, Level 1 Entering
Name everyday objects depicted visually in real-life contexts (e.g.
"paper" in a classroom scene)
Standards
Learning Goals, Objectives, Outcomes, & Standards
Practical Perspectives on Measuring Student Success - L. Mercado IGA 2013 FINAL
Formative vs. Summative Assessment
• Formative: A variety of teacher practices that have the
purpose of gathering information in order to enhance
learning outcomes.
• Summative: A formal process by which student
performance is measured in order to determine a level of
attainment for grading and promotional purposes.
Exercise 1: Formative Assessment
Please offer possible reasons as well as a measure to take
for the following situations:
1. The teacher is asking questions in the past tense and
most students are responding in the present.
2. At least 50% of the class is not on task.
3. Students are not volunteering for a given speaking
activity.
PRINCIPLES ON ASSESSMENT
“Art & Science” Principle
Teaching is the art and science of getting people
to learn…
“Art & Science” Principle
Teaching is the art and science of getting people
to learn…
“Rehearsal” Principal: Grading
“Rehearsal Principle”
Never grade your students on their ability to carry
out a task unless they have had an opportunity to
practice something similar first.
Example: “Rehearsal Principle”
• Course book speaking activity:
Name a nice electronics store. Where is it? What is it like?
• Speaking activity for evaluation:
Name a good restaurant. Where is it? What is it like?
Must share:
- Time allotment
- Vocabulary
- Grammar
- Theme or topic
- Nature of task or
activity
“Sampling Principle”: Grading
• When you evaluate students, what do you look for?
• How much is enough to measure performance?
• What should I focus on?
• How long should an in-class activity for grading last?
Sampling Principle: Grading
Before grading your students, make certain you know
what you are going to measure, what language is
required to complete the activity task, and what the
criteria for success are.
“Feedback” Principle
• What kind of feedback do you give students in the
classroom?
• Should you give them feedback during a speaking or
writing test?
• How much and how specific should feedback on
performance be?
“Feedback” Principle
Feedback should be sufficient so that students
understand what did they right and what they could
have done better, and how. It should always be
delivered on a timely basis.
“Construct” Principle
Have a clear idea as to what an area of evaluation
means and what it is measuring.
“Construct” Principle
What does it mean when you are evaluating…
• Reading?
• Effort?
• Speaking?
• Pronunciation?
“Authenticity” Principle
Students should be tested on things that are
similar to what they have done in the classroom.
PRACTICAL INSTRUMENTS & IDEAS
Instruments
Should…
• lead to “reliable” and “valid” assessments.
• be user-friendly and practical for teachers.
• be easy to understand for students.
Two Types of Instruments
Analytic
• Diagnostic
• Focused criteria
• Traceable feedback
• More objective
Holistic
• User-friendly, “easier” to
understand
• Comprehensive
• Higher level proficiency
Assessment Instrument 1: Speaking
AREA
SCORE
0 1
Accuracy
The student was mostly
unable to use the target
form(s) successfully or
only did so after
receiving assistance.
The student was able
to use the target
form(s) successfully
most of the time
without assistance.
Communication
The student's language
was incomprehensible
at least 50% of the
time, not in accordance
with a successful
completion of the task,
or ambiguous because
of misused vocabulary.
The student's language
was comprehensible
most of the time, in
accordance with the
successful completion
of the task, and
characterized by a
correct use of
vocabulary.
B02 / Page 39 / Unit 6 / Activity 8
Objective: To ask/answer questions about you/your family’s
activities using simple present tense.
EXAMPLES SCORE
0 - 2T: Does your mother work?
A: Yes, I do. 0
B: Yes, she does. She work in a hospital 1
C: Yes, she does. She works in a hospital.
She’s a nurse.
2
Assessment Instrument 1: Speaking
• Listen to the student respond to the question.
What would you grade him using Assessment
Instrument 1?
Assessment Instrument 2: Speaking
Criteria to evaluate performance in Oral Examinations
Rubric Reference Performance Descriptors Rating
3 Very Good / Good
 Completes activity or task thoroughly through the use of ample general language
resources as well as extensive knowledge of topic and subject matter
 Performs communicative function completely according to activity or task
 Pronunciation is highly intelligible.
 Fluent most or all of the time with the possibility of having occasional hesitations and
pauses.
+
2 Fair / Average
 Completes activity or task by exhibiting variety of general language resources as well
as knowledge of topic and subject matter, although details or elaboration may be
lacking at times
 Performs communicative function completely most of the time according to activity
or task
 Pronunciation is usually intelligible, although some utterances are difficult to
understand.
 Pauses and hesitations are noticeable, leading to slower speech.
+
1 Needs reinforcement
 Is not able to complete one or more of the activities or tasks, exhibiting a lack of
general language resources as well as serious knowledge gaps in relation to the topic
or subject matter. Details and attempts at elaboration are scant.
 Performs communicative functions according to activity or task, but significant
difficulty or unsuccessful attempts are evident at least 50% of the time.
 Pronunciation errors clearly affect intelligibility, with many utterances being difficult
to understand.
 Pauses, hesitations and false starts are frequent and speech is slow overall.
-
0 Unsuccessful
 Cannot perform most or any of the activities or tasks.
 Cannot perform most or any of the communicative functions as required by the
activities or tasks.
 Pronunciation is rarely intelligible.
 Speech is halted, inarticulate and fragmented making communication impossible.
-
Assessment Exercise 2
• Listen to the student present her personal
portfolio. What would you grade her using
Assessment Instrument 2?
Assessment Instrument 3: Writing
AREA
SCORE
0 1
Accuracy
The student was mostly
unable to use the target
form(s) successfully or
only did so after
receiving assistance.
The student was able
to use the target
form(s) successfully
most of the time
without assistance.
Communication
The student's language
was incomprehensible
at least 50% of the
time, not in accordance
with a successful
completion of the task,
or ambiguous because
of misused vocabulary.
The student's language
was comprehensible
most of the time, in
accordance with the
successful completion
of the task, and
characterized by a
correct use of
vocabulary.
1. In the summer I visiting my family and I went to
the beach, then I shopping. After I was eating in a
restaurant, the food delicious. My family was
happy I can went.
2. I was having a great time at the beach when
suddenly I received a call from my brother. He
told me that my dog was sick. I returned very
fast because I was very worried. When I arrived
the dog was sleeping the doctor went to see him
and gave him medicine.
3. Something happened when I was visiting my
family I went to the beach and I was having a
good time, when I received a call that my dog is
sick. I was going very fast. I worry very much.
BASIC 12 (Unit 12) pages 79-80 WRITING EXAMPLE
Objective: To use the past continuous and simple past in short paragraph
about something that happened to you. Use adverbs.
Assessment Instrument 4: Writing
Practical Perspectives on Measuring Student Success - L. Mercado IGA 2013 FINAL
Assessment Design
• LGOOS: Link
• Medium: Activity /
Task / Prompt
• Sample Type & Size
• Authenticity
• Timing
• Interpretation:
feedback / grades
Assessment Design
Please choose one of the following alternatives and
design an assessment accordingly:
• To order food in a restaurant using will have /
would like
• To guess the meaning of words from context.
WRAPPING IT UP
General Recommendations
• Plan ahead
• Time yourself
• Inform, no unpleasant
surprises
• Be a good listener
• Give helpful feedback;
don’t de-motivate
• Link performance to
LGOO’s
• Self-assess your
assessments
• Clean the slate
Conclusion
• Assessment & Evaluation are not easy
• We owe it to our students to be as objective as
possible. A lot is at stake.
• Improve your techniques and instruments over
time.
• More knowledge about the area, the easier the
task.
THANK YOU!!!!

Más contenido relacionado

La actualidad más candente

1.tutor vista b2c training manual
1.tutor vista b2c training manual1.tutor vista b2c training manual
1.tutor vista b2c training manualshikadeepu
 
Questioning skills
Questioning skillsQuestioning skills
Questioning skillsbocalapam123
 
Lesson planning presentation
Lesson planning presentationLesson planning presentation
Lesson planning presentationMahdi Bouguerine
 
Effective instructional techniques
Effective instructional techniquesEffective instructional techniques
Effective instructional techniquesLyceljine Tañedo
 
Marking and Feedback
Marking and FeedbackMarking and Feedback
Marking and FeedbackKenny Pieper
 
Language proficiency assessment oral language
Language proficiency assessment oral languageLanguage proficiency assessment oral language
Language proficiency assessment oral languageJill Frances Salinas
 
10-step guide to teaching effective conversation classes
10-step guide to teaching effective conversation classes10-step guide to teaching effective conversation classes
10-step guide to teaching effective conversation classesDylan Gates
 
The art of questioning (2)
The art of questioning (2)The art of questioning (2)
The art of questioning (2)Nanda Palit
 
Writing effective essay questions
Writing effective essay questionsWriting effective essay questions
Writing effective essay questionsBaskaran Kasi
 
Questioning Techniques
Questioning TechniquesQuestioning Techniques
Questioning TechniquesRhett Fiel
 
Presentacion ana 4skills
Presentacion ana 4skillsPresentacion ana 4skills
Presentacion ana 4skillsAna Ramos
 
Oral exam guidelines
Oral exam guidelinesOral exam guidelines
Oral exam guidelineswatler
 
Questioning Techniques Overview
Questioning Techniques OverviewQuestioning Techniques Overview
Questioning Techniques Overviewliteracycoach09
 
Ppg module tsl3105 topic 5 planning for teaching l&s
Ppg module tsl3105 topic 5 planning for teaching l&sPpg module tsl3105 topic 5 planning for teaching l&s
Ppg module tsl3105 topic 5 planning for teaching l&sJojo PaPat
 
Peer feedback or response in writing class
Peer feedback or response in writing classPeer feedback or response in writing class
Peer feedback or response in writing classNuttapong Rutamornchai
 
A Deliberation on Questionnaire – Selection, Construction and Scoring
A Deliberation on Questionnaire –  Selection,  Construction and ScoringA Deliberation on Questionnaire –  Selection,  Construction and Scoring
A Deliberation on Questionnaire – Selection, Construction and Scoringesther rakel
 
Art of-questioning (1)
Art of-questioning (1)Art of-questioning (1)
Art of-questioning (1)hildaBennett
 
Item Writing Guidelines
Item Writing GuidelinesItem Writing Guidelines
Item Writing GuidelinesUNowAcademics
 
Art of questioning
Art of questioningArt of questioning
Art of questioningleonardbryan
 

La actualidad más candente (20)

1.tutor vista b2c training manual
1.tutor vista b2c training manual1.tutor vista b2c training manual
1.tutor vista b2c training manual
 
Questioning skills
Questioning skillsQuestioning skills
Questioning skills
 
Lesson planning presentation
Lesson planning presentationLesson planning presentation
Lesson planning presentation
 
Effective instructional techniques
Effective instructional techniquesEffective instructional techniques
Effective instructional techniques
 
Marking and Feedback
Marking and FeedbackMarking and Feedback
Marking and Feedback
 
Language proficiency assessment oral language
Language proficiency assessment oral languageLanguage proficiency assessment oral language
Language proficiency assessment oral language
 
10-step guide to teaching effective conversation classes
10-step guide to teaching effective conversation classes10-step guide to teaching effective conversation classes
10-step guide to teaching effective conversation classes
 
The art of questioning (2)
The art of questioning (2)The art of questioning (2)
The art of questioning (2)
 
Writing effective essay questions
Writing effective essay questionsWriting effective essay questions
Writing effective essay questions
 
Classroom interaction
Classroom interactionClassroom interaction
Classroom interaction
 
Questioning Techniques
Questioning TechniquesQuestioning Techniques
Questioning Techniques
 
Presentacion ana 4skills
Presentacion ana 4skillsPresentacion ana 4skills
Presentacion ana 4skills
 
Oral exam guidelines
Oral exam guidelinesOral exam guidelines
Oral exam guidelines
 
Questioning Techniques Overview
Questioning Techniques OverviewQuestioning Techniques Overview
Questioning Techniques Overview
 
Ppg module tsl3105 topic 5 planning for teaching l&s
Ppg module tsl3105 topic 5 planning for teaching l&sPpg module tsl3105 topic 5 planning for teaching l&s
Ppg module tsl3105 topic 5 planning for teaching l&s
 
Peer feedback or response in writing class
Peer feedback or response in writing classPeer feedback or response in writing class
Peer feedback or response in writing class
 
A Deliberation on Questionnaire – Selection, Construction and Scoring
A Deliberation on Questionnaire –  Selection,  Construction and ScoringA Deliberation on Questionnaire –  Selection,  Construction and Scoring
A Deliberation on Questionnaire – Selection, Construction and Scoring
 
Art of-questioning (1)
Art of-questioning (1)Art of-questioning (1)
Art of-questioning (1)
 
Item Writing Guidelines
Item Writing GuidelinesItem Writing Guidelines
Item Writing Guidelines
 
Art of questioning
Art of questioningArt of questioning
Art of questioning
 

Destacado

Manual de usuario como realizar una sustitución de auditor
Manual de usuario   como realizar una sustitución de auditorManual de usuario   como realizar una sustitución de auditor
Manual de usuario como realizar una sustitución de auditorMiguel A. C. Sánchez
 
Bases of classroom observation
Bases of classroom observationBases of classroom observation
Bases of classroom observationEzel Guan
 
classroom observation and type of observers
classroom observation and type of observersclassroom observation and type of observers
classroom observation and type of observersSiwar Bdioui
 
Introduction to measuring instruments (ALIV - Bangladesh)
Introduction to measuring instruments (ALIV - Bangladesh)Introduction to measuring instruments (ALIV - Bangladesh)
Introduction to measuring instruments (ALIV - Bangladesh)Md Abu Jauad Khan Aliv
 
Concepts and theories of educational admin and planning
Concepts and theories of educational admin and planningConcepts and theories of educational admin and planning
Concepts and theories of educational admin and planningKhamnaen Phadoungsy
 
Modern and Traditional School Administration and Supervision, Administration ...
Modern and Traditional School Administration and Supervision, Administration ...Modern and Traditional School Administration and Supervision, Administration ...
Modern and Traditional School Administration and Supervision, Administration ...Joey Miñano
 
Measuring instruments ppt
Measuring instruments pptMeasuring instruments ppt
Measuring instruments pptpakidoctors
 
Guiding Principles for the Assessment of Student Learning
Guiding Principles for the Assessment of Student LearningGuiding Principles for the Assessment of Student Learning
Guiding Principles for the Assessment of Student LearningSheila Lavapie
 
What is assessment ‫‬
What is assessment ‫‬What is assessment ‫‬
What is assessment ‫‬Ali Shaqour
 
Observation Power Point Presentation 9 10 2010
Observation Power Point Presentation 9 10 2010Observation Power Point Presentation 9 10 2010
Observation Power Point Presentation 9 10 2010lggvslideshare
 
Educational Administration
Educational AdministrationEducational Administration
Educational AdministrationImran Zakir
 
Measurement and scales
Measurement and scalesMeasurement and scales
Measurement and scalesKaran Khaneja
 
Assessment of Learning
Assessment of LearningAssessment of Learning
Assessment of LearningYaKu Loveria
 
Types of assessment
Types of assessmentTypes of assessment
Types of assessmentcwhinsch
 
Assessment Of Student Learning
Assessment Of Student LearningAssessment Of Student Learning
Assessment Of Student LearningArlan Villanueva
 
Classroom observation final presentation
Classroom observation final presentationClassroom observation final presentation
Classroom observation final presentationjjohnsoncross
 

Destacado (20)

Manual de usuario como realizar una sustitución de auditor
Manual de usuario   como realizar una sustitución de auditorManual de usuario   como realizar una sustitución de auditor
Manual de usuario como realizar una sustitución de auditor
 
Bases of classroom observation
Bases of classroom observationBases of classroom observation
Bases of classroom observation
 
Classroom Observation Techniques
Classroom Observation TechniquesClassroom Observation Techniques
Classroom Observation Techniques
 
classroom observation and type of observers
classroom observation and type of observersclassroom observation and type of observers
classroom observation and type of observers
 
Introduction to measuring instruments (ALIV - Bangladesh)
Introduction to measuring instruments (ALIV - Bangladesh)Introduction to measuring instruments (ALIV - Bangladesh)
Introduction to measuring instruments (ALIV - Bangladesh)
 
Concepts and theories of educational admin and planning
Concepts and theories of educational admin and planningConcepts and theories of educational admin and planning
Concepts and theories of educational admin and planning
 
Modern and Traditional School Administration and Supervision, Administration ...
Modern and Traditional School Administration and Supervision, Administration ...Modern and Traditional School Administration and Supervision, Administration ...
Modern and Traditional School Administration and Supervision, Administration ...
 
Measuring instruments ppt
Measuring instruments pptMeasuring instruments ppt
Measuring instruments ppt
 
Guiding Principles for the Assessment of Student Learning
Guiding Principles for the Assessment of Student LearningGuiding Principles for the Assessment of Student Learning
Guiding Principles for the Assessment of Student Learning
 
What is assessment ‫‬
What is assessment ‫‬What is assessment ‫‬
What is assessment ‫‬
 
Assessment ppt
Assessment pptAssessment ppt
Assessment ppt
 
Observation Power Point Presentation 9 10 2010
Observation Power Point Presentation 9 10 2010Observation Power Point Presentation 9 10 2010
Observation Power Point Presentation 9 10 2010
 
Educational Administration
Educational AdministrationEducational Administration
Educational Administration
 
Observational method
Observational methodObservational method
Observational method
 
Measurement and scales
Measurement and scalesMeasurement and scales
Measurement and scales
 
Assessment of Learning
Assessment of LearningAssessment of Learning
Assessment of Learning
 
Assessment of learning 1
Assessment of learning 1Assessment of learning 1
Assessment of learning 1
 
Types of assessment
Types of assessmentTypes of assessment
Types of assessment
 
Assessment Of Student Learning
Assessment Of Student LearningAssessment Of Student Learning
Assessment Of Student Learning
 
Classroom observation final presentation
Classroom observation final presentationClassroom observation final presentation
Classroom observation final presentation
 

Similar a Practical Perspectives on Measuring Student Success - L. Mercado IGA 2013 FINAL

Language Proficiency Assessment :Oral Language
Language Proficiency Assessment :Oral LanguageLanguage Proficiency Assessment :Oral Language
Language Proficiency Assessment :Oral LanguageJill Frances Salinas
 
LESSON PLANNING PPT.pptx
LESSON PLANNING PPT.pptxLESSON PLANNING PPT.pptx
LESSON PLANNING PPT.pptxdgcristobal02
 
Assessment in a constructivist, technology supported learning
Assessment in a constructivist, technology supported learningAssessment in a constructivist, technology supported learning
Assessment in a constructivist, technology supported learningNur-Aisha Pasandalan
 
Effective feedback and staff well-being twilight
Effective feedback and staff well-being twilightEffective feedback and staff well-being twilight
Effective feedback and staff well-being twilightRoding Valley High School
 
Rubrics for Educational Assessment.pptx
Rubrics for Educational Assessment.pptxRubrics for Educational Assessment.pptx
Rubrics for Educational Assessment.pptxshaziazamir1
 
Day to day concerns
Day to day concernsDay to day concerns
Day to day concernssophiaakdim
 
International baccalaureate (ib) ab initio chinese 2015 examination
International baccalaureate (ib) ab initio chinese 2015 examinationInternational baccalaureate (ib) ab initio chinese 2015 examination
International baccalaureate (ib) ab initio chinese 2015 examinationYi Lee
 
Day to day concerns
Day to day concernsDay to day concerns
Day to day concernsyounes Anas
 
Chapter 7(assessing speaking )
Chapter 7(assessing speaking )Chapter 7(assessing speaking )
Chapter 7(assessing speaking )Kheang Sokheng
 
Be ch 7 assessing students progress
Be ch 7   assessing students  progressBe ch 7   assessing students  progress
Be ch 7 assessing students progressAbdelaziz Aittaleb
 
Lesson 17 Assessment in constructivist technology-supported learning
Lesson 17 Assessment in constructivist technology-supported learningLesson 17 Assessment in constructivist technology-supported learning
Lesson 17 Assessment in constructivist technology-supported learninghannalou dadang
 
Lesson17 ; Assessment in a Constructivist Technology-Supported Learning
Lesson17 ; Assessment in a Constructivist Technology-Supported LearningLesson17 ; Assessment in a Constructivist Technology-Supported Learning
Lesson17 ; Assessment in a Constructivist Technology-Supported Learningrenalyn espinola
 
Constructing rubrics to assess productive skills
Constructing rubrics to assess productive skillsConstructing rubrics to assess productive skills
Constructing rubrics to assess productive skillsjohan cuya garcía
 
dokumen.tips_interpretive-listening.pptx
dokumen.tips_interpretive-listening.pptxdokumen.tips_interpretive-listening.pptx
dokumen.tips_interpretive-listening.pptxBayissaBekele
 
Marking staff meeting 12.5.15
Marking staff meeting 12.5.15Marking staff meeting 12.5.15
Marking staff meeting 12.5.15MrsMcGinty
 
Testing
TestingTesting
Testinghangha
 

Similar a Practical Perspectives on Measuring Student Success - L. Mercado IGA 2013 FINAL (20)

Language Proficiency Assessment :Oral Language
Language Proficiency Assessment :Oral LanguageLanguage Proficiency Assessment :Oral Language
Language Proficiency Assessment :Oral Language
 
S4 best practices in chinese language assessment k-16 - thompson liu
S4   best practices in chinese language assessment k-16 - thompson liuS4   best practices in chinese language assessment k-16 - thompson liu
S4 best practices in chinese language assessment k-16 - thompson liu
 
LESSON PLANNING PPT.pptx
LESSON PLANNING PPT.pptxLESSON PLANNING PPT.pptx
LESSON PLANNING PPT.pptx
 
Assessment in a constructivist, technology supported learning
Assessment in a constructivist, technology supported learningAssessment in a constructivist, technology supported learning
Assessment in a constructivist, technology supported learning
 
Effective feedback and staff well-being twilight
Effective feedback and staff well-being twilightEffective feedback and staff well-being twilight
Effective feedback and staff well-being twilight
 
Rubrics for Educational Assessment.pptx
Rubrics for Educational Assessment.pptxRubrics for Educational Assessment.pptx
Rubrics for Educational Assessment.pptx
 
Day to day concerns
Day to day concernsDay to day concerns
Day to day concerns
 
International baccalaureate (ib) ab initio chinese 2015 examination
International baccalaureate (ib) ab initio chinese 2015 examinationInternational baccalaureate (ib) ab initio chinese 2015 examination
International baccalaureate (ib) ab initio chinese 2015 examination
 
Day to day concerns
Day to day concernsDay to day concerns
Day to day concerns
 
Chapter 7(assessing speaking )
Chapter 7(assessing speaking )Chapter 7(assessing speaking )
Chapter 7(assessing speaking )
 
Be ch 7 assessing students progress
Be ch 7   assessing students  progressBe ch 7   assessing students  progress
Be ch 7 assessing students progress
 
Lesson 17 Assessment in constructivist technology-supported learning
Lesson 17 Assessment in constructivist technology-supported learningLesson 17 Assessment in constructivist technology-supported learning
Lesson 17 Assessment in constructivist technology-supported learning
 
Lesson17 ; Assessment in a Constructivist Technology-Supported Learning
Lesson17 ; Assessment in a Constructivist Technology-Supported LearningLesson17 ; Assessment in a Constructivist Technology-Supported Learning
Lesson17 ; Assessment in a Constructivist Technology-Supported Learning
 
Assessing speaking
Assessing speaking Assessing speaking
Assessing speaking
 
Constructing rubrics to assess productive skills
Constructing rubrics to assess productive skillsConstructing rubrics to assess productive skills
Constructing rubrics to assess productive skills
 
dokumen.tips_interpretive-listening.pptx
dokumen.tips_interpretive-listening.pptxdokumen.tips_interpretive-listening.pptx
dokumen.tips_interpretive-listening.pptx
 
MDD 4 gerardo valdivia
MDD 4 gerardo valdiviaMDD 4 gerardo valdivia
MDD 4 gerardo valdivia
 
Marking staff meeting 12.5.15
Marking staff meeting 12.5.15Marking staff meeting 12.5.15
Marking staff meeting 12.5.15
 
Oral test
Oral testOral test
Oral test
 
Testing
TestingTesting
Testing
 

Practical Perspectives on Measuring Student Success - L. Mercado IGA 2013 FINAL

  • 1. Practical Perspectives on Measuring Student Success Leonardo A. Mercado, M.Ed., M.B.A.
  • 2. “The Big Picture” Why is assessment SO important?
  • 4. Standards • CEFR: Can introduce him/herself and others and can ask and answer questions about personal details such as where he/she lives, people he/she knows and things he/she has. • WIDA Grades 1 – 2, Speaking, Level 1 Entering Name everyday objects depicted visually in real-life contexts (e.g. "paper" in a classroom scene)
  • 7. Formative vs. Summative Assessment • Formative: A variety of teacher practices that have the purpose of gathering information in order to enhance learning outcomes. • Summative: A formal process by which student performance is measured in order to determine a level of attainment for grading and promotional purposes.
  • 8. Exercise 1: Formative Assessment Please offer possible reasons as well as a measure to take for the following situations: 1. The teacher is asking questions in the past tense and most students are responding in the present. 2. At least 50% of the class is not on task. 3. Students are not volunteering for a given speaking activity.
  • 10. “Art & Science” Principle Teaching is the art and science of getting people to learn…
  • 11. “Art & Science” Principle Teaching is the art and science of getting people to learn…
  • 13. “Rehearsal Principle” Never grade your students on their ability to carry out a task unless they have had an opportunity to practice something similar first.
  • 14. Example: “Rehearsal Principle” • Course book speaking activity: Name a nice electronics store. Where is it? What is it like? • Speaking activity for evaluation: Name a good restaurant. Where is it? What is it like? Must share: - Time allotment - Vocabulary - Grammar - Theme or topic - Nature of task or activity
  • 15. “Sampling Principle”: Grading • When you evaluate students, what do you look for? • How much is enough to measure performance? • What should I focus on? • How long should an in-class activity for grading last?
  • 16. Sampling Principle: Grading Before grading your students, make certain you know what you are going to measure, what language is required to complete the activity task, and what the criteria for success are.
  • 17. “Feedback” Principle • What kind of feedback do you give students in the classroom? • Should you give them feedback during a speaking or writing test? • How much and how specific should feedback on performance be?
  • 18. “Feedback” Principle Feedback should be sufficient so that students understand what did they right and what they could have done better, and how. It should always be delivered on a timely basis.
  • 19. “Construct” Principle Have a clear idea as to what an area of evaluation means and what it is measuring.
  • 20. “Construct” Principle What does it mean when you are evaluating… • Reading? • Effort? • Speaking? • Pronunciation?
  • 21. “Authenticity” Principle Students should be tested on things that are similar to what they have done in the classroom.
  • 23. Instruments Should… • lead to “reliable” and “valid” assessments. • be user-friendly and practical for teachers. • be easy to understand for students.
  • 24. Two Types of Instruments Analytic • Diagnostic • Focused criteria • Traceable feedback • More objective Holistic • User-friendly, “easier” to understand • Comprehensive • Higher level proficiency
  • 25. Assessment Instrument 1: Speaking AREA SCORE 0 1 Accuracy The student was mostly unable to use the target form(s) successfully or only did so after receiving assistance. The student was able to use the target form(s) successfully most of the time without assistance. Communication The student's language was incomprehensible at least 50% of the time, not in accordance with a successful completion of the task, or ambiguous because of misused vocabulary. The student's language was comprehensible most of the time, in accordance with the successful completion of the task, and characterized by a correct use of vocabulary.
  • 26. B02 / Page 39 / Unit 6 / Activity 8 Objective: To ask/answer questions about you/your family’s activities using simple present tense. EXAMPLES SCORE 0 - 2T: Does your mother work? A: Yes, I do. 0 B: Yes, she does. She work in a hospital 1 C: Yes, she does. She works in a hospital. She’s a nurse. 2
  • 27. Assessment Instrument 1: Speaking • Listen to the student respond to the question. What would you grade him using Assessment Instrument 1?
  • 28. Assessment Instrument 2: Speaking Criteria to evaluate performance in Oral Examinations Rubric Reference Performance Descriptors Rating 3 Very Good / Good  Completes activity or task thoroughly through the use of ample general language resources as well as extensive knowledge of topic and subject matter  Performs communicative function completely according to activity or task  Pronunciation is highly intelligible.  Fluent most or all of the time with the possibility of having occasional hesitations and pauses. + 2 Fair / Average  Completes activity or task by exhibiting variety of general language resources as well as knowledge of topic and subject matter, although details or elaboration may be lacking at times  Performs communicative function completely most of the time according to activity or task  Pronunciation is usually intelligible, although some utterances are difficult to understand.  Pauses and hesitations are noticeable, leading to slower speech. + 1 Needs reinforcement  Is not able to complete one or more of the activities or tasks, exhibiting a lack of general language resources as well as serious knowledge gaps in relation to the topic or subject matter. Details and attempts at elaboration are scant.  Performs communicative functions according to activity or task, but significant difficulty or unsuccessful attempts are evident at least 50% of the time.  Pronunciation errors clearly affect intelligibility, with many utterances being difficult to understand.  Pauses, hesitations and false starts are frequent and speech is slow overall. - 0 Unsuccessful  Cannot perform most or any of the activities or tasks.  Cannot perform most or any of the communicative functions as required by the activities or tasks.  Pronunciation is rarely intelligible.  Speech is halted, inarticulate and fragmented making communication impossible. -
  • 29. Assessment Exercise 2 • Listen to the student present her personal portfolio. What would you grade her using Assessment Instrument 2?
  • 30. Assessment Instrument 3: Writing AREA SCORE 0 1 Accuracy The student was mostly unable to use the target form(s) successfully or only did so after receiving assistance. The student was able to use the target form(s) successfully most of the time without assistance. Communication The student's language was incomprehensible at least 50% of the time, not in accordance with a successful completion of the task, or ambiguous because of misused vocabulary. The student's language was comprehensible most of the time, in accordance with the successful completion of the task, and characterized by a correct use of vocabulary.
  • 31. 1. In the summer I visiting my family and I went to the beach, then I shopping. After I was eating in a restaurant, the food delicious. My family was happy I can went. 2. I was having a great time at the beach when suddenly I received a call from my brother. He told me that my dog was sick. I returned very fast because I was very worried. When I arrived the dog was sleeping the doctor went to see him and gave him medicine. 3. Something happened when I was visiting my family I went to the beach and I was having a good time, when I received a call that my dog is sick. I was going very fast. I worry very much. BASIC 12 (Unit 12) pages 79-80 WRITING EXAMPLE Objective: To use the past continuous and simple past in short paragraph about something that happened to you. Use adverbs.
  • 34. Assessment Design • LGOOS: Link • Medium: Activity / Task / Prompt • Sample Type & Size • Authenticity • Timing • Interpretation: feedback / grades
  • 35. Assessment Design Please choose one of the following alternatives and design an assessment accordingly: • To order food in a restaurant using will have / would like • To guess the meaning of words from context.
  • 37. General Recommendations • Plan ahead • Time yourself • Inform, no unpleasant surprises • Be a good listener • Give helpful feedback; don’t de-motivate • Link performance to LGOO’s • Self-assess your assessments • Clean the slate
  • 38. Conclusion • Assessment & Evaluation are not easy • We owe it to our students to be as objective as possible. A lot is at stake. • Improve your techniques and instruments over time. • More knowledge about the area, the easier the task.