SlideShare una empresa de Scribd logo
1 de 16
Daisy Map: A Visualization Tool For Student
              Assessments Data
                           October 2008
From Theory to Practice: Design, Vision and Visualization Workshop

                      Ilknur Ickea                              Elizabeth Sklar a,b
                  iicke@gc.cuny.edu                        sklar@sci.brooklyn.cuny.edu

             Dept. of Computer Science,                  Dept. of Computer and Information Science,
          (a)                                      (b)

                   Graduate Center,                              Brooklyn College of the
            City University of New York,                        City University of New York,
                    365 Fifth Ave.                                  Brooklyn, NY, 11210
                 New York, NY,10016

      This work was partially supported by NSF #ITR-05-52294, NSF #PFI-03-32596 and by US Dept of
                                      Education SBIR #ED-06-PO-0895
Motivation




• Computers are ubiquitous in schools today.
• Education data is gathered covering a wide range of information on:
    • student assessments
    • student enrolment
    • financial aspects
• Amount of data collected is overwhelming to educators, administrators,
  policy-makers.
• Our work explores the use of intelligent data analysis and visualization
  techniques to help make sense of education data.
Academic Assessments Case Study




• We worked with Children's Progress Inc.(*) to develop visualization and
  analysis tools on their student assessment application named CPAA.
• The CPAA covers core concepts that are essential to early childhood
  development, grouped into language arts and mathematics
  categories (listening, pre-reading, alphabet knowledge, phonemic
  awareness, reading, writing mechanics,numbers and quantities,
  numeracy, operations, measurement and patterns).




    * http://www.childrensprogress.com
CPAA Overview




• The core concepts are divided into prime questions which address
  specific concept components.
• For example; phonemic awareness is comprised of prime questions
  related to: rhyming, initial sound, blending, and syllable counting.
• The concepts were chosen to reflect US national and state academic
  standards for language arts and mathematics for ages 4-8.
CPAA-Adaptive Assessment




• The prime questions are organized within the assessment in an
  adaptive manner.
• If a child answers a particular prime question correctly, then she will
  receive a more difficult prime question; if not, she will receive a hint.
• A hint is the same question again, presented in a different format.
• Each incorrect response choice has a particular outcome that provides
  a different kind of hint to guide the child to the correct answer.
Assessment Map




Writing Assessment Map
Scoring




• Each assessment covers multiple concepts (Reading(re), Writing(wr),
  Measurement(me), Operations(op), Pattern Forming(pf) and so on).
• Children receive one of the four scores from each concept :
    •   1 Below expectation
    •   2 Approaching expectation
    •   3 At expectation
    •   4 Above expectation
• These scores are State standard.
• Assessments are repeated from time to time within a year (fall, winter,
  spring) and across different grades (from pre-k to 3rd grade).
Data Cube of Assessment Scores




                                 “When?”
       “Who?”




                “What?”
Task: Design a Visualization Tool




• We want a high-level visualization tool to help us monitor how a group of
  students performed on assessments over a period of time.
• We want to see the scores on each concept within an assessment.
• We want to see the changes in scores across different assessments.
• This is like displaying the data cube(3D) on the screen(2D).
From Data Cube to Daisy Map
Color Coding of Scores




                                 1:Red 2:Yellow 3:Blue 4:Green No Score(0): Gray


• Each petal represents the score received for one concept.
• Color of the petal depends on the score.
• More suitable for humans to examine visually than a bunch of numbers
  since humans are great pattern recognizers.
Visualization Application




• We built a visualization tool based on our Daisy Map design.
• Each student assignment is represented by a daisy.
• Goal 1: Each row represents one student's performance across
  time.
• Goal 2: Each column shows the performance of all students on
  one assessment.
Visualization Goal 1




•   One student's performance across time
Visualization Goal 2




• Performance of all students on one
  assessment
Conclusion




• Daisy Map design worked well for our task.
• In general, Daisy Map works well in representing a small number of
  categorical data items.
• Color coding the scores as petals of the daisies is more effective than
  putting the numbers on the screen.
• Daisy Map helped us visualize the 3D data cube of student assessments
  on the 2D screen.
• We were able to simultaneously visualize one student's performance
  across time (horizontally) as well as a group of students' performance on
  the same assessment (vertically).
Thank you!

             Ilknur Icke
http://www.cs.gc.cuny.edu/~iicke
        iicke@gc.cuny.edu

Más contenido relacionado

Destacado (14)

PiñAs
PiñAsPiñAs
PiñAs
 
NAOSHIMA
NAOSHIMANAOSHIMA
NAOSHIMA
 
Marcha agosto-4-2010
Marcha agosto-4-2010Marcha agosto-4-2010
Marcha agosto-4-2010
 
powerpoint
powerpointpowerpoint
powerpoint
 
E Cision Overview Presentation V D2 Stratnet
E Cision Overview Presentation V D2   StratnetE Cision Overview Presentation V D2   Stratnet
E Cision Overview Presentation V D2 Stratnet
 
Eksamen I Pedagogikk
Eksamen I PedagogikkEksamen I Pedagogikk
Eksamen I Pedagogikk
 
ABACUS Statement of Qualifications
ABACUS Statement of QualificationsABACUS Statement of Qualifications
ABACUS Statement of Qualifications
 
2
22
2
 
Setmanaciencia
SetmanacienciaSetmanaciencia
Setmanaciencia
 
管理心得
管理心得管理心得
管理心得
 
Slirp 4 9 09 Final[1]
Slirp 4 9 09 Final[1]Slirp 4 9 09 Final[1]
Slirp 4 9 09 Final[1]
 
Viii Centenario, Barranquilla, 24 De Octubre De 2009
Viii Centenario, Barranquilla, 24 De Octubre De 2009Viii Centenario, Barranquilla, 24 De Octubre De 2009
Viii Centenario, Barranquilla, 24 De Octubre De 2009
 
ローマと道に関するいくつかの問題とその解決
ローマと道に関するいくつかの問題とその解決ローマと道に関するいくつかの問題とその解決
ローマと道に関するいくつかの問題とその解決
 
Anàlisi sintàctica
Anàlisi sintàcticaAnàlisi sintàctica
Anàlisi sintàctica
 

Similar a Visweek08 Icke Sklar Final

Presentation BCME8 April 17th 2014
Presentation BCME8 April 17th 2014Presentation BCME8 April 17th 2014
Presentation BCME8 April 17th 2014
Christian Bokhove
 
NEW_ Assessment, Moving Beyond Testing
NEW_ Assessment, Moving Beyond TestingNEW_ Assessment, Moving Beyond Testing
NEW_ Assessment, Moving Beyond Testing
Heather Aschenbrenner
 
2013LilyPadvsAppInventor
2013LilyPadvsAppInventor2013LilyPadvsAppInventor
2013LilyPadvsAppInventor
nesiban
 
CLP Presentation - Experiential Learning in Practice - 2-17-15
CLP Presentation - Experiential Learning in Practice - 2-17-15CLP Presentation - Experiential Learning in Practice - 2-17-15
CLP Presentation - Experiential Learning in Practice - 2-17-15
Sean Gallagan, Ph.D.
 
2015_DSSG_high_school_Poster
2015_DSSG_high_school_Poster2015_DSSG_high_school_Poster
2015_DSSG_high_school_Poster
Reid Johnson
 
There is life beyond webquests
There is life beyond webquestsThere is life beyond webquests
There is life beyond webquests
OHIO ITSCO
 

Similar a Visweek08 Icke Sklar Final (20)

Learning Trajectory-Aligned Diagnostic Assessments for Early Algebra, Grades ...
Learning Trajectory-Aligned Diagnostic Assessments for Early Algebra, Grades ...Learning Trajectory-Aligned Diagnostic Assessments for Early Algebra, Grades ...
Learning Trajectory-Aligned Diagnostic Assessments for Early Algebra, Grades ...
 
Learning Trajectory-Aligned Diagnostic Assessments for Early Algebra, Grades ...
Learning Trajectory-Aligned Diagnostic Assessments for Early Algebra, Grades ...Learning Trajectory-Aligned Diagnostic Assessments for Early Algebra, Grades ...
Learning Trajectory-Aligned Diagnostic Assessments for Early Algebra, Grades ...
 
Linking Math Standards and Diagnostic Assessments around Learning Trajectories
Linking Math Standards and Diagnostic Assessments around Learning TrajectoriesLinking Math Standards and Diagnostic Assessments around Learning Trajectories
Linking Math Standards and Diagnostic Assessments around Learning Trajectories
 
On Information Quality: Can Your Data Do The Job? (SCECR 2015 Keynote)
On Information Quality: Can Your Data Do The Job? (SCECR 2015 Keynote)On Information Quality: Can Your Data Do The Job? (SCECR 2015 Keynote)
On Information Quality: Can Your Data Do The Job? (SCECR 2015 Keynote)
 
Presentation BCME8 April 17th 2014
Presentation BCME8 April 17th 2014Presentation BCME8 April 17th 2014
Presentation BCME8 April 17th 2014
 
Building Blocks for College Readiness
Building Blocks for College ReadinessBuilding Blocks for College Readiness
Building Blocks for College Readiness
 
Exploring the college scorecard dataset
Exploring the college scorecard datasetExploring the college scorecard dataset
Exploring the college scorecard dataset
 
[DSC Europe 22] Machine learning algorithms as tools for student success pred...
[DSC Europe 22] Machine learning algorithms as tools for student success pred...[DSC Europe 22] Machine learning algorithms as tools for student success pred...
[DSC Europe 22] Machine learning algorithms as tools for student success pred...
 
NEW_ Assessment, Moving Beyond Testing
NEW_ Assessment, Moving Beyond TestingNEW_ Assessment, Moving Beyond Testing
NEW_ Assessment, Moving Beyond Testing
 
2013LilyPadvsAppInventor
2013LilyPadvsAppInventor2013LilyPadvsAppInventor
2013LilyPadvsAppInventor
 
Présentation d'une communication acceptée dans Iceri2019
Présentation d'une communication acceptée dans Iceri2019Présentation d'une communication acceptée dans Iceri2019
Présentation d'une communication acceptée dans Iceri2019
 
CLP Presentation - Experiential Learning in Practice - 2-17-15
CLP Presentation - Experiential Learning in Practice - 2-17-15CLP Presentation - Experiential Learning in Practice - 2-17-15
CLP Presentation - Experiential Learning in Practice - 2-17-15
 
Macfadyen usc tlt keynote 2015.pptx
Macfadyen usc tlt keynote 2015.pptxMacfadyen usc tlt keynote 2015.pptx
Macfadyen usc tlt keynote 2015.pptx
 
ICME-12 presentation
ICME-12 presentationICME-12 presentation
ICME-12 presentation
 
Collaborative Learning in Data Science Education: a Data Expedition as a Form...
Collaborative Learning in Data Science Education: a Data Expedition as a Form...Collaborative Learning in Data Science Education: a Data Expedition as a Form...
Collaborative Learning in Data Science Education: a Data Expedition as a Form...
 
Ed 633 persuasive arguement presentation
Ed 633 persuasive arguement presentationEd 633 persuasive arguement presentation
Ed 633 persuasive arguement presentation
 
2015_DSSG_high_school_Poster
2015_DSSG_high_school_Poster2015_DSSG_high_school_Poster
2015_DSSG_high_school_Poster
 
Data-informed blended learning design
Data-informed blended learning designData-informed blended learning design
Data-informed blended learning design
 
There is life beyond webquests
There is life beyond webquestsThere is life beyond webquests
There is life beyond webquests
 
Jisc learning analytics service updates
Jisc learning analytics service updatesJisc learning analytics service updates
Jisc learning analytics service updates
 

Último

1029-Danh muc Sach Giao Khoa khoi 6.pdf
1029-Danh muc Sach Giao Khoa khoi  6.pdf1029-Danh muc Sach Giao Khoa khoi  6.pdf
1029-Danh muc Sach Giao Khoa khoi 6.pdf
QucHHunhnh
 
Spellings Wk 3 English CAPS CARES Please Practise
Spellings Wk 3 English CAPS CARES Please PractiseSpellings Wk 3 English CAPS CARES Please Practise
Spellings Wk 3 English CAPS CARES Please Practise
AnaAcapella
 
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
ZurliaSoop
 
1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdf
QucHHunhnh
 

Último (20)

Single or Multiple melodic lines structure
Single or Multiple melodic lines structureSingle or Multiple melodic lines structure
Single or Multiple melodic lines structure
 
Kodo Millet PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...
Kodo Millet  PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...Kodo Millet  PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...
Kodo Millet PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...
 
Google Gemini An AI Revolution in Education.pptx
Google Gemini An AI Revolution in Education.pptxGoogle Gemini An AI Revolution in Education.pptx
Google Gemini An AI Revolution in Education.pptx
 
Key note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdfKey note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdf
 
Spatium Project Simulation student brief
Spatium Project Simulation student briefSpatium Project Simulation student brief
Spatium Project Simulation student brief
 
Unit-IV; Professional Sales Representative (PSR).pptx
Unit-IV; Professional Sales Representative (PSR).pptxUnit-IV; Professional Sales Representative (PSR).pptx
Unit-IV; Professional Sales Representative (PSR).pptx
 
Towards a code of practice for AI in AT.pptx
Towards a code of practice for AI in AT.pptxTowards a code of practice for AI in AT.pptx
Towards a code of practice for AI in AT.pptx
 
Mehran University Newsletter Vol-X, Issue-I, 2024
Mehran University Newsletter Vol-X, Issue-I, 2024Mehran University Newsletter Vol-X, Issue-I, 2024
Mehran University Newsletter Vol-X, Issue-I, 2024
 
ICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptxICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptx
 
Unit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptxUnit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptx
 
1029-Danh muc Sach Giao Khoa khoi 6.pdf
1029-Danh muc Sach Giao Khoa khoi  6.pdf1029-Danh muc Sach Giao Khoa khoi  6.pdf
1029-Danh muc Sach Giao Khoa khoi 6.pdf
 
SKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptx
SKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptxSKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptx
SKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptx
 
Spellings Wk 3 English CAPS CARES Please Practise
Spellings Wk 3 English CAPS CARES Please PractiseSpellings Wk 3 English CAPS CARES Please Practise
Spellings Wk 3 English CAPS CARES Please Practise
 
Food safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdfFood safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdf
 
ComPTIA Overview | Comptia Security+ Book SY0-701
ComPTIA Overview | Comptia Security+ Book SY0-701ComPTIA Overview | Comptia Security+ Book SY0-701
ComPTIA Overview | Comptia Security+ Book SY0-701
 
How to Manage Global Discount in Odoo 17 POS
How to Manage Global Discount in Odoo 17 POSHow to Manage Global Discount in Odoo 17 POS
How to Manage Global Discount in Odoo 17 POS
 
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdfUGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
 
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
 
On National Teacher Day, meet the 2024-25 Kenan Fellows
On National Teacher Day, meet the 2024-25 Kenan FellowsOn National Teacher Day, meet the 2024-25 Kenan Fellows
On National Teacher Day, meet the 2024-25 Kenan Fellows
 
1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdf
 

Visweek08 Icke Sklar Final

  • 1. Daisy Map: A Visualization Tool For Student Assessments Data October 2008 From Theory to Practice: Design, Vision and Visualization Workshop Ilknur Ickea Elizabeth Sklar a,b iicke@gc.cuny.edu sklar@sci.brooklyn.cuny.edu Dept. of Computer Science, Dept. of Computer and Information Science, (a) (b) Graduate Center, Brooklyn College of the City University of New York, City University of New York, 365 Fifth Ave. Brooklyn, NY, 11210 New York, NY,10016 This work was partially supported by NSF #ITR-05-52294, NSF #PFI-03-32596 and by US Dept of Education SBIR #ED-06-PO-0895
  • 2. Motivation • Computers are ubiquitous in schools today. • Education data is gathered covering a wide range of information on: • student assessments • student enrolment • financial aspects • Amount of data collected is overwhelming to educators, administrators, policy-makers. • Our work explores the use of intelligent data analysis and visualization techniques to help make sense of education data.
  • 3. Academic Assessments Case Study • We worked with Children's Progress Inc.(*) to develop visualization and analysis tools on their student assessment application named CPAA. • The CPAA covers core concepts that are essential to early childhood development, grouped into language arts and mathematics categories (listening, pre-reading, alphabet knowledge, phonemic awareness, reading, writing mechanics,numbers and quantities, numeracy, operations, measurement and patterns). * http://www.childrensprogress.com
  • 4. CPAA Overview • The core concepts are divided into prime questions which address specific concept components. • For example; phonemic awareness is comprised of prime questions related to: rhyming, initial sound, blending, and syllable counting. • The concepts were chosen to reflect US national and state academic standards for language arts and mathematics for ages 4-8.
  • 5. CPAA-Adaptive Assessment • The prime questions are organized within the assessment in an adaptive manner. • If a child answers a particular prime question correctly, then she will receive a more difficult prime question; if not, she will receive a hint. • A hint is the same question again, presented in a different format. • Each incorrect response choice has a particular outcome that provides a different kind of hint to guide the child to the correct answer.
  • 7. Scoring • Each assessment covers multiple concepts (Reading(re), Writing(wr), Measurement(me), Operations(op), Pattern Forming(pf) and so on). • Children receive one of the four scores from each concept : • 1 Below expectation • 2 Approaching expectation • 3 At expectation • 4 Above expectation • These scores are State standard. • Assessments are repeated from time to time within a year (fall, winter, spring) and across different grades (from pre-k to 3rd grade).
  • 8. Data Cube of Assessment Scores “When?” “Who?” “What?”
  • 9. Task: Design a Visualization Tool • We want a high-level visualization tool to help us monitor how a group of students performed on assessments over a period of time. • We want to see the scores on each concept within an assessment. • We want to see the changes in scores across different assessments. • This is like displaying the data cube(3D) on the screen(2D).
  • 10. From Data Cube to Daisy Map
  • 11. Color Coding of Scores 1:Red 2:Yellow 3:Blue 4:Green No Score(0): Gray • Each petal represents the score received for one concept. • Color of the petal depends on the score. • More suitable for humans to examine visually than a bunch of numbers since humans are great pattern recognizers.
  • 12. Visualization Application • We built a visualization tool based on our Daisy Map design. • Each student assignment is represented by a daisy. • Goal 1: Each row represents one student's performance across time. • Goal 2: Each column shows the performance of all students on one assessment.
  • 13. Visualization Goal 1 • One student's performance across time
  • 14. Visualization Goal 2 • Performance of all students on one assessment
  • 15. Conclusion • Daisy Map design worked well for our task. • In general, Daisy Map works well in representing a small number of categorical data items. • Color coding the scores as petals of the daisies is more effective than putting the numbers on the screen. • Daisy Map helped us visualize the 3D data cube of student assessments on the 2D screen. • We were able to simultaneously visualize one student's performance across time (horizontally) as well as a group of students' performance on the same assessment (vertically).
  • 16. Thank you! Ilknur Icke http://www.cs.gc.cuny.edu/~iicke iicke@gc.cuny.edu