SlideShare una empresa de Scribd logo
1 de 57
Using Data to Understand the Brain

          John Myles White


           March 26, 2012




                                     1 / 57
We want to learn how the brain works




                                       2 / 57
3 / 57
4 / 57
How can learn about the mind and brain using data and models?




                                                                5 / 57
6 / 57
7 / 57
8 / 57
Brain damage victims taught us about functional localization




                                                               9 / 57
10 / 57
How can we learn more without shooting people?




                                                 11 / 57
12 / 57
MRI can give us:
    High-resolution anatomical images
    Real-time measurements of blood flow (fMRI)




                                                 13 / 57
A typical MRI experimental data set contains:
    10 MB of anatomical data
    ∼ 1 GB of fMRI data
         Time series of blood flow sampled every 2s
         Sampled at 60 x 60 x 60 voxels




                                                     14 / 57
15 / 57
16 / 57
17 / 57
How can we use blood flow measurements to learn about function?




                                                                 18 / 57
Design an experiment that randomly switches between tasks:
    Tapping one finger vs. sitting motionless
    Looking at faces vs. looking at places
    Thinking about people vs. thinking about objects




                                                             19 / 57
20 / 57
Search blood flow data for brain regions that respond to tasks




                                                                21 / 57
How can we analyze blood flow data to perform this search?




                                                            22 / 57
The typical approach looks at each voxel separately:
    Try to predict blood flow using task events
    Uses standard linear regression
    Many connections with signal processing




                                                       23 / 57
A newer approach, called MVPA, works in the reverse direction




                                                                24 / 57
In MVPA, we try to predict tasks using blood flow




                                                   25 / 57
26 / 57
We have fewer task-tagged brain images than voxels, so n < p




                                                               27 / 57
Need to use regularization to perform any analysis




                                                     28 / 57
Consider solving y = Xβ




                          29 / 57
When n = p, there may be a unique solution
When n > p, we must choose an approximation
When n < p, there are infinitely many exact solutions
To find “correct” solution, we have to introduce constraints




                                                              30 / 57
In linear regression, we minimize (y − Xβ)2




                                              31 / 57
In L2 regularization, we minimize (y − Xβ)2 + λβ 2




                                                     32 / 57
L2 constraint lets us solve n < p case




                                         33 / 57
But L2 often does not help us find the few voxels that matter most




                                                                    34 / 57
We can try another regularization system called L1 regularization




                                                                    35 / 57
In L1 regularization, we minimize (y − Xβ)2 + λ|β|




                                                     36 / 57
L1 regularization is very modern
Objective function is not differentiable
But is convex and can be minimized computationally
Solution, β ∗ , to minimization problem is typically sparse




                                                              37 / 57
A sparse solution is one in which most features have a weight of 0




                                                                     38 / 57
For MVPA, L1 sparse solutions are, sadly, too sparse




                                                       39 / 57
40 / 57
From neurology, we know we should expect large clusters of voxels




                                                                    41 / 57
42 / 57
Best current approach: mix L1 and L2




                                       43 / 57
In the Elastic Net, we minimize (y − Xβ)2 + λ1 |β| + λ2 β 2




                                                              44 / 57
45 / 57
Improving localization using MVPA is an ongoing problem




                                                          46 / 57
But MVPA has already changed our understanding of the brain




                                                              47 / 57
Forget localization. Focus on prediction




                                           48 / 57
Imagine we have built a classifier that identifies tasks correctly




                                                                   49 / 57
We can use the classifier to test how people think about other tasks




                                                                      50 / 57
The free-recall task:
    Experimental subjects memorize items from 3 lists:
      1. Locations
      2. Faces
      3. Objects
    Subjects then try to recall as many items as they can




                                                            51 / 57
Our theory:
    To remember items, you return to the mental state you were
    in when you memorized the lists
    Before you name any specific item, you return to the state
    concerned with that item’s category
    Only then can you name any specific items




                                                                 52 / 57
Our approach:
    We train classifier to identify type of list being memorized
    We use classifier to assess mental state during free-recall




                                                                  53 / 57
54 / 57
In short, we’re already able to read minds




                                             55 / 57
The real questions for the field are:
    How can we do it better?
    How can we learn more about the brain from fMRI data?




                                                            56 / 57
Any questions?




                 57 / 57

Más contenido relacionado

Destacado

ομορσιες σος καναδα
ομορσιες σος καναδαομορσιες σος καναδα
ομορσιες σος καναδα
filipj2000
 
Pps delz@-forbidden city-reissue 2011
Pps delz@-forbidden city-reissue 2011Pps delz@-forbidden city-reissue 2011
Pps delz@-forbidden city-reissue 2011
filipj2000
 
Luciano pavarotti chitarra romana
Luciano pavarotti chitarra romanaLuciano pavarotti chitarra romana
Luciano pavarotti chitarra romana
filipj2000
 

Destacado (20)

Mexico by john2
Mexico by john2  Mexico by john2
Mexico by john2
 
10강 기업교육론 20110504
10강 기업교육론 2011050410강 기업교육론 20110504
10강 기업교육론 20110504
 
ομορσιες σος καναδα
ομορσιες σος καναδαομορσιες σος καναδα
ομορσιες σος καναδα
 
Zeynep ASA 2011 privacy
Zeynep ASA 2011 privacyZeynep ASA 2011 privacy
Zeynep ASA 2011 privacy
 
Itkan mobile-disabilities v5
Itkan mobile-disabilities v5Itkan mobile-disabilities v5
Itkan mobile-disabilities v5
 
Tecnicas
TecnicasTecnicas
Tecnicas
 
Jim sterne terametric_twitter-webinar_120910
Jim sterne terametric_twitter-webinar_120910Jim sterne terametric_twitter-webinar_120910
Jim sterne terametric_twitter-webinar_120910
 
Pps delz@-forbidden city-reissue 2011
Pps delz@-forbidden city-reissue 2011Pps delz@-forbidden city-reissue 2011
Pps delz@-forbidden city-reissue 2011
 
Lec13
Lec13Lec13
Lec13
 
Collective action under autocracies
Collective action under autocraciesCollective action under autocracies
Collective action under autocracies
 
Pamukkale gr
Pamukkale grPamukkale gr
Pamukkale gr
 
Lec5
Lec5Lec5
Lec5
 
기업교육론 2장 학생발표자료 20110309
기업교육론 2장 학생발표자료 20110309기업교육론 2장 학생발표자료 20110309
기업교육론 2장 학생발표자료 20110309
 
Antartica
AntarticaAntartica
Antartica
 
Bx Lite
Bx LiteBx Lite
Bx Lite
 
13강 기업교육론 20110603
13강 기업교육론 2011060313강 기업교육론 20110603
13강 기업교육론 20110603
 
Geography of microwave survey
Geography of microwave surveyGeography of microwave survey
Geography of microwave survey
 
4강 기업교육론 20110323(공유)
4강 기업교육론 20110323(공유)4강 기업교육론 20110323(공유)
4강 기업교육론 20110323(공유)
 
Luciano pavarotti chitarra romana
Luciano pavarotti chitarra romanaLuciano pavarotti chitarra romana
Luciano pavarotti chitarra romana
 
Gettysburg
GettysburgGettysburg
Gettysburg
 

Más de jakehofman

NYC Data Science Meetup: Computational Social Science
NYC Data Science Meetup: Computational Social ScienceNYC Data Science Meetup: Computational Social Science
NYC Data Science Meetup: Computational Social Science
jakehofman
 
Computational Social Science, Lecture 13: Classification
Computational Social Science, Lecture 13: ClassificationComputational Social Science, Lecture 13: Classification
Computational Social Science, Lecture 13: Classification
jakehofman
 
Computational Social Science, Lecture 11: Regression
Computational Social Science, Lecture 11: RegressionComputational Social Science, Lecture 11: Regression
Computational Social Science, Lecture 11: Regression
jakehofman
 
Computational Social Science, Lecture 10: Online Experiments
Computational Social Science, Lecture 10: Online ExperimentsComputational Social Science, Lecture 10: Online Experiments
Computational Social Science, Lecture 10: Online Experiments
jakehofman
 

Más de jakehofman (20)

Modeling Social Data, Lecture 12: Causality & Experiments, Part 2
Modeling Social Data, Lecture 12: Causality & Experiments, Part 2Modeling Social Data, Lecture 12: Causality & Experiments, Part 2
Modeling Social Data, Lecture 12: Causality & Experiments, Part 2
 
Modeling Social Data, Lecture 11: Causality and Experiments, Part 1
Modeling Social Data, Lecture 11: Causality and Experiments, Part 1Modeling Social Data, Lecture 11: Causality and Experiments, Part 1
Modeling Social Data, Lecture 11: Causality and Experiments, Part 1
 
Modeling Social Data, Lecture 10: Networks
Modeling Social Data, Lecture 10: NetworksModeling Social Data, Lecture 10: Networks
Modeling Social Data, Lecture 10: Networks
 
Modeling Social Data, Lecture 8: Classification
Modeling Social Data, Lecture 8: ClassificationModeling Social Data, Lecture 8: Classification
Modeling Social Data, Lecture 8: Classification
 
Modeling Social Data, Lecture 7: Model complexity and generalization
Modeling Social Data, Lecture 7: Model complexity and generalizationModeling Social Data, Lecture 7: Model complexity and generalization
Modeling Social Data, Lecture 7: Model complexity and generalization
 
Modeling Social Data, Lecture 6: Regression, Part 1
Modeling Social Data, Lecture 6: Regression, Part 1Modeling Social Data, Lecture 6: Regression, Part 1
Modeling Social Data, Lecture 6: Regression, Part 1
 
Modeling Social Data, Lecture 4: Counting at Scale
Modeling Social Data, Lecture 4: Counting at ScaleModeling Social Data, Lecture 4: Counting at Scale
Modeling Social Data, Lecture 4: Counting at Scale
 
Modeling Social Data, Lecture 3: Data manipulation in R
Modeling Social Data, Lecture 3: Data manipulation in RModeling Social Data, Lecture 3: Data manipulation in R
Modeling Social Data, Lecture 3: Data manipulation in R
 
Modeling Social Data, Lecture 2: Introduction to Counting
Modeling Social Data, Lecture 2: Introduction to CountingModeling Social Data, Lecture 2: Introduction to Counting
Modeling Social Data, Lecture 2: Introduction to Counting
 
Modeling Social Data, Lecture 1: Overview
Modeling Social Data, Lecture 1: OverviewModeling Social Data, Lecture 1: Overview
Modeling Social Data, Lecture 1: Overview
 
Modeling Social Data, Lecture 8: Recommendation Systems
Modeling Social Data, Lecture 8: Recommendation SystemsModeling Social Data, Lecture 8: Recommendation Systems
Modeling Social Data, Lecture 8: Recommendation Systems
 
Modeling Social Data, Lecture 6: Classification with Naive Bayes
Modeling Social Data, Lecture 6: Classification with Naive BayesModeling Social Data, Lecture 6: Classification with Naive Bayes
Modeling Social Data, Lecture 6: Classification with Naive Bayes
 
Modeling Social Data, Lecture 3: Counting at Scale
Modeling Social Data, Lecture 3: Counting at ScaleModeling Social Data, Lecture 3: Counting at Scale
Modeling Social Data, Lecture 3: Counting at Scale
 
Modeling Social Data, Lecture 2: Introduction to Counting
Modeling Social Data, Lecture 2: Introduction to CountingModeling Social Data, Lecture 2: Introduction to Counting
Modeling Social Data, Lecture 2: Introduction to Counting
 
Modeling Social Data, Lecture 1: Case Studies
Modeling Social Data, Lecture 1: Case StudiesModeling Social Data, Lecture 1: Case Studies
Modeling Social Data, Lecture 1: Case Studies
 
NYC Data Science Meetup: Computational Social Science
NYC Data Science Meetup: Computational Social ScienceNYC Data Science Meetup: Computational Social Science
NYC Data Science Meetup: Computational Social Science
 
Computational Social Science, Lecture 13: Classification
Computational Social Science, Lecture 13: ClassificationComputational Social Science, Lecture 13: Classification
Computational Social Science, Lecture 13: Classification
 
Computational Social Science, Lecture 11: Regression
Computational Social Science, Lecture 11: RegressionComputational Social Science, Lecture 11: Regression
Computational Social Science, Lecture 11: Regression
 
Computational Social Science, Lecture 10: Online Experiments
Computational Social Science, Lecture 10: Online ExperimentsComputational Social Science, Lecture 10: Online Experiments
Computational Social Science, Lecture 10: Online Experiments
 
Computational Social Science, Lecture 09: Data Wrangling
Computational Social Science, Lecture 09: Data WranglingComputational Social Science, Lecture 09: Data Wrangling
Computational Social Science, Lecture 09: Data Wrangling
 

Último

Salient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functionsSalient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functions
KarakKing
 

Último (20)

Unit 3 Emotional Intelligence and Spiritual Intelligence.pdf
Unit 3 Emotional Intelligence and Spiritual Intelligence.pdfUnit 3 Emotional Intelligence and Spiritual Intelligence.pdf
Unit 3 Emotional Intelligence and Spiritual Intelligence.pdf
 
SOC 101 Demonstration of Learning Presentation
SOC 101 Demonstration of Learning PresentationSOC 101 Demonstration of Learning Presentation
SOC 101 Demonstration of Learning Presentation
 
General Principles of Intellectual Property: Concepts of Intellectual Proper...
General Principles of Intellectual Property: Concepts of Intellectual  Proper...General Principles of Intellectual Property: Concepts of Intellectual  Proper...
General Principles of Intellectual Property: Concepts of Intellectual Proper...
 
ICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptxICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptx
 
How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17
 
Google Gemini An AI Revolution in Education.pptx
Google Gemini An AI Revolution in Education.pptxGoogle Gemini An AI Revolution in Education.pptx
Google Gemini An AI Revolution in Education.pptx
 
Towards a code of practice for AI in AT.pptx
Towards a code of practice for AI in AT.pptxTowards a code of practice for AI in AT.pptx
Towards a code of practice for AI in AT.pptx
 
80 ĐỀ THI THỬ TUYỂN SINH TIẾNG ANH VÀO 10 SỞ GD – ĐT THÀNH PHỐ HỒ CHÍ MINH NĂ...
80 ĐỀ THI THỬ TUYỂN SINH TIẾNG ANH VÀO 10 SỞ GD – ĐT THÀNH PHỐ HỒ CHÍ MINH NĂ...80 ĐỀ THI THỬ TUYỂN SINH TIẾNG ANH VÀO 10 SỞ GD – ĐT THÀNH PHỐ HỒ CHÍ MINH NĂ...
80 ĐỀ THI THỬ TUYỂN SINH TIẾNG ANH VÀO 10 SỞ GD – ĐT THÀNH PHỐ HỒ CHÍ MINH NĂ...
 
Jamworks pilot and AI at Jisc (20/03/2024)
Jamworks pilot and AI at Jisc (20/03/2024)Jamworks pilot and AI at Jisc (20/03/2024)
Jamworks pilot and AI at Jisc (20/03/2024)
 
HMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptx
HMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptxHMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptx
HMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptx
 
On_Translating_a_Tamil_Poem_by_A_K_Ramanujan.pptx
On_Translating_a_Tamil_Poem_by_A_K_Ramanujan.pptxOn_Translating_a_Tamil_Poem_by_A_K_Ramanujan.pptx
On_Translating_a_Tamil_Poem_by_A_K_Ramanujan.pptx
 
Salient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functionsSalient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functions
 
Understanding Accommodations and Modifications
Understanding  Accommodations and ModificationsUnderstanding  Accommodations and Modifications
Understanding Accommodations and Modifications
 
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdfUGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
 
Key note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdfKey note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdf
 
Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...
Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...
Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...
 
Food safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdfFood safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdf
 
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...
 
NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...
NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...
NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...
 
ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.
 

Using Data to Understand the Brain

  • 1. Using Data to Understand the Brain John Myles White March 26, 2012 1 / 57
  • 2. We want to learn how the brain works 2 / 57
  • 5. How can learn about the mind and brain using data and models? 5 / 57
  • 9. Brain damage victims taught us about functional localization 9 / 57
  • 11. How can we learn more without shooting people? 11 / 57
  • 13. MRI can give us: High-resolution anatomical images Real-time measurements of blood flow (fMRI) 13 / 57
  • 14. A typical MRI experimental data set contains: 10 MB of anatomical data ∼ 1 GB of fMRI data Time series of blood flow sampled every 2s Sampled at 60 x 60 x 60 voxels 14 / 57
  • 18. How can we use blood flow measurements to learn about function? 18 / 57
  • 19. Design an experiment that randomly switches between tasks: Tapping one finger vs. sitting motionless Looking at faces vs. looking at places Thinking about people vs. thinking about objects 19 / 57
  • 21. Search blood flow data for brain regions that respond to tasks 21 / 57
  • 22. How can we analyze blood flow data to perform this search? 22 / 57
  • 23. The typical approach looks at each voxel separately: Try to predict blood flow using task events Uses standard linear regression Many connections with signal processing 23 / 57
  • 24. A newer approach, called MVPA, works in the reverse direction 24 / 57
  • 25. In MVPA, we try to predict tasks using blood flow 25 / 57
  • 27. We have fewer task-tagged brain images than voxels, so n < p 27 / 57
  • 28. Need to use regularization to perform any analysis 28 / 57
  • 29. Consider solving y = Xβ 29 / 57
  • 30. When n = p, there may be a unique solution When n > p, we must choose an approximation When n < p, there are infinitely many exact solutions To find “correct” solution, we have to introduce constraints 30 / 57
  • 31. In linear regression, we minimize (y − Xβ)2 31 / 57
  • 32. In L2 regularization, we minimize (y − Xβ)2 + λβ 2 32 / 57
  • 33. L2 constraint lets us solve n < p case 33 / 57
  • 34. But L2 often does not help us find the few voxels that matter most 34 / 57
  • 35. We can try another regularization system called L1 regularization 35 / 57
  • 36. In L1 regularization, we minimize (y − Xβ)2 + λ|β| 36 / 57
  • 37. L1 regularization is very modern Objective function is not differentiable But is convex and can be minimized computationally Solution, β ∗ , to minimization problem is typically sparse 37 / 57
  • 38. A sparse solution is one in which most features have a weight of 0 38 / 57
  • 39. For MVPA, L1 sparse solutions are, sadly, too sparse 39 / 57
  • 41. From neurology, we know we should expect large clusters of voxels 41 / 57
  • 43. Best current approach: mix L1 and L2 43 / 57
  • 44. In the Elastic Net, we minimize (y − Xβ)2 + λ1 |β| + λ2 β 2 44 / 57
  • 46. Improving localization using MVPA is an ongoing problem 46 / 57
  • 47. But MVPA has already changed our understanding of the brain 47 / 57
  • 48. Forget localization. Focus on prediction 48 / 57
  • 49. Imagine we have built a classifier that identifies tasks correctly 49 / 57
  • 50. We can use the classifier to test how people think about other tasks 50 / 57
  • 51. The free-recall task: Experimental subjects memorize items from 3 lists: 1. Locations 2. Faces 3. Objects Subjects then try to recall as many items as they can 51 / 57
  • 52. Our theory: To remember items, you return to the mental state you were in when you memorized the lists Before you name any specific item, you return to the state concerned with that item’s category Only then can you name any specific items 52 / 57
  • 53. Our approach: We train classifier to identify type of list being memorized We use classifier to assess mental state during free-recall 53 / 57
  • 55. In short, we’re already able to read minds 55 / 57
  • 56. The real questions for the field are: How can we do it better? How can we learn more about the brain from fMRI data? 56 / 57
  • 57. Any questions? 57 / 57