1. Computer Assisted Surgery
and
Medical Image Analysis
Computer Vision Group
Artificial Intelligence Laboratory
Massachusetts Institute of Technology
Surgical Planning Lab
Brigham and Women’s Hospital
Harvard Medical School

2. Computer assisted surgery
• Goal:
– Use computer vision techniques to plan and guide
surgical interventions, by giving the surgeon the
ability to sense critical information that is not
normally visible to her
• How?
– Capture models of patient anatomy and function
– Use to guide surgeon’s actions

3. Conventional Surgery: See
the surface
Provided by Nakajima, Atsumi et al.

4. Image Guided Surgery: See
under the surface
Provided by Leventon et al.

5. Intelligently aiding the surgeon
• Convert medical images into models of
patient’s:
– Structural anatomy
– Functional anatomy

7. Central Vessels
common carotid
artery
subclavian artery
brachio
cephalic
trunc
brachio cephalic
trunc
pulmonary trunk
pulmonary
veins
aorta
Courtesy of Lorigo

8. Cartilage
Thickness
Mapping
Courtesy Warfield, Winalski

9. Functional information

10. Visualizing the surgical site
• Augmented
reality
visualizations
• Surgical
guidance
• Simulation of
surgical
navigation

11. Visualizing the surgical site
• Augmented
reality
visualizations
• Surgical
guidance
• Simulation of
surgical
navigation

12. Surgical navigation

13. Visualizing the surgical site
• Augmented
reality
visualizations
• Surgical
guidance
• Simulation of
surgical
navigation