3. •
•
•
•
•
•
•
•
•
•
•
•
•

4. Expand the
state of the art
across the
breadth
of computing
Rapidly
transfer
innovative
technologies
into
Microsoft
products
Ensure that
Microsoft
products have a
future

5. Microsoft Research Global Presence
INDIA
Fuse Labs
XCG
Research Connections
Station Q
SILICON VALLEY NEW YORK CITY
ATL Europe
ATL Israel
ATL Cairo
ASIA
CAMBRIDGE
REDMOND
NEW ENGLAND

6. •
•
•

8. •
•
•
The SenseCam project
Prototype (2003) Research product (2009) Product (2012)

9. INTERACTIVE IDENTITY BADGE
Norman Pohl, Steve Hodges, John Helmes, Nic Villar, Tim
Paek
Belt-worn identity badge with embedded LCD display
that senses movement of retractable string attachment to
allow lightweight, single-hand access to information.
OMNITOUCH
Chris Harrison, Hrvoje Benko, Andy Wilson
Uses a camera/projector system mounted on
the shoulder to seamlessly appropriate
surfaces around the user as interactive
displays.MOODWINGS
Asta Roseway, Paul Johns, Patrick Therien, Mary
Czerwinski
Takes input from affective monitoring devices and
physically actuates butterfly wings to signify moods
such as stress or happiness.
BIONIC CONTACT LENS
Babak Parviz, Brian Otis, Desney Tan, et al.
Uses electronics embedded in a contact lens to project a
virtual display directly on the retina. Can also measure
chemical content in the tears (e.g. to continuously sense
glucose levels).MOUTH-COMPUTER INTERFACE
Scott Saponas, Desney Tan, Daniel Kelley, Babak
Parviz
Uses optical sensors built into a dental retainer to
measure tongue gestures for interaction and
potentially for correcting speech impediments.
HUMANTENNA
Gabe Cohn, Dan Morris, Shwetak Patel, Desney Tan, et
al.
Uses static electric field sensing and body as antenna
to detect when user has touched walls and to infer
whole body gestures, all with zero environmental
instrumentation.
MUSCLE-COMPUTER INTERFACE
Scott Saponas, Dan Morris, Desney Tan, et al.
Uses electromyography (EMG) to sense
muscular activity on forearm and infer finger
gestures without instrumenting hand or wrist.
SKINPUT
Chris Harrison, Dan Morris, Desney Tan
Uses bio-acoustic sensing to localize finger
taps on the skin. Augmented with a pico-
projector, can provide direct manipulation,
graphical user interface on the hand, arm, or
body.
ARMBAND COMMUNICATION
Ran Gilad-Bachrach, Gerald DeJean, Trang Thai, Asta
Roseway
Uses electric fields to turn arm into confined
communication channel that does not require wire. Can
also allow secure communication between people when
they touch.
DIGITS
David Kim, Otmar Hilliges, Shahram Izadi, et al.
Uses infrared illumination/camera system on wrist,
coupled with biomechanical model of hand, to sense
and reconstruct high-resolution finger gestures.
Wearables @
SEPTIMU
Guobin Shen, Feng Zhao, John Stankovic, et al.
Uses an IMU, IR sensor, and microphone embedded in
earphones to detect heart rate, activity level, head
gestures, and context. Can be used to control games or
music playback.
SENSECAM
Steve Hodges, Ken Wood, Abi Sellen, et al.
Wearable camera that automatically captures
photos. Useful in aiding people with memory loss,
logging dietary intake, measuring environmental
context, etc.

10. •
•
•
Build your own device: .NET Gadgeteer

11. Modular
Hardware
Software
Tools
Physical
Design
The .NET Gadgeteer Platform

12. Modular
Hardware
Software
Tools
Physical
Design
The .NET Gadgeteer Platform

13. Modular hardware: mainboards

14. Modules: sensors

15. Modules: communication

16. Modules: display and user input

17. Modules: power and actuation

18. Modules: storage and audio

19. Modules: extensibility

20. Sockets have types, which specify
their electronic interface capabilities

21. Connecting a module to a mainboard

22. Modular
Hardware
Software
Tools
Physical
Design
The .NET Gadgeteer Platform

23. Based on the .NET Micro Framework:
 Subset of .NET
 Programming in C# and Visual Basic
 Interactive debugging
.NET Gadgeteer adds:
 Gadgeteer Core Libraries
 Visual Studio Graphical Designer
 Framework for mainboard and module drivers
Software tools

24. Starting a new .NET Gadgeteer project

26. Modular
Hardware
Software
Tools
Physical
Design
The .NET Gadgeteer Platform

27. Laser-cut enclosure (arcade game)

28. 3D-printed enclosure

29. http://netmf.com/gadgeteer
gadgeteer@microsoft.com

31. Identifying Genetic Causes of Disease

32. •
•
•
•
A A A A
A A T AA A A A
TT
TTTT
TT T T
T
T
TA A
A AA
A A
A
A
A
A A
A A
A

33. Factored Spectrally
Transformed Linear Mixed Models
•
•
•
•
•
nature | methods September 2011
nature | methods June 2012
FaST-LMM
previous
state of
the art

34. •
•
•
•
http://snap.cs.berkeley.edu/

35. •
•
• http://bio.codeplex.com

37. •
•
•
•
•
•
Acquisition Annotation Collaboration

38. •
•
•
•
http://research.microsoft.com/medimaging
Acquisition Annotation Collaboration

39. •
•
•
•
•
http://research.microsoft.com/
medimaging
Acquisition Annotation Collaboration

40. Questions?

42. •
•
•