1. Kinect를 활용한 Chan Seok Kang
동작 인식 프로그래밍
2012.12.15
KINECT FOR WINDOWS

2. Biography
강찬석 (Chan Seok Kang)
• 2011 Microsoft Student Partner 5기
• 2012 Imagine Cup 2012 :
Kinect Fun Lab Semi-Finalist
• (전) KIST 실감교류 연구센터 위촉 연구원
Blog : 자신에 대한 고찰 ( http://talkingaboutme.tistory.com )
Facebook : http://www.facebook.com/kcsgoodboy
KINECT FOR WINDOWS

3. Today`s Session
• 음성으로 제어하는 Kinect Explorer ( 1h~2h )
• Kinect SDK / OpenNI 동시 사용법 ( 1h )
• Processing 활용 (ColorMap / Depth Map) (1h)
KINECT FOR WINDOWS

4. 13th Project
: Speech Controlled Kinect Explorer
KINECT FOR WINDOWS

5. Speech-Controlled Kinect Explorer
• 목적 – Speech Recognition for Tilt control
KINECT FOR WINDOWS

6. Speech-Controlled Kinect Explorer
• Speech SDK Install
KINECT FOR WINDOWS

7. Speech-Controlled Kinect Explorer
• Add Reference File
• + Microsoft.Speech.dll
KINECT FOR WINDOWS

8. Speech-Controlled Kinect Explorer
• Add namespace
• Using Mircosoft.Kinect
• Using Microsoft.speech.recognition
• Using Microsoft.speech.AudioFormat;
• Using System.IO
• Using System.Threading
KINECT FOR WINDOWS

9. Speech-Controlled Kinect Explorer
• Split the Grid
KINECT FOR WINDOWS

10. Speech-Controlled Kinect Explorer
• Insert the ImageControl & Canvas, TextBlock
KINECT FOR WINDOWS

11. Speech-Controlled Kinect Explorer
• XAML View
KINECT FOR WINDOWS

12. Speech-Controlled Kinect Explorer
• Initialize Thread, ThreadStart
KINECT FOR WINDOWS

13. Speech-Controlled Kinect Explorer
• Find the Speech Engine ( test )
KINECT FOR WINDOWS

14. Speech-Controlled Kinect Explorer
• Result
KINECT FOR WINDOWS

15. Speech-Controlled Kinect Explorer
• Modified
KINECT FOR WINDOWS

16. Speech-Controlled Kinect Explorer
• Make a thread
KINECT FOR WINDOWS

17. Speech-Controlled Kinect Explorer
• Insert the Kinect-Enable
KINECT FOR WINDOWS

18. Speech-Controlled Kinect Explorer
• Define the sourceInit
KINECT FOR WINDOWS

19. Speech-Controlled Kinect Explorer
• Fill out the ColorStream
KINECT FOR WINDOWS

20. Speech-Controlled Kinect Explorer
• Fill out the DepthStream
KINECT FOR WINDOWS

21. Speech-Controlled Kinect Explorer
• Fill out the Skeleton Stream
KINECT FOR WINDOWS

22. Speech-Controlled Kinect Explorer
• #region Skeleton
KINECT FOR WINDOWS

23. Speech-Controlled Kinect Explorer
• #endregion Skeleton
KINECT FOR WINDOWS

24. Speech-Controlled Kinect Explorer
• Define the DrawBone
KINECT FOR WINDOWS

25. Speech-Controlled Kinect Explorer
• Use the DrawBone
KINECT FOR WINDOWS

26. Speech-Controlled Kinect Explorer
• test
KINECT FOR WINDOWS

27. Speech-Controlled Kinect Explorer
• Build the Grammar
KINECT FOR WINDOWS

28. Speech-Controlled Kinect Explorer
• Hypothesize / Recognize
• Hypothesize : 단지 추정하는 값
• Recognize : 추정한 값을 통해 인지된 값
-> Speech Engine이 인식한 값을 받으려면
Recognize 이벤트에서 처리해야 됨
여기서는 추정값으로 테스트
KINECT FOR WINDOWS

29. Speech-Controlled Kinect Explorer
• Define Speech Event (Anything you want)
KINECT FOR WINDOWS

30. Speech-Controlled Kinect Explorer
• Result
KINECT FOR WINDOWS

31. Break? Break!
KINECT FOR WINDOWS

32. Break? Break!
KINECT FOR WINDOWS

33. Back To The First Lecture
: Installation
KINECT FOR WINDOWS

34. Installation
• Purpose
• To Develop in Processing Environment!!
KINECT FOR WINDOWS

35. Development Setting
with Kinect OpenNI Bridge
KINECT FOR WINDOWS

36. Step!!
• Installing OpenNI v1.5.2.23
• Installing NITE v1.5.2.21
• Installing SensorKinect v 0.94
• Kinect for Windows 를 OpenNI와 연결시켜주는 드라이버
• Installing Bridge Driver
• Kinect SDK & OpenNI를 같이 쓰게 만드는 드라이버
• Installing Kinect SDK v1.6
KINECT FOR WINDOWS

37. Before Start!!
• 기존에 설치되어 있던 모든 드라이버 삭제
• 키넥트가 뽑힌 상태에서 설치가 진행되어야 함
• 아직 windows 8 을 지원하지 않음
• Windows 7 & VS2010 에서 진행 가능
KINECT FOR WINDOWS

38. Installing OpenNI, NITE, Sensor
• OpenNI Binaries
• Middleware
• 유의사항
• 무조건 32bit!!
KINECT FOR WINDOWS

39. Installing OpenNI, NITE ..
• 정상적인 결과
KINECT FOR WINDOWS

40. Installing Kinect SDK / ToolKit
• After Installing Bridge Driver
• http://talkingaboutme.tistory.com/181
KINECT FOR WINDOWS

41. Install Processing & Library
• Processing.org ->Download 2.0b5 or 2.0b6
• http://code.google.com/p/simple-openni/
-> Download SimpleOpenNI 0.27
KINECT FOR WINDOWS

42. Install Processing & Library
• Extract & move it in document directory
KINECT FOR WINDOWS

43. Processing
KINECT FOR WINDOWS

44. For fun
: RGB / Depth in Processing
KINECT FOR WINDOWS

45. RGB / Depth in Processing
• Import the Library
KINECT FOR WINDOWS

46. RGB / Depth in Processing
KINECT FOR WINDOWS

47. RGB / Depth in Processing
• Define Setup
KINECT FOR WINDOWS

48. RGB / Depth in Processing
• Result
KINECT FOR WINDOWS

49. RGB / Depth in Processing
• Background Subtraction
• 거리에 제한을 두고 색상을 입히는 방식
KINECT FOR WINDOWS

50. If you need help,
Just visit in My blog
http://talkingaboutme.tistory.com
KINECT FOR WINDOWS

51. Through the Third Eye,
See the world deeply.
And Change the world!
KINECT FOR WINDOWS

52. Thank you for Listening 
KINECT FOR WINDOWS

53. KINECT FOR WINDOWS