Presentation of Robert Wechsler/Palindrome iIntermedia Group at the Geneva Sessions 09 /Made in Lausanne

1. Motion Tracking Robert Wechsler Palindrome I nter .media Performance Group Stuttgart, Germany Lausanne, June 2009 www.palindrome.de

2. workshop concept "dance first, think afterwards." - Estragon (S.B.) "to work with motion tracking as an artist, start and finish with the body, not with the technology." - Robert (Palindrome)

3. workshop plan 1 Training. non-dancers: 11:30-11:55 ok? 2 Talk / Discussion / video clips 40 min 3 Improv. Chor. programming (patch-writing). 4 Tech. Sessions 5 Project work 6 Stretching, etc.

4. Talks from me (12-12:40) Talk 1: "What is Palindrome? A very brief history of interactive art. Motion tracking and motion capture." Talk 2: "Sensors: body (physiological) vs. environment-based systems. mapping." Talk 3: "Practical issues: how to get the equipment, etc. A critical discussion of video projections."

11. motion capture

12. motion capture

14. motion capture

16. input physical human action motion tracking and interactivity media output sounds, music, text, projections, lighting

17. input physical human action motion tracking computer sensor (e.g. video camera) output device (e.g. loud speakers) media output sounds, music, text, projections, lighting

18. input physical human action motion tracking computer sensor (e.g. video camera) output device (e.g. loud speakers) media output sounds, music, text, projections, lighting analogue to digital conversion digital to analogue conversion

20. input physical human action motion tracking sensor (e.g. video camera) output device (e.g. loud speakers) media output sounds, music, text, projections, lighting computer

21. What does motion tracking have to do with interaction or art?

23. Drawings. France and Spain ca. 3000 BC interactive performance is nothing new -- you don't need computers to do it!

26. a very brief history of technology -supported interaction in performance Dionysis Thr. Athens - 3c BC

27. Ancient greek theater employed a number of mechanical devices to extend the power of the actor to allow them to play gods and goddesses.

28. Louis XIV, the Sun King, was fascinated by remote-acting mechanical devices

29. on the battle field. Cannons allowed you to take deadly action from a distance (500 meters). "gesture amplification". (not an interactive device...)

30. Electronics, interactive sound and lighting devices were used by New York performance artists in the 60's and 70's Robert Rauschenberg - "Pelican" 1963 Laurie Anderson - "Walking Solo for Tape Bow Violin" 1979

32. end of part 1 . www.palindrome.de

33. Motion Tracking - part 2 Talk 2: sensors mapping eyecon instruction Talk 3: what you need to track motion different software and hardware available where to buy it cheaply video projection techniques artistic issues robert wechsler www.palindrome.de

39. m apping mapping choices multiply: input parameters x output parameters x logical relationships = number of mappings there are important human perception issues in these choices! some can be perceived, many can not!

42. mapping "useful" relationships Boolean (logic in on/off relationships) • positive: movt.=media, no movt.=no media • negative: movt.=no media, no movt.=media • toggle: movt.=media, 2nd. movt.=no media • iteration: movt.=media, 2nd movt.=2nd media, etc. • random, sequential or simultaneous effects continuous controllers • higher/lower – as in a slider (loudness, pitch, filters, etc.) • thresholds – beyond which a certain change occurs •

44. end of part 2 . robert wechsler www.palindrome.de

45. Motion Tracking - part 3 Talk 3: what you need to track motion different software and hardware available where to buy it cheaply video projection techniques artistic issues next steps... Eyecon Training how to control images and video how to connection eyecon to MAX/mp Project Work robert wechsler www.palindrome.de

46. what you need to track motion Of course there are different ways to do it. Different artists have different styles of working, different needs... Advantages of EyeCon flexibility, sensitivity -- you can use it in many different ways ease of use, quick start-up time, DIY (do it yourself) relatively low cost To use EyeCon in the "best way", requires 4 things: computer running windows software camera industrial framegrabber*

48. what you need to track motion Framegrabber captures, or digitizes video (turns analog video into digital video) desktop allows for industrial framegrabber: must be: Falcon (LeoLite, et al.) www.ids-imaging.com

49. what you need to track motion Camera almost any camera will work, but... chip size 1/2" allows WIDE angles and high resolution does not need to be color

50. what you need to track motion Lowest Costs desktop computer get a used one? min. 1 GHz 300 e new, shuttle, barebones, 4 GHz 600 e framegrabber 250 e camera 1/2" chip 350 e zoom lens (4-12 mm) 75 e software licenses 100 – 500 e Total Equipment Cost: 1000 – 2000 e Training (w/ me :) ) includes building equipment 1 week 1000, 3 day intensive 600

53. movies, sounds and lights Media can compliment and support the live performer or it can distract from her-him. This means it depends on how you do it. And there is a fundamental issue to think about...

54. 1. make the image smaller 2. make the image less bright, or black & white 3. lower the resolution of the film, "pixilate" it or use various image abstraction methods 4. use non-human material -- human images and faces distract most of all 5. use semi-transparent screens 6. put the screen up high, down low, in the back, or use thin materials 7. project on the side walls, on the floor or ceiling 8. project on the bodies of the performers 9. have the projection incorporate the performer's live image 10. put the image under the control of the of the performer's movement (ie. make it interactive) movies (moving images) are extremely distracting to the live performer.

55. APPROACH 2: Use Stills. Low Motion Slow Motion.

57. motion tracking - review Positive amplification of gesture sense of spontaneity and engagement text and subtext (words say one thing, body says another) can make art interactive in new ways generates genuinely new ways of associating and connecting media helps to get grants and invitations Negative substitute art with special effects complex processes -- compromise quality and subtlety of expressive media. extremely time consuming, distracting life-less materials and tools de-humanize art and artists

58. Motion Tracking End of part 3. "dance first, think afterwards." - Estragon (S.B.) robert@palindrome.de www.palindrome.de

59. e yecon www.eyecon.palindrome.de