1. Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments Jun Rekimoto Sony Computer Science Laboratory Inc Oct.15.1997

2. From Single Device UI to multi-Device UI Computer PC PDA PDA Kiosk Wall PC PDA PDA Current PC/GUIs are designed for One-user -- One-computer environment Future Computing Environment must be designed for Multi-user -- Multi-computer environments PDA

4. Mouse Jungle

5. Data Copying through Human Body Note: These computers are connected to the Network

6. How people transfer information between nearby computers? % % % % % % A survey conducted on 40 engineers in Sony’s Software Labs.

8. Drag&Drop Pick-and-Drop Inter Computer Pick-and-Drop

9. Information transition between virtual and physical spaces Computer Space 1 Physical Space Computer Space 2 Display Surface Pen virtually Carries the data Pick Drop

11. Applications of Pick-and-Drop Information exchange between PDAs Picking up information from Kiosk (push media) terminal

12. Wall-sized Display + Palmtop Computer

13. Video

14. System Configuration Network Pen ID = 1 Wall Size Display (or Physical Wall) Desktop Display PDA (Nomadic PCs) ID Data 1 xx.gif Pen ID = 2 Pen Manager

15. Pick-and-Drop between Paper and Computer Tablet Printed Objects Page ID Camera Object ID Page Code Pick Position

19. Pick-and-Drop over ClearBoard ENVISIONMENT

21. State Transition Diagram PEN-DOWN DRAG PEN-UP MOVE Time Out DRAG PEN-UP MOVE DOWN Time Out DRAG MOVE PICK DROP PEN-UP Time Out

22. Pick-Move, Pick-Copy Move Copy