In this paper, we first survey technologies on indoor positioning and motion recognition which is one of the principal IoH technologies. Next, we illustrate an example of system designs to extract information on 6M consisting of Man, Machine, Material, Method, Mother-nature, and Money by performing intelligent compression of sensor data, facility data, and work records for various modelling, simulation, and mieruka. Finally, we discuss the advantages for introducing measurement technologies. Presented in IEEE VR 2019 Workshop on Smart Work Technologies (WSWT) http://seam.pj.aist.go.jp/symposium/WSWT2019/

1. ©2017 Sumitomo Electric Industries, Ltd. All Rights Reserved
Towards Realization of
6M Visualization in
Manufacturing Sites
Takeshi Kurata12
Takashi Maehata1, Hidehiko Hashimoto1,
Naohiro Tada1, Ryosuke Ichikari2
1 IoT R&D Center, SEI, Japan
2Human Augmentation Research Center, AIST, Japan

2. ©2017 Sumitomo Electric Industries, Ltd. All Rights Reserved
6M in manufacturing sites
IoT
✔
✔✔
✔
✖
✖
IoT: Internet of Things
IoH: Internet of Humans
IoH
✔
✔
2

3. ©2017 Sumitomo Electric Industries, Ltd. All Rights Reserved
Flow line Measurement for Kaizen (Improvement)
Key IoH tech: Indoor positioning
Outdoor: Free of charge
• Positioning: GNSS (GPS, Michibiki)
• Maps: Google Maps, OSM
Workers/Operators’ positions:
Strong correlation with operation contents
GNSS: Global Navigation Satellite System
OSM: OpenStreetMap
3
Indoor: Benefit principle
• Positioning: Stationary notes installation needed
• Maps: Floor plan creation needed
Japanese people:
Spend 90% of time indoors
Manufacturing sites:
Often occupied by indoor environments

4. National Institute of Advanced Industrial Science and Technology
Indoor positioning:
Pros and Cons
4
xDR: PDR
xDR: VDR
Low cost,
Weaving
positioning
methods
Integrated
positioning
• Combining methods suitable for
each site
• Balancing precision/accuracy and
cost
Indoorpositioning
technologymap
Who?
✖ Occlusion
✖ Occlusion
High power
consumption
High cost
Low precision

5. National Institute of Advanced Industrial Science and Technology
xDR weaving various positioning methods
VDR:
(Vibration-based) Vehicle
Dead Reckoning
[World’s first, 2015]
[Relative positioning]
xDR: PDR+VDR
PDR:
Pedestrian Dead
Reckoning,
[World’s first
Smartphone demo,
2010]
5

6. National Institute of Advanced Industrial Science and Technology 6
Development Platform for Indoor Positioning Technologies

7. National Institute of Advanced Industrial Science and Technology
• Low cost: Utilize 10-axis sensor (accelerometers, gyro sensors,
magnetic sensors, and barometer)
• Low power consumption: 1/20 or less than vision-based systems
• Continuity: Keep tracking without stationary nodes
• Meaningful: Weave various positioning methods with meaningful
lines (shape, speed, heading)
Speed
Heading
Model-based speed estimation
Attitude estimation
Sensor calibration
Moving direction
estimation
Elevation
(Floorlevel)
estimation
7
Model for Pedestrians Model for Vehicles
xDR weaving various positioning methods
VDR:
(Vibration-based)
Vehicle Dead
Reckoning
[World’s first,
2015]
PDR:
Pedestrian
Dead
Reckoning,
[World’s
first
Smartphone
demo,
2010]

8. National Institute of Advanced Industrial Science and Technology
xDR Challenge for Warehouse Operations
• Was held as an sequel competition to "PDR Challenge in Warehouse
Picking“ (Hosted by PDR benchmark standardization committee)
• Competition of Dead-Reckoning for Pedestrian and Vehicle
– xDR=PDR+VDR
• Important dates
– Testing period: Mid May to Mid Aug., 2018
– Results submission due: 18th Sep, 2018
– Announcement of Winners: In IPIN 2018
• Winners
– PDR Track: HBSM from SEI
• Runner-Up: No PDR, No Future! from KDDI Research, Inc.
– VDR Track: HBSM from SEI
• Sponsors:
8

9. ©2017 Sumitomo Electric Industries, Ltd. All Rights Reserved9
Indoor positioning system in SEI

10. National Institute of Advanced Industrial Science and Technology
Motion and Operation Recognition
• Typically, 10 to 20 IMUs attached all over the body
• Reduce the number of IMUs (Partial body measurement)
✔Less cumbersome for workers and hardware cost reduction
✖Precision reduction (Around 10 to 20%)
• Whole-body: Micro-positional data of each body part based on the
skeleton model
• Partial-body: Only local movements for the available sensors
• IoH sensor module with a wearable passive RFID reader and a 10-
axis sensor
– Micro-positional data: Obtainable once more
10
10－20 5 2 & Passive RFID reader
Num of
ten-axis sensors
IMU: Inertia Measurement Unit

11. ©2017 Sumitomo Electric Industries, Ltd. All Rights Reserved
Mieruka, kaizen, and pre-evaluation with
IoH/IoH and social technologies
11
IE: Industrial Engineering, OR: Operations Research, CSQCC: Comupter Supported Quality Control Circle
UI: User Interface, VR: Virtual Reality, MAR: Mixed and Augmented Reality

12. ©2017 Sumitomo Electric Industries, Ltd. All Rights Reserved
6M information by intelligent compression of
sensor data, facility data, and work records
12

13. ©2017 Sumitomo Electric Industries, Ltd. All Rights Reserved
Continual vs On-time
Advantages of continual data record
• Capable of natural behavior observation
• Capable of going back in time such as dashboard cameras
• MTT (Make Time Tangible), Virtual time machine
• Less time lag from problem identified to cause analysis w/ data
13

14. ©2017 Sumitomo Electric Industries, Ltd. All Rights Reserved
Conclusion
14

15. ©2017 Sumitomo Electric Industries, Ltd. All Rights Reserved
In-depth survey
(Narrow but deep)
Screening
with 6M data
(Wide but shallow)
15
Future Works