Se ha denunciado esta presentación.
Utilizamos tu perfil de LinkedIn y tus datos de actividad para personalizar los anuncios y mostrarte publicidad más relevante. Puedes cambiar tus preferencias de publicidad en cualquier momento.
Paper #34
Low-cost data-driven 3D
reconstruction and applications
Alfredo Ballester
Technical Session 10: RGB-D Sensors & ...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
• De...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
• De...
• Why?
• How it works
• Our solutions
• Next evolutions
• Some examples
Why data-driven reconstruction?
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
#2
m...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
#2
m...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
#2
m...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
#2
m...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
#2
m...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Why ...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Why ...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
#1
h...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
#1
h...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
#1
h...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
#1
h...
How it works
How it works: the guts
3D scan databases registered
using Template-based Methods
(Ballester et al. 2014)
How it works: the guts
3D scan databases registered
using Template-based Methods
(Ballester et al. 2014)
How it works: the guts
3D scan databases registered
using Template-based Methods
(Ballester et al. 2014)
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
PC40...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
How ...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
How ...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
How ...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
How ...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
How ...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
How ...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
How ...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
How ...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
How ...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
How ...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
How ...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
How ...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
How ...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
How ...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
How ...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
How ...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
How ...
Our solutions
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Foot...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Foot...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Foot...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Foot...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Foot...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Foot...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Foot...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Foot...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Foot...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Foot...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Foot...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Foot...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Foot...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Body...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Body...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Body...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Body...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Body...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Body...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Body...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Body...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Body...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Body...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Body...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Body...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Body...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Body...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Body...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Body...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Body...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Body...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Body...
Next steps in data-driven
reconstruction
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Next...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Next...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Next...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Next...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Next...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Next...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Next...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Next...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Next...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Next...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Next...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Next...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Next...
Examples of services including IBV
data-driven 3D reconstruction
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Inso...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Foot...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Chil...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Chil...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Chil...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Chil...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Chil...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Chil...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Chil...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Chil...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Chil...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Chil...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Virt...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Virt...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Virt...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Virt...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Virt...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Virt...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Virt...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Virt...
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Virt...
Thanks!
Alfredo Ballester
Alfredo.ballester@ibv.upv.es
Any Questions?
Dr. Carlos Soler (CTO)
Sandra Alemany (Chief Researc...
Próxima SlideShare
Cargando en…5
×

Low-cost data-driven 3D reconstruction and its applications @ 6th ICE 3D Body Scanning Tecnologies, October 2015, Lugano

2.501 visualizaciones

Publicado el

Presented the 28th October 2015 at the 6th International Conference and Exhibition on body Scanning Technologies 2015, Hometrica Consulting, Lugano, Switzerland.

The access to the 3D representation of people’s body shape has multiple applications to consumer goods which performance is related to human body dimensions or shape. This is the case of wearables such as clothing, footwear, headgear, orthotics, or equipment/environments such as furniture, transports or workstations. Some of the existing and potential applications of 3D human representations include personalisation, virtual try-on or size allocation for wearables or product configuration/adjustment for equipment/environments.

However, the cost of 3D scanners is high; the devices are too bulky for homes and retail stores; and its proper use requires expertise to get the relevant parameters from the 3D object (e.g. measurements). These three barriers are currently hindering the massive spreading of 3D scanners as consumer good or as typical in-store appliance.

This paper describes an array of approaches for realistically estimating human 3D shapes (i.e. full bodies or feet) using a regular smartphone or just entering a set of parameters (e.g. age, gender and self-taken measurements). The proposed approaches are based on data-driven 3D reconstructions, using parameterised shape spaces created from large 3D human body or feet databases. The algorithm finds the combination of shape parameters that best matches either the silhouettes extracted from the images or the body measurements entered.

Despite not being actual body scanners, these solutions are easy-to-use and can provide enough accuracy for applications such as virtual try-on, made-to-measure or size allocation of certain types of wearables. Moreover, they can be distributed to the final consumer or to the points of sale at a really reduced cost (or even for free), thus overcoming the main barriers to the massive spreading of its use in e-commerce, new retail experiences, new production pipelines or new business models.

In order to illustrate these technologies, some examples of application to different contexts (i.e. virtual worlds, e-commerce and personalisation) are presented: virtual try-on of female fashion (VisuaLook), size allocation for childrenswear (KIDSIZE), personalised comfort insoles (Sunfeet) and personalised shoes (Feetz).

Publicado en: Móvil
  • Sé el primero en comentar

Low-cost data-driven 3D reconstruction and its applications @ 6th ICE 3D Body Scanning Tecnologies, October 2015, Lugano

  1. 1. Paper #34 Low-cost data-driven 3D reconstruction and applications Alfredo Ballester Technical Session 10: RGB-D Sensors & Low-cost systems 28th October 2015
  2. 2. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 • Developers of 3D scanners • E-commerce Virtual Fashion • CAD developers • Digital Human Model developers • Body mannequin manufacturers • 3D database owners • 1D database owners Technology Development Partner for IT Industry and Academia • Transports • Footwear • Furniture • Orthopaedics • Electronic Devices • Workplace Ergonomics Product Design Consultancy for Manufacturing Industries • Automotive • Apparel • Home Appliances • Headgear
  3. 3. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 • Developers of 3D scanners • E-commerce Virtual Fashion • CAD developers • Digital Human Model developers • Body mannequin manufacturers • 3D database owners • 1D database owners Technology Development Partner for IT Industry and Academia • Transports • Footwear • Furniture • Orthopaedics • Electronic Devices • Workplace Ergonomics Product Design Consultancy for Manufacturing Industries • Automotive • Apparel • Home Appliances • Headgear
  4. 4. • Why? • How it works • Our solutions • Next evolutions • Some examples
  5. 5. Why data-driven reconstruction?
  6. 6. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 #2 millimetric precision is not needed for all applications Why data-driven reconstruction? #3 we had the databases to do it #1 high-end 3D scanning is not for everybody
  7. 7. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 #2 millimetric precision is not needed for all applications Why data-driven reconstruction? High-end 3D scanners at home or at small shops? #3 we had the databases to do it #1 high-end 3D scanning is not for everybody
  8. 8. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 #2 millimetric precision is not needed for all applications Why data-driven reconstruction? #3 we had the databases to do it #1 high-end 3D scanning is not for everybody €conomic  cost & room/size Usability  expertise needed Availability  not portable High-end 3D scanners at home or at small shops?
  9. 9. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 #2 millimetric precision is not needed for all applications Why data-driven reconstruction? #3 we had the databases to develop it #1 high-end 3D scanning is not for everybody
  10. 10. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 #2 millimetric precision is not needed for all applications Why data-driven reconstruction? #3 we had the databases to develop it #1 high-end 3D scanning is not for everybody Product PersonalisationSize Recommendation
  11. 11. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Why data-driven reconstruction? #3 we had the databases to develop it #1 high-end 3D scanning is not for everybody #2 millimetric precision is not needed for all applications
  12. 12. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Why data-driven reconstruction? #3 we had the databases to develop it over 13.000 individual scan data #1 high-end 3D scanning is not for everybody #2 millimetric precision is not needed for all applications
  13. 13. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 #1 high-end 3D scanning is not for everybody #2 millimetric precision is not needed for all applications Our targets #3 we had the databases to develop it
  14. 14. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 #1 high-end 3D scanning is not for everybody • Mobile phone app • Low-cost pricing model • For everybody • Easy-to-use #2 millimetric precision is not needed for all applications Our targets #3 we had the databases to develop it
  15. 15. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 #1 high-end 3D scanning is not for everybody • Mobile phone app • Low-cost pricing model • For everybody • Easy-to-use #2 millimetric precision is not needed for all applications Accurate enough for: • Size selection • Made-to-measure Our targets #3 we had the databases to develop it
  16. 16. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 #1 high-end 3D scanning is not for everybody • Mobile phone app • Low-cost pricing model • For everybody • Easy-to-use #2 millimetric precision is not needed for all applications Accurate enough for: • Size selection • Made-to-measure Our targets #3 we had the databases to develop it • Launching a solution as soon as possible • Southern European data • Extending database
  17. 17. How it works
  18. 18. How it works: the guts 3D scan databases registered using Template-based Methods (Ballester et al. 2014)
  19. 19. How it works: the guts 3D scan databases registered using Template-based Methods (Ballester et al. 2014)
  20. 20. How it works: the guts 3D scan databases registered using Template-based Methods (Ballester et al. 2014)
  21. 21. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 PC40 How it works: the guts Parametric Space of Shapes obtained using PCA (Allen et al. 2003) …. PC1 PC2 PC3
  22. 22. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 How it works: the guts PC1 PC2 PC3 PC100 …. Parametric Space of Shapes obtained using PCA (Allen et al. 2003)
  23. 23. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 How it works: the guts PC1 PC2 PC3 PC100 …. Parametric Space of Shapes obtained using PCA (Allen et al. 2003)
  24. 24. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 How it works: the guts PC1 PC2 PC3 PC100 …. Parametric Space of Shapes obtained using PCA (Allen et al. 2003)
  25. 25. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 How it works: the process Input data Image processing Iterative optimisation 3D object Data extraction
  26. 26. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 How it works: the process Input data Image processing Iterative optimisation 3D object Data extraction
  27. 27. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 How it works: the process Input data Image processing Iterative optimisation 3D object Data extraction Image calibration (external element + camera parameters) & segmentation
  28. 28. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 How it works: the process Input data Image processing Iterative optimisation 3D object Data extraction Image calibration (external element + camera parameters) & segmentation
  29. 29. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 How it works: the process Input data Image processing Iterative optimisation 3D object Data extraction Image calibration (external element + camera parameters) & segmentation
  30. 30. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 How it works: the process Input data Image processing Iterative optimisation 3D object Data extraction Image calibration (external element + camera parameters) & segmentation
  31. 31. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 How it works: the process Input data Image processing Iterative optimisation 3D object Data extraction search->check->search (iterative) Departs from average shape and searches until shape matches silhouette using L-BFGS-B minimisation (Zhu et al. 1997) …. Iteration 0 (initial solution) Iteration 1 Iteration 2 Iteration 3 (convergence) Parametric Shape Space
  32. 32. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 How it works: the process Input data Image processing Iterative optimisation 3D object Data extraction
  33. 33. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 How it works: the process Input data Image processing Iterative optimisation 3D object Data extraction
  34. 34. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 How it works: the process Input data Image processing Iterative optimisation 3D object Data extraction
  35. 35. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 How it works: the process Input data Image processing Iterative optimisation 3D object Data extraction Digital measurement extraction based on homologous topology and on geometric searches (Ballester et al. 2014)
  36. 36. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 How it works: the process Input data Image processing Iterative optimisation 3D object Data extraction Digital measurement extraction based on homologous topology and on geometric searches (Ballester et al. 2014)
  37. 37. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 How it works: the process Input data Image processing Iterative optimisation 3D object Data extraction Other shape data extraction (Ballester et al. 2014) like: • Body part shapes • Landmark positions • 2D sections & contours
  38. 38. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 How it works: the process Input data Image processing Iterative optimisation 3D object Data extraction Other shape data extraction (Ballester et al. 2014) like: • Body part shapes • Landmark positions • 2D sections & contours
  39. 39. Our solutions
  40. 40. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Foot scanning app
  41. 41. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Foot scanning app
  42. 42. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Foot scanning booth
  43. 43. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Foot scanning booth
  44. 44. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Foot scanning booth
  45. 45. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Foot scanning booth
  46. 46. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Foot scanning app & booth (specs)
  47. 47. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Foot scanning app & booth (specs) • Four feet with very different shapes • Scanned five times each
  48. 48. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Foot scanning app & booth (specs) • Four feet with very different shapes • Scanned five times each
  49. 49. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Foot scanning app & booth (specs) • Four feet with very different shapes • Scanned five times each
  50. 50. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Foot scanning app & booth (specs) • Four feet with very different shapes • Scanned five times each
  51. 51. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Foot scanning app & booth (specs) • Four feet with very different shapes • Scanned five times each
  52. 52. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Foot scanning app & booth (specs) • Four feet with very different shapes • Scanned five times each
  53. 53. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Body scanning app (proto) Volunteer C
  54. 54. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Body scanning app (proto) Volunteer C
  55. 55. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Body scanning app (proto) Volunteer C
  56. 56. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Body scanning app (proto) Volunteer C
  57. 57. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Body scanning app (proto) Volunteer C
  58. 58. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Body scanning app (proto) Volunteer C
  59. 59. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Body scanning app (proto) Volunteer C
  60. 60. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Body scanning app (proto) Adaptive guiding silhouette Adapted guiding silhouette Volunteer C
  61. 61. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Body scanning app (proto) Adaptive guiding silhouette Adapted guiding silhouette Boundary detection Boundary detection Volunteer C
  62. 62. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Body scanning app (proto) Adaptive guiding silhouette Adapted guiding silhouette Boundary detection Boundary detection Volunteer C
  63. 63. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Body scanning app (proto) Adaptive guiding silhouette Adapted guiding silhouette Boundary detection Boundary detection Volunteer C
  64. 64. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Body scanning app (proto) Adaptive guiding silhouette Adapted guiding silhouette Boundary detection Boundary detection Volunteer C
  65. 65. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Body scanning app (proto)
  66. 66. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Body scanning app (proto)
  67. 67. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Body scanning app (proto)
  68. 68. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Body scanning app (proto)
  69. 69. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Body scanning app (proto)
  70. 70. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Body scanning app (proto)
  71. 71. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Body scanning app (proto)
  72. 72. Next steps in data-driven reconstruction
  73. 73. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Next steps: pose, composition & size
  74. 74. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Next steps: pose, composition & size
  75. 75. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Next steps: pose, composition & size
  76. 76. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Next steps: pose, composition & size
  77. 77. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Next steps: pose, composition & size
  78. 78. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Next steps: pose, composition & size
  79. 79. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Next steps: pose, composition & size
  80. 80. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Next steps: depth images in phones Why not using depth sensors?
  81. 81. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Next steps: depth images in phones Why not using depth sensors?
  82. 82. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Next steps: depth images in phones Why not using depth sensors? 100 200 300 400 500 600 50 100 150 200 250 300 350 400 450 Will image-based reconstruction become obsolete when Depth will be in all devices?
  83. 83. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Next steps: depth images in phones Why not using depth sensors? 100 200 300 400 500 600 50 100 150 200 250 300 350 400 450 Will image-based reconstruction become obsolete when Depth will be in all devices?
  84. 84. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Next steps: depth images in phones Why not using depth sensors? 100 200 300 400 500 600 50 100 150 200 250 300 350 400 450 Will image-based reconstruction become obsolete when Depth will be in all devices?
  85. 85. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Next steps: depth images in phones Why not using depth sensors? 100 200 300 400 500 600 50 100 150 200 250 300 350 400 450 Will image-based reconstruction become obsolete when Depth will be in all devices?
  86. 86. Examples of services including IBV data-driven 3D reconstruction
  87. 87. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Insole personalisation http://www.sunfeet.es/en/
  88. 88. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Footwear personalisation
  89. 89. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Childrenswear size allocation Kidsize DB • Customers, • Manufacturers • e-commerces Kidsize iFrame (customers) Virtual try-on engine Kidsize App (customers) Size allocation engine Kidsize backoffice (SMEs)
  90. 90. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Childrenswear size allocation Kidsize DB • Customers, • Manufacturers • e-commerces Kidsize iFrame (customers) Virtual try-on engine Kidsize App (customers) Size allocation engine Kidsize backoffice (SMEs)
  91. 91. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Childrenswear size allocation
  92. 92. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Childrenswear size allocation http://www.kidsizesolution.com/
  93. 93. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Childrenswear size allocation http://www.kidsizesolution.com/
  94. 94. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Childrenswear size allocation http://www.kidsizesolution.com/ Actual scan KidSize App Actual scan KidSize App
  95. 95. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Childrenswear size allocation http://www.kidsizesolution.com/ Actual scan KidSize App
  96. 96. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Childrenswear size allocation http://www.kidsizesolution.com/
  97. 97. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Childrenswear size allocation http://www.kidsizesolution.com/ Actual scan KidSize App
  98. 98. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Childrenswear size allocation http://www.kidsizesolution.com/ Actual scan KidSize App
  99. 99. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Virtual look
  100. 100. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Virtual look Age 28 Weight 53 Height 166 Bust 83 Waist 66 Hip 90
  101. 101. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Virtual look Age 28 Weight 53 Height 166 Bust 83 Waist 66 Hip 90 DAZ Parametric IBV
  102. 102. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Virtual look Age 28 Weight 53 Height 166 Bust 83 Waist 66 Hip 90 DAZ Parametric IBV Enriched Virtual try-on
  103. 103. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Virtual look Age 40 Weight 60 Height 175 Bust 90 Waist 73 Hip 102 DAZ Parametric IBV Enriched Virtual try-on
  104. 104. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Virtual look Age 40 Weight 60 Height 175 Bust 90 Waist 73 Hip 102 DAZ Parametric IBV Enriched Virtual try-on
  105. 105. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Virtual look Age 40 Weight 60 Height 175 Bust 90 Waist 73 Hip 102 DAZ Parametric IBV Enriched Virtual try-on
  106. 106. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Virtual look Age 40 Weight 60 Height 175 Bust 90 Waist 73 Hip 102 DAZ Parametric IBV Enriched Virtual try-on
  107. 107. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Virtual look Age 40 Weight 60 Height 175 Bust 90 Waist 73 Hip 102 DAZ Parametric IBV Enriched Virtual try-on
  108. 108. Thanks! Alfredo Ballester Alfredo.ballester@ibv.upv.es Any Questions? Dr. Carlos Soler (CTO) Sandra Alemany (Chief Researcher) Dr. Eduardo Parrilla (Chief Developer) Dr. Juan C. González (Product Manager) Jordi Uriel Ana Piérola Paola Piqueras Beatriz Nácher Clara Solves Sergio A. Puigcerver Julio A. Vivas Silvia San Jerónimo Francisco Fos … anthropometry.ibv.org

×