Se ha denunciado esta presentación.
Utilizamos tu perfil de LinkedIn y tus datos de actividad para personalizar los anuncios y mostrarte publicidad más relevante. Puedes cambiar tus preferencias de publicidad en cualquier momento.

Knowledge graphs for search & discovery

1.298 visualizaciones

Publicado el

Slides for my talk at the DotAI conference in Paris on May 31st 2018.
I'll add the link to the video as soon as it is uploaded.

Publicado en: Tecnología
  • Inicia sesión para ver los comentarios

Knowledge graphs for search & discovery

  1. 1. ⓒ 2018, Kiwisoft, all rights reserved Aurélien Géron, May 31st 2018 Knowledge Graphs & Deep Learning @ YouTube ⓒ 2018, Kiwisoft, all rights reserved
  2. 2. ⓒ 2018, Kiwisoft, all rights reserved Generic Recs ⓒ 2018, Kiwisoft, all rights reserved
  3. 3. ⓒ 2018, Kiwisoft, all rights reserved Personnalized Recs ⓒ 2018, Kiwisoft, all rights reserved
  4. 4. ⓒ 2018, Kiwisoft, all rights reserved Collaborative Filtering ⓒ 2018, Kiwisoft, all rights reserved
  5. 5. ⓒ 2018, Kiwisoft, all rights reserved ? ? ? Collaborative Filtering ? ⓒ 2018, Kiwisoft, all rights reserved
  6. 6. ⓒ 2018, Kiwisoft, all rights reserved Collaborative Filtering ⓒ 2018, Kiwisoft, all rights reserved
  7. 7. ⓒ 2018, Kiwisoft, all rights reserved Collaborative Filtering ⓒ 2018, Kiwisoft, all rights reserved
  8. 8. ⓒ 2018, Kiwisoft, all rights reserved Deep Learning for Recommendations https://research.google.com/pubs/archive/45530.pdf ⓒ 2018, Kiwisoft, all rights reserved
  9. 9. ⓒ 2018, Kiwisoft, all rights reserved Deep Learning for Recommendations Source: figure 3 from “Deep Neural Networks for YouTube Recommendations”, by Paul Covington, Jay Adams and Emre Sargin: https://research.google.com/pubs/archive/45530.pdf ⓒ 2018, Kiwisoft, all rights reserved
  10. 10. ⓒ 2018, Kiwisoft, all rights reserved ? ? ? Cold Start Problem ? ⓒ 2018, Kiwisoft, all rights reserved
  11. 11. ⓒ 2018, Kiwisoft, all rights reserved Cold Start Problem ? ? ? ? ⓒ 2018, Kiwisoft, all rights reserved
  12. 12. ⓒ 2018, Kiwisoft, all rights reserved Rescued by Entities ⓒ 2018, Kiwisoft, all rights reserved
  13. 13. ⓒ 2018, Kiwisoft, all rights reserved Rescued by Entities ⓒ 2018, Kiwisoft, all rights reserved
  14. 14. ⓒ 2018, Kiwisoft, all rights reserved Rescued by Entities ⓒ 2018, Kiwisoft, all rights reserved
  15. 15. ⓒ 2018, Kiwisoft, all rights reserved Deep Learning for Recommendations Source: figure 3 from “Deep Neural Networks for YouTube Recommendations”, by Paul Covington, Jay Adams and Emre Sargin: https://research.google.com/pubs/archive/45530.pdf ⓒ 2018, Kiwisoft, all rights reserved
  16. 16. ⓒ 2018, Kiwisoft, all rights reserved topic vector Deep Learning for Recommendations Source: figure 3 from “Deep Neural Networks for YouTube Recommendations”, by Paul Covington, Jay Adams and Emre Sargin: https://research.google.com/pubs/archive/45530.pdf The topic vector block is not in the original figure. ⓒ 2018, Kiwisoft, all rights reserved
  17. 17. ⓒ 2018, Kiwisoft, all rights reserved Visual Content Analysis (VCA) Right image by Aphex34: https://commons.wikimedia.org/wiki/File:Typical_cnn.png Deep Convolutional Neural Network ⓒ 2018, Kiwisoft, all rights reserved Left image from video: https://www.youtube.com/watch?v=EZEgz50VMsk
  18. 18. ⓒ 2018, Kiwisoft, all rights reserved Large-scale Video Classification with Convolutional Neural Networks, CVPR 2014 https://youtu.be/qrzQ_AB1DZk Visual Content Analysis (VCA) ⓒ 2018, Kiwisoft, all rights reserved
  19. 19. ⓒ 2018, Kiwisoft, all rights reserved Entity Linking using Textual Metadata ⓒ 2018, Kiwisoft, all rights reserved
  20. 20. ⓒ 2018, Kiwisoft, all rights reserved Entity Linking using Textual Metadata ⓒ 2018, Kiwisoft, all rights reserved
  21. 21. ⓒ 2018, Kiwisoft, all rights reserved Wikipedia: Knowledge for Humans ⓒ 2018, Kiwisoft, all rights reserved
  22. 22. ⓒ 2018, Kiwisoft, all rights reserved Wikipedia: Knowledge for Humans ⓒ 2018, Kiwisoft, all rights reserved
  23. 23. ⓒ 2018, Kiwisoft, all rights reserved Wikidata: Knowledge for Machines ⓒ 2018, Kiwisoft, all rights reserved
  24. 24. ⓒ 2018, Kiwisoft, all rights reserved Wikidata: Statements ⓒ 2018, Kiwisoft, all rights reserved
  25. 25. ⓒ 2018, Kiwisoft, all rights reserved Wikidata: Statements PropertyEntity Value Triple ⓒ 2018, Kiwisoft, all rights reserved
  26. 26. ⓒ 2018, Kiwisoft, all rights reserved Wikidata: Statements P31Q2831 Q5 Michael Jackson Human instance of ⓒ 2018, Kiwisoft, all rights reserved
  27. 27. ⓒ 2018, Kiwisoft, all rights reserved Wikidata: Graph of Entities P19 P569 Aug 29th 1958 description Q2831 “American singer and dancer” (en) “歌手” (ja) “அெம க பாடக ” (ta) date of birth place of birth Michael Jackson Gary P17country Q30 U.S.A. P625 Q184116 41°34'51"N 87°20'44"Wlocation ⓒ 2018, Kiwisoft, all rights reserved
  28. 28. ⓒ 2018, Kiwisoft, all rights reserved Wikidata: SPARQL https://query.wikidata.org/ ⓒ 2018, Kiwisoft, all rights reserved
  29. 29. ⓒ 2018, Kiwisoft, all rights reserved Wikidata: SPARQL ⓒ 2018, Kiwisoft, all rights reserved
  30. 30. ⓒ 2018, Kiwisoft, all rights reserved import requests SPARQL_URL = "https://query.wikidata.org/sparql" query = "SELECT ?coordinates WHERE {...}" params = {"query": query, "format": "json"} response = requests.get(SPARQL_URL, params=params).json() print(response["results"]["bindings"][0]["coordinates"]["value"]) $ python wikidata_demo.py Point(-87.345555555 41.580833333) Wikidata: Query using Python wikidata_demo.py ⓒ 2018, Kiwisoft, all rights reserved
  31. 31. ⓒ 2018, Kiwisoft, all rights reserved Search: Knowledge Panels ⓒ 2018, Kiwisoft, all rights reserved
  32. 32. ⓒ 2018, Kiwisoft, all rights reserved Structured Discovery ⓒ 2018, Kiwisoft, all rights reserved
  33. 33. ⓒ 2018, Kiwisoft, all rights reserved Structured Discovery ⓒ 2018, Kiwisoft, all rights reserved
  34. 34. ⓒ 2018, Kiwisoft, all rights reserved Structured Discovery ⓒ 2018, Kiwisoft, all rights reserved
  35. 35. ⓒ 2018, Kiwisoft, all rights reserved Entity Linking using Textual Metadata ⓒ 2018, Kiwisoft, all rights reserved
  36. 36. ⓒ 2018, Kiwisoft, all rights reserved Entity Linking using Textual Metadata Q592031 (Wingsuit flying) ⓒ 2018, Kiwisoft, all rights reserved
  37. 37. ⓒ 2018, Kiwisoft, all rights reserved Entity Linking using Textual Metadata Q612 (Dubai) Q592031 (Wingsuit flying) ⓒ 2018, Kiwisoft, all rights reserved
  38. 38. ⓒ 2018, Kiwisoft, all rights reserved Entity Linking using Textual Metadata Q592031 (Wingsuit flying) Q309162 (Extreme sport) Q809831 (BASE jumping) Q193210 (Skydiving) Q612 (Dubai) ⓒ 2018, Kiwisoft, all rights reserved
  39. 39. ⓒ 2018, Kiwisoft, all rights reserved Entity Linking using Textual Metadata Q592031 (Wingsuit flying) Q309162 (Extreme sport) Q809831 (BASE jumping) Q193210 (Skydiving) Q612 (Dubai) ⓒ 2018, Kiwisoft, all rights reserved
  40. 40. ⓒ 2018, Kiwisoft, all rights reserved Entity Linking using Textual Metadata Q592031 (Wingsuit flying) Q309162 (Extreme sport) Q809831 (BASE jumping) Q193210 (Skydiving) Q612 (Dubai) ??? ⓒ 2018, Kiwisoft, all rights reserved
  41. 41. ⓒ 2018, Kiwisoft, all rights reserved Entity Linking using Textual Metadata Q592031 (Wingsuit flying) Q309162 (Extreme sport) Q809831 (BASE jumping) Q193210 (Skydiving) Q612 (Dubai) Q1409571 German screenwriter Q1686732 German catholic priest Q2150539 German journalist, author and stage director Q2150541 German farmer and politician (KPD) Q2150546 German football manager Q6108620 American botanist (1890-1970) Q18815147 German classical philologist and teacher Q24018780 Swedish-German artist ⓒ 2018, Kiwisoft, all rights reserved
  42. 42. ⓒ 2018, Kiwisoft, all rights reserved Entity Linking using Textual Metadata Q592031 (Wingsuit flying) Q309162 (Extreme sport) Q809831 (BASE jumping) Q193210 (Skydiving) Q612 (Dubai) Q1409571 German screenwriter Q1686732 German catholic priest Q2150539 German journalist, author and stage director Q2150541 German farmer and politician (KPD) Q2150546 German football manager Q6108620 American botanist (1890-1970) Q18815147 German classical philologist and teacher Q24018780 Swedish-German artist ⓒ 2018, Kiwisoft, all rights reserved
  43. 43. ⓒ 2018, Kiwisoft, all rights reserved Entity Linking using Textual Metadata Q592031 (Wingsuit flying) Q309162 (Extreme sport) Q809831 (BASE jumping) Q193210 (Skydiving) Q612 (Dubai) Q35127 (website) Q918 (Twitter) Q355 (Facebook) Q34508 (Video) ⓒ 2018, Kiwisoft, all rights reserved
  44. 44. ⓒ 2018, Kiwisoft, all rights reserved Entity Linking using Textual Metadata Q592031 (Wingsuit flying) Q309162 (Extreme sport) Q809831 (BASE jumping) Q193210 (Skydiving) Q612 (Dubai) Q35127 (website) Q918 (Twitter) Q355 (Facebook) Q34508 (Video) ⓒ 2018, Kiwisoft, all rights reserved
  45. 45. ⓒ 2018, Kiwisoft, all rights reserved Entity Linking using Textual Metadata ⓒ 2018, Kiwisoft, all rights reserved Mention Detection Disambiguation Pruning
  46. 46. ⓒ 2018, Kiwisoft, all rights reserved LSTM LSTM LSTM LSTM LSTM LSTM LSTM LSTM Entity Recognition Using Deep Learning Washington and New York LSTM LSTM LSTM ⓒ 2018, Kiwisoft, all rights reserved Softmax Softmax 0 LSTM LSTM Softmax B-LOC LSTM LSTM Softmax I-LOC LSTM B-LOC
  47. 47. ⓒ 2018, Kiwisoft, all rights reserved Entity Linking Using Contextual Signals ? ⓒ 2018, Kiwisoft, all rights reserved
  48. 48. ⓒ 2018, Kiwisoft, all rights reserved Entity Linking Using Contextual Signals ⓒ 2018, Kiwisoft, all rights reserved
  49. 49. ⓒ 2018, Kiwisoft, all rights reserved Entity Linking Using Contextual Signals ⓒ 2018, Kiwisoft, all rights reserved
  50. 50. ⓒ 2018, Kiwisoft, all rights reserved Ranking Candidate Entities VCA Text Ctx ⓒ 2018, Kiwisoft, all rights reserved
  51. 51. ⓒ 2018, Kiwisoft, all rights reserved Ranking Candidate Entities Q592031 (Wingsuit flying) Q309162 (Extreme sport) Q612 (Dubai) Q809831 (BASE jumping) VCA Text Ctx Q193210 (Skydiving) ⓒ 2018, Kiwisoft, all rights reserved
  52. 52. ⓒ 2018, Kiwisoft, all rights reserved Ranking Candidate Entities Q592031 (Wingsuit flying) Q309162 (Extreme sport) Q612 (Dubai) Q809831 (BASE jumping) VCA Text Ctx Q193210 (Skydiving) Q592031 (Wingsuit flying) Q612 (Dubai) Q193210 (Skydiving) Q309162 (Extreme sport) Q809831 (BASE jumping) ⓒ 2018, Kiwisoft, all rights reserved
  53. 53. ⓒ 2018, Kiwisoft, all rights reserved Please watch the video and tell us which of the following topics it is about: ● BASE jumping ● Dubai ● Extreme sport ● Skydiving ● Wingsuit flying Human Evaluations Central Off-TopicSecondary Central Off-TopicSecondary Central Off-TopicSecondary Central Off-TopicSecondary Central Off-TopicSecondary ⓒ 2018, Kiwisoft, all rights reserved
  54. 54. ⓒ 2018, Kiwisoft, all rights reserved Entity Linking Using Deep Learning https://goo.gl/Q39di0 List of papers by Amund Tveit on Deep Learning for Entity Linking ⓒ 2018, Kiwisoft, all rights reserved
  55. 55. ⓒ 2018, Kiwisoft, all rights reserved https://github.com/ageron/handson-ml
  56. 56. ⓒ 2018, Kiwisoft, all rights reserved https://youtube.com/c/AurelienGeron
  57. 57. ⓒ 2018, Kiwisoft, all rights reserved Thank you! ⓒ 2018, Kiwisoft, all rights reserved

×