Se ha denunciado esta presentación.
Utilizamos tu perfil de LinkedIn y tus datos de actividad para personalizar los anuncios y mostrarte publicidad más relevante. Puedes cambiar tus preferencias de publicidad en cualquier momento.

Generative Adversarial Networks (GANs) and Disentangled Representations @ NeurIPS2018

4.521 visualizaciones

Publicado el

Generative Adversarial Networks (GANs) の進展、 Disentangled Representations の重要性、NeurIPS2018で採択された "GANs and Disentangled Representations" の論文をまとめ、紹介しています。 NeurIPS2018読み会@PFNでの発表資料です。

Publicado en: Tecnología
  • Sé el primero en comentar

Generative Adversarial Networks (GANs) and Disentangled Representations @ NeurIPS2018

  1. 1. Copyright (C) 2019 DeNA Co.,Ltd. All Rights Reserved.Copyright (C) 2019 DeNA Co.,Ltd. All Rights Reserved.
  2. 2. Copyright (C) 2019 DeNA Co.,Ltd. All Rights Reserved. 2
  3. 3. Copyright (C) 2019 DeNA Co.,Ltd. All Rights Reserved.
  4. 4. Copyright (C) 2019 DeNA Co.,Ltd. All Rights Reserved. 4 (@hamadakoichi) 2010 6 Mobage2011 4 Mobage DeNA DeNA2014 10 : ( ) TokyoWebmining - 1500 - 2010 60 DeNA - 50 / -
  5. 5. Copyright (C) 2019 DeNA Co.,Ltd. All Rights Reserved. Full-body High-resolution Anime Generation with Progressive Structure-conditional Generative Adversarial Networks Koichi Hamada, Kentaro Tachibana, Tianqi Li, Hiroto Honda, and Yusuke Uchida. In ECCVW 2018. 5
  6. 6. Copyright (C) 2019 DeNA Co.,Ltd. All Rights Reserved. 0 5 : / Full-body anime generation at 1024x1024 with Progressive Structure-conditional GANs 0 5 : 3. Adding action to full-body anime characters with Progressive Structure-conditional GANs Full-body High-resolution Anime Generation with Progressive Structure-conditional Generative Adversarial Networks Koichi Hamada, Kentaro Tachibana, Tianqi Li, Hiroto Honda, and Yusuke Uchida. In ECCVW 2018. 6
  7. 7. Copyright (C) 2019 DeNA Co.,Ltd. All Rights Reserved. 7
  8. 8. Copyright (C) 2019 DeNA Co.,Ltd. All Rights Reserved. 8 ProgressiveGAN (Karras et al., ICLR 2018) BigGAN (Brock et al., ICLR 2019) Style-based GAN (Karras et al., arXiv: 1812.04948)
  9. 9. Copyright (C) 2019 DeNA Co.,Ltd. All Rights Reserved.
  10. 10. Copyright (C) 2019 DeNA Co.,Ltd. All Rights Reserved.
  11. 11. Copyright (C) 2019 DeNA Co.,Ltd. All Rights Reserved.
  12. 12. Copyright (C) 2019 DeNA Co.,Ltd. All Rights Reserved.
  13. 13. Copyright (C) 2019 DeNA Co.,Ltd. All Rights Reserved. 13
  14. 14. Copyright (C) 2019 DeNA Co.,Ltd. All Rights Reserved. 14 ProgressiveGAN (Karras et al., ICLR 2018) BigGAN (Brock et al., ICLR 2019) Style-based GAN (Karras et al., arXiv: 1812.04948)
  15. 15. Copyright (C) 2019 DeNA Co.,Ltd. All Rights Reserved. 15 Generative Adversarial Nets. Ian J. Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, Yoshua Bengio. arXiv:1406.2661. In NeurIPS 2014.
  16. 16. Copyright (C) 2019 DeNA Co.,Ltd. All Rights Reserved. 16 Generative Adversarial Nets. Ian J. Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, Yoshua Bengio. arXiv:1406.2661. In NeurIPS 2014.
  17. 17. Copyright (C) 2019 DeNA Co.,Ltd. All Rights Reserved. 17 ProgressiveGAN (Karras et al., ICLR 2018) BigGAN (Brock et al., ICLR 2019) Style-based GAN (Karras et al., arXiv: 1812.04948)
  18. 18. Copyright (C) 2019 DeNA Co.,Ltd. All Rights Reserved. 18 Progressive Growing of GANs for Improved Quality, Stability, and Variation. Tero Karras, Timo Aila, Samuli Laine, Jaakko Lehtinen. In ICLR 2018. (1024X1024) (256x256)
  19. 19. Copyright (C) 2019 DeNA Co.,Ltd. All Rights Reserved. 19 + Spectral Normalization on Generator + Self Attention + Two Time Scale Update Rule (512x512) + Spectral Normalization on Discriminator + Projection Discriminator SNGAN with Projection (Miyato+, ICLR’18) SAGAN (Zhang+, 18) BigGAN (Brock+, ICLR’19) + Large Batch Size (256→2048) + Large Channel (64→96) + Shared Embedding + Hierarchical Latent Space + Truncation Trick + Orthogonal Regularization + First Singular Value Clamp + Zero-centered Gradient Penalty Large Scale GAN Training for High Fidelity Natural Image Synthesis. Andrew Brock, Jeff Donahue, Karen Simonyan. arXiv:1809.11096. In ICLR 2019.
  20. 20. Copyright (C) 2019 DeNA Co.,Ltd. All Rights Reserved. 20 Large Scale GAN Training for High Fidelity Natural Image Synthesis. Andrew Brock, Jeff Donahue, Karen Simonyan. arXiv:1809.11096. In ICLR 2018. (512x512) Generator Typical Architecture Res Block Architecture for ImageNet at 512x512
  21. 21. Copyright (C) 2019 DeNA Co.,Ltd. All Rights Reserved. 21 ProgressiveGAN (Karras et al., ICLR 2018) BigGAN (Brock et al., ICLR 2019) 2
  22. 22. Copyright (C) 2019 DeNA Co.,Ltd. All Rights Reserved. 22 ProgressiveGAN (Karras et al., ICLR 2018) BigGAN (Brock et al., ICLR 2019) 2
  23. 23. Copyright (C) 2019 DeNA Co.,Ltd. All Rights Reserved. 23 ProgressiveGAN (Karras et al., ICLR 2018) BigGAN (Brock et al., ICLR 2019)
  24. 24. Copyright (C) 2019 DeNA Co.,Ltd. All Rights Reserved. 24 ProgressiveGAN (Karras et al., ICLR 2018) BigGAN (Brock et al., ICLR 2019)
  25. 25. Copyright (C) 2019 DeNA Co.,Ltd. All Rights Reserved. 25 ProgressiveGAN (Karras et al., ICLR 2018) BigGAN (Brock et al., ICLR 2019) 2
  26. 26. Copyright (C) 2019 DeNA Co.,Ltd. All Rights Reserved. 26 ProgressiveGAN (Karras et al., ICLR 2018) BigGAN (Brock et al., ICLR 2019)
  27. 27. Copyright (C) 2019 DeNA Co.,Ltd. All Rights Reserved. 27 ProgressiveGAN (Karras et al., ICLR 2018) BigGAN (Brock et al., ICLR 2019)
  28. 28. Copyright (C) 2019 DeNA Co.,Ltd. All Rights Reserved. 28 ProgressiveGAN (Karras et al., ICLR 2018) BigGAN (Brock et al., ICLR 2019)
  29. 29. Copyright (C) 2019 DeNA Co.,Ltd. All Rights Reserved. 29 Progressive Structure-conditional GANs (PSGAN) Full-body High-resolution Anime Generation with Progressive Structure-conditional Generative Adversarial Networks. Koichi Hamada, Kentaro Tachibana, Tianqi Li, Hiroto Honda, and Yusuke Uchida. arXiv:1809.01890. In ECCV Workshop 2018. https://www.youtube.com/watch?v=bIi5gSITK0E
  30. 30. Copyright (C) 2019 DeNA Co.,Ltd. All Rights Reserved. 30 Progressive Structure-conditional GANs (PSGAN) Full-body High-resolution Anime Generation with Progressive Structure-conditional Generative Adversarial Networks. Koichi Hamada, Kentaro Tachibana, Tianqi Li, Hiroto Honda, and Yusuke Uchida. arXiv:1809.01890. In ECCV Workshop 2018. https://www.youtube.com/watch?v=bIi5gSITK0E
  31. 31. Copyright (C) 2019 DeNA Co.,Ltd. All Rights Reserved. 31 A Style-Based Generator Architecture for Generative Adversarial Networks. Tero Karras, Samuli Laine, Timo Aila. arXiv:1812.04948.
  32. 32. Copyright (C) 2019 DeNA Co.,Ltd. All Rights Reserved. 32 A Style-Based Generator Architecture for Generative Adversarial Networks. Tero Karras, Samuli Laine, Timo Aila. arXiv:1812.04948. Style Based Generator https://www.youtube.com/watch?v=kSLJriaOumA
  33. 33. Copyright (C) 2019 DeNA Co.,Ltd. All Rights Reserved. 33
  34. 34. Copyright (C) 2019 DeNA Co.,Ltd. All Rights Reserved. 34
  35. 35. Copyright (C) 2019 DeNA Co.,Ltd. All Rights Reserved. 1. FD-GAN: Pose-guided Feature Distilling GAN for Robust Person Re-identification 2. Unsupervised Learning of Object Landmarks through Conditional Image Generation 3. A Unified Feature Disentangler for Multi-Domain Image Translation and Manipulation 4. Image-to-image translation for cross-domain disentanglement 5. Unsupervised Adversarial Invariance 35 (Selected)
  36. 36. Copyright (C) 2019 DeNA Co.,Ltd. All Rights Reserved. 1. FD-GAN: Pose-guided Feature Distilling GAN for Robust Person Re-identification 2. Unsupervised Learning of Object Landmarks through Conditional Image Generation 3. A Unified Feature Disentangler for Multi-Domain Image Translation and Manipulation 4. Image-to-image translation for cross-domain disentanglement 5. Unsupervised Adversarial Invariance 36 (Selected)
  37. 37. Copyright (C) 2019 DeNA Co.,Ltd. All Rights Reserved. 37 FD-GAN: Pose-guided Feature Distilling GAN for Robust Person Re-identification. Yixiao Ge, Zhuowan Li, Haiyu Zhao, Guojun Yin, Shuai Yi, Xiaogang Wang, Hongsheng Li. arXiv:1810.02936. In NeurIPS 2018.
  38. 38. Copyright (C) 2019 DeNA Co.,Ltd. All Rights Reserved. 38 FD-GAN: Pose-guided Feature Distilling GAN for Robust Person Re-identification. Yixiao Ge, Zhuowan Li, Haiyu Zhao, Guojun Yin, Shuai Yi, Xiaogang Wang, Hongsheng Li. arXiv:1810.02936. In NeurIPS 2018.
  39. 39. Copyright (C) 2019 DeNA Co.,Ltd. All Rights Reserved. 39 FD-GAN: Pose-guided Feature Distilling GAN for Robust Person Re-identification. Yixiao Ge, Zhuowan Li, Haiyu Zhao, Guojun Yin, Shuai Yi, Xiaogang Wang, Hongsheng Li. arXiv:1810.02936. In NeurIPS 2018.
  40. 40. Copyright (C) 2019 DeNA Co.,Ltd. All Rights Reserved. 40 FD-GAN: Pose-guided Feature Distilling GAN for Robust Person Re-identification. Yixiao Ge, Zhuowan Li, Haiyu Zhao, Guojun Yin, Shuai Yi, Xiaogang Wang, Hongsheng Li. arXiv:1810.02936. In NeurIPS 2018.
  41. 41. Copyright (C) 2019 DeNA Co.,Ltd. All Rights Reserved. 1. FD-GAN: Pose-guided Feature Distilling GAN for Robust Person Re-identification 2. Unsupervised Learning of Object Landmarks through Conditional Image Generation 3. A Unified Feature Disentangler for Multi-Domain Image Translation and Manipulation 4. Image-to-image translation for cross-domain disentanglement 5. Unsupervised Adversarial Invariance 41 (Selected)
  42. 42. Copyright (C) 2019 DeNA Co.,Ltd. All Rights Reserved. 42 Unsupervised Learning of Object Landmarks through Conditional Image Generation. Tomas Jakab, Ankush Gupta, Hakan Bilen, Andrea Vedaldi. arXiv:1806.07823. In NeurIPS 2018.
  43. 43. Copyright (C) 2019 DeNA Co.,Ltd. All Rights Reserved. 43 Unsupervised Learning of Object Landmarks through Conditional Image Generation. Tomas Jakab, Ankush Gupta, Hakan Bilen, Andrea Vedaldi. arXiv:1806.07823. In NeurIPS 2018.
  44. 44. Copyright (C) 2019 DeNA Co.,Ltd. All Rights Reserved. 44 MAFL Dataset Normalized %-MSE Unsupervised Learning of Object Landmarks through Conditional Image Generation. Tomas Jakab, Ankush Gupta, Hakan Bilen, Andrea Vedaldi. arXiv:1806.07823. In NeurIPS 2018.
  45. 45. Copyright (C) 2019 DeNA Co.,Ltd. All Rights Reserved. 45 Unsupervised Learning of Object Landmarks through Conditional Image Generation. Tomas Jakab, Ankush Gupta, Hakan Bilen, Andrea Vedaldi. arXiv:1806.07823. In NeurIPS 2018.
  46. 46. Copyright (C) 2019 DeNA Co.,Ltd. All Rights Reserved. 46 Unsupervised Learning of Object Landmarks through Conditional Image Generation. Tomas Jakab, Ankush Gupta, Hakan Bilen, Andrea Vedaldi. arXiv:1806.07823. In NeurIPS 2018.
  47. 47. Copyright (C) 2019 DeNA Co.,Ltd. All Rights Reserved. 1. FD-GAN: Pose-guided Feature Distilling GAN for Robust Person Re-identification 2. Unsupervised Learning of Object Landmarks through Conditional Image Generation 3. A Unified Feature Disentangler for Multi-Domain Image Translation and Manipulation 4. Image-to-image translation for cross-domain disentanglement 5. Unsupervised Adversarial Invariance 47 (Selected)
  48. 48. Copyright (C) 2019 DeNA Co.,Ltd. All Rights Reserved. 48 A Unified Feature Disentangler for Multi-Domain Image Translation and Manipulation. Alexander H. Liu, Yen-Cheng Liu, Yu-Ying Yeh, Yu-Chiang Frank Wang. arXiv:1809.01361. In NeurIPS 2018.
  49. 49. Copyright (C) 2019 DeNA Co.,Ltd. All Rights Reserved. 49 VAE Loss Adversarial Domain Discrimination GAN Domain Classification Update A Unified Feature Disentangler for Multi-Domain Image Translation and Manipulation. Alexander H. Liu, Yen-Cheng Liu, Yu-Ying Yeh, Yu-Chiang Frank Wang. arXiv:1809.01361. In NeurIPS 2018.
  50. 50. Copyright (C) 2019 DeNA Co.,Ltd. All Rights Reserved. 50 A Unified Feature Disentangler for Multi-Domain Image Translation and Manipulation. Alexander H. Liu, Yen-Cheng Liu, Yu-Ying Yeh, Yu-Chiang Frank Wang. arXiv:1809.01361. In NeurIPS 2018.
  51. 51. Copyright (C) 2019 DeNA Co.,Ltd. All Rights Reserved. 51 A Unified Feature Disentangler for Multi-Domain Image Translation and Manipulation. Alexander H. Liu, Yen-Cheng Liu, Yu-Ying Yeh, Yu-Chiang Frank Wang. arXiv:1809.01361. In NeurIPS 2018.
  52. 52. Copyright (C) 2019 DeNA Co.,Ltd. All Rights Reserved. 1. FD-GAN: Pose-guided Feature Distilling GAN for Robust Person Re-identification 2. Unsupervised Learning of Object Landmarks through Conditional Image Generation 3. A Unified Feature Disentangler for Multi-Domain Image Translation and Manipulation 4. Image-to-image translation for cross-domain disentanglement 5. Unsupervised Adversarial Invariance 52 (Selected)
  53. 53. Copyright (C) 2019 DeNA Co.,Ltd. All Rights Reserved. 53 Image-to-image translation for cross-domain disentanglement. Abel Gonzalez-Garcia, Joost van de Weijer, Yoshua Bengio. arXiv:1805.09730. In NeurIPS 2018.
  54. 54. Copyright (C) 2019 DeNA Co.,Ltd. All Rights Reserved. 54 Image-to-image translation for cross-domain disentanglement. Abel Gonzalez-Garcia, Joost van de Weijer, Yoshua Bengio. arXiv:1805.09730. In NeurIPS 2018.
  55. 55. Copyright (C) 2019 DeNA Co.,Ltd. All Rights Reserved. 55 Cross-domain retrieval (Recall@1) on MNIST-CD/CB Image-to-image translation for cross-domain disentanglement. Abel Gonzalez-Garcia, Joost van de Weijer, Yoshua Bengio. arXiv:1805.09730. In NeurIPS 2018.
  56. 56. Copyright (C) 2019 DeNA Co.,Ltd. All Rights Reserved. 56 Learned Perceptual Image Patch Similarly METRIC on generated samples Image-to-image translation for cross-domain disentanglement. Abel Gonzalez-Garcia, Joost van de Weijer, Yoshua Bengio. arXiv:1805.09730. In NeurIPS 2018.
  57. 57. Copyright (C) 2019 DeNA Co.,Ltd. All Rights Reserved. 57 Cross-domain retrieval (Recall@1) on Facades and Maps Image-to-image translation for cross-domain disentanglement. Abel Gonzalez-Garcia, Joost van de Weijer, Yoshua Bengio. arXiv:1805.09730. In NeurIPS 2018.
  58. 58. Copyright (C) 2019 DeNA Co.,Ltd. All Rights Reserved. 1. FD-GAN: Pose-guided Feature Distilling GAN for Robust Person Re-identification 2. Unsupervised Learning of Object Landmarks through Conditional Image Generation 3. A Unified Feature Disentangler for Multi-Domain Image Translation and Manipulation 4. Image-to-image translation for cross-domain disentanglement 5. Unsupervised Adversarial Invariance 58 (Selected)
  59. 59. Copyright (C) 2019 DeNA Co.,Ltd. All Rights Reserved. 59 Unsupervised Adversarial Invariance. Ayush Jaiswal, Yue Wu, Wael AbdAlmageed, Premkumar Natarajan. arXiv:1809.10083. In NeurIPS 2018.
  60. 60. Copyright (C) 2019 DeNA Co.,Ltd. All Rights Reserved. 60 Unsupervised Adversarial Invariance. Ayush Jaiswal, Yue Wu, Wael AbdAlmageed, Premkumar Natarajan. arXiv:1809.10083. In NeurIPS 2018.
  61. 61. Copyright (C) 2019 DeNA Co.,Ltd. All Rights Reserved. 61 Unsupervised Adversarial Invariance. Ayush Jaiswal, Yue Wu, Wael AbdAlmageed, Premkumar Natarajan. arXiv:1809.10083. In NeurIPS 2018.
  62. 62. Copyright (C) 2019 DeNA Co.,Ltd. All Rights Reserved. 62 Unsupervised Adversarial Invariance. Ayush Jaiswal, Yue Wu, Wael AbdAlmageed, Premkumar Natarajan. arXiv:1809.10083. In NeurIPS 2018.
  63. 63. Copyright (C) 2019 DeNA Co.,Ltd. All Rights Reserved. 63 Unsupervised Adversarial Invariance. Ayush Jaiswal, Yue Wu, Wael AbdAlmageed, Premkumar Natarajan. arXiv:1809.10083. In NeurIPS 2018.
  64. 64. Copyright (C) 2019 DeNA Co.,Ltd. All Rights Reserved. 64 Unsupervised Adversarial Invariance. Ayush Jaiswal, Yue Wu, Wael AbdAlmageed, Premkumar Natarajan. arXiv:1809.10083. In NeurIPS 2018.
  65. 65. Copyright (C) 2019 DeNA Co.,Ltd. All Rights Reserved. 1. FD-GAN: Pose-guided Feature Distilling GAN for Robust Person Re-identification 2. Unsupervised Learning of Object Landmarks through Conditional Image Generation 3. A Unified Feature Disentangler for Multi-Domain Image Translation and Manipulation 4. Image-to-image translation for cross-domain disentanglement 5. Unsupervised Adversarial Invariance 65 (Selected)
  66. 66. Copyright (C) 2019 DeNA Co.,Ltd. All Rights Reserved. 66
  67. 67. Copyright (C) 2019 DeNA Co.,Ltd. All Rights Reserved. 67 ProgressiveGAN (Karras et al., ICLR 2018) BigGAN (Brock et al., ICLR 2019)
  68. 68. Copyright (C) 2019 DeNA Co.,Ltd. All Rights Reserved. 68 ProgressiveGAN (Karras et al., ICLR 2018) BigGAN (Brock et al., ICLR 2019)
  69. 69. Copyright (C) 2019 DeNA Co.,Ltd. All Rights Reserved. 69 Progressive Structure-conditional GANs (PSGAN) Full-body High-resolution Anime Generation with Progressive Structure-conditional Generative Adversarial Networks. Koichi Hamada, Kentaro Tachibana, Tianqi Li, Hiroto Honda, and Yusuke Uchida. arXiv:1809.01890. In ECCV Workshop 2018. A Style-Based Generator Architecture for Generative Adversarial Networks. Tero Karras, Samuli Laine, Timo Aila. arXiv:1812.04948. Style Based Generator
  70. 70. Copyright (C) 2019 DeNA Co.,Ltd. All Rights Reserved. 70 1. FD-GAN: Pose-guided Feature Distilling GAN for Robust Person Re-identification 2. Unsupervised Learning of Object Landmarks through Conditional Image Generation 3. A Unified Feature Disentangler for Multi-Domain Image Translation and Manipulation 4. Image-to-image translation for cross-domain disentanglement 5. Unsupervised Adversarial Invariance
  71. 71. Copyright (C) 2019 DeNA Co.,Ltd. All Rights Reserved.
  72. 72. Copyright (C) 2019 DeNA Co.,Ltd. All Rights Reserved. https://techcon.dena.com/2019/
  73. 73. Copyright (C) 2019 DeNA Co.,Ltd. All Rights Reserved. https://techcon.dena.com/2019/
  74. 74. Copyright (C) 2019 DeNA Co.,Ltd. All Rights Reserved. https://techcon.dena.com/2019/
  75. 75. Copyright (C) 2019 DeNA Co.,Ltd. All Rights Reserved.

×