Alluxio on Kubernetes - Powering training through Container Storage Interface plugin
•
0 recomendaciones•162 vistas
Alluxio Day XII April 28, 2022 https://www.alluxio.io/alluxio-day/ Speaker: Shawn Sun
Recomendados
Recomendados
Más contenido relacionado
Similar a Alluxio on Kubernetes - Powering training through Container Storage Interface plugin
Similar a Alluxio on Kubernetes - Powering training through Container Storage Interface plugin (20)
Más de Alluxio, Inc.
Más de Alluxio, Inc. (20)
Último
Último (20)
Alluxio on Kubernetes - Powering training through Container Storage Interface plugin
- 1. Alluxio on Kubernetes Powering training through Container Storage Interface (CSI) plugin
- 2. Alluxio Fuse
- 3. Alluxio on Kubernetes Alluxio Master pod Master Container Job Master Container Alluxio Worker pod Worker Container Job Worker Container Alluxio Fuse pod Fuse Container Alluxio Worker pod Worker Container Job Worker Container Alluxio Fuse pod Fuse Container
- 4. DaemonSet: Worker & Fuse Alluxio Worker pod Worker Container Job Worker Container Alluxio Fuse pod Fuse Container Alluxio Worker pod Worker Container Job Worker Container Alluxio Fuse pod Fuse Container Alluxio Worker pod Worker Container Job Worker Container Alluxio Fuse pod Fuse Container Host Machine 1 Host Machine 2 Host Machine 3
- 5. Application Alluxio Worker pod Worker Container Job Worker Container Alluxio Fuse pod Fuse Container Host Machine Volume mount
- 6. Application Alluxio Worker pod Worker Container Job Worker Container Alluxio Fuse pod Fuse Container Host Machine Application pod Application Container Volume mount mount req data
- 7. Advantages 1. Better performance because of data-locality 2. Easy to deploy. `helm install` to start the whole Alluxio cluster Alluxio Worker pod Worker Contain er Job Worker Contain er Alluxio Fuse pod Fuse Container Host Machine Application pod Application Container Volume mount mount req data
- 8. Challenges Alluxio Worker pod Worker Contain er Job Worker Contain er Alluxio Fuse pod Fuse Container Host Machine Application pod Application Container Volume mount mount req data 1. Fuse pod is not always needed but always taking resources. Ex. data preprocessing 2. In some workloads Fuse pod is not needed on some machines in the cluster. Lots of manual work.
- 9. Before CSI on Kubernetes Pod Volume AWS EBS AzureDisk AzureFile CephFS …
- 10. CSI on Kubernetes Pod Volume CSI AWS EBS AzureDisk AzureFile CephFS … More than 100 existing CSI drivers
- 11. Alluxio CSI Driver v1.0.0 Host Machine Alluxio CSI Driver Components
- 12. Alluxio CSI Driver v1.0.0 Host Machine Alluxio CSI Driver Components Persistent volume + claim
- 13. Alluxio CSI Driver v1.0.0 Host Machine Alluxio CSI Driver Components Application pod Application Container Persistent volume + claim mount mount + Alluxio Fuse
- 14. Advantages of Alluxio CSI Driver v1.0.0 1. Fuse process lifecycle is the same as the application pod. Perfectly solving our previous challenges 2. Easy to deploy. With CSI deployed with `helm install`, Fuse process is automated. Host Machine CSI Components Application pod Application Container Persistent volume + claim mount mount + Alluxio Fuse
- 15. Challenges of Alluxio CSI Driver v1.0.0 1. Fuse processes reside in one of the CSI components - nodeserver What if nodeserver is down? What if nodeserver needs to be upgraded? Host Machine CSI Components Application pod Application Container Persistent volume + claim mount mount + Alluxio Fuse
- 16. Challenges of Alluxio CSI Driver v1.0.0 1. Fuse processes reside in one of the CSI components - nodeserver What if nodeserver is down? What if nodeserver needs to be upgraded? Host Machine Application pod Application Container Persistent volume + claim mount
- 17. Alluxio CSI Driver v1.1.0 Host Machine Persistent volume + claim CSI Components
- 18. Alluxio CSI Driver v1.1.0 Alluxio Fuse pod Fuse Container Host Machine Application pod Application Container Persistent volume + claim mount mount CSI Components create
- 19. Alluxio CSI Driver v1.1.0 Alluxio Fuse pod Fuse Container Host Machine Application pod Application Container Persistent volume + claim mount mount What if nodeserver is down? What if nodeserver needs to be upgraded? Problem solved!
- 20. 1. Fuse pod resource allocation 2. In some cases, different applications always use different Fuse processes Next Steps
- 21. Acknowledgement Community users ● Kevin Cai@AntFin ● Hui Fei, Haoning Sun@Shopee ● Binyang Li@Microsoft