Bay Area Meetup presentation (6/15/16)

1. Alluxio (formerly Tachyon):
Accessing Data Anywhere with Unified Namespace
Jiri Simsa
June 15, 2016 @ Alluxio Meetup (hosted by Intel)

2. About Me
• Software Engineer @ Alluxio, Inc.
• PMC Member and Maintainer of Alluxio Open Source Project
• Ph.D. from Carnegie Mellon University (Parallel Data Lab)
• Worked at Google before joining Alluxio
• Twitter: @jsimsa, Github: jsimsa
2

3. Outline
• Motivation
• Unified Namespace
• Use Cases
• Demo
3

4. Big Data Ecosystem
4

5. Big Data Ecosystem
5

6. Big Data Ecosystem
6

7. Alluxio Benefits
• Future-proofing your applications
–applications can communicate with different storage
systems, both existing and new, using the same
namespace and interface
–seamless integration between applications and new
storage systems enables faster innovation
• Enabling new workloads
–one-time effort to enable an application to access many
different types of storage systems and a storage system
to be accessed by many different types of applications
7

8. Outline
• Motivation
• Unified Namespace
• Use Cases
• Demo
8

9. Unified Namespace
an abstraction that makes it possible for
applications to access different storage
systems through the same interface
9

10. Transparent Naming
•Operations over persisted Alluxio objects
mapped transparently to underlying storage
•Alluxio paths are preserved in storage layer
Alluxio Storage System (HDFS, S3, …)
alluxio://host:port/
Data Users
Reports Sales Alice Bob
hdfs://host:port/
Data Users
Reports Sales Alice Bob
10

11. Multiple Storage Systems
•Unified namespace for multiple data sources
•Sharing of data across storage systems
•API for on-the-fly mounting / unmounting
Alluxio
Storage System A
alluxio://host:port/
Data Users
Alice Bob
hdfs://host:port/
Users
Alice Bob
Storage System B
s3://host/bucket
Reports Sales
Reports Sales
11

12. Outline
• Motivation
• Unified Namespace
• Use Cases
• Demo
12

13. Multiple Storage / Compute
13

14. Changing Storage Backend
14

15. Changing Storage Backend
15

16. Outline
• Motivation
• Unified Namespace
• Use Cases
• Demo
16

17. Resources
• Alluxio Project: http://www.alluxio.org
• Development: https://github.com/Alluxio/alluxio
• Meet Friends: http://www.meetup.com/Alluxio
• Alluxio, Inc.: http://www.alluxio.com
• Contact us: info@alluxio.com
17

18. Backup Slides
18

19. Architecture Overview
19