Cloudera Federal Forum 2014: Cloud Deployment for the Enterprise Data Hub

•

4 recomendaciones•2,057 vistas

Chief Technologist, Office of the CTO at Cloudera, Eli Collins, shares information about the enterprise data hub in the cloud and Cloudera's relationship with AWS.

Tecnología Empresariales

The Enterprise Data Hub in the Cloud
Eli Collins, Chief Technologist

1

©2014 Cloudera, Inc. All rights reserved.

2

©2014 Cloudera, Inc. All rights reserved.

What we’re really talking about
Host

Customer

Vendor
3

Vendor

AWS
GCE
SoftLayer
…

Customer

Manage

T-Systems
Accenture
..

EMR
AltiScale
..

©2014 Cloudera, Inc. All rights reserved.

Primarily dedicated
physical on-prem
infrastructure
2. Alternatives
emerging
1.

Engineering Perspective
• Long-running

Long-running batch jobs
• Cluster stores the data and provides services (Impala,
Search, HBase, Accumulo, etc)
•

• Ephemeral

Self-service, demos
• Test/Dev, POC
• Periodic batch
•

4

©2014 Cloudera, Inc. All rights reserved.

Product Thinking
• Many EDH environments

will be hybrid

Valid reasons for/against cloud deployments
• Private/public capabilities will converge
•

• Run Cloudera anywhere
•

5

EDH works with multiple deployment models

©2014 Cloudera, Inc. All rights reserved.

Portability is KEY
• Multiple deployment options

Cloud Connect: AWS, SoftLayer, Savvis, T-Systems, Verizon
• Integrated support offerings
• Growing provider, SI, and MSP ecosystem
•

• Multiple pricing models

Traditional
• Usage-based
•

6

©2014 Cloudera, Inc. All rights reserved.

Functionality is KEY too
• Enterprise Data Hub functionality & innovation

Impala, Search, Sentry, Spark, ..
• ISV ecosystem
•

• Management
•

7

Cloudera Manager, NAVIGATOR, and BDR

©2014 Cloudera, Inc. All rights reserved.

Our Reference Architecture

+

8

©2014 Cloudera, Inc. All rights reserved.

Cloudera Leveraging AWS
• Elastic Compute (EC2)
• Simple Storage Service (S3)
• Relational Database Service (RDS)
• Elastic Block Store (EBS)
• Direct Connect

• Virtual Private Cloud (VPC)

9

©2014 Cloudera, Inc. All rights reserved.

Private VPC Subnet

10

©2014 Cloudera, Inc. All rights reserved.

Public VPC Subnet

11

©2014 Cloudera, Inc. All rights reserved.

Private and Public Subnets

12

©2014 Cloudera, Inc. All rights reserved.

Instance Types and Roles

13

©2014 Cloudera, Inc. All rights reserved.

What’s coming?
• Automated deployment

Joint reference architectures
• Extend this with your IT
•

• Self-service (via service providers)
• More platforms and providers

14

©2014 Cloudera, Inc. All rights reserved.

Taking Full Advantage of the Cloud
• Enhanced transient clusters

Grow/shrink, compute only instances, spot instances
• Improved S3 and Swift support
•

• Hybrid environments

Cross-DC operation
• Centralized discovery & management
• Bursting
•

15

©2014 Cloudera, Inc. All rights reserved.

16

©2014 Cloudera, Inc. All rights reserved.

Más contenido relacionado

La actualidad más candente

How to Build Multi-disciplinary Analytics Applications on a Shared Data PlatformCloudera, Inc.

Data Modeling for Data Science: Simplify Your Workload with Complex Types in ...Cloudera, Inc.

How to Run Cloudera Enterprise on Microsoft AzureCloudera, Inc.

Standing Up an Effective Enterprise Data Hub -- Technology and BeyondCloudera, Inc.

Enterprise Hadoop in the Cloud. In Minutes. | How to Run Cloudera Enterprise ...Cloudera, Inc.

Big data journey to the cloud maz chaudhri 5.30.18Cloudera, Inc.

Unlock Hadoop Success with Cloudera Navigator OptimizerCloudera, Inc.

Consolidate your data marts for fast, flexible analytics 5.24.18Cloudera, Inc.

PaaS or Fail: Rule the Cloud with AltusCloudera, Inc.

The Vision & Challenge of Applied Machine LearningCloudera, Inc.

Analyzing Hadoop Data Using Sparklyr Cloudera, Inc.

Cloudera Altus: Big Data in the Cloud Made EasyCloudera, Inc.

Part 2: Apache Kudu: Extending the Capabilities of Operational and Analytic D...Cloudera, Inc.

Data Science and Machine Learning for the EnterpriseCloudera, Inc.

Making Self-Service BI a Reality in the EnterpriseCloudera, Inc.

Multi-Tenant Operations with Cloudera 5.7 & BTCloudera, Inc.

Comment développer une stratégie Big Data dans le cloud public avec l'offre P...Cloudera, Inc.

Data Drive Applications_WebinarSean Spediacci

The 6th Wave of Automation: Automation of Decisions | Cloudera Analytics & Ma...Cloudera, Inc.

What’s New in Cloudera Enterprise 6.0: The Inside Scoop 6.14.18Cloudera, Inc.

La actualidad más candente (20)

How to Build Multi-disciplinary Analytics Applications on a Shared Data Platform

Data Modeling for Data Science: Simplify Your Workload with Complex Types in ...

How to Run Cloudera Enterprise on Microsoft Azure

Standing Up an Effective Enterprise Data Hub -- Technology and Beyond

Enterprise Hadoop in the Cloud. In Minutes. | How to Run Cloudera Enterprise ...

Big data journey to the cloud maz chaudhri 5.30.18

Unlock Hadoop Success with Cloudera Navigator Optimizer

Consolidate your data marts for fast, flexible analytics 5.24.18

PaaS or Fail: Rule the Cloud with Altus

The Vision & Challenge of Applied Machine Learning

Analyzing Hadoop Data Using Sparklyr 

Cloudera Altus: Big Data in the Cloud Made Easy

Part 2: Apache Kudu: Extending the Capabilities of Operational and Analytic D...

Data Science and Machine Learning for the Enterprise

Making Self-Service BI a Reality in the Enterprise

Multi-Tenant Operations with Cloudera 5.7 & BT

Comment développer une stratégie Big Data dans le cloud public avec l'offre P...

Data Drive Applications_Webinar

The 6th Wave of Automation: Automation of Decisions | Cloudera Analytics & Ma...

What’s New in Cloudera Enterprise 6.0: The Inside Scoop 6.14.18

Destacado

"Targeting the Big Guys: Account Based Sales Development" at SaaStr Annual 2016saastr

AWS re:Invent re:Cap - 데이터 분석: Amazon EC2 C4 Instance + Amazon EBS - 김일호Amazon Web Services Korea

Challenges for running Hadoop on AWS - AdvancedAWS MeetupAndrei Savu

Cloudera Impala - Las Vegas Big Data Meetup Nov 5th 2014cdmaxime

ClouderaAhmed Salman

Hw09 Clouderas Distribution For HadoopCloudera, Inc.

Five Tips for Running Cloudera on AWSCloudera, Inc.

Which Hadoop Distribution to use: Apache, Cloudera, MapR or HortonWorks?Edureka!

(BDT305) Lessons Learned and Best Practices for Running Hadoop on AWS | AWS r...Amazon Web Services

Apache hadoop and cdh(cloudera distribution) introduction 基本介紹Anna Yen

Hadoop benchmark: Evaluating Cloudera, Hortonworks, and MapRDouglas Bernardini

Hadoop Workshop using Cloudera on Amazon EC2IMC Institute

Overview of Amazon Web ServicesAmazon Web Services

AWS Cloud Kata | Bangkok - Getting to MVPAmazon Web Services

AWS 101: Cloud Computing Seminar (2012)Amazon Web Services

Introduction to Amazon Web ServicesAmazon Web Services

Destacado (16)

"Targeting the Big Guys: Account Based Sales Development" at SaaStr Annual 2016

AWS re:Invent re:Cap - 데이터 분석: Amazon EC2 C4 Instance + Amazon EBS - 김일호

Challenges for running Hadoop on AWS - AdvancedAWS Meetup

Cloudera Impala - Las Vegas Big Data Meetup Nov 5th 2014

Cloudera

Hw09 Clouderas Distribution For Hadoop

Five Tips for Running Cloudera on AWS

Which Hadoop Distribution to use: Apache, Cloudera, MapR or HortonWorks?

(BDT305) Lessons Learned and Best Practices for Running Hadoop on AWS | AWS r...

Apache hadoop and cdh(cloudera distribution) introduction 基本介紹

Hadoop benchmark: Evaluating Cloudera, Hortonworks, and MapR

Hadoop Workshop using Cloudera on Amazon EC2

Overview of Amazon Web Services

AWS Cloud Kata | Bangkok - Getting to MVP

AWS 101: Cloud Computing Seminar (2012)

Introduction to Amazon Web Services

Similar a Cloudera Federal Forum 2014: Cloud Deployment for the Enterprise Data Hub

Cloudera Director: Unlock the Full Potential of Hadoop in the CloudCloudera, Inc.

Introducing Cloudera Director at Big Data BashAndrei Savu

Leveraging the cloud for analytics and machine learning 1.29.19Cloudera, Inc.

My sql en la nube conoce las mejores prácticas en administración y operación_...GeneXus

Basics of cloud computing ( aws )Deepak Singhal

Using MySQL in the CloudMatt Lord

Infoblox Cloud Solutions - Cisco Mid-Atlantic User GroupNetCraftsmen

Introducing Azure ArcMohamed Wali

Hadoop Operations – Past, Present, and FutureDataWorks Summit

Cloud FoundationAnil Bidari ( CEO , Cloud Enabled)

Getting the Most Out of Your Data in the Cloud with CloudbreakHortonworks

Cloudera GoDataFest Deploying Cloudera in the CloudGoDataDriven

Hadoop Operations - Past, Present, and FutureDataWorks Summit

Learn Cloud Computing from ScratchIntellipaat

Hadoop security @ Philly Hadoop Meetup May 2015Shravan (Sean) Pabba

Data in the Cloud Crash CourseDataWorks Summit

Cloud computing(ppt)priyas211420

Open stack @ sierra wirelessLINAGORA

What Is Cloud Computing? | Cloud Computing For Beginners | Cloud Computing Tr...Simplilearn

One Hadoop, Multiple Clouds - NYC Big Data MeetupAndrei Savu

Similar a Cloudera Federal Forum 2014: Cloud Deployment for the Enterprise Data Hub (20)

Cloudera Director: Unlock the Full Potential of Hadoop in the Cloud

Introducing Cloudera Director at Big Data Bash

Leveraging the cloud for analytics and machine learning 1.29.19

My sql en la nube conoce las mejores prácticas en administración y operación_...

Basics of cloud computing ( aws )

Using MySQL in the Cloud

Infoblox Cloud Solutions - Cisco Mid-Atlantic User Group

Introducing Azure Arc

Hadoop Operations – Past, Present, and Future

Cloud Foundation

Getting the Most Out of Your Data in the Cloud with Cloudbreak

Cloudera GoDataFest Deploying Cloudera in the Cloud

Hadoop Operations - Past, Present, and Future

Learn Cloud Computing from Scratch

Hadoop security @ Philly Hadoop Meetup May 2015

Data in the Cloud Crash Course

Cloud computing(ppt)

Open stack @ sierra wireless

What Is Cloud Computing? | Cloud Computing For Beginners | Cloud Computing Tr...

One Hadoop, Multiple Clouds - NYC Big Data Meetup

Más de Cloudera, Inc.

Partner Briefing_January 25 (FINAL).pptxCloudera, Inc.

Cloudera Data Impact Awards 2021 - Finalists Cloudera, Inc.

2020 Cloudera Data Impact Awards FinalistsCloudera, Inc.

Edc event vienna presentation 1 oct 2019Cloudera, Inc.

Machine Learning with Limited Labeled Data 4/3/19Cloudera, Inc.

Data Driven With the Cloudera Modern Data Warehouse 3.19.19Cloudera, Inc.

Introducing Cloudera DataFlow (CDF) 2.13.19Cloudera, Inc.

Introducing Cloudera Data Science Workbench for HDP 2.12.19Cloudera, Inc.

Shortening the Sales Cycle with a Modern Data Warehouse 1.30.19Cloudera, Inc.

Modernizing the Legacy Data Warehouse – What, Why, and How 1.23.19Cloudera, Inc.

Leveraging the Cloud for Big Data Analytics 12.11.18Cloudera, Inc.

Modern Data Warehouse Fundamentals Part 3Cloudera, Inc.

Modern Data Warehouse Fundamentals Part 2Cloudera, Inc.

Modern Data Warehouse Fundamentals Part 1Cloudera, Inc.

Extending Cloudera SDX beyond the PlatformCloudera, Inc.

Federated Learning: ML with Privacy on the Edge 11.15.18Cloudera, Inc.

Analyst Webinar: Doing a 180 on Customer 360Cloudera, Inc.

Build a modern platform for anti-money laundering 9.19.18Cloudera, Inc.

Introducing the data science sandbox as a service 8.30.18Cloudera, Inc.

Cloudera SDXCloudera, Inc.

Más de Cloudera, Inc. (20)

Partner Briefing_January 25 (FINAL).pptx

Cloudera Data Impact Awards 2021 - Finalists

2020 Cloudera Data Impact Awards Finalists

Edc event vienna presentation 1 oct 2019

Machine Learning with Limited Labeled Data 4/3/19

Data Driven With the Cloudera Modern Data Warehouse 3.19.19

Introducing Cloudera DataFlow (CDF) 2.13.19

Introducing Cloudera Data Science Workbench for HDP 2.12.19

Shortening the Sales Cycle with a Modern Data Warehouse 1.30.19

Modernizing the Legacy Data Warehouse – What, Why, and How 1.23.19

Leveraging the Cloud for Big Data Analytics 12.11.18

Modern Data Warehouse Fundamentals Part 3

Modern Data Warehouse Fundamentals Part 2

Modern Data Warehouse Fundamentals Part 1

Extending Cloudera SDX beyond the Platform

Federated Learning: ML with Privacy on the Edge 11.15.18

Analyst Webinar: Doing a 180 on Customer 360

Build a modern platform for anti-money laundering 9.19.18

Introducing the data science sandbox as a service 8.30.18

Cloudera SDX

Último

Top 5 Benefits OF Using Muvi Live Paywall For Live StreamsRoshan Dwivedi

08448380779 Call Girls In Diplomatic Enclave Women Seeking MenDelhi Call girls

How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes

TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc

Automating Google Workspace (GWS) & more with Apps Scriptwesley chun

Factors to Consider When Choosing Accounts Payable Services Providers.pptxKatpro Technologies

GenCyber Cyber Security Day PresentationMichael W. Hawkins

Slack Application Development 101 Slidespraypatel2

How to convert PDF to text with Nanonetsnaman860154

Handwritten Text Recognition for manuscripts and early printed textsMaria Levchenko

08448380779 Call Girls In Friends Colony Women Seeking MenDelhi Call girls

Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Igalia

A Call to Action for Generative AI in 2024Results

IAC 2024 - IA Fast Track to Search Focused AI SolutionsEnterprise Knowledge

The 7 Things I Know About Cyber Security After 25 Years | April 2024Rafal Los

[2024]Digital Global Overview Report 2024 Meltwater.pdfhans926745

Presentation on how to chat with PDF using ChatGPT code interpreternaman860154

The Codex of Business Writing Software for Real-World Solutions 2.pptxMalak Abu Hammad

Finology Group – Insurtech Innovation Award 2024The Digital Insurer

From Event to Action: Accelerate Your Decision Making with Real-Time AutomationSafe Software

Cloudera Federal Forum 2014: Cloud Deployment for the Enterprise Data Hub

3. What we’re really talking about Host Customer Vendor 3 Vendor AWS GCE SoftLayer … Customer Manage T-Systems Accenture .. EMR AltiScale .. ©2014 Cloudera, Inc. All rights reserved. Primarily dedicated physical on-prem infrastructure 2. Alternatives emerging 1.

4. Engineering Perspective • Long-running Long-running batch jobs • Cluster stores the data and provides services (Impala, Search, HBase, Accumulo, etc) • • Ephemeral Self-service, demos • Test/Dev, POC • Periodic batch • 4 ©2014 Cloudera, Inc. All rights reserved.

5. Product Thinking • Many EDH environments will be hybrid Valid reasons for/against cloud deployments • Private/public capabilities will converge • • Run Cloudera anywhere • 5 EDH works with multiple deployment models ©2014 Cloudera, Inc. All rights reserved.

6. Portability is KEY • Multiple deployment options Cloud Connect: AWS, SoftLayer, Savvis, T-Systems, Verizon • Integrated support offerings • Growing provider, SI, and MSP ecosystem • • Multiple pricing models Traditional • Usage-based • 6 ©2014 Cloudera, Inc. All rights reserved.

7. Functionality is KEY too • Enterprise Data Hub functionality & innovation Impala, Search, Sentry, Spark, .. • ISV ecosystem • • Management • 7 Cloudera Manager, NAVIGATOR, and BDR ©2014 Cloudera, Inc. All rights reserved.

9. Cloudera Leveraging AWS • Elastic Compute (EC2) • Simple Storage Service (S3) • Relational Database Service (RDS) • Elastic Block Store (EBS) • Direct Connect • Virtual Private Cloud (VPC) 9 ©2014 Cloudera, Inc. All rights reserved.

14. What’s coming? • Automated deployment Joint reference architectures • Extend this with your IT • • Self-service (via service providers) • More platforms and providers 14 ©2014 Cloudera, Inc. All rights reserved.

15. Taking Full Advantage of the Cloud • Enhanced transient clusters Grow/shrink, compute only instances, spot instances • Improved S3 and Swift support • • Hybrid environments Cross-DC operation • Centralized discovery & management • Bursting • 15 ©2014 Cloudera, Inc. All rights reserved.

Cloudera Federal Forum 2014: Cloud Deployment for the Enterprise Data Hub

Recomendados

Recomendados

Más contenido relacionado

La actualidad más candente

La actualidad más candente (20)

Destacado

Destacado (16)

Similar a Cloudera Federal Forum 2014: Cloud Deployment for the Enterprise Data Hub

Similar a Cloudera Federal Forum 2014: Cloud Deployment for the Enterprise Data Hub (20)

Más de Cloudera, Inc.

Más de Cloudera, Inc. (20)

Último

Último (20)

Cloudera Federal Forum 2014: Cloud Deployment for the Enterprise Data Hub