SlideShare una empresa de Scribd logo
1 de 32
Descargar para leer sin conexión
© 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Vicky Falconer
Business Development Manager, Big Data - Amazon Web Services
Better Business From Exploring
Ideas
Modern Data Architectures On AWS
© 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Let’s go on a Common
Customer Journey
© 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Meet AudibleEars, as they move from B2B to B2C
* This case is representative of a common customer journey, but AudibleEars isn’t an actual business
AudibleEars manufacturers hearing aids.
They ran a traditional business since
2005, selling through distribution
channels.
2005
In 2016, they launched their first “AudibleEars
App”. The hearing aid comes with the
AudibleEars mobile app which enables
customized control of the hearing device, voice
to text translation, music streaming. The device
syncs with the users mobile phone via
Bluetooth. The mobile app has optional GPS
tracking.
2016
© 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
AudibleEars Needs To Answer New Questions
And Move Faster
Raymond, Head of ProductLim, Head of Finance
Are customers using the new features?
What is the demand forecast by product category?
What is the social sentiment about our products?
How do quality issues impact cost of production?
Can I look at supplier performance over time?
How can we reduce our inventory holding costs?
© 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
To Answer New Questions Quickly, We Look
To A Modern Data Architecture Design
Massive upfront costs
Overprovisioned capacity
Long implementation times
Pay as you go, for what you use
Decoupled pipelines and engines
Experimentation platform
Ingest/
Collect
Consume/
visualise
Store Process/
analyze
1 4
0 9
5
© 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Outcome 1:
Modernise And Consolidate
© 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Start With A Set Of Specific Questions To
Answer, Then Work Backwards To The Data
Required
Lim, Head of Finance
How do quality issues impact cost of production?
Can I look at supplier performance over time?
How can we reduce our inventory holding costs?
Order History /
Returns (CRM)
Inventory /
Production (ERP)
© 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Ingest ServingData
sources
Modern Data Architecture
Insights to enhance business applications, new digital services
Transactions
ERP
Data analysts
DATA PIPELINES
Ingest/
Collect
Consume /
Visualise
Store Process /
Analyze
1 4
0 9
5
© 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Start Small and Iterate
© 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Ingest ServingData
sources
Modern Data Architecture
Insights to enhance business applications, new digital services
Transactions
ERP
DATA PIPELINES
Data
Lake
expdp
Data
Data analysts
Data Warehouse
Amazon Redshift
Direct Query
Amazon Athena
She asks for the SMALLEST amount of data to answer her questions.
If it isn’t good enough, she asks for another small slice to be loaded to the DATA LAKE
© 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Amazon Redshift – Modern Data Warehousing
Fast, scalable, fully managed data warehouse at 1/10th the cost
Massively parallel, scales from gigabytes to exabytes
Queries data across your Redshift data warehouse and Amazon S3 data lake
Fast at scale
Columnar storage
technology to improve I/O
efficiency and scale query
performance
Open file formats
Analyze optimised data
formats on direct-
attached disks, and all
open file formats in S3
Cost-effective
Start at $0.25 per hour;
as low as $250-$333 per
uncompressed terabyte
per year
$
Secure
Audit everything; encrypt
data end-to-end; extensive
certification and
compliance
© 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Characteristics Of A Data Lake
Future
Proof
Flexible
Access
Dive in
Anywhere
Collect
Anything
© 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Start With A Set Of Specific Questions To
Answer, Then Work Backwards To The Data
Required
Raymond, Head of Product
Are customers using the new features?
What is the demand forecast by product category?
What is the social sentiment about our products?
Trending /
Mentions (Social)
Order History /
Returns (CRM)
NOW IN THE DATA LAKE
© 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Experiment, Validate, then Scale
© 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Ingest ServingData
sources
Modern Data Architecture
Insights to enhance business applications, new digital services
DATA PIPELINES
Data
Lake
He first looks to the DATA LAKE, and imports only the category data he needs
He imports JUST ENOUGH data to see if the market is responding to products.
Business users
Transactions
ERP
Social media
Data
Stream
Capture
Amazon
Kinesis
Events
Amazon
QuickSight
Data Warehouse
Amazon Redshift
Stream Data
Amazon
ElasticSearch
© 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Common Data Pipeline Configuration
Raw Data
Amazon S3
Highly decoupled configurations scale better, are more fault tolerant, and cost optimised
ETL (Hadoop)
Amazon EMR
Triggered Code
Amazon Lambda
Staged Data
(Data Lake)
Amazon S3
ETL & Catalog Management
AWS Glue
Data Warehouse
Amazon Redshift
Triggered Code
Amazon Lambda
© 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Data security
and management
Encryption
Access Controls
Monitoring and Metrics
Audit Trails
Automation
Serverless Computing
Data Discovery and
Protection
Data Visualisation
Data movement
Physical Appliances
Hybrid Storage
Private Networks
File Data
WAN Acceleration
Third-party Applications
Streaming Data
Complete Set Of Building Blocks
FileBlock
Object Archival
Storage types
© 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Ingest ServingData
sources
Modern Data Architecture
Insights to enhance business applications, new digital services
Transactions
ERP
Data analysts
Business users
DATA PIPELINES
EVENT PIPELINES
Data
Event
Insights
Data
Lake
Social media
© 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Outcome 2:
Innovate For New Insight
© 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
AudibleEars Has Its First Direct Relationship
With Consumers
Krzysztof, Data ScientistBala, Head of Research & Development
What are our customer segments, based on usage?
Can we predict changes to hearing loss from usage
of the app?
Can we give a better customer experience, for
example optimised settings, based on signals?
How are consumers using the hearing aids?
When do they turn them off? How are they
altering the settings throughout the day?
What kinds of people are in/decreasing usage?
© 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Start With A Set Of Specific Questions To
Answer, Then Work Backwards To The Data
Required
Media consumption
(Partner API)
Registration, usage
[time/place]
(Mobile app)
Bala, Head of Research & Development
How are consumers using the hearing aids?
When do they turn them off? How are they
altering the settings throughout the day?
What kinds of people are in/decreasing usage?
© 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Start With A Set Of Specific Questions To
Answer, Then Work Backwards To The Data
Required
Krzysztof, Data Scientist
Voice to text, GPS
DATA LAKE, OR NOT?
Registration, usage
[time/place]
(Mobile app)
LOAD TO DATA LAKE
What are our customer segments, based on usage?
Can we predict changes to hearing loss from usage
of the app?
Can we give a better customer experience, for
example optimised settings, based on signals?
© 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Sandboxes - Fast, Cheap, Low Risk
© 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Ingest ServingData
sources
Transactions
Data scientists
Business users
Connected
devices
DATA PIPELINES
EVENT PIPELINES
Data
Event
Insights
Data
Lake
Sandbox
ML / Analytics / DLWeb logs /
clickstream
Modern Data Architecture
Insights to enhance business applications, new digital services
© 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Ingest ServingData
sources
Modern Data Architecture
Innovate for new revenues - personalisation and forecasting
Transactions
ERP
Data analysts
Data scientists
Business users
Connected
devices
DATA PIPELINES
EVENT PIPELINES
Data
Event
Insights
Data
Lake
ML / Analytics
Social media
Web logs /
clickstream
© 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Outcome 3:
Real-Time Engagement
© 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
AudibleEars Offers A Personalised Life
Soundtrack
Personalised, based on
past preferences,
people with similar behaviors,
and environments detected
© 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Use AudibleEars Voice Enablement To Recommend
Settings
What are the
best settings for
watching a play?
Amazon Transcribe
/ Comprehend
Action: <RECOMMEND>
Category: THEATRE
Request settings
HISTORY
RECOMMENDATION!
PEOPLE LIKE YOU
Amazon Kinesis
Streams
Connected device data
Location: <FIND GPS>
Ambient Noise: <FIND Noise>
© 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Ingest ServingData
sources
Modern Data Architecture
Real-time engagement and interactive customer experiences
Transactions
ERP
Data analysts
Data scientists
Business users
Engagement platformsConnected
devices
Automation / events
DATA PIPELINES
EVENT PIPELINES
Data
Event Action
Insights
Data
Lake
ML / Analytics
Predict /
Recommend
AI Services
Social media
Web logs /
clickstream
© 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Business Outcomes on a Modern Data
Architecture
Outcome 1 : Modernise and consolidate
• Insights to enhance business applications and create new
digital services
Outcome 2 : Innovate for new insights
• Personalisation, demand forecasting, risk analysis
Outcome 3 : Real-time engagement
• Interactive customer experience, event-driven automation,
fraud detection
© 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Ready to build better business from your
ideas?
Short list projects that
directly impact
customer engagement
and adoption
Build simple data
pipelines that allow you
to test new ideas, and
fill your data lake
Ask our solution architects
and professional services
teams to help you build
Thank You

Más contenido relacionado

La actualidad más candente

Role of Data in Digital Transformation
Role of Data in Digital TransformationRole of Data in Digital Transformation
Role of Data in Digital TransformationVMware Tanzu
 
Data Monetization– Mine data & Track Telecom customer behavior
Data Monetization– Mine data & Track Telecom customer behaviorData Monetization– Mine data & Track Telecom customer behavior
Data Monetization– Mine data & Track Telecom customer behaviorMahindra Comviva
 
Srini Data Monetization
Srini Data MonetizationSrini Data Monetization
Srini Data MonetizationSrini Alavala
 
Best Practices in Implementing Social and Mobile CX for Utilities
Best Practices in Implementing Social and Mobile CX for UtilitiesBest Practices in Implementing Social and Mobile CX for Utilities
Best Practices in Implementing Social and Mobile CX for UtilitiesCapgemini
 
Data-driven marketing - expert panel
Data-driven marketing - expert panelData-driven marketing - expert panel
Data-driven marketing - expert panelCloudera, Inc.
 
Too Small to Get Hacked? Think Again (Webinar)
Too Small to Get Hacked? Think Again (Webinar)Too Small to Get Hacked? Think Again (Webinar)
Too Small to Get Hacked? Think Again (Webinar)OnRamp
 
SugarCON 2013: World Class Analytics for SugarCRM with IBM
SugarCON 2013: World Class Analytics for SugarCRM with IBMSugarCON 2013: World Class Analytics for SugarCRM with IBM
SugarCON 2013: World Class Analytics for SugarCRM with IBMPalmtreeConsulting
 
Capital Factory - Career Tips
Capital Factory - Career TipsCapital Factory - Career Tips
Capital Factory - Career TipsSandy Carter
 
THT10839_OpenWorldSF2015 CSP Location Data Monetization V1.0
THT10839_OpenWorldSF2015 CSP Location Data Monetization V1.0THT10839_OpenWorldSF2015 CSP Location Data Monetization V1.0
THT10839_OpenWorldSF2015 CSP Location Data Monetization V1.0Srini Alavala
 
Future of Business Networks
Future of Business NetworksFuture of Business Networks
Future of Business NetworksSAP Ariba
 
Understanding Big Data
Understanding Big DataUnderstanding Big Data
Understanding Big DataCapgemini
 
Business Analytics per il Finance: stato dell’arte, esigenze emergenti e nuov...
Business Analytics per il Finance: stato dell’arte, esigenze emergenti e nuov...Business Analytics per il Finance: stato dell’arte, esigenze emergenti e nuov...
Business Analytics per il Finance: stato dell’arte, esigenze emergenti e nuov...Fondazione CUOA
 
How to optimize the supply chain with ai
How to optimize the supply chain with ai How to optimize the supply chain with ai
How to optimize the supply chain with ai GlobalTechCouncil
 
GigaOM Putting Big Data to Work by Brett Sheppard
GigaOM Putting Big Data to Work by Brett SheppardGigaOM Putting Big Data to Work by Brett Sheppard
GigaOM Putting Big Data to Work by Brett SheppardBrett Sheppard
 
AI & ML for Supply Chain Optimization
AI & ML for Supply Chain OptimizationAI & ML for Supply Chain Optimization
AI & ML for Supply Chain OptimizationShiSh Shridhar
 

La actualidad más candente (20)

Role of Data in Digital Transformation
Role of Data in Digital TransformationRole of Data in Digital Transformation
Role of Data in Digital Transformation
 
Data Monetization– Mine data & Track Telecom customer behavior
Data Monetization– Mine data & Track Telecom customer behaviorData Monetization– Mine data & Track Telecom customer behavior
Data Monetization– Mine data & Track Telecom customer behavior
 
Model Factory at ING Bank
Model Factory at ING BankModel Factory at ING Bank
Model Factory at ING Bank
 
Srini Data Monetization
Srini Data MonetizationSrini Data Monetization
Srini Data Monetization
 
Best Practices in Implementing Social and Mobile CX for Utilities
Best Practices in Implementing Social and Mobile CX for UtilitiesBest Practices in Implementing Social and Mobile CX for Utilities
Best Practices in Implementing Social and Mobile CX for Utilities
 
Data-driven marketing - expert panel
Data-driven marketing - expert panelData-driven marketing - expert panel
Data-driven marketing - expert panel
 
Too Small to Get Hacked? Think Again (Webinar)
Too Small to Get Hacked? Think Again (Webinar)Too Small to Get Hacked? Think Again (Webinar)
Too Small to Get Hacked? Think Again (Webinar)
 
SugarCON 2013: World Class Analytics for SugarCRM with IBM
SugarCON 2013: World Class Analytics for SugarCRM with IBMSugarCON 2013: World Class Analytics for SugarCRM with IBM
SugarCON 2013: World Class Analytics for SugarCRM with IBM
 
01 big dataoverview
01 big dataoverview01 big dataoverview
01 big dataoverview
 
Capital Factory - Career Tips
Capital Factory - Career TipsCapital Factory - Career Tips
Capital Factory - Career Tips
 
THT10839_OpenWorldSF2015 CSP Location Data Monetization V1.0
THT10839_OpenWorldSF2015 CSP Location Data Monetization V1.0THT10839_OpenWorldSF2015 CSP Location Data Monetization V1.0
THT10839_OpenWorldSF2015 CSP Location Data Monetization V1.0
 
Haven 2 0
Haven 2 0 Haven 2 0
Haven 2 0
 
Future of Business Networks
Future of Business NetworksFuture of Business Networks
Future of Business Networks
 
Understanding Big Data
Understanding Big DataUnderstanding Big Data
Understanding Big Data
 
Business Analytics per il Finance: stato dell’arte, esigenze emergenti e nuov...
Business Analytics per il Finance: stato dell’arte, esigenze emergenti e nuov...Business Analytics per il Finance: stato dell’arte, esigenze emergenti e nuov...
Business Analytics per il Finance: stato dell’arte, esigenze emergenti e nuov...
 
How to optimize the supply chain with ai
How to optimize the supply chain with ai How to optimize the supply chain with ai
How to optimize the supply chain with ai
 
Rapid-fire BI
Rapid-fire BIRapid-fire BI
Rapid-fire BI
 
GigaOM Putting Big Data to Work by Brett Sheppard
GigaOM Putting Big Data to Work by Brett SheppardGigaOM Putting Big Data to Work by Brett Sheppard
GigaOM Putting Big Data to Work by Brett Sheppard
 
Big data for Telco: opportunity or threat?
Big data for Telco: opportunity or threat?Big data for Telco: opportunity or threat?
Big data for Telco: opportunity or threat?
 
AI & ML for Supply Chain Optimization
AI & ML for Supply Chain OptimizationAI & ML for Supply Chain Optimization
AI & ML for Supply Chain Optimization
 

Similar a Better Business from Exploring Ideas - Modern Data Architectures on AWS

Data Analytics를 통한 비지니스 혁신::Craig Stries::AWS Summit Seoul 2018
Data Analytics를 통한 비지니스 혁신::Craig Stries::AWS Summit Seoul 2018Data Analytics를 통한 비지니스 혁신::Craig Stries::AWS Summit Seoul 2018
Data Analytics를 통한 비지니스 혁신::Craig Stries::AWS Summit Seoul 2018Amazon Web Services Korea
 
Pemahaman Pelanggan & Machine Learning (Level 200 – 300) | Kenali Pelanggan A...
Pemahaman Pelanggan & Machine Learning (Level 200 – 300) | Kenali Pelanggan A...Pemahaman Pelanggan & Machine Learning (Level 200 – 300) | Kenali Pelanggan A...
Pemahaman Pelanggan & Machine Learning (Level 200 – 300) | Kenali Pelanggan A...Amazon Web Services
 
雲上打造資料湖 (Data Lake):智能化駕馭商機 (Level 300)
雲上打造資料湖 (Data Lake):智能化駕馭商機 (Level 300)雲上打造資料湖 (Data Lake):智能化駕馭商機 (Level 300)
雲上打造資料湖 (Data Lake):智能化駕馭商機 (Level 300)Amazon Web Services
 
AWS Summit Webinar Edition | Modern Data Architecture | Microsoft Application...
AWS Summit Webinar Edition | Modern Data Architecture | Microsoft Application...AWS Summit Webinar Edition | Modern Data Architecture | Microsoft Application...
AWS Summit Webinar Edition | Modern Data Architecture | Microsoft Application...Amazon Web Services
 
Get to Know Your Customers - Build and Innovate with a Modern Data Architecture
Get to Know Your Customers - Build and Innovate with a Modern Data ArchitectureGet to Know Your Customers - Build and Innovate with a Modern Data Architecture
Get to Know Your Customers - Build and Innovate with a Modern Data ArchitectureAmazon Web Services
 
AWS Summit Singapore - Get to Know Your Customers - Modern Data Architecture
AWS Summit Singapore - Get to Know Your Customers - Modern Data ArchitectureAWS Summit Singapore - Get to Know Your Customers - Modern Data Architecture
AWS Summit Singapore - Get to Know Your Customers - Modern Data ArchitectureAmazon Web Services
 
AWS Summit Singapore - Get to Know Your Customers - Modern Data Architecture
AWS Summit Singapore - Get to Know Your Customers - Modern Data ArchitectureAWS Summit Singapore - Get to Know Your Customers - Modern Data Architecture
AWS Summit Singapore - Get to Know Your Customers - Modern Data ArchitectureAmazon Web Services
 
Starting your Cloud Transformation Journey - Tel Aviv Summit 2018
Starting your Cloud Transformation Journey - Tel Aviv Summit 2018Starting your Cloud Transformation Journey - Tel Aviv Summit 2018
Starting your Cloud Transformation Journey - Tel Aviv Summit 2018Boaz Ziniman
 
Starting your Cloud Transformation Journey - Tel Aviv Summit 2018
Starting your Cloud Transformation Journey - Tel Aviv Summit 2018Starting your Cloud Transformation Journey - Tel Aviv Summit 2018
Starting your Cloud Transformation Journey - Tel Aviv Summit 2018Amazon Web Services
 
The Future of Enterprise IT - Lessons Learned
The Future of Enterprise IT - Lessons LearnedThe Future of Enterprise IT - Lessons Learned
The Future of Enterprise IT - Lessons LearnedAmazon Web Services
 
Build and Innovate with a Modern Data Architecture
Build and Innovate with a Modern Data ArchitectureBuild and Innovate with a Modern Data Architecture
Build and Innovate with a Modern Data ArchitectureAmazon Web Services
 
Starting your Cloud Journey - AWSomeDay Israel
Starting your Cloud Journey - AWSomeDay IsraelStarting your Cloud Journey - AWSomeDay Israel
Starting your Cloud Journey - AWSomeDay IsraelAmazon Web Services
 
Starting your cloud journey - AWSomeDay Israel
Starting your cloud journey - AWSomeDay IsraelStarting your cloud journey - AWSomeDay Israel
Starting your cloud journey - AWSomeDay IsraelBoaz Ziniman
 
Real-World AI and Deep Learning for Enterprise with Case Studies
Real-World AI and Deep Learning for Enterprise with Case StudiesReal-World AI and Deep Learning for Enterprise with Case Studies
Real-World AI and Deep Learning for Enterprise with Case StudiesAmazon Web Services
 
BI & Analytics - A Datalake on AWS
BI & Analytics - A Datalake on AWSBI & Analytics - A Datalake on AWS
BI & Analytics - A Datalake on AWSAmazon Web Services
 
AI and IoT innovation - an industry focus
AI and IoT innovation - an industry focusAI and IoT innovation - an industry focus
AI and IoT innovation - an industry focusAmazon Web Services
 
Remediate Tech Debt or Drive Innovation - AWS Summit Sydney 2018
Remediate Tech Debt or Drive Innovation - AWS Summit Sydney 2018Remediate Tech Debt or Drive Innovation - AWS Summit Sydney 2018
Remediate Tech Debt or Drive Innovation - AWS Summit Sydney 2018Amazon Web Services
 
AI/ML with Data Lakes: Counterintuitive Consumer Insights in Retail (RET206) ...
AI/ML with Data Lakes: Counterintuitive Consumer Insights in Retail (RET206) ...AI/ML with Data Lakes: Counterintuitive Consumer Insights in Retail (RET206) ...
AI/ML with Data Lakes: Counterintuitive Consumer Insights in Retail (RET206) ...Amazon Web Services
 
Enabling New Retail Customer Experiences with Big Data - AWS Online Tech Talks
Enabling New Retail Customer Experiences with Big Data - AWS Online Tech TalksEnabling New Retail Customer Experiences with Big Data - AWS Online Tech Talks
Enabling New Retail Customer Experiences with Big Data - AWS Online Tech TalksAmazon Web Services
 

Similar a Better Business from Exploring Ideas - Modern Data Architectures on AWS (20)

Data Analytics를 통한 비지니스 혁신::Craig Stries::AWS Summit Seoul 2018
Data Analytics를 통한 비지니스 혁신::Craig Stries::AWS Summit Seoul 2018Data Analytics를 통한 비지니스 혁신::Craig Stries::AWS Summit Seoul 2018
Data Analytics를 통한 비지니스 혁신::Craig Stries::AWS Summit Seoul 2018
 
Pemahaman Pelanggan & Machine Learning (Level 200 – 300) | Kenali Pelanggan A...
Pemahaman Pelanggan & Machine Learning (Level 200 – 300) | Kenali Pelanggan A...Pemahaman Pelanggan & Machine Learning (Level 200 – 300) | Kenali Pelanggan A...
Pemahaman Pelanggan & Machine Learning (Level 200 – 300) | Kenali Pelanggan A...
 
雲上打造資料湖 (Data Lake):智能化駕馭商機 (Level 300)
雲上打造資料湖 (Data Lake):智能化駕馭商機 (Level 300)雲上打造資料湖 (Data Lake):智能化駕馭商機 (Level 300)
雲上打造資料湖 (Data Lake):智能化駕馭商機 (Level 300)
 
AWS Summit Webinar Edition | Modern Data Architecture | Microsoft Application...
AWS Summit Webinar Edition | Modern Data Architecture | Microsoft Application...AWS Summit Webinar Edition | Modern Data Architecture | Microsoft Application...
AWS Summit Webinar Edition | Modern Data Architecture | Microsoft Application...
 
Get to Know Your Customers - Build and Innovate with a Modern Data Architecture
Get to Know Your Customers - Build and Innovate with a Modern Data ArchitectureGet to Know Your Customers - Build and Innovate with a Modern Data Architecture
Get to Know Your Customers - Build and Innovate with a Modern Data Architecture
 
AWS Summit Singapore - Get to Know Your Customers - Modern Data Architecture
AWS Summit Singapore - Get to Know Your Customers - Modern Data ArchitectureAWS Summit Singapore - Get to Know Your Customers - Modern Data Architecture
AWS Summit Singapore - Get to Know Your Customers - Modern Data Architecture
 
AWS Summit Singapore - Get to Know Your Customers - Modern Data Architecture
AWS Summit Singapore - Get to Know Your Customers - Modern Data ArchitectureAWS Summit Singapore - Get to Know Your Customers - Modern Data Architecture
AWS Summit Singapore - Get to Know Your Customers - Modern Data Architecture
 
Starting your Cloud Transformation Journey - Tel Aviv Summit 2018
Starting your Cloud Transformation Journey - Tel Aviv Summit 2018Starting your Cloud Transformation Journey - Tel Aviv Summit 2018
Starting your Cloud Transformation Journey - Tel Aviv Summit 2018
 
Starting your Cloud Transformation Journey - Tel Aviv Summit 2018
Starting your Cloud Transformation Journey - Tel Aviv Summit 2018Starting your Cloud Transformation Journey - Tel Aviv Summit 2018
Starting your Cloud Transformation Journey - Tel Aviv Summit 2018
 
The Future of Enterprise IT - Lessons Learned
The Future of Enterprise IT - Lessons LearnedThe Future of Enterprise IT - Lessons Learned
The Future of Enterprise IT - Lessons Learned
 
Build and Innovate with a Modern Data Architecture
Build and Innovate with a Modern Data ArchitectureBuild and Innovate with a Modern Data Architecture
Build and Innovate with a Modern Data Architecture
 
Starting your Cloud Journey - AWSomeDay Israel
Starting your Cloud Journey - AWSomeDay IsraelStarting your Cloud Journey - AWSomeDay Israel
Starting your Cloud Journey - AWSomeDay Israel
 
Starting your cloud journey - AWSomeDay Israel
Starting your cloud journey - AWSomeDay IsraelStarting your cloud journey - AWSomeDay Israel
Starting your cloud journey - AWSomeDay Israel
 
Keynote: AWS Startup Day São Paulo
Keynote: AWS Startup Day São PauloKeynote: AWS Startup Day São Paulo
Keynote: AWS Startup Day São Paulo
 
Real-World AI and Deep Learning for Enterprise with Case Studies
Real-World AI and Deep Learning for Enterprise with Case StudiesReal-World AI and Deep Learning for Enterprise with Case Studies
Real-World AI and Deep Learning for Enterprise with Case Studies
 
BI & Analytics - A Datalake on AWS
BI & Analytics - A Datalake on AWSBI & Analytics - A Datalake on AWS
BI & Analytics - A Datalake on AWS
 
AI and IoT innovation - an industry focus
AI and IoT innovation - an industry focusAI and IoT innovation - an industry focus
AI and IoT innovation - an industry focus
 
Remediate Tech Debt or Drive Innovation - AWS Summit Sydney 2018
Remediate Tech Debt or Drive Innovation - AWS Summit Sydney 2018Remediate Tech Debt or Drive Innovation - AWS Summit Sydney 2018
Remediate Tech Debt or Drive Innovation - AWS Summit Sydney 2018
 
AI/ML with Data Lakes: Counterintuitive Consumer Insights in Retail (RET206) ...
AI/ML with Data Lakes: Counterintuitive Consumer Insights in Retail (RET206) ...AI/ML with Data Lakes: Counterintuitive Consumer Insights in Retail (RET206) ...
AI/ML with Data Lakes: Counterintuitive Consumer Insights in Retail (RET206) ...
 
Enabling New Retail Customer Experiences with Big Data - AWS Online Tech Talks
Enabling New Retail Customer Experiences with Big Data - AWS Online Tech TalksEnabling New Retail Customer Experiences with Big Data - AWS Online Tech Talks
Enabling New Retail Customer Experiences with Big Data - AWS Online Tech Talks
 

Más de Amazon Web Services

Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Amazon Web Services
 
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Amazon Web Services
 
Esegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS FargateEsegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS FargateAmazon Web Services
 
Costruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWSCostruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWSAmazon Web Services
 
Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot Amazon Web Services
 
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Amazon Web Services
 
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...Amazon Web Services
 
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsMicrosoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsAmazon Web Services
 
Database Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatareDatabase Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatareAmazon Web Services
 
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJSCrea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJSAmazon Web Services
 
API moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e webAPI moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e webAmazon Web Services
 
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareDatabase Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareAmazon Web Services
 
Tools for building your MVP on AWS
Tools for building your MVP on AWSTools for building your MVP on AWS
Tools for building your MVP on AWSAmazon Web Services
 
How to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckHow to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckAmazon Web Services
 
Building a web application without servers
Building a web application without serversBuilding a web application without servers
Building a web application without serversAmazon Web Services
 
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...Amazon Web Services
 
Introduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container ServiceIntroduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container ServiceAmazon Web Services
 

Más de Amazon Web Services (20)

Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
 
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
 
Esegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS FargateEsegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS Fargate
 
Costruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWSCostruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWS
 
Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot
 
Open banking as a service
Open banking as a serviceOpen banking as a service
Open banking as a service
 
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
 
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
 
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsMicrosoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
 
Computer Vision con AWS
Computer Vision con AWSComputer Vision con AWS
Computer Vision con AWS
 
Database Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatareDatabase Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatare
 
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJSCrea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
 
API moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e webAPI moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e web
 
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareDatabase Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
 
Tools for building your MVP on AWS
Tools for building your MVP on AWSTools for building your MVP on AWS
Tools for building your MVP on AWS
 
How to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckHow to Build a Winning Pitch Deck
How to Build a Winning Pitch Deck
 
Building a web application without servers
Building a web application without serversBuilding a web application without servers
Building a web application without servers
 
Fundraising Essentials
Fundraising EssentialsFundraising Essentials
Fundraising Essentials
 
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
 
Introduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container ServiceIntroduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container Service
 

Better Business from Exploring Ideas - Modern Data Architectures on AWS

  • 1. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. Vicky Falconer Business Development Manager, Big Data - Amazon Web Services Better Business From Exploring Ideas Modern Data Architectures On AWS
  • 2. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. Let’s go on a Common Customer Journey
  • 3. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. Meet AudibleEars, as they move from B2B to B2C * This case is representative of a common customer journey, but AudibleEars isn’t an actual business AudibleEars manufacturers hearing aids. They ran a traditional business since 2005, selling through distribution channels. 2005 In 2016, they launched their first “AudibleEars App”. The hearing aid comes with the AudibleEars mobile app which enables customized control of the hearing device, voice to text translation, music streaming. The device syncs with the users mobile phone via Bluetooth. The mobile app has optional GPS tracking. 2016
  • 4. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. AudibleEars Needs To Answer New Questions And Move Faster Raymond, Head of ProductLim, Head of Finance Are customers using the new features? What is the demand forecast by product category? What is the social sentiment about our products? How do quality issues impact cost of production? Can I look at supplier performance over time? How can we reduce our inventory holding costs?
  • 5. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. To Answer New Questions Quickly, We Look To A Modern Data Architecture Design Massive upfront costs Overprovisioned capacity Long implementation times Pay as you go, for what you use Decoupled pipelines and engines Experimentation platform Ingest/ Collect Consume/ visualise Store Process/ analyze 1 4 0 9 5
  • 6. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. Outcome 1: Modernise And Consolidate
  • 7. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. Start With A Set Of Specific Questions To Answer, Then Work Backwards To The Data Required Lim, Head of Finance How do quality issues impact cost of production? Can I look at supplier performance over time? How can we reduce our inventory holding costs? Order History / Returns (CRM) Inventory / Production (ERP)
  • 8. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. Ingest ServingData sources Modern Data Architecture Insights to enhance business applications, new digital services Transactions ERP Data analysts DATA PIPELINES Ingest/ Collect Consume / Visualise Store Process / Analyze 1 4 0 9 5
  • 9. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. Start Small and Iterate
  • 10. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. Ingest ServingData sources Modern Data Architecture Insights to enhance business applications, new digital services Transactions ERP DATA PIPELINES Data Lake expdp Data Data analysts Data Warehouse Amazon Redshift Direct Query Amazon Athena She asks for the SMALLEST amount of data to answer her questions. If it isn’t good enough, she asks for another small slice to be loaded to the DATA LAKE
  • 11. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. Amazon Redshift – Modern Data Warehousing Fast, scalable, fully managed data warehouse at 1/10th the cost Massively parallel, scales from gigabytes to exabytes Queries data across your Redshift data warehouse and Amazon S3 data lake Fast at scale Columnar storage technology to improve I/O efficiency and scale query performance Open file formats Analyze optimised data formats on direct- attached disks, and all open file formats in S3 Cost-effective Start at $0.25 per hour; as low as $250-$333 per uncompressed terabyte per year $ Secure Audit everything; encrypt data end-to-end; extensive certification and compliance
  • 12. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. Characteristics Of A Data Lake Future Proof Flexible Access Dive in Anywhere Collect Anything
  • 13. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. Start With A Set Of Specific Questions To Answer, Then Work Backwards To The Data Required Raymond, Head of Product Are customers using the new features? What is the demand forecast by product category? What is the social sentiment about our products? Trending / Mentions (Social) Order History / Returns (CRM) NOW IN THE DATA LAKE
  • 14. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. Experiment, Validate, then Scale
  • 15. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. Ingest ServingData sources Modern Data Architecture Insights to enhance business applications, new digital services DATA PIPELINES Data Lake He first looks to the DATA LAKE, and imports only the category data he needs He imports JUST ENOUGH data to see if the market is responding to products. Business users Transactions ERP Social media Data Stream Capture Amazon Kinesis Events Amazon QuickSight Data Warehouse Amazon Redshift Stream Data Amazon ElasticSearch
  • 16. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. Common Data Pipeline Configuration Raw Data Amazon S3 Highly decoupled configurations scale better, are more fault tolerant, and cost optimised ETL (Hadoop) Amazon EMR Triggered Code Amazon Lambda Staged Data (Data Lake) Amazon S3 ETL & Catalog Management AWS Glue Data Warehouse Amazon Redshift Triggered Code Amazon Lambda
  • 17. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. Data security and management Encryption Access Controls Monitoring and Metrics Audit Trails Automation Serverless Computing Data Discovery and Protection Data Visualisation Data movement Physical Appliances Hybrid Storage Private Networks File Data WAN Acceleration Third-party Applications Streaming Data Complete Set Of Building Blocks FileBlock Object Archival Storage types
  • 18. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. Ingest ServingData sources Modern Data Architecture Insights to enhance business applications, new digital services Transactions ERP Data analysts Business users DATA PIPELINES EVENT PIPELINES Data Event Insights Data Lake Social media
  • 19. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. Outcome 2: Innovate For New Insight
  • 20. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. AudibleEars Has Its First Direct Relationship With Consumers Krzysztof, Data ScientistBala, Head of Research & Development What are our customer segments, based on usage? Can we predict changes to hearing loss from usage of the app? Can we give a better customer experience, for example optimised settings, based on signals? How are consumers using the hearing aids? When do they turn them off? How are they altering the settings throughout the day? What kinds of people are in/decreasing usage?
  • 21. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. Start With A Set Of Specific Questions To Answer, Then Work Backwards To The Data Required Media consumption (Partner API) Registration, usage [time/place] (Mobile app) Bala, Head of Research & Development How are consumers using the hearing aids? When do they turn them off? How are they altering the settings throughout the day? What kinds of people are in/decreasing usage?
  • 22. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. Start With A Set Of Specific Questions To Answer, Then Work Backwards To The Data Required Krzysztof, Data Scientist Voice to text, GPS DATA LAKE, OR NOT? Registration, usage [time/place] (Mobile app) LOAD TO DATA LAKE What are our customer segments, based on usage? Can we predict changes to hearing loss from usage of the app? Can we give a better customer experience, for example optimised settings, based on signals?
  • 23. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. Sandboxes - Fast, Cheap, Low Risk
  • 24. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. Ingest ServingData sources Transactions Data scientists Business users Connected devices DATA PIPELINES EVENT PIPELINES Data Event Insights Data Lake Sandbox ML / Analytics / DLWeb logs / clickstream Modern Data Architecture Insights to enhance business applications, new digital services
  • 25. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. Ingest ServingData sources Modern Data Architecture Innovate for new revenues - personalisation and forecasting Transactions ERP Data analysts Data scientists Business users Connected devices DATA PIPELINES EVENT PIPELINES Data Event Insights Data Lake ML / Analytics Social media Web logs / clickstream
  • 26. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. Outcome 3: Real-Time Engagement
  • 27. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. AudibleEars Offers A Personalised Life Soundtrack Personalised, based on past preferences, people with similar behaviors, and environments detected
  • 28. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. Use AudibleEars Voice Enablement To Recommend Settings What are the best settings for watching a play? Amazon Transcribe / Comprehend Action: <RECOMMEND> Category: THEATRE Request settings HISTORY RECOMMENDATION! PEOPLE LIKE YOU Amazon Kinesis Streams Connected device data Location: <FIND GPS> Ambient Noise: <FIND Noise>
  • 29. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. Ingest ServingData sources Modern Data Architecture Real-time engagement and interactive customer experiences Transactions ERP Data analysts Data scientists Business users Engagement platformsConnected devices Automation / events DATA PIPELINES EVENT PIPELINES Data Event Action Insights Data Lake ML / Analytics Predict / Recommend AI Services Social media Web logs / clickstream
  • 30. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. Business Outcomes on a Modern Data Architecture Outcome 1 : Modernise and consolidate • Insights to enhance business applications and create new digital services Outcome 2 : Innovate for new insights • Personalisation, demand forecasting, risk analysis Outcome 3 : Real-time engagement • Interactive customer experience, event-driven automation, fraud detection
  • 31. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. Ready to build better business from your ideas? Short list projects that directly impact customer engagement and adoption Build simple data pipelines that allow you to test new ideas, and fill your data lake Ask our solution architects and professional services teams to help you build