SlideShare una empresa de Scribd logo
1 de 14
DATA TRANSFORMATION AND REPORTING FOR YOUR
AMAZON REDSHIFT
▪ www.holistics.io
THE DISRUPTION OF AMAZON REDSHIFT
Source: Amazon Redshift
A fast and powerful, petabyte-scale data warehouse that is:
A Lot Faster
A Lot Cheaper
A Lot Simpler
Runs on SQL
TYPICAL REDSHIFT USE-CASE
▪ Data from production databases and
other sources are imported into Amazon
Redshift on an hourly/daily basis
▪ Data then gets aggregated, summarized,
and derived inside Amazon Redshift
▪ The transformed data is then being
analyzed, explored and presented to
business users through some internal
web interfaces.
TRANSFORM
USER 1 USER 2 USER 3
Event Based
Data
Third Party
APIs
Production
DBs
IMPORT
PRESENT
CHALLENGES FOR REDSHIFT USERS
Data Import
▪ Write script to load data into Redshift (split data,
upload into S3, load into tables)
▪ Manually manage & performance-tune Redshift
tables (sortkeys, distkey, compression types)
Data Transformation:
▪ Write scripts to create aggregated/summarized
tables from existing tables
▪ Manage the scheduling of the tasks
Data Extraction:
▪ Spend time building web interface front-end to
present data
▪ Spend time extracting and emailing data to users
TRANSFORM
USER 1 USER 2 USER 3
Event Based
Data
Third Party
APIs
Production
DBs
IMPORT
PRESENT
THE HOLISTICS APPROACH
HOLISTICS DATA PRESENTATION AND EXPLORATION
Access Control
Report Filters
Audit Trails
Report Charts
Report Dashboards
Pivot Table
HOLISTICS REDSHIFT IN-MEMORY DATA TRANSFORMATION
Aggregation
Materialization
HOLISTICS DATA INGESTION (Source Data)
Import Production Databases
Import Spreadsheet from Users
Import
Transform
Present Report Creation
Scheduled Emails
Annotations
An end-to-end UI on top of Amazon Redshift to
manage your entire data pipeline process.
Summarization
Icon made by Freepik from www.flaticon.com
FEATURES HIGHLIGHTS
▪ Imports:
▪ Loading of production databases (PostgreSQL) into Redshift
▪ Uploading of user-generated data (CSV, Excel) into Redshift
▪ Manage & Transformations:
▪ Scheduled transformations within Redshift
▪ Manage Redshift tables with simple UI
▪ Reporting & Presentation:
▪ SQL-friendly reports & dashboards, KPI reporting
▪ Annotations
▪ Self-serving Pivot Table
▪ Automated report emails
▪ Powerful Access Control Management
FEATURES – BY ROLE
▪ Analysts & Admins:
▪ Flexible report creations: Create reports, charts and dashboards for business users (using
SQL)
▪ Data transformations: create and manage scheduled aggregations within Redshift
▪ Business Users:
▪ View Reports: Browse and view reports
▪ Schedule report emails: receive regular report updates via emails
▪ Custom Data Uploads: Get custom data (Excel, CSV) into Redshift
▪ Pivot Table: Explore and interact with prepared data-sets
HIGHLIGHTS & BENEFITS
1. Focus on your core activities
2. Runs on SQL
3. Powerful Data Access Control
4. Fully Utilize Power of Amazon Redshift
5. Cost-effective
FOCUS ON YOUR CORE ACTIVITIES
▪ Engineers working on core product development instead of peripheral
reporting tools
▪ Analysts spend more time providing new insights into data, and less time on
manual repetitive information requests from users.
▪ Business users spend less time waiting for information and more time
exploring what they need.
RUNS ON SQL
▪For Report Creation
▪ Friendly for novice SQL analysts to create simple reports
▪ Flexible for power SQL analysts to create complex reports
▪ Easy to hire and train new analysts
▪Extended syntax to complement SQL
▪ Report Filters
▪ Advanced data access control
FLEXIBLE AND POWERFUL DATA ACCESS CONTROL
▪Works well for any combination of user group permissions
▪Assign up to 5 levels of data access control
▪ Data Source Level
▪ User Level
▪ User Group Level
▪ Column Level
▪ Row Level
GET MORE OUT OF REDSHIFT
▪ Cost-saving: Direct your investment into Redshift to get you the highest
performance per dollar for your analytics infrastructure
▪ Maximize resources utilizations: Fully leverage on the in-memory processing
power of Redshift to run your data transformation and queries activities
▪ Simple UI: User interface to help simplify management of your data pipeline
activities with Redshift
▪ No need to move your data outside of Redshift
COST-EFFECTIVE
▪ Computing resources costs for your BI tool (CPU, Memory)
▪ Cost of storage in your BI tool for data that is already in Redshift
▪ Cost of training and hiring for specific BI skill-sets
www.holistics.io
THANK YOU

Más contenido relacionado

Último

FESE Capital Markets Fact Sheet 2024 Q1.pdf
FESE Capital Markets Fact Sheet 2024 Q1.pdfFESE Capital Markets Fact Sheet 2024 Q1.pdf
FESE Capital Markets Fact Sheet 2024 Q1.pdfMarinCaroMartnezBerg
 
Mature dropshipping via API with DroFx.pptx
Mature dropshipping via API with DroFx.pptxMature dropshipping via API with DroFx.pptx
Mature dropshipping via API with DroFx.pptxolyaivanovalion
 
Chintamani Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore ...
Chintamani Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore ...Chintamani Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore ...
Chintamani Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore ...amitlee9823
 
Halmar dropshipping via API with DroFx
Halmar  dropshipping  via API with DroFxHalmar  dropshipping  via API with DroFx
Halmar dropshipping via API with DroFxolyaivanovalion
 
Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...ZurliaSoop
 
Discover Why Less is More in B2B Research
Discover Why Less is More in B2B ResearchDiscover Why Less is More in B2B Research
Discover Why Less is More in B2B Researchmichael115558
 
CebaBaby dropshipping via API with DroFX.pptx
CebaBaby dropshipping via API with DroFX.pptxCebaBaby dropshipping via API with DroFX.pptx
CebaBaby dropshipping via API with DroFX.pptxolyaivanovalion
 
Smarteg dropshipping via API with DroFx.pptx
Smarteg dropshipping via API with DroFx.pptxSmarteg dropshipping via API with DroFx.pptx
Smarteg dropshipping via API with DroFx.pptxolyaivanovalion
 
Call Girls Bommasandra Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
Call Girls Bommasandra Just Call 👗 7737669865 👗 Top Class Call Girl Service B...Call Girls Bommasandra Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
Call Girls Bommasandra Just Call 👗 7737669865 👗 Top Class Call Girl Service B...amitlee9823
 
Capstone Project on IBM Data Analytics Program
Capstone Project on IBM Data Analytics ProgramCapstone Project on IBM Data Analytics Program
Capstone Project on IBM Data Analytics ProgramMoniSankarHazra
 
Ravak dropshipping via API with DroFx.pptx
Ravak dropshipping via API with DroFx.pptxRavak dropshipping via API with DroFx.pptx
Ravak dropshipping via API with DroFx.pptxolyaivanovalion
 
Call Girls in Sarai Kale Khan Delhi 💯 Call Us 🔝9205541914 🔝( Delhi) Escorts S...
Call Girls in Sarai Kale Khan Delhi 💯 Call Us 🔝9205541914 🔝( Delhi) Escorts S...Call Girls in Sarai Kale Khan Delhi 💯 Call Us 🔝9205541914 🔝( Delhi) Escorts S...
Call Girls in Sarai Kale Khan Delhi 💯 Call Us 🔝9205541914 🔝( Delhi) Escorts S...Delhi Call girls
 
Cheap Rate Call girls Sarita Vihar Delhi 9205541914 shot 1500 night
Cheap Rate Call girls Sarita Vihar Delhi 9205541914 shot 1500 nightCheap Rate Call girls Sarita Vihar Delhi 9205541914 shot 1500 night
Cheap Rate Call girls Sarita Vihar Delhi 9205541914 shot 1500 nightDelhi Call girls
 
Call Girls Begur Just Call 👗 7737669865 👗 Top Class Call Girl Service Bangalore
Call Girls Begur Just Call 👗 7737669865 👗 Top Class Call Girl Service BangaloreCall Girls Begur Just Call 👗 7737669865 👗 Top Class Call Girl Service Bangalore
Call Girls Begur Just Call 👗 7737669865 👗 Top Class Call Girl Service Bangaloreamitlee9823
 
Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...
Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...
Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...Valters Lauzums
 
April 2024 - Crypto Market Report's Analysis
April 2024 - Crypto Market Report's AnalysisApril 2024 - Crypto Market Report's Analysis
April 2024 - Crypto Market Report's Analysismanisha194592
 
Call Girls In Bellandur ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Bellandur ☎ 7737669865 🥵 Book Your One night StandCall Girls In Bellandur ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Bellandur ☎ 7737669865 🥵 Book Your One night Standamitlee9823
 
Escorts Service Kumaraswamy Layout ☎ 7737669865☎ Book Your One night Stand (B...
Escorts Service Kumaraswamy Layout ☎ 7737669865☎ Book Your One night Stand (B...Escorts Service Kumaraswamy Layout ☎ 7737669865☎ Book Your One night Stand (B...
Escorts Service Kumaraswamy Layout ☎ 7737669865☎ Book Your One night Stand (B...amitlee9823
 

Último (20)

(NEHA) Call Girls Katra Call Now 8617697112 Katra Escorts 24x7
(NEHA) Call Girls Katra Call Now 8617697112 Katra Escorts 24x7(NEHA) Call Girls Katra Call Now 8617697112 Katra Escorts 24x7
(NEHA) Call Girls Katra Call Now 8617697112 Katra Escorts 24x7
 
FESE Capital Markets Fact Sheet 2024 Q1.pdf
FESE Capital Markets Fact Sheet 2024 Q1.pdfFESE Capital Markets Fact Sheet 2024 Q1.pdf
FESE Capital Markets Fact Sheet 2024 Q1.pdf
 
Mature dropshipping via API with DroFx.pptx
Mature dropshipping via API with DroFx.pptxMature dropshipping via API with DroFx.pptx
Mature dropshipping via API with DroFx.pptx
 
Chintamani Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore ...
Chintamani Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore ...Chintamani Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore ...
Chintamani Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore ...
 
CHEAP Call Girls in Saket (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Saket (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICECHEAP Call Girls in Saket (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Saket (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
 
Halmar dropshipping via API with DroFx
Halmar  dropshipping  via API with DroFxHalmar  dropshipping  via API with DroFx
Halmar dropshipping via API with DroFx
 
Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
 
Discover Why Less is More in B2B Research
Discover Why Less is More in B2B ResearchDiscover Why Less is More in B2B Research
Discover Why Less is More in B2B Research
 
CebaBaby dropshipping via API with DroFX.pptx
CebaBaby dropshipping via API with DroFX.pptxCebaBaby dropshipping via API with DroFX.pptx
CebaBaby dropshipping via API with DroFX.pptx
 
Smarteg dropshipping via API with DroFx.pptx
Smarteg dropshipping via API with DroFx.pptxSmarteg dropshipping via API with DroFx.pptx
Smarteg dropshipping via API with DroFx.pptx
 
Call Girls Bommasandra Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
Call Girls Bommasandra Just Call 👗 7737669865 👗 Top Class Call Girl Service B...Call Girls Bommasandra Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
Call Girls Bommasandra Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
 
Capstone Project on IBM Data Analytics Program
Capstone Project on IBM Data Analytics ProgramCapstone Project on IBM Data Analytics Program
Capstone Project on IBM Data Analytics Program
 
Ravak dropshipping via API with DroFx.pptx
Ravak dropshipping via API with DroFx.pptxRavak dropshipping via API with DroFx.pptx
Ravak dropshipping via API with DroFx.pptx
 
Call Girls in Sarai Kale Khan Delhi 💯 Call Us 🔝9205541914 🔝( Delhi) Escorts S...
Call Girls in Sarai Kale Khan Delhi 💯 Call Us 🔝9205541914 🔝( Delhi) Escorts S...Call Girls in Sarai Kale Khan Delhi 💯 Call Us 🔝9205541914 🔝( Delhi) Escorts S...
Call Girls in Sarai Kale Khan Delhi 💯 Call Us 🔝9205541914 🔝( Delhi) Escorts S...
 
Cheap Rate Call girls Sarita Vihar Delhi 9205541914 shot 1500 night
Cheap Rate Call girls Sarita Vihar Delhi 9205541914 shot 1500 nightCheap Rate Call girls Sarita Vihar Delhi 9205541914 shot 1500 night
Cheap Rate Call girls Sarita Vihar Delhi 9205541914 shot 1500 night
 
Call Girls Begur Just Call 👗 7737669865 👗 Top Class Call Girl Service Bangalore
Call Girls Begur Just Call 👗 7737669865 👗 Top Class Call Girl Service BangaloreCall Girls Begur Just Call 👗 7737669865 👗 Top Class Call Girl Service Bangalore
Call Girls Begur Just Call 👗 7737669865 👗 Top Class Call Girl Service Bangalore
 
Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...
Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...
Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...
 
April 2024 - Crypto Market Report's Analysis
April 2024 - Crypto Market Report's AnalysisApril 2024 - Crypto Market Report's Analysis
April 2024 - Crypto Market Report's Analysis
 
Call Girls In Bellandur ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Bellandur ☎ 7737669865 🥵 Book Your One night StandCall Girls In Bellandur ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Bellandur ☎ 7737669865 🥵 Book Your One night Stand
 
Escorts Service Kumaraswamy Layout ☎ 7737669865☎ Book Your One night Stand (B...
Escorts Service Kumaraswamy Layout ☎ 7737669865☎ Book Your One night Stand (B...Escorts Service Kumaraswamy Layout ☎ 7737669865☎ Book Your One night Stand (B...
Escorts Service Kumaraswamy Layout ☎ 7737669865☎ Book Your One night Stand (B...
 

Destacado

AI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdfAI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdfmarketingartwork
 
PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024Neil Kimberley
 
Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)contently
 
How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024Albert Qian
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsKurio // The Social Media Age(ncy)
 
Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Search Engine Journal
 
5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summarySpeakerHub
 
ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd Clark Boyd
 
Getting into the tech field. what next
Getting into the tech field. what next Getting into the tech field. what next
Getting into the tech field. what next Tessa Mero
 
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentGoogle's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentLily Ray
 
Time Management & Productivity - Best Practices
Time Management & Productivity -  Best PracticesTime Management & Productivity -  Best Practices
Time Management & Productivity - Best PracticesVit Horky
 
The six step guide to practical project management
The six step guide to practical project managementThe six step guide to practical project management
The six step guide to practical project managementMindGenius
 
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...RachelPearson36
 
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...Applitools
 
12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at Work12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at WorkGetSmarter
 

Destacado (20)

AI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdfAI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
 
Skeleton Culture Code
Skeleton Culture CodeSkeleton Culture Code
Skeleton Culture Code
 
PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024
 
Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)
 
How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie Insights
 
Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024
 
5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary
 
ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd
 
Getting into the tech field. what next
Getting into the tech field. what next Getting into the tech field. what next
Getting into the tech field. what next
 
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentGoogle's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search Intent
 
How to have difficult conversations
How to have difficult conversations How to have difficult conversations
How to have difficult conversations
 
Introduction to Data Science
Introduction to Data ScienceIntroduction to Data Science
Introduction to Data Science
 
Time Management & Productivity - Best Practices
Time Management & Productivity -  Best PracticesTime Management & Productivity -  Best Practices
Time Management & Productivity - Best Practices
 
The six step guide to practical project management
The six step guide to practical project managementThe six step guide to practical project management
The six step guide to practical project management
 
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
 
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
 
12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at Work12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at Work
 
ChatGPT webinar slides
ChatGPT webinar slidesChatGPT webinar slides
ChatGPT webinar slides
 
More than Just Lines on a Map: Best Practices for U.S Bike Routes
More than Just Lines on a Map: Best Practices for U.S Bike RoutesMore than Just Lines on a Map: Best Practices for U.S Bike Routes
More than Just Lines on a Map: Best Practices for U.S Bike Routes
 

Holistics for Amazon Redshift

  • 1. DATA TRANSFORMATION AND REPORTING FOR YOUR AMAZON REDSHIFT ▪ www.holistics.io
  • 2. THE DISRUPTION OF AMAZON REDSHIFT Source: Amazon Redshift A fast and powerful, petabyte-scale data warehouse that is: A Lot Faster A Lot Cheaper A Lot Simpler Runs on SQL
  • 3. TYPICAL REDSHIFT USE-CASE ▪ Data from production databases and other sources are imported into Amazon Redshift on an hourly/daily basis ▪ Data then gets aggregated, summarized, and derived inside Amazon Redshift ▪ The transformed data is then being analyzed, explored and presented to business users through some internal web interfaces. TRANSFORM USER 1 USER 2 USER 3 Event Based Data Third Party APIs Production DBs IMPORT PRESENT
  • 4. CHALLENGES FOR REDSHIFT USERS Data Import ▪ Write script to load data into Redshift (split data, upload into S3, load into tables) ▪ Manually manage & performance-tune Redshift tables (sortkeys, distkey, compression types) Data Transformation: ▪ Write scripts to create aggregated/summarized tables from existing tables ▪ Manage the scheduling of the tasks Data Extraction: ▪ Spend time building web interface front-end to present data ▪ Spend time extracting and emailing data to users TRANSFORM USER 1 USER 2 USER 3 Event Based Data Third Party APIs Production DBs IMPORT PRESENT
  • 5. THE HOLISTICS APPROACH HOLISTICS DATA PRESENTATION AND EXPLORATION Access Control Report Filters Audit Trails Report Charts Report Dashboards Pivot Table HOLISTICS REDSHIFT IN-MEMORY DATA TRANSFORMATION Aggregation Materialization HOLISTICS DATA INGESTION (Source Data) Import Production Databases Import Spreadsheet from Users Import Transform Present Report Creation Scheduled Emails Annotations An end-to-end UI on top of Amazon Redshift to manage your entire data pipeline process. Summarization Icon made by Freepik from www.flaticon.com
  • 6. FEATURES HIGHLIGHTS ▪ Imports: ▪ Loading of production databases (PostgreSQL) into Redshift ▪ Uploading of user-generated data (CSV, Excel) into Redshift ▪ Manage & Transformations: ▪ Scheduled transformations within Redshift ▪ Manage Redshift tables with simple UI ▪ Reporting & Presentation: ▪ SQL-friendly reports & dashboards, KPI reporting ▪ Annotations ▪ Self-serving Pivot Table ▪ Automated report emails ▪ Powerful Access Control Management
  • 7. FEATURES – BY ROLE ▪ Analysts & Admins: ▪ Flexible report creations: Create reports, charts and dashboards for business users (using SQL) ▪ Data transformations: create and manage scheduled aggregations within Redshift ▪ Business Users: ▪ View Reports: Browse and view reports ▪ Schedule report emails: receive regular report updates via emails ▪ Custom Data Uploads: Get custom data (Excel, CSV) into Redshift ▪ Pivot Table: Explore and interact with prepared data-sets
  • 8. HIGHLIGHTS & BENEFITS 1. Focus on your core activities 2. Runs on SQL 3. Powerful Data Access Control 4. Fully Utilize Power of Amazon Redshift 5. Cost-effective
  • 9. FOCUS ON YOUR CORE ACTIVITIES ▪ Engineers working on core product development instead of peripheral reporting tools ▪ Analysts spend more time providing new insights into data, and less time on manual repetitive information requests from users. ▪ Business users spend less time waiting for information and more time exploring what they need.
  • 10. RUNS ON SQL ▪For Report Creation ▪ Friendly for novice SQL analysts to create simple reports ▪ Flexible for power SQL analysts to create complex reports ▪ Easy to hire and train new analysts ▪Extended syntax to complement SQL ▪ Report Filters ▪ Advanced data access control
  • 11. FLEXIBLE AND POWERFUL DATA ACCESS CONTROL ▪Works well for any combination of user group permissions ▪Assign up to 5 levels of data access control ▪ Data Source Level ▪ User Level ▪ User Group Level ▪ Column Level ▪ Row Level
  • 12. GET MORE OUT OF REDSHIFT ▪ Cost-saving: Direct your investment into Redshift to get you the highest performance per dollar for your analytics infrastructure ▪ Maximize resources utilizations: Fully leverage on the in-memory processing power of Redshift to run your data transformation and queries activities ▪ Simple UI: User interface to help simplify management of your data pipeline activities with Redshift ▪ No need to move your data outside of Redshift
  • 13. COST-EFFECTIVE ▪ Computing resources costs for your BI tool (CPU, Memory) ▪ Cost of storage in your BI tool for data that is already in Redshift ▪ Cost of training and hiring for specific BI skill-sets

Notas del editor

  1. In February 2013, Amazon launched Amazon Redshift, a fast, cheap and fully-managed data warehouse that makes it simple and cost-effect to store and analyze all your data with existing business intelligence tools. Since then, the its growth has been phenomenal, companies have been on-boarding Amazon Redshift into their data platforms. Companies (especially technology startups) now can have a data-warehouse of their own for less than US$1000/TB/year
  2. Icon made by Freepik from www.flaticon.com