SlideShare una empresa de Scribd logo
1 de 28
Kyligence Cloud 4 – An Overview
George Demarest
Head of Marketing
george.demarest@kyligence.io
Li Kang
VP, North America
li.kang@kyligence.io
Agenda
 Introduction to Kyligence
 Announcement: Kyligence Cloud 4
 Kyligence Innovations
 Use Cases and Successes
 Demonstration
© Kyligence Inc. 2021, Confidential.
Three Pillars of Modern Cloud Analytics
Distributed Compute Columnar Storage Precomputation
© Kyligence Inc. 2021, Confidential.
MPP Queries – Slow and Costly in the Cloud
Common to Greenplum, Snowflake, Synapse, Redshift
Data Volume /
$$$
Resource
Consumption
Runtime Computation
MPP Engines : Runtime Computation
Data
Concurrency
© Kyligence Inc. 2021, Confidential.
OLAP Precomputation - Faster and Cheaper in the Cloud
Q: How many laptops were sold in Los Angeles in June?
An Aggregate Index (a.k.a. Cube)
Precomputation – Compute Once, Query Many Times
Data
Data Volume /
$$$
Resource
Consumption
Runtime Computation
Concurrency
Precomputation
© Kyligence Inc. 2021, Confidential.
Apache Kylin
Top Level Project
 The only open-source OLAP
technology on big data platform
AwardWinning
 InfoWorld’s Bossies 2015 & 2016
(Best of Open-Source Software Awards)
Sub-Second Interactive Query
 Large scale, high concurrency, multi-
dimensional, sub-second query latency
1,000+ Organizations
 Adopted by thousands of
organizations globally
© Kyligence Inc. 2021, Confidential.
Kyligence: Kylin + Intelligence
• Founded in 2016 by the creators of Apache Kylin
• Enhances Kylin with AI-assisted auto-modeling, Unified Semantic
Layer for leading BI tools
• CRN Top-10 big data startups in 2018
• Global Presence: San Jose, Seattle, New York, Shanghai, Beijing
• VCs: Fidelity International, Shunwei Capital, Broadband Capital,
Redpoint, Cisco, Coatue
2016
Pre-A
Redpoint
Cisco
2017
Series A
CBC
Shunwei
2018
Series B
8Roads
2019
Series C
Coatue
© Kyligence Inc. 2021, Confidential.
Kyligence in Action
Migrated 1,200+ Cognos
cubes to 2 Kyligence cubes
360º real-time view of spend
insights for finance teams
Migrated 2nd largest SSAS
deployment to Kyligence/Azure
Top 10 Global
Investment Bank
US FinTech
SaaS Provider
World’s Largest
Credit/Debit Card Network
Results:
 95% queries < 2s
 100+ concurrent users
Results:
 500X improved efficiency
 10X faster + more stable analytics
Results:
 Single, 100+ TB distributed
Kyligence cube
© Kyligence Inc. 2021, Confidential.
Trusted by Global Fortune 500
Banking & Finance
Telecom
Technology
CPG & Retail
© Kyligence Inc. 2021, Confidential.
Announced Jan. 21
Kyligence Cloud 4
The First Cloud-Native OLAP Platform
Cloud-native architecture Elasticity, separate compute from storage
Cloud immediacy Deploys in minutes, on AWS/Azure marketplace
Enhanced AI engine Auto-modeling, self-tuning cubes/indexes
Unified Semantic Model MDX, SQL, REST access transparent to BI users
© Kyligence Inc. 2021, Confidential.
Kyligence Cloud Architecture
Unified Semantic Layer
Data as a Service
Machine Learning
Data as a Service
SaaS & Apps
CRM HCM
SCM
Low Latency Queries
Any BI Tool
Any Cloud
Any Data Platform
Data Warehouse
Streaming Data
Data Lake
AI Augmented Engine
Precomputation Layer
Distributed Cubes
& Table Indexes
Multi-dimensional
Modeling
Security &
Governance
Finance
Marketing
Sales
© Kyligence Inc. 2021, Confidential.
Cloud Native Architecture
Separation of compute and
storage
• Spark compute cluster
• Shared cloud object storage
• Scale and optimize separately for best
results and price performance
• Continuity: build cluster separate from – and
doesn’t disrupt – query cluster
Removed legacy Hadoop requirement
• MapReduce, HDFS, HBase
Spark Cubing Persisted in Parquet format,
Optimized for Cloud Storage
High performance components
• Cubing with Spark, stored as Parquet
• All tasks are executed in memory with Spark
- cubing, querying, modeling, aggregation
• Cubes and indexes saved in Parquet
© Kyligence Inc. 2021, Confidential.
Precomputing Everything Isn’t Practical
Precomputation
Total Indexes = 2 ^ Number of dimensions - 1
© Kyligence Inc. 2021, Confidential.
Precomputing Everything Isn’t Practical
Challenge
• 50 dimensions => 1.2T Indexes
• Today, 100+ dimensions are possible
• Cost is always critical
Solution
• AI-brokered compromise
© Kyligence Inc. 2021, Confidential.
AI-Assisted Cubing and Auto-Modeling
Model Training
Pre-aggregation
Data Processing
Auto-Generate
Cube & Index
AI-Augmented
Engine
Self-training
Group wisdom
Queries across the org
ingested as input
Benefits
- Continuous model improvement without
human intervention
- Greater user satisfaction
© Kyligence Inc. 2021, Confidential.
Intelligent Query Routing
With Smart Pushdown™
Goal:
• Cubes: maximize query hits on
precomputed results
• Table Indexes: precompute
detailed/ad-hoc queries if possible
• Intelligent pushdown if not
Total Freedom for BI users to slice
and dice, drill down, roll up, etc.
Seconds to Minutes
Smart Pushdown™
Kyligence
millions of queries/day
© Kyligence Inc. 2021, Confidential.
Unified Semantic Layer
 ​From technical details to
business contexts
 Consistent semantics across
all major BI tools
 Centralized access control
 Advanced business
definitions and logic
© Kyligence Inc. 2021, Confidential.
Case Study: UnionPay – Modernize Traditional OLAP
World’s largest debit/credit card issuer
Results
 500x improvement in maintenance efficiency
 10x faster with greater stability
 Time to insight: less than 4 hours
 Significant TCO reduction
Solution
 Replaced Cognos backend with Kyligence
 Consolidated 1,200 cubes to 2
 Retained Cognos reporting frontend
Challenge
 1,200+ existing Cognos cubes to manage
 1,000+ ETL jobs to maintain
 Time to insight: over 4 days
Backend migrated to
2 Kyligence cubes
© Kyligence Inc. 2021, Confidential.
Case Study: UnionPay – Modernize Traditional OLAP
World’s largest debit/credit card issuer
Blog
eBook
© Kyligence Inc. 2021, Confidential.
Case Study: US Wealth Management – OLAP Cloud Migration
 Challenges
 Microsoft SSAS reaching practical limits
 Many TB OLAP Cube, 350B rows
 Query latencies unacceptable for dashboards
 MDX queries 20 secs – 60+ secs
 SQL queries 5 secs – 10+ secs
 Hampered analyst productivity
 Slow load times
 Duplicate/derived cubes: duplicate effort
 Solution
 Redeploy to Azure/Kyligence
 Same data sources, same BI tools
 80+% query latencies < 1 sec
© Kyligence Inc. 2021, Confidential.
Case Study: US AI Fintech Vendor – Self-Service Cloud Analytics
 SaaS vendors sit on top of a large
amount of transaction data
 Provide business insights and industry
benchmarks as an add-on product
subscription
 Challenges are performance,
concurrency, and cost
 Fixed cloud infrastructure cost while
# of users/queries grow
 Not possible with Cloud DWs
© Kyligence Inc. 2021, Confidential.
Use Case – Cloud Data Warehouse Enhancements
 Improved query performances
 Cost reduction by 10x
 Support 100s of users is very expensive on Snowflake
 Every query / compute causes charges
 Excel pivot table support
 Target prospects
 Snowflake customers
 Large dataset and/or large # of users
 Prefer to use Excel pivot table
Demo
Demo
© Kyligence Inc. 2021, Confidential.
Kyligence Cloud 4
The First Cloud-Native OLAP Platform
Cloud-native architecture Elasticity, separate compute from storage
Cloud immediacy Deploys in minutes, on AWS/Azure marketplace
Enhanced AI engine Auto-modeling, self-tuning cubes/indexes
Unified Semantic Model MDX, SQL, REST access transparent to BI users
© Kyligence Inc. 2021, Confidential.
Contact Us
Kyligence Inc
 http://kyligence.io
 info@kyligence.io
 Twitter: @Kyligence
Apache Kylin
 http://kylin.apache.org
 dev@kylin.apache.org
 Twitter: @ApacheKylin
© Kyligence Inc. 2021, Confidential.
© Kyligence Inc. 2021, Confidential.
Solution: Kyligence Pivot to Snowflake
© Kyligence Inc. 2021, Confidential.
Kyligence Pivot to Snowflake Architecture
• Leverage MDX for semantic consistency
• Seamless user experience
• Zero client configuration
• Calculate once, consume many
• Supports AWS and Azure
Database Events Files IoT
Unified Semantic Layer
MDX
Engine
Access
Control
Enterprise
Security
Query
Pushdown

Más contenido relacionado

La actualidad más candente

Simplified Machine Learning Architecture with an Event Streaming Platform (Ap...
Simplified Machine Learning Architecture with an Event Streaming Platform (Ap...Simplified Machine Learning Architecture with an Event Streaming Platform (Ap...
Simplified Machine Learning Architecture with an Event Streaming Platform (Ap...
Kai Wähner
 
Teradata vs-exadata
Teradata vs-exadataTeradata vs-exadata
Teradata vs-exadata
Louis liu
 

La actualidad más candente (20)

SeaweedFS introduction
SeaweedFS introductionSeaweedFS introduction
SeaweedFS introduction
 
Programming in Spark using PySpark
Programming in Spark using PySpark      Programming in Spark using PySpark
Programming in Spark using PySpark
 
[DSC Europe 22] Lakehouse architecture with Delta Lake and Databricks - Draga...
[DSC Europe 22] Lakehouse architecture with Delta Lake and Databricks - Draga...[DSC Europe 22] Lakehouse architecture with Delta Lake and Databricks - Draga...
[DSC Europe 22] Lakehouse architecture with Delta Lake and Databricks - Draga...
 
Kafka for Real-Time Replication between Edge and Hybrid Cloud
Kafka for Real-Time Replication between Edge and Hybrid CloudKafka for Real-Time Replication between Edge and Hybrid Cloud
Kafka for Real-Time Replication between Edge and Hybrid Cloud
 
Simplified Machine Learning Architecture with an Event Streaming Platform (Ap...
Simplified Machine Learning Architecture with an Event Streaming Platform (Ap...Simplified Machine Learning Architecture with an Event Streaming Platform (Ap...
Simplified Machine Learning Architecture with an Event Streaming Platform (Ap...
 
The evolution of Netflix's S3 data warehouse (Strata NY 2018)
The evolution of Netflix's S3 data warehouse (Strata NY 2018)The evolution of Netflix's S3 data warehouse (Strata NY 2018)
The evolution of Netflix's S3 data warehouse (Strata NY 2018)
 
Exactly-Once Financial Data Processing at Scale with Flink and Pinot
Exactly-Once Financial Data Processing at Scale with Flink and PinotExactly-Once Financial Data Processing at Scale with Flink and Pinot
Exactly-Once Financial Data Processing at Scale with Flink and Pinot
 
Databricks Delta Lake and Its Benefits
Databricks Delta Lake and Its BenefitsDatabricks Delta Lake and Its Benefits
Databricks Delta Lake and Its Benefits
 
Understanding Query Plans and Spark UIs
Understanding Query Plans and Spark UIsUnderstanding Query Plans and Spark UIs
Understanding Query Plans and Spark UIs
 
Next generation business automation with the red hat decision manager and red...
Next generation business automation with the red hat decision manager and red...Next generation business automation with the red hat decision manager and red...
Next generation business automation with the red hat decision manager and red...
 
Partner Briefing_January 25 (FINAL).pptx
Partner Briefing_January 25 (FINAL).pptxPartner Briefing_January 25 (FINAL).pptx
Partner Briefing_January 25 (FINAL).pptx
 
Presto: Optimizing Performance of SQL-on-Anything Engine
Presto: Optimizing Performance of SQL-on-Anything EnginePresto: Optimizing Performance of SQL-on-Anything Engine
Presto: Optimizing Performance of SQL-on-Anything Engine
 
Machine Learning Data Lineage with MLflow and Delta Lake
Machine Learning Data Lineage with MLflow and Delta LakeMachine Learning Data Lineage with MLflow and Delta Lake
Machine Learning Data Lineage with MLflow and Delta Lake
 
Teradata vs-exadata
Teradata vs-exadataTeradata vs-exadata
Teradata vs-exadata
 
Developing Active-Active Geo-Distributed Apps with Redis
Developing Active-Active Geo-Distributed Apps with RedisDeveloping Active-Active Geo-Distributed Apps with Redis
Developing Active-Active Geo-Distributed Apps with Redis
 
Real Time Analytics: Algorithms and Systems
Real Time Analytics: Algorithms and SystemsReal Time Analytics: Algorithms and Systems
Real Time Analytics: Algorithms and Systems
 
How to build a streaming Lakehouse with Flink, Kafka, and Hudi
How to build a streaming Lakehouse with Flink, Kafka, and HudiHow to build a streaming Lakehouse with Flink, Kafka, and Hudi
How to build a streaming Lakehouse with Flink, Kafka, and Hudi
 
Delta Lake OSS: Create reliable and performant Data Lake by Quentin Ambard
Delta Lake OSS: Create reliable and performant Data Lake by Quentin AmbardDelta Lake OSS: Create reliable and performant Data Lake by Quentin Ambard
Delta Lake OSS: Create reliable and performant Data Lake by Quentin Ambard
 
Modernizing to a Cloud Data Architecture
Modernizing to a Cloud Data ArchitectureModernizing to a Cloud Data Architecture
Modernizing to a Cloud Data Architecture
 
A Deep Dive into Query Execution Engine of Spark SQL
A Deep Dive into Query Execution Engine of Spark SQLA Deep Dive into Query Execution Engine of Spark SQL
A Deep Dive into Query Execution Engine of Spark SQL
 

Similar a Kyligence Cloud 4 - An Overview

BusinessIntelligenze - On Cloud BI (English)
BusinessIntelligenze - On Cloud BI (English)BusinessIntelligenze - On Cloud BI (English)
BusinessIntelligenze - On Cloud BI (English)
BusinessIntelligenze
 
Connecta Event: Big Query och dataanalys med Google Cloud Platform
Connecta Event: Big Query och dataanalys med Google Cloud PlatformConnecta Event: Big Query och dataanalys med Google Cloud Platform
Connecta Event: Big Query och dataanalys med Google Cloud Platform
ConnectaDigital
 

Similar a Kyligence Cloud 4 - An Overview (20)

Addressing the systemic shortcomings of cloud analytics
Addressing the systemic shortcomings of cloud analyticsAddressing the systemic shortcomings of cloud analytics
Addressing the systemic shortcomings of cloud analytics
 
Architecting Snowflake for High Concurrency and High Performance
Architecting Snowflake for High Concurrency and High PerformanceArchitecting Snowflake for High Concurrency and High Performance
Architecting Snowflake for High Concurrency and High Performance
 
Kyligence Cloud 4 - Feature Focus: AI-Augmented Engine
Kyligence Cloud 4 - Feature Focus: AI-Augmented EngineKyligence Cloud 4 - Feature Focus: AI-Augmented Engine
Kyligence Cloud 4 - Feature Focus: AI-Augmented Engine
 
Take the Bias out of Big Data Insights With Augmented Analytics
Take the Bias out of Big Data Insights With Augmented AnalyticsTake the Bias out of Big Data Insights With Augmented Analytics
Take the Bias out of Big Data Insights With Augmented Analytics
 
Precomputation or Data Virtualization, which one is right for you?
Precomputation or Data Virtualization, which one is right for you?Precomputation or Data Virtualization, which one is right for you?
Precomputation or Data Virtualization, which one is right for you?
 
Lightning-Fast, Interactive Business Intelligence Performance with MicroStrat...
Lightning-Fast, Interactive Business Intelligence Performance with MicroStrat...Lightning-Fast, Interactive Business Intelligence Performance with MicroStrat...
Lightning-Fast, Interactive Business Intelligence Performance with MicroStrat...
 
How Analytics Teams Using SSAS Can Embrace Big Data and the Cloud
How Analytics Teams Using SSAS Can Embrace Big Data and the CloudHow Analytics Teams Using SSAS Can Embrace Big Data and the Cloud
How Analytics Teams Using SSAS Can Embrace Big Data and the Cloud
 
Snowflake: The Good, the Bad and the Ugly
Snowflake: The Good, the Bad and the UglySnowflake: The Good, the Bad and the Ugly
Snowflake: The Good, the Bad and the Ugly
 
Higher ROI-N
Higher ROI-NHigher ROI-N
Higher ROI-N
 
Transitioning to the Cloud: Implications for Reliability, Redundancy & Recove...
Transitioning to the Cloud: Implications for Reliability, Redundancy & Recove...Transitioning to the Cloud: Implications for Reliability, Redundancy & Recove...
Transitioning to the Cloud: Implications for Reliability, Redundancy & Recove...
 
BusinessIntelligenze - On Cloud BI (English)
BusinessIntelligenze - On Cloud BI (English)BusinessIntelligenze - On Cloud BI (English)
BusinessIntelligenze - On Cloud BI (English)
 
AI-Powered Analytics: What It Is and How It’s Powering the Next Generation of...
AI-Powered Analytics: What It Is and How It’s Powering the Next Generation of...AI-Powered Analytics: What It Is and How It’s Powering the Next Generation of...
AI-Powered Analytics: What It Is and How It’s Powering the Next Generation of...
 
IBM & Cloudera: Hybrid Cloud & the Power of Possibilities
IBM & Cloudera: Hybrid Cloud & the Power of PossibilitiesIBM & Cloudera: Hybrid Cloud & the Power of Possibilities
IBM & Cloudera: Hybrid Cloud & the Power of Possibilities
 
Simplify Data Analytics Over the Cloud
Simplify Data Analytics Over the CloudSimplify Data Analytics Over the Cloud
Simplify Data Analytics Over the Cloud
 
Snowflake: The Good, the Bad, and the Ugly
Snowflake: The Good, the Bad, and the UglySnowflake: The Good, the Bad, and the Ugly
Snowflake: The Good, the Bad, and the Ugly
 
Providing Interactive Analytics on Excel with Billions of Rows
Providing Interactive Analytics on Excel with Billions of RowsProviding Interactive Analytics on Excel with Billions of Rows
Providing Interactive Analytics on Excel with Billions of Rows
 
IBM Storage: Cloud like pricing with pay as you grow consumption
IBM Storage: Cloud like pricing with pay as you grow consumptionIBM Storage: Cloud like pricing with pay as you grow consumption
IBM Storage: Cloud like pricing with pay as you grow consumption
 
Unblocking Innovation for Digital Transformation
Unblocking Innovation for Digital TransformationUnblocking Innovation for Digital Transformation
Unblocking Innovation for Digital Transformation
 
Connecta Event: Big Query och dataanalys med Google Cloud Platform
Connecta Event: Big Query och dataanalys med Google Cloud PlatformConnecta Event: Big Query och dataanalys med Google Cloud Platform
Connecta Event: Big Query och dataanalys med Google Cloud Platform
 
JetSweep & CloudHealth Tech: Journey to the Cloud
JetSweep & CloudHealth Tech: Journey to the CloudJetSweep & CloudHealth Tech: Journey to the Cloud
JetSweep & CloudHealth Tech: Journey to the Cloud
 

Más de SamanthaBerlant

Más de SamanthaBerlant (8)

Kyligence Cloud 4 - Feature Focus: Spark-Powered Cubing and Indexing
Kyligence Cloud 4 - Feature Focus: Spark-Powered Cubing and IndexingKyligence Cloud 4 - Feature Focus: Spark-Powered Cubing and Indexing
Kyligence Cloud 4 - Feature Focus: Spark-Powered Cubing and Indexing
 
Smashing Through Big Data Barriers with Tableau and Snowflake
Smashing Through Big Data Barriers with Tableau and SnowflakeSmashing Through Big Data Barriers with Tableau and Snowflake
Smashing Through Big Data Barriers with Tableau and Snowflake
 
Extreme Excel: How a 35-Year-Old Desktop App Smashed Through the Big Data Bar...
Extreme Excel: How a 35-Year-Old Desktop App Smashed Through the Big Data Bar...Extreme Excel: How a 35-Year-Old Desktop App Smashed Through the Big Data Bar...
Extreme Excel: How a 35-Year-Old Desktop App Smashed Through the Big Data Bar...
 
Open Source Technologies in the Analytics Revolution
Open Source Technologies in the Analytics RevolutionOpen Source Technologies in the Analytics Revolution
Open Source Technologies in the Analytics Revolution
 
SF Big Analytics Meetup - Exact Count Distinct with Apache Kylin
SF Big Analytics Meetup - Exact Count Distinct with Apache KylinSF Big Analytics Meetup - Exact Count Distinct with Apache Kylin
SF Big Analytics Meetup - Exact Count Distinct with Apache Kylin
 
Enhance Data Governance with Kyligence Unified Semantic Layer
Enhance Data Governance with Kyligence Unified Semantic LayerEnhance Data Governance with Kyligence Unified Semantic Layer
Enhance Data Governance with Kyligence Unified Semantic Layer
 
Apache Kylin 101
Apache Kylin 101Apache Kylin 101
Apache Kylin 101
 
How to Guarantee Exact Count Distinct Queries with Sub-Second Latency on Mass...
How to Guarantee Exact Count Distinct Queries with Sub-Second Latency on Mass...How to Guarantee Exact Count Distinct Queries with Sub-Second Latency on Mass...
How to Guarantee Exact Count Distinct Queries with Sub-Second Latency on Mass...
 

Último

Vip Mumbai Call Girls Thane West Call On 9920725232 With Body to body massage...
Vip Mumbai Call Girls Thane West Call On 9920725232 With Body to body massage...Vip Mumbai Call Girls Thane West Call On 9920725232 With Body to body massage...
Vip Mumbai Call Girls Thane West Call On 9920725232 With Body to body massage...
amitlee9823
 
Abortion pills in Jeddah | +966572737505 | Get Cytotec
Abortion pills in Jeddah | +966572737505 | Get CytotecAbortion pills in Jeddah | +966572737505 | Get Cytotec
Abortion pills in Jeddah | +966572737505 | Get Cytotec
Abortion pills in Riyadh +966572737505 get cytotec
 
Call Girls Jalahalli Just Call 👗 7737669865 👗 Top Class Call Girl Service Ban...
Call Girls Jalahalli Just Call 👗 7737669865 👗 Top Class Call Girl Service Ban...Call Girls Jalahalli Just Call 👗 7737669865 👗 Top Class Call Girl Service Ban...
Call Girls Jalahalli Just Call 👗 7737669865 👗 Top Class Call Girl Service Ban...
amitlee9823
 
Junnasandra Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...
Junnasandra Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...Junnasandra Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...
Junnasandra Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...
amitlee9823
 
➥🔝 7737669865 🔝▻ Thrissur Call-girls in Women Seeking Men 🔝Thrissur🔝 Escor...
➥🔝 7737669865 🔝▻ Thrissur Call-girls in Women Seeking Men  🔝Thrissur🔝   Escor...➥🔝 7737669865 🔝▻ Thrissur Call-girls in Women Seeking Men  🔝Thrissur🔝   Escor...
➥🔝 7737669865 🔝▻ Thrissur Call-girls in Women Seeking Men 🔝Thrissur🔝 Escor...
amitlee9823
 
Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
amitlee9823
 
➥🔝 7737669865 🔝▻ Bangalore Call-girls in Women Seeking Men 🔝Bangalore🔝 Esc...
➥🔝 7737669865 🔝▻ Bangalore Call-girls in Women Seeking Men  🔝Bangalore🔝   Esc...➥🔝 7737669865 🔝▻ Bangalore Call-girls in Women Seeking Men  🔝Bangalore🔝   Esc...
➥🔝 7737669865 🔝▻ Bangalore Call-girls in Women Seeking Men 🔝Bangalore🔝 Esc...
amitlee9823
 
➥🔝 7737669865 🔝▻ Dindigul Call-girls in Women Seeking Men 🔝Dindigul🔝 Escor...
➥🔝 7737669865 🔝▻ Dindigul Call-girls in Women Seeking Men  🔝Dindigul🔝   Escor...➥🔝 7737669865 🔝▻ Dindigul Call-girls in Women Seeking Men  🔝Dindigul🔝   Escor...
➥🔝 7737669865 🔝▻ Dindigul Call-girls in Women Seeking Men 🔝Dindigul🔝 Escor...
amitlee9823
 
Call Girls In Hsr Layout ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Hsr Layout ☎ 7737669865 🥵 Book Your One night StandCall Girls In Hsr Layout ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Hsr Layout ☎ 7737669865 🥵 Book Your One night Stand
amitlee9823
 
➥🔝 7737669865 🔝▻ malwa Call-girls in Women Seeking Men 🔝malwa🔝 Escorts Ser...
➥🔝 7737669865 🔝▻ malwa Call-girls in Women Seeking Men  🔝malwa🔝   Escorts Ser...➥🔝 7737669865 🔝▻ malwa Call-girls in Women Seeking Men  🔝malwa🔝   Escorts Ser...
➥🔝 7737669865 🔝▻ malwa Call-girls in Women Seeking Men 🔝malwa🔝 Escorts Ser...
amitlee9823
 
Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
ZurliaSoop
 
Call Girls Begur Just Call 👗 7737669865 👗 Top Class Call Girl Service Bangalore
Call Girls Begur Just Call 👗 7737669865 👗 Top Class Call Girl Service BangaloreCall Girls Begur Just Call 👗 7737669865 👗 Top Class Call Girl Service Bangalore
Call Girls Begur Just Call 👗 7737669865 👗 Top Class Call Girl Service Bangalore
amitlee9823
 
Mg Road Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Banga...
Mg Road Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Banga...Mg Road Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Banga...
Mg Road Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Banga...
amitlee9823
 
Call Girls In Bellandur ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Bellandur ☎ 7737669865 🥵 Book Your One night StandCall Girls In Bellandur ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Bellandur ☎ 7737669865 🥵 Book Your One night Stand
amitlee9823
 

Último (20)

Vip Mumbai Call Girls Thane West Call On 9920725232 With Body to body massage...
Vip Mumbai Call Girls Thane West Call On 9920725232 With Body to body massage...Vip Mumbai Call Girls Thane West Call On 9920725232 With Body to body massage...
Vip Mumbai Call Girls Thane West Call On 9920725232 With Body to body massage...
 
Abortion pills in Jeddah | +966572737505 | Get Cytotec
Abortion pills in Jeddah | +966572737505 | Get CytotecAbortion pills in Jeddah | +966572737505 | Get Cytotec
Abortion pills in Jeddah | +966572737505 | Get Cytotec
 
Call Girls Jalahalli Just Call 👗 7737669865 👗 Top Class Call Girl Service Ban...
Call Girls Jalahalli Just Call 👗 7737669865 👗 Top Class Call Girl Service Ban...Call Girls Jalahalli Just Call 👗 7737669865 👗 Top Class Call Girl Service Ban...
Call Girls Jalahalli Just Call 👗 7737669865 👗 Top Class Call Girl Service Ban...
 
Junnasandra Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...
Junnasandra Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...Junnasandra Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...
Junnasandra Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...
 
➥🔝 7737669865 🔝▻ Thrissur Call-girls in Women Seeking Men 🔝Thrissur🔝 Escor...
➥🔝 7737669865 🔝▻ Thrissur Call-girls in Women Seeking Men  🔝Thrissur🔝   Escor...➥🔝 7737669865 🔝▻ Thrissur Call-girls in Women Seeking Men  🔝Thrissur🔝   Escor...
➥🔝 7737669865 🔝▻ Thrissur Call-girls in Women Seeking Men 🔝Thrissur🔝 Escor...
 
Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
 
➥🔝 7737669865 🔝▻ Bangalore Call-girls in Women Seeking Men 🔝Bangalore🔝 Esc...
➥🔝 7737669865 🔝▻ Bangalore Call-girls in Women Seeking Men  🔝Bangalore🔝   Esc...➥🔝 7737669865 🔝▻ Bangalore Call-girls in Women Seeking Men  🔝Bangalore🔝   Esc...
➥🔝 7737669865 🔝▻ Bangalore Call-girls in Women Seeking Men 🔝Bangalore🔝 Esc...
 
➥🔝 7737669865 🔝▻ Dindigul Call-girls in Women Seeking Men 🔝Dindigul🔝 Escor...
➥🔝 7737669865 🔝▻ Dindigul Call-girls in Women Seeking Men  🔝Dindigul🔝   Escor...➥🔝 7737669865 🔝▻ Dindigul Call-girls in Women Seeking Men  🔝Dindigul🔝   Escor...
➥🔝 7737669865 🔝▻ Dindigul Call-girls in Women Seeking Men 🔝Dindigul🔝 Escor...
 
Anomaly detection and data imputation within time series
Anomaly detection and data imputation within time seriesAnomaly detection and data imputation within time series
Anomaly detection and data imputation within time series
 
April 2024 - Crypto Market Report's Analysis
April 2024 - Crypto Market Report's AnalysisApril 2024 - Crypto Market Report's Analysis
April 2024 - Crypto Market Report's Analysis
 
Call Girls In Hsr Layout ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Hsr Layout ☎ 7737669865 🥵 Book Your One night StandCall Girls In Hsr Layout ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Hsr Layout ☎ 7737669865 🥵 Book Your One night Stand
 
Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...
Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...
Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...
 
Capstone Project on IBM Data Analytics Program
Capstone Project on IBM Data Analytics ProgramCapstone Project on IBM Data Analytics Program
Capstone Project on IBM Data Analytics Program
 
➥🔝 7737669865 🔝▻ malwa Call-girls in Women Seeking Men 🔝malwa🔝 Escorts Ser...
➥🔝 7737669865 🔝▻ malwa Call-girls in Women Seeking Men  🔝malwa🔝   Escorts Ser...➥🔝 7737669865 🔝▻ malwa Call-girls in Women Seeking Men  🔝malwa🔝   Escorts Ser...
➥🔝 7737669865 🔝▻ malwa Call-girls in Women Seeking Men 🔝malwa🔝 Escorts Ser...
 
Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
 
Call Girls Begur Just Call 👗 7737669865 👗 Top Class Call Girl Service Bangalore
Call Girls Begur Just Call 👗 7737669865 👗 Top Class Call Girl Service BangaloreCall Girls Begur Just Call 👗 7737669865 👗 Top Class Call Girl Service Bangalore
Call Girls Begur Just Call 👗 7737669865 👗 Top Class Call Girl Service Bangalore
 
Call Girls in Sarai Kale Khan Delhi 💯 Call Us 🔝9205541914 🔝( Delhi) Escorts S...
Call Girls in Sarai Kale Khan Delhi 💯 Call Us 🔝9205541914 🔝( Delhi) Escorts S...Call Girls in Sarai Kale Khan Delhi 💯 Call Us 🔝9205541914 🔝( Delhi) Escorts S...
Call Girls in Sarai Kale Khan Delhi 💯 Call Us 🔝9205541914 🔝( Delhi) Escorts S...
 
Mg Road Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Banga...
Mg Road Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Banga...Mg Road Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Banga...
Mg Road Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Banga...
 
Thane Call Girls 7091864438 Call Girls in Thane Escort service book now -
Thane Call Girls 7091864438 Call Girls in Thane Escort service book now -Thane Call Girls 7091864438 Call Girls in Thane Escort service book now -
Thane Call Girls 7091864438 Call Girls in Thane Escort service book now -
 
Call Girls In Bellandur ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Bellandur ☎ 7737669865 🥵 Book Your One night StandCall Girls In Bellandur ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Bellandur ☎ 7737669865 🥵 Book Your One night Stand
 

Kyligence Cloud 4 - An Overview

  • 1. Kyligence Cloud 4 – An Overview George Demarest Head of Marketing george.demarest@kyligence.io Li Kang VP, North America li.kang@kyligence.io
  • 2. Agenda  Introduction to Kyligence  Announcement: Kyligence Cloud 4  Kyligence Innovations  Use Cases and Successes  Demonstration
  • 3. © Kyligence Inc. 2021, Confidential. Three Pillars of Modern Cloud Analytics Distributed Compute Columnar Storage Precomputation
  • 4. © Kyligence Inc. 2021, Confidential. MPP Queries – Slow and Costly in the Cloud Common to Greenplum, Snowflake, Synapse, Redshift Data Volume / $$$ Resource Consumption Runtime Computation MPP Engines : Runtime Computation Data Concurrency
  • 5. © Kyligence Inc. 2021, Confidential. OLAP Precomputation - Faster and Cheaper in the Cloud Q: How many laptops were sold in Los Angeles in June? An Aggregate Index (a.k.a. Cube) Precomputation – Compute Once, Query Many Times Data Data Volume / $$$ Resource Consumption Runtime Computation Concurrency Precomputation
  • 6. © Kyligence Inc. 2021, Confidential. Apache Kylin Top Level Project  The only open-source OLAP technology on big data platform AwardWinning  InfoWorld’s Bossies 2015 & 2016 (Best of Open-Source Software Awards) Sub-Second Interactive Query  Large scale, high concurrency, multi- dimensional, sub-second query latency 1,000+ Organizations  Adopted by thousands of organizations globally
  • 7. © Kyligence Inc. 2021, Confidential. Kyligence: Kylin + Intelligence • Founded in 2016 by the creators of Apache Kylin • Enhances Kylin with AI-assisted auto-modeling, Unified Semantic Layer for leading BI tools • CRN Top-10 big data startups in 2018 • Global Presence: San Jose, Seattle, New York, Shanghai, Beijing • VCs: Fidelity International, Shunwei Capital, Broadband Capital, Redpoint, Cisco, Coatue 2016 Pre-A Redpoint Cisco 2017 Series A CBC Shunwei 2018 Series B 8Roads 2019 Series C Coatue
  • 8. © Kyligence Inc. 2021, Confidential. Kyligence in Action Migrated 1,200+ Cognos cubes to 2 Kyligence cubes 360º real-time view of spend insights for finance teams Migrated 2nd largest SSAS deployment to Kyligence/Azure Top 10 Global Investment Bank US FinTech SaaS Provider World’s Largest Credit/Debit Card Network Results:  95% queries < 2s  100+ concurrent users Results:  500X improved efficiency  10X faster + more stable analytics Results:  Single, 100+ TB distributed Kyligence cube
  • 9. © Kyligence Inc. 2021, Confidential. Trusted by Global Fortune 500 Banking & Finance Telecom Technology CPG & Retail
  • 10. © Kyligence Inc. 2021, Confidential. Announced Jan. 21 Kyligence Cloud 4 The First Cloud-Native OLAP Platform Cloud-native architecture Elasticity, separate compute from storage Cloud immediacy Deploys in minutes, on AWS/Azure marketplace Enhanced AI engine Auto-modeling, self-tuning cubes/indexes Unified Semantic Model MDX, SQL, REST access transparent to BI users
  • 11. © Kyligence Inc. 2021, Confidential. Kyligence Cloud Architecture Unified Semantic Layer Data as a Service Machine Learning Data as a Service SaaS & Apps CRM HCM SCM Low Latency Queries Any BI Tool Any Cloud Any Data Platform Data Warehouse Streaming Data Data Lake AI Augmented Engine Precomputation Layer Distributed Cubes & Table Indexes Multi-dimensional Modeling Security & Governance Finance Marketing Sales
  • 12. © Kyligence Inc. 2021, Confidential. Cloud Native Architecture Separation of compute and storage • Spark compute cluster • Shared cloud object storage • Scale and optimize separately for best results and price performance • Continuity: build cluster separate from – and doesn’t disrupt – query cluster Removed legacy Hadoop requirement • MapReduce, HDFS, HBase Spark Cubing Persisted in Parquet format, Optimized for Cloud Storage High performance components • Cubing with Spark, stored as Parquet • All tasks are executed in memory with Spark - cubing, querying, modeling, aggregation • Cubes and indexes saved in Parquet
  • 13. © Kyligence Inc. 2021, Confidential. Precomputing Everything Isn’t Practical Precomputation Total Indexes = 2 ^ Number of dimensions - 1
  • 14. © Kyligence Inc. 2021, Confidential. Precomputing Everything Isn’t Practical Challenge • 50 dimensions => 1.2T Indexes • Today, 100+ dimensions are possible • Cost is always critical Solution • AI-brokered compromise
  • 15. © Kyligence Inc. 2021, Confidential. AI-Assisted Cubing and Auto-Modeling Model Training Pre-aggregation Data Processing Auto-Generate Cube & Index AI-Augmented Engine Self-training Group wisdom Queries across the org ingested as input Benefits - Continuous model improvement without human intervention - Greater user satisfaction
  • 16. © Kyligence Inc. 2021, Confidential. Intelligent Query Routing With Smart Pushdown™ Goal: • Cubes: maximize query hits on precomputed results • Table Indexes: precompute detailed/ad-hoc queries if possible • Intelligent pushdown if not Total Freedom for BI users to slice and dice, drill down, roll up, etc. Seconds to Minutes Smart Pushdown™ Kyligence millions of queries/day
  • 17. © Kyligence Inc. 2021, Confidential. Unified Semantic Layer  ​From technical details to business contexts  Consistent semantics across all major BI tools  Centralized access control  Advanced business definitions and logic
  • 18. © Kyligence Inc. 2021, Confidential. Case Study: UnionPay – Modernize Traditional OLAP World’s largest debit/credit card issuer Results  500x improvement in maintenance efficiency  10x faster with greater stability  Time to insight: less than 4 hours  Significant TCO reduction Solution  Replaced Cognos backend with Kyligence  Consolidated 1,200 cubes to 2  Retained Cognos reporting frontend Challenge  1,200+ existing Cognos cubes to manage  1,000+ ETL jobs to maintain  Time to insight: over 4 days Backend migrated to 2 Kyligence cubes
  • 19. © Kyligence Inc. 2021, Confidential. Case Study: UnionPay – Modernize Traditional OLAP World’s largest debit/credit card issuer Blog eBook
  • 20. © Kyligence Inc. 2021, Confidential. Case Study: US Wealth Management – OLAP Cloud Migration  Challenges  Microsoft SSAS reaching practical limits  Many TB OLAP Cube, 350B rows  Query latencies unacceptable for dashboards  MDX queries 20 secs – 60+ secs  SQL queries 5 secs – 10+ secs  Hampered analyst productivity  Slow load times  Duplicate/derived cubes: duplicate effort  Solution  Redeploy to Azure/Kyligence  Same data sources, same BI tools  80+% query latencies < 1 sec
  • 21. © Kyligence Inc. 2021, Confidential. Case Study: US AI Fintech Vendor – Self-Service Cloud Analytics  SaaS vendors sit on top of a large amount of transaction data  Provide business insights and industry benchmarks as an add-on product subscription  Challenges are performance, concurrency, and cost  Fixed cloud infrastructure cost while # of users/queries grow  Not possible with Cloud DWs
  • 22. © Kyligence Inc. 2021, Confidential. Use Case – Cloud Data Warehouse Enhancements  Improved query performances  Cost reduction by 10x  Support 100s of users is very expensive on Snowflake  Every query / compute causes charges  Excel pivot table support  Target prospects  Snowflake customers  Large dataset and/or large # of users  Prefer to use Excel pivot table
  • 24. © Kyligence Inc. 2021, Confidential. Kyligence Cloud 4 The First Cloud-Native OLAP Platform Cloud-native architecture Elasticity, separate compute from storage Cloud immediacy Deploys in minutes, on AWS/Azure marketplace Enhanced AI engine Auto-modeling, self-tuning cubes/indexes Unified Semantic Model MDX, SQL, REST access transparent to BI users
  • 25. © Kyligence Inc. 2021, Confidential. Contact Us Kyligence Inc  http://kyligence.io  info@kyligence.io  Twitter: @Kyligence Apache Kylin  http://kylin.apache.org  dev@kylin.apache.org  Twitter: @ApacheKylin
  • 26. © Kyligence Inc. 2021, Confidential.
  • 27. © Kyligence Inc. 2021, Confidential. Solution: Kyligence Pivot to Snowflake
  • 28. © Kyligence Inc. 2021, Confidential. Kyligence Pivot to Snowflake Architecture • Leverage MDX for semantic consistency • Seamless user experience • Zero client configuration • Calculate once, consume many • Supports AWS and Azure Database Events Files IoT Unified Semantic Layer MDX Engine Access Control Enterprise Security Query Pushdown