SlideShare una empresa de Scribd logo
1 de 16
Descargar para leer sin conexión
Case Study in Banking and Finance: The Real-World Use of Big Data in Financial Services 
Big Data World Show, Malaysia 
Loon Wing Yuen 
Director, Innovation 
Group Information Services, 
Group Information and Operations Division 
Shangri-La Hotel, Kuala Lumpur 
9-10 September, 2014
The Opportunity in CIMB (circa 2012) 
CIMB had the largest Facebook fan-base (over 600k) among banks in Malaysia 
CIMB also had the largest Facebook fan-base (over 1m) among banks in ASEAN 
CIMB also had a huge Twitter following 
CIMB had launched OctoPay (Facebook Banking) and many Facebook-related marketing campaigns, several which targeted debit card usage – we built a database of matching CustomerIDs and FBIDs with associated FB structured and unstructured data 
With this data asset, there were potential debit card revenue opportunities leveraging this asset 
2 
FB Marketing Campaigns (2011 & 2012) 
ASEAN’s 1st banking service on Facebook (2012)
Application Use Case – Leveraging the value of our customer’s FB Likes 
The Debit Card business was new and so the active card base was low, resulting in low transactional volumes. Hence, this did not give the business a good idea on the types of merchant spend. 
We decided to check if there was a correlation between FB Likes and merchant spend. Assuming there was a good correlation – then the hypothesis was that we could take the wider range of merchant categories in FB Likes and use them for marketing campaign interventions. 
3 
Big Data 
Platform 
(FB Likes) 
With 
Debit Card 
With 
Spend 
Regular Spender 
Irregular* Spender 
Without 
Spend 
Without 
Debit Card 
Traditional Big Data 
New 
Big Data 
2012
Distribution of Customers’ FB Likes 
►Total identified distinct users who generated FB Like*: 27,614 (out of a total of 53,482) 
►Out of the 53k total, we linked 12,925 users as active CIMB customers 
►Approximately 6.5% of users liked more than 500 pages in their Facebook profile. 
►These 6.5% of “heavy FB Likes users” accounted for approximately 36% of the total FB Likes captured. 
We discovered that the FB Likes generated by customers were very unevenly distributed. 
* -- Excluding an FB Like for CIMB. 
14544 
9006 
2277 
1787 
0 
2000 
4000 
6000 
8000 
10000 
12000 
14000 
16000 
<=100 
>100 and <=300 
>300 and <=500 
>500 
Total Number of User Count versus Total Number of Likes per User 
567047, 12% 
1584913, 34% 
874962, 18% 
1696692, 36% 
Total Number of User Like Pages versus Total Number of Likes per User 
<=100 
>100 and <=300 
>300 and <=500 
>500 
2012 
4
Correlation of FB Likes with Merchant Spend 
►Significant amounts of data cleansing and transformations required 
►Correlations stronger in certain merchant categories/brands 
►Not every FB Like is correlated 
►Statistical testing required to determine the strength of correlations 
We discovered good correlations among certain merchant categories and brands. 
•The matching of the merchant_name and fblike_name is based on the simple “Like” SQL statement which does not guarantee the full match between the merchant_name and fblike_name. 
•More powerful data cleaning is needed to match the merchant_name and fblike_name more accurately. 
Debit Card Txn 
FB data 
2012 
5
Distinct Count of FBLikes for Starbucks 
by Micro Segment 
Targeted Interventions by Merchant Brand 
►Size of bubble represents Total FB Likes from Credit Card Prospect Base* 
FILTERED BDPP DATASET AS AT 11 MAR 2013: 
1.6 FB CAMPAIGN DATA FROM GMCD - I LOVE NEW YORK, DEBIT CARD RESKIN, MY DEBIT CARD, FOOTBALL FANTASY, YOUTH PEEK BUY, YOUTH VIDEO VOTING 
2.FB CIMB_ASSISTS DATA FROM GMCD 
3.CUSTOMER TAGGING DATA FROM BIU 
We can then partner with a selected existing merchant (eg. Starbucks) and design a very targeted campaign – or on-board a promising new merchant partnership. 
6 
Note*: Prospect Base is based on active customers aged > 21 yrs old without a credit card. 
Micro Segment 
Distinct Count of FBLikes for Starbucks 
Facebook User Base 
4,747 
Active Customer Base 
1,778 
Credit Card Base 
96 
Credit Card Prospect Base* 
1,216 
Debit Card Base 
946 
Distinct Count of FBLikes for Starbucks 
by Business Segment 
Distinct Count of FBLikes for Starbucks 
by Macro Segment 
FBLikes Comparison between Credit Card Base & 
Debit Card Base for Starbucks by Macro Segment 
2013
Application Use Case – Moving on to the Credit Card base 
The results from the work on the Debit Card base was promising enough to gain buy-in to next work on the Credit Card base as the next phase. 
7 
2013 
The scope was to create actionable insights to: 
Increase credit card usage 
Reactivate inactive credit card users 
The approach was to: 
Focus on influencing usage behavior – hence the focus on analyzing customer behaviors 
Influence usage behavior by offering targeted merchant offers 
Increased usage will generally lead to increased balances 
The deliverables were: 
Decile analysis of the card user base by card spend, merchant category and merchant brand spend 
 A range of actionable propositions that can drive card usage 
A fully sized segmentation model for targeted offers
Credit Card Usage Analysis 
The business goal at high level is to maximise both usage and balances for each credit card customer. 
8 
Usage 
Balance 
High Usage 
Medium Balance 
High Usage 
Low Balance 
(Transactors) 
High Usage 
High Balance 
(Core Revolvers) 
Medium Usage 
Medium Balance 
Medium Usage 
Low Balance 
Medium Usage 
High Balance 
Low Usage 
Medium Balance 
Low Usage 
Low Balance 
Low Usage 
High Balance 
1 
2 
3 
4 
5 
6 
7 
8 
9 
‘Occasionals’ 
Profitable 
group 
2013
From Analysis to Actionable Insights 
An example of crafting a marketing proposition for the ‘Occasionals’ cohort. 
1. Understand customer purchases by merchant categories 
2. Understand merchant 
product features 
3. Plan campaign and create offers 
4. Generate the customer list for each offer and execute according to campaign plan 
Which product to offer 
Choo- sing 
who to target 
2013 
9
Big Data Analytics Platform for Business 
In reality though, this is how the business is analyzed – by deciles. The new Big Data Exploration Portal allows “speed of thought” analyses as compared to the traditional multi-week report turnarounds from the data-warehouse – a key metric is now “Time to Actionable Insights”. 
10 
2014 
Entire Customer Base 
with > 30 months of transactional data 
500+ different metrics calculated in < 2 seconds
The problem is that at least two-thirds of our effort and time is spent with data cleansing, filtering, transformation, enrichment, etc. instead of extracting business value from the data. 
Our Biggest Challenge though is.. 
11
Big Data requires familiarity with Statistical/Machine Learning and NoSQL approaches 
The Statistical/Machine Learning approaches used were: 
► Principal Component Analysis (a Statistical dimensionality reduction approach) was used to reveal key behaviors among the credit card base 
► K-Means clustering (a Machine Learning approach) was used to identify and segment “Low to High (Y1  Y2) Usage” spend behavior 
► Neural Networks (a Machine Learning approach) was used to predict spend behavior 
► Support Vector Machines (a Machine Learning approach) was used to predict customer inactivity 
The NoSQL approaches used were: 
► De-normalisation/nesting of the transactional data 
► Modeling the data for optimal access for the purposes of supporting long-term customer analytics and near-realtime customer intervention systems 
Some of the statistical/machine learning and NoSQL approaches used were: 
2013 - 2014 
12
Enhancing Business Capabilities with Big Data analytics 
Big Data analytics can enhance all business dimensions of “Analytics” and “Management Information” 
Compliance & Regulatory Analytics 
Basel II & III 
FATCA 
Sarbanes Oxley Act (SOX) 
Fraud / AML 
Suspicious Activity 
Compliance Reporting 
Regulatory Reporting 
Risk Management Analytics 
Credit Risk 
Market Risk 
Operations Risk 
Liquidity Risk 
Capital Analysis 
Collection Analysis 
Exposure Analysis 
Sales Analytics 
Event/Campaign Analytics 
Behavior Analytics 
Market Analytics 
Transaction Analytics 
Customer Analytics 
Targeted Marketing / Sales 
Lead Analytics 
Management Analytics 
Income Analytics 
Cost Analytics 
Profitability Analytics 
Sales Performance 
Payment Analytics 
Capital Allocation Analytics 
Position Analytics 
Balance Sheet Analytics 
Weighted Average Analytics 
Structured Finance Analytics 
Liquidity Analytics 
Corporate Action Analytics 
Performance Analytics 
Financial Market Analytics 
Foreign Exchange Analytics 
Settlement Analytics 
Performance vs Benchmark 
Asset Allocation Analytics 
Product Analytics 
Portfolio Performance 
Portfolio Risk Analytics 
13
Rebuilding our Big Data and Machine Learning Platform 
There is an incredible opportunity to leverage Big Data and Machine Learning technologies to 
add advanced capabilities to our digital channels as well as to dramatically reduce “time to 
actionable insights” for our business stakeholders. 
ElasticSearch 
Indexing 
Map - 
Reduce 
Pig Hive 
Tez HBase Storm Spark* 
Yarn 
HDFS 
Exploration 
Portal 
Enterprise Data 
Warehouse 
Customer NoSQL Repository 
(Cassandra) 
2014 
Analytics REST-API layer 
Business 
Analyst 
14
Focus on the business priorities first, start with an engaged business stakeholder and manageable pilot 
Identify a business opportunity to address and prove the viability/business case, let the next business use case build upon this success and expand 
Focus on people and skills, lesser on the technologies 
The technologies are new, so be prepared to experiment; use, discard and replace technology components as required (many are open-source, fortunately) 
Data cleansing/preparation/ management is a big issue, not to be underestimated 
If the existing EDW is not primarily built for customer centricity and insight, don’t retrofit this into the EDW – instead build something akin to the Customer NoSQL Repository outside using new Big Data technologies 
Approach 
Capabilities 
There is an incredible opportunity to leverage Big Data and Machine Learning technologies to add advanced capabilities to an organisation’s digital channels and supporting the business need of significantly reducing “time to actionable insights” 
There is significant business opportunity in leveraging external data such as FB and Twitter 
But rethink approach on leveraging this FB and Twitter data – start with working on the issue of reliably linking external ids with internal customer ids 
Opportunity 
Summary and our learnings along the journey so far 
2012 – 2014 
15
Thank You

Más contenido relacionado

La actualidad más candente

Understanding Electronic Commerce
Understanding Electronic CommerceUnderstanding Electronic Commerce
Understanding Electronic CommerceTyler Hannan
 
Top-10 Technology Trends in Retail Banking: 2018
Top-10 Technology Trends in Retail Banking: 2018Top-10 Technology Trends in Retail Banking: 2018
Top-10 Technology Trends in Retail Banking: 2018Capgemini
 
Creating a Digital Banking Strategy - 01.23.15
Creating a Digital Banking Strategy - 01.23.15Creating a Digital Banking Strategy - 01.23.15
Creating a Digital Banking Strategy - 01.23.15Calvin Turner
 
Leveraging Big Data to Drive Bank Customer Engagement and Loyalty
Leveraging Big Data to Drive Bank Customer Engagement and LoyaltyLeveraging Big Data to Drive Bank Customer Engagement and Loyalty
Leveraging Big Data to Drive Bank Customer Engagement and LoyaltyJim Marous
 
Role of emerging technologies in Banking Operations
Role of emerging technologies in Banking OperationsRole of emerging technologies in Banking Operations
Role of emerging technologies in Banking OperationsPrashanth Ravada
 
Experience-Led Digital Banking: Getting Customers to Buy with Low Cost Digita...
Experience-Led Digital Banking: Getting Customers to Buy with Low Cost Digita...Experience-Led Digital Banking: Getting Customers to Buy with Low Cost Digita...
Experience-Led Digital Banking: Getting Customers to Buy with Low Cost Digita...Capgemini
 
[Keynote] Predictive APIs: What about Banking? - Natalino Busa @ PAPIs Connect
[Keynote] Predictive APIs: What about Banking? - Natalino Busa @ PAPIs Connect[Keynote] Predictive APIs: What about Banking? - Natalino Busa @ PAPIs Connect
[Keynote] Predictive APIs: What about Banking? - Natalino Busa @ PAPIs ConnectPAPIs.io
 
Future of artificial intelligence in the banking sector
Future of artificial intelligence in the banking sectorFuture of artificial intelligence in the banking sector
Future of artificial intelligence in the banking sectorusmsystems
 
FinQLOUD platform for digital banking
FinQLOUD platform for digital bankingFinQLOUD platform for digital banking
FinQLOUD platform for digital bankingMaxim Orlovsky
 
2013 Retail Banking Digital Marketing Report
2013 Retail Banking Digital Marketing Report2013 Retail Banking Digital Marketing Report
2013 Retail Banking Digital Marketing ReportMARC USA
 
Transformation and reconstruction of banks in the digital era
Transformation and reconstruction of banks in the digital eraTransformation and reconstruction of banks in the digital era
Transformation and reconstruction of banks in the digital eraAntonio Mazzone
 
Tablet Banking Series: Your key to a successful tablet banking proposition
Tablet Banking Series: Your key to a successful tablet banking propositionTablet Banking Series: Your key to a successful tablet banking proposition
Tablet Banking Series: Your key to a successful tablet banking propositionMapa International Limited
 
Blockchain in Corporate Banking: What’s Up?
Blockchain in Corporate Banking: What’s Up?Blockchain in Corporate Banking: What’s Up?
Blockchain in Corporate Banking: What’s Up?mercatoradvisory
 
Success Factors for Digital Transformation in Banking
Success Factors for Digital Transformation in BankingSuccess Factors for Digital Transformation in Banking
Success Factors for Digital Transformation in BankingTata Consultancy Services
 
Business Intelligence and Analytics in Banking
Business Intelligence and Analytics in BankingBusiness Intelligence and Analytics in Banking
Business Intelligence and Analytics in BankingSesameindia Pvt Ltd
 
Evolution of Digital Bank 4.0
Evolution of Digital Bank 4.0Evolution of Digital Bank 4.0
Evolution of Digital Bank 4.0Connected Futures
 
Addiko Bank Digital Transformation Experience - Microsoft Sinergija 18
Addiko Bank Digital Transformation Experience - Microsoft Sinergija 18Addiko Bank Digital Transformation Experience - Microsoft Sinergija 18
Addiko Bank Digital Transformation Experience - Microsoft Sinergija 18Vladimir Ljubibratic
 

La actualidad más candente (20)

Fintech
FintechFintech
Fintech
 
The Changing Payments Landscape
The Changing Payments LandscapeThe Changing Payments Landscape
The Changing Payments Landscape
 
Understanding Electronic Commerce
Understanding Electronic CommerceUnderstanding Electronic Commerce
Understanding Electronic Commerce
 
Top-10 Technology Trends in Retail Banking: 2018
Top-10 Technology Trends in Retail Banking: 2018Top-10 Technology Trends in Retail Banking: 2018
Top-10 Technology Trends in Retail Banking: 2018
 
Creating a Digital Banking Strategy - 01.23.15
Creating a Digital Banking Strategy - 01.23.15Creating a Digital Banking Strategy - 01.23.15
Creating a Digital Banking Strategy - 01.23.15
 
Leveraging Big Data to Drive Bank Customer Engagement and Loyalty
Leveraging Big Data to Drive Bank Customer Engagement and LoyaltyLeveraging Big Data to Drive Bank Customer Engagement and Loyalty
Leveraging Big Data to Drive Bank Customer Engagement and Loyalty
 
Role of emerging technologies in Banking Operations
Role of emerging technologies in Banking OperationsRole of emerging technologies in Banking Operations
Role of emerging technologies in Banking Operations
 
Experience-Led Digital Banking: Getting Customers to Buy with Low Cost Digita...
Experience-Led Digital Banking: Getting Customers to Buy with Low Cost Digita...Experience-Led Digital Banking: Getting Customers to Buy with Low Cost Digita...
Experience-Led Digital Banking: Getting Customers to Buy with Low Cost Digita...
 
[Keynote] Predictive APIs: What about Banking? - Natalino Busa @ PAPIs Connect
[Keynote] Predictive APIs: What about Banking? - Natalino Busa @ PAPIs Connect[Keynote] Predictive APIs: What about Banking? - Natalino Busa @ PAPIs Connect
[Keynote] Predictive APIs: What about Banking? - Natalino Busa @ PAPIs Connect
 
Future of artificial intelligence in the banking sector
Future of artificial intelligence in the banking sectorFuture of artificial intelligence in the banking sector
Future of artificial intelligence in the banking sector
 
FinQLOUD platform for digital banking
FinQLOUD platform for digital bankingFinQLOUD platform for digital banking
FinQLOUD platform for digital banking
 
RETAIL BANKING
RETAIL BANKING RETAIL BANKING
RETAIL BANKING
 
2013 Retail Banking Digital Marketing Report
2013 Retail Banking Digital Marketing Report2013 Retail Banking Digital Marketing Report
2013 Retail Banking Digital Marketing Report
 
Transformation and reconstruction of banks in the digital era
Transformation and reconstruction of banks in the digital eraTransformation and reconstruction of banks in the digital era
Transformation and reconstruction of banks in the digital era
 
Tablet Banking Series: Your key to a successful tablet banking proposition
Tablet Banking Series: Your key to a successful tablet banking propositionTablet Banking Series: Your key to a successful tablet banking proposition
Tablet Banking Series: Your key to a successful tablet banking proposition
 
Blockchain in Corporate Banking: What’s Up?
Blockchain in Corporate Banking: What’s Up?Blockchain in Corporate Banking: What’s Up?
Blockchain in Corporate Banking: What’s Up?
 
Success Factors for Digital Transformation in Banking
Success Factors for Digital Transformation in BankingSuccess Factors for Digital Transformation in Banking
Success Factors for Digital Transformation in Banking
 
Business Intelligence and Analytics in Banking
Business Intelligence and Analytics in BankingBusiness Intelligence and Analytics in Banking
Business Intelligence and Analytics in Banking
 
Evolution of Digital Bank 4.0
Evolution of Digital Bank 4.0Evolution of Digital Bank 4.0
Evolution of Digital Bank 4.0
 
Addiko Bank Digital Transformation Experience - Microsoft Sinergija 18
Addiko Bank Digital Transformation Experience - Microsoft Sinergija 18Addiko Bank Digital Transformation Experience - Microsoft Sinergija 18
Addiko Bank Digital Transformation Experience - Microsoft Sinergija 18
 

Destacado

Ux och design som konverterar del 1
Ux och design som konverterar   del 1Ux och design som konverterar   del 1
Ux och design som konverterar del 1Wipcore
 
The Semantic Web – A Vision Come True, or Giving Up the Great Plan?
The Semantic Web – A Vision Come True, or Giving Up the Great Plan?The Semantic Web – A Vision Come True, or Giving Up the Great Plan?
The Semantic Web – A Vision Come True, or Giving Up the Great Plan?Martin Hepp
 
An ontologyforopenrubricexchangeontheweb
An ontologyforopenrubricexchangeonthewebAn ontologyforopenrubricexchangeontheweb
An ontologyforopenrubricexchangeonthewebbpanulla
 
Scottish Public Opinion Monitor - May 2013
Scottish Public Opinion Monitor - May 2013Scottish Public Opinion Monitor - May 2013
Scottish Public Opinion Monitor - May 2013Ipsos UK
 
De Empreendedor à Empresário
De Empreendedor à EmpresárioDe Empreendedor à Empresário
De Empreendedor à EmpresárioFernando Tomé
 
Design Thinking for Advanced Manufacturing _ Industry Recommendations_Dec 2014
Design Thinking for Advanced Manufacturing _ Industry Recommendations_Dec 2014 Design Thinking for Advanced Manufacturing _ Industry Recommendations_Dec 2014
Design Thinking for Advanced Manufacturing _ Industry Recommendations_Dec 2014 Jane Cockburn
 
Open Rubrics and The Semantic Web: Open Ed 2010
Open Rubrics and The Semantic Web: Open Ed 2010Open Rubrics and The Semantic Web: Open Ed 2010
Open Rubrics and The Semantic Web: Open Ed 2010bpanulla
 
Actielijst 201304
Actielijst 201304Actielijst 201304
Actielijst 201304Kees Dekker
 
淺談HTTP發展趨勢與SPDY
淺談HTTP發展趨勢與SPDY淺談HTTP發展趨勢與SPDY
淺談HTTP發展趨勢與SPDYBilly Yang
 
The Tablet Project: Charts
The Tablet Project: ChartsThe Tablet Project: Charts
The Tablet Project: ChartsNewsworks
 
Tutorial avanzado wordle
Tutorial avanzado wordleTutorial avanzado wordle
Tutorial avanzado wordleAníbal Rossi
 

Destacado (16)

Ux och design som konverterar del 1
Ux och design som konverterar   del 1Ux och design som konverterar   del 1
Ux och design som konverterar del 1
 
The Semantic Web – A Vision Come True, or Giving Up the Great Plan?
The Semantic Web – A Vision Come True, or Giving Up the Great Plan?The Semantic Web – A Vision Come True, or Giving Up the Great Plan?
The Semantic Web – A Vision Come True, or Giving Up the Great Plan?
 
An ontologyforopenrubricexchangeontheweb
An ontologyforopenrubricexchangeonthewebAn ontologyforopenrubricexchangeontheweb
An ontologyforopenrubricexchangeontheweb
 
Scottish Public Opinion Monitor - May 2013
Scottish Public Opinion Monitor - May 2013Scottish Public Opinion Monitor - May 2013
Scottish Public Opinion Monitor - May 2013
 
De Empreendedor à Empresário
De Empreendedor à EmpresárioDe Empreendedor à Empresário
De Empreendedor à Empresário
 
RASPBIAN JESSIE WITH PIXEL
RASPBIAN JESSIE WITH PIXELRASPBIAN JESSIE WITH PIXEL
RASPBIAN JESSIE WITH PIXEL
 
1 spattern matching using biometric techniques
1 spattern matching using biometric techniques1 spattern matching using biometric techniques
1 spattern matching using biometric techniques
 
Design Thinking for Advanced Manufacturing _ Industry Recommendations_Dec 2014
Design Thinking for Advanced Manufacturing _ Industry Recommendations_Dec 2014 Design Thinking for Advanced Manufacturing _ Industry Recommendations_Dec 2014
Design Thinking for Advanced Manufacturing _ Industry Recommendations_Dec 2014
 
Open Rubrics and The Semantic Web: Open Ed 2010
Open Rubrics and The Semantic Web: Open Ed 2010Open Rubrics and The Semantic Web: Open Ed 2010
Open Rubrics and The Semantic Web: Open Ed 2010
 
Actielijst 201304
Actielijst 201304Actielijst 201304
Actielijst 201304
 
Van Godtsenhoven Karen
Van Godtsenhoven KarenVan Godtsenhoven Karen
Van Godtsenhoven Karen
 
淺談HTTP發展趨勢與SPDY
淺談HTTP發展趨勢與SPDY淺談HTTP發展趨勢與SPDY
淺談HTTP發展趨勢與SPDY
 
The Tablet Project: Charts
The Tablet Project: ChartsThe Tablet Project: Charts
The Tablet Project: Charts
 
CUE one pager
CUE one pagerCUE one pager
CUE one pager
 
Stress
StressStress
Stress
 
Tutorial avanzado wordle
Tutorial avanzado wordleTutorial avanzado wordle
Tutorial avanzado wordle
 

Similar a Big Data World presentation - Sep. 2014

Big Data - New Insights Transform Industries
Big Data - New Insights Transform IndustriesBig Data - New Insights Transform Industries
Big Data - New Insights Transform IndustriesIBM Software India
 
Data Science Use cases in Banking
Data Science Use cases in BankingData Science Use cases in Banking
Data Science Use cases in BankingArul Bharathi
 
Rfm clustering analysis
Rfm clustering analysisRfm clustering analysis
Rfm clustering analysisair india
 
W.UP Sales.UP digital sales and engagement tool for banks
W.UP Sales.UP digital sales and engagement tool for banksW.UP Sales.UP digital sales and engagement tool for banks
W.UP Sales.UP digital sales and engagement tool for banksW.UP
 
Consumer Analytics A Primer
Consumer Analytics A PrimerConsumer Analytics A Primer
Consumer Analytics A Primerijtsrd
 
B2B DATA: You Don't Have to Love it, But Don't Ignore it
B2B DATA: You Don't Have to Love it, But Don't Ignore itB2B DATA: You Don't Have to Love it, But Don't Ignore it
B2B DATA: You Don't Have to Love it, But Don't Ignore itamdia
 
How Big Data helps banks know their customers better
How Big Data helps banks know their customers betterHow Big Data helps banks know their customers better
How Big Data helps banks know their customers betterHEXANIKA
 
Acquire Grow & Retain customers - The business imperative for Big Data
Acquire Grow & Retain customers - The business imperative for Big DataAcquire Grow & Retain customers - The business imperative for Big Data
Acquire Grow & Retain customers - The business imperative for Big DataIBM Software India
 
Future and scope of big data analytics in Digital Finance and banking.
Future and scope of big data analytics in Digital Finance and banking.Future and scope of big data analytics in Digital Finance and banking.
Future and scope of big data analytics in Digital Finance and banking.VIJAYAKUMAR P
 
Big Data: Banking Industry Use Case
Big Data: Banking Industry Use Case Big Data: Banking Industry Use Case
Big Data: Banking Industry Use Case Ramandeep Kaur Bagri
 
How to get started in extracting business value from big data 1 of 2 oct 2013
How to get started in extracting business value from big data 1 of 2 oct 2013How to get started in extracting business value from big data 1 of 2 oct 2013
How to get started in extracting business value from big data 1 of 2 oct 2013Jaime Nistal
 
Uses of analytics in finance
Uses of analytics in financeUses of analytics in finance
Uses of analytics in financeNikithaDaniel1
 
Data mining for the online retail industry
Data mining for the online retail industryData mining for the online retail industry
Data mining for the online retail industryATUL SHARMA
 
Accelerate Revenue with a Customer Data Platform
Accelerate Revenue with a Customer Data PlatformAccelerate Revenue with a Customer Data Platform
Accelerate Revenue with a Customer Data PlatformLattice Engines
 
Big Data Retail Banking
Big Data Retail Banking Big Data Retail Banking
Big Data Retail Banking Sandeep Bhagat
 

Similar a Big Data World presentation - Sep. 2014 (20)

Big Data - New Insights Transform Industries
Big Data - New Insights Transform IndustriesBig Data - New Insights Transform Industries
Big Data - New Insights Transform Industries
 
Data Science Use cases in Banking
Data Science Use cases in BankingData Science Use cases in Banking
Data Science Use cases in Banking
 
Rfm clustering analysis
Rfm clustering analysisRfm clustering analysis
Rfm clustering analysis
 
W.UP Sales.UP digital sales and engagement tool for banks
W.UP Sales.UP digital sales and engagement tool for banksW.UP Sales.UP digital sales and engagement tool for banks
W.UP Sales.UP digital sales and engagement tool for banks
 
Consumer Analytics A Primer
Consumer Analytics A PrimerConsumer Analytics A Primer
Consumer Analytics A Primer
 
Creds Latest
Creds LatestCreds Latest
Creds Latest
 
Creds Latest
Creds LatestCreds Latest
Creds Latest
 
The Data People
The Data PeopleThe Data People
The Data People
 
B2B DATA: You Don't Have to Love it, But Don't Ignore it
B2B DATA: You Don't Have to Love it, But Don't Ignore itB2B DATA: You Don't Have to Love it, But Don't Ignore it
B2B DATA: You Don't Have to Love it, But Don't Ignore it
 
Gain Customer Insights with Data
Gain Customer Insights with DataGain Customer Insights with Data
Gain Customer Insights with Data
 
How Big Data helps banks know their customers better
How Big Data helps banks know their customers betterHow Big Data helps banks know their customers better
How Big Data helps banks know their customers better
 
Acquire Grow & Retain customers - The business imperative for Big Data
Acquire Grow & Retain customers - The business imperative for Big DataAcquire Grow & Retain customers - The business imperative for Big Data
Acquire Grow & Retain customers - The business imperative for Big Data
 
Sample.pdXcf
Sample.pdXcfSample.pdXcf
Sample.pdXcf
 
Future and scope of big data analytics in Digital Finance and banking.
Future and scope of big data analytics in Digital Finance and banking.Future and scope of big data analytics in Digital Finance and banking.
Future and scope of big data analytics in Digital Finance and banking.
 
Big Data: Banking Industry Use Case
Big Data: Banking Industry Use Case Big Data: Banking Industry Use Case
Big Data: Banking Industry Use Case
 
How to get started in extracting business value from big data 1 of 2 oct 2013
How to get started in extracting business value from big data 1 of 2 oct 2013How to get started in extracting business value from big data 1 of 2 oct 2013
How to get started in extracting business value from big data 1 of 2 oct 2013
 
Uses of analytics in finance
Uses of analytics in financeUses of analytics in finance
Uses of analytics in finance
 
Data mining for the online retail industry
Data mining for the online retail industryData mining for the online retail industry
Data mining for the online retail industry
 
Accelerate Revenue with a Customer Data Platform
Accelerate Revenue with a Customer Data PlatformAccelerate Revenue with a Customer Data Platform
Accelerate Revenue with a Customer Data Platform
 
Big Data Retail Banking
Big Data Retail Banking Big Data Retail Banking
Big Data Retail Banking
 

Último

GA4 Without Cookies [Measure Camp AMS]
GA4 Without Cookies [Measure Camp AMS]GA4 Without Cookies [Measure Camp AMS]
GA4 Without Cookies [Measure Camp AMS]📊 Markus Baersch
 
Easter Eggs From Star Wars and in cars 1 and 2
Easter Eggs From Star Wars and in cars 1 and 2Easter Eggs From Star Wars and in cars 1 and 2
Easter Eggs From Star Wars and in cars 1 and 217djon017
 
1:1定制(UQ毕业证)昆士兰大学毕业证成绩单修改留信学历认证原版一模一样
1:1定制(UQ毕业证)昆士兰大学毕业证成绩单修改留信学历认证原版一模一样1:1定制(UQ毕业证)昆士兰大学毕业证成绩单修改留信学历认证原版一模一样
1:1定制(UQ毕业证)昆士兰大学毕业证成绩单修改留信学历认证原版一模一样vhwb25kk
 
Predicting Salary Using Data Science: A Comprehensive Analysis.pdf
Predicting Salary Using Data Science: A Comprehensive Analysis.pdfPredicting Salary Using Data Science: A Comprehensive Analysis.pdf
Predicting Salary Using Data Science: A Comprehensive Analysis.pdfBoston Institute of Analytics
 
Student profile product demonstration on grades, ability, well-being and mind...
Student profile product demonstration on grades, ability, well-being and mind...Student profile product demonstration on grades, ability, well-being and mind...
Student profile product demonstration on grades, ability, well-being and mind...Seán Kennedy
 
RS 9000 Call In girls Dwarka Mor (DELHI)⇛9711147426🔝Delhi
RS 9000 Call In girls Dwarka Mor (DELHI)⇛9711147426🔝DelhiRS 9000 Call In girls Dwarka Mor (DELHI)⇛9711147426🔝Delhi
RS 9000 Call In girls Dwarka Mor (DELHI)⇛9711147426🔝Delhijennyeacort
 
Effects of Smartphone Addiction on the Academic Performances of Grades 9 to 1...
Effects of Smartphone Addiction on the Academic Performances of Grades 9 to 1...Effects of Smartphone Addiction on the Academic Performances of Grades 9 to 1...
Effects of Smartphone Addiction on the Academic Performances of Grades 9 to 1...limedy534
 
From idea to production in a day – Leveraging Azure ML and Streamlit to build...
From idea to production in a day – Leveraging Azure ML and Streamlit to build...From idea to production in a day – Leveraging Azure ML and Streamlit to build...
From idea to production in a day – Leveraging Azure ML and Streamlit to build...Florian Roscheck
 
Data Factory in Microsoft Fabric (MsBIP #82)
Data Factory in Microsoft Fabric (MsBIP #82)Data Factory in Microsoft Fabric (MsBIP #82)
Data Factory in Microsoft Fabric (MsBIP #82)Cathrine Wilhelmsen
 
ASML's Taxonomy Adventure by Daniel Canter
ASML's Taxonomy Adventure by Daniel CanterASML's Taxonomy Adventure by Daniel Canter
ASML's Taxonomy Adventure by Daniel Cantervoginip
 
RABBIT: A CLI tool for identifying bots based on their GitHub events.
RABBIT: A CLI tool for identifying bots based on their GitHub events.RABBIT: A CLI tool for identifying bots based on their GitHub events.
RABBIT: A CLI tool for identifying bots based on their GitHub events.natarajan8993
 
原版1:1定制南十字星大学毕业证(SCU毕业证)#文凭成绩单#真实留信学历认证永久存档
原版1:1定制南十字星大学毕业证(SCU毕业证)#文凭成绩单#真实留信学历认证永久存档原版1:1定制南十字星大学毕业证(SCU毕业证)#文凭成绩单#真实留信学历认证永久存档
原版1:1定制南十字星大学毕业证(SCU毕业证)#文凭成绩单#真实留信学历认证永久存档208367051
 
INTERNSHIP ON PURBASHA COMPOSITE TEX LTD
INTERNSHIP ON PURBASHA COMPOSITE TEX LTDINTERNSHIP ON PURBASHA COMPOSITE TEX LTD
INTERNSHIP ON PURBASHA COMPOSITE TEX LTDRafezzaman
 
Biometric Authentication: The Evolution, Applications, Benefits and Challenge...
Biometric Authentication: The Evolution, Applications, Benefits and Challenge...Biometric Authentication: The Evolution, Applications, Benefits and Challenge...
Biometric Authentication: The Evolution, Applications, Benefits and Challenge...GQ Research
 
Call Girls In Dwarka 9654467111 Escorts Service
Call Girls In Dwarka 9654467111 Escorts ServiceCall Girls In Dwarka 9654467111 Escorts Service
Call Girls In Dwarka 9654467111 Escorts ServiceSapana Sha
 
办理学位证中佛罗里达大学毕业证,UCF成绩单原版一比一
办理学位证中佛罗里达大学毕业证,UCF成绩单原版一比一办理学位证中佛罗里达大学毕业证,UCF成绩单原版一比一
办理学位证中佛罗里达大学毕业证,UCF成绩单原版一比一F sss
 
Building on a FAIRly Strong Foundation to Connect Academic Research to Transl...
Building on a FAIRly Strong Foundation to Connect Academic Research to Transl...Building on a FAIRly Strong Foundation to Connect Academic Research to Transl...
Building on a FAIRly Strong Foundation to Connect Academic Research to Transl...Jack DiGiovanna
 
20240419 - Measurecamp Amsterdam - SAM.pdf
20240419 - Measurecamp Amsterdam - SAM.pdf20240419 - Measurecamp Amsterdam - SAM.pdf
20240419 - Measurecamp Amsterdam - SAM.pdfHuman37
 
2006_GasProcessing_HB (1).pdf HYDROCARBON PROCESSING
2006_GasProcessing_HB (1).pdf HYDROCARBON PROCESSING2006_GasProcessing_HB (1).pdf HYDROCARBON PROCESSING
2006_GasProcessing_HB (1).pdf HYDROCARBON PROCESSINGmarianagonzalez07
 
Student Profile Sample report on improving academic performance by uniting gr...
Student Profile Sample report on improving academic performance by uniting gr...Student Profile Sample report on improving academic performance by uniting gr...
Student Profile Sample report on improving academic performance by uniting gr...Seán Kennedy
 

Último (20)

GA4 Without Cookies [Measure Camp AMS]
GA4 Without Cookies [Measure Camp AMS]GA4 Without Cookies [Measure Camp AMS]
GA4 Without Cookies [Measure Camp AMS]
 
Easter Eggs From Star Wars and in cars 1 and 2
Easter Eggs From Star Wars and in cars 1 and 2Easter Eggs From Star Wars and in cars 1 and 2
Easter Eggs From Star Wars and in cars 1 and 2
 
1:1定制(UQ毕业证)昆士兰大学毕业证成绩单修改留信学历认证原版一模一样
1:1定制(UQ毕业证)昆士兰大学毕业证成绩单修改留信学历认证原版一模一样1:1定制(UQ毕业证)昆士兰大学毕业证成绩单修改留信学历认证原版一模一样
1:1定制(UQ毕业证)昆士兰大学毕业证成绩单修改留信学历认证原版一模一样
 
Predicting Salary Using Data Science: A Comprehensive Analysis.pdf
Predicting Salary Using Data Science: A Comprehensive Analysis.pdfPredicting Salary Using Data Science: A Comprehensive Analysis.pdf
Predicting Salary Using Data Science: A Comprehensive Analysis.pdf
 
Student profile product demonstration on grades, ability, well-being and mind...
Student profile product demonstration on grades, ability, well-being and mind...Student profile product demonstration on grades, ability, well-being and mind...
Student profile product demonstration on grades, ability, well-being and mind...
 
RS 9000 Call In girls Dwarka Mor (DELHI)⇛9711147426🔝Delhi
RS 9000 Call In girls Dwarka Mor (DELHI)⇛9711147426🔝DelhiRS 9000 Call In girls Dwarka Mor (DELHI)⇛9711147426🔝Delhi
RS 9000 Call In girls Dwarka Mor (DELHI)⇛9711147426🔝Delhi
 
Effects of Smartphone Addiction on the Academic Performances of Grades 9 to 1...
Effects of Smartphone Addiction on the Academic Performances of Grades 9 to 1...Effects of Smartphone Addiction on the Academic Performances of Grades 9 to 1...
Effects of Smartphone Addiction on the Academic Performances of Grades 9 to 1...
 
From idea to production in a day – Leveraging Azure ML and Streamlit to build...
From idea to production in a day – Leveraging Azure ML and Streamlit to build...From idea to production in a day – Leveraging Azure ML and Streamlit to build...
From idea to production in a day – Leveraging Azure ML and Streamlit to build...
 
Data Factory in Microsoft Fabric (MsBIP #82)
Data Factory in Microsoft Fabric (MsBIP #82)Data Factory in Microsoft Fabric (MsBIP #82)
Data Factory in Microsoft Fabric (MsBIP #82)
 
ASML's Taxonomy Adventure by Daniel Canter
ASML's Taxonomy Adventure by Daniel CanterASML's Taxonomy Adventure by Daniel Canter
ASML's Taxonomy Adventure by Daniel Canter
 
RABBIT: A CLI tool for identifying bots based on their GitHub events.
RABBIT: A CLI tool for identifying bots based on their GitHub events.RABBIT: A CLI tool for identifying bots based on their GitHub events.
RABBIT: A CLI tool for identifying bots based on their GitHub events.
 
原版1:1定制南十字星大学毕业证(SCU毕业证)#文凭成绩单#真实留信学历认证永久存档
原版1:1定制南十字星大学毕业证(SCU毕业证)#文凭成绩单#真实留信学历认证永久存档原版1:1定制南十字星大学毕业证(SCU毕业证)#文凭成绩单#真实留信学历认证永久存档
原版1:1定制南十字星大学毕业证(SCU毕业证)#文凭成绩单#真实留信学历认证永久存档
 
INTERNSHIP ON PURBASHA COMPOSITE TEX LTD
INTERNSHIP ON PURBASHA COMPOSITE TEX LTDINTERNSHIP ON PURBASHA COMPOSITE TEX LTD
INTERNSHIP ON PURBASHA COMPOSITE TEX LTD
 
Biometric Authentication: The Evolution, Applications, Benefits and Challenge...
Biometric Authentication: The Evolution, Applications, Benefits and Challenge...Biometric Authentication: The Evolution, Applications, Benefits and Challenge...
Biometric Authentication: The Evolution, Applications, Benefits and Challenge...
 
Call Girls In Dwarka 9654467111 Escorts Service
Call Girls In Dwarka 9654467111 Escorts ServiceCall Girls In Dwarka 9654467111 Escorts Service
Call Girls In Dwarka 9654467111 Escorts Service
 
办理学位证中佛罗里达大学毕业证,UCF成绩单原版一比一
办理学位证中佛罗里达大学毕业证,UCF成绩单原版一比一办理学位证中佛罗里达大学毕业证,UCF成绩单原版一比一
办理学位证中佛罗里达大学毕业证,UCF成绩单原版一比一
 
Building on a FAIRly Strong Foundation to Connect Academic Research to Transl...
Building on a FAIRly Strong Foundation to Connect Academic Research to Transl...Building on a FAIRly Strong Foundation to Connect Academic Research to Transl...
Building on a FAIRly Strong Foundation to Connect Academic Research to Transl...
 
20240419 - Measurecamp Amsterdam - SAM.pdf
20240419 - Measurecamp Amsterdam - SAM.pdf20240419 - Measurecamp Amsterdam - SAM.pdf
20240419 - Measurecamp Amsterdam - SAM.pdf
 
2006_GasProcessing_HB (1).pdf HYDROCARBON PROCESSING
2006_GasProcessing_HB (1).pdf HYDROCARBON PROCESSING2006_GasProcessing_HB (1).pdf HYDROCARBON PROCESSING
2006_GasProcessing_HB (1).pdf HYDROCARBON PROCESSING
 
Student Profile Sample report on improving academic performance by uniting gr...
Student Profile Sample report on improving academic performance by uniting gr...Student Profile Sample report on improving academic performance by uniting gr...
Student Profile Sample report on improving academic performance by uniting gr...
 

Big Data World presentation - Sep. 2014

  • 1. Case Study in Banking and Finance: The Real-World Use of Big Data in Financial Services Big Data World Show, Malaysia Loon Wing Yuen Director, Innovation Group Information Services, Group Information and Operations Division Shangri-La Hotel, Kuala Lumpur 9-10 September, 2014
  • 2. The Opportunity in CIMB (circa 2012) CIMB had the largest Facebook fan-base (over 600k) among banks in Malaysia CIMB also had the largest Facebook fan-base (over 1m) among banks in ASEAN CIMB also had a huge Twitter following CIMB had launched OctoPay (Facebook Banking) and many Facebook-related marketing campaigns, several which targeted debit card usage – we built a database of matching CustomerIDs and FBIDs with associated FB structured and unstructured data With this data asset, there were potential debit card revenue opportunities leveraging this asset 2 FB Marketing Campaigns (2011 & 2012) ASEAN’s 1st banking service on Facebook (2012)
  • 3. Application Use Case – Leveraging the value of our customer’s FB Likes The Debit Card business was new and so the active card base was low, resulting in low transactional volumes. Hence, this did not give the business a good idea on the types of merchant spend. We decided to check if there was a correlation between FB Likes and merchant spend. Assuming there was a good correlation – then the hypothesis was that we could take the wider range of merchant categories in FB Likes and use them for marketing campaign interventions. 3 Big Data Platform (FB Likes) With Debit Card With Spend Regular Spender Irregular* Spender Without Spend Without Debit Card Traditional Big Data New Big Data 2012
  • 4. Distribution of Customers’ FB Likes ►Total identified distinct users who generated FB Like*: 27,614 (out of a total of 53,482) ►Out of the 53k total, we linked 12,925 users as active CIMB customers ►Approximately 6.5% of users liked more than 500 pages in their Facebook profile. ►These 6.5% of “heavy FB Likes users” accounted for approximately 36% of the total FB Likes captured. We discovered that the FB Likes generated by customers were very unevenly distributed. * -- Excluding an FB Like for CIMB. 14544 9006 2277 1787 0 2000 4000 6000 8000 10000 12000 14000 16000 <=100 >100 and <=300 >300 and <=500 >500 Total Number of User Count versus Total Number of Likes per User 567047, 12% 1584913, 34% 874962, 18% 1696692, 36% Total Number of User Like Pages versus Total Number of Likes per User <=100 >100 and <=300 >300 and <=500 >500 2012 4
  • 5. Correlation of FB Likes with Merchant Spend ►Significant amounts of data cleansing and transformations required ►Correlations stronger in certain merchant categories/brands ►Not every FB Like is correlated ►Statistical testing required to determine the strength of correlations We discovered good correlations among certain merchant categories and brands. •The matching of the merchant_name and fblike_name is based on the simple “Like” SQL statement which does not guarantee the full match between the merchant_name and fblike_name. •More powerful data cleaning is needed to match the merchant_name and fblike_name more accurately. Debit Card Txn FB data 2012 5
  • 6. Distinct Count of FBLikes for Starbucks by Micro Segment Targeted Interventions by Merchant Brand ►Size of bubble represents Total FB Likes from Credit Card Prospect Base* FILTERED BDPP DATASET AS AT 11 MAR 2013: 1.6 FB CAMPAIGN DATA FROM GMCD - I LOVE NEW YORK, DEBIT CARD RESKIN, MY DEBIT CARD, FOOTBALL FANTASY, YOUTH PEEK BUY, YOUTH VIDEO VOTING 2.FB CIMB_ASSISTS DATA FROM GMCD 3.CUSTOMER TAGGING DATA FROM BIU We can then partner with a selected existing merchant (eg. Starbucks) and design a very targeted campaign – or on-board a promising new merchant partnership. 6 Note*: Prospect Base is based on active customers aged > 21 yrs old without a credit card. Micro Segment Distinct Count of FBLikes for Starbucks Facebook User Base 4,747 Active Customer Base 1,778 Credit Card Base 96 Credit Card Prospect Base* 1,216 Debit Card Base 946 Distinct Count of FBLikes for Starbucks by Business Segment Distinct Count of FBLikes for Starbucks by Macro Segment FBLikes Comparison between Credit Card Base & Debit Card Base for Starbucks by Macro Segment 2013
  • 7. Application Use Case – Moving on to the Credit Card base The results from the work on the Debit Card base was promising enough to gain buy-in to next work on the Credit Card base as the next phase. 7 2013 The scope was to create actionable insights to: Increase credit card usage Reactivate inactive credit card users The approach was to: Focus on influencing usage behavior – hence the focus on analyzing customer behaviors Influence usage behavior by offering targeted merchant offers Increased usage will generally lead to increased balances The deliverables were: Decile analysis of the card user base by card spend, merchant category and merchant brand spend  A range of actionable propositions that can drive card usage A fully sized segmentation model for targeted offers
  • 8. Credit Card Usage Analysis The business goal at high level is to maximise both usage and balances for each credit card customer. 8 Usage Balance High Usage Medium Balance High Usage Low Balance (Transactors) High Usage High Balance (Core Revolvers) Medium Usage Medium Balance Medium Usage Low Balance Medium Usage High Balance Low Usage Medium Balance Low Usage Low Balance Low Usage High Balance 1 2 3 4 5 6 7 8 9 ‘Occasionals’ Profitable group 2013
  • 9. From Analysis to Actionable Insights An example of crafting a marketing proposition for the ‘Occasionals’ cohort. 1. Understand customer purchases by merchant categories 2. Understand merchant product features 3. Plan campaign and create offers 4. Generate the customer list for each offer and execute according to campaign plan Which product to offer Choo- sing who to target 2013 9
  • 10. Big Data Analytics Platform for Business In reality though, this is how the business is analyzed – by deciles. The new Big Data Exploration Portal allows “speed of thought” analyses as compared to the traditional multi-week report turnarounds from the data-warehouse – a key metric is now “Time to Actionable Insights”. 10 2014 Entire Customer Base with > 30 months of transactional data 500+ different metrics calculated in < 2 seconds
  • 11. The problem is that at least two-thirds of our effort and time is spent with data cleansing, filtering, transformation, enrichment, etc. instead of extracting business value from the data. Our Biggest Challenge though is.. 11
  • 12. Big Data requires familiarity with Statistical/Machine Learning and NoSQL approaches The Statistical/Machine Learning approaches used were: ► Principal Component Analysis (a Statistical dimensionality reduction approach) was used to reveal key behaviors among the credit card base ► K-Means clustering (a Machine Learning approach) was used to identify and segment “Low to High (Y1  Y2) Usage” spend behavior ► Neural Networks (a Machine Learning approach) was used to predict spend behavior ► Support Vector Machines (a Machine Learning approach) was used to predict customer inactivity The NoSQL approaches used were: ► De-normalisation/nesting of the transactional data ► Modeling the data for optimal access for the purposes of supporting long-term customer analytics and near-realtime customer intervention systems Some of the statistical/machine learning and NoSQL approaches used were: 2013 - 2014 12
  • 13. Enhancing Business Capabilities with Big Data analytics Big Data analytics can enhance all business dimensions of “Analytics” and “Management Information” Compliance & Regulatory Analytics Basel II & III FATCA Sarbanes Oxley Act (SOX) Fraud / AML Suspicious Activity Compliance Reporting Regulatory Reporting Risk Management Analytics Credit Risk Market Risk Operations Risk Liquidity Risk Capital Analysis Collection Analysis Exposure Analysis Sales Analytics Event/Campaign Analytics Behavior Analytics Market Analytics Transaction Analytics Customer Analytics Targeted Marketing / Sales Lead Analytics Management Analytics Income Analytics Cost Analytics Profitability Analytics Sales Performance Payment Analytics Capital Allocation Analytics Position Analytics Balance Sheet Analytics Weighted Average Analytics Structured Finance Analytics Liquidity Analytics Corporate Action Analytics Performance Analytics Financial Market Analytics Foreign Exchange Analytics Settlement Analytics Performance vs Benchmark Asset Allocation Analytics Product Analytics Portfolio Performance Portfolio Risk Analytics 13
  • 14. Rebuilding our Big Data and Machine Learning Platform There is an incredible opportunity to leverage Big Data and Machine Learning technologies to add advanced capabilities to our digital channels as well as to dramatically reduce “time to actionable insights” for our business stakeholders. ElasticSearch Indexing Map - Reduce Pig Hive Tez HBase Storm Spark* Yarn HDFS Exploration Portal Enterprise Data Warehouse Customer NoSQL Repository (Cassandra) 2014 Analytics REST-API layer Business Analyst 14
  • 15. Focus on the business priorities first, start with an engaged business stakeholder and manageable pilot Identify a business opportunity to address and prove the viability/business case, let the next business use case build upon this success and expand Focus on people and skills, lesser on the technologies The technologies are new, so be prepared to experiment; use, discard and replace technology components as required (many are open-source, fortunately) Data cleansing/preparation/ management is a big issue, not to be underestimated If the existing EDW is not primarily built for customer centricity and insight, don’t retrofit this into the EDW – instead build something akin to the Customer NoSQL Repository outside using new Big Data technologies Approach Capabilities There is an incredible opportunity to leverage Big Data and Machine Learning technologies to add advanced capabilities to an organisation’s digital channels and supporting the business need of significantly reducing “time to actionable insights” There is significant business opportunity in leveraging external data such as FB and Twitter But rethink approach on leveraging this FB and Twitter data – start with working on the issue of reliably linking external ids with internal customer ids Opportunity Summary and our learnings along the journey so far 2012 – 2014 15