SlideShare una empresa de Scribd logo
1 de 11
1

AN ADVENTUROUS JOURNEY
THROUGH THE FIELD OF

BIG DATA
P ROGRAMME


Concept de ma thèse


Étude de la littérature



Cas: FOD Justice



Cas: Adswizz



Démo



Conclusion

2
3

C ONCEPT DE MA THÈSE


M’initier au Big Data



Expérimenter avec les machines virtuelles (HortonWorks)





Contacts externes, événements, Médias sociaux, webinars
Réunions sur BigData.be (+pratique)

Projet


FOD Justice



SAS Visual Analytics



UITDAGING

Configurer un environnement de Big Data (HDP)



INNOVATIE

Adswizz (‘réserve’)

OPPORTUNITEIT
4

T HESIS


Data aspect


Volume, variëteit en velocity





External data

Technological aspect




HADOOP

MOBILE

Distributed (HDFS/MapReduce)

Analytical aspect



Prescriptive

Externe
data

Predictive

CLOUD

SOCIAL MEDIA
T HESIS


Customer churn



Fraudulent transactions



Customer insight



Discover new patterns between data

5
T HESIS
1.

Research

2.

Formulate opportunities

3.

Develop use case(s)

4.

Identify requirements

5.

Set-up testing environment

6.

Evaluate results

6
7

C ASE : FOD J USTITIE
Duidelijke afspraken

2.

Scope afgebakend

3.

Project goedgekeurd

4.

Veelheid aan procedures

5.

Moeilijke communicatie

6.

SAS Visual Analytics

“

PROCEDURES
COMMUNICATIE

A man’s errors are his portals of discovery.
by James Joyce

“

1.
CASE: A DSWIZZ


Injectie advertenties



Logfiles



75GB  750GB/maand



Amazon S3 & EMR



WEBLOGS

Internet radio webstreams



8

Pig scripts

SCRIPTS

Skill to do comes from doing.
by Ralph Waldo Emerson

“

“

PIG
9

DEMO
by Anton Chekhov

“

“

Knowledge is of no value unless
you put it into practice.
B ESLUIT
A LG E M E E N :


Big Data is een ‘hot’ topic



Uitbreiding op klassieke Business Intelligence



Wordt steeds belangrijker



Vereist nieuwe kennis (Analytics, Pig/Hive, Linux, … )



Goede voorbereiding en klein beginnen

P E RS O O N L I J K :


Boeiende en leerrijk traject



Communicatie, Toepassing Big Data, PigQL, SAS Programming & VA



Ontwikkeling professionele attitude



Aan een interessante & uitdagende job geholpen

10
11

VRAGEN?
by George Bernard Shaw

“

“

No question is so difficult to answer as
that to which the answer is obvious.

Más contenido relacionado

Similar a Presentation Thesis Big Data

Big data insights part i
Big data insights   part iBig data insights   part i
Big data insights part iRaji Gogulapati
 
Mapping (big) data science (15 dec2014)대학(원)생
Mapping (big) data science (15 dec2014)대학(원)생Mapping (big) data science (15 dec2014)대학(원)생
Mapping (big) data science (15 dec2014)대학(원)생Han Woo PARK
 
McKegney -- Analytics in the Physical World
McKegney -- Analytics in the Physical WorldMcKegney -- Analytics in the Physical World
McKegney -- Analytics in the Physical WorldRoss McKegney
 
Introduction to Big Data An analogy between Sugar Cane & Big Data
Introduction to Big Data An analogy  between Sugar Cane & Big DataIntroduction to Big Data An analogy  between Sugar Cane & Big Data
Introduction to Big Data An analogy between Sugar Cane & Big DataJean-Marc Desvaux
 
Fontys Eric van Tol
Fontys Eric van TolFontys Eric van Tol
Fontys Eric van TolTalentEvent
 
Towards smart data strategies
Towards smart data strategiesTowards smart data strategies
Towards smart data strategiesEric Anvar
 
Donders neuroimage toolkit - open science and good practices
Donders neuroimage toolkit -  open science and good practicesDonders neuroimage toolkit -  open science and good practices
Donders neuroimage toolkit - open science and good practicesRobert Oostenveld
 
TCS Point of View Session - Analyze by Dr. Gautam Shroff, VP and Chief Scient...
TCS Point of View Session - Analyze by Dr. Gautam Shroff, VP and Chief Scient...TCS Point of View Session - Analyze by Dr. Gautam Shroff, VP and Chief Scient...
TCS Point of View Session - Analyze by Dr. Gautam Shroff, VP and Chief Scient...Tata Consultancy Services
 
CuttingEEG - Open Science, Open Data and BIDS for EEG
CuttingEEG - Open Science, Open Data and BIDS for EEGCuttingEEG - Open Science, Open Data and BIDS for EEG
CuttingEEG - Open Science, Open Data and BIDS for EEGRobert Oostenveld
 
Future of Business Intelligence keynote
Future of Business Intelligence keynoteFuture of Business Intelligence keynote
Future of Business Intelligence keynotepaul.hawking
 
Big Data - What's the Big Deal
Big Data - What's the Big DealBig Data - What's the Big Deal
Big Data - What's the Big DealDebarchan Sarkar
 
Whitepaper: Know Your Big Data – in 10 Minutes! - Happiest Minds
Whitepaper: Know Your Big Data – in 10 Minutes! - Happiest MindsWhitepaper: Know Your Big Data – in 10 Minutes! - Happiest Minds
Whitepaper: Know Your Big Data – in 10 Minutes! - Happiest MindsHappiest Minds Technologies
 
Computer Applications and Systems - Workshop V
Computer Applications and Systems - Workshop VComputer Applications and Systems - Workshop V
Computer Applications and Systems - Workshop VRaji Gogulapati
 
MAKING SENSE OF IOT DATA W/ BIG DATA + DATA SCIENCE - CHARLES CAI
MAKING SENSE OF IOT DATA W/ BIG DATA + DATA SCIENCE - CHARLES CAIMAKING SENSE OF IOT DATA W/ BIG DATA + DATA SCIENCE - CHARLES CAI
MAKING SENSE OF IOT DATA W/ BIG DATA + DATA SCIENCE - CHARLES CAIBig Data Week
 
Big data for the next generation of event companies
Big data for the next generation of event companiesBig data for the next generation of event companies
Big data for the next generation of event companiesRaj Anand
 
Big Data World Singapore 2017 - Moving Towards Digitization & Artificial Inte...
Big Data World Singapore 2017 - Moving Towards Digitization & Artificial Inte...Big Data World Singapore 2017 - Moving Towards Digitization & Artificial Inte...
Big Data World Singapore 2017 - Moving Towards Digitization & Artificial Inte...Garrett Teoh Hor Keong
 
Hitachi Data Systems Big Data Roadmap
Hitachi Data Systems Big Data RoadmapHitachi Data Systems Big Data Roadmap
Hitachi Data Systems Big Data RoadmapHitachi Vantara
 

Similar a Presentation Thesis Big Data (20)

Big data insights part i
Big data insights   part iBig data insights   part i
Big data insights part i
 
Mapping (big) data science (15 dec2014)대학(원)생
Mapping (big) data science (15 dec2014)대학(원)생Mapping (big) data science (15 dec2014)대학(원)생
Mapping (big) data science (15 dec2014)대학(원)생
 
McKegney -- Analytics in the Physical World
McKegney -- Analytics in the Physical WorldMcKegney -- Analytics in the Physical World
McKegney -- Analytics in the Physical World
 
Introduction to Big Data An analogy between Sugar Cane & Big Data
Introduction to Big Data An analogy  between Sugar Cane & Big DataIntroduction to Big Data An analogy  between Sugar Cane & Big Data
Introduction to Big Data An analogy between Sugar Cane & Big Data
 
Data Mining With Big Data
Data Mining With Big DataData Mining With Big Data
Data Mining With Big Data
 
Big Data 2.0
Big Data 2.0Big Data 2.0
Big Data 2.0
 
Data Scientist Enablement roadmap 1.0
Data Scientist Enablement roadmap 1.0Data Scientist Enablement roadmap 1.0
Data Scientist Enablement roadmap 1.0
 
Fontys Eric van Tol
Fontys Eric van TolFontys Eric van Tol
Fontys Eric van Tol
 
Towards smart data strategies
Towards smart data strategiesTowards smart data strategies
Towards smart data strategies
 
Donders neuroimage toolkit - open science and good practices
Donders neuroimage toolkit -  open science and good practicesDonders neuroimage toolkit -  open science and good practices
Donders neuroimage toolkit - open science and good practices
 
TCS Point of View Session - Analyze by Dr. Gautam Shroff, VP and Chief Scient...
TCS Point of View Session - Analyze by Dr. Gautam Shroff, VP and Chief Scient...TCS Point of View Session - Analyze by Dr. Gautam Shroff, VP and Chief Scient...
TCS Point of View Session - Analyze by Dr. Gautam Shroff, VP and Chief Scient...
 
CuttingEEG - Open Science, Open Data and BIDS for EEG
CuttingEEG - Open Science, Open Data and BIDS for EEGCuttingEEG - Open Science, Open Data and BIDS for EEG
CuttingEEG - Open Science, Open Data and BIDS for EEG
 
Future of Business Intelligence keynote
Future of Business Intelligence keynoteFuture of Business Intelligence keynote
Future of Business Intelligence keynote
 
Big Data - What's the Big Deal
Big Data - What's the Big DealBig Data - What's the Big Deal
Big Data - What's the Big Deal
 
Whitepaper: Know Your Big Data – in 10 Minutes! - Happiest Minds
Whitepaper: Know Your Big Data – in 10 Minutes! - Happiest MindsWhitepaper: Know Your Big Data – in 10 Minutes! - Happiest Minds
Whitepaper: Know Your Big Data – in 10 Minutes! - Happiest Minds
 
Computer Applications and Systems - Workshop V
Computer Applications and Systems - Workshop VComputer Applications and Systems - Workshop V
Computer Applications and Systems - Workshop V
 
MAKING SENSE OF IOT DATA W/ BIG DATA + DATA SCIENCE - CHARLES CAI
MAKING SENSE OF IOT DATA W/ BIG DATA + DATA SCIENCE - CHARLES CAIMAKING SENSE OF IOT DATA W/ BIG DATA + DATA SCIENCE - CHARLES CAI
MAKING SENSE OF IOT DATA W/ BIG DATA + DATA SCIENCE - CHARLES CAI
 
Big data for the next generation of event companies
Big data for the next generation of event companiesBig data for the next generation of event companies
Big data for the next generation of event companies
 
Big Data World Singapore 2017 - Moving Towards Digitization & Artificial Inte...
Big Data World Singapore 2017 - Moving Towards Digitization & Artificial Inte...Big Data World Singapore 2017 - Moving Towards Digitization & Artificial Inte...
Big Data World Singapore 2017 - Moving Towards Digitization & Artificial Inte...
 
Hitachi Data Systems Big Data Roadmap
Hitachi Data Systems Big Data RoadmapHitachi Data Systems Big Data Roadmap
Hitachi Data Systems Big Data Roadmap
 

Último

psychiatric nursing HISTORY COLLECTION .docx
psychiatric  nursing HISTORY  COLLECTION  .docxpsychiatric  nursing HISTORY  COLLECTION  .docx
psychiatric nursing HISTORY COLLECTION .docxPoojaSen20
 
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptxBasic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptxDenish Jangid
 
ComPTIA Overview | Comptia Security+ Book SY0-701
ComPTIA Overview | Comptia Security+ Book SY0-701ComPTIA Overview | Comptia Security+ Book SY0-701
ComPTIA Overview | Comptia Security+ Book SY0-701bronxfugly43
 
Sociology 101 Demonstration of Learning Exhibit
Sociology 101 Demonstration of Learning ExhibitSociology 101 Demonstration of Learning Exhibit
Sociology 101 Demonstration of Learning Exhibitjbellavia9
 
Class 11th Physics NEET formula sheet pdf
Class 11th Physics NEET formula sheet pdfClass 11th Physics NEET formula sheet pdf
Class 11th Physics NEET formula sheet pdfAyushMahapatra5
 
1029-Danh muc Sach Giao Khoa khoi 6.pdf
1029-Danh muc Sach Giao Khoa khoi  6.pdf1029-Danh muc Sach Giao Khoa khoi  6.pdf
1029-Danh muc Sach Giao Khoa khoi 6.pdfQucHHunhnh
 
Introduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The BasicsIntroduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The BasicsTechSoup
 
Beyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global ImpactBeyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global ImpactPECB
 
Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104misteraugie
 
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...christianmathematics
 
This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.christianmathematics
 
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptxMaritesTamaniVerdade
 
Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17Celine George
 
Micro-Scholarship, What it is, How can it help me.pdf
Micro-Scholarship, What it is, How can it help me.pdfMicro-Scholarship, What it is, How can it help me.pdf
Micro-Scholarship, What it is, How can it help me.pdfPoh-Sun Goh
 
ICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptxICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptxAreebaZafar22
 
Grant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy ConsultingGrant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy ConsultingTechSoup
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfciinovamais
 
ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.MaryamAhmad92
 
The basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptxThe basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptxheathfieldcps1
 
Measures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and ModeMeasures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and ModeThiyagu K
 

Último (20)

psychiatric nursing HISTORY COLLECTION .docx
psychiatric  nursing HISTORY  COLLECTION  .docxpsychiatric  nursing HISTORY  COLLECTION  .docx
psychiatric nursing HISTORY COLLECTION .docx
 
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptxBasic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
 
ComPTIA Overview | Comptia Security+ Book SY0-701
ComPTIA Overview | Comptia Security+ Book SY0-701ComPTIA Overview | Comptia Security+ Book SY0-701
ComPTIA Overview | Comptia Security+ Book SY0-701
 
Sociology 101 Demonstration of Learning Exhibit
Sociology 101 Demonstration of Learning ExhibitSociology 101 Demonstration of Learning Exhibit
Sociology 101 Demonstration of Learning Exhibit
 
Class 11th Physics NEET formula sheet pdf
Class 11th Physics NEET formula sheet pdfClass 11th Physics NEET formula sheet pdf
Class 11th Physics NEET formula sheet pdf
 
1029-Danh muc Sach Giao Khoa khoi 6.pdf
1029-Danh muc Sach Giao Khoa khoi  6.pdf1029-Danh muc Sach Giao Khoa khoi  6.pdf
1029-Danh muc Sach Giao Khoa khoi 6.pdf
 
Introduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The BasicsIntroduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The Basics
 
Beyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global ImpactBeyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global Impact
 
Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104
 
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
 
This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.
 
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
 
Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17
 
Micro-Scholarship, What it is, How can it help me.pdf
Micro-Scholarship, What it is, How can it help me.pdfMicro-Scholarship, What it is, How can it help me.pdf
Micro-Scholarship, What it is, How can it help me.pdf
 
ICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptxICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptx
 
Grant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy ConsultingGrant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy Consulting
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdf
 
ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.
 
The basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptxThe basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptx
 
Measures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and ModeMeasures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and Mode
 

Presentation Thesis Big Data

  • 1. 1 AN ADVENTUROUS JOURNEY THROUGH THE FIELD OF BIG DATA
  • 2. P ROGRAMME  Concept de ma thèse  Étude de la littérature  Cas: FOD Justice  Cas: Adswizz  Démo  Conclusion 2
  • 3. 3 C ONCEPT DE MA THÈSE  M’initier au Big Data   Expérimenter avec les machines virtuelles (HortonWorks)   Contacts externes, événements, Médias sociaux, webinars Réunions sur BigData.be (+pratique) Projet  FOD Justice  SAS Visual Analytics  UITDAGING Configurer un environnement de Big Data (HDP)  INNOVATIE Adswizz (‘réserve’) OPPORTUNITEIT
  • 4. 4 T HESIS  Data aspect  Volume, variëteit en velocity   External data Technological aspect   HADOOP MOBILE Distributed (HDFS/MapReduce) Analytical aspect   Prescriptive Externe data Predictive CLOUD SOCIAL MEDIA
  • 5. T HESIS  Customer churn  Fraudulent transactions  Customer insight  Discover new patterns between data 5
  • 6. T HESIS 1. Research 2. Formulate opportunities 3. Develop use case(s) 4. Identify requirements 5. Set-up testing environment 6. Evaluate results 6
  • 7. 7 C ASE : FOD J USTITIE Duidelijke afspraken 2. Scope afgebakend 3. Project goedgekeurd 4. Veelheid aan procedures 5. Moeilijke communicatie 6. SAS Visual Analytics “ PROCEDURES COMMUNICATIE A man’s errors are his portals of discovery. by James Joyce “ 1.
  • 8. CASE: A DSWIZZ  Injectie advertenties  Logfiles  75GB  750GB/maand  Amazon S3 & EMR  WEBLOGS Internet radio webstreams  8 Pig scripts SCRIPTS Skill to do comes from doing. by Ralph Waldo Emerson “ “ PIG
  • 9. 9 DEMO by Anton Chekhov “ “ Knowledge is of no value unless you put it into practice.
  • 10. B ESLUIT A LG E M E E N :  Big Data is een ‘hot’ topic  Uitbreiding op klassieke Business Intelligence  Wordt steeds belangrijker  Vereist nieuwe kennis (Analytics, Pig/Hive, Linux, … )  Goede voorbereiding en klein beginnen P E RS O O N L I J K :  Boeiende en leerrijk traject  Communicatie, Toepassing Big Data, PigQL, SAS Programming & VA  Ontwikkeling professionele attitude  Aan een interessante & uitdagende job geholpen 10
  • 11. 11 VRAGEN? by George Bernard Shaw “ “ No question is so difficult to answer as that to which the answer is obvious.

Notas del editor

  1. Bonsoir tout le monde, je m’appelle Natan et le dernière neuf mois j’ai travaillé sur le topique de ‘Big Data’. C’est faisait une voyage aventureux qui j’ai beaucoup d’appris et je suis vraiment content j’ai choisis ce topique. Les dix minutes prochain je vais vous donnez un peu plus d’information comme ma thèse et les projets que j’ai travaillé.
  2. IntroductionPe programme pour ce soir: je vais vous expliquer le concept de ma thèse, quelque chose des projet lesquelles j’ai travaillé et vous donnez un démo de ‘SAS Visual Analytics’ et Pig scripts. Je vais finir avec un conclusion.
  3. L’objectifinitialétaitd’étudier de manièrethéorique , de me documenter et d’étudierle monde des Big Data et d’appliquer mes connaissancesthéoriques à unprojetconcretchez FOD Justice. Pour réalisercelaj’aiparticipé à des événements Big Data, j’y ai interagi, j’aisuivi des Webinars, j’aiconsulté en détails les médiassociaux et j’ai fait intervenir des contactsexternes. Ce sontvraimentles meilleurschemins pour en apprendre plus sur les Big Data et vraimentcomprendre les aspectsconcrets et pratiquesliésaux Big Data.Au ministère de la Justice, ma mission était de construireunenvironnementaveccinqserveurs et la plateforme de donnés de HortonWorks (HDP) avec comme but de transformer les données. Ma mission étaitaussi de travaillersurleserveurdémo de SAS Visual Analytics.