Analyzing Oracle Query Logs Using Xadoop and Pig

•Descargar como PPT, PDF•

2 recomendaciones•1,612 vistas

Maxim Grinev

Overview of our data analytics work given to Microsoft SQL Server guys during their visit to Systems Group, ETH Zurich

Tecnología

Systems Group Dept. Computer Science ETH Zurich - Switzerland Xadoop – new approaches to data analytics Lukas Blunschi, Maxim Grinev , Maria Grineva, Donald Kossmann, Georg Polzer, Kurt Stockinger (Credit Suisse)

Credit Suisse Project ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Possible Solutions ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Hadoop Solution 1: Using Pig ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Hadoop Solution 1: Pig Example ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Hadoop Solution 1: Experiments 38m 10s 26m 20s 11m 05s 5 workers 59m 20s 40m 30s 19m 00s 3 workers 90 Gb 60 Gb 30 Gb

Hadoop Solution 2: Using XQuery ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Hadoop Solution 2: Using XQuery ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Future Work: Vision ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Future work: Issues ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Más contenido relacionado

La actualidad más candente

Spark - Alexis Seigneurin (English)Alexis Seigneurin

Spark what's new what's comingDatabricks

Real-time Data Analytics mit Elasticsearchinovex GmbH

2014 09-12 lambda-architecture-at-indixYu Ishikawa

SparkR: The Past, the Present and the Future-(Shivaram Venkataraman and Rui S...Spark Summit

High-Performance Analytics with Probabilistic Data Structures: the Power of H...Databricks

Dremel: Interactive Analysis of Web-Scale Datasets robertlz

Hadoop workshopPurna Chander

SparkR-Advance Analytic for Big Datasamuel shamiri

Getting Started with PostGIS geographic database - Lasma Sietinsone, EDINAJISC GECO

Getting started with PostGIS geographic databaseEDINA, University of Edinburgh

Small intro to Big Data - Old versionSoftwareMill

Cost-Based Optimizer Framework for Spark SQL: Spark Summit East talk by Ron H...Spark Summit

report on aadhaar anlysis using bid data hadoop and hivesiddharthboora

A look ahead at spark 2.0 Databricks

introduction to data processing using Hadoop and PigRicardo Varela

Visualizing big data in the browser using sparkDatabricks

Implementing HDF5 in MATLABThe HDF-EOS Tools and Information Center

Google's DremelMaria Stylianou

Practical Large Scale Experiences with Spark 2.0 Machine Learning: Spark Summ...Spark Summit

La actualidad más candente (20)

Spark - Alexis Seigneurin (English)

Spark what's new what's coming

Real-time Data Analytics mit Elasticsearch

2014 09-12 lambda-architecture-at-indix

SparkR: The Past, the Present and the Future-(Shivaram Venkataraman and Rui S...

High-Performance Analytics with Probabilistic Data Structures: the Power of H...

Dremel: Interactive Analysis of Web-Scale Datasets

Hadoop workshop

SparkR-Advance Analytic for Big Data

Getting Started with PostGIS geographic database - Lasma Sietinsone, EDINA

Getting started with PostGIS geographic database

Small intro to Big Data - Old version

Cost-Based Optimizer Framework for Spark SQL: Spark Summit East talk by Ron H...

report on aadhaar anlysis using bid data hadoop and hive

A look ahead at spark 2.0

introduction to data processing using Hadoop and Pig

Visualizing big data in the browser using spark

Implementing HDF5 in MATLAB

Google's Dremel

Practical Large Scale Experiences with Spark 2.0 Machine Learning: Spark Summ...

Similar a Analyzing Oracle Query Logs Using Xadoop and Pig

hadoop&zingzingopen

Hadoop & ZingLong Dao

Hadoop World 2011: Building Web Analytics Processing on Hadoop at CBS Interac...Cloudera, Inc.

Big data week presentationJoseph Adler

M7 and Apache Drill, Micheal HausenblasModern Data Stack France

New Developments in SparkDatabricks

Berlin Buzz Words - Apache Drill by Ted Dunning & Michael HausenblasMapR Technologies

Large scale, interactive ad-hoc queries over different datastores with Apache...jaxLondonConference

Clogeny Hadoop ecosystem - an overviewMadhur Nawandar

Inroduction to Big DataOmnia Safaan

Leveraging Hadoop in your PostgreSQL EnvironmentJim Mlodgenski

A look under the hood at Apache Spark's API and engine evolutionsDatabricks

Paris Data Geek - Spark Streaming Djamel Zouaoui

Data ScienceSubhajit75

Emerging technologies /frameworks in Big DataRahul Jain

HKOSCon18 - Chetan Khatri - Scaling TB's of Data with Apache Spark and Scala ...Chetan Khatri

Brief Intro to Apache Spark @ Stanford ICMEPaco Nathan

BuildingsocialanalyticstoolwithmongodbMongoDB APAC

Hadoop Hive Talk At IIT-DelhiJoydeep Sen Sarma

AWS Hadoop and PIG and overviewDan Morrill

Similar a Analyzing Oracle Query Logs Using Xadoop and Pig (20)

hadoop&zing

Hadoop & Zing

Hadoop World 2011: Building Web Analytics Processing on Hadoop at CBS Interac...

Big data week presentation

M7 and Apache Drill, Micheal Hausenblas

New Developments in Spark

Berlin Buzz Words - Apache Drill by Ted Dunning & Michael Hausenblas

Large scale, interactive ad-hoc queries over different datastores with Apache...

Clogeny Hadoop ecosystem - an overview

Inroduction to Big Data

Leveraging Hadoop in your PostgreSQL Environment

A look under the hood at Apache Spark's API and engine evolutions

Paris Data Geek - Spark Streaming

Data Science

Emerging technologies /frameworks in Big Data

HKOSCon18 - Chetan Khatri - Scaling TB's of Data with Apache Spark and Scala ...

Brief Intro to Apache Spark @ Stanford ICME

Buildingsocialanalyticstoolwithmongodb

Hadoop Hive Talk At IIT-Delhi

AWS Hadoop and PIG and overview

Último

Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...apidays

Finology Group – Insurtech Innovation Award 2024The Digital Insurer

08448380779 Call Girls In Civil Lines Women Seeking MenDelhi Call girls

🐬 The future of MySQL is Postgres 🐘RTylerCroy

Artificial Intelligence: Facts and MythsJoaquim Jorge

Boost Fertility New Invention Ups Success Rates.pdfsudhanshuwaghmare1

Tata AIG General Insurance Company - Insurer Innovation Award 2024The Digital Insurer

How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes

Factors to Consider When Choosing Accounts Payable Services Providers.pptxKatpro Technologies

Breaking the Kubernetes Kill Chain: Host Path MountPuma Security, LLC

Axa Assurance Maroc - Insurer Innovation Award 2024The Digital Insurer

What Are The Drone Anti-jamming Systems Technology?Antenna Manufacturer Coco

Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Igalia

A Call to Action for Generative AI in 2024Results

How to convert PDF to text with Nanonetsnaman860154

08448380779 Call Girls In Diplomatic Enclave Women Seeking MenDelhi Call girls

Scaling API-first – The story of a global engineering organizationRadu Cotescu

IAC 2024 - IA Fast Track to Search Focused AI SolutionsEnterprise Knowledge

The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfEnterprise Knowledge

Data Cloud, More than a CDP by Matt RobisonAnna Loughnan Colquhoun