Apache Pig

•Descargar como PPT, PDF•

2 recomendaciones•749 vistas

Jéferson Machado

Tecnología Empresariales

What Pig does ?

Extensible (Pig Latin)
UDFs (User Defined Functions)

Local mode
Map reduce mode (requires a
hadoop cluster) - Default

Example

File: /etc/passwd

PIG LATIN
Input / output

Debugging

•LOAD
•STORE

•DUMP
•DESCRIBLE
•EXPLAIN
•ILLUSTRATE

Working with Data
•FILTER
•FOREACH
•GROUP
•UNION
•SPLIT

slideshare.net/jefersonm

twitter.com/jefersonm

github.com/jefersonm

slideshare.net/jefersonm

twitter.com/jefersonm

github.com/jefersonm

Más contenido relacionado

Destacado

Business model generation

Business model generation

Business model generationJéferson Machado

Agile Coaching P2

Agile Coaching P2

Agile Coaching P2Diego Pacheco

1 jeferson (grow)

1 jeferson (grow)

1 jeferson (grow)Jéferson Machado

GROWJéferson Machado

AngularJSJéferson Machado

Management 3.0Jéferson Machado

Python - basics

Python - basics

Python - basicsJéferson Machado

Management 3.0, como evoluir pessoas em conjunto com sua organização.

Management 3.0, como evoluir pessoas em conjunto com sua organização.

Management 3.0, como evoluir pessoas em conjunto com sua organização.Jéferson Machado

Apache SparkJéferson Machado

Distributed Data Analysis with Hadoop and R - Strangeloop 2011

Distributed Data Analysis with Hadoop and R - Strangeloop 2011

Distributed Data Analysis with Hadoop and R - Strangeloop 2011Jonathan Seidman

Agile Restropective

Agile Restropective

Agile RestropectiveMarcos Alves

Lean & T.O.CJéferson Machado

Responsive Design

Responsive Design

Responsive DesignMarcos Alves

Apache pigMudassir Khan Pathan

Apache pigSuresh Mandava

Plano de carreira, isso funciona ? Me consegue uma bússola por favor. (Agile...

Plano de carreira, isso funciona ? Me consegue uma bússola por favor. (Agile...

Plano de carreira, isso funciona ? Me consegue uma bússola por favor. (Agile...Jéferson Machado

Metodologias Ageis

Metodologias Ageis

Metodologias AgeisMarcosMaozinha

Coaching e Autodesenvolvimento: Transformando a Cultura de Desenvolvimento de...

Coaching e Autodesenvolvimento: Transformando a Cultura de Desenvolvimento de...

Coaching e Autodesenvolvimento: Transformando a Cultura de Desenvolvimento de...Marcos Alves

How to innovate ?

How to innovate ?

How to innovate ?Jéferson Machado

Kanban metricsJéferson Machado

Destacado (20)

Business model generation

Business model generation

Business model generation

Agile Coaching P2

Agile Coaching P2

Agile Coaching P2

1 jeferson (grow)

1 jeferson (grow)

1 jeferson (grow)

GROW

AngularJS

Management 3.0

Python - basics

Python - basics

Python - basics

Management 3.0, como evoluir pessoas em conjunto com sua organização.

Management 3.0, como evoluir pessoas em conjunto com sua organização.

Management 3.0, como evoluir pessoas em conjunto com sua organização.

Apache Spark

Distributed Data Analysis with Hadoop and R - Strangeloop 2011

Distributed Data Analysis with Hadoop and R - Strangeloop 2011

Distributed Data Analysis with Hadoop and R - Strangeloop 2011

Agile Restropective

Agile Restropective

Agile Restropective

Lean & T.O.C

Responsive Design

Responsive Design

Responsive Design

Apache pig

Apache pig

Plano de carreira, isso funciona ? Me consegue uma bússola por favor. (Agile...

Plano de carreira, isso funciona ? Me consegue uma bússola por favor. (Agile...

Plano de carreira, isso funciona ? Me consegue uma bússola por favor. (Agile...

Metodologias Ageis

Metodologias Ageis

Metodologias Ageis

Coaching e Autodesenvolvimento: Transformando a Cultura de Desenvolvimento de...

Coaching e Autodesenvolvimento: Transformando a Cultura de Desenvolvimento de...

Coaching e Autodesenvolvimento: Transformando a Cultura de Desenvolvimento de...

How to innovate ?

How to innovate ?

How to innovate ?

Kanban metrics

Más de Jéferson Machado

druid.ioJéferson Machado

Apache Spark Internals - Part 2

Apache Spark Internals - Part 2

Apache Spark Internals - Part 2Jéferson Machado

Node.js, is it the solution for every problem?

Node.js, is it the solution for every problem?

Node.js, is it the solution for every problem?Jéferson Machado

Management 3.0 (TDC 2015)

Management 3.0 (TDC 2015)

Management 3.0 (TDC 2015)Jéferson Machado

Apache HBaseJéferson Machado

ScalaJéferson Machado

Theory of constraints

Theory of constraints

Theory of constraintsJéferson Machado

Spring MVCJéferson Machado

Continuous integration

Continuous integration

Continuous integrationJéferson Machado

WebpyJéferson Machado

GradleJéferson Machado

PadrinoJéferson Machado

Haskell scala exercises presentation

Haskell scala exercises presentation

Haskell scala exercises presentationJéferson Machado

RabbitMQJéferson Machado

Clojure presentation

Clojure presentation

Clojure presentationJéferson Machado

ErjangJéferson Machado

Clojure noirJéferson Machado

Clojure LDC 5Jéferson Machado

Más de Jéferson Machado (18)

druid.io

Apache Spark Internals - Part 2

Apache Spark Internals - Part 2

Apache Spark Internals - Part 2

Node.js, is it the solution for every problem?

Node.js, is it the solution for every problem?

Node.js, is it the solution for every problem?

Management 3.0 (TDC 2015)

Management 3.0 (TDC 2015)

Management 3.0 (TDC 2015)

Apache HBase

Scala

Theory of constraints

Theory of constraints

Theory of constraints

Spring MVC

Continuous integration

Continuous integration

Continuous integration

Webpy

Gradle

Padrino

Haskell scala exercises presentation

Haskell scala exercises presentation

Haskell scala exercises presentation

RabbitMQ

Clojure presentation

Clojure presentation

Clojure presentation

Erjang

Clojure noir

Clojure LDC 5

Último

Exploring the Future Potential of AI-Enabled Smartphone Processors

Exploring the Future Potential of AI-Enabled Smartphone Processors

Exploring the Future Potential of AI-Enabled Smartphone Processorsdebabhi2

The 7 Things I Know About Cyber Security After 25 Years | April 2024

The 7 Things I Know About Cyber Security After 25 Years | April 2024

The 7 Things I Know About Cyber Security After 25 Years | April 2024Rafal Los

What Are The Drone Anti-jamming Systems Technology?

What Are The Drone Anti-jamming Systems Technology?

What Are The Drone Anti-jamming Systems Technology?Antenna Manufacturer Coco

🐬 The future of MySQL is Postgres 🐘

🐬 The future of MySQL is Postgres 🐘

🐬 The future of MySQL is Postgres 🐘RTylerCroy

CNv6 Instructor Chapter 6 Quality of Service

CNv6 Instructor Chapter 6 Quality of Service

CNv6 Instructor Chapter 6 Quality of Servicegiselly40

How to Troubleshoot Apps for the Modern Connected Worker

How to Troubleshoot Apps for the Modern Connected Worker

How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes

Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...

Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...

Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Miguel Araújo

EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx

EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx

EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEarley Information Science

Boost Fertility New Invention Ups Success Rates.pdf

Boost Fertility New Invention Ups Success Rates.pdf

Boost Fertility New Invention Ups Success Rates.pdfsudhanshuwaghmare1

Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...

Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...

Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...Neo4j

2024: Domino Containers - The Next Step. News from the Domino Container commu...

2024: Domino Containers - The Next Step. News from the Domino Container commu...

2024: Domino Containers - The Next Step. News from the Domino Container commu...Martijn de Jong

Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...

Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...

Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...apidays

Scaling API-first – The story of a global engineering organization

Scaling API-first – The story of a global engineering organization

Scaling API-first – The story of a global engineering organizationRadu Cotescu

08448380779 Call Girls In Greater Kailash - I Women Seeking Men

08448380779 Call Girls In Greater Kailash - I Women Seeking Men

08448380779 Call Girls In Greater Kailash - I Women Seeking MenDelhi Call girls

08448380779 Call Girls In Friends Colony Women Seeking Men

08448380779 Call Girls In Friends Colony Women Seeking Men

08448380779 Call Girls In Friends Colony Women Seeking MenDelhi Call girls

04-2024-HHUG-Sales-and-Marketing-Alignment.pptx

04-2024-HHUG-Sales-and-Marketing-Alignment.pptx

04-2024-HHUG-Sales-and-Marketing-Alignment.pptxHampshireHUG

Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024

Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024

Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024The Digital Insurer

GenAI Risks & Security Meetup 01052024.pdf

GenAI Risks & Security Meetup 01052024.pdf

GenAI Risks & Security Meetup 01052024.pdflior mazor

Driving Behavioral Change for Information Management through Data-Driven Gree...

Driving Behavioral Change for Information Management through Data-Driven Gree...

Driving Behavioral Change for Information Management through Data-Driven Gree...Enterprise Knowledge

Artificial Intelligence: Facts and Myths

Artificial Intelligence: Facts and Myths

Artificial Intelligence: Facts and MythsJoaquim Jorge

Último (20)

Exploring the Future Potential of AI-Enabled Smartphone Processors

Exploring the Future Potential of AI-Enabled Smartphone Processors

Exploring the Future Potential of AI-Enabled Smartphone Processors

The 7 Things I Know About Cyber Security After 25 Years | April 2024

The 7 Things I Know About Cyber Security After 25 Years | April 2024

The 7 Things I Know About Cyber Security After 25 Years | April 2024

What Are The Drone Anti-jamming Systems Technology?

What Are The Drone Anti-jamming Systems Technology?

What Are The Drone Anti-jamming Systems Technology?

🐬 The future of MySQL is Postgres 🐘

🐬 The future of MySQL is Postgres 🐘

🐬 The future of MySQL is Postgres 🐘

CNv6 Instructor Chapter 6 Quality of Service

CNv6 Instructor Chapter 6 Quality of Service

CNv6 Instructor Chapter 6 Quality of Service

How to Troubleshoot Apps for the Modern Connected Worker

How to Troubleshoot Apps for the Modern Connected Worker

How to Troubleshoot Apps for the Modern Connected Worker

Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...

Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...

Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...

EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx

EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx

EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx

Boost Fertility New Invention Ups Success Rates.pdf

Boost Fertility New Invention Ups Success Rates.pdf

Boost Fertility New Invention Ups Success Rates.pdf

Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...

Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...

Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...

2024: Domino Containers - The Next Step. News from the Domino Container commu...

2024: Domino Containers - The Next Step. News from the Domino Container commu...

2024: Domino Containers - The Next Step. News from the Domino Container commu...

Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...

Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...

Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...

Scaling API-first – The story of a global engineering organization

Scaling API-first – The story of a global engineering organization

Scaling API-first – The story of a global engineering organization

08448380779 Call Girls In Greater Kailash - I Women Seeking Men

08448380779 Call Girls In Greater Kailash - I Women Seeking Men

08448380779 Call Girls In Greater Kailash - I Women Seeking Men

08448380779 Call Girls In Friends Colony Women Seeking Men

08448380779 Call Girls In Friends Colony Women Seeking Men

08448380779 Call Girls In Friends Colony Women Seeking Men

04-2024-HHUG-Sales-and-Marketing-Alignment.pptx

04-2024-HHUG-Sales-and-Marketing-Alignment.pptx

04-2024-HHUG-Sales-and-Marketing-Alignment.pptx

Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024

Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024

Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024

GenAI Risks & Security Meetup 01052024.pdf

GenAI Risks & Security Meetup 01052024.pdf

GenAI Risks & Security Meetup 01052024.pdf

Driving Behavioral Change for Information Management through Data-Driven Gree...

Driving Behavioral Change for Information Management through Data-Driven Gree...

Driving Behavioral Change for Information Management through Data-Driven Gree...

Artificial Intelligence: Facts and Myths

Artificial Intelligence: Facts and Myths

Artificial Intelligence: Facts and Myths

Apache Pig

1.

2. What Pig does ?

3. Extensible (Pig Latin) UDFs (User Defined Functions)

4. Local mode Map reduce mode (requires a hadoop cluster) - Default

5. Example File: /etc/passwd

6. PIG LATIN Input / output Debugging •LOAD •STORE •DUMP •DESCRIBLE •EXPLAIN •ILLUSTRATE Working with Data •FILTER •FOREACH •GROUP •UNION •SPLIT

7.

8.

9. slideshare.net/jefersonm twitter.com/jefersonm github.com/jefersonm

10. slideshare.net/jefersonm twitter.com/jefersonm github.com/jefersonm