SlideShare uma empresa Scribd logo
1 de 14
Baixar para ler offline
PDI – Muito além de Business Intelligence

www.knowsolution.com.br

PDI - KETTLE
Muito Além de Business Intelligence

Leandro Guimarães
PDI – Muito além de Business Intelligence

www.knowsolution.com.br

O Que é o PDI?
•  Pentaho Data Integration - Conhecido como Kettle;
•  Faz parte da suite de ferramentas Pentaho;
•  Ferramenta de ETL (Extract, Transform, Load);
•  Interface gráfica (Drag and Drop);
www.knowsolution.com.br

PDI – Muito além de Business Intelligence

Processo ETL
Extract

Transform

Load

Dimensional

Bancos de Dados,
Excel, etc..

Relacional
PDI – Muito além de Business Intelligence

Fontes de Dados (Extract)
•  Mais de 35 Tipos de
Fontes de Dados
•  Conexão com Bancos de
dados via JDBC
•  Arquivos Excel, csv,
tamanho fixo
•  Leitura de E-mails
•  Json
•  Serviços REST
•  Serviços SOAP
•  …

www.knowsolution.com.br
PDI – Muito além de Business Intelligence

Ferramentas (Transform)
•  Cálculos;
•  Joins;
•  Group by;
•  Sort;
•  WebServices;
•  SSH;
•  JavaScript;
•  …

www.knowsolution.com.br
PDI – Muito além de Business Intelligence

Saídas (Load)
•  Loading em Bancos de Dados
via JDBC
•  Arquivos Excel
•  RSS
•  XML
•  HTTP
•  Json
•  Arquivos Texto
•  E-mail

www.knowsolution.com.br
PDI – Muito além de Business Intelligence

www.knowsolution.com.br

Exemplo Prático 1
•  Importação de uma Planilha Excel com clientes para uma

tabela PostgreSQL;
•  Inserir ordenado por ID;
•  Primeiro nome deve estar em coluna separada;

•  Tempo Aproximado: 8 minutos (Buscar_Clientes)
PDI – Muito além de Business Intelligence

www.knowsolution.com.br

Exemplo Prático 2
•  Ler vendas de uma tabela PostgreSQL;
•  Analisar cotação da moeda via WS;
•  Exportar para planilha Excel com o valor da cotação.
•  Tempo Aproximado: 10 minutos (Exportar Vendas)
PDI – Muito além de Business Intelligence

www.knowsolution.com.br

Exemplo Prático 3
•  Enviar como arquivo anexo a planilha gerada pelo

Exemplo 2 para um e-mail específico;
•  Tempo Aproximado: 7 minutos
PDI – Muito além de Business Intelligence

www.knowsolution.com.br

Kitchen
•  Ferramenta para execução de Jobs via linha de comando;
•  Possibilidade de agendar via crontab, Agendador de

Tarefas, etc…
•  sh kitchen.sh /rep:1 /job:PostSale_Job /user:***

/pass:*** /logfile:/home/pentaho/logs/etl/kettle.log
/level:Debug
PDI – Muito além de Business Intelligence

O Lado Negro da Força

www.knowsolution.com.br
PDI – Muito além de Business Intelligence

O Lado Negro da Força 2

www.knowsolution.com.br
PDI – Muito além de Business Intelligence

www.knowsolution.com.br

Onde se aprofundar?
•  Lista de discussão: pentahobr@yahoo.com.br
•  Wiki: www.wiki.pentaho.com
•  Blog Know Solutions: www.knowsolution.com.br
•  Contato direto: leandro@knowsolution.com.br
www.knowsolution.com.br

PDI – Muito além de Business Intelligence

Obrigado!
Dúvidas?
Contato:
leandro@knowsolution.com

Mais conteúdo relacionado

Destaque

2024 State of Marketing Report – by Hubspot
2024 State of Marketing Report – by Hubspot2024 State of Marketing Report – by Hubspot
2024 State of Marketing Report – by HubspotMarius Sescu
 
Everything You Need To Know About ChatGPT
Everything You Need To Know About ChatGPTEverything You Need To Know About ChatGPT
Everything You Need To Know About ChatGPTExpeed Software
 
Product Design Trends in 2024 | Teenage Engineerings
Product Design Trends in 2024 | Teenage EngineeringsProduct Design Trends in 2024 | Teenage Engineerings
Product Design Trends in 2024 | Teenage EngineeringsPixeldarts
 
How Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental HealthHow Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental HealthThinkNow
 
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdfAI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdfmarketingartwork
 
PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024Neil Kimberley
 
Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)contently
 
How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024Albert Qian
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsKurio // The Social Media Age(ncy)
 
Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Search Engine Journal
 
5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summarySpeakerHub
 
ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd Clark Boyd
 
Getting into the tech field. what next
Getting into the tech field. what next Getting into the tech field. what next
Getting into the tech field. what next Tessa Mero
 
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentGoogle's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentLily Ray
 
Time Management & Productivity - Best Practices
Time Management & Productivity -  Best PracticesTime Management & Productivity -  Best Practices
Time Management & Productivity - Best PracticesVit Horky
 
The six step guide to practical project management
The six step guide to practical project managementThe six step guide to practical project management
The six step guide to practical project managementMindGenius
 
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...RachelPearson36
 

Destaque (20)

2024 State of Marketing Report – by Hubspot
2024 State of Marketing Report – by Hubspot2024 State of Marketing Report – by Hubspot
2024 State of Marketing Report – by Hubspot
 
Everything You Need To Know About ChatGPT
Everything You Need To Know About ChatGPTEverything You Need To Know About ChatGPT
Everything You Need To Know About ChatGPT
 
Product Design Trends in 2024 | Teenage Engineerings
Product Design Trends in 2024 | Teenage EngineeringsProduct Design Trends in 2024 | Teenage Engineerings
Product Design Trends in 2024 | Teenage Engineerings
 
How Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental HealthHow Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental Health
 
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdfAI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
 
Skeleton Culture Code
Skeleton Culture CodeSkeleton Culture Code
Skeleton Culture Code
 
PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024
 
Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)
 
How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie Insights
 
Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024
 
5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary
 
ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd
 
Getting into the tech field. what next
Getting into the tech field. what next Getting into the tech field. what next
Getting into the tech field. what next
 
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentGoogle's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search Intent
 
How to have difficult conversations
How to have difficult conversations How to have difficult conversations
How to have difficult conversations
 
Introduction to Data Science
Introduction to Data ScienceIntroduction to Data Science
Introduction to Data Science
 
Time Management & Productivity - Best Practices
Time Management & Productivity -  Best PracticesTime Management & Productivity -  Best Practices
Time Management & Productivity - Best Practices
 
The six step guide to practical project management
The six step guide to practical project managementThe six step guide to practical project management
The six step guide to practical project management
 
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
 

PDI - Muito além de Business Intelligence

  • 1. PDI – Muito além de Business Intelligence www.knowsolution.com.br PDI - KETTLE Muito Além de Business Intelligence Leandro Guimarães
  • 2. PDI – Muito além de Business Intelligence www.knowsolution.com.br O Que é o PDI? •  Pentaho Data Integration - Conhecido como Kettle; •  Faz parte da suite de ferramentas Pentaho; •  Ferramenta de ETL (Extract, Transform, Load); •  Interface gráfica (Drag and Drop);
  • 3. www.knowsolution.com.br PDI – Muito além de Business Intelligence Processo ETL Extract Transform Load Dimensional Bancos de Dados, Excel, etc.. Relacional
  • 4. PDI – Muito além de Business Intelligence Fontes de Dados (Extract) •  Mais de 35 Tipos de Fontes de Dados •  Conexão com Bancos de dados via JDBC •  Arquivos Excel, csv, tamanho fixo •  Leitura de E-mails •  Json •  Serviços REST •  Serviços SOAP •  … www.knowsolution.com.br
  • 5. PDI – Muito além de Business Intelligence Ferramentas (Transform) •  Cálculos; •  Joins; •  Group by; •  Sort; •  WebServices; •  SSH; •  JavaScript; •  … www.knowsolution.com.br
  • 6. PDI – Muito além de Business Intelligence Saídas (Load) •  Loading em Bancos de Dados via JDBC •  Arquivos Excel •  RSS •  XML •  HTTP •  Json •  Arquivos Texto •  E-mail www.knowsolution.com.br
  • 7. PDI – Muito além de Business Intelligence www.knowsolution.com.br Exemplo Prático 1 •  Importação de uma Planilha Excel com clientes para uma tabela PostgreSQL; •  Inserir ordenado por ID; •  Primeiro nome deve estar em coluna separada; •  Tempo Aproximado: 8 minutos (Buscar_Clientes)
  • 8. PDI – Muito além de Business Intelligence www.knowsolution.com.br Exemplo Prático 2 •  Ler vendas de uma tabela PostgreSQL; •  Analisar cotação da moeda via WS; •  Exportar para planilha Excel com o valor da cotação. •  Tempo Aproximado: 10 minutos (Exportar Vendas)
  • 9. PDI – Muito além de Business Intelligence www.knowsolution.com.br Exemplo Prático 3 •  Enviar como arquivo anexo a planilha gerada pelo Exemplo 2 para um e-mail específico; •  Tempo Aproximado: 7 minutos
  • 10. PDI – Muito além de Business Intelligence www.knowsolution.com.br Kitchen •  Ferramenta para execução de Jobs via linha de comando; •  Possibilidade de agendar via crontab, Agendador de Tarefas, etc… •  sh kitchen.sh /rep:1 /job:PostSale_Job /user:*** /pass:*** /logfile:/home/pentaho/logs/etl/kettle.log /level:Debug
  • 11. PDI – Muito além de Business Intelligence O Lado Negro da Força www.knowsolution.com.br
  • 12. PDI – Muito além de Business Intelligence O Lado Negro da Força 2 www.knowsolution.com.br
  • 13. PDI – Muito além de Business Intelligence www.knowsolution.com.br Onde se aprofundar? •  Lista de discussão: pentahobr@yahoo.com.br •  Wiki: www.wiki.pentaho.com •  Blog Know Solutions: www.knowsolution.com.br •  Contato direto: leandro@knowsolution.com.br
  • 14. www.knowsolution.com.br PDI – Muito além de Business Intelligence Obrigado! Dúvidas? Contato: leandro@knowsolution.com