SlideShare una empresa de Scribd logo
1 de 24
Descargar para leer sin conexión
HUE+SDK




HOW TO GET STARTED






Romain Rigaux

Cloudera - Feb 20, 2014
What is Hue?

HUE 1

Desktop-­‐like	
  in	
  a	
  browser,	
  did	
  its	
  
job	
  but	
  pretty	
  slow,	
  memory	
  leaks	
  
and	
  not	
  very	
  IE	
  friendly	
  but	
  
definitely	
  advanced	
  for	
  its	
  time	
  
(2009-­‐2010).
HISTORY

HUE 2

The	
  first	
  flat	
  structure	
  port,	
  with	
  
Twitter	
  Bootstrap	
  all	
  over	
  the	
  
place.
HISTORY

HUE 2.5

New	
  apps,	
  improved	
  the	
  UX	
  
adding	
  new	
  nice	
  functionalities	
  
like	
  autocomplete	
  and	
  drag	
  &	
  
drop.
HISTORY

HUE 3 ALPHA

Proposed	
  design,	
  didn’t	
  make	
  it.
HISTORY

HUE 3

Transition	
  to	
  the	
  new	
  UI,	
  major	
  
improvements	
  and	
  new	
  apps.
HISTORY
HUE 3.5+
RE

TO

ET
AS

M

BR

ER

R

...

O
SQ
W
SE
O
ZO
O
R
P
O
KE
EP
ER
U
SE
R
AD
M
DB IN
Q
U
ER
Y
SP
AR
K
H
O
M
E

SE

BA

H

C

AR

SE

H

E

PA
LA
BR
O
W
SE
R

IM

E

IV

H

N

SE

R

W

O

BR
G

SI

DE

O
ZI

O

JO
B

G

PI

SE

O
W

BR

JO
B

LE

FI

APPS
APPS

Hue Plugins
YARN

JobTracker

Pig
Oozie

Cloudera	

Impala

HiveServer2
HDFS

Hive	

Metastore

HBase
Solr

Zookeeper
Sqoop2

LDAP	

SAML
FAST PACE
LAST MONTH

91	
  issues	
  created	
  and	
  90	
  resolved.	
  
Core	
  team	
  +	
  Community
STACK
BACKEND


Python	
  +	
  Django	
  (with	
  tiny	
  bits	
  in	
  
Java)

FRONTEND


jQuery

Bootstrap

Knockout.js

Love
WHY SDK?
EXTEND HUE AND GET

-­‐	
  Other	
  type	
  of	
  visualizations	
  
-­‐	
  Export	
  in	
  another	
  format	
  
-­‐	
  Simpler	
  API	
  than	
  Hadoop	
  
-­‐	
  Custom	
  dashboards	
  
-­‐	
  YOUR_COMPANY	
  app
SDK

HUE
http://gethue.com/docs-­‐3.5.0/
sdk/sdk.html

Django
https://docs.djangoproject.com/
en/1.6/intro/reusable-­‐apps/
Hue Architecture
2 PARTS

https://github.com/cloudera/hue

/desktop	
  
	
  	
  /core	
  
	
  	
  	
  	
  /app	
  framework	
  
	
  	
  	
  	
  /documents	
  
	
  	
  	
  	
  /REST/Thrift	
  libs	
  
	
  	
  	
  	
  /...	
  
	
  	
  /libs	
  
	
  	
  	
  	
  /hadoop	
  
	
  	
  	
  	
  /liboauth	
  
	
  	
  	
  	
  /liboozie	
  
	
  	
  	
  	
  /...	
  

/apps	
  
	
  	
  /impala	
  
	
  	
  /filebrowser	
  
	
  	
  /jobbrowser	
  
	
  	
  /oozie	
  
	
  	
  /hbase	
  
	
  	
  /...	
  
	
  	
  /your_app	
  
	
  	
  /...	
  
Proxy App
PROXY APP

Put	
  anything	
  inside	
  Hue!	
  
!

Integrate	
  external	
  apps
New community Apps
PLUGGABLE APPS

-­‐	
  Hue	
  Hannibal	
  
-­‐	
  Hue	
  Chrome	
  notifier	
  
YARN Apps
HUE FRONTEND?

-­‐	
  Build	
  a	
  new	
  Yarn	
  
-­‐	
  Embedded	
  REST	
  API	
  
-­‐	
  Get	
  it	
  in	
  Job	
  Browser	
  or	
  custom	
  app	
  
	
  	
  (inherit	
  login/security/other	
  API)
HADOOP INTERFACES
REST & THRIFT

Many	
  Hadoop	
  interfaces	
  used	
  

WebHDFS	
  
YARN	
  API	
  (RM,	
  NM,	
  MR...)	
  
HiveServer2	
  
Impala	
  
HBase	
  
Oozie	
  
Sqoop2	
  
ZooKeeper	
  
...	
  









DEMO 

TIME

Missed something?
GET STARTED

Basic	
  usage	
  of	
  the	
  Hue/Django	
  shell	
  
Basic	
  access	
  to	
  the	
  Hue/Django	
  DB	
  
!

Execute	
  Hive	
  or	
  Impala	
  queries	
  
A	
  new	
  set	
  of	
  icons	
  for	
  file	
  types	
  
!

Pluggable	
  authentication	
  backends	
  (OAuth	
  1.0/1.1,	
  
LDAP,	
  SAML,	
  OpenId...)
What's next?
HUE 3+

Document	
  Model	
  
Unification	
  of	
  internal	
  API	
  (blueprint)	
  
External	
  API?	
  
Pluggable	
  widgets?	
  (aka	
  within	
  app	
  SDK)	
  
GET HUE

CLOUDERA’S CDH

TARBALL

CLOUDERA’S DEMO VM

Stable	
  and	
  highly	
  tested	
  
releases	
  perfectly	
  integrated	
  
with	
  the	
  Hadoop	
  ecosystem,	
  
automagically	
  configured	
  by	
  
Cloudera	
  Manager.

Try	
  in	
  advance	
  the	
  latest	
  and	
  
greatest	
  but	
  you’ll	
  have	
  to	
  
configure	
  everything	
  on	
  your	
  
own.

Get	
  to	
  play	
  with	
  Hue	
  and	
  
various	
  Hadoop	
  components	
  
in	
  5	
  minutes.	
  It’s	
  a	
  self	
  
contained	
  CDH	
  environment	
  
ready	
  to	
  use.

HORTONWORKS*

MAPR*

HP CLOUD*

In	
  HDP	
  there’s	
  an	
  old	
  forked	
  
version	
  of	
  Hue	
  2.3.

Newer	
  version	
  than	
  HDP,	
  close	
  
to	
  the	
  original	
  2.5	
  minus	
  apps	
  
like	
  HBase,	
  Impala,	
  Sqoop,	
  
Search.

The	
  newest	
  addition,	
  ships	
  
Hue	
  3.0	
  through	
  the	
  
GreenButton	
  products.	
  

BIGTOP

EMBEDDED/DEMO IN IND. COMPANIES

* YOUR MILEAGE MAY VARY.
LINKS

WEBSITE

http://gethue.com
BLOG

http://blog.gethue.com
TWITTER

@gethue
USER GROUP

hue-­‐user@
THANKS.

QUESTIONS?

gethue.com

Más contenido relacionado

Similar a SF Dev Meetup - Hue SDK

Hadoop trainer's profile
Hadoop trainer's profileHadoop trainer's profile
Hadoop trainer's profile
hadooptraining
 
Federico Feroldi: PHP in Yahoo!
Federico Feroldi: PHP in Yahoo!Federico Feroldi: PHP in Yahoo!
Federico Feroldi: PHP in Yahoo!
Francesco Fullone
 

Similar a SF Dev Meetup - Hue SDK (20)

Hue: The Hadoop UI - Hadoop Singapore
Hue: The Hadoop UI - Hadoop SingaporeHue: The Hadoop UI - Hadoop Singapore
Hue: The Hadoop UI - Hadoop Singapore
 
Hue: The Hadoop UI - HUG France
Hue: The Hadoop UI - HUG FranceHue: The Hadoop UI - HUG France
Hue: The Hadoop UI - HUG France
 
April 2014 HUG : Integrating HUE with Multi-tenant cluster
April 2014 HUG : Integrating HUE with Multi-tenant clusterApril 2014 HUG : Integrating HUE with Multi-tenant cluster
April 2014 HUG : Integrating HUE with Multi-tenant cluster
 
August 2013 HUG: Hue: the UI for Apache Hadoop
August 2013 HUG: Hue: the UI for Apache HadoopAugust 2013 HUG: Hue: the UI for Apache Hadoop
August 2013 HUG: Hue: the UI for Apache Hadoop
 
Y! HUG Hue: the Hadoop UI
Y! HUG   Hue: the Hadoop UIY! HUG   Hue: the Hadoop UI
Y! HUG Hue: the Hadoop UI
 
Beeswax Hive editor in Hue
Beeswax Hive editor in HueBeeswax Hive editor in Hue
Beeswax Hive editor in Hue
 
[drupalday2017] - Decoupled frontend con Drupal 8 e OpenUI 5
[drupalday2017] - Decoupled frontend con Drupal 8 e OpenUI 5[drupalday2017] - Decoupled frontend con Drupal 8 e OpenUI 5
[drupalday2017] - Decoupled frontend con Drupal 8 e OpenUI 5
 
Big Data Training in Ludhiana
Big Data Training in LudhianaBig Data Training in Ludhiana
Big Data Training in Ludhiana
 
Big Data Training in Mohali
Big Data Training in MohaliBig Data Training in Mohali
Big Data Training in Mohali
 
Big Data Training in Amritsar
Big Data Training in AmritsarBig Data Training in Amritsar
Big Data Training in Amritsar
 
Developing eXtensions for HUE
Developing eXtensions for HUEDeveloping eXtensions for HUE
Developing eXtensions for HUE
 
Hadoop online training
Hadoop online training Hadoop online training
Hadoop online training
 
Hadoop trainer's profile
Hadoop trainer's profileHadoop trainer's profile
Hadoop trainer's profile
 
Uyuni: the solution to manage your Linux infrastructure (OpenFest 2020)
Uyuni: the solution to manage your Linux infrastructure (OpenFest 2020)Uyuni: the solution to manage your Linux infrastructure (OpenFest 2020)
Uyuni: the solution to manage your Linux infrastructure (OpenFest 2020)
 
Federico Feroldi: PHP in Yahoo!
Federico Feroldi: PHP in Yahoo!Federico Feroldi: PHP in Yahoo!
Federico Feroldi: PHP in Yahoo!
 
Federico Feroldi Php In Yahoo
Federico Feroldi Php In YahooFederico Feroldi Php In Yahoo
Federico Feroldi Php In Yahoo
 
Poitou-Charentes JUG 2016 Eclipse Che: The Next-Gen Eclipse IDE
Poitou-Charentes JUG 2016 Eclipse Che: The Next-Gen Eclipse IDEPoitou-Charentes JUG 2016 Eclipse Che: The Next-Gen Eclipse IDE
Poitou-Charentes JUG 2016 Eclipse Che: The Next-Gen Eclipse IDE
 
Hue: Big Data Web applications for Interactive Hadoop at Big Data Spain 2014
Hue: Big Data Web applications for Interactive Hadoop at Big Data Spain 2014Hue: Big Data Web applications for Interactive Hadoop at Big Data Spain 2014
Hue: Big Data Web applications for Interactive Hadoop at Big Data Spain 2014
 
Eclipse SCADA Release 0.1.0
Eclipse SCADA Release 0.1.0Eclipse SCADA Release 0.1.0
Eclipse SCADA Release 0.1.0
 
Hadoop in adtech
Hadoop in adtechHadoop in adtech
Hadoop in adtech
 

Más de gethue

Spark Summit Europe: Building a REST Job Server for interactive Spark as a se...
Spark Summit Europe: Building a REST Job Server for interactive Spark as a se...Spark Summit Europe: Building a REST Job Server for interactive Spark as a se...
Spark Summit Europe: Building a REST Job Server for interactive Spark as a se...
gethue
 

Más de gethue (11)

Spark Summit Europe: Building a REST Job Server for interactive Spark as a se...
Spark Summit Europe: Building a REST Job Server for interactive Spark as a se...Spark Summit Europe: Building a REST Job Server for interactive Spark as a se...
Spark Summit Europe: Building a REST Job Server for interactive Spark as a se...
 
SF Solr Meetup - Interactively Search and Visualize Your Big Data
SF Solr Meetup - Interactively Search and Visualize Your Big DataSF Solr Meetup - Interactively Search and Visualize Your Big Data
SF Solr Meetup - Interactively Search and Visualize Your Big Data
 
Big Data Scala by the Bay: Interactive Spark in your Browser
Big Data Scala by the Bay: Interactive Spark in your BrowserBig Data Scala by the Bay: Interactive Spark in your Browser
Big Data Scala by the Bay: Interactive Spark in your Browser
 
20150627 bigdatala
20150627 bigdatala20150627 bigdatala
20150627 bigdatala
 
Hadoop Summit - Interactive Big Data Analysis with Solr, Spark and Hue
Hadoop Summit - Interactive Big Data Analysis with Solr, Spark and HueHadoop Summit - Interactive Big Data Analysis with Solr, Spark and Hue
Hadoop Summit - Interactive Big Data Analysis with Solr, Spark and Hue
 
Harness the power of Spark and Solr in Hue: Big Data Amsterdam v.2.0
Harness the power of Spark and Solr in Hue: Big Data Amsterdam v.2.0Harness the power of Spark and Solr in Hue: Big Data Amsterdam v.2.0
Harness the power of Spark and Solr in Hue: Big Data Amsterdam v.2.0
 
Interactively Search and Visualize Your Big Data
Interactively Search and Visualize Your Big DataInteractively Search and Visualize Your Big Data
Interactively Search and Visualize Your Big Data
 
Sqoop2 refactoring for generic data transfer - NYC Sqoop Meetup
Sqoop2 refactoring for generic data transfer - NYC Sqoop MeetupSqoop2 refactoring for generic data transfer - NYC Sqoop Meetup
Sqoop2 refactoring for generic data transfer - NYC Sqoop Meetup
 
LDAP, SAML and Hue
LDAP, SAML and HueLDAP, SAML and Hue
LDAP, SAML and Hue
 
Hadoop Israel - HBase Browser in Hue
Hadoop Israel - HBase Browser in HueHadoop Israel - HBase Browser in Hue
Hadoop Israel - HBase Browser in Hue
 
HBase + Hue - LA HBase User Group
HBase + Hue - LA HBase User GroupHBase + Hue - LA HBase User Group
HBase + Hue - LA HBase User Group
 

Último

Structuring Teams and Portfolios for Success
Structuring Teams and Portfolios for SuccessStructuring Teams and Portfolios for Success
Structuring Teams and Portfolios for Success
UXDXConf
 
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
panagenda
 

Último (20)

Using IESVE for Room Loads Analysis - UK & Ireland
Using IESVE for Room Loads Analysis - UK & IrelandUsing IESVE for Room Loads Analysis - UK & Ireland
Using IESVE for Room Loads Analysis - UK & Ireland
 
Continuing Bonds Through AI: A Hermeneutic Reflection on Thanabots
Continuing Bonds Through AI: A Hermeneutic Reflection on ThanabotsContinuing Bonds Through AI: A Hermeneutic Reflection on Thanabots
Continuing Bonds Through AI: A Hermeneutic Reflection on Thanabots
 
Introduction to FDO and How It works Applications _ Richard at FIDO Alliance.pdf
Introduction to FDO and How It works Applications _ Richard at FIDO Alliance.pdfIntroduction to FDO and How It works Applications _ Richard at FIDO Alliance.pdf
Introduction to FDO and How It works Applications _ Richard at FIDO Alliance.pdf
 
Structuring Teams and Portfolios for Success
Structuring Teams and Portfolios for SuccessStructuring Teams and Portfolios for Success
Structuring Teams and Portfolios for Success
 
The Value of Certifying Products for FDO _ Paul at FIDO Alliance.pdf
The Value of Certifying Products for FDO _ Paul at FIDO Alliance.pdfThe Value of Certifying Products for FDO _ Paul at FIDO Alliance.pdf
The Value of Certifying Products for FDO _ Paul at FIDO Alliance.pdf
 
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
 
Syngulon - Selection technology May 2024.pdf
Syngulon - Selection technology May 2024.pdfSyngulon - Selection technology May 2024.pdf
Syngulon - Selection technology May 2024.pdf
 
Integrating Telephony Systems with Salesforce: Insights and Considerations, B...
Integrating Telephony Systems with Salesforce: Insights and Considerations, B...Integrating Telephony Systems with Salesforce: Insights and Considerations, B...
Integrating Telephony Systems with Salesforce: Insights and Considerations, B...
 
Microsoft CSP Briefing Pre-Engagement - Questionnaire
Microsoft CSP Briefing Pre-Engagement - QuestionnaireMicrosoft CSP Briefing Pre-Engagement - Questionnaire
Microsoft CSP Briefing Pre-Engagement - Questionnaire
 
Behind the Scenes From the Manager's Chair: Decoding the Secrets of Successfu...
Behind the Scenes From the Manager's Chair: Decoding the Secrets of Successfu...Behind the Scenes From the Manager's Chair: Decoding the Secrets of Successfu...
Behind the Scenes From the Manager's Chair: Decoding the Secrets of Successfu...
 
Google I/O Extended 2024 Warsaw
Google I/O Extended 2024 WarsawGoogle I/O Extended 2024 Warsaw
Google I/O Extended 2024 Warsaw
 
Secure Zero Touch enabled Edge compute with Dell NativeEdge via FDO _ Brad at...
Secure Zero Touch enabled Edge compute with Dell NativeEdge via FDO _ Brad at...Secure Zero Touch enabled Edge compute with Dell NativeEdge via FDO _ Brad at...
Secure Zero Touch enabled Edge compute with Dell NativeEdge via FDO _ Brad at...
 
WebRTC and SIP not just audio and video @ OpenSIPS 2024
WebRTC and SIP not just audio and video @ OpenSIPS 2024WebRTC and SIP not just audio and video @ OpenSIPS 2024
WebRTC and SIP not just audio and video @ OpenSIPS 2024
 
Powerful Start- the Key to Project Success, Barbara Laskowska
Powerful Start- the Key to Project Success, Barbara LaskowskaPowerful Start- the Key to Project Success, Barbara Laskowska
Powerful Start- the Key to Project Success, Barbara Laskowska
 
Simplified FDO Manufacturing Flow with TPMs _ Liam at Infineon.pdf
Simplified FDO Manufacturing Flow with TPMs _ Liam at Infineon.pdfSimplified FDO Manufacturing Flow with TPMs _ Liam at Infineon.pdf
Simplified FDO Manufacturing Flow with TPMs _ Liam at Infineon.pdf
 
Designing for Hardware Accessibility at Comcast
Designing for Hardware Accessibility at ComcastDesigning for Hardware Accessibility at Comcast
Designing for Hardware Accessibility at Comcast
 
ASRock Industrial FDO Solutions in Action for Industrial Edge AI _ Kenny at A...
ASRock Industrial FDO Solutions in Action for Industrial Edge AI _ Kenny at A...ASRock Industrial FDO Solutions in Action for Industrial Edge AI _ Kenny at A...
ASRock Industrial FDO Solutions in Action for Industrial Edge AI _ Kenny at A...
 
Extensible Python: Robustness through Addition - PyCon 2024
Extensible Python: Robustness through Addition - PyCon 2024Extensible Python: Robustness through Addition - PyCon 2024
Extensible Python: Robustness through Addition - PyCon 2024
 
Linux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdf
Linux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdfLinux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdf
Linux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdf
 
Working together SRE & Platform Engineering
Working together SRE & Platform EngineeringWorking together SRE & Platform Engineering
Working together SRE & Platform Engineering
 

SF Dev Meetup - Hue SDK