SlideShare una empresa de Scribd logo
1 de 11
Descargar para leer sin conexión
Ambari
1.2
How Ambari Agents Register




© Hortonworks Inc. 2013      Page 1
Summary
• Terminology
   – Bootstrap –how to initially install an Agent on a host and “kick-off” registration
   – Registration – the act of an Agent host “registering” with the Server


• Are there multiple ways to bootstrap an Agent?
   Yes. Option #1: SSH and Option #2: Manual (no SSH)


• What are the differences between Option #1 and Option #2?
   With Option #1, you can have the Ambari Server bootstrap the agents during
   “Confirm Hosts”, which requires you to provide the SSH key so the Ambari Server
   can connect to + access the Agent host.

   With Option #2, you can manually install the Agent, which does not require the SSH
   key for the Ambari Server.




        Architecting the Future of Big Data
                                                                                          Page 2
        © Hortonworks Inc. 2013
Ambari Cluster Install Wizard




   OPTION 1
      and
provide SSH Key




   OPTION 2




           Architecting the Future of Big Data
                                                 Page 3
           © Hortonworks Inc. 2013
Bootstrap
Operational Flows




Architecting the Future of Big Data
                                      Page 4
© Hortonworks Inc. 2013
Option #1: Ambari Agent Bootstrap (SSH)

   Ambari Server                                                     Ambari Agent

                                      1) Configure Ambari Repo
 These
ops use
the SSH                         2) Copy Ambari Agent Setup script
  key
                              3) Execute Ambari Agent Setup script


                                                                                    4) Install epel-release


                                                                                    5) Install ambari-agent



                                                                                    6) Configure ambari-agent.ini


                                                                                    7) Start ambari-agent
                               8) Begin Ambari Agent Registration




          Architecting the Future of Big Data
                                                                                                               Page 5
          © Hortonworks Inc. 2013
Option #1: Ambari Agent Bootstrap (SSH)
     Operation                                                 Description

1    Configure Ambari Repo                                     Use the ambari.repo file on the Ambari Server and SCP to
                                                               Agent host(s).

2    Copy Ambari Agent Setup script                            SCP the setupAgent.py script on Agent host(s).

3    Execute Ambari Agent Setup script                         SSH to Agent host(s) and execute python setupAgent.py

4    Install epel-release                                      Install epel-release package using yum / zypper.

5    Install ambari-agent                                      Install ambari-agent package using yum / zypper.

6    Configure ambari-agent.ini                                Modify the /etc/ambari-agent/ambari-agent.ini and set the
                                                               hostname to the Ambari Server hostname.

7    Start ambari-agent                                        Start the ambari-agent process.

8    Begin Ambari Agent Registration                           Agent begins the registration process.


** Ambari Server initiates the “bootstrap” process by calling bootstrap.py



               Architecting the Future of Big Data
                                                                                                                           Page 6
               © Hortonworks Inc. 2013
Option #2: Ambari Agent Bootstrap (Manual)

    Ambari Server                                                             Ambari Agent


 No SSH
 ops are                                                                                         1) Configure Ambari repo
performed
                                                                                                 2) Install epel-release


                                                                                                 3) Install ambari-agent



                                                                                                 4) Configure ambari-agent.ini


                                                                                                 5) Start ambari-agent
                                     6) Begin Ambari Agent Registration




    ** User executes all ops as root no the Agent host(s). No requirement for SSH Private Key.



                   Architecting the Future of Big Data
                                                                                                                                 Page 7
                   © Hortonworks Inc. 2013
Agent Registration




Architecting the Future of Big Data
                                      Page 8
© Hortonworks Inc. 2013
Ambari Agent Registration
 Ambari Server                                                     Ambari Agent      Agent Host
                            1) Connect on Handshake port 8441

                                      2) Download Server Cert

                                  3) Request to Sign Agent Cert


                           4) Sign Agent Cert

                            5) Download Agent Cert + Disconnect


                            6) Connect on Registration port 8440

                          7) Perform 2WAY auth using Agent Cert
                                                                            8) Get FQDN              8a)
                                                                                                    Host
                                            9) Register host                                        Script


                           10) Complete Host Registration

                                   11) Agent Heartbeat Begins



      Architecting the Future of Big Data
                                                                                                  Page 9
      © Hortonworks Inc. 2013
Ambari Agent Registration
     Operation                                  Description
1    Connect on Handshake port 8441             Ambari Agent connects to Ambari Server on the handshake port.

2    Download Server Certificate                Ambari Agent downloads the Server Certificate.

3    Request to sign Agent Certificate          Ambari Agent requests for Ambari Server to sign the Agent
                                                Certificate.
4    Sign Agent Cert                            Ambari Server signs Agent Certificate with password.

5    Download Agent Cert and Disconnect         Ambar Agent downloads Agent Certificate and disconnects.

6    Connect on Registration port 8440          Ambari Agent connects to Ambari Server on the registration port.

7    Perform 2WAY auth using Agent Cert         2WAY authentication between Agent and Server.

8    Get FQDN                                   Ambari Agent host gets the Fully Qualified Domain Name (FQDN)
                                                for the Agent host. Note: (8a) In case the host has multiple
                                                hostnames, use the host script to echo the hostname to use for
                                                registration.
9    Register Host                              Using the FQDN, the Agent host registers with the Ambari Server.

10   Complete Host Registration                 Ambari Server completes the host registration by adding the host to
                                                the Ambari DB.
11   Agent Heartbeat Begins                     Ambari Agent starts heartbeat to Ambari Server, checking for
                                                commands to execute.

          Architecting the Future of Big Data
                                                                                                               Page 10
          © Hortonworks Inc. 2013
Useful Resources
Resource                                         Link

Using Custom Hostnames                           http://docs.hortonworks.com/HDPDocuments/HDP1/HDP-
Script                                           1.2.1/bk_using_Ambari_book/content/ambari-chap7a.html

Manually Registering Ambari                      http://docs.hortonworks.com/HDPDocuments/HDP1/HDP-
Agents                                           1.2.1/bk_using_Ambari_book/content/ambari-chap6.html




           Architecting the Future of Big Data
                                                                                                         Page 11
           © Hortonworks Inc. 2013

Más contenido relacionado

Similar a Ambari: Agent Registration Flow

Apache Ambari - What's New in 1.2.5
Apache Ambari - What's New in 1.2.5Apache Ambari - What's New in 1.2.5
Apache Ambari - What's New in 1.2.5Hortonworks
 
Accumulo Summit 2014: Monitoring Apache Accumulo
Accumulo Summit 2014: Monitoring Apache AccumuloAccumulo Summit 2014: Monitoring Apache Accumulo
Accumulo Summit 2014: Monitoring Apache AccumuloAccumulo Summit
 
Pm 02 track1-- 魏刚--osac-trusted-computing-pools-in-folsom-v2
Pm 02 track1-- 魏刚--osac-trusted-computing-pools-in-folsom-v2Pm 02 track1-- 魏刚--osac-trusted-computing-pools-in-folsom-v2
Pm 02 track1-- 魏刚--osac-trusted-computing-pools-in-folsom-v2OpenCity Community
 
Hortonworks technical workshop operations with ambari
Hortonworks technical workshop   operations with ambariHortonworks technical workshop   operations with ambari
Hortonworks technical workshop operations with ambariHortonworks
 
Managing 2000 Node Cluster with Ambari
Managing 2000 Node Cluster with AmbariManaging 2000 Node Cluster with Ambari
Managing 2000 Node Cluster with AmbariDataWorks Summit
 
Apache Ambari - What's New in 2.4
Apache Ambari - What's New in 2.4 Apache Ambari - What's New in 2.4
Apache Ambari - What's New in 2.4 Hortonworks
 
OpenStack Architecture
OpenStack ArchitectureOpenStack Architecture
OpenStack ArchitectureMirantis
 
OpenStack Architecture
OpenStack ArchitectureOpenStack Architecture
OpenStack ArchitectureMirantis
 
K8s, Amazon EKS - 유재석, AWS 솔루션즈 아키텍트
K8s, Amazon EKS - 유재석, AWS 솔루션즈 아키텍트K8s, Amazon EKS - 유재석, AWS 솔루션즈 아키텍트
K8s, Amazon EKS - 유재석, AWS 솔루션즈 아키텍트Amazon Web Services Korea
 
Ethereum Smart Contracts on Hyperledger Fabric
Ethereum Smart Contracts on Hyperledger Fabric Ethereum Smart Contracts on Hyperledger Fabric
Ethereum Smart Contracts on Hyperledger Fabric Horea Porutiu
 
IBM Monitoring and Diagnostics Tools - Health Center 3.0.2
IBM Monitoring and Diagnostics Tools - Health Center 3.0.2IBM Monitoring and Diagnostics Tools - Health Center 3.0.2
IBM Monitoring and Diagnostics Tools - Health Center 3.0.2Chris Bailey
 
AWS 고객사를 위한 ‘AWS 컨테이너 교육’ - 유재석, AWS 솔루션즈 아키텍트
AWS 고객사를 위한 ‘AWS 컨테이너 교육’ - 유재석, AWS 솔루션즈 아키텍트AWS 고객사를 위한 ‘AWS 컨테이너 교육’ - 유재석, AWS 솔루션즈 아키텍트
AWS 고객사를 위한 ‘AWS 컨테이너 교육’ - 유재석, AWS 솔루션즈 아키텍트Amazon Web Services Korea
 
AWS Container Services – 유재석 (AWS 솔루션즈 아키텍트)
AWS Container Services – 유재석 (AWS 솔루션즈 아키텍트)AWS Container Services – 유재석 (AWS 솔루션즈 아키텍트)
AWS Container Services – 유재석 (AWS 솔루션즈 아키텍트)Amazon Web Services Korea
 
Amazon Container Services – 유재석 (AWS 솔루션즈 아키텍트)
 Amazon Container Services – 유재석 (AWS 솔루션즈 아키텍트) Amazon Container Services – 유재석 (AWS 솔루션즈 아키텍트)
Amazon Container Services – 유재석 (AWS 솔루션즈 아키텍트)Amazon Web Services Korea
 
Linux11 Proxy Server
Linux11 Proxy ServerLinux11 Proxy Server
Linux11 Proxy ServerJainul Musani
 
Managing your Hadoop Clusters with Ambari
Managing your Hadoop Clusters with AmbariManaging your Hadoop Clusters with Ambari
Managing your Hadoop Clusters with AmbariDataWorks Summit
 
Apache Ambari - What's New in 1.6.0
Apache Ambari - What's New in 1.6.0Apache Ambari - What's New in 1.6.0
Apache Ambari - What's New in 1.6.0Hortonworks
 
BlackHat EU 2012 - Zhenhua Liu - Breeding Sandworms: How To Fuzz Your Way Out...
BlackHat EU 2012 - Zhenhua Liu - Breeding Sandworms: How To Fuzz Your Way Out...BlackHat EU 2012 - Zhenhua Liu - Breeding Sandworms: How To Fuzz Your Way Out...
BlackHat EU 2012 - Zhenhua Liu - Breeding Sandworms: How To Fuzz Your Way Out...MindShare_kk
 

Similar a Ambari: Agent Registration Flow (20)

An Overview of Ambari
An Overview of AmbariAn Overview of Ambari
An Overview of Ambari
 
Apache Ambari - What's New in 1.2.5
Apache Ambari - What's New in 1.2.5Apache Ambari - What's New in 1.2.5
Apache Ambari - What's New in 1.2.5
 
Accumulo Summit 2014: Monitoring Apache Accumulo
Accumulo Summit 2014: Monitoring Apache AccumuloAccumulo Summit 2014: Monitoring Apache Accumulo
Accumulo Summit 2014: Monitoring Apache Accumulo
 
Pm 02 track1-- 魏刚--osac-trusted-computing-pools-in-folsom-v2
Pm 02 track1-- 魏刚--osac-trusted-computing-pools-in-folsom-v2Pm 02 track1-- 魏刚--osac-trusted-computing-pools-in-folsom-v2
Pm 02 track1-- 魏刚--osac-trusted-computing-pools-in-folsom-v2
 
Distributed objects
Distributed objectsDistributed objects
Distributed objects
 
Hortonworks technical workshop operations with ambari
Hortonworks technical workshop   operations with ambariHortonworks technical workshop   operations with ambari
Hortonworks technical workshop operations with ambari
 
Managing 2000 Node Cluster with Ambari
Managing 2000 Node Cluster with AmbariManaging 2000 Node Cluster with Ambari
Managing 2000 Node Cluster with Ambari
 
Apache Ambari - What's New in 2.4
Apache Ambari - What's New in 2.4 Apache Ambari - What's New in 2.4
Apache Ambari - What's New in 2.4
 
OpenStack Architecture
OpenStack ArchitectureOpenStack Architecture
OpenStack Architecture
 
OpenStack Architecture
OpenStack ArchitectureOpenStack Architecture
OpenStack Architecture
 
K8s, Amazon EKS - 유재석, AWS 솔루션즈 아키텍트
K8s, Amazon EKS - 유재석, AWS 솔루션즈 아키텍트K8s, Amazon EKS - 유재석, AWS 솔루션즈 아키텍트
K8s, Amazon EKS - 유재석, AWS 솔루션즈 아키텍트
 
Ethereum Smart Contracts on Hyperledger Fabric
Ethereum Smart Contracts on Hyperledger Fabric Ethereum Smart Contracts on Hyperledger Fabric
Ethereum Smart Contracts on Hyperledger Fabric
 
IBM Monitoring and Diagnostics Tools - Health Center 3.0.2
IBM Monitoring and Diagnostics Tools - Health Center 3.0.2IBM Monitoring and Diagnostics Tools - Health Center 3.0.2
IBM Monitoring and Diagnostics Tools - Health Center 3.0.2
 
AWS 고객사를 위한 ‘AWS 컨테이너 교육’ - 유재석, AWS 솔루션즈 아키텍트
AWS 고객사를 위한 ‘AWS 컨테이너 교육’ - 유재석, AWS 솔루션즈 아키텍트AWS 고객사를 위한 ‘AWS 컨테이너 교육’ - 유재석, AWS 솔루션즈 아키텍트
AWS 고객사를 위한 ‘AWS 컨테이너 교육’ - 유재석, AWS 솔루션즈 아키텍트
 
AWS Container Services – 유재석 (AWS 솔루션즈 아키텍트)
AWS Container Services – 유재석 (AWS 솔루션즈 아키텍트)AWS Container Services – 유재석 (AWS 솔루션즈 아키텍트)
AWS Container Services – 유재석 (AWS 솔루션즈 아키텍트)
 
Amazon Container Services – 유재석 (AWS 솔루션즈 아키텍트)
 Amazon Container Services – 유재석 (AWS 솔루션즈 아키텍트) Amazon Container Services – 유재석 (AWS 솔루션즈 아키텍트)
Amazon Container Services – 유재석 (AWS 솔루션즈 아키텍트)
 
Linux11 Proxy Server
Linux11 Proxy ServerLinux11 Proxy Server
Linux11 Proxy Server
 
Managing your Hadoop Clusters with Ambari
Managing your Hadoop Clusters with AmbariManaging your Hadoop Clusters with Ambari
Managing your Hadoop Clusters with Ambari
 
Apache Ambari - What's New in 1.6.0
Apache Ambari - What's New in 1.6.0Apache Ambari - What's New in 1.6.0
Apache Ambari - What's New in 1.6.0
 
BlackHat EU 2012 - Zhenhua Liu - Breeding Sandworms: How To Fuzz Your Way Out...
BlackHat EU 2012 - Zhenhua Liu - Breeding Sandworms: How To Fuzz Your Way Out...BlackHat EU 2012 - Zhenhua Liu - Breeding Sandworms: How To Fuzz Your Way Out...
BlackHat EU 2012 - Zhenhua Liu - Breeding Sandworms: How To Fuzz Your Way Out...
 

Último

Designing A Time bound resource download URL
Designing A Time bound resource download URLDesigning A Time bound resource download URL
Designing A Time bound resource download URLRuncy Oommen
 
UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6DianaGray10
 
The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...
The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...
The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...Aggregage
 
Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1DianaGray10
 
Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™Adtran
 
Building AI-Driven Apps Using Semantic Kernel.pptx
Building AI-Driven Apps Using Semantic Kernel.pptxBuilding AI-Driven Apps Using Semantic Kernel.pptx
Building AI-Driven Apps Using Semantic Kernel.pptxUdaiappa Ramachandran
 
Comparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioComparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioChristian Posta
 
Introduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptxIntroduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptxMatsuo Lab
 
VoIP Service and Marketing using Odoo and Asterisk PBX
VoIP Service and Marketing using Odoo and Asterisk PBXVoIP Service and Marketing using Odoo and Asterisk PBX
VoIP Service and Marketing using Odoo and Asterisk PBXTarek Kalaji
 
How Accurate are Carbon Emissions Projections?
How Accurate are Carbon Emissions Projections?How Accurate are Carbon Emissions Projections?
How Accurate are Carbon Emissions Projections?IES VE
 
AI You Can Trust - Ensuring Success with Data Integrity Webinar
AI You Can Trust - Ensuring Success with Data Integrity WebinarAI You Can Trust - Ensuring Success with Data Integrity Webinar
AI You Can Trust - Ensuring Success with Data Integrity WebinarPrecisely
 
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostKubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostMatt Ray
 
NIST Cybersecurity Framework (CSF) 2.0 Workshop
NIST Cybersecurity Framework (CSF) 2.0 WorkshopNIST Cybersecurity Framework (CSF) 2.0 Workshop
NIST Cybersecurity Framework (CSF) 2.0 WorkshopBachir Benyammi
 
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDEADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDELiveplex
 
Empowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership BlueprintEmpowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership BlueprintMahmoud Rabie
 
Bird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemBird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemAsko Soukka
 
COMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online CollaborationCOMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online Collaborationbruanjhuli
 
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019IES VE
 
Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024SkyPlanner
 

Último (20)

Designing A Time bound resource download URL
Designing A Time bound resource download URLDesigning A Time bound resource download URL
Designing A Time bound resource download URL
 
UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6
 
The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...
The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...
The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...
 
Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1
 
Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™
 
Building AI-Driven Apps Using Semantic Kernel.pptx
Building AI-Driven Apps Using Semantic Kernel.pptxBuilding AI-Driven Apps Using Semantic Kernel.pptx
Building AI-Driven Apps Using Semantic Kernel.pptx
 
Comparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioComparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and Istio
 
Introduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptxIntroduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptx
 
20230104 - machine vision
20230104 - machine vision20230104 - machine vision
20230104 - machine vision
 
VoIP Service and Marketing using Odoo and Asterisk PBX
VoIP Service and Marketing using Odoo and Asterisk PBXVoIP Service and Marketing using Odoo and Asterisk PBX
VoIP Service and Marketing using Odoo and Asterisk PBX
 
How Accurate are Carbon Emissions Projections?
How Accurate are Carbon Emissions Projections?How Accurate are Carbon Emissions Projections?
How Accurate are Carbon Emissions Projections?
 
AI You Can Trust - Ensuring Success with Data Integrity Webinar
AI You Can Trust - Ensuring Success with Data Integrity WebinarAI You Can Trust - Ensuring Success with Data Integrity Webinar
AI You Can Trust - Ensuring Success with Data Integrity Webinar
 
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostKubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
 
NIST Cybersecurity Framework (CSF) 2.0 Workshop
NIST Cybersecurity Framework (CSF) 2.0 WorkshopNIST Cybersecurity Framework (CSF) 2.0 Workshop
NIST Cybersecurity Framework (CSF) 2.0 Workshop
 
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDEADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
 
Empowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership BlueprintEmpowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership Blueprint
 
Bird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemBird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystem
 
COMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online CollaborationCOMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online Collaboration
 
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
 
Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024
 

Ambari: Agent Registration Flow

  • 1. Ambari 1.2 How Ambari Agents Register © Hortonworks Inc. 2013 Page 1
  • 2. Summary • Terminology – Bootstrap –how to initially install an Agent on a host and “kick-off” registration – Registration – the act of an Agent host “registering” with the Server • Are there multiple ways to bootstrap an Agent? Yes. Option #1: SSH and Option #2: Manual (no SSH) • What are the differences between Option #1 and Option #2? With Option #1, you can have the Ambari Server bootstrap the agents during “Confirm Hosts”, which requires you to provide the SSH key so the Ambari Server can connect to + access the Agent host. With Option #2, you can manually install the Agent, which does not require the SSH key for the Ambari Server. Architecting the Future of Big Data Page 2 © Hortonworks Inc. 2013
  • 3. Ambari Cluster Install Wizard OPTION 1 and provide SSH Key OPTION 2 Architecting the Future of Big Data Page 3 © Hortonworks Inc. 2013
  • 4. Bootstrap Operational Flows Architecting the Future of Big Data Page 4 © Hortonworks Inc. 2013
  • 5. Option #1: Ambari Agent Bootstrap (SSH) Ambari Server Ambari Agent 1) Configure Ambari Repo These ops use the SSH 2) Copy Ambari Agent Setup script key 3) Execute Ambari Agent Setup script 4) Install epel-release 5) Install ambari-agent 6) Configure ambari-agent.ini 7) Start ambari-agent 8) Begin Ambari Agent Registration Architecting the Future of Big Data Page 5 © Hortonworks Inc. 2013
  • 6. Option #1: Ambari Agent Bootstrap (SSH) Operation Description 1 Configure Ambari Repo Use the ambari.repo file on the Ambari Server and SCP to Agent host(s). 2 Copy Ambari Agent Setup script SCP the setupAgent.py script on Agent host(s). 3 Execute Ambari Agent Setup script SSH to Agent host(s) and execute python setupAgent.py 4 Install epel-release Install epel-release package using yum / zypper. 5 Install ambari-agent Install ambari-agent package using yum / zypper. 6 Configure ambari-agent.ini Modify the /etc/ambari-agent/ambari-agent.ini and set the hostname to the Ambari Server hostname. 7 Start ambari-agent Start the ambari-agent process. 8 Begin Ambari Agent Registration Agent begins the registration process. ** Ambari Server initiates the “bootstrap” process by calling bootstrap.py Architecting the Future of Big Data Page 6 © Hortonworks Inc. 2013
  • 7. Option #2: Ambari Agent Bootstrap (Manual) Ambari Server Ambari Agent No SSH ops are 1) Configure Ambari repo performed 2) Install epel-release 3) Install ambari-agent 4) Configure ambari-agent.ini 5) Start ambari-agent 6) Begin Ambari Agent Registration ** User executes all ops as root no the Agent host(s). No requirement for SSH Private Key. Architecting the Future of Big Data Page 7 © Hortonworks Inc. 2013
  • 8. Agent Registration Architecting the Future of Big Data Page 8 © Hortonworks Inc. 2013
  • 9. Ambari Agent Registration Ambari Server Ambari Agent Agent Host 1) Connect on Handshake port 8441 2) Download Server Cert 3) Request to Sign Agent Cert 4) Sign Agent Cert 5) Download Agent Cert + Disconnect 6) Connect on Registration port 8440 7) Perform 2WAY auth using Agent Cert 8) Get FQDN 8a) Host 9) Register host Script 10) Complete Host Registration 11) Agent Heartbeat Begins Architecting the Future of Big Data Page 9 © Hortonworks Inc. 2013
  • 10. Ambari Agent Registration Operation Description 1 Connect on Handshake port 8441 Ambari Agent connects to Ambari Server on the handshake port. 2 Download Server Certificate Ambari Agent downloads the Server Certificate. 3 Request to sign Agent Certificate Ambari Agent requests for Ambari Server to sign the Agent Certificate. 4 Sign Agent Cert Ambari Server signs Agent Certificate with password. 5 Download Agent Cert and Disconnect Ambar Agent downloads Agent Certificate and disconnects. 6 Connect on Registration port 8440 Ambari Agent connects to Ambari Server on the registration port. 7 Perform 2WAY auth using Agent Cert 2WAY authentication between Agent and Server. 8 Get FQDN Ambari Agent host gets the Fully Qualified Domain Name (FQDN) for the Agent host. Note: (8a) In case the host has multiple hostnames, use the host script to echo the hostname to use for registration. 9 Register Host Using the FQDN, the Agent host registers with the Ambari Server. 10 Complete Host Registration Ambari Server completes the host registration by adding the host to the Ambari DB. 11 Agent Heartbeat Begins Ambari Agent starts heartbeat to Ambari Server, checking for commands to execute. Architecting the Future of Big Data Page 10 © Hortonworks Inc. 2013
  • 11. Useful Resources Resource Link Using Custom Hostnames http://docs.hortonworks.com/HDPDocuments/HDP1/HDP- Script 1.2.1/bk_using_Ambari_book/content/ambari-chap7a.html Manually Registering Ambari http://docs.hortonworks.com/HDPDocuments/HDP1/HDP- Agents 1.2.1/bk_using_Ambari_book/content/ambari-chap6.html Architecting the Future of Big Data Page 11 © Hortonworks Inc. 2013