SlideShare una empresa de Scribd logo
1 de 14
Working with a Remote Cluster
  7/6/2012

© 2012 MapR Technologies   Remote Cluster 1
Working with a Remote Cluster
   Agenda
   • Prerequisites
   • Configuring the Clusters
   • Managing Multiple Clusters
   • Mirroring between Clusters
   • Transferring Data with Dump Files




© 2012 MapR Technologies    Remote Cluster 2
Working with a Remote Cluster
   Objectives
   At the end of this module you will be able to:
   • List the prerequisites for working with multiple clusters
   • Understand how to configure each node when working with multiple
     clusters
   • Describe what is involved in managing multiple clusters
   • Explain how mirroring between clusters works
   • Understand how to transfer data from a dump file




© 2012 MapR Technologies         Remote Cluster 3
Prerequisites




© 2012 MapR Technologies     Remote Cluster 4
Prerequisites

     Clusters must already be established and running
     Clusters must have different names
     Forward and reverse hostname resolution between all nodes
      –   Yes, even between the clusters
      –   Either in /etc/hosts or via DNS




© 2012 MapR Technologies            Remote Cluster 5
Configuring the Clusters




© 2012 MapR Technologies   Remote Cluster 6
Configuring the Clusters

     Use configure.sh to create new entries in mapr-clusters.conf
      –   On cluster 1: configure.sh –C <cluster 2> -N <cluster 2>
      –   On cluster 2, do the reverse (only if you plan to mirror back to cluster 1>
     -N option adds a new line to mapr-clusters.conf
      –   First line is the local cluster; other lines point to other clusters
      –   To remove clusters from mapr-clusters.conf you must edit the file
     Restart the warden on all nodes on both clusters




© 2012 MapR Technologies             Remote Cluster 7
Managing Multiple
                               Clusters



© 2012 MapR Technologies       Remote Cluster 8
Managing Multiple Clusters




© 2012 MapR Technologies   Remote Cluster 9
Mirroring between
                                Clusters



© 2012 MapR Technologies       Remote Cluster 10
Mirroring between Clusters

     Set up mirror volume with source on named cluster
      –   maprcli volume create
             -name vol1-mirror
             -source vol1@cluster1
             -path /vol1-mirror
             -mount 1
             -type 1




© 2012 MapR Technologies     Remote Cluster 11
Transferring Data with
                          Dump Files



© 2012 MapR Technologies   Remote Cluster 12
Restoration from Dump Files




          Restore dump files to new mirror volumes
               Restore each incremental dump!
          If volumes need to be writable
               Create volumes to receive data
                Copy data from mirror volumes
© 2012 MapR Technologies        Remote Cluster 13
Questions




© 2012 MapR Technologies   Remote Cluster 14

Más contenido relacionado

La actualidad más candente

NYC Hadoop Meetup - MapR, Architecture, Philosophy and Applications
NYC Hadoop Meetup - MapR, Architecture, Philosophy and ApplicationsNYC Hadoop Meetup - MapR, Architecture, Philosophy and Applications
NYC Hadoop Meetup - MapR, Architecture, Philosophy and Applications
Jason Shao
 
MapReduce Improvements in MapR Hadoop
MapReduce Improvements in MapR HadoopMapReduce Improvements in MapR Hadoop
MapReduce Improvements in MapR Hadoop
abord
 

La actualidad más candente (20)

20a installation
20a installation20a installation
20a installation
 
MapR Tutorial Series
MapR Tutorial SeriesMapR Tutorial Series
MapR Tutorial Series
 
Autonomous control in Big Data platforms: and experience with Cassandra
Autonomous control in Big Data platforms: and experience with CassandraAutonomous control in Big Data platforms: and experience with Cassandra
Autonomous control in Big Data platforms: and experience with Cassandra
 
NYC Hadoop Meetup - MapR, Architecture, Philosophy and Applications
NYC Hadoop Meetup - MapR, Architecture, Philosophy and ApplicationsNYC Hadoop Meetup - MapR, Architecture, Philosophy and Applications
NYC Hadoop Meetup - MapR, Architecture, Philosophy and Applications
 
10c introduction
10c introduction10c introduction
10c introduction
 
Introduction to Yarn
Introduction to YarnIntroduction to Yarn
Introduction to Yarn
 
Hadoop Internals
Hadoop InternalsHadoop Internals
Hadoop Internals
 
MapReduce Improvements in MapR Hadoop
MapReduce Improvements in MapR HadoopMapReduce Improvements in MapR Hadoop
MapReduce Improvements in MapR Hadoop
 
Spark tunning in Apache Kylin
Spark tunning in Apache KylinSpark tunning in Apache Kylin
Spark tunning in Apache Kylin
 
Architectural Overview of MapR's Apache Hadoop Distribution
Architectural Overview of MapR's Apache Hadoop DistributionArchitectural Overview of MapR's Apache Hadoop Distribution
Architectural Overview of MapR's Apache Hadoop Distribution
 
Anatomy of Hadoop YARN
Anatomy of Hadoop YARNAnatomy of Hadoop YARN
Anatomy of Hadoop YARN
 
Hadoop fault-tolerance
Hadoop fault-toleranceHadoop fault-tolerance
Hadoop fault-tolerance
 
Hadoop: Past, Present and Future - v2.1 - SQLSaturday #340
Hadoop: Past, Present and Future - v2.1 - SQLSaturday #340Hadoop: Past, Present and Future - v2.1 - SQLSaturday #340
Hadoop: Past, Present and Future - v2.1 - SQLSaturday #340
 
Hadoop - Past, Present and Future - v2.0
Hadoop - Past, Present and Future - v2.0Hadoop - Past, Present and Future - v2.0
Hadoop - Past, Present and Future - v2.0
 
Database Research on Modern Computing Architecture
Database Research on Modern Computing ArchitectureDatabase Research on Modern Computing Architecture
Database Research on Modern Computing Architecture
 
Hadoop Cluster With High Availability
Hadoop Cluster With High AvailabilityHadoop Cluster With High Availability
Hadoop Cluster With High Availability
 
Accelerate Reed-Solomon coding for Fault-Tolerance in RAID-like system
Accelerate Reed-Solomon coding for Fault-Tolerance in RAID-like systemAccelerate Reed-Solomon coding for Fault-Tolerance in RAID-like system
Accelerate Reed-Solomon coding for Fault-Tolerance in RAID-like system
 
Advanced Hadoop Tuning and Optimization
Advanced Hadoop Tuning and Optimization Advanced Hadoop Tuning and Optimization
Advanced Hadoop Tuning and Optimization
 
How to Increase Performance of Your Hadoop Cluster
How to Increase Performance of Your Hadoop ClusterHow to Increase Performance of Your Hadoop Cluster
How to Increase Performance of Your Hadoop Cluster
 
HDF-EOS Tools
HDF-EOS ToolsHDF-EOS Tools
HDF-EOS Tools
 

Destacado

Sánchez montaño leslie vanesa
Sánchez  montaño  leslie  vanesaSánchez  montaño  leslie  vanesa
Sánchez montaño leslie vanesa
lesli3
 
27.wssd의 준비동향과 한국여성의 참여전략, 첨부파일
27.wssd의 준비동향과 한국여성의 참여전략, 첨부파일27.wssd의 준비동향과 한국여성의 참여전략, 첨부파일
27.wssd의 준비동향과 한국여성의 참여전략, 첨부파일
여성환경연대
 
CEREC 30
CEREC 30CEREC 30
CEREC 30
Lalamay
 

Destacado (19)

Clima y violencia escolar
Clima y violencia escolarClima y violencia escolar
Clima y violencia escolar
 
Rea tec monterrey practica 3 portafolio susan solis r
Rea tec monterrey practica 3 portafolio susan solis rRea tec monterrey practica 3 portafolio susan solis r
Rea tec monterrey practica 3 portafolio susan solis r
 
Sánchez montaño leslie vanesa
Sánchez  montaño  leslie  vanesaSánchez  montaño  leslie  vanesa
Sánchez montaño leslie vanesa
 
Raul Arte(Raul Chaves-2010)
Raul Arte(Raul Chaves-2010)Raul Arte(Raul Chaves-2010)
Raul Arte(Raul Chaves-2010)
 
DIDACTICA
DIDACTICADIDACTICA
DIDACTICA
 
Searching for Commercial Real Estate and Property
Searching for Commercial Real Estate and PropertySearching for Commercial Real Estate and Property
Searching for Commercial Real Estate and Property
 
Exposición Cabanillas centros do Salnés
Exposición Cabanillas centros do SalnésExposición Cabanillas centros do Salnés
Exposición Cabanillas centros do Salnés
 
je suis un fou à Al Hoceïma je me nomme Didier
  je suis un fou à Al Hoceïma je me nomme Didier    je suis un fou à Al Hoceïma je me nomme Didier
je suis un fou à Al Hoceïma je me nomme Didier
 
27.wssd의 준비동향과 한국여성의 참여전략, 첨부파일
27.wssd의 준비동향과 한국여성의 참여전략, 첨부파일27.wssd의 준비동향과 한국여성의 참여전략, 첨부파일
27.wssd의 준비동향과 한국여성의 참여전략, 첨부파일
 
From social data to social insight
From social data to social insightFrom social data to social insight
From social data to social insight
 
CEREC 30
CEREC 30CEREC 30
CEREC 30
 
Modelos de enseñanza
Modelos de enseñanzaModelos de enseñanza
Modelos de enseñanza
 
Jean Sibelius Finlandia
Jean Sibelius FinlandiaJean Sibelius Finlandia
Jean Sibelius Finlandia
 
Tarea 2 Dimensiones de la Didáctica
Tarea 2 Dimensiones de la DidácticaTarea 2 Dimensiones de la Didáctica
Tarea 2 Dimensiones de la Didáctica
 
Copy of glass ionomer cement/ dental implant courses
Copy of glass ionomer cement/ dental implant coursesCopy of glass ionomer cement/ dental implant courses
Copy of glass ionomer cement/ dental implant courses
 
Cleaning & Shaping
Cleaning & ShapingCleaning & Shaping
Cleaning & Shaping
 
Space managment
Space managmentSpace managment
Space managment
 
God's great plan for you
God's great plan for youGod's great plan for you
God's great plan for you
 
7 maravillas
7 maravillas7 maravillas
7 maravillas
 

Similar a 55a remote cluster

Disaster recovery of OpenStack Cinder using DRBD
Disaster recovery of OpenStack Cinder using DRBDDisaster recovery of OpenStack Cinder using DRBD
Disaster recovery of OpenStack Cinder using DRBD
Viswesuwara Nathan
 
LINBIT_HA_Business_Apr2016
LINBIT_HA_Business_Apr2016LINBIT_HA_Business_Apr2016
LINBIT_HA_Business_Apr2016
Alexandre Huynh
 
Distributed Framework for Data Mining As a Service on Private Cloud
Distributed Framework for Data Mining As a Service on Private CloudDistributed Framework for Data Mining As a Service on Private Cloud
Distributed Framework for Data Mining As a Service on Private Cloud
IJERA Editor
 
Chapter 10.slides
Chapter 10.slidesChapter 10.slides
Chapter 10.slides
lara_ays
 

Similar a 55a remote cluster (20)

22 configuration
22 configuration22 configuration
22 configuration
 
The Apache Cassandra ecosystem
The Apache Cassandra ecosystemThe Apache Cassandra ecosystem
The Apache Cassandra ecosystem
 
50a volumes
50a volumes50a volumes
50a volumes
 
HBase with MapR
HBase with MapRHBase with MapR
HBase with MapR
 
Disaster recovery of OpenStack Cinder using DRBD
Disaster recovery of OpenStack Cinder using DRBDDisaster recovery of OpenStack Cinder using DRBD
Disaster recovery of OpenStack Cinder using DRBD
 
OpenNebulaConf 2016 - The DRBD SDS for OpenNebula by Philipp Reisner, LINBIT
OpenNebulaConf 2016 - The DRBD SDS for OpenNebula by Philipp Reisner, LINBITOpenNebulaConf 2016 - The DRBD SDS for OpenNebula by Philipp Reisner, LINBIT
OpenNebulaConf 2016 - The DRBD SDS for OpenNebula by Philipp Reisner, LINBIT
 
Kubernetes From Scratch .pdf
Kubernetes From Scratch .pdfKubernetes From Scratch .pdf
Kubernetes From Scratch .pdf
 
Efficient resource management with Red Hat OpenShift
Efficient resource management with Red Hat OpenShiftEfficient resource management with Red Hat OpenShift
Efficient resource management with Red Hat OpenShift
 
LINBIT_HA_Business_Apr2016
LINBIT_HA_Business_Apr2016LINBIT_HA_Business_Apr2016
LINBIT_HA_Business_Apr2016
 
Distributed Framework for Data Mining As a Service on Private Cloud
Distributed Framework for Data Mining As a Service on Private CloudDistributed Framework for Data Mining As a Service on Private Cloud
Distributed Framework for Data Mining As a Service on Private Cloud
 
48a tuning
48a tuning48a tuning
48a tuning
 
Scalability 09262012
Scalability 09262012Scalability 09262012
Scalability 09262012
 
Data Analytics Using Container Persistence Through SMACK - Manny Rodriguez-Pe...
Data Analytics Using Container Persistence Through SMACK - Manny Rodriguez-Pe...Data Analytics Using Container Persistence Through SMACK - Manny Rodriguez-Pe...
Data Analytics Using Container Persistence Through SMACK - Manny Rodriguez-Pe...
 
Chapter 10.slides
Chapter 10.slidesChapter 10.slides
Chapter 10.slides
 
Simplifying Cloud Architectures with Data Virtualization
Simplifying Cloud Architectures with Data VirtualizationSimplifying Cloud Architectures with Data Virtualization
Simplifying Cloud Architectures with Data Virtualization
 
#VirtualDesignMaster 3 Challenge 3 - Harshvardhan Gupta
#VirtualDesignMaster 3 Challenge 3 - Harshvardhan Gupta#VirtualDesignMaster 3 Challenge 3 - Harshvardhan Gupta
#VirtualDesignMaster 3 Challenge 3 - Harshvardhan Gupta
 
MCDB: Multi Cloud Database Model
MCDB: Multi Cloud Database ModelMCDB: Multi Cloud Database Model
MCDB: Multi Cloud Database Model
 
Enabling Disaster Recovery as Service (DRaaS) on OpenStack
Enabling Disaster Recovery as Service (DRaaS) on OpenStack Enabling Disaster Recovery as Service (DRaaS) on OpenStack
Enabling Disaster Recovery as Service (DRaaS) on OpenStack
 
C* Summit 2013: Netflix Open Source Tools and Benchmarks for Cassandra by Adr...
C* Summit 2013: Netflix Open Source Tools and Benchmarks for Cassandra by Adr...C* Summit 2013: Netflix Open Source Tools and Benchmarks for Cassandra by Adr...
C* Summit 2013: Netflix Open Source Tools and Benchmarks for Cassandra by Adr...
 
dmapply: A functional primitive to express distributed machine learning algor...
dmapply: A functional primitive to express distributed machine learning algor...dmapply: A functional primitive to express distributed machine learning algor...
dmapply: A functional primitive to express distributed machine learning algor...
 

Más de mapr-academy

Más de mapr-academy (6)

53 lab-nfs
53 lab-nfs53 lab-nfs
53 lab-nfs
 
51 lab-volumes
51 lab-volumes51 lab-volumes
51 lab-volumes
 
42 lab-managing services
42 lab-managing services42 lab-managing services
42 lab-managing services
 
41a managing services
41a managing services41a managing services
41a managing services
 
14 lab-planing
14 lab-planing14 lab-planing
14 lab-planing
 
3 map r installation & setup administration course description
3 map r installation & setup administration course description3 map r installation & setup administration course description
3 map r installation & setup administration course description
 

Último

Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
Joaquim Jorge
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
vu2urc
 

Último (20)

🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 
Advantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your BusinessAdvantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your Business
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
 
A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
Developing An App To Navigate The Roads of Brazil
Developing An App To Navigate The Roads of BrazilDeveloping An App To Navigate The Roads of Brazil
Developing An App To Navigate The Roads of Brazil
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdf
 

55a remote cluster

  • 1. Working with a Remote Cluster 7/6/2012 © 2012 MapR Technologies Remote Cluster 1
  • 2. Working with a Remote Cluster Agenda • Prerequisites • Configuring the Clusters • Managing Multiple Clusters • Mirroring between Clusters • Transferring Data with Dump Files © 2012 MapR Technologies Remote Cluster 2
  • 3. Working with a Remote Cluster Objectives At the end of this module you will be able to: • List the prerequisites for working with multiple clusters • Understand how to configure each node when working with multiple clusters • Describe what is involved in managing multiple clusters • Explain how mirroring between clusters works • Understand how to transfer data from a dump file © 2012 MapR Technologies Remote Cluster 3
  • 4. Prerequisites © 2012 MapR Technologies Remote Cluster 4
  • 5. Prerequisites  Clusters must already be established and running  Clusters must have different names  Forward and reverse hostname resolution between all nodes – Yes, even between the clusters – Either in /etc/hosts or via DNS © 2012 MapR Technologies Remote Cluster 5
  • 6. Configuring the Clusters © 2012 MapR Technologies Remote Cluster 6
  • 7. Configuring the Clusters  Use configure.sh to create new entries in mapr-clusters.conf – On cluster 1: configure.sh –C <cluster 2> -N <cluster 2> – On cluster 2, do the reverse (only if you plan to mirror back to cluster 1>  -N option adds a new line to mapr-clusters.conf – First line is the local cluster; other lines point to other clusters – To remove clusters from mapr-clusters.conf you must edit the file  Restart the warden on all nodes on both clusters © 2012 MapR Technologies Remote Cluster 7
  • 8. Managing Multiple Clusters © 2012 MapR Technologies Remote Cluster 8
  • 9. Managing Multiple Clusters © 2012 MapR Technologies Remote Cluster 9
  • 10. Mirroring between Clusters © 2012 MapR Technologies Remote Cluster 10
  • 11. Mirroring between Clusters  Set up mirror volume with source on named cluster – maprcli volume create -name vol1-mirror -source vol1@cluster1 -path /vol1-mirror -mount 1 -type 1 © 2012 MapR Technologies Remote Cluster 11
  • 12. Transferring Data with Dump Files © 2012 MapR Technologies Remote Cluster 12
  • 13. Restoration from Dump Files  Restore dump files to new mirror volumes  Restore each incremental dump!  If volumes need to be writable  Create volumes to receive data  Copy data from mirror volumes © 2012 MapR Technologies Remote Cluster 13
  • 14. Questions © 2012 MapR Technologies Remote Cluster 14