Enviar búsqueda
Cargar
58a migration
•
2 recomendaciones
•
451 vistas
M
mapr-academy
Seguir
Tecnología
Empresariales
Denunciar
Compartir
Denunciar
Compartir
1 de 18
Recomendados
55a remote cluster
55a remote cluster
mapr-academy
80a disaster recovery
80a disaster recovery
mapr-academy
52 nfs
52 nfs
mapr-academy
70a monitoring & troubleshooting
70a monitoring & troubleshooting
mapr-academy
12a architecture
12a architecture
mapr-academy
30a accessing your cluster
30a accessing your cluster
mapr-academy
Hands on MapR -- Viadea
Hands on MapR -- Viadea
viadea
13c planning
13c planning
mapr-academy
Recomendados
55a remote cluster
55a remote cluster
mapr-academy
80a disaster recovery
80a disaster recovery
mapr-academy
52 nfs
52 nfs
mapr-academy
70a monitoring & troubleshooting
70a monitoring & troubleshooting
mapr-academy
12a architecture
12a architecture
mapr-academy
30a accessing your cluster
30a accessing your cluster
mapr-academy
Hands on MapR -- Viadea
Hands on MapR -- Viadea
viadea
13c planning
13c planning
mapr-academy
20a installation
20a installation
mapr-academy
Introduction to Yarn
Introduction to Yarn
Omid Vahdaty
10c introduction
10c introduction
mapr-academy
MapR Tutorial Series
MapR Tutorial Series
selvaraaju
Hadoop Internals
Hadoop Internals
Pietro Michiardi
MapReduce Improvements in MapR Hadoop
MapReduce Improvements in MapR Hadoop
abord
Hadoop: Past, Present and Future - v2.1 - SQLSaturday #340
Hadoop: Past, Present and Future - v2.1 - SQLSaturday #340
Big Data Joe™ Rossi
NYC Hadoop Meetup - MapR, Architecture, Philosophy and Applications
NYC Hadoop Meetup - MapR, Architecture, Philosophy and Applications
Jason Shao
Anatomy of Hadoop YARN
Anatomy of Hadoop YARN
Rajesh Ananda Kumar
Hadoop - Past, Present and Future - v2.0
Hadoop - Past, Present and Future - v2.0
Big Data Joe™ Rossi
Hadoop fault-tolerance
Hadoop fault-tolerance
Ravindra Bandara
Architectural Overview of MapR's Apache Hadoop Distribution
Architectural Overview of MapR's Apache Hadoop Distribution
mcsrivas
Spark tunning in Apache Kylin
Spark tunning in Apache Kylin
Shi Shao Feng
Inside MapR's M7
Inside MapR's M7
Ted Dunning
The Future of Hadoop: MapR VP of Product Management, Tomer Shiran
The Future of Hadoop: MapR VP of Product Management, Tomer Shiran
MapR Technologies
Hadoop: Past, Present and Future - v2.2 - SQLSaturday #326 - Tampa BA Edition
Hadoop: Past, Present and Future - v2.2 - SQLSaturday #326 - Tampa BA Edition
Big Data Joe™ Rossi
Yarn
Yarn
Ayub Mohammad
Hadoop - Past, Present and Future - v1.1
Hadoop - Past, Present and Future - v1.1
Big Data Joe™ Rossi
Hadoop fault tolerance
Hadoop fault tolerance
Pallav Jha
Advanced Hadoop Tuning and Optimization
Advanced Hadoop Tuning and Optimization
Shivkumar Babshetty
Un tringleur deballe toute son intimite
Un tringleur deballe toute son intimite
foamydog6118
450 aniversari d'honorato juan
450 aniversari d'honorato juan
cordexativa
Más contenido relacionado
La actualidad más candente
20a installation
20a installation
mapr-academy
Introduction to Yarn
Introduction to Yarn
Omid Vahdaty
10c introduction
10c introduction
mapr-academy
MapR Tutorial Series
MapR Tutorial Series
selvaraaju
Hadoop Internals
Hadoop Internals
Pietro Michiardi
MapReduce Improvements in MapR Hadoop
MapReduce Improvements in MapR Hadoop
abord
Hadoop: Past, Present and Future - v2.1 - SQLSaturday #340
Hadoop: Past, Present and Future - v2.1 - SQLSaturday #340
Big Data Joe™ Rossi
NYC Hadoop Meetup - MapR, Architecture, Philosophy and Applications
NYC Hadoop Meetup - MapR, Architecture, Philosophy and Applications
Jason Shao
Anatomy of Hadoop YARN
Anatomy of Hadoop YARN
Rajesh Ananda Kumar
Hadoop - Past, Present and Future - v2.0
Hadoop - Past, Present and Future - v2.0
Big Data Joe™ Rossi
Hadoop fault-tolerance
Hadoop fault-tolerance
Ravindra Bandara
Architectural Overview of MapR's Apache Hadoop Distribution
Architectural Overview of MapR's Apache Hadoop Distribution
mcsrivas
Spark tunning in Apache Kylin
Spark tunning in Apache Kylin
Shi Shao Feng
Inside MapR's M7
Inside MapR's M7
Ted Dunning
The Future of Hadoop: MapR VP of Product Management, Tomer Shiran
The Future of Hadoop: MapR VP of Product Management, Tomer Shiran
MapR Technologies
Hadoop: Past, Present and Future - v2.2 - SQLSaturday #326 - Tampa BA Edition
Hadoop: Past, Present and Future - v2.2 - SQLSaturday #326 - Tampa BA Edition
Big Data Joe™ Rossi
Yarn
Yarn
Ayub Mohammad
Hadoop - Past, Present and Future - v1.1
Hadoop - Past, Present and Future - v1.1
Big Data Joe™ Rossi
Hadoop fault tolerance
Hadoop fault tolerance
Pallav Jha
Advanced Hadoop Tuning and Optimization
Advanced Hadoop Tuning and Optimization
Shivkumar Babshetty
La actualidad más candente
(20)
20a installation
20a installation
Introduction to Yarn
Introduction to Yarn
10c introduction
10c introduction
MapR Tutorial Series
MapR Tutorial Series
Hadoop Internals
Hadoop Internals
MapReduce Improvements in MapR Hadoop
MapReduce Improvements in MapR Hadoop
Hadoop: Past, Present and Future - v2.1 - SQLSaturday #340
Hadoop: Past, Present and Future - v2.1 - SQLSaturday #340
NYC Hadoop Meetup - MapR, Architecture, Philosophy and Applications
NYC Hadoop Meetup - MapR, Architecture, Philosophy and Applications
Anatomy of Hadoop YARN
Anatomy of Hadoop YARN
Hadoop - Past, Present and Future - v2.0
Hadoop - Past, Present and Future - v2.0
Hadoop fault-tolerance
Hadoop fault-tolerance
Architectural Overview of MapR's Apache Hadoop Distribution
Architectural Overview of MapR's Apache Hadoop Distribution
Spark tunning in Apache Kylin
Spark tunning in Apache Kylin
Inside MapR's M7
Inside MapR's M7
The Future of Hadoop: MapR VP of Product Management, Tomer Shiran
The Future of Hadoop: MapR VP of Product Management, Tomer Shiran
Hadoop: Past, Present and Future - v2.2 - SQLSaturday #326 - Tampa BA Edition
Hadoop: Past, Present and Future - v2.2 - SQLSaturday #326 - Tampa BA Edition
Yarn
Yarn
Hadoop - Past, Present and Future - v1.1
Hadoop - Past, Present and Future - v1.1
Hadoop fault tolerance
Hadoop fault tolerance
Advanced Hadoop Tuning and Optimization
Advanced Hadoop Tuning and Optimization
Destacado
Un tringleur deballe toute son intimite
Un tringleur deballe toute son intimite
foamydog6118
450 aniversari d'honorato juan
450 aniversari d'honorato juan
cordexativa
Christmas in america
Christmas in america
IETI SD
Proyecto AREA
Proyecto AREA
Cristóbal Blázquez
Transcript
Transcript
RyanStoll2016
Sánchez montaño leslie vanesa
Sánchez montaño leslie vanesa
lesli3
Dli book 01 lesson 4.vocab
Dli book 01 lesson 4.vocab
Keith Miller
Brayan7 a
Brayan7 a
IETI SD
Bandada de la dimension didactica
Bandada de la dimension didactica
kpacitacion_2015
Hari_New Resume
Hari_New Resume
Harry Bhilawadi Bhilawadi
SILLA PORTA CELULAR
SILLA PORTA CELULAR
DANIUJAP
Tarea 9 Procedimiento para elaborar un SLIDCASTS en POWERPOINT
Tarea 9 Procedimiento para elaborar un SLIDCASTS en POWERPOINT
MATALOTE5855
In situ conservation2222
In situ conservation2222
Asha cherian
Depreciation
Depreciation
Farooq Saeed
rotary cutting instruments in conservative dentistry
rotary cutting instruments in conservative dentistry
Vasundhara naik
Password Security
Password Security
Melissa Shaffer
Sacred namedecodingandunlocking
Sacred namedecodingandunlocking
Raul Cifuentes
Destacado
(17)
Un tringleur deballe toute son intimite
Un tringleur deballe toute son intimite
450 aniversari d'honorato juan
450 aniversari d'honorato juan
Christmas in america
Christmas in america
Proyecto AREA
Proyecto AREA
Transcript
Transcript
Sánchez montaño leslie vanesa
Sánchez montaño leslie vanesa
Dli book 01 lesson 4.vocab
Dli book 01 lesson 4.vocab
Brayan7 a
Brayan7 a
Bandada de la dimension didactica
Bandada de la dimension didactica
Hari_New Resume
Hari_New Resume
SILLA PORTA CELULAR
SILLA PORTA CELULAR
Tarea 9 Procedimiento para elaborar un SLIDCASTS en POWERPOINT
Tarea 9 Procedimiento para elaborar un SLIDCASTS en POWERPOINT
In situ conservation2222
In situ conservation2222
Depreciation
Depreciation
rotary cutting instruments in conservative dentistry
rotary cutting instruments in conservative dentistry
Password Security
Password Security
Sacred namedecodingandunlocking
Sacred namedecodingandunlocking
Similar a 58a migration
Introduction to Spark
Introduction to Spark
Carol McDonald
Apache Spark Overview
Apache Spark Overview
Carol McDonald
10c introduction
10c introduction
Inyoung Cho
Advanced Spark and TensorFlow Meetup - Dec 12 2017 - Dong Meng, MapR + Kubern...
Advanced Spark and TensorFlow Meetup - Dec 12 2017 - Dong Meng, MapR + Kubern...
Chris Fregly
22 configuration
22 configuration
mapr-academy
Spark SQL versus Apache Drill: Different Tools with Different Rules
Spark SQL versus Apache Drill: Different Tools with Different Rules
DataWorks Summit/Hadoop Summit
YARN - Presented At Dallas Hadoop User Group
YARN - Presented At Dallas Hadoop User Group
Rommel Garcia
Development on Cloud,PaaS and SDDC
Development on Cloud,PaaS and SDDC
seungdon Choi
Development on cloud_paa_s_sddc_mkim_20141216_final
Development on cloud_paa_s_sddc_mkim_20141216_final
minseok kim
Drill into Drill – How Providing Flexibility and Performance is Possible
Drill into Drill – How Providing Flexibility and Performance is Possible
MapR Technologies
YARN: the Key to overcoming the challenges of broad-based Hadoop Adoption
YARN: the Key to overcoming the challenges of broad-based Hadoop Adoption
DataWorks Summit
Tez: Accelerating Data Pipelines - fifthel
Tez: Accelerating Data Pipelines - fifthel
t3rmin4t0r
Big Data Everywhere Chicago: Getting Real with the MapR Platform (MapR)
Big Data Everywhere Chicago: Getting Real with the MapR Platform (MapR)
BigDataEverywhere
Yarns About Yarn
Yarns About Yarn
Cloudera, Inc.
Analyzing Real-World Data with Apache Drill
Analyzing Real-World Data with Apache Drill
tshiran
Bigdata and Hadoop with Docker
Bigdata and Hadoop with Docker
haridasnss
Hortonworks Yarn Code Walk Through January 2014
Hortonworks Yarn Code Walk Through January 2014
Hortonworks
Why Apache Spark is the Heir to MapReduce in the Hadoop Ecosystem
Why Apache Spark is the Heir to MapReduce in the Hadoop Ecosystem
Cloudera, Inc.
Big Data Everywhere Chicago: SQL on Hadoop
Big Data Everywhere Chicago: SQL on Hadoop
BigDataEverywhere
Mapreduce Hadop.pptx
Mapreduce Hadop.pptx
Bangladesh University of Professionals
Similar a 58a migration
(20)
Introduction to Spark
Introduction to Spark
Apache Spark Overview
Apache Spark Overview
10c introduction
10c introduction
Advanced Spark and TensorFlow Meetup - Dec 12 2017 - Dong Meng, MapR + Kubern...
Advanced Spark and TensorFlow Meetup - Dec 12 2017 - Dong Meng, MapR + Kubern...
22 configuration
22 configuration
Spark SQL versus Apache Drill: Different Tools with Different Rules
Spark SQL versus Apache Drill: Different Tools with Different Rules
YARN - Presented At Dallas Hadoop User Group
YARN - Presented At Dallas Hadoop User Group
Development on Cloud,PaaS and SDDC
Development on Cloud,PaaS and SDDC
Development on cloud_paa_s_sddc_mkim_20141216_final
Development on cloud_paa_s_sddc_mkim_20141216_final
Drill into Drill – How Providing Flexibility and Performance is Possible
Drill into Drill – How Providing Flexibility and Performance is Possible
YARN: the Key to overcoming the challenges of broad-based Hadoop Adoption
YARN: the Key to overcoming the challenges of broad-based Hadoop Adoption
Tez: Accelerating Data Pipelines - fifthel
Tez: Accelerating Data Pipelines - fifthel
Big Data Everywhere Chicago: Getting Real with the MapR Platform (MapR)
Big Data Everywhere Chicago: Getting Real with the MapR Platform (MapR)
Yarns About Yarn
Yarns About Yarn
Analyzing Real-World Data with Apache Drill
Analyzing Real-World Data with Apache Drill
Bigdata and Hadoop with Docker
Bigdata and Hadoop with Docker
Hortonworks Yarn Code Walk Through January 2014
Hortonworks Yarn Code Walk Through January 2014
Why Apache Spark is the Heir to MapReduce in the Hadoop Ecosystem
Why Apache Spark is the Heir to MapReduce in the Hadoop Ecosystem
Big Data Everywhere Chicago: SQL on Hadoop
Big Data Everywhere Chicago: SQL on Hadoop
Mapreduce Hadop.pptx
Mapreduce Hadop.pptx
Más de mapr-academy
53 lab-nfs
53 lab-nfs
mapr-academy
51 lab-volumes
51 lab-volumes
mapr-academy
50a volumes
50a volumes
mapr-academy
48a tuning
48a tuning
mapr-academy
42 lab-managing services
42 lab-managing services
mapr-academy
41a managing services
41a managing services
mapr-academy
14 lab-planing
14 lab-planing
mapr-academy
3 map r installation & setup administration course description
3 map r installation & setup administration course description
mapr-academy
Más de mapr-academy
(8)
53 lab-nfs
53 lab-nfs
51 lab-volumes
51 lab-volumes
50a volumes
50a volumes
48a tuning
48a tuning
42 lab-managing services
42 lab-managing services
41a managing services
41a managing services
14 lab-planing
14 lab-planing
3 map r installation & setup administration course description
3 map r installation & setup administration course description
Último
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
Radu Cotescu
🐬 The future of MySQL is Postgres 🐘
🐬 The future of MySQL is Postgres 🐘
RTylerCroy
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
The Digital Insurer
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
Remote DBA Services
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
apidays
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
sammart93
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
Joaquim Jorge
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
Anna Loughnan Colquhoun
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Edi Saputra
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
debabhi2
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
Khem
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
Martijn de Jong
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024
The Digital Insurer
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
Safe Software
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
The Digital Insurer
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
wesley chun
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Miguel Araújo
HTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation Strategies
Boston Institute of Analytics
Último
(20)
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
🐬 The future of MySQL is Postgres 🐘
🐬 The future of MySQL is Postgres 🐘
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
HTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation Strategies
58a migration
1.
Migrating from Another
Distribution 7/6/2012 © 2012 MapR Technologies Migration 1
2.
Migration
Agenda • Migration Roadmap • Planning the Migration • MapR Deployment • Component Migration • Application Migration • Data Migration • Node Migration © 2012 MapR Technologies Migration 2
3.
Migration
Objectives At the end of this module you will be able to: • List the important steps in migrating to MapR from another Hadoop distribution • Plan for a migration to MapR • Describe the process for migrating components to MapR • Identify the steps for migrating applications to MapR • Explain how to migrate data to MapR © 2012 MapR Technologies Migration 3
4.
Migration Roadmap © 2012
MapR Technologies Migration 4
5.
Migration Roadmap
Planning Initial MapR Deployment Component Migration Application Migration Data Migration Node Migration © 2012 MapR Technologies Migration 5
6.
Planning the Migration ©
2012 MapR Technologies Migration 6
7.
Planning the Migration
Requirements and goals Potential issues Data migration – Move datasets individually or all at once? Downtime – How much can you tolerate, if any? Customization Storage © 2012 MapR Technologies Migration 7
8.
MapR Deployment © 2012
MapR Technologies Migration 8
9.
MapR Deployment
Install, configure and test MapR cluster Add ecosystem components and applications you need Test MapR functionality – Your custom patches and one-off code might no longer be needed © 2012 MapR Technologies Migration 9
10.
Component Migration © 2012
MapR Technologies Migration 10
11.
Component Migration
Hive Migration – Import table schemas – Import Hive metastore – Using Hive with volumes HBase Migration – Use the /hbase volume – Turn off compression for the /hbase volume Migrating customized components – Reapply your patches to MapR versions – Do not hardcode paths – use fs.default.name © 2012 MapR Technologies Migration 11
12.
Application Migration © 2012
MapR Technologies Migration 12
13.
Application Migration
Make sure Java classpath includes path to maprfs.jar Make sure java.library.path includes libMapRClient.so Use fs.default.name – Point to maprfs:/// – Uses cluster specified on the first line of mapr-clusters.conf The distcp command does not copy file permissions Remove explicit memory settings from your application Test application with a small amount of data © 2012 MapR Technologies Migration 13
14.
Data Migration © 2012
MapR Technologies Migration 14
15.
Data Migration
Distributed copy – hadoop distcp command – Sets up MapReduce job to copy files and directories Push data – Use MapR File Client to push data from the other cluster © 2012 MapR Technologies Migration 15
16.
Node Migration © 2012
MapR Technologies Migration 16
17.
Node Migration
Reclaim nodes – Decommission nodes from the other cluster – Make sure the nodes meet the MapR installation requirements – Add the nodes to the MapR cluster © 2012 MapR Technologies Migration 17
18.
Questions © 2012 MapR
Technologies Migration 18