High Availability in YARN - Project Preview

•

1 recomendación•1,205 vistas

Arinto Murdopo

Project preview presentation for ID2219.

Educación

Highly Available
NG Hadoop MapReduce
Arinto Murdopo
Mário Almeida
Umit Cavus
Strahinja Lazetic

Supervisor: Jim Dowling

Outcome
● Highly Available implementation of YARN
○ with Zookeeper before the hadoop team
○ with NDB MySql-Cluster before Jim kicks us out

● (Secondary goal) make RM stateless so we
can have more than one running at each
moment.
○ So we can have failover when there is failure in a
RM

● (Eventual goal) Get a job!

Más contenido relacionado

Destacado

Practica 2 luis ivan cruz val.persi-10

Sam houston chess teamSam Houston Lmc

Maailmassa on parempia pankkejaPankki2

Uso correto de epi´s abafadoresPaulo Carvalho

Why File Sharing is Dangerous?Arinto Murdopo

Arviointi ja palaute 2011Marko Havu

Architecting a Cloud-Scale Identity FabricArinto Murdopo

The counting system for small animals in japaneseCheyanneStotlar

Moodboards edaedaozdemir

Pechakuchacmcgrupo8

Distributed Computing - What, why, how..Arinto Murdopo

153 test plan< <

UX homework4mylovelymac

Parts of SpeechJen Lawson

Quantum Cryptography and Possible AttacksArinto Murdopo

Pankki 2.0-hankkeen esittelyPankki2

Cultura mitesComalat1D

Netcare csi kelvin's talk aug 2015Kelvin Glen

Parallelization of Smith-Waterman Algorithm using MPIArinto Murdopo

Destacado (20)

Practica 2 luis ivan cruz val.

Sam houston chess team

Maailmassa on parempia pankkeja

Uso correto de epi´s abafadores

Why File Sharing is Dangerous?

Arviointi ja palaute 2011

Architecting a Cloud-Scale Identity Fabric

The counting system for small animals in japanese

Moodboards eda

Pechakucha

Distributed Computing - What, why, how..

153 test plan

UX homework4

Parts of Speech

Quantum Cryptography and Possible Attacks

Pankki 2.0-hankkeen esittely

Cultura mites

Netcare csi kelvin's talk aug 2015

Parallelization of Smith-Waterman Algorithm using MPI

Más de Arinto Murdopo

Distributed Decision Tree Learning for Mining Big Data StreamsArinto Murdopo

Next Generation Hadoop: High Availability for YARN Arinto Murdopo

High Availability in YARNArinto Murdopo

An Integer Programming Representation for Data Center Power-Aware Management ...Arinto Murdopo

Quantum Cryptography and Possible Attacks-slideArinto Murdopo

Dremel Paper ReviewArinto Murdopo

Megastore - ID2220 PresentationArinto Murdopo

Flume Event ScalabilityArinto Murdopo

Large Scale Distributed Storage Systems in Volunteer Computing - SlideArinto Murdopo

Large-Scale Decentralized Storage Systems for Volunter Computing SystemsArinto Murdopo

Rise of Network VirtualizationArinto Murdopo

Consistency Tradeoffs in Modern Distributed Database System DesignArinto Murdopo

Distributed Storage System for Volunteer ComputingArinto Murdopo

Apache FlumeArinto Murdopo

Why Use “REST” Architecture for Web Services?Arinto Murdopo

Distributed SystemsArinto Murdopo

Más de Arinto Murdopo (17)

Distributed Decision Tree Learning for Mining Big Data Streams

Next Generation Hadoop: High Availability for YARN

High Availability in YARN

An Integer Programming Representation for Data Center Power-Aware Management ...

Quantum Cryptography and Possible Attacks-slide

Dremel Paper Review

Megastore - ID2220 Presentation

Flume Event Scalability

Large Scale Distributed Storage Systems in Volunteer Computing - Slide

Large-Scale Decentralized Storage Systems for Volunter Computing Systems

Rise of Network Virtualization

Consistency Tradeoffs in Modern Distributed Database System Design

Distributed Storage System for Volunteer Computing

Apache Flume

Why Use “REST” Architecture for Web Services?

Distributed Systems

Último

Privatization and Disinvestment - Meaning, Objectives, Advantages and Disadva...RKavithamani

Nutritional Needs Presentation - HLTH 104misteraugie

How to Make a Pirate ship Primary Education.pptxmanuelaromero2013

Paris 2024 Olympic Geographies - an activityGeoBlogs

Advanced Views - Calendar View in Odoo 17Celine George

Sanyam Choudhary Chemistry practical.pdfsanyamsingh5019

“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...Marc Dusseiller Dusjagr

Separation of Lanthanides/ Lanthanides and ActinidesFatimaKhan178732

Call Girls in Dwarka Mor Delhi Contact Us 9654467111Sapana Sha

Código Creativo y Arte de Software | Unidad 1Maestría en Comunicación Digital Interactiva - UNR

TataKelola dan KamSiber Kecerdasan Buatan v022.pdfSarwono Sutikno, Dr.Eng.,CISA,CISSP,CISM,CSX-F

1029-Danh muc Sach Giao Khoa khoi 6.pdfQucHHunhnh

Mastering the Unannounced Regulatory InspectionSafetyChain Software

Contemporary philippine arts from the regions_PPT_Module_12 [Autosaved] (1).pptxRoyAbrique

The basics of sentences session 2pptx copy.pptxheathfieldcps1

Accessible design: Minimum effort, maximum impactdawncurless

The Most Excellent Way | 1 Corinthians 13Steve Thomason

Beyond the EU: DORA and NIS 2 Directive's Global ImpactPECB

Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...EduSkills OECD

1029 - Danh muc Sach Giao Khoa 10 . pdfQucHHunhnh