Sanger HPC infrastructure Report (2007)

•Descargar como ODP, PDF•

3 recomendaciones•909 vistas

Guy Coates

Overview of the Sanger Institute HPC infrastructure and mangement tools, given at the Spring 2007 Hepix meeting.

Tecnología

Sanger Institute Site Report Nov 2007 Guy Coates [email_address]

About the Institute ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Why are we here? ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],   Sequencing machines

Managing Growth ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Data centre ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],rack rack rack rack

Storage ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Compute ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Infrastructure / Management ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Tera-scale Oracle ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Compute farm ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Farm lustre storage ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Lustre performance ,[object Object],[object Object]

Supporting New Sequencing ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Data pull ... LSF reconfig allows processing and alignment capacity to be interchanged. Lustre Clients have 2xGigE, 4GigE trunks from chassis to core switch. Datastore 320TB EVA (Lustre) sequencer1 sequencer 20 blade chassis (alignment) blade chassis (processing) blade chassis (processing) blade chassis (alignment) blade chassis (alignment) blade chassis (suckers) scratch area 25TB SFS20 (Lustre) Final Repository (NFS)

Acknowledgements ,[object Object],[object Object],[object Object],[object Object],[object Object],HP Life sciences / SFS ,[object Object],[object Object],[object Object],[object Object],Sanger Institute ,[object Object],[object Object],[object Object]

Más contenido relacionado

La actualidad más candente

HDFS IssuesSteve Loughran

RedisKishor Parkhe

My other computer_is_a_datacentreSteve Loughran

Hadoop TechnologyAtul Kushwaha

HadoopZubair Arshad

Challenges and Opportunities of Big Data GenomicsYasin Memari

getFamiliarWithHadoopAmirReza Mohammadi

Lightning fast genomics with Spark, Adam and ScalaAndy Petrella

Hadoop Research Shreyansh Ajit kumar

Hadoop: The elephant in the roomcacois

A Step to the Clouded Solution of Scalable Clinical Genome Sequencing (BDT308...Amazon Web Services

Масштабируемость Hadoop в Facebook. Дмитрий Мольков, Facebookyaevents

Hadoop-Quick introductionSandeep Singh

Introduction to Hadoop part1Giovanna Roda

Apache hadoop technology : BeginnersShweta Patnaik

Hadoop An IntroductionMohanasundaram Ponnusamy

PPT on HadoopShubham Parmar

Hadoop Adventures At Spotify (Strata Conference + Hadoop World 2013)Adam Kawa

MongoDB by TonnyAgate Studio

Ga4 gh meeting at the the sanger instituteMatt Massie

La actualidad más candente (20)

HDFS Issues

Redis

My other computer_is_a_datacentre

Hadoop Technology

Hadoop

Challenges and Opportunities of Big Data Genomics

getFamiliarWithHadoop

Lightning fast genomics with Spark, Adam and Scala

Hadoop Research

Hadoop: The elephant in the room

A Step to the Clouded Solution of Scalable Clinical Genome Sequencing (BDT308...

Масштабируемость Hadoop в Facebook. Дмитрий Мольков, Facebook

Hadoop-Quick introduction

Introduction to Hadoop part1

Apache hadoop technology : Beginners

Hadoop An Introduction

PPT on Hadoop

Hadoop Adventures At Spotify (Strata Conference + Hadoop World 2013)

MongoDB by Tonny

Ga4 gh meeting at the the sanger institute

Similar a Sanger HPC infrastructure Report (2007)

SUE 2018 - Migrating a 130TB Cluster from Elasticsearch 2 to 5 in 20 Hours Wi...Fred de Villamil

Setting up repositoriesIryna Kuchma

Exadata x2 extyangjx

Setting up repositories: Technical Requirements, Repository Software, Metad...Iryna Kuchma

Computational infrastructure for NGS data analysiscursoNGS

Sun Oracle Exadata V2 For OLTP And DWHMark Rabne

Blades for HPTCGuy Coates

LUG 2014Hitoshi Sato

The Smug Mug TaleMySQLConference

Architecting a 35 PB distributed parallel file system for scienceSpeck&Tech

Pilot Hadoop Towards 2500 Nodes and Cluster RedundancyStuart Pook

JetStor NAS series 2016Gene Leyzarovich

MySQL NDB Cluster 8.0 SQL faster than NoSQL Bernd Ocklin

E Science As A Lens On The World Lazowskaguest43b4df3

E Science As A Lens On The World LazowskaWCET

My First 100 days with an Exadata (WP)Gustavo Rene Antunez

PAS 8 DatasheetPanasas

[RakutenTechConf2013] [A-3] TSUBAME2.5 to 3.0 and Convergence with Extreme Bi...Rakuten Group, Inc.

12.) fabric (your next data center)Jeff Green

Architecture of exadata database machine – Part IIParesh Nayak,OCP®,Prince2®

Similar a Sanger HPC infrastructure Report (2007) (20)

SUE 2018 - Migrating a 130TB Cluster from Elasticsearch 2 to 5 in 20 Hours Wi...

Setting up repositories

Exadata x2 ext

Setting up repositories: Technical Requirements, Repository Software, Metad...

Computational infrastructure for NGS data analysis

Sun Oracle Exadata V2 For OLTP And DWH

Blades for HPTC

LUG 2014

The Smug Mug Tale

Architecting a 35 PB distributed parallel file system for science

Pilot Hadoop Towards 2500 Nodes and Cluster Redundancy

JetStor NAS series 2016

MySQL NDB Cluster 8.0 SQL faster than NoSQL

E Science As A Lens On The World Lazowska

My First 100 days with an Exadata (WP)

PAS 8 Datasheet

[RakutenTechConf2013] [A-3] TSUBAME2.5 to 3.0 and Convergence with Extreme Bi...

12.) fabric (your next data center)

Architecture of exadata database machine – Part II

Último

Driving Behavioral Change for Information Management through Data-Driven Gree...Enterprise Knowledge

ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProduct Anonymous

Artificial Intelligence: Facts and MythsJoaquim Jorge

04-2024-HHUG-Sales-and-Marketing-Alignment.pptxHampshireHUG

08448380779 Call Girls In Greater Kailash - I Women Seeking MenDelhi Call girls

Presentation on how to chat with PDF using ChatGPT code interpreternaman860154

Powerful Google developer tools for immediate impact! (2023-24 C)wesley chun

Axa Assurance Maroc - Insurer Innovation Award 2024The Digital Insurer

Boost Fertility New Invention Ups Success Rates.pdfsudhanshuwaghmare1

08448380779 Call Girls In Civil Lines Women Seeking MenDelhi Call girls

Finology Group – Insurtech Innovation Award 2024The Digital Insurer

Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Igalia

IAC 2024 - IA Fast Track to Search Focused AI SolutionsEnterprise Knowledge

08448380779 Call Girls In Diplomatic Enclave Women Seeking MenDelhi Call girls

Tech Trends Report 2024 Future Today Institute.pdfhans926745

Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Miguel Araújo

TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc

presentation ICT roal in 21st century educationjfdjdjcjdnsjd

A Domino Admins Adventures (Engage 2024)Gabriella Davis

Automating Google Workspace (GWS) & more with Apps Scriptwesley chun