SlideShare una empresa de Scribd logo
1 de 16
Descargar para leer sin conexión
Building Computational
Grids with Apple’s Xgrid
            Middleware
                            Baden Hughes
       Department of Computer Science and
                      Software Engineering
               The University of Melbourne
             badenh@csse.unimelb.edu.au


17 January 2006        Hughes @ AusGrid 2006   1
Talk Overview
     Introduction
     Xgrid History
     Solution Architecture
     Apple Native vs 3rd Party Components
     Production Experience
     Conclusions



17 January 2006      Hughes @ AusGrid 2006   2
Introduction
     In June 2005 Apple released Xgrid 1.0, a framework
     for loosely coupled distributed computation,
     specifically targets embarrasingly parallel computation
     Xgrid has been positioned as being highly accessible
     advanced computing solution for less technically
     oriented user communities, particularly small to
     medium research groups without easy access to
     traditional HPC environments
     While technically simple, from a functional perspective
     Xgrid blurs the distinction between HPC user and
     maintainer, which could engender new grass-roots
     research through a self-sustaining model for HPC
17 January 2006           Hughes @ AusGrid 2006                3
Xgrid History
     1/2004 Xgrid Technical Preview 1
           Proof of concept only
           Limited developer release
     11/2004 Xgrid Technical Preview 2
           Robust CLI, immature GUI
           Wide developer release
           Reasonable adoption, 3rd party tools emerge
     4/2005 Xgrid 1.0
           Robust CLI, GUI, API
           Production oriented, vendor supported release
           Mac OS X Server centric (somewhat controversially)
17 January 2006                Hughes @ AusGrid 2006            4
Xgrid Architecture
     Client, Controller, Agent
     Client
           User interface; controller authentication; job
           submission/retrieval
     Controller
           Job submission; management (aka cluster head
           node + some brokering)
     Agent
           Compute node (dedicated or cycle stealing; local
           or remote)
17 January 2006              Hughes @ AusGrid 2006            5
Configuration and Systems
Management
     Integrated local client configuration via System
     Preferences
     Remote client configuration via ssh, Apple RD;
     Netboot etc
     Controller based Server Admin tools allow ‘whole of
     grid’ configuration (authentication methods, agent
     type etc)
     Integrated user management and authentication
     (Kerberos, SSO, LDAP, Active Directory)
     Controller discovery either specified (FQDN) or
     dynamic (ZeroConf, Rendezvous, Bonjour)
17 January 2006          Hughes @ AusGrid 2006             6
Job Specification and
Management
     Job = 1 or more tasks
     Jobs described in Apple’s extensible plist format
     (either native plist or XML)
     Submission to controller via client either in serial or
     batch mode
     Controller periodically probes all registered agents to
     determine availability (NB currently proprietary
     scheduling heuristic)
     Asynchronous client-controller interaction model:
     clients can disconnect and later reconnect to retrieve
     completed jobs

17 January 2006            Hughes @ AusGrid 2006               7
Scalability
     Published (cluster mode) benchmarks:
           128 Agents
           20,000 queued jobs
           100,000 tasks per job
           2Gb data per job
           1Gb results per task
           10Gb aggregate results per job
     Production sites with >200 agents in distributed
     mode
     Integration with existing OS X management tools
     such as ARD does allow for considerable scalability
17 January 2006                Hughes @ AusGrid 2006       8
Apple Native Components
Overview




17 January 2006   Hughes @ AusGrid 2006   9
Apple Native Components
Detail
     GUI:
       Xgrid.app, simple user interface
     CLI
       Xgrid, batch oriented, supports multitask submission
     Cocoa Framework
       XgridFoundation, ObjC core, with PyObj access, full featured
     Xgrid Controller
           client authentication, node management, job scheduling
     Tiger Agent
        Xgrid agent for Mac OS X 10.4 nodes
     Panther Agent
        Xgrid agent for Mac OS X 10.3 nodes
     Network Communications
        Based around BEEP (IETF RFC 3080)
17 January 2006                   Hughes @ AusGrid 2006               10
3rd Party Components
Overview




17 January 2006   Hughes @ AusGrid 2006   11
3rd Party Components Detail
     GridStuffer
           OS X GUI (Cocoa) application for multi-task job submission,
           monitoring, retrieval
     PyXG
           Python/PyObjC-based API for Xgrid client
     GridBus Data Broker:
           data-centric brokering service with (experimental) support for Xgrid
           client
     XgridLite:
           functionally reduced Xgrid controller for OS X workstation platforms
     Xgrid Linux Agent:
           Linux native Xgrid agent
     XgridAgent-Java:
           Platform-independent Java-based Xgrid agent

17 January 2006                       Hughes @ AusGrid 2006                       12
Production Experience
     Locations
           Universities: Stanford, Reed, Utah, Simon Fraser, Toronto,
           Melbourne
           Numerous industrial sites
     Application Domains
           Natural language processing
           Modelling biochemical receptors
           Nonlinear computation in epidemiology
           Rendering animations
           Low autocorrelation binary sequence search
           Biophytonic tissue analysis

17 January 2006                Hughes @ AusGrid 2006                13
Conclusion
     Significant advantage for Xgrid is ease of
     administration and use; contrasts with many other
     cluster/grid computing middleware
     Some disadvantages in area integration (particularly
     with other middleware suites)
     Active 3rd party development community and open
     relations with Apple’s Xgrid product group have made
     Xgrid more compelling
     Some shrink-wrapped applications have Xgrid support
     (eg GridMathematica)
     Other cluster/grid computing solutions for Mac OS X
     exist (eg MPI, Pooch)
17 January 2006          Hughes @ AusGrid 2006          14
More Xgrid Info

     http://www.apple.com/acg/xgrid

     http://developer.apple.com/hardware/hpc

     http://www.macresearch.org



17 January 2006      Hughes @ AusGrid 2006     15
Acknowledgements
     Research supported by Apple Computer Inc,
     through the Apple University Consortium and
     the Apple University Development Fund
     Thanks to Ernest Prabhakar (Xgrid Product
     Manager) and Richard Crandall (Advanced
     Computation Group) from Apple for
     comments on an earlier version of this paper


17 January 2006       Hughes @ AusGrid 2006     16

Más contenido relacionado

Destacado

2nd Trimester Sponges
2nd Trimester Sponges2nd Trimester Sponges
2nd Trimester SpongesCorey Topf
 
Week 12 Sponges
Week 12 SpongesWeek 12 Sponges
Week 12 SpongesCorey Topf
 
Zappos - NAA - 3-9-09
Zappos - NAA - 3-9-09Zappos - NAA - 3-9-09
Zappos - NAA - 3-9-09zappos
 
2nd Trimester Sponges
2nd Trimester Sponges2nd Trimester Sponges
2nd Trimester SpongesCorey Topf
 
The organisation of social security coordination
The organisation of social security coordinationThe organisation of social security coordination
The organisation of social security coordinationStevenSegaert
 
Zappos - ETR - 03-24-09
Zappos - ETR -  03-24-09Zappos - ETR -  03-24-09
Zappos - ETR - 03-24-09zappos
 
IADD1 0809 Q3 Hoorcollege1 Deeltijd
IADD1 0809 Q3 Hoorcollege1 DeeltijdIADD1 0809 Q3 Hoorcollege1 Deeltijd
IADD1 0809 Q3 Hoorcollege1 DeeltijdHans Kemp
 
Week 32 Sponges
Week 32 SpongesWeek 32 Sponges
Week 32 SpongesCorey Topf
 
Zappos - James Malinchak Event - 7-26-09
Zappos - James Malinchak Event - 7-26-09Zappos - James Malinchak Event - 7-26-09
Zappos - James Malinchak Event - 7-26-09zappos
 
#MoreCrypto : Introduction to TLS
#MoreCrypto : Introduction to TLS#MoreCrypto : Introduction to TLS
#MoreCrypto : Introduction to TLSOlle E Johansson
 
Quick Quiz Week1
Quick Quiz Week1Quick Quiz Week1
Quick Quiz Week1Corey Topf
 
Ep 2012 week4-piaget_para-tarjetas
Ep 2012 week4-piaget_para-tarjetasEp 2012 week4-piaget_para-tarjetas
Ep 2012 week4-piaget_para-tarjetaslaurahe
 
Mijn cmd beleving
Mijn cmd belevingMijn cmd beleving
Mijn cmd belevingHans Kemp
 
Vocabulary tuesdayswithmorrie
Vocabulary tuesdayswithmorrieVocabulary tuesdayswithmorrie
Vocabulary tuesdayswithmorrieCorey Topf
 
Keynote deeldag nijmegen_deelstad_2015
Keynote deeldag nijmegen_deelstad_2015Keynote deeldag nijmegen_deelstad_2015
Keynote deeldag nijmegen_deelstad_2015roemen
 
European Outdoor Summit 2013 Keynote
European Outdoor Summit 2013 Keynote European Outdoor Summit 2013 Keynote
European Outdoor Summit 2013 Keynote Johan Ronnestam
 
Innovation academy2014 2015
Innovation academy2014 2015Innovation academy2014 2015
Innovation academy2014 2015Corey Topf
 

Destacado (20)

2nd Trimester Sponges
2nd Trimester Sponges2nd Trimester Sponges
2nd Trimester Sponges
 
Week 12 Sponges
Week 12 SpongesWeek 12 Sponges
Week 12 Sponges
 
Zappos - NAA - 3-9-09
Zappos - NAA - 3-9-09Zappos - NAA - 3-9-09
Zappos - NAA - 3-9-09
 
2nd Trimester Sponges
2nd Trimester Sponges2nd Trimester Sponges
2nd Trimester Sponges
 
The organisation of social security coordination
The organisation of social security coordinationThe organisation of social security coordination
The organisation of social security coordination
 
Zappos - ETR - 03-24-09
Zappos - ETR -  03-24-09Zappos - ETR -  03-24-09
Zappos - ETR - 03-24-09
 
IADD1 0809 Q3 Hoorcollege1 Deeltijd
IADD1 0809 Q3 Hoorcollege1 DeeltijdIADD1 0809 Q3 Hoorcollege1 Deeltijd
IADD1 0809 Q3 Hoorcollege1 Deeltijd
 
Week 32 Sponges
Week 32 SpongesWeek 32 Sponges
Week 32 Sponges
 
U21 n zmedicinevaldez
U21 n zmedicinevaldezU21 n zmedicinevaldez
U21 n zmedicinevaldez
 
Zappos - James Malinchak Event - 7-26-09
Zappos - James Malinchak Event - 7-26-09Zappos - James Malinchak Event - 7-26-09
Zappos - James Malinchak Event - 7-26-09
 
#MoreCrypto : Introduction to TLS
#MoreCrypto : Introduction to TLS#MoreCrypto : Introduction to TLS
#MoreCrypto : Introduction to TLS
 
Quick Quiz Week1
Quick Quiz Week1Quick Quiz Week1
Quick Quiz Week1
 
Ep 2012 week4-piaget_para-tarjetas
Ep 2012 week4-piaget_para-tarjetasEp 2012 week4-piaget_para-tarjetas
Ep 2012 week4-piaget_para-tarjetas
 
Mijn cmd beleving
Mijn cmd belevingMijn cmd beleving
Mijn cmd beleving
 
Vocabulary tuesdayswithmorrie
Vocabulary tuesdayswithmorrieVocabulary tuesdayswithmorrie
Vocabulary tuesdayswithmorrie
 
Keynote deeldag nijmegen_deelstad_2015
Keynote deeldag nijmegen_deelstad_2015Keynote deeldag nijmegen_deelstad_2015
Keynote deeldag nijmegen_deelstad_2015
 
Blogging
BloggingBlogging
Blogging
 
Actividad 3
Actividad 3Actividad 3
Actividad 3
 
European Outdoor Summit 2013 Keynote
European Outdoor Summit 2013 Keynote European Outdoor Summit 2013 Keynote
European Outdoor Summit 2013 Keynote
 
Innovation academy2014 2015
Innovation academy2014 2015Innovation academy2014 2015
Innovation academy2014 2015
 

Similar a Building Computational Grids with Apple’s Xgrid Middleware

OFI Overview 2019 Webinar
OFI Overview 2019 WebinarOFI Overview 2019 Webinar
OFI Overview 2019 Webinarseanhefty
 
AGILE software, devices and wider ecosystem
AGILE software, devices and wider ecosystemAGILE software, devices and wider ecosystem
AGILE software, devices and wider ecosystemAGILE IoT
 
Open Source Possibilities for 5G Edge Computing Deployment
Open Source Possibilities for 5G Edge Computing DeploymentOpen Source Possibilities for 5G Edge Computing Deployment
Open Source Possibilities for 5G Edge Computing DeploymentIgnacio Verona
 
FPGA-based soft-processors: 6G nodes and post-quantum security in space
 FPGA-based soft-processors: 6G nodes and post-quantum security in space FPGA-based soft-processors: 6G nodes and post-quantum security in space
FPGA-based soft-processors: 6G nodes and post-quantum security in spaceFacultad de Informática UCM
 
OGCE TeraGrid 2010 Science Gateway Tutorial Intro
OGCE TeraGrid 2010 Science Gateway Tutorial IntroOGCE TeraGrid 2010 Science Gateway Tutorial Intro
OGCE TeraGrid 2010 Science Gateway Tutorial Intromarpierc
 
Red Hat Java Update and Quarkus Introduction
Red Hat Java Update and Quarkus IntroductionRed Hat Java Update and Quarkus Introduction
Red Hat Java Update and Quarkus IntroductionJohn Archer
 
GoGrid 3.0 Webinar: Complex Infrastructure Made Easy - Learn About the GoGrid...
GoGrid 3.0 Webinar: Complex Infrastructure Made Easy - Learn About the GoGrid...GoGrid 3.0 Webinar: Complex Infrastructure Made Easy - Learn About the GoGrid...
GoGrid 3.0 Webinar: Complex Infrastructure Made Easy - Learn About the GoGrid...GoGrid Cloud Hosting
 
FutureGrid Computing Testbed as a Service
 FutureGrid Computing Testbed as a Service FutureGrid Computing Testbed as a Service
FutureGrid Computing Testbed as a ServiceGeoffrey Fox
 
Zou Layered VO PDCAT2008 V0.5 Concise
Zou Layered VO PDCAT2008 V0.5 ConciseZou Layered VO PDCAT2008 V0.5 Concise
Zou Layered VO PDCAT2008 V0.5 Conciseyongqiangzou
 
OGCE RT Rroject Review
OGCE RT Rroject ReviewOGCE RT Rroject Review
OGCE RT Rroject Reviewmarpierc
 
OGCE Review for Indiana University Research Technologies
OGCE Review for Indiana University Research TechnologiesOGCE Review for Indiana University Research Technologies
OGCE Review for Indiana University Research Technologiesmarpierc
 
Open Source Software for Industry 4.0
Open Source Software for Industry 4.0Open Source Software for Industry 4.0
Open Source Software for Industry 4.0Ian Skerrett
 
Java User Group Freiburg - Internet of Things für Java-Entwickler
Java User Group Freiburg - Internet of Things für Java-EntwicklerJava User Group Freiburg - Internet of Things für Java-Entwickler
Java User Group Freiburg - Internet of Things für Java-EntwicklerMarcus Munzert
 
OGF standards for cloud computing
OGF standards for cloud computingOGF standards for cloud computing
OGF standards for cloud computingAlan Sill
 
Hungarian ClusterGrid and its applications
Hungarian ClusterGrid and its applicationsHungarian ClusterGrid and its applications
Hungarian ClusterGrid and its applicationsFerenc Szalai
 
DDDP 2019 - Brown to Green
DDDP 2019  - Brown to GreenDDDP 2019  - Brown to Green
DDDP 2019 - Brown to GreenJohn Archer
 
Open source based software ‘gxt’ mangosystem
Open source based software ‘gxt’ mangosystemOpen source based software ‘gxt’ mangosystem
Open source based software ‘gxt’ mangosystemHaNJiN Lee
 

Similar a Building Computational Grids with Apple’s Xgrid Middleware (20)

OFI Overview 2019 Webinar
OFI Overview 2019 WebinarOFI Overview 2019 Webinar
OFI Overview 2019 Webinar
 
AGILE software, devices and wider ecosystem
AGILE software, devices and wider ecosystemAGILE software, devices and wider ecosystem
AGILE software, devices and wider ecosystem
 
Open Source Possibilities for 5G Edge Computing Deployment
Open Source Possibilities for 5G Edge Computing DeploymentOpen Source Possibilities for 5G Edge Computing Deployment
Open Source Possibilities for 5G Edge Computing Deployment
 
FPGA-based soft-processors: 6G nodes and post-quantum security in space
 FPGA-based soft-processors: 6G nodes and post-quantum security in space FPGA-based soft-processors: 6G nodes and post-quantum security in space
FPGA-based soft-processors: 6G nodes and post-quantum security in space
 
OGCE TeraGrid 2010 Science Gateway Tutorial Intro
OGCE TeraGrid 2010 Science Gateway Tutorial IntroOGCE TeraGrid 2010 Science Gateway Tutorial Intro
OGCE TeraGrid 2010 Science Gateway Tutorial Intro
 
Red Hat Java Update and Quarkus Introduction
Red Hat Java Update and Quarkus IntroductionRed Hat Java Update and Quarkus Introduction
Red Hat Java Update and Quarkus Introduction
 
GoGrid 3.0 Webinar: Complex Infrastructure Made Easy - Learn About the GoGrid...
GoGrid 3.0 Webinar: Complex Infrastructure Made Easy - Learn About the GoGrid...GoGrid 3.0 Webinar: Complex Infrastructure Made Easy - Learn About the GoGrid...
GoGrid 3.0 Webinar: Complex Infrastructure Made Easy - Learn About the GoGrid...
 
FutureGrid Computing Testbed as a Service
 FutureGrid Computing Testbed as a Service FutureGrid Computing Testbed as a Service
FutureGrid Computing Testbed as a Service
 
Zou Layered VO PDCAT2008 V0.5 Concise
Zou Layered VO PDCAT2008 V0.5 ConciseZou Layered VO PDCAT2008 V0.5 Concise
Zou Layered VO PDCAT2008 V0.5 Concise
 
OGCE RT Rroject Review
OGCE RT Rroject ReviewOGCE RT Rroject Review
OGCE RT Rroject Review
 
OGCE Review for Indiana University Research Technologies
OGCE Review for Indiana University Research TechnologiesOGCE Review for Indiana University Research Technologies
OGCE Review for Indiana University Research Technologies
 
Session19 Globus
Session19 GlobusSession19 Globus
Session19 Globus
 
Open Source Software for Industry 4.0
Open Source Software for Industry 4.0Open Source Software for Industry 4.0
Open Source Software for Industry 4.0
 
Java User Group Freiburg - Internet of Things für Java-Entwickler
Java User Group Freiburg - Internet of Things für Java-EntwicklerJava User Group Freiburg - Internet of Things für Java-Entwickler
Java User Group Freiburg - Internet of Things für Java-Entwickler
 
OGF standards for cloud computing
OGF standards for cloud computingOGF standards for cloud computing
OGF standards for cloud computing
 
Hungarian ClusterGrid and its applications
Hungarian ClusterGrid and its applicationsHungarian ClusterGrid and its applications
Hungarian ClusterGrid and its applications
 
DDDP 2019 - Brown to Green
DDDP 2019  - Brown to GreenDDDP 2019  - Brown to Green
DDDP 2019 - Brown to Green
 
Open source based software ‘gxt’ mangosystem
Open source based software ‘gxt’ mangosystemOpen source based software ‘gxt’ mangosystem
Open source based software ‘gxt’ mangosystem
 
Hybrid Cloud 2014
Hybrid Cloud 2014Hybrid Cloud 2014
Hybrid Cloud 2014
 
PowerAI Deep dive
PowerAI Deep divePowerAI Deep dive
PowerAI Deep dive
 

Más de Baden Hughes

Closing the Gap: Data Models for Documentary Linguistics
Closing the Gap: Data Models for Documentary LinguisticsClosing the Gap: Data Models for Documentary Linguistics
Closing the Gap: Data Models for Documentary LinguisticsBaden Hughes
 
Managing Perl Installations: A SysAdmin's View
Managing Perl Installations: A SysAdmin's ViewManaging Perl Installations: A SysAdmin's View
Managing Perl Installations: A SysAdmin's ViewBaden Hughes
 
If We're Not There Yet, How Far Do We Have To Go ? Web Metadata at The Univer...
If We're Not There Yet, How Far Do We Have To Go ? Web Metadata at The Univer...If We're Not There Yet, How Far Do We Have To Go ? Web Metadata at The Univer...
If We're Not There Yet, How Far Do We Have To Go ? Web Metadata at The Univer...Baden Hughes
 
Functional Requirements for an Interlinear Text Editor
Functional Requirements for an Interlinear Text EditorFunctional Requirements for an Interlinear Text Editor
Functional Requirements for an Interlinear Text EditorBaden Hughes
 
Management of Metadata in Linguistic Fieldwork: Experience from the ACLA Pro...
Management of Metadata in Linguistic Fieldwork: Experience from the ACLA Pro...Management of Metadata in Linguistic Fieldwork: Experience from the ACLA Pro...
Management of Metadata in Linguistic Fieldwork: Experience from the ACLA Pro...Baden Hughes
 
Disambiguating Advanced Computing for Humanities Researchers
Disambiguating Advanced Computing for Humanities ResearchersDisambiguating Advanced Computing for Humanities Researchers
Disambiguating Advanced Computing for Humanities ResearchersBaden Hughes
 
Metadata Quality Evaluation: Experience from the Open Language Archives Commu...
Metadata Quality Evaluation: Experience from the Open Language Archives Commu...Metadata Quality Evaluation: Experience from the Open Language Archives Commu...
Metadata Quality Evaluation: Experience from the Open Language Archives Commu...Baden Hughes
 
Encoding and Presenting Interlinear Text Using XML Technologies
Encoding and Presenting Interlinear Text Using XML TechnologiesEncoding and Presenting Interlinear Text Using XML Technologies
Encoding and Presenting Interlinear Text Using XML TechnologiesBaden Hughes
 
Refactoring Metadata:
Refactoring Metadata:Refactoring Metadata:
Refactoring Metadata:Baden Hughes
 
Towards a Web Search Service for Minority Language Communities
Towards a Web Search Service for Minority Language CommunitiesTowards a Web Search Service for Minority Language Communities
Towards a Web Search Service for Minority Language CommunitiesBaden Hughes
 
Change Management and Versioning in Ontologies
Change Management and Versioning in OntologiesChange Management and Versioning in Ontologies
Change Management and Versioning in OntologiesBaden Hughes
 
Object Reuse and Exchange (ORE) : Experience in the Open Language Archives Co...
Object Reuse and Exchange (ORE) : Experience in the Open Language Archives Co...Object Reuse and Exchange (ORE) : Experience in the Open Language Archives Co...
Object Reuse and Exchange (ORE) : Experience in the Open Language Archives Co...Baden Hughes
 
The Effects of Cross-Pollination : How non-library mass market services are c...
The Effects of Cross-Pollination : How non-library mass market services are c...The Effects of Cross-Pollination : How non-library mass market services are c...
The Effects of Cross-Pollination : How non-library mass market services are c...Baden Hughes
 
Why Digitization Increases the Value of Print Collections
Why Digitization Increases the Value of Print CollectionsWhy Digitization Increases the Value of Print Collections
Why Digitization Increases the Value of Print CollectionsBaden Hughes
 

Más de Baden Hughes (14)

Closing the Gap: Data Models for Documentary Linguistics
Closing the Gap: Data Models for Documentary LinguisticsClosing the Gap: Data Models for Documentary Linguistics
Closing the Gap: Data Models for Documentary Linguistics
 
Managing Perl Installations: A SysAdmin's View
Managing Perl Installations: A SysAdmin's ViewManaging Perl Installations: A SysAdmin's View
Managing Perl Installations: A SysAdmin's View
 
If We're Not There Yet, How Far Do We Have To Go ? Web Metadata at The Univer...
If We're Not There Yet, How Far Do We Have To Go ? Web Metadata at The Univer...If We're Not There Yet, How Far Do We Have To Go ? Web Metadata at The Univer...
If We're Not There Yet, How Far Do We Have To Go ? Web Metadata at The Univer...
 
Functional Requirements for an Interlinear Text Editor
Functional Requirements for an Interlinear Text EditorFunctional Requirements for an Interlinear Text Editor
Functional Requirements for an Interlinear Text Editor
 
Management of Metadata in Linguistic Fieldwork: Experience from the ACLA Pro...
Management of Metadata in Linguistic Fieldwork: Experience from the ACLA Pro...Management of Metadata in Linguistic Fieldwork: Experience from the ACLA Pro...
Management of Metadata in Linguistic Fieldwork: Experience from the ACLA Pro...
 
Disambiguating Advanced Computing for Humanities Researchers
Disambiguating Advanced Computing for Humanities ResearchersDisambiguating Advanced Computing for Humanities Researchers
Disambiguating Advanced Computing for Humanities Researchers
 
Metadata Quality Evaluation: Experience from the Open Language Archives Commu...
Metadata Quality Evaluation: Experience from the Open Language Archives Commu...Metadata Quality Evaluation: Experience from the Open Language Archives Commu...
Metadata Quality Evaluation: Experience from the Open Language Archives Commu...
 
Encoding and Presenting Interlinear Text Using XML Technologies
Encoding and Presenting Interlinear Text Using XML TechnologiesEncoding and Presenting Interlinear Text Using XML Technologies
Encoding and Presenting Interlinear Text Using XML Technologies
 
Refactoring Metadata:
Refactoring Metadata:Refactoring Metadata:
Refactoring Metadata:
 
Towards a Web Search Service for Minority Language Communities
Towards a Web Search Service for Minority Language CommunitiesTowards a Web Search Service for Minority Language Communities
Towards a Web Search Service for Minority Language Communities
 
Change Management and Versioning in Ontologies
Change Management and Versioning in OntologiesChange Management and Versioning in Ontologies
Change Management and Versioning in Ontologies
 
Object Reuse and Exchange (ORE) : Experience in the Open Language Archives Co...
Object Reuse and Exchange (ORE) : Experience in the Open Language Archives Co...Object Reuse and Exchange (ORE) : Experience in the Open Language Archives Co...
Object Reuse and Exchange (ORE) : Experience in the Open Language Archives Co...
 
The Effects of Cross-Pollination : How non-library mass market services are c...
The Effects of Cross-Pollination : How non-library mass market services are c...The Effects of Cross-Pollination : How non-library mass market services are c...
The Effects of Cross-Pollination : How non-library mass market services are c...
 
Why Digitization Increases the Value of Print Collections
Why Digitization Increases the Value of Print CollectionsWhy Digitization Increases the Value of Print Collections
Why Digitization Increases the Value of Print Collections
 

Último

Borderless Access - Global Panel book-unlock 2024
Borderless Access - Global Panel book-unlock 2024Borderless Access - Global Panel book-unlock 2024
Borderless Access - Global Panel book-unlock 2024Borderless Access
 
Project Brief & Information Architecture Report
Project Brief & Information Architecture ReportProject Brief & Information Architecture Report
Project Brief & Information Architecture Reportamberjiles31
 
Personal Brand Exploration Presentation Eric Bonilla
Personal Brand Exploration Presentation Eric BonillaPersonal Brand Exploration Presentation Eric Bonilla
Personal Brand Exploration Presentation Eric BonillaEricBonilla13
 
The End of Business as Usual: Rewire the Way You Work to Succeed in the Consu...
The End of Business as Usual: Rewire the Way You Work to Succeed in the Consu...The End of Business as Usual: Rewire the Way You Work to Succeed in the Consu...
The End of Business as Usual: Rewire the Way You Work to Succeed in the Consu...Brian Solis
 
Borderless Access - Global B2B Panel book-unlock 2024
Borderless Access - Global B2B Panel book-unlock 2024Borderless Access - Global B2B Panel book-unlock 2024
Borderless Access - Global B2B Panel book-unlock 2024Borderless Access
 
MoneyBridge Pitch Deck - Investor Presentation
MoneyBridge Pitch Deck - Investor PresentationMoneyBridge Pitch Deck - Investor Presentation
MoneyBridge Pitch Deck - Investor Presentationbaron83
 
Building Your Personal Brand on LinkedIn - Expert Planet- 2024
 Building Your Personal Brand on LinkedIn - Expert Planet-  2024 Building Your Personal Brand on LinkedIn - Expert Planet-  2024
Building Your Personal Brand on LinkedIn - Expert Planet- 2024Stephan Koning
 
MC Heights construction company in Jhang
MC Heights construction company in JhangMC Heights construction company in Jhang
MC Heights construction company in Jhangmcgroupjeya
 
The Vietnam Believer Newsletter_MARCH 25, 2024_EN_Vol. 003
The Vietnam Believer Newsletter_MARCH 25, 2024_EN_Vol. 003The Vietnam Believer Newsletter_MARCH 25, 2024_EN_Vol. 003
The Vietnam Believer Newsletter_MARCH 25, 2024_EN_Vol. 003believeminhh
 
Developing Coaching Skills: Mine, Yours, Ours
Developing Coaching Skills: Mine, Yours, OursDeveloping Coaching Skills: Mine, Yours, Ours
Developing Coaching Skills: Mine, Yours, OursKaiNexus
 
Talent Management research intelligence_13 paradigm shifts_20 March 2024.pdf
Talent Management research intelligence_13 paradigm shifts_20 March 2024.pdfTalent Management research intelligence_13 paradigm shifts_20 March 2024.pdf
Talent Management research intelligence_13 paradigm shifts_20 March 2024.pdfCharles Cotter, PhD
 
BCE24 | Virtual Brand Ambassadors: Making Brands Personal - John Meulemans
BCE24 | Virtual Brand Ambassadors: Making Brands Personal - John MeulemansBCE24 | Virtual Brand Ambassadors: Making Brands Personal - John Meulemans
BCE24 | Virtual Brand Ambassadors: Making Brands Personal - John MeulemansBBPMedia1
 
Graham and Doddsville - Issue 1 - Winter 2006 (1).pdf
Graham and Doddsville - Issue 1 - Winter 2006 (1).pdfGraham and Doddsville - Issue 1 - Winter 2006 (1).pdf
Graham and Doddsville - Issue 1 - Winter 2006 (1).pdfAnhNguyen97152
 
HELENE HECKROTTE'S PROFESSIONAL PORTFOLIO.pptx
HELENE HECKROTTE'S PROFESSIONAL PORTFOLIO.pptxHELENE HECKROTTE'S PROFESSIONAL PORTFOLIO.pptx
HELENE HECKROTTE'S PROFESSIONAL PORTFOLIO.pptxHelene Heckrotte
 
Q2 2024 APCO Geopolitical Radar - The Global Operating Environment for Business
Q2 2024 APCO Geopolitical Radar - The Global Operating Environment for BusinessQ2 2024 APCO Geopolitical Radar - The Global Operating Environment for Business
Q2 2024 APCO Geopolitical Radar - The Global Operating Environment for BusinessAPCO
 
Scrum Events & How to run them effectively
Scrum Events & How to run them effectivelyScrum Events & How to run them effectively
Scrum Events & How to run them effectivelyMarianna Nakou
 
NewBase 25 March 2024 Energy News issue - 1710 by Khaled Al Awadi_compress...
NewBase  25 March  2024  Energy News issue - 1710 by Khaled Al Awadi_compress...NewBase  25 March  2024  Energy News issue - 1710 by Khaled Al Awadi_compress...
NewBase 25 March 2024 Energy News issue - 1710 by Khaled Al Awadi_compress...Khaled Al Awadi
 
Plano de marketing- inglês em formato ppt
Plano de marketing- inglês  em formato pptPlano de marketing- inglês  em formato ppt
Plano de marketing- inglês em formato pptElizangelaSoaresdaCo
 
Borderless Access - Global B2B Panel book-unlock 2024
Borderless Access - Global B2B Panel book-unlock 2024Borderless Access - Global B2B Panel book-unlock 2024
Borderless Access - Global B2B Panel book-unlock 2024Borderless Access
 

Último (20)

Borderless Access - Global Panel book-unlock 2024
Borderless Access - Global Panel book-unlock 2024Borderless Access - Global Panel book-unlock 2024
Borderless Access - Global Panel book-unlock 2024
 
Project Brief & Information Architecture Report
Project Brief & Information Architecture ReportProject Brief & Information Architecture Report
Project Brief & Information Architecture Report
 
Personal Brand Exploration Presentation Eric Bonilla
Personal Brand Exploration Presentation Eric BonillaPersonal Brand Exploration Presentation Eric Bonilla
Personal Brand Exploration Presentation Eric Bonilla
 
The End of Business as Usual: Rewire the Way You Work to Succeed in the Consu...
The End of Business as Usual: Rewire the Way You Work to Succeed in the Consu...The End of Business as Usual: Rewire the Way You Work to Succeed in the Consu...
The End of Business as Usual: Rewire the Way You Work to Succeed in the Consu...
 
Borderless Access - Global B2B Panel book-unlock 2024
Borderless Access - Global B2B Panel book-unlock 2024Borderless Access - Global B2B Panel book-unlock 2024
Borderless Access - Global B2B Panel book-unlock 2024
 
WAM Corporate Presentation Mar 25 2024.pdf
WAM Corporate Presentation Mar 25 2024.pdfWAM Corporate Presentation Mar 25 2024.pdf
WAM Corporate Presentation Mar 25 2024.pdf
 
MoneyBridge Pitch Deck - Investor Presentation
MoneyBridge Pitch Deck - Investor PresentationMoneyBridge Pitch Deck - Investor Presentation
MoneyBridge Pitch Deck - Investor Presentation
 
Building Your Personal Brand on LinkedIn - Expert Planet- 2024
 Building Your Personal Brand on LinkedIn - Expert Planet-  2024 Building Your Personal Brand on LinkedIn - Expert Planet-  2024
Building Your Personal Brand on LinkedIn - Expert Planet- 2024
 
MC Heights construction company in Jhang
MC Heights construction company in JhangMC Heights construction company in Jhang
MC Heights construction company in Jhang
 
The Vietnam Believer Newsletter_MARCH 25, 2024_EN_Vol. 003
The Vietnam Believer Newsletter_MARCH 25, 2024_EN_Vol. 003The Vietnam Believer Newsletter_MARCH 25, 2024_EN_Vol. 003
The Vietnam Believer Newsletter_MARCH 25, 2024_EN_Vol. 003
 
Developing Coaching Skills: Mine, Yours, Ours
Developing Coaching Skills: Mine, Yours, OursDeveloping Coaching Skills: Mine, Yours, Ours
Developing Coaching Skills: Mine, Yours, Ours
 
Talent Management research intelligence_13 paradigm shifts_20 March 2024.pdf
Talent Management research intelligence_13 paradigm shifts_20 March 2024.pdfTalent Management research intelligence_13 paradigm shifts_20 March 2024.pdf
Talent Management research intelligence_13 paradigm shifts_20 March 2024.pdf
 
BCE24 | Virtual Brand Ambassadors: Making Brands Personal - John Meulemans
BCE24 | Virtual Brand Ambassadors: Making Brands Personal - John MeulemansBCE24 | Virtual Brand Ambassadors: Making Brands Personal - John Meulemans
BCE24 | Virtual Brand Ambassadors: Making Brands Personal - John Meulemans
 
Graham and Doddsville - Issue 1 - Winter 2006 (1).pdf
Graham and Doddsville - Issue 1 - Winter 2006 (1).pdfGraham and Doddsville - Issue 1 - Winter 2006 (1).pdf
Graham and Doddsville - Issue 1 - Winter 2006 (1).pdf
 
HELENE HECKROTTE'S PROFESSIONAL PORTFOLIO.pptx
HELENE HECKROTTE'S PROFESSIONAL PORTFOLIO.pptxHELENE HECKROTTE'S PROFESSIONAL PORTFOLIO.pptx
HELENE HECKROTTE'S PROFESSIONAL PORTFOLIO.pptx
 
Q2 2024 APCO Geopolitical Radar - The Global Operating Environment for Business
Q2 2024 APCO Geopolitical Radar - The Global Operating Environment for BusinessQ2 2024 APCO Geopolitical Radar - The Global Operating Environment for Business
Q2 2024 APCO Geopolitical Radar - The Global Operating Environment for Business
 
Scrum Events & How to run them effectively
Scrum Events & How to run them effectivelyScrum Events & How to run them effectively
Scrum Events & How to run them effectively
 
NewBase 25 March 2024 Energy News issue - 1710 by Khaled Al Awadi_compress...
NewBase  25 March  2024  Energy News issue - 1710 by Khaled Al Awadi_compress...NewBase  25 March  2024  Energy News issue - 1710 by Khaled Al Awadi_compress...
NewBase 25 March 2024 Energy News issue - 1710 by Khaled Al Awadi_compress...
 
Plano de marketing- inglês em formato ppt
Plano de marketing- inglês  em formato pptPlano de marketing- inglês  em formato ppt
Plano de marketing- inglês em formato ppt
 
Borderless Access - Global B2B Panel book-unlock 2024
Borderless Access - Global B2B Panel book-unlock 2024Borderless Access - Global B2B Panel book-unlock 2024
Borderless Access - Global B2B Panel book-unlock 2024
 

Building Computational Grids with Apple’s Xgrid Middleware

  • 1. Building Computational Grids with Apple’s Xgrid Middleware Baden Hughes Department of Computer Science and Software Engineering The University of Melbourne badenh@csse.unimelb.edu.au 17 January 2006 Hughes @ AusGrid 2006 1
  • 2. Talk Overview Introduction Xgrid History Solution Architecture Apple Native vs 3rd Party Components Production Experience Conclusions 17 January 2006 Hughes @ AusGrid 2006 2
  • 3. Introduction In June 2005 Apple released Xgrid 1.0, a framework for loosely coupled distributed computation, specifically targets embarrasingly parallel computation Xgrid has been positioned as being highly accessible advanced computing solution for less technically oriented user communities, particularly small to medium research groups without easy access to traditional HPC environments While technically simple, from a functional perspective Xgrid blurs the distinction between HPC user and maintainer, which could engender new grass-roots research through a self-sustaining model for HPC 17 January 2006 Hughes @ AusGrid 2006 3
  • 4. Xgrid History 1/2004 Xgrid Technical Preview 1 Proof of concept only Limited developer release 11/2004 Xgrid Technical Preview 2 Robust CLI, immature GUI Wide developer release Reasonable adoption, 3rd party tools emerge 4/2005 Xgrid 1.0 Robust CLI, GUI, API Production oriented, vendor supported release Mac OS X Server centric (somewhat controversially) 17 January 2006 Hughes @ AusGrid 2006 4
  • 5. Xgrid Architecture Client, Controller, Agent Client User interface; controller authentication; job submission/retrieval Controller Job submission; management (aka cluster head node + some brokering) Agent Compute node (dedicated or cycle stealing; local or remote) 17 January 2006 Hughes @ AusGrid 2006 5
  • 6. Configuration and Systems Management Integrated local client configuration via System Preferences Remote client configuration via ssh, Apple RD; Netboot etc Controller based Server Admin tools allow ‘whole of grid’ configuration (authentication methods, agent type etc) Integrated user management and authentication (Kerberos, SSO, LDAP, Active Directory) Controller discovery either specified (FQDN) or dynamic (ZeroConf, Rendezvous, Bonjour) 17 January 2006 Hughes @ AusGrid 2006 6
  • 7. Job Specification and Management Job = 1 or more tasks Jobs described in Apple’s extensible plist format (either native plist or XML) Submission to controller via client either in serial or batch mode Controller periodically probes all registered agents to determine availability (NB currently proprietary scheduling heuristic) Asynchronous client-controller interaction model: clients can disconnect and later reconnect to retrieve completed jobs 17 January 2006 Hughes @ AusGrid 2006 7
  • 8. Scalability Published (cluster mode) benchmarks: 128 Agents 20,000 queued jobs 100,000 tasks per job 2Gb data per job 1Gb results per task 10Gb aggregate results per job Production sites with >200 agents in distributed mode Integration with existing OS X management tools such as ARD does allow for considerable scalability 17 January 2006 Hughes @ AusGrid 2006 8
  • 9. Apple Native Components Overview 17 January 2006 Hughes @ AusGrid 2006 9
  • 10. Apple Native Components Detail GUI: Xgrid.app, simple user interface CLI Xgrid, batch oriented, supports multitask submission Cocoa Framework XgridFoundation, ObjC core, with PyObj access, full featured Xgrid Controller client authentication, node management, job scheduling Tiger Agent Xgrid agent for Mac OS X 10.4 nodes Panther Agent Xgrid agent for Mac OS X 10.3 nodes Network Communications Based around BEEP (IETF RFC 3080) 17 January 2006 Hughes @ AusGrid 2006 10
  • 11. 3rd Party Components Overview 17 January 2006 Hughes @ AusGrid 2006 11
  • 12. 3rd Party Components Detail GridStuffer OS X GUI (Cocoa) application for multi-task job submission, monitoring, retrieval PyXG Python/PyObjC-based API for Xgrid client GridBus Data Broker: data-centric brokering service with (experimental) support for Xgrid client XgridLite: functionally reduced Xgrid controller for OS X workstation platforms Xgrid Linux Agent: Linux native Xgrid agent XgridAgent-Java: Platform-independent Java-based Xgrid agent 17 January 2006 Hughes @ AusGrid 2006 12
  • 13. Production Experience Locations Universities: Stanford, Reed, Utah, Simon Fraser, Toronto, Melbourne Numerous industrial sites Application Domains Natural language processing Modelling biochemical receptors Nonlinear computation in epidemiology Rendering animations Low autocorrelation binary sequence search Biophytonic tissue analysis 17 January 2006 Hughes @ AusGrid 2006 13
  • 14. Conclusion Significant advantage for Xgrid is ease of administration and use; contrasts with many other cluster/grid computing middleware Some disadvantages in area integration (particularly with other middleware suites) Active 3rd party development community and open relations with Apple’s Xgrid product group have made Xgrid more compelling Some shrink-wrapped applications have Xgrid support (eg GridMathematica) Other cluster/grid computing solutions for Mac OS X exist (eg MPI, Pooch) 17 January 2006 Hughes @ AusGrid 2006 14
  • 15. More Xgrid Info http://www.apple.com/acg/xgrid http://developer.apple.com/hardware/hpc http://www.macresearch.org 17 January 2006 Hughes @ AusGrid 2006 15
  • 16. Acknowledgements Research supported by Apple Computer Inc, through the Apple University Consortium and the Apple University Development Fund Thanks to Ernest Prabhakar (Xgrid Product Manager) and Richard Crandall (Advanced Computation Group) from Apple for comments on an earlier version of this paper 17 January 2006 Hughes @ AusGrid 2006 16