SlideShare una empresa de Scribd logo
1 de 27
Descargar para leer sin conexión
gLite Adminis-
    tration
  Workshop
     2010

S. Freitag, F.
  Feldhaus
                 gLite Administration Workshop
Overview
                    GridKa Summer School 2010
Grid
middleware

Plan for Today     Stefan Freitag, Florian Feldhaus
Services
                        Robotics Research Institute
                              TU Dortmund


                         September 8, 2010
Contents

gLite Adminis-
    tration
  Workshop
     2010

S. Freitag, F.
  Feldhaus        1 Overview
Overview

Grid
middleware        2 Grid middleware
Plan for Today

Services

                  3 Plan for Today


                  4 Brief introduction to gLite services
Overview

gLite Adminis-
    tration
  Workshop
     2010

S. Freitag, F.
  Feldhaus       Monday
Overview         Grid Computing and Cloud Computing, an Overview (T. Cass)
Grid
middleware

Plan for Today
                 Tuesday
Services         gLite Introduction Course (M. Sober)

                 Today
                 gLite Administration Course (S. Freitag, F. Feldhaus)
Time table

gLite Adminis-
    tration
  Workshop
     2010

S. Freitag, F.
  Feldhaus        11:00   Brief introduction
Overview
                  11:30   site BDII
Grid
                  12:30   Lunch (northern canteen)
middleware        13:45   Batch system
Plan for Today
                  14:45   CREAM Compute Element
Services
                  15:30   Coffee break
                  16:00   User Interface
                  17:00   Advanced exercises and site testing
                  18:30   End of the workshop
Why Grid middlewares?

gLite Adminis-
    tration
  Workshop
     2010
                 Resource sharing in early days of computing
S. Freitag, F.
  Feldhaus         1   only few scientists had access to compute and storage
Overview               resources
Grid
middleware
                   2   resources only available at a very limited number of sites
Plan for Today

Services




                 If you were not working at such a site → What a pity!
Why Grid middlewares?

gLite Adminis-
    tration      Maybe you have heard...
  Workshop
     2010
                 If the mountain won’t come to Mohammed, Mohammed must
S. Freitag, F.
  Feldhaus       go to the mountain.
Overview
                 Consequences
Grid
middleware

Plan for Today
                     Scientists moved to the places where the required
Services             resources were available.
                     Resource sharing allowed multiple scientists to access the
                     resources at the same time
Why Grid middlewares? - Intervention

gLite Adminis-
    tration
  Workshop
     2010
                 You could ask: ”Why did those scientists move? If I was a one
S. Freitag, F.
  Feldhaus       of those scientists I would have simply used something like
                 ssh?”
Overview

Grid             Brief historical overview
middleware

Plan for Today        rsh originated as part of the BSD Unix operating system
Services
                      in 1983
                      Version 1 of the ssh protocol was designed in 1995


                      Until protocols for remote shells were developed, there was
                      no other choice
Why Grid middlewares?

gLite Adminis-
    tration          Over time resources became affordable for research
  Workshop
     2010            facilities → more resources and more locations
S. Freitag, F.
  Feldhaus
                                                                      Site B
Overview

Grid                                 Site A
middleware

Plan for Today
                                                                      Site D
Services

                                          Site C




                 As some scientists had/ still have no access to local resources a
                 way for sharing resources in the research community was
                 required.
Why Grid middlewares?

gLite Adminis-
    tration
  Workshop
     2010

S. Freitag, F.
  Feldhaus
                 Fosters checklist:
Overview
                 A Grid
Grid
middleware

Plan for Today
                      coordinates resources that are not subject to centralized
Services              control
                      It integrates/ coordinates resources and users that exist
                      within different control domains.
Why Grid middlewares?

gLite Adminis-
    tration
  Workshop
     2010

S. Freitag, F.
  Feldhaus       Fosters checklist:
Overview         A Grid
Grid
middleware
                      uses standard, open, general-purpose protocols and
Plan for Today
                      interfaces
Services
                      delivers nontrivial qualities of service. → allows its
                      constituent resources to be used in a coordinated fashion
                      to deliver various qualities of service.
Grid middleware implementations

gLite Adminis-
    tration
  Workshop
     2010
                     gLite
S. Freitag, F.
  Feldhaus

Overview

Grid
middleware

Plan for Today
                     NAREGI (National Research Grid Initiative), Japan
Services
Grid middleware implementations

gLite Adminis-
    tration
  Workshop
     2010
                     ARC (Advanced Resource Connector)
S. Freitag, F.
  Feldhaus

Overview

Grid
middleware           Globus Toolkit
Plan for Today

Services




                     UNICORE (Uniform Interface to Compute Resources)
Grid middleware

gLite Adminis-
    tration
  Workshop
     2010

S. Freitag, F.
  Feldhaus
                 Most services implemented by Grid middlewares can be
                 assigned to one or more of the following categories:
Overview

Grid             Service categories
middleware

Plan for Today
                     Execution management,
Services
                     Data management,
                     Information services and
                     Security
Globus Toolkit 5

gLite Adminis-
    tration
  Workshop
     2010

S. Freitag, F.
  Feldhaus

Overview

Grid
middleware

Plan for Today

Services




                            Figure: Globus Toolkit 5 Architecture
gLite

gLite Adminis-
    tration
  Workshop
     2010

S. Freitag, F.   Execution Management
  Feldhaus

Overview             Workload Management System
Grid                 CREAM Compute Element
middleware

Plan for Today       Batch system
Services


                 Information services

                     siteBDII
                     TopLevelBDII
gLite

gLite Adminis-
    tration
  Workshop
     2010

S. Freitag, F.
                 Data management
  Feldhaus

Overview
                     LFC (File Catalog)
Grid                 dCache Storage Element
middleware

Plan for Today       CASTOR (CERN Advanced Storage manager)
Services             DPM (Disk Pool Manager)


                 Security

                     GSI (Grid Security Infrastructure)
gLite Interaction

gLite Adminis-
    tration
                 is more complex than you can imagine.
  Workshop
     2010

S. Freitag, F.
  Feldhaus

Overview

Grid
middleware

Plan for Today

Services




                             Figure: EGEEgLiteJobSubmissionSchema

                                  Thanks to Maarten Litmaath
Plan for today

gLite Adminis-
    tration
  Workshop
     2010
                 Focus: Installation & Configuration
S. Freitag, F.
  Feldhaus
                 of gLite services required for a site offering access to compute
                 resources
Overview
                      Execution Management
Grid
middleware                CREAM Compute Element
Plan for Today            Batchsytem (Torque server and one worker node)
Services             Information Services
                          siteBDII
                     Additional services
                          User Interface
                          VO Box
                          Accounting service (APEL node)
                          LFC (File catalog)
Worker Node

gLite Adminis-
    tration
  Workshop
     2010

S. Freitag, F.       eager beaver of the Grid site
  Feldhaus
                     all jobs submitted to the site are executed on worker nodes
Overview
                     the worker nodes are linked to a batch system server
Grid
middleware

Plan for Today   Installed software
Services
                     Batch system software (Torque mom)
                     CLI/ libraries for e.g. file catalog and storage element
                     operations
                     (MPI)
Batch System Server

gLite Adminis-
    tration
  Workshop
     2010

S. Freitag, F.       consists of different queues
  Feldhaus
                     may vary in wallclocktime, max. resource allocation,. . .
Overview
                     job management
Grid
middleware           assigning jobs to worker nodes, start/ stop jobs
Plan for Today
                     workernode management
Services

                 Installed software

                     Torque Batchsystem server
                     Maui Scheduler
Compute Element

gLite Adminis-
    tration
  Workshop
     2010            Contact point for WMS and end users to submit jobs to
S. Freitag, F.       the Grid site
  Feldhaus
                     Authorizes remote users for job submission
Overview

Grid
                     Acts on behalf of the users and submits jobs via the batch
middleware           system client.
Plan for Today

Services
                 Installed software

                     Tomcat (CREAM CE is using this)
                     Accounting service (APEL)
                     Information provider (GIP)
                     Batchsystem client
siteBDII

gLite Adminis-
    tration
  Workshop
     2010

S. Freitag, F.
                     Contact point for TopLevelBDIIs
  Feldhaus           yep, there is not only one!
Overview             Queries local gLite services for information
Grid
middleware           In both cases LDAP is used
Plan for Today

Services
                 Installed software

                     openLDAP

                 GridMap: http://gridmap.cern.ch
                 GStat 2.0:
                 http://gstat-prod.cern.ch/gstat/geo/openlayers
VO Box

gLite Adminis-
    tration
  Workshop
     2010

S. Freitag, F.       allows virtual organizations to run their own specific
  Feldhaus
                     services and directly access their local software area at a
Overview
                     Grid site.
Grid
middleware           (usually) software managers are able to connect to the
Plan for Today       VoBox via gsissh
Services

                 Installed software

                     gsissh client (Port 1975 is default)
                     gLite CLI/ libraries
APEL node

gLite Adminis-
    tration
  Workshop
     2010
                     Publishes accounting information to the Grid via
S. Freitag, F.       ActiveMQ
  Feldhaus
                     Information is taken from a local database
Overview
                     Compute Elements fill the database by
Grid
middleware                  parsing the batch system accounting logs
Plan for Today              MySQL inserts
Services

                 Installed software

                     MySQL
                     Java

                 APEL RSS: Link
                 Accounting Portal: http://www3.egee.cesga.es/
Plan for today

gLite Adminis-
    tration
  Workshop
     2010

S. Freitag, F.       Group to small teams of 4 - 6 people
  Feldhaus
                     Each team will act as a SysAdmin team of a grid site.
Overview
                     Open http://gkswiki.fzk.de/index.php5 in your
Grid
middleware           browser
Plan for Today
                     Select gLite administration workshop with hands-on
Services
                     Now it is your turn!

                 Support
                 If you experience problems while setting up the services, Florian
                 and I will join your team and assist.
Hints

gLite Adminis-
    tration
  Workshop
                 Hint 1
     2010
                 Make an initial sketch of your site setup containing an
S. Freitag, F.
  Feldhaus       assignment of grid services to hosts (and administrators)
Overview

Grid             Hint 2
middleware

Plan for Today
                 We suggest to install the basic services in the following order
Services             siteBDII
                     Batchsytem
                     Compute Element

                 To anyone interested
                 How to establish a storage resource at your grid site is shown
                 tomorrow in the dCache administrations workshop.
gLite Adminis-
    tration
  Workshop
     2010

S. Freitag, F.
  Feldhaus       Our experience
Overview
                     Do not expect that everything works ouf-of-the-box.
Grid
middleware

Plan for Today
                 For now
Services

                           Thanks for your attention!
                                 Questions !?
                 Access to your machines: ssh -p24 root@gks-X-XYZ.fzk.de

Más contenido relacionado

Destacado

Как попасть на Cеверный полюс?
Как попасть на Cеверный полюс?Как попасть на Cеверный полюс?
Как попасть на Cеверный полюс?RussiaDiscovery
 
Hands-on Training Merced-3.15.12
Hands-on Training Merced-3.15.12Hands-on Training Merced-3.15.12
Hands-on Training Merced-3.15.12Healthy City
 
07 hopelessness of_justification_by_law
07 hopelessness of_justification_by_law07 hopelessness of_justification_by_law
07 hopelessness of_justification_by_lawDon McClain
 
Ibm web sphere datapower b2b appliance xb60 revealed
Ibm web sphere datapower b2b appliance xb60 revealedIbm web sphere datapower b2b appliance xb60 revealed
Ibm web sphere datapower b2b appliance xb60 revealednetmotshop
 
Healthy City Community Planning and Development webinar
Healthy City Community Planning and Development webinarHealthy City Community Planning and Development webinar
Healthy City Community Planning and Development webinarHealthy City
 
Final Presentation
Final PresentationFinal Presentation
Final PresentationMegan Cisar
 
Salzburg Academy: Julian's presentation
Salzburg Academy: Julian's presentationSalzburg Academy: Julian's presentation
Salzburg Academy: Julian's presentationJulian McDougall
 
Ruth, A Portrait of Redemption
Ruth, A Portrait of RedemptionRuth, A Portrait of Redemption
Ruth, A Portrait of RedemptionDon McClain
 
Claves para la implementacion de tendencias y enfoques sandra silva
Claves para la implementacion de tendencias y enfoques  sandra silvaClaves para la implementacion de tendencias y enfoques  sandra silva
Claves para la implementacion de tendencias y enfoques sandra silvaSANDRA SILVA
 
How to Use HealthyCity.org to Influence Policy
How to Use HealthyCity.org to Influence PolicyHow to Use HealthyCity.org to Influence Policy
How to Use HealthyCity.org to Influence PolicyHealthy City
 
Labs And Walkthroughs
Labs And WalkthroughsLabs And Walkthroughs
Labs And WalkthroughsBryan Tuttle
 
超卡哇伊的動物
超卡哇伊的動物超卡哇伊的動物
超卡哇伊的動物k87414
 
Media workplace research methods
Media workplace research methods Media workplace research methods
Media workplace research methods Julian McDougall
 
06 Study Of The Law - Stealing & Bearing False Witness
06 Study Of The Law - Stealing & Bearing False Witness06 Study Of The Law - Stealing & Bearing False Witness
06 Study Of The Law - Stealing & Bearing False WitnessDon McClain
 
Cloud Computing im Kontext des D-Grid
Cloud Computing im Kontext des D-GridCloud Computing im Kontext des D-Grid
Cloud Computing im Kontext des D-GridStefan Freitag
 

Destacado (19)

Как попасть на Cеверный полюс?
Как попасть на Cеверный полюс?Как попасть на Cеверный полюс?
Как попасть на Cеверный полюс?
 
Hands-on Training Merced-3.15.12
Hands-on Training Merced-3.15.12Hands-on Training Merced-3.15.12
Hands-on Training Merced-3.15.12
 
07 hopelessness of_justification_by_law
07 hopelessness of_justification_by_law07 hopelessness of_justification_by_law
07 hopelessness of_justification_by_law
 
Ibm web sphere datapower b2b appliance xb60 revealed
Ibm web sphere datapower b2b appliance xb60 revealedIbm web sphere datapower b2b appliance xb60 revealed
Ibm web sphere datapower b2b appliance xb60 revealed
 
Healthy City Community Planning and Development webinar
Healthy City Community Planning and Development webinarHealthy City Community Planning and Development webinar
Healthy City Community Planning and Development webinar
 
Final Presentation
Final PresentationFinal Presentation
Final Presentation
 
Salzburg Academy: Julian's presentation
Salzburg Academy: Julian's presentationSalzburg Academy: Julian's presentation
Salzburg Academy: Julian's presentation
 
Ruth, A Portrait of Redemption
Ruth, A Portrait of RedemptionRuth, A Portrait of Redemption
Ruth, A Portrait of Redemption
 
Fdi Retail
Fdi RetailFdi Retail
Fdi Retail
 
Claves para la implementacion de tendencias y enfoques sandra silva
Claves para la implementacion de tendencias y enfoques  sandra silvaClaves para la implementacion de tendencias y enfoques  sandra silva
Claves para la implementacion de tendencias y enfoques sandra silva
 
How to Use HealthyCity.org to Influence Policy
How to Use HealthyCity.org to Influence PolicyHow to Use HealthyCity.org to Influence Policy
How to Use HealthyCity.org to Influence Policy
 
Hitoriaurrea
HitoriaurreaHitoriaurrea
Hitoriaurrea
 
Tugas pw [10]
Tugas pw [10]Tugas pw [10]
Tugas pw [10]
 
Labs And Walkthroughs
Labs And WalkthroughsLabs And Walkthroughs
Labs And Walkthroughs
 
Pre
PrePre
Pre
 
超卡哇伊的動物
超卡哇伊的動物超卡哇伊的動物
超卡哇伊的動物
 
Media workplace research methods
Media workplace research methods Media workplace research methods
Media workplace research methods
 
06 Study Of The Law - Stealing & Bearing False Witness
06 Study Of The Law - Stealing & Bearing False Witness06 Study Of The Law - Stealing & Bearing False Witness
06 Study Of The Law - Stealing & Bearing False Witness
 
Cloud Computing im Kontext des D-Grid
Cloud Computing im Kontext des D-GridCloud Computing im Kontext des D-Grid
Cloud Computing im Kontext des D-Grid
 

Similar a gLite Administration Workshop, Slides

A distributed video management cloud platform using hadoop
A distributed video management cloud platform using hadoopA distributed video management cloud platform using hadoop
A distributed video management cloud platform using hadoopredpel dot com
 
Config Management and Data Service Deep Dive
Config Management and Data Service Deep DiveConfig Management and Data Service Deep Dive
Config Management and Data Service Deep DiveCristina Vidu
 
ITU-T Study Group 13 Introduction
ITU-T Study Group 13 IntroductionITU-T Study Group 13 Introduction
ITU-T Study Group 13 IntroductionITU
 
CLoud computing, virtualization, scalability, media computing, course
CLoud computing, virtualization, scalability, media computing, courseCLoud computing, virtualization, scalability, media computing, course
CLoud computing, virtualization, scalability, media computing, coursePaolo Nesi
 
Pivotal: Operationalizing 1000 Node Hadoop Cluster - Analytics Workbench
Pivotal: Operationalizing 1000 Node Hadoop Cluster - Analytics WorkbenchPivotal: Operationalizing 1000 Node Hadoop Cluster - Analytics Workbench
Pivotal: Operationalizing 1000 Node Hadoop Cluster - Analytics WorkbenchEMC
 
Data Processing and Analysis
Data Processing and AnalysisData Processing and Analysis
Data Processing and AnalysisEUDAT
 
WTSA-16_SG13_Presentation.pptx
WTSA-16_SG13_Presentation.pptxWTSA-16_SG13_Presentation.pptx
WTSA-16_SG13_Presentation.pptxlionofsouth
 
Spatial data infrastructure in the cloud, 2011
Spatial data infrastructure in the cloud, 2011Spatial data infrastructure in the cloud, 2011
Spatial data infrastructure in the cloud, 2011Moullet
 
Configuration & Recommendation
Configuration & RecommendationConfiguration & Recommendation
Configuration & RecommendationAGILE IoT
 
Cloud computing - Terena 2011
Cloud computing - Terena 2011Cloud computing - Terena 2011
Cloud computing - Terena 2011Jisc
 
Orchestrate a Data Symphony
Orchestrate a Data SymphonyOrchestrate a Data Symphony
Orchestrate a Data SymphonyAlluxio, Inc.
 
IRJET- Comparatively Analysis on K-Means++ and Mini Batch K-Means Clustering ...
IRJET- Comparatively Analysis on K-Means++ and Mini Batch K-Means Clustering ...IRJET- Comparatively Analysis on K-Means++ and Mini Batch K-Means Clustering ...
IRJET- Comparatively Analysis on K-Means++ and Mini Batch K-Means Clustering ...IRJET Journal
 
Private&publish cloud present
Private&publish cloud presentPrivate&publish cloud present
Private&publish cloud presentnisitgolf
 
BOS - Hyperkonvergenz – Der einzige Weg zum Software definierten Rechenzentrum?
BOS - Hyperkonvergenz – Der einzige Weg zum Software definierten Rechenzentrum?BOS - Hyperkonvergenz – Der einzige Weg zum Software definierten Rechenzentrum?
BOS - Hyperkonvergenz – Der einzige Weg zum Software definierten Rechenzentrum?Fujitsu Central Europe
 
Simplified Data Preparation for Machine Learning in Hybrid and Multi Clouds
Simplified Data Preparation for Machine Learning in Hybrid and Multi CloudsSimplified Data Preparation for Machine Learning in Hybrid and Multi Clouds
Simplified Data Preparation for Machine Learning in Hybrid and Multi CloudsAlluxio, Inc.
 

Similar a gLite Administration Workshop, Slides (20)

A distributed video management cloud platform using hadoop
A distributed video management cloud platform using hadoopA distributed video management cloud platform using hadoop
A distributed video management cloud platform using hadoop
 
RMC_final
RMC_finalRMC_final
RMC_final
 
Config Management and Data Service Deep Dive
Config Management and Data Service Deep DiveConfig Management and Data Service Deep Dive
Config Management and Data Service Deep Dive
 
ITU-T Study Group 13 Introduction
ITU-T Study Group 13 IntroductionITU-T Study Group 13 Introduction
ITU-T Study Group 13 Introduction
 
CLoud computing, virtualization, scalability, media computing, course
CLoud computing, virtualization, scalability, media computing, courseCLoud computing, virtualization, scalability, media computing, course
CLoud computing, virtualization, scalability, media computing, course
 
Pivotal: Operationalizing 1000 Node Hadoop Cluster - Analytics Workbench
Pivotal: Operationalizing 1000 Node Hadoop Cluster - Analytics WorkbenchPivotal: Operationalizing 1000 Node Hadoop Cluster - Analytics Workbench
Pivotal: Operationalizing 1000 Node Hadoop Cluster - Analytics Workbench
 
Data Processing and Analysis
Data Processing and AnalysisData Processing and Analysis
Data Processing and Analysis
 
WTSA-16_SG13_Presentation.pptx
WTSA-16_SG13_Presentation.pptxWTSA-16_SG13_Presentation.pptx
WTSA-16_SG13_Presentation.pptx
 
Spatial data infrastructure in the cloud, 2011
Spatial data infrastructure in the cloud, 2011Spatial data infrastructure in the cloud, 2011
Spatial data infrastructure in the cloud, 2011
 
Configuration & Recommendation
Configuration & RecommendationConfiguration & Recommendation
Configuration & Recommendation
 
Cloud computing - Terena 2011
Cloud computing - Terena 2011Cloud computing - Terena 2011
Cloud computing - Terena 2011
 
Cloud by dev
Cloud by devCloud by dev
Cloud by dev
 
Orchestrate a Data Symphony
Orchestrate a Data SymphonyOrchestrate a Data Symphony
Orchestrate a Data Symphony
 
IRJET- Comparatively Analysis on K-Means++ and Mini Batch K-Means Clustering ...
IRJET- Comparatively Analysis on K-Means++ and Mini Batch K-Means Clustering ...IRJET- Comparatively Analysis on K-Means++ and Mini Batch K-Means Clustering ...
IRJET- Comparatively Analysis on K-Means++ and Mini Batch K-Means Clustering ...
 
NFV evolution towards 5G
NFV evolution towards 5GNFV evolution towards 5G
NFV evolution towards 5G
 
SDN-based Inter-Cloud Federation for OF@TEIN
SDN-based Inter-Cloud Federation for OF@TEINSDN-based Inter-Cloud Federation for OF@TEIN
SDN-based Inter-Cloud Federation for OF@TEIN
 
Private&publish cloud present
Private&publish cloud presentPrivate&publish cloud present
Private&publish cloud present
 
BOS - Hyperkonvergenz – Der einzige Weg zum Software definierten Rechenzentrum?
BOS - Hyperkonvergenz – Der einzige Weg zum Software definierten Rechenzentrum?BOS - Hyperkonvergenz – Der einzige Weg zum Software definierten Rechenzentrum?
BOS - Hyperkonvergenz – Der einzige Weg zum Software definierten Rechenzentrum?
 
Evolving Mobile Data Application Services With SDN
Evolving Mobile Data Application Services With SDNEvolving Mobile Data Application Services With SDN
Evolving Mobile Data Application Services With SDN
 
Simplified Data Preparation for Machine Learning in Hybrid and Multi Clouds
Simplified Data Preparation for Machine Learning in Hybrid and Multi CloudsSimplified Data Preparation for Machine Learning in Hybrid and Multi Clouds
Simplified Data Preparation for Machine Learning in Hybrid and Multi Clouds
 

Más de Stefan Freitag

Globus Toolkit Status @ bwGrid F2F
Globus Toolkit Status @ bwGrid F2FGlobus Toolkit Status @ bwGrid F2F
Globus Toolkit Status @ bwGrid F2FStefan Freitag
 
D-Grid IaaS Vorstellung
D-Grid IaaS VorstellungD-Grid IaaS Vorstellung
D-Grid IaaS VorstellungStefan Freitag
 
Vorstellung IGE bei bwGrid Face2Face Meeting
Vorstellung IGE bei bwGrid Face2Face MeetingVorstellung IGE bei bwGrid Face2Face Meeting
Vorstellung IGE bei bwGrid Face2Face MeetingStefan Freitag
 
Cloud Computing in D-Grid
Cloud Computing in D-GridCloud Computing in D-Grid
Cloud Computing in D-GridStefan Freitag
 
Talk at the Security Workshop, GridKA Summerschool 2010
Talk at the Security Workshop, GridKA Summerschool 2010Talk at the Security Workshop, GridKA Summerschool 2010
Talk at the Security Workshop, GridKA Summerschool 2010Stefan Freitag
 
Virtuelle Organisation dgOps - Status
Virtuelle Organisation dgOps - StatusVirtuelle Organisation dgOps - Status
Virtuelle Organisation dgOps - StatusStefan Freitag
 
Erweiterung einer D-Grid-Ressource um eine Compute-Cloud-Schnittstelle
Erweiterung einer D-Grid-Ressource um eine Compute-Cloud-Schnittstelle Erweiterung einer D-Grid-Ressource um eine Compute-Cloud-Schnittstelle
Erweiterung einer D-Grid-Ressource um eine Compute-Cloud-Schnittstelle Stefan Freitag
 
Zusammenfassung Open Issue Session "Cloud Computing im Kontext des D-Grid"
Zusammenfassung Open Issue Session "Cloud Computing im Kontext des D-Grid"Zusammenfassung Open Issue Session "Cloud Computing im Kontext des D-Grid"
Zusammenfassung Open Issue Session "Cloud Computing im Kontext des D-Grid"Stefan Freitag
 
Integration of Cloud and Grid Middleware at DGRZR
Integration of Cloud and Grid Middleware at DGRZRIntegration of Cloud and Grid Middleware at DGRZR
Integration of Cloud and Grid Middleware at DGRZRStefan Freitag
 

Más de Stefan Freitag (10)

Globus Toolkit Status @ bwGrid F2F
Globus Toolkit Status @ bwGrid F2FGlobus Toolkit Status @ bwGrid F2F
Globus Toolkit Status @ bwGrid F2F
 
D-Grid IaaS Vorstellung
D-Grid IaaS VorstellungD-Grid IaaS Vorstellung
D-Grid IaaS Vorstellung
 
Vorstellung IGE bei bwGrid Face2Face Meeting
Vorstellung IGE bei bwGrid Face2Face MeetingVorstellung IGE bei bwGrid Face2Face Meeting
Vorstellung IGE bei bwGrid Face2Face Meeting
 
D-Grid Infrastructure
D-Grid InfrastructureD-Grid Infrastructure
D-Grid Infrastructure
 
Cloud Computing in D-Grid
Cloud Computing in D-GridCloud Computing in D-Grid
Cloud Computing in D-Grid
 
Talk at the Security Workshop, GridKA Summerschool 2010
Talk at the Security Workshop, GridKA Summerschool 2010Talk at the Security Workshop, GridKA Summerschool 2010
Talk at the Security Workshop, GridKA Summerschool 2010
 
Virtuelle Organisation dgOps - Status
Virtuelle Organisation dgOps - StatusVirtuelle Organisation dgOps - Status
Virtuelle Organisation dgOps - Status
 
Erweiterung einer D-Grid-Ressource um eine Compute-Cloud-Schnittstelle
Erweiterung einer D-Grid-Ressource um eine Compute-Cloud-Schnittstelle Erweiterung einer D-Grid-Ressource um eine Compute-Cloud-Schnittstelle
Erweiterung einer D-Grid-Ressource um eine Compute-Cloud-Schnittstelle
 
Zusammenfassung Open Issue Session "Cloud Computing im Kontext des D-Grid"
Zusammenfassung Open Issue Session "Cloud Computing im Kontext des D-Grid"Zusammenfassung Open Issue Session "Cloud Computing im Kontext des D-Grid"
Zusammenfassung Open Issue Session "Cloud Computing im Kontext des D-Grid"
 
Integration of Cloud and Grid Middleware at DGRZR
Integration of Cloud and Grid Middleware at DGRZRIntegration of Cloud and Grid Middleware at DGRZR
Integration of Cloud and Grid Middleware at DGRZR
 

Último

EBUS5423 Data Analytics and Reporting Bl
EBUS5423 Data Analytics and Reporting BlEBUS5423 Data Analytics and Reporting Bl
EBUS5423 Data Analytics and Reporting BlDr. Bruce A. Johnson
 
How to Add Existing Field in One2Many Tree View in Odoo 17
How to Add Existing Field in One2Many Tree View in Odoo 17How to Add Existing Field in One2Many Tree View in Odoo 17
How to Add Existing Field in One2Many Tree View in Odoo 17Celine George
 
A gentle introduction to Artificial Intelligence
A gentle introduction to Artificial IntelligenceA gentle introduction to Artificial Intelligence
A gentle introduction to Artificial IntelligenceApostolos Syropoulos
 
P4C x ELT = P4ELT: Its Theoretical Background (Kanazawa, 2024 March).pdf
P4C x ELT = P4ELT: Its Theoretical Background (Kanazawa, 2024 March).pdfP4C x ELT = P4ELT: Its Theoretical Background (Kanazawa, 2024 March).pdf
P4C x ELT = P4ELT: Its Theoretical Background (Kanazawa, 2024 March).pdfYu Kanazawa / Osaka University
 
Riddhi Kevadiya. WILLIAM SHAKESPEARE....
Riddhi Kevadiya. WILLIAM SHAKESPEARE....Riddhi Kevadiya. WILLIAM SHAKESPEARE....
Riddhi Kevadiya. WILLIAM SHAKESPEARE....Riddhi Kevadiya
 
HED Office Sohayok Exam Question Solution 2023.pdf
HED Office Sohayok Exam Question Solution 2023.pdfHED Office Sohayok Exam Question Solution 2023.pdf
HED Office Sohayok Exam Question Solution 2023.pdfMohonDas
 
DUST OF SNOW_BY ROBERT FROST_EDITED BY_ TANMOY MISHRA
DUST OF SNOW_BY ROBERT FROST_EDITED BY_ TANMOY MISHRADUST OF SNOW_BY ROBERT FROST_EDITED BY_ TANMOY MISHRA
DUST OF SNOW_BY ROBERT FROST_EDITED BY_ TANMOY MISHRATanmoy Mishra
 
How to Show Error_Warning Messages in Odoo 17
How to Show Error_Warning Messages in Odoo 17How to Show Error_Warning Messages in Odoo 17
How to Show Error_Warning Messages in Odoo 17Celine George
 
Work Experience for psp3 portfolio sasha
Work Experience for psp3 portfolio sashaWork Experience for psp3 portfolio sasha
Work Experience for psp3 portfolio sashasashalaycock03
 
How to Add a New Field in Existing Kanban View in Odoo 17
How to Add a New Field in Existing Kanban View in Odoo 17How to Add a New Field in Existing Kanban View in Odoo 17
How to Add a New Field in Existing Kanban View in Odoo 17Celine George
 
Department of Health Compounder Question ‍Solution 2022.pdf
Department of Health Compounder Question ‍Solution 2022.pdfDepartment of Health Compounder Question ‍Solution 2022.pdf
Department of Health Compounder Question ‍Solution 2022.pdfMohonDas
 
Clinical Pharmacy Introduction to Clinical Pharmacy, Concept of clinical pptx
Clinical Pharmacy  Introduction to Clinical Pharmacy, Concept of clinical pptxClinical Pharmacy  Introduction to Clinical Pharmacy, Concept of clinical pptx
Clinical Pharmacy Introduction to Clinical Pharmacy, Concept of clinical pptxraviapr7
 
5 charts on South Africa as a source country for international student recrui...
5 charts on South Africa as a source country for international student recrui...5 charts on South Africa as a source country for international student recrui...
5 charts on South Africa as a source country for international student recrui...CaraSkikne1
 
How to Manage Cross-Selling in Odoo 17 Sales
How to Manage Cross-Selling in Odoo 17 SalesHow to Manage Cross-Selling in Odoo 17 Sales
How to Manage Cross-Selling in Odoo 17 SalesCeline George
 
Easter in the USA presentation by Chloe.
Easter in the USA presentation by Chloe.Easter in the USA presentation by Chloe.
Easter in the USA presentation by Chloe.EnglishCEIPdeSigeiro
 
Vani Magazine - Quarterly Magazine of Seshadripuram Educational Trust
Vani Magazine - Quarterly Magazine of Seshadripuram Educational TrustVani Magazine - Quarterly Magazine of Seshadripuram Educational Trust
Vani Magazine - Quarterly Magazine of Seshadripuram Educational TrustSavipriya Raghavendra
 
Diploma in Nursing Admission Test Question Solution 2023.pdf
Diploma in Nursing Admission Test Question Solution 2023.pdfDiploma in Nursing Admission Test Question Solution 2023.pdf
Diploma in Nursing Admission Test Question Solution 2023.pdfMohonDas
 

Último (20)

Finals of Kant get Marx 2.0 : a general politics quiz
Finals of Kant get Marx 2.0 : a general politics quizFinals of Kant get Marx 2.0 : a general politics quiz
Finals of Kant get Marx 2.0 : a general politics quiz
 
EBUS5423 Data Analytics and Reporting Bl
EBUS5423 Data Analytics and Reporting BlEBUS5423 Data Analytics and Reporting Bl
EBUS5423 Data Analytics and Reporting Bl
 
How to Add Existing Field in One2Many Tree View in Odoo 17
How to Add Existing Field in One2Many Tree View in Odoo 17How to Add Existing Field in One2Many Tree View in Odoo 17
How to Add Existing Field in One2Many Tree View in Odoo 17
 
A gentle introduction to Artificial Intelligence
A gentle introduction to Artificial IntelligenceA gentle introduction to Artificial Intelligence
A gentle introduction to Artificial Intelligence
 
P4C x ELT = P4ELT: Its Theoretical Background (Kanazawa, 2024 March).pdf
P4C x ELT = P4ELT: Its Theoretical Background (Kanazawa, 2024 March).pdfP4C x ELT = P4ELT: Its Theoretical Background (Kanazawa, 2024 March).pdf
P4C x ELT = P4ELT: Its Theoretical Background (Kanazawa, 2024 March).pdf
 
Riddhi Kevadiya. WILLIAM SHAKESPEARE....
Riddhi Kevadiya. WILLIAM SHAKESPEARE....Riddhi Kevadiya. WILLIAM SHAKESPEARE....
Riddhi Kevadiya. WILLIAM SHAKESPEARE....
 
HED Office Sohayok Exam Question Solution 2023.pdf
HED Office Sohayok Exam Question Solution 2023.pdfHED Office Sohayok Exam Question Solution 2023.pdf
HED Office Sohayok Exam Question Solution 2023.pdf
 
DUST OF SNOW_BY ROBERT FROST_EDITED BY_ TANMOY MISHRA
DUST OF SNOW_BY ROBERT FROST_EDITED BY_ TANMOY MISHRADUST OF SNOW_BY ROBERT FROST_EDITED BY_ TANMOY MISHRA
DUST OF SNOW_BY ROBERT FROST_EDITED BY_ TANMOY MISHRA
 
How to Show Error_Warning Messages in Odoo 17
How to Show Error_Warning Messages in Odoo 17How to Show Error_Warning Messages in Odoo 17
How to Show Error_Warning Messages in Odoo 17
 
Work Experience for psp3 portfolio sasha
Work Experience for psp3 portfolio sashaWork Experience for psp3 portfolio sasha
Work Experience for psp3 portfolio sasha
 
How to Add a New Field in Existing Kanban View in Odoo 17
How to Add a New Field in Existing Kanban View in Odoo 17How to Add a New Field in Existing Kanban View in Odoo 17
How to Add a New Field in Existing Kanban View in Odoo 17
 
March 2024 Directors Meeting, Division of Student Affairs and Academic Support
March 2024 Directors Meeting, Division of Student Affairs and Academic SupportMarch 2024 Directors Meeting, Division of Student Affairs and Academic Support
March 2024 Directors Meeting, Division of Student Affairs and Academic Support
 
Department of Health Compounder Question ‍Solution 2022.pdf
Department of Health Compounder Question ‍Solution 2022.pdfDepartment of Health Compounder Question ‍Solution 2022.pdf
Department of Health Compounder Question ‍Solution 2022.pdf
 
Clinical Pharmacy Introduction to Clinical Pharmacy, Concept of clinical pptx
Clinical Pharmacy  Introduction to Clinical Pharmacy, Concept of clinical pptxClinical Pharmacy  Introduction to Clinical Pharmacy, Concept of clinical pptx
Clinical Pharmacy Introduction to Clinical Pharmacy, Concept of clinical pptx
 
5 charts on South Africa as a source country for international student recrui...
5 charts on South Africa as a source country for international student recrui...5 charts on South Africa as a source country for international student recrui...
5 charts on South Africa as a source country for international student recrui...
 
How to Manage Cross-Selling in Odoo 17 Sales
How to Manage Cross-Selling in Odoo 17 SalesHow to Manage Cross-Selling in Odoo 17 Sales
How to Manage Cross-Selling in Odoo 17 Sales
 
Easter in the USA presentation by Chloe.
Easter in the USA presentation by Chloe.Easter in the USA presentation by Chloe.
Easter in the USA presentation by Chloe.
 
Vani Magazine - Quarterly Magazine of Seshadripuram Educational Trust
Vani Magazine - Quarterly Magazine of Seshadripuram Educational TrustVani Magazine - Quarterly Magazine of Seshadripuram Educational Trust
Vani Magazine - Quarterly Magazine of Seshadripuram Educational Trust
 
Prelims of Kant get Marx 2.0: a general politics quiz
Prelims of Kant get Marx 2.0: a general politics quizPrelims of Kant get Marx 2.0: a general politics quiz
Prelims of Kant get Marx 2.0: a general politics quiz
 
Diploma in Nursing Admission Test Question Solution 2023.pdf
Diploma in Nursing Admission Test Question Solution 2023.pdfDiploma in Nursing Admission Test Question Solution 2023.pdf
Diploma in Nursing Admission Test Question Solution 2023.pdf
 

gLite Administration Workshop, Slides

  • 1. gLite Adminis- tration Workshop 2010 S. Freitag, F. Feldhaus gLite Administration Workshop Overview GridKa Summer School 2010 Grid middleware Plan for Today Stefan Freitag, Florian Feldhaus Services Robotics Research Institute TU Dortmund September 8, 2010
  • 2. Contents gLite Adminis- tration Workshop 2010 S. Freitag, F. Feldhaus 1 Overview Overview Grid middleware 2 Grid middleware Plan for Today Services 3 Plan for Today 4 Brief introduction to gLite services
  • 3. Overview gLite Adminis- tration Workshop 2010 S. Freitag, F. Feldhaus Monday Overview Grid Computing and Cloud Computing, an Overview (T. Cass) Grid middleware Plan for Today Tuesday Services gLite Introduction Course (M. Sober) Today gLite Administration Course (S. Freitag, F. Feldhaus)
  • 4. Time table gLite Adminis- tration Workshop 2010 S. Freitag, F. Feldhaus 11:00 Brief introduction Overview 11:30 site BDII Grid 12:30 Lunch (northern canteen) middleware 13:45 Batch system Plan for Today 14:45 CREAM Compute Element Services 15:30 Coffee break 16:00 User Interface 17:00 Advanced exercises and site testing 18:30 End of the workshop
  • 5. Why Grid middlewares? gLite Adminis- tration Workshop 2010 Resource sharing in early days of computing S. Freitag, F. Feldhaus 1 only few scientists had access to compute and storage Overview resources Grid middleware 2 resources only available at a very limited number of sites Plan for Today Services If you were not working at such a site → What a pity!
  • 6. Why Grid middlewares? gLite Adminis- tration Maybe you have heard... Workshop 2010 If the mountain won’t come to Mohammed, Mohammed must S. Freitag, F. Feldhaus go to the mountain. Overview Consequences Grid middleware Plan for Today Scientists moved to the places where the required Services resources were available. Resource sharing allowed multiple scientists to access the resources at the same time
  • 7. Why Grid middlewares? - Intervention gLite Adminis- tration Workshop 2010 You could ask: ”Why did those scientists move? If I was a one S. Freitag, F. Feldhaus of those scientists I would have simply used something like ssh?” Overview Grid Brief historical overview middleware Plan for Today rsh originated as part of the BSD Unix operating system Services in 1983 Version 1 of the ssh protocol was designed in 1995 Until protocols for remote shells were developed, there was no other choice
  • 8. Why Grid middlewares? gLite Adminis- tration Over time resources became affordable for research Workshop 2010 facilities → more resources and more locations S. Freitag, F. Feldhaus Site B Overview Grid Site A middleware Plan for Today Site D Services Site C As some scientists had/ still have no access to local resources a way for sharing resources in the research community was required.
  • 9. Why Grid middlewares? gLite Adminis- tration Workshop 2010 S. Freitag, F. Feldhaus Fosters checklist: Overview A Grid Grid middleware Plan for Today coordinates resources that are not subject to centralized Services control It integrates/ coordinates resources and users that exist within different control domains.
  • 10. Why Grid middlewares? gLite Adminis- tration Workshop 2010 S. Freitag, F. Feldhaus Fosters checklist: Overview A Grid Grid middleware uses standard, open, general-purpose protocols and Plan for Today interfaces Services delivers nontrivial qualities of service. → allows its constituent resources to be used in a coordinated fashion to deliver various qualities of service.
  • 11. Grid middleware implementations gLite Adminis- tration Workshop 2010 gLite S. Freitag, F. Feldhaus Overview Grid middleware Plan for Today NAREGI (National Research Grid Initiative), Japan Services
  • 12. Grid middleware implementations gLite Adminis- tration Workshop 2010 ARC (Advanced Resource Connector) S. Freitag, F. Feldhaus Overview Grid middleware Globus Toolkit Plan for Today Services UNICORE (Uniform Interface to Compute Resources)
  • 13. Grid middleware gLite Adminis- tration Workshop 2010 S. Freitag, F. Feldhaus Most services implemented by Grid middlewares can be assigned to one or more of the following categories: Overview Grid Service categories middleware Plan for Today Execution management, Services Data management, Information services and Security
  • 14. Globus Toolkit 5 gLite Adminis- tration Workshop 2010 S. Freitag, F. Feldhaus Overview Grid middleware Plan for Today Services Figure: Globus Toolkit 5 Architecture
  • 15. gLite gLite Adminis- tration Workshop 2010 S. Freitag, F. Execution Management Feldhaus Overview Workload Management System Grid CREAM Compute Element middleware Plan for Today Batch system Services Information services siteBDII TopLevelBDII
  • 16. gLite gLite Adminis- tration Workshop 2010 S. Freitag, F. Data management Feldhaus Overview LFC (File Catalog) Grid dCache Storage Element middleware Plan for Today CASTOR (CERN Advanced Storage manager) Services DPM (Disk Pool Manager) Security GSI (Grid Security Infrastructure)
  • 17. gLite Interaction gLite Adminis- tration is more complex than you can imagine. Workshop 2010 S. Freitag, F. Feldhaus Overview Grid middleware Plan for Today Services Figure: EGEEgLiteJobSubmissionSchema Thanks to Maarten Litmaath
  • 18. Plan for today gLite Adminis- tration Workshop 2010 Focus: Installation & Configuration S. Freitag, F. Feldhaus of gLite services required for a site offering access to compute resources Overview Execution Management Grid middleware CREAM Compute Element Plan for Today Batchsytem (Torque server and one worker node) Services Information Services siteBDII Additional services User Interface VO Box Accounting service (APEL node) LFC (File catalog)
  • 19. Worker Node gLite Adminis- tration Workshop 2010 S. Freitag, F. eager beaver of the Grid site Feldhaus all jobs submitted to the site are executed on worker nodes Overview the worker nodes are linked to a batch system server Grid middleware Plan for Today Installed software Services Batch system software (Torque mom) CLI/ libraries for e.g. file catalog and storage element operations (MPI)
  • 20. Batch System Server gLite Adminis- tration Workshop 2010 S. Freitag, F. consists of different queues Feldhaus may vary in wallclocktime, max. resource allocation,. . . Overview job management Grid middleware assigning jobs to worker nodes, start/ stop jobs Plan for Today workernode management Services Installed software Torque Batchsystem server Maui Scheduler
  • 21. Compute Element gLite Adminis- tration Workshop 2010 Contact point for WMS and end users to submit jobs to S. Freitag, F. the Grid site Feldhaus Authorizes remote users for job submission Overview Grid Acts on behalf of the users and submits jobs via the batch middleware system client. Plan for Today Services Installed software Tomcat (CREAM CE is using this) Accounting service (APEL) Information provider (GIP) Batchsystem client
  • 22. siteBDII gLite Adminis- tration Workshop 2010 S. Freitag, F. Contact point for TopLevelBDIIs Feldhaus yep, there is not only one! Overview Queries local gLite services for information Grid middleware In both cases LDAP is used Plan for Today Services Installed software openLDAP GridMap: http://gridmap.cern.ch GStat 2.0: http://gstat-prod.cern.ch/gstat/geo/openlayers
  • 23. VO Box gLite Adminis- tration Workshop 2010 S. Freitag, F. allows virtual organizations to run their own specific Feldhaus services and directly access their local software area at a Overview Grid site. Grid middleware (usually) software managers are able to connect to the Plan for Today VoBox via gsissh Services Installed software gsissh client (Port 1975 is default) gLite CLI/ libraries
  • 24. APEL node gLite Adminis- tration Workshop 2010 Publishes accounting information to the Grid via S. Freitag, F. ActiveMQ Feldhaus Information is taken from a local database Overview Compute Elements fill the database by Grid middleware parsing the batch system accounting logs Plan for Today MySQL inserts Services Installed software MySQL Java APEL RSS: Link Accounting Portal: http://www3.egee.cesga.es/
  • 25. Plan for today gLite Adminis- tration Workshop 2010 S. Freitag, F. Group to small teams of 4 - 6 people Feldhaus Each team will act as a SysAdmin team of a grid site. Overview Open http://gkswiki.fzk.de/index.php5 in your Grid middleware browser Plan for Today Select gLite administration workshop with hands-on Services Now it is your turn! Support If you experience problems while setting up the services, Florian and I will join your team and assist.
  • 26. Hints gLite Adminis- tration Workshop Hint 1 2010 Make an initial sketch of your site setup containing an S. Freitag, F. Feldhaus assignment of grid services to hosts (and administrators) Overview Grid Hint 2 middleware Plan for Today We suggest to install the basic services in the following order Services siteBDII Batchsytem Compute Element To anyone interested How to establish a storage resource at your grid site is shown tomorrow in the dCache administrations workshop.
  • 27. gLite Adminis- tration Workshop 2010 S. Freitag, F. Feldhaus Our experience Overview Do not expect that everything works ouf-of-the-box. Grid middleware Plan for Today For now Services Thanks for your attention! Questions !? Access to your machines: ssh -p24 root@gks-X-XYZ.fzk.de