GlideinWMS The Glidein-based Workflow Management System

GlideinWMS

Installation Overview

Jump to:
  1. Installation Process
  2. Possible Configurations
  3. Using the OSG Factory
  4. Configuration-based Installer
  5. GlideinWMS ini file
  6. manage_glidens script
  7. Additional documents
Install documents:
  1. GlideinWMS Factory
  2. GlideinWMS Frontend
  3. User Pool Collector
  4. User Pool Schedd
Download Page

Read this first!

GlideinWMS RPMs are distributed via Open Science Grid (OSG) and documented in the following pages:

These RPMs install a default version of the system but with the option to manually edit settings for more complicated configurations. Check the Factory configuration and Frontend configuration for a more detailed reference about the configuration.

TAR Files distribution is no longer supported.

Possible Configurations

The following are recommended configurations for installing GlideinWMS. If you are installing a Factory, note that only configurations with the WMS Pool and Factory on the same node are supported. Also note that worker nodes must be able to access the web server on the Factory and Frontend nodes in order to download necessary files.

It should be noted that it is possible to install the GlideinWMS across administrative boundaries (i.e. you will only install part of the GlideinWMS infrastructure). See the OSG section below for an example.

Several possible configurations are:

Two Server configuration (recommended minimum):

Three Server configuration (recommended for 1000+ glideins)

One Server configuration (Use only for test installs)

OSG Factory configuration

Members of the Open Science Grid can use the OSG Factory at UCSD or GOC. In this case, they need to install only the following services:

See OSG Glidein Factory for more details on how to use this setup to talk to the OSG Factory. You will also need a proxy for the Frontend to communicate and (at least) one proxy for the glideins for submission.

OSG provides also an RPM to install the Glidein Frontend, the User Pool and scheduler. See the OSG GlideinWMS VO Frontend RPM installation guide for the RPM installation and configuration to use the OSG Factory. Note that the RPM installation by default installs all three these components.

GlideinWMS ini configuration file

The ini file determines the installation and configuration of the various services. All ini file attributes are required. However, in several cases the value may be left empty. See the service-specific documentation for the details for each attribute.

The configuration based installer requires that the same ini file be used for all service installations. There are several areas where data is required from other services. Since most services can be installed on separate hosts, the installer can only validate data for the node being installed.

Default Section

The attributes in this section apply to all subsequent sections in the ini file unless they are overridden specifically in that section. So, if the location/value of any option varies from host to host, you will need to override them in that section of the ini file.

Pacman options

The 2 pacman related attributes are in the Default section and were used to download and install the OSG/VDT client software and CA certificates with Pacman. This is obsolete, please:

If OSG Client and the CA certificates are not already installed on the node see the prerequisites section for instructions to install them.

Service options

The GlideinWMS system provides five different services, each one with a section in the ini file: WMSCollector, Factory, VOFrontend, UserCollector, Submit (host). All service attributes are described in their respective install pages. Each page, e.g. the VO Frontend installation page describes what is required for installing and validating that service.

Here you can find some example configuration files.

The manage-glideins script

This script is used to install and manage the GlideinWMS services. It is located in glideinWMS/install/manage-glideins and can be invoked in different ways. 

./manage-glideins --ACTION SERVICE --ini INIFILE [--ssh [user]]  [--debug]

This invocation can be used to install, start, stop or check the status of the glidein services based on the configuration in the specified ini file.

ACTION can be one of:

  • validate: Allows you to validate the ini file prior to installation
  • install: Install the service
  • configure: This allows you to reconfigure your service based on changes to the ini file without re-installing HTCondor.
    For services using HTCondor, it will update the config.d local config files,
    For the Factory and VO Frontend, it will update the respective xml config files.
  • start: Starts the service. Remote starting of services is possible if remote access (via ssh) is allowed.
  • stop: Stops the service. Remote stopping of services is possible if remote access (via ssh) is allowed.
  • status: Returns the status of the service. Remote starting of services is possible if remote access (via ssh) is allowed.

SERVICE can be one of:

  • wmscollector
  • usercollector
  • Factory
  • submit
  • vofrontend
  • rpm (Used for OSG Frontend RPM sites. Note: The 'install' action is not allowed for this service.)
  • all: can only be used with start/stop/status actions

--ssh: Allows the start/stop/status actions to be performed remotely providing the user has valid access to the other service's node via 'ssh -l' using the service's username. The '--ssh' option will use the ini file specified username attribute unless an optional 'user' is specified.

--debug: When used with start/stop/status actions, it will display the series of commands used. 


./manage-glideins --install-node --ini INIFILE
This invocation allows you to install all services configured for the node where you are running the script. There are some limitation to this. 


./manage-glideins --create-entries --ini INIFILE
This invocation can be used to select new glidein entry points after the initial installation of a Factory service. It will walk you through the same question and answer process querying ReSS and allowing for manual entries. It will then create a file containing the entry elements for the elements you selected. This can then be merged with the existing Factory configuration file and a reconfiguration performed to update those elements. 


./manage-glideins --create-group --ini INIFILE
This invocation can be used to select new group selection criteria after the initial installation of a Frontend service. It will walk you through the same question and answer process as during the installation. It will then create a file containing the group element for the criteria selected. This can then be merged with the existing Frontend configuration file and a reconfiguration performed. 


./manage-glideins --show-ini INIFILE
This invocation allows you to view the ini file options/values. It substitutes the variables and is especially useful when the DEFAULT section is used to apply values to all sections/services. 


./manage-glideins --create-template SERVICE
This invocation allows you to create an ini file template for installing a single service. It contains all the required attributes for that service. It should be understood that many of the cross-validations that would normally insure a working installation are bypassed since those validations are normally performed on the node for those services.

Additional Documents:
Banner image by Madhusudan Katti used under Creative Commons license.
Original Home URL: http://glideinwms.fnal.gov. GlideinWMS email support: glideinwms-support at fnal.gov