GlideinWMS The Glidein-based Workflow Management System

WMS Factory

Overview

Overview

The main task of the Glidein Factory (or WMS Factory) is to advertise itself, listen for requests from Frontend clients and submit glideins. Look at the picture below for a schematic view.

factory overview

A single glidein Factory can handle multiple kinds of glideins, also called glidein entry points (as they usually point to different Grid resources). For each entry point, it will advertise a different class-ad.
Similarly, each request from a Frontend client will affect a single entry point; a Frontend will need to advertise several requests in order to have glideins submitted to all the desirable resources.

The Glidein Factory philosophy

The main idea behind a Glidein Factory is to make the life of a Frontend as easy as possible. And to do that, the Factory needs to abstract as much as possible.

For starters, the Factory itself is the one that knows the details of various Grid sites and properly configures the glidein entry points, so they will run without any additional knowledge. A Frontend only needs to know that an entry point exists, and the parameters it takes.

Additionally, the Factory also does the submissions themselves. The Frontend just publishes that it needs some glideins and the Factory will start submitting them. The only handle the Frontend may want to use is the ability to regulate the rate of glideins that are sent to the Grid site. In the current implementation, this can be achieved by setting the desired number of idle glideins to be kept in the Grid queue.

The typical scenario features a Frontend with several (hundreds or even thousands of) user jobs in the queue that is looking for resources to run them. It will fetch the Factory classads, select the ones that satisfy its needs, and advertise class-ads with requests for those glideins. If the Frontend ever runs out of user jobs, it will advertise the fact that it does not need those glideins anymore. In practical terms, this means asking the Factory to keep exactly 0 idle glideins in the queue.

Factory Management At a Glance

Here are some common tasks you may need to do as a Factory admin (with links to more information):

  • Starting and Stopping the Factory: systemctl start gwms-factory; systemctl stop gwms-factory
  • Configuration can be found in either factory.xml or glideinWMS.xml in your Factory's instance directory (depending on your installation method).
  • After modifying the xml, be sure to reconfig your Factory: systemctl stop gwms-factory; gwms-factory reconfig; systemctl start gwms-factory
  • Monitoring the Factory

For more information, see the Factory OSG RPM guide.