GlideinWMS The Glidein-based Workflow Management System

Search Results

GlideinWMS

History

Stable Series

  • v2_7_1 released on May 14, 2013 (Manual,Installation instructions,Tarball)
    • glidecondor_addDN tool now supports adding DNs from a file
    • Added new tool glidecondor_createSecCol to dynamically create secondary collectors
    • Bug Fix: Fixed a bug where condor config templates used by glideinwms components had undefined values
    • Bug Fix: analyze_entries tool now correctly handles URI http://
    • Bug Fix: Fixed a bug where frontend would crash if the some of the internal files were trucated to zero length.
    • Bug Fix: Factory now correctly does the cleanup of log files
    • Bug Fix: Factory now correctly does accounting of glideins in default condor schedd
    • Bug Fix: proxy_info works correctly with the cat option
    • Bug Fix: Fixed an issue where glidecondor_addDN would fail if the certificate marker has trailing new line character
    • Bug Fix: glidecondor_upgrade now correctly works with the HTCondor 7.8.8 and 7.9.6 tarballs
  • v2_7 released on April 02, 2013 (Manual,Installation instructions,Tarball)
    • glideinwms code is now organized as python packages
    • Factory no longer creates long running process per entry. Instead, it runs only a single long running glideFactoryEntryGroup process instead of multiple glideFactoryEntry processes. Factory config supports two additional config attributes entry_parallel_workers and update_thread_count (see factory configuration docs for details)
    • Improved factory prerformance by migrating popen calls to use python's subprocess library
    • Improved the performance of the Frontend by using pre-clustering in the Frontend match-making
    • Created index.html for factory monitoring so that admins can disable directory browsing in httpd.conf
    • Added support for Partitionable condor slots in the glidein
    • Frontend policy for matching factory classads is now exposed in glideresource classads
    • Added a tool to dynamically create a secondary schedd config files and directories to the existing installation
    • Improved the usability of the frontendGrouGraphStatusNow monitoring
    • Factory now ships with two new operations tools: entry_ls and entry_rm
    • Improved documentation
    • Factory will now try to recover glideins with held code 79
    • Bug Fix: Fixed a bug where the factory entry processes and the frontend group (element) processes would inherit their parent's environment corrupting their own environment
    • Bug Fix: Fixed a bug where installers were not setting SHARED_PORT_MAX_WORKERS in respective condor_config correctly
    • Bug Fix: Fixed a bug where the frontend would match jobs with now proxy to sites that require glexec
    • Bug Fix: Glidein's job wrapper now behaves as true wrapper
    • Bug Fix: Fixed a bug where frontend_startup would not correctly pick default frontend.xml
    • Bug Fix: Fixed a bug in frontend where failure to evaluate match_expr for one group would prevent frontend from requesting glideins for other groups
    • Bug Fix: RPM now has shared port daemon enabled in the configuration
    • Bug Fix: Fixed a bug where Factory would sometime use wrong DN when calculating proxy hash
    • Bug Fix: Fixed a bug where factoryStatusNow.html would not link to the factoryEntryStatusNow.html correctly if the entry name is too long
    • Bug Fix: setup_x509.sh now correctly checks for existence of the grid-proxy-info and voms-proxy-info binaries on the worker node
    • Bug Fix: Frontend now counts the partitionable slots correctly
  • v2_6_2 released on November 02, 2012 (Manual,Installation instructions,Tarball)
    • Factory now supports glidein failure modes. This information is propagated back to the factory.
    • Glideins now have different idle timeouts for startup and tail. The glideins now exit much faster after comleting jobs and they do not have enough time left to run another job.
    • Added support for javascriptRRD 2.6.2
    • Consolidate the condor_tarball tag in glideinwms.xml to read in a list of os, arch, version. See docs for details.
    • Ini-installer will default collector_port to 9618 if not specified in appropriate config sections.
    • Installation now supports GRIDMANAGER_PROXY_REFRESH_TIME for condorg services
    • Improved logging when frontend fails to evaluate match expressions.
    • Monitoring pages changed to be even more compliant with DOM4
    • Improved the means for distributing condor config files for different condor services.
    • Improved documentation.
    • Bug Fix: Better handling of monitor dir during upgrade
    • Bug Fix: Factory correctlt handles frontend in downtime and now it does not affect requests from other frontends
    • Bug Fix: Putting entry in downtime multiple times now warns the user
    • Bug Fix: Fixed a bug where v2.6.1 frontend would crash under certain
    • Bug Fix: Installers do not set CONDOR_VERSION as constant by default. This will now enable frontends to override this attr.
    • Bug Fix: Ini-installer now correctly cleans up files on re-install
  • v2_6_1 released on August 21, 2012 (Manual,Installation instructions,Tarball)

    NOTE: Follow special instructions on downloads page if upgrading to condor 7.8.2

    • Factory now limits the speed at which it releases held glideins. After too many unrecoverable attempts, held glideins are removed.
    • Added support for Condor 7.8+
      KNOWN ISSUE: Only applies if you upgrade condor binaries in place without using the installer. Upgrading condor binaries for user pool and the wms collector with multiple schedds should not be done without corresponding changes to the condor configuration file. If the JOB_QUEUE_LOG is not correctly configured for each sched, condor queue will be corrupted for all the scheds
    • Glideins now support curl & data file transfer plugins in condor
    • New installations of factory and frontend services now communicate with condor daemons using TCP by default.
    • Bug Fix: Factory configuration now supports specifying limits for different security classes of same frontend
      KNOWN ISSUE: If limits are configured in the factory, this change breaks backward compatibility. As a workaround, admin needs to remove the limits and re-apply them after installation and initial configuration
    • Bug Fix: Factory monitoring pages now correctly work in Firefox 14+
    • Bug Fix: Frontend now monitors the glideins correctly when the corresponding factory classad is missing
    • Bug Fix: Fixed factory logging. Factory can now correctly extract info from a voms proxy
    • Bug Fix: Factory now correctly logs the Completed jobs info in rrd
  • v2_6 released on July 24, 2012 (Manual,Installation instructions,Tarball)
    • Add attr_dict in the environment of the frontend match_expr
    • Config defined attributes are now available in match_expr
    • Factory now supports deleting entries using --force_delete
    • Upgrading glideinwms with changes to the monitoring rrds is supported
    • Frontend advertises its monitoring url to the factory
    • Misbehaving glidein can be put on hold using WANT_HOLD
    • The start_expr is now a native part of match
    • Startd now advertises per-slot memory when configured by the factory. VO frontend can use GLIDEIN_MaxMemMBs_Estimate attr to make glidein estimate the available memory (based on memory/core or memory/cpu)
    • entry_q now reads GLIDEIN_FACTORY_DIR from env before checking cwd
    • Multiple user collectors are supported in HA mode
    • Factory can specify if glexec required vs provided by site
    • Providing config file locations for glideinwms.xml and frontend.xml is optional during reconfig
    • Entry downtime reason is now reported in the glidefactory classad
    • Improved support for RHEL 6 platform
    • Added support for new ARC Gatekeeper 1.x
    • Linux distro of the worker node is available in the glidein's classad
    • Condor classad fields are now considered case insensitive
    • Bug Fix: Glidein correctly handles semicolons in STARTER_JOB_ENVIRONMENT
    • Bug Fix: Java is correctly disable by default preventing increase in the image size during condor daemon benchmarking
    • Bug Fix: Frontend correctly correctly supports properties
    • Bug Fix: Glidein now correctly finds glexec on glite site
    • Bug Fix: Glideins update the user collector using TCP by default
    • Bug Fix: Ini-Installer now correctly works with condor tarball on RHEL6
    • Bug Fix: Reduced the logging in factory generated by inactive entries
    • Bug Fix: For frontend rpm, init.d scriptes now correctly sudo to the frontend user before reconfig
    • Bug Fix: Any errors due to changes in condor_q output are logged
    • Bug Fix: MaxJobRetirementTime and PREEMPT expressions now correctly work with WANT_HOLD
    • Bug Fix: Factory correctly deals with the situation when the frontend changes the proxy used
    • Bug Fix: It is possible to specify limits for different frontends for an entry in the factory config
    • Bug Fix: Glidein sets the LD_LIBRARY_PATH so condor uses local shared libraries before those in system path
    • KNOWN ISSUE: When the monitor work_dir is moved, reconfig/upgrade will fail. Recommended work-around is to delete the xml configuration in the work directory, change the work directory, then reconfig/upgrade.
    • KNOWN ISSUE: If the work directory has changed, frontend startup upgrade will not create the group directories and then the frontend will fail (silently). If you are changing directories (e.g. from a RPM upgrade), you should copy the group directories manually.
  • v2_5_7 released on April 5, 2012 (Manual,Installation instructions,Tarball)
    • Patch of the clean_glidein_queue to return 1 only when something was really done
    • Fix handling of held jobs when hitting the held limit
    • Fix log messages that printed out wrong held limits
    • Add locking when talking to the collector
  • v2_5_6 released on March 16, 2012 (Manual,Installation instructions,Tarball)
    • Factory supports per-frontend limits in the config
    • Bug Fix: Fixed a bug where frontend would not stop cleanly
    • Bug Fix: Factory doesnot depend on the X509_CERT_DIR in the environment
  • v2_5_5 released on February 10, 2012 (Manual,Installation instructions,Tarball)
    • Added filtering to analyze_entries
    • Reduced the number of debug log messages when entry becomes inactive.
    • Frontend match making uses autoclusters, greatly increasing the performance for busy frontends
    • Package the list of shared libraries required by Condor 7.7.3+ for glidein tarballs
    • Pilot proxy is not available in the user job environment any more reducing the chance for user job using it.
    • Ini Installer caan now create a tmeplate for single service installs
    • Bug Fix: Fixed several issues with the frontend rpm
    • Bug Fix: GLIDEIN_Glexec_Use=NEVER setting now correctly works with the setting require_voms_proxy=True
    • Bug Fix: Installer now correctly works with the RPM OSG client
    • Bug Fix: ReqMaxIdle was grossly overestimated before.
    • Bug Fix: Fixed bug in factory monitoring web pages where the link generation was off by one for monitoring groups
    • Bug Fix: Correctly respect the remove max_per_cycle=0 glideins in the factory
    • Bug Fix: glexec_setup.sh now uses correct proxy for its tests
    • Bug Fix: "warn" function is defined in generated add_config_line.source
  • v2_5_4 released on December 19, 2011 (Manual,Installation instructions,Tarball)
      NOTE: To upgrade to this version from anything earlier than v2.5.3, please see the instructions here.
    • Added support for VDT pre installed via rpm. While using ini-installer set vdt_location to empty and x509_cert_dir=/etc/grid-security/certificates
    • Consolidated some of the frontend rpm related patches
    • Added support for rsl in glideinWMS.xml to map to cream_attributes in the jdf
    • Bug Fix: Factory now correctly renews the proxies if the limits are hit
    • Bug Fix: frontend_startup does not show "upgrade" in help
    • Bug Fix: glideclient, glidefactoryclient and glideresource classads now correctly show UpdateSequenceNumber to help condor track potentially lost updates
    • Bug Fix: Fixed a bug where condor_shared_port daemon was not correctly stopped under certain conditions
  • v2_5_3 released on November 11, 2011 (Manual,Installation instructions,Tarball)
      NOTE: To upgrade to this version from anything earlier than v2.5.3, please see the instructions here.
    • Updated the license to reflect current Fermitools license Factory does a better job at respecting frontend limits Admins can add custom html to the monitoring pages
    • Monitoring now displays additional information about the Factory and Frontend names
    • Improved documentation
    • Enable Match Authentication configuration by default
    • Made quering of schedds efficient where ever possible.
    • Add autocomplete/search to table in frontendGroupGraphStatusNow.html
    • Added 'upgrade' option to factory startup script so that all the files in the glidein submit directory are updated. Did the same for the frontend startup script. 'reconfig' only updates the files populated with information from the configuration files (no scripts).
    • The OSG rpm worker node client requires changes to glidein startup scripts. If you plan on using OSG sites that have used this rpm, you must "upgrade" your factory in order to get glideins.
    • Bug Fix: If there is no GLOBUS_LOCATION available to glidein, it will not exit
    • Bug Fix: Fixed a bug where factory would not advertise the entry under certain conditions when it was put in downtime.
    • Bug Fix: Fixed a bug where glidein_reconfig would not properly validate schedd_name
    • Bug Fix: Fixed a bug where frontend reconfig was not populating GSI_DAEMON_PROXY correctly in frontend.condor_config
    • Bug Fix: Writeback of config files on reconfig is now enable by default
    • Bug Fix: Frontend does better error reporting when quering user pool or the schedd fails
    • Bug Fix: Fixed a bug in condor log parsing when we encounter event 400 (Job was evicted)
    • Bug Fix: Fixed a bug where factory would not correctly accept requests from frontends that were still using old keys
    • Bug Fix: Fixed a bug where glidein pilot proxy lifetime was not taken into account vs GLIDEIN_Max_Walltime
    • Bug Fix: Fixed a bug where expired/renewed proxy created error in completed_jobs accounting
    • Bug Fix: Fixed a bug where running_glideins_per_entry was not treating the limits correctly
    • Bug Fix: Fixed a bug in DAEMON_SHUTDOWN
    • Bug Fix: Fixed a bug where voms requirements were not treated correctly
    • Bug Fix: Added glidecondor_upgrade back to the install dir. This file was missing in v2_5_2_1 release
  • v2_5_2_1 released on October 07, 2011 (Manual,Installation instructions,Tarball)
    • Bug Fix: Fixed a bug creation of START expression when VOMS proxy is set be required.
    • Bug Fix: Revert the glidein shutdown behavior introduced in v2_5_2
    • Bug Fix: Add condor_glexec_update_proxy to Condor tarball if available
  • v2_5_2 released on July 20, 2011 (Manual,Installation instructions,Tarball)
    • Frontend publishes glideresource classad to the pool collector. This is useful for the users to do match making for their jobs.
    • Useful job info like JOB_Site, JOB_GLIDEIN_Entry_Name, JOB_GLIDEIN_Name JOB_GLIDEIN_Factory, JOB_GLIDEIN_Schedd, JOB_GLIDEIN_ClusterId, JOB_GLIDEIN_ProcId, JOB_GLIDEIN_Site is now added to SUBMIT_EXPRS
    • Default GLEXEC_JOB = True when GLEXEC_BIN is set to use glexec
    • Factory can now resue old public key after startup to decrypt frontend requests. Grace time for old public key is configurable.
    • The frontend now can set global limits on number of glideins.
    • The frontend now can use more than a single CPU.
    • glexec now tested during initial validation.
    • Bug Fix frontend: Do not double count glideins when using multiple groups.
    • Bug Fix frontend: Respect per-entry running limits.
    • Bug Fix factory: The factory was not properly checking the security classes and setting downtimes.
    • Bug Fix factory: Improper termination of glideins because of SIGHUP is handled correctly
    • Bug Fix factory: Daylight savings is now correctly accounted for.
    • Bug Fix factory: GLIDEIN_Max_Walltime is now used correctly.
    • Major improvements in the factory and frontend monitoring. Now requires javascriptRRD 0.6.0+.
    • Added tools for comparing the Factory configuration file with what is published in information systems.
    • Limit the max number of glideins per frontend
    • Use DAEMON_SHUTDOWN to shutdown glidein daemons
    • Allow factory to specify if an entry point (CE) requires voms proxies only for pilot and user jobs
    • Documentation Improvements:
      - Secondary WMS/User Collector documentation added to Advanced Condor Configuration
      - Documented the internal communication protocol through classads
  • v2_5_1 released on March 02, 2011 (Manual,Installation instructions,Tarball)
    • Factory now can remove excessive glideins. New ClassAd attribute - RemoveExcess
    • Frontend will request removal of glideins when no user jobs in queue
    • Improved idle counting by the frontend when jobs match many factory entries.
    • Improved frontend logging.
    • Add Java support in the glideins.
    • Changed factory monitoring. It is now based on security names and not plain frontend names
    • Improved installation process using ini based installer.
    • glideinWMS tarball does not include CVS directories and files any more
    • Added support of shared port configuration for condor daemons
    • SIGHUP signals to glideins are ignored correctly.
    • Improved documentation
    • Bug Fix: Fixed a bug introduced in v2_5 release where reconfiguring the factory would fail because of monitoring groups
    • Bug Fix: Fixed a typo in one of the links in frontendRRDBrowse.html
  • v2_5 released on January 24, 2011 (Manual,Installation instructions,Tarball)
    • Installer can now install gridFTP and VOMS certs needed by CREAM
    • glideinWMS release is now available in 3 different tarballs, frontend only, factory only and a complete tarball.
    • glideinWMS factory and the Corral frontend can now talk to each other
    • Factory is smarter about handling held glideins
    • Factory can now black/white list VOs on a per-entry basis
    • Version of glideinWMS is now published in the classads. Scheme can detect any changes to any service appropriate files and advertises version as patched.
    • Frontend should try to recover the crashed group before it gives up and shutsdown
    • Improvements to the monitoring
    • Improvements to documentaion
    • Add support for use of TCP in condor_advertise
    • Add support for condor_advertise -multiple (requires Condor v7.5.4+)
    • Improved factory stopping procedure
    • Add XML monitoring files of RRD files on both factory and frontend
    • Add JobsRunningHere attribute - CANNOT SIMPLY UPGRADE, NEEDS NEW INSTANCE FOR BOTH FACTORY AND FRONTEND
    • Graceful shutdown of the glidein by trapping signals in glidein_startup
    • Bug Fix: Fixed a bug where factory would create a malformed glideinWMS.xml config file when configured to use a default proxy for glideins from the factory.
    • Bug Fix: Factory entry sometimes stops reporting when it gets an exception for any reason
    • Bug Fix: Top-level schedd_status.xml malformed Total data
    • Bug Fix: Fixed a bug where the LogCounts.rrd was created with wrong data types.
    • KNOWN ISSUE: Automatic release of held glideins for CREAM CEs with issues could result in factory submitting more than required glideins to the CE. As a workaround, disable release of held glideins for CREAM CE.

  • Development Series

    This is work in progress, so some pieces may be broken and the documentation out of sync. But it is a good place to look for what is going on.
    • v3_0 released on April 05, 2012 (Manual,Installation instructions,Tarball)
      • Support for new API for factory - frontend communication
      • Added support to the Factory for EC2 Query API submissions to the Cloud
      • Change to max job limits to reflect more accurate names
      • Add attr_dict in the environemnt of the frontend match_expr
      • New feature: The start_expr is now a native part of match
      • Improved logging using standard Python logging APIs
      • The option to have either the factory and/or the frontend provide the pilot proxy has been removed. The frontend must always provide it.
      • Added support to the Factory for EC2 Query API submissions to the Cloud
      • Consolidated the condor_tarball tag in glideinwms.xml to read in a list of os, arch, version
      • Added unittests for downtime, proxy plugins, and support functions
      • Miscellaenous bug fixes
    • v2_3_2, released on April 06, 2010 (Manual,Installation instructions,Tarball)
      • Fixed a security bug in the way certificate/proxy DN(s) are handled. If you are upgrading the installation rather than full install, you should patch the condor_mapfile used by Condor daemons in your installation using the convert_condormap tool available from the glideinWMS download page. For additional security, users should add new DN to the condor_mapfile only by using the glidecondor_addDN tool available in the glideinWMS/install directory.
    • v2_3_1, released on March 11, 2010 (Manual,Installation instructions,Tarball)
      • Documentation Changes. There are no code changes since v2_3
    • v2_3, released on February 02, 2010 (Manual,Installation instructions,Tarball)
      Current development version.
      Improvements list:
      • Attempt to restart a crashed entry few times before shutting down the factory. Restarting is allowed for max restart_attempts in time interval restart_interval sec in te factory.
      • Add vacuum option to manageDowntimes.
      • Factory now properly handles new-style frontends without a group.
      • Frontend code has been refactored to allow use as a library.
      • More protections in place.
      • Fixed a security bug in key handling. BREAKES BACKWARDS COMPATIBILITY! But it is needed.
      • Fixed a bug in glidein_startup.sh that prevented the passing of * as a parameter value
      • Fixed a logical bug in the glidein config that resulted in job preemption.
      • Added support for condor_ssh (v7.4 and up)
      • Add support for unquoted string to be published in classads. The type is 'expr'
      • Documentation Changes
      • Minor bugs fixed.
      KNOWN ISSUES: If using condor 7.4.0-7.4.2 and 7.5.0, USE_VOMS_ATTRIBUTESshould be set to false for Collector and negotiator to avoid potential problems and memory leaks in GSI libraries.
      WARNING: This release has security bug fixes and is not compatible with older releases. You will need to update all the daemons at the same time.
    • v2_2, released on November 3rd, 2009 (Manual,Installation instructions,Tarball)
      Current development version.
      Improvements list:
      • Bug Fix: GLEXEC_JOB and GLEXEC_STARTER were not published in glideins classds. This was preventing psuedo interactive monitoring to work in case of GLEXEC.
      • Made VDT optional.
      • Addedd support for VDT 2.0, and made it the default.
      • Added Globus-Client and Myproxy-Client in the minimal VDT install.
      • Installer now allows the collector to run on non-standard port.
      • Factory now only checks X509_USER_PROXY if it needs it.
      • Added support for multiple versions of condor in a single factory.
      • Added ReqEncIdentity to the frontend->factory protocol to prevent replay attacks.
      WARNING: This effectively prevents old-style frontends to talk to new style factories.
      NOTE: Will only work with Condor 7.3.1 or newer
      KNOWN ISSUES: Pseudo interactive monitoring will not work with glexec.
    • v2_1, released on August 24th, 2009 (Manual,Installation instructions,Tarball)
      Improvements list:
      • Fixed a bug that was throwing an exception if a glidein failed.
      • Fixed handling of grid-mapfiles coming from client.
      • Fixed support for nordugrid.
      • Improvements to the monitoring.
      • Improvements to the installer.
      • Improved documentation.
    • v2_0, released on Mar 5th, 2009 (Manual,Installation instructions,Tarball)
      Improvements list:
      • create_frontend and create_glidein now share much code
      • Added create_frontend, recreate_frontend.
      • Frontend now has a stage web area and passes it to the factory
      • Factory publishes list of supported signtypes and frontend uses this for factory selection
      • User provided code in the glidein API changed. The 2nd arg is now one of main|entry|client|client_group
      • Added tools/glidein_status.py.
      • The monitoring page now has client-side monitoring based on javascriptRRD.
      • Support multiple proxies... frontend drives this via plugins.

    Old Releases

    • v2_4_3 released on September 30, 2010 (Manual,Installation instructions,Tarball)
      • Install VOMS Certificates during the install time
      • Entry does not print stacktrace when it fails to submit glidein. Instead it logs the error message appropriately.
      • Default scripts run on the worker node correctly print errors to stderr instead of stdout
      • Allow factory to startup from any directory
      • Python scripts get the python from /usr/bin/env python instead of /bin/env python making them more portable accross different linux distros
      • Better exception handling and error reporting
      • Fixed how voms_proxy_init is looked for after VDT install
      • Bug Fix: Fixed a bug where Summarize.listStored() in CondorMonitor.py returned the wrong value
      • Bug Fix: Fixed a bug in factory monitoring that prevented proper aggregation of sites
      • Bug Fix: Correctly interpret DN from a voms proxy generated from a service certificate.
      • Bug Fix: Generate frontend's condor_config without empty values for certain configuration options. Empty values is not the right way to reset the configuration options.
    • v2_4_2 released on August 03, 2010 (Manual,Installation instructions,Tarball)
      • Fixed the incompatibility introduced in v2_4_1 in monitoring components.
    • v2_4_1 released on July 27, 2010 (Manual,Installation instructions,Tarball)
      • Add a new configuration option for PREEMPT_GRACE_TIME
      • Move configuration of GLIDEIN_Job_Max_Time from the factory to the frontend
      • In factory config added checks to make sure Factory configuration is consistent w.r.t CONDOR_ARCH, CONDOR_VERSION, CONDOR_OS
      • Monitoring enhancement to make selection/deselection of groups/entries easier
      • Support GLIDEIN_Glexec_Use in frontend config attrs. Frontend can mandate or make the use of GLEXEC optional. Used in conjunction with GLEXEC_BIN in factory config. If GLEXEC_BIN in set to NONE for an entry in factory config, it is assumed that the entry doesn't have GLEXEC configured on site.
      • Improvements to documentation
      • Bug Fix: Allow the use of the same DN for both the security and the collector
      • Bug Fix: Returning invalid variable during proxy creation
      • KNOWN ISSUE: Running glideinWMS v2_4_1 with Condor 7.5.3 has not been tested. Altough, most of the things may work, security changes in Condor may affect your installation.
      • KNOWN ISSUE: Installer is not always able to get the correct DN from the certificates/proxies. It does not correctly strip the CN= bit of the DN in certain cases. If the DN guessed is not correct, make the required changes in the configurations and/or condor_mapfile.
    • v2_4 released on May 04, 2010 (Manual,Installation instructions,Tarball)
      • Add proxy security classes to the frontend
      • Add SecurityName to the frontend.
      • Add DNs for frontend proxy and all the daemons the frontend talks to; create own Condor config file and gldiein gridmap file out of them.
      • Frontend now dynalically creates GLIDEIN_Collector.
      • Frontend now requires Match authentication.
      • Add frontend autentication info to the factory config.
      • Add support for different frontend identities in different WMS collectors.
      • Put log files in a separate tree.
      • Put client logs and client proxies in separate trees.
      • Implement privilege separation in the factory.
      • Various minor refactoring of code to achieve the above.
      • Aggregate gatekeeper/sites for factory monitoring.
      • Introduced monitoringgroups to group sites together for monitoring purposes in factory.
      • KNOWN ISSUES: Installer is not always able to get the correct DN from the certificates/proxies. It does not correctly strip the CN= bit of the DN in certain cases. If the DN guessed is not correct, make the required changes in the configurations and/or condor_mapfile.
    • v1_6_3, released on April 06, 2010 (Manual,Installation instructions,Tarball)
      • Fixed a security bug in the way certificate/proxy DN(s) are handled. If you are upgrading the installation rather than full install, you should patch the condor_mapfile used by Condor daemons in your installation using the convert_condormap tool available from the glideinWMS download page. For additional security, users should add new DN to the condor_mapfile only by using the glidecondor_addDN tool available in the glideinWMS/install directory.
    • v1_6_2, released on Sep 14, 2009 (Manual,Installation instructions,Tarball)
      Current production version.
      Minor bug fixes.

      Systems that installed v1.6.1 need to upgrade to this release. They only need to replace the glideinWMS files.
      Improvements list:

      • Fixed a bug in frontend that would lead frontend to crash in certain conditions while logging the information
    • v1_6_1, released on Sep 08th, 2009 (Manual,Installation instructions,Tarball)
      Current production version.
      Minor bug fixes.

      Most systems don't need to upgrade.
      Improvements list:

      • Better randomization of GCBs and collectors
      • Collector list now supports ranges of ports
      • Fixed Condor-G log parsing
      • Better treatment of multiple-collectors in the installer
      • Add support for CCB and USE_MATCH_AUTH in the installer.
      • Add OSG:vo-client to the minimal VDT install
      • Better handling of Nordugrid sites.
      • Start factory in nice mode to give priority to Condor daemons
      • In condor_config for glideins remove explicit STARTER_UPDATE_INTERVAL
      • Removing GLIDEIN_Use_TCP, now uses UPDATE_COLLECTOR_WITH_TCP instead
      • Force integrity on reads from WMS collector
      • Better layout of monitoring pages
      • Better error handling in Factory downtime management
      • Better formatting of error logs for factory and frontend
      • Bug Fix: GLEXEC_JOB and GLEXEC_STARTER were not published in glideins classds. This was preventing psuedo interactive monitoring to work in case of GLEXEC
      • Improved documentation
    • v1_6, released on Mar 5th, 2009 (Manual,Installation instructions,Tarball)
      Current production version.
      Improved scalability, improved documentation and minor bug fixes.
      Added dependency on m2crypto.

      Most systems don't need to upgrade.
      Improvements list:

      • The XML file now supports comments.
      • Installer uses both .profile and .bashrc.
      • Frontend now requires integrity checks when talking to the WMS collector.
      • Refactored install options so that most tasks performed as a non-privileged user.
      • Using m2crypto for sha1 checks.
      • Fixed startup bugs in various debug tools.
      • Improved monitoring scalability (fewer RRD files)
      • Add support for CCB.
    • v1_5_2, released on Nov 6th, 2008 (Manual,Installation instructions,Tarball)
      The major new feature is a fix for VDT installation.
      Most systems don't need to upgrade.
      Improvements list:
      • Fixed VDT installation.
      • Factory now changes public key at each restart.
      • Minor monitoring improvements.
    • v1_5_1, released on Oct 28th, 2008 (Manual,Installation instructions,Tarball)
      This is essentially a bug fix release for v1_5.
      It is safe to upgrade.
      Improvements list:
      • Added flag that allows/requires proxies from frontend.
      • Fixed bug in factory installation with encryption.
      • The glidein now finds out about OSG squid.
      • Fixed bug in the node blacklisting code.
    • v1_5, released on Oct 24th, 2008 (Manual,Installation instructions,Tarball)
      Current version.
      Contains several scalability features over v1_4_X.
      Contains a new secure message passing infrastructure.
      Improvements list:
      • Added support for secure info passing between VO frontend and gfactory
        Requires M2Crypto Python module
      • VO frontend can now give the gfactory its own proxy to be used for pilot submission
        Requires the encryption mentioned above
      • gcb_setup is now loaded by default
        Can use GCB_ORDER=NONE to disable it
        Warning: Explicit listing of gcb_setup may create problems.
      • glexec_setup is now loaded by default
        Can use GLEXEC_BIN=NONE to disable it
        Warning: Explicit listing of glexec_setup may create problems.
      • Randomized the retire time to smooth terminations.
        Can be controlled via GLIDEIN_Retire_Time_Spread.
      • Some monitoring tweaks.
      • Added more switches
        Warning: xml slightly incompatible with v1_4_X
      • The factory config file is now read only.
      • Added switches to limit log file growth.
      Warning: If upgrading from v1_4_X, the reconfig will fail due changes in the monitoring setup. Manually remove want_split_terminated_graphs switch in the XML file and the reconfig will work again.
    • v1_4_4, released on Sep 30th, 2008 (Manual,Installation instructions,Tarball)
      This is a bug fix and condor update release, and you are encouraged to upgrade from v1_4_3.
      Improvements list:
      • Add factory_constraint parameter to the frontend.
      • Add support for GLEXEC_JOB.
      • Add support for USE_MATCH_AUTH.
      • Add new protection against condor_submit errors.
      • Warnings go into the info file, too. Easier to correlate errors this way.
      • Better colors in graphs.
    • v1_4_3, released on Sep 5th, 2008 (Manual,Installation instructions,Tarball)
      This is a scalability release, and you are encouraged to upgrade from v1_4_2.
      Improvements list:
      • Added mutexes to reduce factory load due to monitoring.
        Previous releases were not really scalable to more than approximately 50 entry points.
    • v1_4_2, released on Aug 26th, 2008 (Manual,Installation instructions,Tarball)
      This is a bugfix release, and you are encouraged to upgrade from a v1_4_1.
      Improvements list:
      • Improved pseudo-interactive monitoring
        • The changes introduced in v1_4_1 could leave behind zombies.
      • Fix glexec setup script bug.
    • v1_4_1, released on Aug 13th, 2008 (Manual,Installation instructions,Tarball)
      It is safe to upgrade from a v1_4.
      Improvements list:
      • Improved pseudo-interactive monitoring
        • By default use a separate startd for montoring
        • Old multi-VM mode can be enabled by MONITOR_MODE=MULTI
      • Fixed factory handling held jobs
      • Improved installer defaults
    • v1_4, released on Aug 7th, 2008 (Manual,Installation instructions,Tarball)
      Improvements list:
      • Better support for RESS and BDII
        Including automatic downtime handling
      • User STARTD_SENDS_ALIVES=True by default.
        Disable glidein UDP port by default.
        Note: This affects how Condor works
      • Global files can now be loaded after entry
      • Added support for job wrapper scripts.
      • Fix monitor locking.
      • gcb_setup now supports ORDER=NONE.
        gcb_setup is now loaded automatically.
      • Add verbosity to entries.
      • Add config section to entries.
      • Improve held handling.
      • Add a completed job log.
      • Improve signal handling (for stopping frontend/factory)
      • Made the most CPU intensive part of monitoring optional.
      • Installer now supports multiple collectors.
      WARNING: If you used a previous version, consider reinstalling everything, including Condor.
      This version contains several key changes.
    • v1_3, released on Jul 17th, 2008 (Manual,Installation instructions,Tarball)
      Improvements list:
      • Factory and frontend now gets sleep and advertize attr from config.
      • Add downtime concept to the factory and relative management tool.
      • Add command to get info about factory config file.
      • Add init.d style startup script.
      • Fix pseudo-interactive monitoring when glexec is used.
      • Reduce VO frontend condor_q load by adding job_attributes.
      • VO frontend now queries the collector and advertises result.
      • Smarter algorithm to calculate min_idle, also using condor_status.
      • Improve monitoring.
      • Minor bug fixes.
      WARNING: Entry points need to be recreated, if you used an older version.
    • v1_2_3, released on Jul 2nd, 2008 (Manual,Installation instructions)
      Improvements list:
      • Fix glexec handling in condor v7.0.2 and above.
      • Cut in half the number of condor_q's in the frontend.
      • Minor monitoring twaeks.
      • Minor installation tweaks.
    • v1_2_2, released on Jun 27th, 2008 (Manual,Installation instructions)
      This version fixes a major installer bug and has monitoring over v1_2_1. It is safe to upgrade from a v1_2_1, however, the entry points need to be recreated.
      Improvements list:
      • Fix condor installation.
      • Update versions in installer.
      • Added glidein_gcb and collector_setup.
      • Add LIBEXEC to condor_config.
      • Better support for EGEE (by supporting $TMPDIR).
    • v1_2_1, released on May 30th, 2008 (Manual,Installation instructions)
      This version has essentially usability and monitoring improvements over v1_2. It is safe to upgrade from a v1_2.
      The major improvements are:
      • Added support for BDII.
      • Added stop scripts for factory and frontend.
      • Added tools/wmsTxtList.py and tools/glidein_interactive.py.
      • All commands now are executable.
      • Add client and Condor-G monitoring in factory data.
      • Greatly improved log stats monitoring.
      • Add doc section on monitoring.
    • v1_2, released on May 5th, 2008 (Manual,Installation instructions)
      It has several improvements over v1_1, including:
      • More fine grained configuration of glideins
      • Factory reads now force integrity checks
      • Glideins now publish the gatekeeper name
      • Fixed several bugs
    • v1_1, released on Jan 30th, 2008 (Manual,Installation instructions)
      It has several improvements over v1_0, including:
      • Entry points can now be updated by using reconfig_glidein
      • Add automatic OSG glexec discovery
      • Use condor_mapfile for authorization
      • Installer now supports Condor v7 (without Quill)
      • Installer now supports gLExec
      • Fixed several minor bugs
      WARNING: Security configuration has been overhauled to fix the security issues of the provious verisons.
      Please reinstall (or at least reconfigure) your Condor installation.
    • v1_0, released on Dec 18th, 2007 (Manual,Installation instructions)
      It has several improvements over v0_9, including:
      • During installation, Quill is now optional.
      • During installation, Condor config can be split into condor_config.local.
      • Files are now loaded in order specified.
      • Added local_start.sh to ease testing.
      • create_glideins code had a major rewrite, but users should not notice any major change.
      • Slimmed down glidein_submit.sh.
      • Many bugs fixed.
      WARNING: Entry points need to be recreated, if you used an older version.
    • v0_9, released on Nov 14th, 2007
      It has several improvements over v0_8, including:
      • Significant speedup in the VO frontend matchmaking
      • Added MaxRunningGlideins request
      • Use human readable dates in logs
      • Factory will use python rrd module if present
      • Reduced graphing load of the factory
      • Frontend will work even if some of the schedd are down
      • Improved installation scripts.
      WARNING: The config directory structure has changed a lot for both the factory and the frontend and need to be recreated, if you used an older version.
    • v0_8, released on May 24th, 2007
      It has several improvements over v0_7, including:
      • Add support for multiple schedds
      • Add initial support for pseudo interactive monitoring
      • Inproved Web monitoring
      • Better documentation
      WARNING: The config directory structure has changed a lot and need to be recreated, if you used an older version.
    • v0_7, released on Apr 11th, 2007
      It has several improvements over v0_6, including:
      • Add support for Condor 6.9.2.
      • Add support for user variables
      • Move log and monitoring files into entry dir.
      • Add lock files.
      • Create proper ClassAd cleanup when daemons exit.
      WARNING: The config directory structure has changed a lot and need to be recreated, if you used an older version.
    • v0_6, released on Apr 9th, 2007
      The glidein factory was extensively reworked:
      • A single factory daemon now can serve several entry points.
      • The config file is XML based.
      WARNING: The config directory structure has changed a lot and need to be recreated, if you used an older version.
    • v0_5, released on Mar 23rd, 2007
      It has several improvements over v0_4, including:
      • Several bugs has been fixed
      • Improved glidein factory monitoring.
      • Added monitoring information in the ClassAds.
    • v0_4, released on Feb 12th, 2007
      It has several improvements over v0_3, including:
      • Several bugs has been fixed
      • The glidein factory now has an extensive graphical monitoring.
    • v0_3, released on Oct 31st, 2006
      It has several improvements over v0_2, including:
      • Several bugs has been fixed
      • It now supports GCB for WAN deployments and gLExec to comply with Grid site accounting
      • It is now much more stable and has better logging.
      • The user documentation has been greatly improved and now describes advanced configuration options, too.
    • v0_2, released on Oct 9th, 2006
      The first usable version