|
OSG Daily Validation Project
Introduction
The Open Science Grid (OSG) is a US grid
computing infrastructure supporting scientific computing via an open collaboration of
science researchers, software developers, and computing, storage and network providers.
US CMS is a key member of the OSG Consortium, and the future successes of OSG is key to
the future success of US CMS. In order to ensure the integrity of the OSG software
layer, a project was started by US CMS in order to validate its integrity.
Goals
- Downloading, installing, and configuring OSG components from scratch on a
daily basis in an automated way to ensure the integrity of the software stack.
This is presented as a service to the OSG software maintainers.
- To automate (as much as possible) the OSG installation procedure to facilitate wide-spread
use of OSG on distributed US CMS Resources.
- Identifying time-dependent issues in the OSG installation procedures.
- Documenting the changes from day-to-day in the OSG software cache.
- Documenting the changes from version to version in the OSG software stack, facilitating
proper maintenance, support, and documentation for new OSG versions.
- Providing a near real-time test harness for OSG software packaging.
Implementation
A combination of shell and expect scripts do a fresh install of OSG and ITB
caches every evening.
A summary e-mail is sent out and daily logs are kept for 20 days.
Brief summaries from each daily build process are posted to the
osg-daily-build mailing list.
These logs are published and are available here:
Future Plans
- Integrating all four daily builds onto a single node using Xen
Virtual Machine technology. The VM technology will also allow us to
begin from a clean OS template every night.
- Integrating OSG validation procedures with VDT validation procedures.
- Iterative improvements in the testing scenarios.
Last modified: Feb 27, 2006 09:19 CST - John Weigand fnal.gov - Added VOMS ITB
Last modified: Feb 8, 2006 15:12 CST - John Weigand fnal.gov - added VOMS OSG
|
