USCMS MOP

MOP is a system for distributing CMS production jobs over GRID extensively used during several GRID and CMS milestones including CMS Pre Challenge Production and GRID-3 . MOP interfaces to several DPE tools including McRunjob, CMS workflow creation tool, facilitates creation of workflows as DAGs which are then executed using DAGMAN, Condor_G and Globus over the GRID. MOP orchestrate end-to-end job execution including data transfers for and after execution of production jobs. Most of CMS Applications (CMKIN, CMSIM, OSCAR, Hit, Digi) are supported. Several modes of operations are supported, including direct staging of data from Mass Storage (dcache) to Worker Nodes and vice versa. MOP interfaces to Configuration Monitor and Condor_G Match Maker to achieve Job Scheduling.

MOP declares two type of sites w.r.t its operation. MOP Master is the site where DAGs are created for Jobs, and MOP Worker is the site where Jobs are submitted and executed. Following Animation describes MOP operation,
http://www-ed.fnal.gov/work/sc2001/mop-animate-2.html
MOP Master:
MOP Master site needs 'DPE Master suite' deployed from http://www.uscms.org/SoftwareComputing/Grid/DPE/gridinfo.html.

Operation guide for MOP master:

(supporting DPE1_5) http://home.fnal.gov/~anzar/DPE_Operations.html
(supporting DPE 2_0) http://home.fnal.gov/~anzar/MOP_MASTER/DPE20ProdOpsManual.html
(supporting DPE 2_1_0 ) http://home.fnal.gov/~anzar/MOP_MASTER/DPE_2_1_Production_Operations_Manual.html
(supporting DPE 2_3 ) http://home.fnal.gov/~anzar/MOP_MASTER/DPE_2_3_Production_Operations_Manual.html
(supporting DPE 2_4 ) http://home.fnal.gov/~anzar/MOP_MASTER/DPE_2_4_Production_Operations_Manual.html
(supporting DPE 2_4_1 ) http://home.fnal.gov/~anzar/MOP_MASTER/DPE_2_4_1_Production_Operations_Manual.html

MOP Master Operation Tools:
Follow this link http://home.fnal.gov/~kuropat/cms/cms.html
MOP master troubleshooting Guide

MOP Worker :
Setup is described here
http://home.fnal.gov/~anzar/MOP_WORKER/Setting_Up_a_MOP_Worker_Site_.html

Verifying a MOP Worker deployment from Master site.
Using this script, this could be achieved.

Staus of worker sites
http://hotdog65.fnal.gov/ganglia-webfrontend/
Current Production:
MOP is currently used to run OSCAR Production on USCMS Production GRID and Grid3 (opportunistic) resources.



Development:
MOP is maintained as mop_submitter module in CD CVS Repository,

Please follow the CD CVS access control

Current Development:


Other References  (Information given in following links is pretty old and not Guranteed):
http://www.cs.wisc.edu/~adesmet/cms_mop_master.html
http://home.fnal.gov/~anzar/MOP_MASTER/mop.html
http://grid.fnal.gov/test_beds/MOP_install.htm



Last update 06/13/2005
M. Anzar Afaq anzar[@]fnal.gov
Fermi National Accelerator Laboratory phone: (630) 840-6856
Computing Division - CMS Group fax : (630) 840-2783
P.O.Box 500, MS 234, Batavia, IL 60510 http://home.fnal.gov/~anzar