OU ATLAS/OCHEP/Grid/Tier 2 Page

• Hardware and Software Installation
• Contact Info
• Grid Monitoring
• Other useful Grid-related Links
• Grid-related Meetings
• Network Monitoring
• OU Links

OUHEP Cluster Hardware and Software Installation:

OCHEP (US ATLAS Tier 2) Cluster Hardware:

OUHEP (Desktop) Cluster Hardware:

OUHEP_ITB Cluster Hardware:

Installed System and Grid Software (click on the links for installation notes):

• YP (NIS) Server and NFS Automounter (autofs)
• RHEL6.9
• APCSMART UPS (Uninterruptible Power Supply)
• Condor
• Ganglia and RRDTOOL
• OSG 3

For Reference: Old Installed Software (click on the links for installation notes):

• RHEL5.9 NFS/NIS Client node post-install script (and old SLF3 NFS/NIS Client node post-install script)
• iperf 1.7.0
• OSG releases OSG 1.2.0, OSG 1.0.0, OSG 0.8.0, OSG 0.6.0, OSG 0.4.1, OSG 0.4.0, OSG 0.2.1,
  and ITB releases OSG 1.1.0 install, OSG 1.1.0 update, OSG 0.9.1
• GASS and GRAM cleanup script
• GUMS 1.0.1
• DQ2 0.2.11
• BeStMan-Gateway 2.2.1.2.i7
• dCache 1.6.6-5 and dCache 1.6.5-3
• OpenAFS 1.2.13
• Transarc AFS 3.6.1 - no longer used; does not seem to work properly with multi-processor systems; i.e., doesn't shut down, just hangs, which makes proper machine shutdown impossible. That's why I eventually installed OpenAFS.
• OpenAFS 1.0.1 -- installed on the RedHat 6.2 nodes.
• pacman 1
• Globus 1.1.4; I had first installed Globus 1.1.3, and I had done it in pieces, part 1, part 2 and part 3. (also, info on Globus Installation at Michigan and Indiana, and Globus Administration at Argonne). And here are some additional tips on how to set up Globus 1.1.x under RedHat 7.2.
• MDS setup (for Globus 1.1.x); GRIS servers on all local nodes - and now also the Condor job scheduler - will report to the GIIS server on the gatekeeper.
• gsiftp 0.3; you can get the tar ball at http://www.globus.org/gsiftp-alpha/tools.html. And the bottom of this page tells you what has changed for RedHat 7.2 (xinetd).
• Condor 6.2.1; If you are using the Globus jobmanager-condor for Globus 1.1.x, be sure to fix the I/O bug in the globus-script-condor-submit; look at the bottom of this page for instructions.
• Globus 2.0beta
• Condor 6.4.7 and Condor-g 6.4.7
• WorldGrid -- VDT 1.1.9
• Grid3v2.1 -- VDT 1.1.14, which also contains MonALISA v1.2.8
  If you need MonALISA v1.2.12 to report to multiple Groups simultaneously, see here for istructions
  More info about MonALISA
• Grid3Dev Installation notes
• CEMon on top of OSG 0.4.1 install
• Atlfast-Fortran -- old and out of date.
• Athena-Atlfast -- scripts for Globus 1.1.x -- runs via Globus, and can also be submitted to a job scheduler (here Condor) to run multiple jobs -- no longer used.

Contacts:

• Horst Severini, OUHEP Computing Coordinator - hs@nhn.ou.edu, (405)325-3961x36359
• Chris Walker, OUHEP Technician - walker@nhn.ou.edu, (405)325-3961x36350
• Patrick Skubic, Professor - pls@nhn.ou.edu, (405)325-3961x36329
• Joel Snow, Adjunct Professor - snow@nhn.ou.edu, (405)466-3328
• Andy Feldt, Dept. Sys Admin - afeldt@ou.edu, (405)325-3961x36115

Links to other Tier 1 and Tier 2 Centers :

• BNL Tier 1
• NorthEast Tier 2
• Great Lakes Tier 2
• MidWest Tier 2
• SouthWest Tier 2 and SWT2 Listserv Archives and SWT2 RT Tickets and USAtlasTier3 RT Tickets
• Western Tier 2

Grid Monitoring:

• OSG Information Management (OIM) Interface, Registration Instructions, Operations Instructions, and OSG Ops Meeting Minutes
• OSG Grid Monitoring, Grid Operations Center (GOC) Systems and Services Monitor, and MyOSG
• Ganglia Load and Status Monitor for OCHEP, particularly OUHEP and NHN and OU_OCHEP_SWT2 and Lucille_CE, and Lucille's CondorQ and BWMon, and Lucille at Work
• perfSONAR Network Monitoring of USATLAS Tier2 sites (OSG Mesh and Testbed Instance) and of OU Tier 2 Cluster: PS1 and PS2, Check_MK, and LHCperfSONAR page and WLCGperfSONAR Monitoring page, and ATLAS Traffic Report
• MonaLISA and WLCG Earth
• RSV Monitoring, as well as local RSV pages for OUHEP_OSG, OU_OCHEP_SWT2, OUHEP_ITB, OU_OSCER_ATLAS, and Lucille_CE, and OU_OCHEP_SWT2 Gratia RSV Quality, SAM Reports, Espace Reports, and a SAM Test GridView Help Page
• GridScan Production Monitoring, GridScan Integration Results, GridScan Development Results, and VORS (VO Resource Selector) Pages
• CEMon / BDII Server Status for OSG and OSG-ITB, and ReSS Central Services History (and old private area), and details on OU_OCHEP_SWT2, OUHEP_OSG, and OUHEP_ITB, and ReSS Storage Endpoints
• Generic Information Provider (GIP) Validation Page
• OSCER XDMOD Page
• OSG Accounting, OSG Accounting 24h Overview, OU_OCHEP_SWT2, OU_OSCER_ATLAS, LUCILLE_CE, OUHEP_OSG, and OU and LU Jobs Summary OU and LU Sites Summary
• EGI Accounting pages for Tier2s and OSG, and EGI Devel Accounting, and Espace Reports
• GSTAT Accounting and information on the APEL/WLCG Gratia Interface
• WLCG Dashboard and Daily Job Summary, and ADC Monitoring and REBUS and AGIS Downtime Calendar and Blacklisting Info
• ETF Dashboard, SSB Metrics, US SSB Metrics, OU_OCHEP_SWT2 SSB Metrics, and OU_OCHEP_SWT2 SAM Metrics and OU_OSCER_ATLAS SAM Metrics
• SWT2 SAM Monitoring: Summary and Details
• AGIS, AGIS Development, AGIS Documentation, AGIS Modification Instructions, New SchedConfig Instructions, and Instructions on queue status changes
• AGIS User List, AGIS Service View, AGIS Panda Queue View, ATLAS AGIS Queues, and TiersOfATLASCache
• CERN FTS Monitoring, DQ2 US Space Summary, DQ2 Site Summary, DQ2 Site Spacetoken Usage, DQ2 User Space Usage, DQ2 User Dataset List, and OU Space Usage
• USAtlasStorageSetUp and LOCALGROUPDISK Usage
• Federated XrootD Monitoring, FAX Status Board, Transfer, MonaLisa, and WAN performance Monitoring

Other Useful Grid-related Links:

• US ATLAS Grid Computing Page at BNL, US ATLAS Grid Resource TWiki, US ATLAS Computing Facility, and US ATLAS Home Page
• US ATLAS Tier 2 Support Center Pages at BNL and US ATLAS SouthWest Tier 2 TWiki (and SouthWest Tier2 Center Proposal), and US ATLAS Facilities Integration Program
• BNL RT Ticket System and US ATLAS Facility Intergration JIRA
• LHC Computing Grid (LCG), WLCG TWiki, and LCG2 User Interface
• Grid Computing introduction page at the ATLAS Workbook and WLCG Client installation page
• Open Science Grid (OSG), particularly OSG Installation Instructions, HTCondor CE Overview and HTCondor CE Install Information; also OSG Development Twiki, OSG Documentation, and OSG Integration TestBed (ITB)
• The US ATLAS Production System Panda, especially CVS Repository and LXR Cross Referencer (and backup), and BNL and Panda Google Group Listservers, CERN Central SVN Service, and PAthena, as well as instructions for SVN setup at BNL and AtlasCanada
• The US ATLAS GIT Repository and CERN FAX GIT Repository
• Panda Monitor (old), particularly finished production and failed production and finished analysis and failed analysis jobs at OU, and ANALY_OU_OCHEP_SWT2 HC jobs, OU_OCHEP_SWT2 HC jobs, OU_OSCER_ATLAS HC jobs, and US sites, as well as Panda ITB Robot Page, SchedConfig Info and Panda Shift Guide, and new Panda monitor prototype
• MCORE Panda Monitor and OU_OSCER_ATLAS_MCORE PandaMon configuration
• ATLAS Pilot Factory Monitor and gridui18's APF Logs and Jose's APF Links
• HammerCloud, particularly SiteOverview, CloudOverview, and AutoExclusions
• ADC Squad How To for Sites and Sites Setup and Configuration Info
• DQ2 for Panda OSG sites, DDM for US ATLAS, Wensheng's DQ2 area, DDM Client Installation, LFC migration, and Charles' LFC area; and current TiersOfATLASCache.py and AMI
• Rucio and R2D2 Rule Request Page
• DDMDarkDataCleaning and DDMLostFiles and Consistency Checks
• Information on SRM and SE Tips in general, as well as Installation Documentation on BeStMan and BeStMan Gateway in OSG, and BeStMan Gateway and Adler32 Checksum instructions for US ATLAS, and Information about Java versions and preferences
• SRM to GridFTP Migration
• US ATLAS Tier 1/2 dCache System and dCache mailing lists, and old dCache area
• Tier 2 Squid Deployment, Frontier data distribution service, and Database Deployment and Operations, as well as Frontier Monitoring
• US ATLAS Tier 3 Storage Setup Guide, particularly Xrootd, and the Atlas Xrootd System in general and US Atlas Xrootd Configuration and Atlas Xrootd Upgrade Instructions and FAX Operations Guide and FAX End-Users Tutorial
• USAtlas BNL Tier 3 Pages, SLAC Tier 3 Pages, ATLAS Tier 3 Pages, Tier3SW Pages at CERN and Canada, and OSG Tier 3 Pages, and ATLASLocalRootBase
• ATLAS Storage at CERN (EOS)
• The ATLAS HPC Effort
• The Globus Project and its Toolkit Documentation
• Globus Error codes, more Error documentation, and Bugzilla bug reporting page
• Globus Firewall Requirements
• The Condor Project and Condor-G, and Condor Week 2005, 2006, 2007, 2008, 2009, 2010, 2011, ..., 2015, 2016 2017
• The Virtual Data Toolkit (VDT) and VDT office hours
• The Chimera Virtual Data System in GriPhyN and at U. Chicago; also, its Grid Component Library
• Information on Registration and Certificate Authorities at DOEGrids, Cert Search page, Information on obtaining OSG grid certificates and OSG certificate request page and new and DigiCert certificate request page, and Information on obtaining ATLAS grid certificates and joining VOs
• Information on the transition to the DigiCert CA and CILogon HSM
• Information on Certificate Renewal Scripts from the OSG Security TWiki
• Computer Security Software Tools (certificate related), and more GSI Configuration Information
• Sun Grid Engine (SGE) Integration with the Globus Toolkit
• ATLAS Computing, information about new web page structure, US ATLAS Computing (old US ATLAS Computing page)
• ATLAS Software Installation and Platforms and Compilers, especially for RHEL3/SLC3, RHEL4/SLC4 and Distributed Analysis on RHEL4/SLC4, RHEL5/SLC5 and SLC5 LCG Dependencies, RHEL6/SLC6 and SLC6 LCG Dependencies, SLC6 Readiness and SL6 Deployment Status, CentOS7 Readiness and CentOS7 Dependencies and SL7 Testing and SL7 Installation Notes, and Rucio Configuration
• CERN LINUX Repository and WLCG Repository
• AthenaMP Facility Configuration, Testing, and Virtual Memory requirements
• Satus of current releases and nightly reco releases
• CVMFS notes at CERN and BNL (old), as well as for Tier3 installations
• ATLAS Software Setup using CVMFS
• ATLAS Production Releases, particularly at OU_OCHEP_SWT2 and OU_OSCER_ATLAS
• ATLAS Release Caches and Patch Caches
• US ATLAS Software Support, especially FDR Analysis Support, and ATLAS Work Book and Distributed Analysis on Panda and Physics Analysis Tools
• Scientific Linux (SL)
• Premier.Dell.Com Product Services
• Pacman -- local OU Cache, and also Pacman Cache, BU Cache, UTA Cache, SWT2 Cache, MWT2 Cache, OSG Cache, OSG-ITB Cache, OSG-VTB Cache, VDT Cache, VDT-Test Cache, iVDGL Cache, GCL Cache, and ATLAS Release Cache, ATLAS Patch Cache, and am-BNL Cache
• Science Grid This Week, International Science Grid This Week, and GRIDtoday
• OpenAFS and IBM AFS Documentation
• FNAL List Archives
• BNL Labmail
• lists.bnl.gov Mailing Lists and US ATLAS HyperNews Forum
• ATLAS Panda Google Group
• CERN Groups and E-Groups
• ATLAS Mailing Lists and Subscription Info, and ATLAS HyperNews Forum
• ATLAS Computing Meeting Agendas
• ATLAS Grid Meeting Agendas
• LCG Meeting Agendas
• Grid3 Meeting Agendas and other iVDGL Events
• US ATLAS Physics Analysis Meeting Agendas and RCF Meeting Agendas
• Video Conferencing at CERN, and Web Streaming from UM's Web Lectures Archives
• ESnet Collaboration Services and Codian AdHoc (88x) Streaming
• EVO Video Conferencing and EVO - Access Grid Bridging
• Video Conferencing Instructions and OUHEP Video Conference Schedule

Grid-related Meetings:

• US ATLAS Tier 2 Workshop (UC)
• US ATLAS Tier 2 Workshop (HU)
• US ATLAS Tier 2 Workshop (UTA)
• US ATLAS Tier 2 Workshop (UCSD)
• US ATLAS Tier 2 Workshop (IU)
• US ATLAS Tier 2 Workshop (SLAC)
• US ATLAS Tier 2 Workshop (RENCI)
• US ATLAS Tier 2 Workshop (UM)
• US ATLAS Tier 2 Workshop (BNL)
• OU and SMU Monopole Workshop (OU)
• ATLAS Southwest Tier 2 Center Analysis Workshop (UTA)
• US ATLAS SWT2 Meeting (OU)
• ATLAS Southwest Tier 2 Center Analysis Workshop (UTA)
• OU, SWT2, and US ATLAS Physics Analysis Agenda Areas
• Software and Computing Workshops and Grid Deployment Board Meetings and US ATLAS Distributed Facility Meetings and Distributed Computing Operations Meetings and Grid Tools and Services Meetings and Other ATLAS Meetings
• BNL ATLAS Meeting Travel Regulations and Exemptions
• More meetings and workshops from the US ATLAS Grid page

OU Network Monitoring Links:

• ESnet LHCONE Network Monitoring
• OU IT Network Traffic Monitoring
• OU Internal Network Traffic Monitoring for OUHEP0/00 (ifIndex 13) and trunk (ifIndex 17), OUHEP9/11/12/30 (ifIndex 108, 24, 73, 60) and trunk (ifIndex 6), SEC (ifIndex 583, 586, 587), and SRTC (ifIndex 94), and NOC (ifIndex 260)
• OneNet Traffic between OU and ESnet and OneNet Latencies to Cable Modem sites
• Network Transfer Monitoring to BNL: daily, hourly, and main page
• FNAL Network Traffic Monitoring (and backup) and FNAL Internal Network Traffic Map and Network performance monitoring to FNAL and SLAC Bandwidth Tests
• Network Performance Tests to OU: PS1 and PS2; also NPAD and NDT at the NWC; as well as to BNL: NPAD and NDT, and newmon.bnl.gov
• Network Performance Tests (NPAD and NDT) to various NLR test points, from the Global Resarch NOC Page at IU
• Network Performance Tests to Internet 2 in Chicago: NPAD and NDT
• Internet2 Live Network Status and AL2S
• High Performance Data Transfer Info at the Pittsburgh Supercomputing Center

Links to other OU Pages:

• OUHEP ATLAS Page
• OUHEP DØ and DOSAR Grid Computing Page
• OUHEP Page
• OU Physics & Astronomy
• University of Oklahoma