Personal tools
You are here: Home Documentation Handbook Daily Tasks
Document Actions

Daily Tasks

by admin last modified 2007-05-16 06:12

A list of tasks which must be performed each day to monitor the health of the T2 site.

General cluster

  • Log in to red.
  • Type the following commands to check NFS health:
    • ls /mnt/nfs03
    • ls /mnt/nfs04
    • ls /mnt/ssa
  • Type qstat -q to make sure PBS is running.
  • Verify NAT is working.

Grid Interfaces

CMS Tests

  • The SAM webpage is located at here.  There should be an entry for site Nebraska and it should pass all tests.
  • The JobRobot page.  Click on the latest day's worth of information.  Look for unl in the table (usually second-to-last).  Verify that all jobs have been successful.

OSG Tests

  • CEMon/BDII Server Status.  Look for the red.unl.edu entry; make sure that the Served Data age and CEMon Data Feed entry have both been updated within the last 10 minutes.  (There may also be a BDII Data Feed column which is very old; ignore it)
  • VORS.  There should be two green dots in Nebraska from VORS (one for storage, one for CE).  Make sure Nebraska and T2_Nebraska_Storage both PASS in the table.
    • T2_Storage_Nebraska.  Click on the link to the Latest Test Results.  Make sure all tests PASS.
    • Nebraska.  Click on the link to the Latest Test Results.  Make sure all tests PASS (except for optional VDS ones).


dCache


Phedex

  • Check network graphs to make sure LoadTest transfers are happening.
  • Visit the PhEDEx webpage, make sure we are appearing in the data rates table.
    • Investigate / report any transfer errors.
    • Check last 24 hour's transfer quality.  Report any significant deviations from 100%.

Websites

  • Visit t2.unl.edu (this webpage) to make sure it is online.



Powered by Plone, the Open Source Content Management System