Cluster Status
Cluster Utilization
Fairshare Table
Project Usage
Project Accounts
File Systems
Administration
System Status
Documentation
Software
Facilities
Links

Jefferson Lab LQCD Homepage
Welcome to the Jefferson Lab Lattice QCD user facilty.
New users start here (last updated Jun 11, 2010 to include info on new GPU resources)
Report a problem
13-May-12 7n decommission today and some 10g IB networking issues Today, after 5 years of service, our oldest cluster, 7n will be decommissioned. Also, some 10g nodes will be affected and some jobs will be lost because some of their infiniband cables are physically routed though 7n.
11-Apr-12 New 12s Cluster The contract for the new LQCD cluster has been awarded, for a total of 212 dual 8 core Sandy Bridge nodes. It will be called "12s" meaning "2012 Sandy Bridge cluster". The blade compute nodes are dual socket Sandy Bridge 2.0 GHz, with 32 GB RAM and 500GB disk. The SuperMicro systems will connect via QDR, with full bi-sectional bandwidth, leaf and spine. Delivery is expected in late May.
11-Apr-12 7n Cluster Decommissioning May 14  The 7n cluster will be turned off and permanently removed from service on Monday May 14, in preparation for the arrival of the new 12s system. 12s will be installed physically in the space that 7n now uses, and power will be updated as well.
19-Mar-12 New GPU tags There is a new tag GTX to differentiate between a commercial GPU (currently tagged Tesla) and a consumer GPU (now tagged GTX). All CPU and GPU tags are documented on our wiki.
05-Mar-12 Ongoing Lustre write performance issues After last summer's software updates, write performance of some of the Lustre servers dropped to as much as 3-3.5x what it was before the update. This performance problem is limited to the oldest nodes, which hold about 40% of the total files in Lustre. Please give us feedback at hpcadmin@jlab.org if this lower performance is having a big impact on your system utilization.
09-Feb-12 Experimental support for hdf5 file format hdf5 with szip compression is available on the qcd10i1/2 interactive machines. To use it do module load hdf5. It is NOT available on the compute nodes at this time, nor is a parallel version available either. Any feedback is welcome.
07-Nov-11 9g GPU upgrades GTX285->580 The 32 9g gpu nodes with quad GTX285 cards were upgraded to GTX580s over a 2 week period starting 11/17/11.
System Status: 
Jlab Lattice PORTAL
Last update: Wed May 16 22:13:10 EDT 2012
Jlab GPU Cluster
Cluster Nodes: 8-11g 54-10g 65-9g
85%



Jlab Infiniband Cluster
Nodes: 224-10q 335-9q
98%



Feedback (suggestions for new material, links to be added, etc.).