Technical Details
The Genetic Cluster Computer is part of the Dutch national compute cluster Lisa, hosted by SARA.
The LISA system configuration
512 compute nodes:
- 32, each equipped with:
- Processors: 2 Intel® quad-core Xeon” L5420
- Clock: 2.5 GHz
- Front Side Bus: 1330 MHz
- Memory: 16 GB
- Cache: 12 MB
- Infiniband: Qlogic
- Local scratch space: 65 Gbyte
- 384, each equipped with:
- Processors: 2 Intel® quad-core Xeon” L5520
- Clock: 2.26 GHz
- Quick Path Interconnect: 5.86 GT/s
- Memory: 24 GB
- Cache: 8 MB
- Infiniband: Qlogic on 256 nodes
- Local scratch space: 65 Gbyte
- 96, each equipped with:
- Processors: 2 Intel® six-core Xeon” L5640
- Clock: 2.26 GHz
- Quick Path Interconnect: 5.86 GT/s
- Memory: 24 GB
- Cache: 12 MB
- Infiniband: Qlogic on 64 nodes
- Local scratch space: 220 Gbyte
- Qlogic 4x DDR InfiniBand network:
- Bandwidth: 1600 MB/sec
- Latency: <6 µsec
- Total peak performance: 20 TFlop/sec
- Disk space: 48 TB SUN® Thor systems for the home file systems
- Operating system: Debian Linux AMD64 OS.
There are five types of compute nodes:
| Number | Cores | Memory | InfiniBand |
|---|---|---|---|
| 32 | 8 | 16 GB | Qlogic |
| 128 | 8 | 24 GB | - |
| 256 | 8 | 24 GB | Qlogic |
| 32 | 12 | 24 GB | - |
| 64 | 12 | 24 GB | Qlogic |
Managing the national compute cluster
In order to keep the national compute cluster manageable, use is made of the following software:
- Cfengine2
- a configuration engine.
- SystemImager
- SARA has developed an add-on for SystemImager to manage the PXE boot process. It is available here. There is an excellent description available at the Technical University of Denmark.
- OpenPBS and TORQUE
- SARA has developed a Python interface for both batch systems.
So it is now possible to develop batch utilities in Python instead of C. The software package contains an example directory with an ASCII xpbsmon utility. - Ganglia
- For Ganglia SARA has developed an add-on to monitor OpenPBS and TORQUE queues. This creation is based on software included in the rocks toolkit.
- torque_2_deb
- SARA has developed software to make a debian package from the Torque source
- Dell
- OpenManage Server Administrator (OMSA): SARA has ported the OMSA tools to Debian