Parallel Computing Laboratory
The Laboratory of Parallel Computing activities are aimed to set up and develop the computing cluster “Zeolite”, optimized for high-performance computations in quantum physics and crystal chemistry, including:
procurement of computer, network, electrical and cooling equipment, execution control of orders and installation works;
engineering, installation, testing and diagnostics of server and network hardware, supplier interaction on warranty replacements;
installation, setting and update of firmware, system and additional (cluster resources management system and cluster load monitoring system) software;
installation, setting, compilation and optimization (if necessary) of application software (programs, libraries);
consulting of cluster users on computations performance, front-end and further processing of data.
Current configuration and equipment specifications:
number of computing nodes – 54;
number of cores available for computations x86-64 AVX/AVX2 — 1520;
total memory space – 15 Tbyte;
number of cores within a node – 24/32/64;
a node memory space – 256/512 Gbyte;
data transfer medium - FDR Infiniband 56 Gbps;
aggregate throughput – 12 Tbps;
network storage system — Ethernet 10Gbps;
aggregate throughput – 1,2 Tbps;
number of storage servers – 7;
total capacity of storage system – 120 Tbyte;
total performance of computing nodes AVX (816 cores, test HPL LINPACK) 12TFLOPS
total performance of computing nodes AVX2 (704 cores, test HPL LINPACK) 18TFLOPS
Additional equipment:
uninterruptible power system Eaton Powerware 9355 (2×30 kVA) – 3;
cooling system: precision air conditioners DeLonghi Performer DXO29 (3×29 kW);
auxiliary network: commutators Hewlett-Packard ProCurve 25xx (2×48 GbE).
System software:
OS Ubuntu Linux LTS 16;
Mellanox OFED;
OpenMPI 1.6.5, 1.8.8, 2.0.2, 3.1.0
The main used compilers and libraries:
gcc, g++, gfortran;
FFTW (Fast Fourier Transform library);
ATLAS (Automatically Tuned Linear Algebra Software);
ScaLAPACK (Scalable Linear Algebra PACKage);
Intel Fortran/C/C++ Composer XE;
Intel MKL (Math Kernel Library).
Application software:
VASP 5.x.x;
Wien2k;
Gaussian09;
Crystal 14;
Quantum Espresso;
Siesta;
DFTB+;
cp2k;
cpmd;
gulp.
Additional software:
SLURM (resource management system);
Ganglia (monitoring system).