- HybriLIT Platform Software and Hardware Environment
- Job Queues
- Data Storage and Processing Systems
- Basic steps for making calculations on the platform
- Getting Started: Remote Access to the Platform
HybriLIT Platform Software and Hardware Environment
The HybriLIT training and testing facility is built on compute nodes equipped with multi-core Intel processors and NVIDIA GPU accelerators (see the Hardware section for details).
Compute Node Types
- CPU nodes with Intel Xeon Phi 7290 multi-core processors
- CPU nodes with Intel Xeon E5-2695 v2 multi-core processors
- GPU nodes with Intel Xeon E5-2695 v3 multi-core processors and NVIDIA K80 GPUs
- GPU nodes with Intel Xeon E5-2698 v4 multi-core processors and NVIDIA V100 GPUs
Job Queues
Jobs are submitted by placing them into a queue associated with a user account. Since HybriLIT is a heterogeneous platform, separate queues have been created to support different types of computing resources.
Currently, HybriLIT provides 5 queues:
- interactive* — includes one compute node with 2 × Intel Xeon E5-2695 v2 (12 cores each). This queue is suitable for running test programs. The maximum wall time is 2 hours. (*The asterisk indicates that this is the default queue.)
- cpu — includes 15 compute nodes, each with one Intel Xeon Phi (72 cores). This queue is intended for CPU-based applications. The maximum wall time is 7 days.
- long — includes 6 compute nodes, each with one Intel Xeon Phi (72 cores). This queue is suitable for long-running applications with execution times of up to 4 weeks.
- gpu_k80 — includes one compute node with 2 × Intel Xeon E5-2695 v3 (14 cores each) and 2 × NVIDIA Tesla K80 GPUs. This queue is intended for GPU-accelerated applications. The maximum wall time is 7 days.
- gpu_volta — includes one compute node with 2 × Intel Xeon E5-2698 v4 (20 cores each) and 8 × NVIDIA V100 GPUs. This queue is suitable for long-running GPU applications with execution times of up to 7 days.
Operating System and Software Environment
The heterogeneous platform runs AlmaLinux 9.6 and uses the SLURM workload manager.
The installed software environment includes compilers and development tools for building, debugging, and profiling parallel applications, as well as the Lmod module system.
Data Storage and Processing Systems
To improve reliability and performance, several data storage and processing systems are available to users on the platform.
1. Home
User home directory:
/zfs/store5.hydra.local/user/l/login
This directory is intended for editing files and building/compiling programs. Each user has a 100 GB quota. The home directory is not intended for running computations and is not accessible on compute nodes.
2. Project
User project directory:
/lustre/projects/l/login
This directory is intended for running computations and storing working files (executables, input, and output files) during job execution. No quota is applied, and the directory is accessible on compute nodes.
3. Scratch Lustre 12×12*
High-performance scratch directory:
/lustre/scratch/l/login (*will be available later)
This directory is located on the Lustre 12×12 file system, which is optimized for high I/O workloads. It is intended for massively parallel applications with intensive input/output operations. Files stored in Scratch Lustre 12×12 are not guaranteed to be preserved for more than 90 days.
4. Scratch NFS/ZFS
Backup scratch directory:
/zfs/scratch/l/login
This directory is hosted on an NFS/ZFS file system and is intended for jobs that process a large number of small files (less than 10 MB each). Files stored in Scratch NFS/ZFS are not guaranteed to be preserved for more than 90 days.
5. Lustre (Legacy Home Directory)
Old user home directory:
/lustre/home/user/l/login
At present, files are being migrated from the previous storage system to the current project directory /lustre/projects. This process may take some time. Please do not worry — all data are preserved and will be fully transferred.
Basic steps for making calculations on the platform
Getting Started: Remote Access to the Platform
Remote access to the HybriLIT heterogeneous computing platform is available only via SSH.
DNS address:
hydra.jinr.ru
Detailed connection instructions for different operating systems are provided below.
For Linux Users
Open a terminal and run:
ssh USERNAME@hydra.jinr.ru
where USERNAME is the login you received during registration, and hydra.jinr.ru is the server address. When prompted, enter your password. Upon successful authentication, you will see a command prompt:
[USERNAME@hydra ~] $
This indicates that you are connected to the platform and located in your home directory. During the first connection attempt, you may see a warning about an unknown host. Type yes and press Enter to add the host to the list of known hosts.
For Windows Users
Windows users must use an SSH client such as PuTTY or MobaXterm.
Connecting with PuTTY
PuTTY does not require installation. Download putty.exe from: http://the.earth.li/~sgtatham/putty/latest/x86/putty.exe. Save it to a convenient location and run it.
PuTTY configuration steps:
- In the Host Name (or IP address) field, enter: hydra.jinr.ru
- In Saved Sessions, enter a name for the connection (e.g., hydra.jinr.ru)
- To enable remote graphical applications (X11):
-
- Go to Connection → SSH → X11
- Enable X11 forwarding
- Verify that Connection → SSH → Tunnels has Local ports accept connections from other hosts enabled
- Return to the Session tab and click Save
- Click Open to connect to the HybriLIT platform
- Enter your login and password when prompted
After successful authentication, you will see:
|
1 |
<span lang="EN-GB" style="color: black;">[USERNAME@hydra ~] $</span> |
This confirms that you are connected and located in your home directory. During the first connection, typeyes when prompted to confirm the server identity.
Installing and Using MobaXterm
- Visit mobaxterm.mobatek.net and download either:
- the portable version (no installation required), or
- the installer version (recommended below)
2. Run MobaXterm_Setup_XX.exe and follow the standard installation steps
3. After installation, launch MobaXterm using the desktop shortcut
4. From the top menu, select Sessions → New session
5. Enter hydra.jinr.ru in the Remote host field and click OK
6. A new tab will open. Enter your login and password. Upon successful authentication, you will see:
