Deepak: New Page

2026-04-20T06:25:07Z

New Page

New page

{{DISPLAYTITLE:Magus02 — HPC Knowledge Base}}
__NOTOC__

<div style="background:linear-gradient(135deg,#0d1b2a 0%,#1a2a3f 100%);border:1px solid #2a4a6b;border-radius:10px;padding:30px 36px;margin-bottom:28px;">
<div style="font-family:monospace;font-size:11px;color:#5ba3d9;letter-spacing:2px;text-transform:uppercase;margin-bottom:10px;">Shiv Nadar Institution of Eminence — HPC Infrastructure</div>
<div style="font-size:40px;font-weight:900;color:#ffffff;letter-spacing:-1px;line-height:1;margin-bottom:12px;">Magus02 HPC<br>Knowledge Base</div>
<div style="font-size:15px;color:#94a8be;max-width:680px;line-height:1.7;margin-bottom:24px;">Your complete reference for accessing, using, and getting the most out of the Magus02 High Performance Computing cluster at SNU. Whether you are a first-time user or an experienced HPC programmer, this wiki has you covered.</div>
<div style="display:flex;gap:12px;flex-wrap:wrap;">
<span style="background:#00c9ff;color:#060e18;font-family:monospace;font-size:12px;font-weight:700;padding:6px 14px;border-radius:5px;">HOST: magus02.snu.edu.in</span>
<span style="background:rgba(57,211,83,0.15);color:#39d353;font-family:monospace;font-size:12px;font-weight:700;padding:6px 14px;border-radius:5px;border:1px solid rgba(57,211,83,0.3);">● SYSTEM OPERATIONAL</span>
<span style="background:rgba(0,201,255,0.1);color:#00c9ff;font-family:monospace;font-size:12px;padding:6px 14px;border-radius:5px;border:1px solid rgba(0,201,255,0.2);">SCHEDULER: Slurm</span>
</div>
</div>

== 🚀 Quick Navigation ==

{| style="width:100%;border-collapse:separate;border-spacing:14px;"
|-
| colspan="2" style="background:#0a1520;border:2px solid #00c9ff;border-radius:10px;padding:20px 24px;" |
<div style="font-size:13px;font-family:monospace;color:#5ba3d9;letter-spacing:1px;text-transform:uppercase;margin-bottom:8px;">⚡ New to Magus02? Start here</div>
<div style="font-size:16px;font-weight:700;color:#e6edf3;margin-bottom:6px;">[[Magus02/Getting_Started|→ Getting Started Guide]]</div>
<div style="font-size:14px;color:#7a94aa;">Everything from account access and SSH login to running your first job — in one guide.</div>
|-
| style="width:50%;background:#0d1b2a;border:1px solid #1e3a5a;border-radius:10px;padding:20px 22px;vertical-align:top;" |
<div style="font-size:12px;font-family:monospace;color:#5ba3d9;letter-spacing:1px;text-transform:uppercase;margin-bottom:12px;">📘 Basics</div>
<div style="font-size:13px;line-height:2.2;color:#94a8be;">
[[Magus02/Getting_Started|Getting Started]] · First steps on Magus02<br>
[[Magus02/Shell|Linux Shell]] · Commands and filesystem navigation<br>
[[Magus02/SSH|SSH Access]] · Connecting securely to the cluster<br>
[[Magus02/File_Transfer|File Transfer]] · scp, rsync, WinSCP, FileZilla<br>
[[Magus02/Modules|Environment Modules]] · Loading software on HPC<br>
[[Magus02/Scheduling_Basics|Scheduling Basics]] · How the batch system works
</div>
| style="width:50%;background:#0d1b2a;border:1px solid #1e3a5a;border-radius:10px;padding:20px 22px;vertical-align:top;" |
<div style="font-size:12px;font-family:monospace;color:#5ba3d9;letter-spacing:1px;text-transform:uppercase;margin-bottom:12px;">⚙️ HPC User Guide</div>
<div style="font-size:13px;line-height:2.2;color:#94a8be;">
[[Magus02/Compiler|Compilers]] · GCC, Intel, LLVM, PGI<br>
[[Magus02/Batch_Scheduler|Batch Scheduler]] · Submitting and managing jobs<br>
[[Magus02/OpenMP_Usage|OpenMP Usage]] · Shared-memory parallelism<br>
[[Magus02/MPI_Usage|MPI Usage]] · Distributed-memory parallelism<br>
[[Magus02/NUMA|NUMA Architecture]] · Memory locality and pinning<br>
[[Magus02/FAQ_Batch_Jobs|FAQ: Batch Jobs]] · Common problems and solutions
</div>
|}

== 🖥️ About Magus02 ==

Magus02 is the primary HPC cluster at Shiv Nadar Institution of Eminence, Delhi NCR, hosted within the Department of Chemical Engineering. It provides researchers, faculty, and students with large-scale parallel computing resources for a wide range of workloads including computational chemistry, fluid dynamics, machine learning, and data analysis.

=== Cluster at a Glance ===

{| class="wikitable" style="width:100%;text-align:center;"
|-
! style="background:#0d1b2a;color:#00c9ff;font-family:monospace;font-size:11px;letter-spacing:1px;" | TOTAL CORES
! style="background:#0d1b2a;color:#00c9ff;font-family:monospace;font-size:11px;letter-spacing:1px;" | PEAK PERFORMANCE
! style="background:#0d1b2a;color:#00c9ff;font-family:monospace;font-size:11px;letter-spacing:1px;" | COMPUTE NODES
! style="background:#0d1b2a;color:#00c9ff;font-family:monospace;font-size:11px;letter-spacing:1px;" | GPU NODES
! style="background:#0d1b2a;color:#00c9ff;font-family:monospace;font-size:11px;letter-spacing:1px;" | TOTAL RAM
! style="background:#0d1b2a;color:#00c9ff;font-family:monospace;font-size:11px;letter-spacing:1px;" | STORAGE
|-
| '''9,064''' || '''238 TFlops''' || '''57''' || '''2 (Tesla A100×4)''' || '''~42 TB''' || '''750 TB'''
|}

{| class="wikitable sortable" style="width:100%;"
|-
! style="background:#0d1b2a;color:#94a8be;" | Node Type
! style="background:#0d1b2a;color:#94a8be;" | Processor
! style="background:#0d1b2a;color:#94a8be;" | RAM / Node
! style="background:#0d1b2a;color:#94a8be;" | Cores / Node
! style="background:#0d1b2a;color:#94a8be;" | GPU
! style="background:#0d1b2a;color:#94a8be;" | Count
! style="background:#0d1b2a;color:#94a8be;" | Total RAM
! style="background:#0d1b2a;color:#94a8be;" | Total Cores
|-
| <span style="background:#0d2535;color:#00c9ff;font-family:monospace;font-size:12px;padding:2px 8px;border-radius:4px;">Compute Node</span>
| <code>AMD EPYC 7763</code> || 512 GB || 128 || — || 57 || 29,184 GB || 7,296
|-
| <span style="background:#2a2000;color:#f0c040;font-family:monospace;font-size:12px;padding:2px 8px;border-radius:4px;">High Memory Node</span>
| <code>AMD EPYC 7543</code> || 1,024 GB || 64 || — || 12 || 12,288 GB || 768
|-
| <span style="background:#0d2a10;color:#39d353;font-family:monospace;font-size:12px;padding:2px 8px;border-radius:4px;">GPU Node</span>
| <code>Intel Xeon Platinum 8368</code> || 512 GB || 64 || Tesla A100 ×4 || 2 || 1,024 GB || 128
|-
| <span style="background:#2a1010;color:#f85149;font-family:monospace;font-size:12px;padding:2px 8px;border-radius:4px;">Storage</span>
| colspan="7" | <code>750 TB</code> Parallel Filesystem
|}

=== Queue Summary ===

{| class="wikitable" style="width:100%;font-size:13px;"
|-
! style="background:#0d1b2a;color:#94a8be;" | Queue
! style="background:#0d1b2a;color:#94a8be;" | Node Type
! style="background:#0d1b2a;color:#94a8be;" | Max Cores/Job
! style="background:#0d1b2a;color:#94a8be;" | Max Nodes
! style="background:#0d1b2a;color:#94a8be;" | Wall Time
! style="background:#0d1b2a;color:#94a8be;" | Use Case
|-
| <span style="background:#0d2535;color:#00c9ff;font-family:monospace;font-size:11px;padding:2px 8px;border-radius:4px;">medium</span> || Compute || 128 || 77 || 1 week || General multi-node jobs
|-
| <span style="background:#0d2a10;color:#39d353;font-family:monospace;font-size:11px;padding:2px 8px;border-radius:4px;">small</span> || Compute || 32 || 16 || 1 month || Testing and small runs
|-
| <span style="background:#2a2000;color:#f0c040;font-family:monospace;font-size:11px;padding:2px 8px;border-radius:4px;">high_mem</span> || High Memory || 256 || 12 || 2 weeks || Gaussian, large in-memory jobs
|-
| <span style="background:#2a1010;color:#f85149;font-family:monospace;font-size:11px;padding:2px 8px;border-radius:4px;">large</span> || Compute || 256 || 24 || 2 weeks || Large parallel production runs
|-
| <span style="background:#1a0a30;color:#b392f0;font-family:monospace;font-size:11px;padding:2px 8px;border-radius:4px;">GPU</span> || GPU || 16 || 4 || 1 week || CUDA/GPU workloads
|-
| <span style="background:#1a1a1a;color:#8b949e;font-family:monospace;font-size:11px;padding:2px 8px;border-radius:4px;">low/long</span> || Compute || 1024 || All || 1 month || Long, low-priority jobs
|}

→ See [[Magus02|Magus02 Cluster Page]] for full queue details, connection instructions, and application list.

== 📚 Documentation Sections ==

=== Basics (New Users) ===

{| style="width:100%;border-collapse:separate;border-spacing:10px;"
|-
| style="background:#0d1b2a;border:1px solid #1e3a5a;border-radius:8px;padding:16px 18px;vertical-align:top;width:33%;" |
<div style="font-size:18px;margin-bottom:8px;">🖥️</div>
<div style="font-weight:700;font-size:14px;margin-bottom:6px;color:#e6edf3;">[[Magus02/Getting_Started|Getting Started]]</div>
<div style="font-size:13px;color:#7a94aa;">Access, login, VPN, first steps on the cluster.</div>
| style="background:#0d1b2a;border:1px solid #1e3a5a;border-radius:8px;padding:16px 18px;vertical-align:top;width:33%;" |
<div style="font-size:18px;margin-bottom:8px;">⌨️</div>
<div style="font-weight:700;font-size:14px;margin-bottom:6px;color:#e6edf3;">[[Magus02/Shell|Linux Shell]]</div>
<div style="font-size:13px;color:#7a94aa;">Essential commands for navigation, files, and utilities.</div>
| style="background:#0d1b2a;border:1px solid #1e3a5a;border-radius:8px;padding:16px 18px;vertical-align:top;width:33%;" |
<div style="font-size:18px;margin-bottom:8px;">🔒</div>
<div style="font-weight:700;font-size:14px;margin-bottom:6px;color:#e6edf3;">[[Magus02/SSH|SSH Access]]</div>
<div style="font-size:13px;color:#7a94aa;">Connecting from Linux, macOS, and Windows.</div>
|-
| style="background:#0d1b2a;border:1px solid #1e3a5a;border-radius:8px;padding:16px 18px;vertical-align:top;" |
<div style="font-size:18px;margin-bottom:8px;">📁</div>
<div style="font-weight:700;font-size:14px;margin-bottom:6px;color:#e6edf3;">[[Magus02/File_Transfer|File Transfer]]</div>
<div style="font-size:13px;color:#7a94aa;">scp, rsync, FTP/SFTP, WinSCP, FileZilla.</div>
| style="background:#0d1b2a;border:1px solid #1e3a5a;border-radius:8px;padding:16px 18px;vertical-align:top;" |
<div style="font-size:18px;margin-bottom:8px;">📦</div>
<div style="font-weight:700;font-size:14px;margin-bottom:6px;color:#e6edf3;">[[Magus02/Modules|Environment Modules]]</div>
<div style="font-size:13px;color:#7a94aa;">Loading compilers, MPI, and scientific software.</div>
| style="background:#0d1b2a;border:1px solid #1e3a5a;border-radius:8px;padding:16px 18px;vertical-align:top;" |
<div style="font-size:18px;margin-bottom:8px;">📋</div>
<div style="font-weight:700;font-size:14px;margin-bottom:6px;color:#e6edf3;">[[Magus02/Scheduling_Basics|Scheduling Basics]]</div>
<div style="font-size:13px;color:#7a94aa;">Batch queues, job lifecycle, and scheduling algorithms.</div>
|}

=== HPC User Guide ===

{| style="width:100%;border-collapse:separate;border-spacing:10px;"
|-
| style="background:#0d1b2a;border:1px solid #1e3a5a;border-radius:8px;padding:16px 18px;vertical-align:top;width:33%;" |
<div style="font-size:18px;margin-bottom:8px;">🔧</div>
<div style="font-weight:700;font-size:14px;margin-bottom:6px;color:#e6edf3;">[[Magus02/Compiler|Compilers]]</div>
<div style="font-size:13px;color:#7a94aa;">GCC, Intel icc/ifort, LLVM/clang, PGI/NVIDIA.</div>
| style="background:#0d1b2a;border:1px solid #1e3a5a;border-radius:8px;padding:16px 18px;vertical-align:top;width:33%;" |
<div style="font-size:18px;margin-bottom:8px;">📤</div>
<div style="font-weight:700;font-size:14px;margin-bottom:6px;color:#e6edf3;">[[Magus02/Batch_Scheduler|Batch Scheduler]]</div>
<div style="font-size:13px;color:#7a94aa;">Job types: serial, OpenMP, MPI, hybrid, array, chain.</div>
| style="background:#0d1b2a;border:1px solid #1e3a5a;border-radius:8px;padding:16px 18px;vertical-align:top;width:33%;" |
<div style="font-size:18px;margin-bottom:8px;">🔀</div>
<div style="font-weight:700;font-size:14px;margin-bottom:6px;color:#e6edf3;">[[Magus02/OpenMP_Usage|OpenMP Usage]]</div>
<div style="font-size:13px;color:#7a94aa;">Compiling and running shared-memory parallel programs.</div>
|-
| style="background:#0d1b2a;border:1px solid #1e3a5a;border-radius:8px;padding:16px 18px;vertical-align:top;" |
<div style="font-size:18px;margin-bottom:8px;">🌐</div>
<div style="font-weight:700;font-size:14px;margin-bottom:6px;color:#e6edf3;">[[Magus02/MPI_Usage|MPI Usage]]</div>
<div style="font-size:13px;color:#7a94aa;">Open MPI and Intel MPI: compile, run, bind.</div>
| style="background:#0d1b2a;border:1px solid #1e3a5a;border-radius:8px;padding:16px 18px;vertical-align:top;" |
<div style="font-size:18px;margin-bottom:8px;">🏗️</div>
<div style="font-weight:700;font-size:14px;margin-bottom:6px;color:#e6edf3;">[[Magus02/NUMA|NUMA Architecture]]</div>
<div style="font-size:13px;color:#7a94aa;">Non-uniform memory access, thread pinning, first-touch.</div>
| style="background:#0d1b2a;border:1px solid #1e3a5a;border-radius:8px;padding:16px 18px;vertical-align:top;" |
<div style="font-size:18px;margin-bottom:8px;">❓</div>
<div style="font-weight:700;font-size:14px;margin-bottom:6px;color:#e6edf3;">[[Magus02/FAQ_Batch_Jobs|FAQ: Batch Jobs]]</div>
<div style="font-size:13px;color:#7a94aa;">Troubleshooting common Slurm job issues.</div>
|}

== 🔗 Resources & Support ==

{| style="width:100%;border-collapse:separate;border-spacing:12px;"
|-
| style="background:#0a1a0a;border:1px solid #1a4020;border-radius:8px;padding:16px 20px;vertical-align:top;width:50%;" |
<div style="font-weight:700;font-size:14px;color:#39d353;margin-bottom:8px;">📞 Getting Help</div>
<div style="font-size:13px;color:#7a94aa;line-height:1.8;">
Contact the HPC Administration Team for access requests, technical issues, and software installation.<br><br>
<strong style="color:#e6edf3;">Email:</strong> <code>hpc-admin@snu.edu.in</code><br>
<strong style="color:#e6edf3;">IT Helpdesk:</strong> Submit a ticket via the SNU IT portal
</div>
| style="background:#0a1520;border:1px solid #1a3050;border-radius:8px;padding:16px 20px;vertical-align:top;width:50%;" |
<div style="font-weight:700;font-size:14px;color:#00c9ff;margin-bottom:8px;">📄 Downloads</div>
<div style="font-size:13px;color:#7a94aa;line-height:1.8;">
[[Media:Linux_Command_Reference.pdf|⬇ Slurm / Linux Command Reference (PDF)]]<br><br>
All major Slurm commands, job submission flags, and useful Linux utilities in a single printable reference sheet.
</div>
|}

<div style="background:#2a1a00;border-left:4px solid #f0c040;border-radius:6px;padding:14px 18px;margin:20px 0;font-size:14px;color:#d4b870;">
⚠️ <strong>External Access Reminder:</strong> Accessing Magus02 from outside the SNU campus network requires a VPN connection. Contact the HPC admin team or scan the QR barcode on your welcome email to request VPN access. See [[Magus02/SSH#External_VPN|SSH — External VPN Access]] for details.
</div>

----
<div style="font-family:monospace;font-size:11px;color:#484f58;text-align:right;margin-top:4px;">
Maintained by HPC Administration · Shiv Nadar Institution of Eminence, Delhi NCR · wiki.snu.edu.in
</div>

Magus02/Knowledge Base - Revision history

Deepak: New Page