Difference between revisions of "Magus02"
Widgets
Widgets<bs-widget-edit>
(21 intermediate revisions by 3 users not shown) | |||
Line 1: | Line 1: | ||
− | ===What is HPC ?=== | + | ====What is HPC ?==== |
<div style="font-size: 0.875em;">High performance computing (HPC) is the ability to process data and perform complex calculations at high speeds. To put it into perspective, a laptop or desktop with a 3 GHz processor can perform around 3 billion calculations per second. While that is much faster than any human can achieve, it pales in comparison to HPC solutions that can perform quadrillions of calculations per second.</div> | <div style="font-size: 0.875em;">High performance computing (HPC) is the ability to process data and perform complex calculations at high speeds. To put it into perspective, a laptop or desktop with a 3 GHz processor can perform around 3 billion calculations per second. While that is much faster than any human can achieve, it pales in comparison to HPC solutions that can perform quadrillions of calculations per second.</div> | ||
HPC is specifically needed for these reasons: | HPC is specifically needed for these reasons: | ||
Line 8: | Line 8: | ||
− | ''' | + | '''Specification:''' |
− | Total Cores = 8064 (AMD) | + | * Total Cores = 8064 (AMD) |
+ | * 238 Tflops | ||
+ | * 57 Compute Nodes | ||
+ | * 2 Login Nodes | ||
+ | * 2 Master Nodes | ||
+ | * 12 High memory nodes with local SSD | ||
+ | * Better performance of applications, which require high performance storage but do not scale well across nodes. E.g. Gaussian. | ||
− | Memory | + | '''Memory''' |
+ | * 4 GB Per core for Compute Nodes, with a total memory = 29,184 GB | ||
+ | * 16 GB Per core for High Memory Nodes, with total memory = 12,288 GB | ||
− | |||
− | + | ===='''Compute Specification:'''==== | |
− | + | {| class=" sortable contenttable wikitable" style="height: 141px;" width="1026" | |
− | {| style="height: | + | |
|- | |- | ||
− | | | + | || |
− | + | '''COMPUTE NODES''' | |
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | || | |
+ | '''PROCESSOR''' | ||
− | + | || | |
+ | '''RAM''' | ||
+ | || | ||
+ | '''CORE''' | ||
− | + | || | |
+ | '''GPU''' | ||
− | + | || | |
+ | '''NO OF NODES''' | ||
+ | || | ||
+ | '''TOTAL RAM''' | ||
+ | || | ||
+ | '''TOTAL CORES''' | ||
+ | |- | ||
+ | ||Compute Node | ||
+ | ||AMD EPYC 7763 | ||
+ | ||512 GB | ||
+ | ||128 | ||
+ | ||- | ||
+ | ||57 | ||
+ | ||29184GB | ||
+ | ||7296 | ||
+ | |- | ||
+ | ||High Memory Node | ||
+ | ||AMD EPYC 7543 | ||
+ | ||1024GB | ||
+ | ||64 | ||
+ | ||- | ||
+ | ||12 | ||
+ | ||12228GB | ||
+ | ||768 | ||
+ | |- | ||
+ | ||GPU | ||
+ | ||INTEL XEON PLATINUM 8358 | ||
+ | ||512GB | ||
+ | ||64 | ||
+ | ||Tesla A100*4 | ||
+ | ||2 | ||
+ | ||1024GB | ||
+ | ||128 | ||
+ | |- | ||
+ | ||Total | ||
+ | || | ||
+ | || | ||
+ | || | ||
+ | || | ||
+ | || | ||
+ | ||42436 | ||
+ | ||8192 | ||
+ | |- | ||
+ | ||Storage | ||
+ | ||750TB PFS | ||
+ | || | ||
+ | || | ||
+ | || | ||
+ | || | ||
+ | || | ||
+ | || | ||
+ | |} | ||
− | ==='''How to connect to Snu HPC ?'''=== | + | ===='''How to connect to Snu HPC ?'''==== |
<span style="color: #000000;"> Enumerated here are the various types.</span> | <span style="color: #000000;"> Enumerated here are the various types.</span> | ||
Line 52: | Line 106: | ||
− | '''How to Reset Password on | + | ===='''How to Reset Password on Magus02 ?'''==== |
− | + | ||
<span style="color: #000000;"><span class="ui-provider hb b c d e f g h i j k l m n o p q r s t u v w x y z ab ac ae af ag ah ai aj ak" dir="ltr"> Step1.<span style="color: #000000;"> Login to <span style="color: #0000ff;">magus02</span> account.</span></span></span> | <span style="color: #000000;"><span class="ui-provider hb b c d e f g h i j k l m n o p q r s t u v w x y z ab ac ae af ag ah ai aj ak" dir="ltr"> Step1.<span style="color: #000000;"> Login to <span style="color: #0000ff;">magus02</span> account.</span></span></span> | ||
Line 95: | Line 148: | ||
<span style="color: #0000ff;">[[File:MicrosoftTeams-image_(13).png|left|frame|link=|703x420px]]</span> | <span style="color: #0000ff;">[[File:MicrosoftTeams-image_(13).png|left|frame|link=|703x420px]]</span> | ||
+ | |||
+ | |||
Line 131: | Line 186: | ||
==='''How to Connect to Magus from outside SNU Network ?'''=== | ==='''How to Connect to Magus from outside SNU Network ?'''=== | ||
− | To access MEGUS from outside the SNU network, | + | To gain access to MEGUS from outside the SNU network, a VPN connection is mandatory. To acquire VPN access, kindly click on the [https://forms.office.com/Pages/ResponsePage.aspx?id=12YS_ftig0aFL0FyYUAqLN3tPd66H1xCnswYz1fby35UMkhBR0lMSlJLUlZGT0wwTzJTOUtLNEpZVy4u VPN Request Form] or utilize the option of accessing it by scanning the barcode provided below. |
− | ==='''How to Transfers data using WinSCP Windows (Client).'''=== | + | |
+ | |||
+ | |||
+ | |||
+ | ===='''How to Transfers data using WinSCP Windows (Client).'''==== | ||
Step1 : Open the WinSCP and fill all the details, After that click on the <span style="color: #3366ff;">Login</span> Button. | Step1 : Open the WinSCP and fill all the details, After that click on the <span style="color: #3366ff;">Login</span> Button. | ||
[[File:MicrosoftTeams-image.png|left|frame|link=|782x440px]] | [[File:MicrosoftTeams-image.png|left|frame|link=|782x440px]] | ||
+ | |||
+ | |||
+ | |||
+ | |||
+ | |||
+ | |||
Line 173: | Line 238: | ||
Step 2 : Click <span style="color: #3366ff;">Yes</span> on Warning tab. | Step 2 : Click <span style="color: #3366ff;">Yes</span> on Warning tab. | ||
+ | |||
Line 249: | Line 315: | ||
| width="147"| | | width="147"| | ||
− | + | serial_test | |
| width="110"| | | width="110"| | ||
Line 295: | Line 361: | ||
512 | 512 | ||
− | | width="111"| | + | | width="111"| 2 |
|- | |- | ||
| width="60"| | | width="60"| | ||
Line 411: | Line 477: | ||
32 | 32 | ||
− | | width="111"| | + | | width="111"|2 |
|- | |- | ||
| width="60"| | | width="60"| | ||
Line 469: | Line 535: | ||
1024 | 1024 | ||
− | | width="111"| | + | | width="111"|8 |
|- | |- | ||
| width="60"|'''9''' | | width="60"|'''9''' | ||
Line 483: | Line 549: | ||
|} | |} | ||
====='''[[Slurm Command Reference:]]'''===== | ====='''[[Slurm Command Reference:]]'''===== | ||
+ | '''[[Media:Linux_Command_Reference.pdf|Linux_Command_Reference.pdf]]''' |
Latest revision as of 16:47, 13 December 2023
Contents
What is HPC ?
HPC is specifically needed for these reasons:
- It paves the way for new innovations in science, technology, business and academia.
- It improves processing speeds, which can be critical for many kinds of computing operations, applications and workloads.
- It helps lay the foundation for a reliable, fast IT infrastructure that can store, process and analyze massive amounts of data for various applications.
Specification:
- Total Cores = 8064 (AMD)
- 238 Tflops
- 57 Compute Nodes
- 2 Login Nodes
- 2 Master Nodes
- 12 High memory nodes with local SSD
- Better performance of applications, which require high performance storage but do not scale well across nodes. E.g. Gaussian.
Memory
- 4 GB Per core for Compute Nodes, with a total memory = 29,184 GB
- 16 GB Per core for High Memory Nodes, with total memory = 12,288 GB
Compute Specification:
COMPUTE NODES |
PROCESSOR |
RAM |
CORE |
GPU |
NO OF NODES |
TOTAL RAM |
TOTAL CORES |
Compute Node | AMD EPYC 7763 | 512 GB | 128 | - | 57 | 29184GB | 7296 |
High Memory Node | AMD EPYC 7543 | 1024GB | 64 | - | 12 | 12228GB | 768 |
GPU | INTEL XEON PLATINUM 8358 | 512GB | 64 | Tesla A100*4 | 2 | 1024GB | 128 |
Total | 42436 | 8192 | |||||
Storage | 750TB PFS |
How to connect to Snu HPC ?
Enumerated here are the various types.
- SSH : Host magus02.snu.edu.in ( default port 22 )
- From Linux Machine : $ssh [email protected]
- From Windows Machine using putty.
How to Reset Password on Magus02 ?
Step1. Login to magus02 account.
Step2: Use Passwd Command.
How to Connect to Magus from outside SNU Network ?
To gain access to MEGUS from outside the SNU network, a VPN connection is mandatory. To acquire VPN access, kindly click on the VPN Request Form or utilize the option of accessing it by scanning the barcode provided below.
How to Transfers data using WinSCP Windows (Client).
Step1 : Open the WinSCP and fill all the details, After that click on the Login Button.
Step 2 : Click Yes on Warning tab.
Step 3: Connected, Now you can transfer the data using Right click of key Panel.
Applications on Megus
Vasp, Quantum espresso, BigDFT, Gaussian, Siesta, Gromacs, OpenFOAM.
Queue Structure on Magus02.
S.No. | Processor Architecture | Priority | Queue Name | Min no of Cores Required to submit job | Max no of cores allowed per job | No of nodes in the queue | Wall Time | MAX Cores User can Use in the Queue | Max No. of Pending Jobs Per user |
1 |
AMD EPYC 7763 |
50 |
serial_test |
1 |
1 |
1 |
1 hour |
Unlimited |
Unlimited |
2 |
AMD EPYC 7763 |
50 |
Medium |
32 |
128 |
16 |
1 week |
512 |
2 |
3 |
AMD EPYC 7543 |
50 |
Small |
8 |
32 |
16 |
1 week |
256 |
2 |
4 |
AMD EPYC 7543 |
50 |
High_mem |
32 |
256 |
10 |
2 weeks |
512 |
2 |
5 |
AMD EPYC 7763 |
50 |
Large |
64 |
256 |
25 |
2 weeks |
1024 |
2 |
6 |
AMD EPYC 7763 |
50 |
Large_io |
8 |
32 |
2 |
1 week |
32 |
2 |
7 |
Intel Xeon Platinum 8358 |
50 |
GPU |
16 |
16 |
2 |
1 week |
32 |
1 |
8 |
AMD EPYC 7763 |
Low |
Long |
32 |
1024 |
All lm nodes |
1 Month |
1024 |
8 |
9 | AMD EPYC 7763 | Low | Serial_long | 1 | 1 | 1 | 1 week | Unlimited | Unlimited |