Deepak: new

2026-04-20T06:36:03Z

new

New page

{{DISPLAYTITLE:File Transfer — Magus02 HPC}}
<div style="background:#0d1b2a;border:1px solid #1e3a5a;border-radius:8px;padding:12px 18px;margin-bottom:20px;font-size:13px;font-family:monospace;color:#5ba3d9;">
📍 [[Magus02/Knowledge_Base|Magus02 Knowledge Base]] → Basics → File Transfer
</div>

To run jobs on Magus02, your input data and scripts must reside on the cluster's filesystem. This page covers all methods for moving files between your local machine and Magus02.

__TOC__

== Choosing a Transfer Method ==

{| class="wikitable" style="width:100%;"
|-
! Method !! Best For !! Platform
|-
| <code>scp</code> || Quick transfer of one or a few files || Linux / macOS / Windows 10+
|-
| <code>rsync</code> || Syncing large directories efficiently || Linux / macOS
|-
| WinSCP || Graphical file manager for Windows || Windows
|-
| FileZilla || Cross-platform graphical FTP/SFTP client || Windows / macOS / Linux
|}

<div style="background:#0d1a2a;border-left:4px solid #00c9ff;border-radius:6px;padding:14px 18px;margin:16px 0;font-size:14px;color:#94a8be;">
💡 <strong>Note:</strong> <code>scp</code> and <code>rsync</code> build on SSH. Ensure your SSH access is working first (see [[Magus02/SSH|SSH Access]]). If you load modules in your <code>.bashrc</code> that produce output, <code>scp</code> and <code>sftp</code> may fail — see the troubleshooting note below.
</div>

== scp — Secure Copy ==

<code>scp</code> is the simplest method for transferring individual files. It works wherever SSH works.

<pre>
# Upload a local file to your home directory on Magus02:
$ scp myinput.dat your_username@magus02.snu.edu.in:~/

# Upload to a specific remote path:
$ scp myinput.dat your_username@magus02.snu.edu.in:/scratch/myuser/project/

# Download a file from Magus02 to your local machine:
$ scp your_username@magus02.snu.edu.in:~/results/output.log ./

# Upload an entire directory (recursive):
$ scp -r myproject/ your_username@magus02.snu.edu.in:~/
</pre>

=== Troubleshooting scp / sftp failures ===

If <code>scp</code> fails silently or graphical clients like FileZilla show no files, the cause is often '''output generated during login''' (e.g. from <code>module load</code> commands in your <code>.bashrc</code>). Fix it by adding this guard to your <code>~/.bashrc</code>:

<pre>
# Only run interactive-session commands when shell is interactive:
[ -z "$PS1" ] && return
# --- put all your 'module load ...' commands AFTER this line ---
</pre>

== rsync — Directory Synchronisation ==

<code>rsync</code> is more powerful than <code>scp</code>: it only transfers the '''differences''' between source and destination, making it far more efficient for large directories or repeated transfers.

<pre>
# General syntax:
$ rsync [options] [source] [destination]

# Sync a local directory to Magus02 (compressed, verbose, human-readable):
$ rsync -azvh -e ssh myproject/ your_username@magus02.snu.edu.in:/scratch/myuser/project/

# Sync results back from Magus02 to your local machine:
$ rsync -azvh -e ssh your_username@magus02.snu.edu.in:/scratch/myuser/project/results/ ./results/
</pre>

Common options:

{| class="wikitable" style="width:100%;"
|-
! Option !! Effect
|-
| <code>-a</code> || Archive mode: preserves timestamps, permissions, symlinks, and recurses into subdirectories
|-
| <code>-z</code> || Compress data during transfer
|-
| <code>-v</code> || Verbose output — show files being transferred
|-
| <code>-h</code> || Human-readable sizes
|-
| <code>-n</code> || Dry run — show what would be transferred without actually doing it
|-
| <code>--delete</code> || Delete files at the destination that no longer exist at the source
|}

== WinSCP — Graphical Client (Windows) ==

WinSCP provides a drag-and-drop file manager for Windows users.

; Step 1 — Open WinSCP and configure the session:
: Set '''File protocol''' to SFTP, '''Host name''' to <code>magus02.snu.edu.in</code>, '''Port''' to <code>22</code>, and enter your username and password. Click '''Login'''.

; Step 2 — Accept the host key:
: On first connection, click '''Yes''' to trust the host fingerprint.

; Step 3 — Transfer files:
: Your local files appear on the left panel, Magus02 files on the right. Drag and drop, or right-click to upload/download.

Download WinSCP: [https://winscp.net winscp.net]

== FileZilla — Cross-Platform Graphical Client ==

FileZilla works on Windows, macOS, and Linux. Connect using SFTP:

* '''Host:''' <code>sftp://magus02.snu.edu.in</code>
* '''Port:''' <code>22</code>
* Enter your username and password, then click '''Quickconnect'''.

Your local files appear in the left panel; remote cluster files appear in the right panel.

Download FileZilla: [https://filezilla-project.org filezilla-project.org]

== References ==

* [http://www.hypexr.org/linux_scp_help.php SCP usage examples]
* [http://www.createdbypete.com/articles/a-practical-guide-to-using-rsync Basic rsync guide]
* [[Magus02/SSH|SSH Access Guide]]

----
<div style="font-family:monospace;font-size:11px;color:#484f58;text-align:right;">
[[Magus02/Knowledge_Base|↑ Back to Knowledge Base]] · Maintained by HPC Administration · wiki.snu.edu.in
</div>

Magus02/File Transfer - Revision history

Deepak: new