Transferring Files to Pegasus from a remote host

Pegasus supports multiple file transfer programs such as FileZilla and PSFTP, and common command line utilities such as scp and rsync.

Using FileZilla

FileZilla is a free, user friendly, open source, cross-platform FTP, SFTP and FTPS application.

Download the FileZilla client here: https://filezilla-project.org/download.php?show_all=1 and follow the installation instructions for your platform (http://wiki.filezilla-project.org/Client_Installation).

There are issues with the latest OSX and the latest FileZilla.  We have provided compatible distributions below.

FileZilla_3.12.0.2_osx

Launch FileZilla and open File : Site Manager.

Click the “New Site” button and name your entry.

  • Host: pegasus.ccs.miami.edu
  • Protocol: “SFTP”
  • Logon Type: “Normal”
  • enter your username and password

You can also select Logon Type: “Ask for password” for a password prompt each connection.FileZilla Site Manager

Click the “Connect” button. Once connected, you can drag and drop files or directories between your local machine and the server.

Using command line utilities

When executing multiple instantiations of scp or rsync, please limit your transfers to no more than 2-3 processes at a time. Command-line Data Transfer / SSH Data transfer from any Unix/Linux system can be accomplished using the scp utility. A file can be copied from your local system to the remote server using rsync or scp.

scp

An example transfer might look like this:

pegasus$ scp /path/to/filename \
            username@pegasus.ccs.miami.edu:/scratch/username

Consult the man pages for more information on scp.

rsync

The rsync command is another way to keep your data up to date. In contrast to scp, rsync transfers only the actual changed parts of a file (instead of transferring an entire file). Hence, this selective method of data transfer can be much more efficient than scp. The following example demonstrates usage of the rsync command for transferring a file named “firstExample.c” from the current location to Pegasus.

pegasus$ rsync firstExample.c \
            username@pegasus.ccs.miami.edu:/scratch/username

An entire directory can be transferred from source to destination by using rsync as well. For directory transfers, the options -atvr will transfer the files recursively (-r option) along with the modification times (-t option) and in the archive mode (-a option).