2019-09-06 CCS services restored

As of 12:00 P.M. All CCS storage and systems are operational again.  Thank you for your patience.

2019-04-10 Projects filesystem expansion complete

The expansion and maintenance of the /projects2 filesystem has been completed, and all access has been restored.

CCS AC
hpc@ccs.miami.edu

2019-02-05 CG Campus network upgrades complete

CCS network upgrades have completed and access has been restored.

CCS AC
hpc@ccs.miami.edu

2018-10-13 Network maintenance complete

CCS network maintenance has completed and access has been restored.

CCS AC
hpc@ccs.miami.edu

2018-09-21 File system access restored

/scratch and /projects file system access has been restored.

CCS AC
hpc@ccs.miami.edu

Cloud

The Cloud core is focused on providing a flexible SaaS (Storage as a Service) and PaaS (Platform as a Service) architecture to UM researchers. At over 7 PB, the W.A.D.E. storage cloud is one of the largest data provisioning clouds in academic research.

Three data services (W.A.D.E., SPS, and Vault) are all based on the same hardware. By using fabric segmenting, Advanced Computing is able to provide dynamic storage provisioning across all storage services while still retaining electrical and logical isolation.

A high-speed InfiniBand network connecting storage backed by a state-of-the-art file system supports IO-intensive workloads that can be scaled out across thousands of cpus. This flexible cloud architecture allows UM faculty and students to solve complex problems using applications that require high bandwidth, high-speed data storage and networking, and a high number of cpu cycles.

The Advanced Computing group is continuously working to increase the ability to scale out services in a clustered architecture while balancing the need for the increase in I/O operations, throughput, and capacity.

Current efforts include:

  • use of the latest parallel filesystem software such as SpectrumScale which provides concurrent high-speed file access to applications executing on multiple nodes in the system
  • collection and analysis of filesystem statistics and constant monitoring and tuning of the filesystems in response to workloads
  • use of object storage technology, in which files are organized as objects in a flat directory rather than a traditional tree hierarchy
    This can boost performance for large collections of files since the system no longer needs to navigate a tree like structure to locate data but instead uses indexed data often held entirely in memory.
  • implementation of a tiered storage model in which data can be stored according to how it is accessed
    This allows the data required by running applications which must be accessed with very low latency and high throughput to be stored differently than archival data which is accessed infrequently.
  • deployment of multi-protocol gateways (NFS, CIFS, sftp, Globus) to allow students and faculty convenient access to data