2018-06-26 CCS Storage system maintenance, July 3rd – complete

7 am – 12 am Tuesday July 3rd, storage systems for the pegasus compute cluster, apollo, and visx will undergo hardware maintenance.

During this maintenance period, pegasus batch execution and login nodes will be unavailable – as will the gateway (gw.ccs.miami.edu), apollo, and visx systems.

2017-10-05 – Advanced Computing Resources

MEMORANDUM:
Due to financial decisions made at the Miller School of Medicine (MSOM), open access on both Pegasus and Bigfoot will no longer be available to MSOM faculty, staff, and students effective October 31, 2017. 
Read the full contents for details about how this will affect your CCS account.

CCS Data Center Migration – August 3, 2017

CCS resources will be unavailable starting August 3, 2017 at 20:00. All CCS systems and networks will be affected.
Details and updates on the CCS AC website here: http://ccs.miami.edu/ac/migration

2017-02-17 CCS Advanced Computing – Slack community

CCS Advanced Computing invites you to connect with the Advanced Computing community on Slack: http://umadvancedcomputing.slack.com
The Advanced Computing community Slack channels provide a place for user discussions, information sharing, and informal announcements about CCS resources and developments. All users with an @miami.edu or @umiami.edu email address can create a Slack account in UM Advanced Computing.

2017-01-18 CCS Portal – portal.ccs.miami.edu

CCS Advanced Computing is excited to announce the launch of our newly redesigned Portal: https://portal.ccs.miami.edu
The new CCS Portal home page showcases up-to-date information about our clusters. Click the title for more details.

Cloud

The Cloud core is focused on providing a flexible SaaS (Storage as a Service) and PaaS (Platform as a Service) architecture to UM researchers. At over 7 PB, the W.A.D.E. storage cloud is one of the largest data provisioning clouds in academic research.

Three data services (W.A.D.E., SPS, and Vault) are all based on the same hardware. By using fabric segmenting, Advanced Computing is able to provide dynamic storage provisioning across all storage services while still retaining electrical and logical isolation.

A high-speed InfiniBand network connecting storage backed by a state-of-the-art file system supports IO-intensive workloads that can be scaled out across thousands of cpus. This flexible cloud architecture allows UM faculty and students to solve complex problems using applications that require high bandwidth, high-speed data storage and networking, and a high number of cpu cycles.

The Advanced Computing group is continuously working to increase the ability to scale out services in a clustered architecture while balancing the need for the increase in I/O operations, throughput, and capacity.

Current efforts include:

  • use of the latest parallel filesystem software such as SpectrumScale which provides concurrent high-speed file access to applications executing on multiple nodes in the system
  • collection and analysis of filesystem statistics and constant monitoring and tuning of the filesystems in response to workloads
  • use of object storage technology, in which files are organized as objects in a flat directory rather than a traditional tree hierarchy
    This can boost performance for large collections of files since the system no longer needs to navigate a tree like structure to locate data but instead uses indexed data often held entirely in memory.
  • implementation of a tiered storage model in which data can be stored according to how it is accessed
    This allows the data required by running applications which must be accessed with very low latency and high throughput to be stored differently than archival data which is accessed infrequently.
  • deployment of multi-protocol gateways (NFS, CIFS, sftp, Globus) to allow students and faculty convenient access to data