BRC Condo Storage Service for Savio

Berkeley Research Computing (BRC) offers a Condo Storage service for researchers who are Savio Condo Cluster contributors and need additional persistent storage to hold their data sets while using the Savio cluster. Researchers pay a one-time upfront cost for this storage, which is available in 25 TB increments at a cost of $7K each (plus sales tax), with a typical initial purchase of 50 TB for $14K (plus tax). The storage is maintained by BRC for a 5-year period thereafter at no additional cost to the researcher. Please feel free to contact us with your questions about this offering.

Overview

By default, each user on Savio is entitled to a 10 GB home directory which receives regular backups; in addition, each Condo-using research group receives up to 200 GB of project space to hold research specific application software shared among the group's users. All users also have access to the large Savio high performance scratch filesystem for working with non-persistent data.

This Condo Storage service supplements the above offerings. It is intended to provide a cost-effective, persistent storage solution for users or research groups that need to import, work on, and store large data sets to support their use of Savio. The table below compares the cost of various storage alternatives and shows the cost advantage of this service:

Cost comparison for 50 TB over 5 yrs

Model/service Details of cost Total cost Cost/TB/yr
UCB IST Performance tier 50TB x $1680/TB/yr x 5 yrs $420,000 $1680
UCB IST Utility tier 50TB x $600/TB/yr x 5 yrs $150,000 $600
CASS (UCLA)1 50TB x $119.12/TB/yr x 5 yrs $29,780 $119
AWS Glacier2 50TB x $84/TB/yr x 5 yrs $21,000 $84
BRC Condo Storage $14K + CA Sales tax: $7443 $14,744 $59

Program Detail

Similar in concept to the Condo Computing program, BRC provides the storage infrastructure consisting of a Dell Compellent SC8000/FS8600 storage server and covers the cost of supporting the system. Researchers can purchase Compellent storage shelves and have them hosted in the BRC storage infrastructure. This allows researchers to 1) pay a one-time upfront cost for the storage without having to incur ongoing support costs; and 2) pay only for the incremental cost of the storage shelf and disk drives because the cost of the storage servers and disk controllers are covered by BRC.

Storage shelves are purchased and maintained on a 5-year life cycle. At the end of 5 yrs, Condo Storage contributors who wish to continue participating in the program will be offered one of the following options, and possibly both: (1) purchase new storage; or (2) cover the cost of annual vendor hardware maintenance for their existing storage shelves. Which of these options are available will depend on when the contributor’s storage was purchased, and when the BRC Program determines that server hardware for the storage infrastructure must be upgraded.

Hardware

The BRC storage infrastructure consists of a Dell Compellent SC8000/FS8600 enterprise storage server with dual controllers and SC200 storage shelves containing 12x6TB Nearline SAS 7200 RPM disks in a RAID6 configuration. It is connected to the BRC 10GBE firewalled subnet supporting the Savio cluster and is only accessible from outside the Savio cluster via the BRC Data Transfer Node which in turn is connected to the UC Berkeley Science DMZ network. Performance is very good, but users whose computation includes heavy I/O should stage data on the parallel filesystem mounted at /global/scratch, rather than access condo storage directly from Savio's computational nodes. PIs can purchase a fully loaded Compellent SC200 storage shelf for $14K (plus sales tax) that will yield 50TB usable storage. Half shelves yielding 25 TB usable storage are also available for $7K (plus tax).

Backups

Backups are the responsibility of the owner of the storage. Faculty can work with BRC and IST staff to obtain regular backups or to set up regular filesystem snapshots.

Purchasing

Interested faculty and PIs should contact us at brc-hpc-help@berkeley.edu for further information. BRC will assist with entering a storage shelf purchase requisition in increments of 25TB, and initiate the procurement. The entire process from start to production is anticipated to be 6 weeks.

Eligibility

The Condo Storage service is available only to UC Berkeley faculty who are Savio Condo Cluster Service contributors.


1Cloud Archival Storage Service (https://idre.ucla.edu/cass). Included for price comparison only, as CASS would not be performant enough for many Savio use-cases. Purchase w/ federal funds incurs a 26% overhead.

2Based upon current AWS pricing of $.007/GB/mo; does not include data egress charges. Included for price comparison only, as Glacier would not be performant enough for many Savio use-cases.

3Reflects CA Partial Sales Tax Rate Exemption for equipment purchased for research and development in biotechnology, physical, engineering, and life sciences.