User Interfaces

HPSS Storage Broker is used to store, protect, and error correct project datasets across a wide variety of archive storage including public and private S3 object stores, file systems, and HPSS. The HPSS Storage Broker was made generally available in 3Q 2021.

SwiftOnHPSS for OpenStack Swift is an S3 interface for HPSS that supports automatic class of service (COS) selection, automatic HPSS end-to-end data integrity support with OpenStack Swift md5 object checksums, and shared access of Swift objects by other HPSS interfaces.

Intended for HPC use, HPSS can be coupled with IBM Storage Scale (built upon GPFS) to automatically:

• Copy files from Storage Scale to HPSS
• Purge Storage Scale files that are not being used when space thresholds are reached
• Recall files from HPSS when accessed by Storage Scale users
• Save a point-in-time snapshot of Storage Scale.

HPSS for Storage Scale allows multiple Storage Scale file systems to be managed by a single HPSS.

Linux applications benefit from a near-POSIX standard read-write file system interface. This interface enables HPSS to be mounted as a Linux file system in user space (Fuse). Customers are using HPSSFS Fuse with Open SSL (encrypted file transfer solution), MinIO (S3 object storage solution), OpenStack (object storage solution), SaMBa (Microsoft Windows file sharing), NFS (POSIX file sharing), DSpace (restful open digital repository solution), and Bacula (site backup solutions).

The high-performance file transfer protocol (FTP) interface moves files in and out of HPSS at high data rates. Standard FTP and the HPSS high-performance Parallel FTP commands are both supported. Download the HPSS Admin Guide from our HPSS Documentation page for details of these FTP commands.

The Hierarchical Storage Interface (HSI) provides a familiar UNIX shell-style interface for managing and transferring files. HPSS parallel file transfers are done automatically. HTAR is a utility for storing groups of files using the POSIX TAR specification and a high-performance multithreaded buffering scheme to transfer files directly to and from HPSS. Download the HSI/HTAR Installation Guide and the HSI Reference Manual from our HPSS Documentation page for more information.