HPSS Collaboration

The Ultimate Solution for Your Expanding Universe of Data

WHAT IS HIGH PERFORMANCE STORAGE SYSTEM?

HPSS storage software meets the most challenging long term scalable storage requirements. HPSS features reduce the total cost of ownership of data, maximize transfer performance of all file sizes, lower tape cartridge costs, maximize storage utilization, efficiently manage data integrity, and minimize failure recovery time.

There are well known value propositions for the different types of storage. Solid state disks are the best storage option when bandwidth and I/O per second are the driving requirements. When files are needed immediately and capacity is the driving requirement, power-hungry hard disk drives may be the best option. Tape is the most economical storage for infrequently accessed data at scale, and is often called “zero-watt storage”. Many storage and cloud providers offer different levels of storage, at different price points. Learn how HPSS helps with the long-term stewardship of data at scale.

Enabling Growth and Performance

INCREMENTAL SCALABILITY

Based on storage needs and deployment schedules, HPSS scales incrementally by adding computer, network and storage resources. A single HPSS namespace can scale from petabytes to exabytes of data, from millions to billions of files, and from a few file-creates per second to thousands per second.

AVAILABILITY & DURABILITY

HPSS offers high availability and long-term data protection. Db2 allows for fast failure recovery while autonomous transactions ensure metadata integrity. Software file checksum validation and logical block protection ensure data accuracy while HPSS RAIT offers low-cost data redundancy.

PERFORMANCE & EFFICIENCY

HPSS maximizes performance of hardware for long term storage. A single scalable namespace simplifies management and maximizes the sharing of resources. Moving large files in parallel and collocating related files improves transfer rates. Organizing the order of reads and writes reduces access latencies. Policies and automation allows for transparency.

DELIVERY & SUPPORT

HPSS is delivered and supported as an IBM service offering. IBM delivers a detailed solution architecture, verification of solution components, installation and configuration of HPSS software, and test results to show production readiness.

Who developed HPSS?

HPSS is the result of over three decades of collaboration among five Department of Energy laboratories and IBM, with significant contributions by universities and other laboratories worldwide.

Best of class for tape!

HPSS is considered best of class for tape because of our efficient use of tape hardware and media. That efficiency provided by HPSS means you will need fewer tape drives, and you will enjoy faster data transfers.

Not licensed by capacity!

Since HPSS is delivered and supported as an IBM service offering, the licensing cost is the same regardless of your data amount. Whether you manage 2 petabytes or 2 exabytes, the annual support fee for HPSS will remain the same, even as your hardware footprint and data management needs grows.

MEET WITH HPSS AT THESE INDUSTRY EVENTS

  • HUF 2025

    November 3-7, 2025
    Location: University of California Livermore Collaboration Center (UCLCC)

    We are pleased to announce the High Performance Storage System (HPSS) User Forum (HUF) will be hosted by Lawrence Livermore National Laboratory (LLNL) at the University of California Livermore Collaboration Center (UCLCC) from November 3-7, 2025. This will be an in-person meeting available to HPSS customers only.

    Registration Deadline: September 26, 2025

    Please contact us for more details.

  • HPSS @ SC25

    November 16-21, 2025
    Location: St. Louis, MO

    The 2025 International Conference for High Performance Computing, Networking, Storage and Analysis will be in St. Louis, MO from November 16 through November 21, 2025. Please contact your local IBM client executive or contact us to schedule a HPSS Single Client Briefing to meet with the IBM business and HPSS technical leaders.

WHAT’S NEW?

HPSS 11.2 Release

HPSS 11.2.0 was released on February 13, 2025 and introduces four new features and numerous minor updates.

HPSS Data Capacity and File Count Leaders

December 2024: The European Centre for Medium-Range Weather Forecasts (ECMWF) is the data capacity leader with over 1.2 exabytes of data (1,202 petabytes) in a single instance of HPSS. Lawrence Livermore National Laboratory (LLNL) is the file count leader with almost 3.8 billion files spanning two HPSS instances. One HPSS has over 1.9 billion files and the other HPSS has over 1.8 billion files.

HPSS 11.1 Release

HPSS 11.1.0 was released on August 9, 2024 and introduces seven new features and numerous minor updates.

To an Exabyte and beyond!

On March 14th, 2024, ECMWF reported, “We hit one exabyte stored in a single HPSS namespace”. They added, “Between spring of 2010 and today, we have grown at 47% annually on average; a 53 times magnitude increase…. It is great to know that HPSS has scaled for us from just under 19PB back then to 1EB today!” Cheers to the HPSS team at ECMWF for being the first HPSS deployment to pass this milestone!

HPSS 10.3 Release

HPSS 10.3 was released on September 30th, 2023 and introduces seven new features and numerous minor updates.


IS HPSS RIGHT FOR YOU?

Two of the top three fastest supercomputers on the planet rely on HPSS for long-term storage (top500.org).

WHO LEVERAGES HPSS?