HPSS Collaboration

The Ultimate Solution for Your Expanding Universe of Data

WHAT IS HIGH PERFORMANCE STORAGE SYSTEM?

HPSS storage software meets the most challenging long term scalable storage requirements. HPSS features reduce the total cost of ownership of data, maximize transfer performance of all file sizes, lower tape cartridge costs, maximize storage utilization, efficiently manage data integrity, and minimize failure recovery time.

There are well known value propositions for the different types of storage. Solid state disks are the best storage option when bandwidth and I/O per second are the driving requirements. When files are needed immediately and capacity is the driving requirement, power-hungry hard disk drives may be the best option. Tape is the most economical storage for infrequently accessed data at scale, and is often called “zero-watt storage”. Many storage and cloud providers offer different levels of storage, at different price points. Learn how HPSS helps with the long-term stewardship of data at scale.

Enabling Growth and Performance

INCREMENTAL SCALABILITY

Based on storage needs and deployment schedules, HPSS scales incrementally by adding computer, network and storage resources. A single HPSS namespace can scale from petabytes to exabytes of data, from millions to billions of files, and from a few file-creates per second to thousands per second.

AVAILABILITY & DURABILITY

HPSS offers high availability and long-term data protection. Db2 allows for fast failure recovery while autonomous transactions ensure metadata integrity. Software file checksum validation and logical block protection ensure data accuracy while HPSS RAIT offers low-cost data redundancy.

PERFORMANCE & EFFICIENCY

HPSS maximizes performance of hardware for long term storage. A single scalable namespace simplifies management and maximizes the sharing of resources. Moving large files in parallel and collocating related files improves transfer rates. Organizing the order of reads and writes reduces access latencies. Policies and automation allows for transparency.

DELIVERY & SUPPORT

HPSS is delivered and supported as an IBM service offering. IBM delivers a detailed solution architecture, verification of solution components, installation and configuration of HPSS software, and test results to show production readiness. The annual support fee for 20 petabytes or 2 exabytes is the same.

Who developed HPSS?

HPSS is the result of over three decades of collaboration among five Department of Energy laboratories and IBM, with significant contributions by universities and other laboratories worldwide.

Best of breed for tape!

HPSS is considered best of breed for tape because of our efficient use of tape hardware and media. Tape hardware and media efficiency translates to fewer tape drives to meet requirements, faster transfers, and happier users.

Not licensed by capacity!

HPSS is delivered and supported as an IBM service offering, so 2 PB or 200 PB disk and tape tiers are licensed the same. This keeps the annual support fee for HPSS relatively flat from year-to-year as your hardware footprint grows.

MEET WITH HPSS AT THESE INDUSTRY EVENTS

  • HPSS @ STS 2025

    June 8-10, 2025
    Location: Rosen Centre Hotel in Orlando, Florida

    The 6th Annual Storage Technology Showcase is in the planning phase now, but HPSS expects to support the event. Check out their web site!

  • HPSS @ ISC 2025

    June 10-13, 2025
    Location: Hamburg, Germany

    ISC 2025 is the event for high performance computing, machine learning, and data analytics, and will be in Hamburg, Germany at the Congress Center Hamburg, from June 10th through June 13th, 2025. Please contact us to meet with the IBM business and technical leaders of HPSS.

  • 2025 HUF

    TBD, September 2025
    Location: Customer’s Site

    The 2025 HPSS User Forum (HUF) will be an in-person event should be scheduled sometime in September of 2025, at a customer-location. This will be a great opportunity to present your site report, hear from other HPSS sites, talk with HPSS collaboration developers, testers, support folks and the HPSS leadership (from IBM and DOE Labs). Please contact us if you are not a customer but would like to attend!

  • HPSS @ SC25

    November 16-21, 2025
    Location: St. Louis, MO

    The 2025 International Conference for High Performance Computing, Networking, Storage and Analysis will be in St. Louis, MO from November 16 through November 21, 2025. Please contact your local IBM client executive or contact us to schedule a HPSS Single Client Briefing to meet with the IBM business and HPSS technical leaders.

WHAT’S NEW?

HPSS Data Capacity and File Count Leaders

December 2024: The European Centre for Medium-Range Weather Forecasts (ECMWF) is the data capacity leader with over 1.2 exabytes of data (1,202 petabytes) in a single instance of HPSS. Lawrence Livermore National Laboratory (LLNL) is the file count leader with almost 3.8 billion files spanning two HPSS instances. One HPSS has over 1.9 billion files and the other HPSS has over 1.8 billion files.

HPSS 11.1 Release

HPSS 11.1.0 was released on August 9, 2024 and introduces seven new features and numerous minor updates.

To an Exabyte and beyond!

On March 14th, 2024, ECMWF reported, “We hit one exabyte stored in a single HPSS namespace”. They added, “Between spring of 2010 and today, we have grown at 47% annually on average; a 53 times magnitude increase…. It is great to know that HPSS has scaled for us from just under 19PB back then to 1EB today!” Cheers to the HPSS team at ECMWF for being the first HPSS deployment to pass this milestone!

HPSS 10.3 Release

HPSS 10.3 was released on September 30th, 2023 and introduces seven new features and numerous minor updates.

HPSS 10.2 Release

HPSS 10.2 was released on February 16th, 2023 and introduces six new features and numerous minor updates.


IS HPSS RIGHT FOR YOU?

The three fastest supercomputers on the planet rely on HPSS for long-term storage (top500.org).

WHO LEVERAGES HPSS?