HiPerGator 2.0

Download the HiPerGator 2.0 specification sheet.

HiPerGator 1.0 has:

  • 16,000 cores
  • 64 TeraByte of RAM
  • 2 PetaByte of disk storage
  • Maximum speed of 157 Teraflops = 157 trillion floating point operations

The HiPerGator 2.0 expansion adds:

  • 30,000 cores
  • 120 TeraByte of RAM
  • 1 PetaByte of disk storage
  • Maximum speed of 1,100 Teraflops – 1,100 trillion floating point operations

To put these numbers in context, consider the following comparisons:

  • The 1,100 Teraflops speed of HiPerGator 2.0 is the same as the combined speed of 600 PlayStation 4 and 840 Xbox One gaming stations, if they could be made to work together effectively and efficiently on large data and complex problems.
  • The human brain is estimated to have the power equivalent to 20 Petaflops.
  • The 120 TeraByte of RAM memory, not the 1 PetaByte of long-term disk storage, of HiPerGator 2.0 can hold 240 million books.

Nodes and processors

The expansion of HiPerGator consists of 30,000 cores of the latest Intel E5-2698 v3 (16 core, 2.3 GHz, 135 W) processors with 4 GB RAM per core in approximately 1,000 nodes made by Dell. The diskless nodes have 128 GB of 2133 MHz DDR4 RAM. The total amount of RAM in HiPerGator 2.0 is 120 TeraBytes.

Network

  • The nodes are connected by Mellanox 56Gbit/s FDR InfiniBand interconnect for fast data access to storage and for distributed memory parallel processing. The core switches use the 100 Gbit/s EDR InfiniBand standard.
  • There is a 10 Gbit/s Ethernet for management and for providing the operating system to the diskless nodes.
  • There is a separate 10 Gbit/s Ethernet network connecting the nodes to support the planned new services of running virtual machines and virtual cluster on HiPerGator.

Storage

The storage of all user data is on a fast parallel and highly redundant storage infrastructure that can sustain high input output rates from the many thousands of processors in HiPerGator making simultaneous requests. The parallel file system is Intel Enterprise Edition Lustre 2.5 and has a total capacity of 3 PetaBytes.