Evaluating ScaleMP virtual shared memory architecture for use in HPC

Abstract

ScaleMP has provided vSMP Foundation, a new technology for large shared memory systems which could change how some mid-tier scientific computing applications are supported. vSMP aggregates multiple x86 servers into a single high-end large memory system and operating system, representing an alternative to traditional SMP or NUMA architectures that often require expensive and specialized hardware to accomplish a similar task. 

 

This project looks to evaluate the vSMP system on FutureGrid's new "echo" computational resource.  We will evaluate vSMP first based on traditional HPC benchmarks usually run on distributed memory systems such as MPI-enabled clusters. Next, we will look at benchmarks such as SPEC OpenMP and PRASEC to evaluate the system's overall scalability related to multi-threaded applications. This work will also look to support novel bioinformatics applications on the new large scale shared memory system, including de-novo genome assembly and new graph algorithms. 

 

 

 

Intellectual Merit

This work will provide an unbiased evaluation of the ScaleMP's vSMP foundation for use in supporting mid-tier scientific computing. We expect this technology to be especially useful to users who need to scale their application quickly and are unable to completely re-write their code. Furthermore, this work could significantly enhance many big-data applications by allowing scientists to move databases on traditional tertiary storage to 5.6TB of system memory, which could effectively speed up computation by many orders of magnitude.

Broader Impact

This evaluation of the ScaleMP vSMP foundation could advise future large-scale cyberinfrastructure that aim to support shared memory systems. Furthemore, this work could help guide resarchers on how to best use the new shared memory architecture with minimal effort.

Use of FutureGrid

This will use the ECHO system with ScaleMP's vSMP foundation.

Scale Of Use

We will scale up to all 16 ndoes of Echo, and may require the bare-metal distributed memory installation on Echo to have a comparative base-case.

Publications


FG-407
Andrew Younge
Indiana University
Active

Project Members

Chaitanya Gogineni
Scott McCaulay

FutureGrid Experts

Andrew Younge