Full HTML for

Basic foilset PetaFlop(JNAC) Overview Presentations -- Results of Studies and Next Steps Sep 19,96

Given by Paul Smith DoE at NSTC Committee Presentation on Sept 19,1996. Foils prepared Sept 19, 1996
Outside Index Summary of Material

This was stand alone presentation of PetaFlop Findings and Recommended Next Steps
Audience was NSTC Committee on Computing Information and Communication
This summarizes results of the series of Petaflop Workshops and Conference Events
It Summarizes the case to move forward with the Federal Program

Table of Contents for full HTML of PetaFlop(JNAC) Overview Presentations -- Results of Studies and Next Steps Sep 19,96

 Denote Foils where Image Critical
Denote Foils where HTML is sufficient
1 NSTC/Committee on Computing, Information & Communication Meeting PetaFLOPS Workshops Results September 19, 1996 Dr. Paul H. Smith Department of Energy
2 Contents
3 I. Workshop series... background: PetaFLOPS workshops.
4 I. Workshop series... background: Community & Sponsoring Agencies
5 I. Workshop series... background: Workshops Purposes
6 Title of foil 6
7 Title of foil 7
8 II. Major Findings & Recommendations: Findings.
9 II. Major Findings & Recommendations: Findings.
10 II. Major Findings & Recommendations: Recommendations
11 II. Major Findings & Recommendations: Recommendations
12 PP Presentation
13 III. Key drivers for advanced computational capabilities beyond HPCC. Why PetaFLOPS??
14 III. Key drivers: The State of the Art
15 III. Key drivers: The Need for PetaFLOPS Computing
16 III. Key drivers: Broad-Scale Applications
17 III. Key drivers: Technological Limitations
18 III. Key drivers: Summary
19 IV. Architecture Point Designs & SW Design Studies: Point Design Study:
20 IV. Architecture Point Designs & SW Design Studies: 1996 Point Design Awards
21 IV. Architecture Point Designs & SW Design Studies: Architectural Framework
22 IV. Architecture Point Designs & SW Design Studies: Key SW Development Areas
23 IV. Architecture Point Designs & SW Design Studies: Software Implementation Strategy
24 V. A National program concept: Basis
25 V. A National program concept: Scope & Strategy
26 V. A National program concept: Technology Projection Model
27 V. A National program concept: Structure & Flow
28 V. A National program concept: Technology Model
29 V. A National program concept: Research Projects - Technology
30 V. A National program concept: Research Projects - Architecture
31 V. A National program concept: Research Projects - System Software
32 V. A National program concept: Research Projects - Applications & Algorithms
33 V. A National focused program concept: Early Program Milestones
34 VI. Future actions necessary to mold an R&D program: The Message
35 VI. Future actions necessary to mold an R&D program: Near Term Recommendation
36 VI. Future actions necessary to mold an R&D program: Next Steps
37 VI. Future actions necessary to mold an R&D program: PetaFLOPS Algorithms Workshop (PAL`97)
38 VI. Future actions : Next Steps Integrate into Federal R&D Planning

Outside Index Summary of Material

HTML version of Basic Foils prepared Sept 19, 1996

Foil 1 NSTC/Committee on Computing, Information & Communication Meeting PetaFLOPS Workshops Results September 19, 1996 Dr. Paul H. Smith Department of Energy

From PetaFlop(JNAC) Overview Presentations -- Results of Studies and Next Steps Sep 19,96 NSTC Committee Presentation -- Sept 19,1996. *
Full HTML Index
HTML version of Basic Foils prepared Sept 19, 1996

Foil 2 Contents

From PetaFlop(JNAC) Overview Presentations -- Results of Studies and Next Steps Sep 19,96 NSTC Committee Presentation -- Sept 19,1996. *
Full HTML Index
I. Workshop series... background.
II. Major findings & recommendations from the PetaFLOPS workshops.
III. Key drivers for advanced computational capabilities beyond HPCC.
IV. PetaFLOPS Architecture Point Designs & SW Design Studies.
V. A National program concept.
VI. Future actions to mold an R&D program.
HTML version of Basic Foils prepared Sept 19, 1996

Foil 3 I. Workshop series... background: PetaFLOPS workshops.

From PetaFlop(JNAC) Overview Presentations -- Results of Studies and Next Steps Sep 19,96 NSTC Committee Presentation -- Sept 19,1996. *
Full HTML Index
PetaFLOPS I
  • January 1994 in Pasadena, CA.
  • 60+ experts.
  • Set tone for subsequent Workshops.
PetaFLOPS Bodega Bay Summer Study
  • August 1995
PetaFLOPS Architecture Workshop, PAWS'96
  • April 1996
PetaSOFT'96
  • June 1996
HTML version of Basic Foils prepared Sept 19, 1996

Foil 4 I. Workshop series... background: Community & Sponsoring Agencies

From PetaFlop(JNAC) Overview Presentations -- Results of Studies and Next Steps Sep 19,96 NSTC Committee Presentation -- Sept 19,1996. *
Full HTML Index
Sponsoring Agencies
NASA
NSF
DOE
DARPA
NSA
BMDO
t
Private
sector
Academic
Federal
National
Laboratories
HTML version of Basic Foils prepared Sept 19, 1996

Foil 5 I. Workshop series... background: Workshops Purposes

From PetaFlop(JNAC) Overview Presentations -- Results of Studies and Next Steps Sep 19,96 NSTC Committee Presentation -- Sept 19,1996. *
Full HTML Index
To identify immediate & future applications.
To provide standard base (PetaFLOPS I) to measure advances in PetaFLOPS R&D.
To identify critical enabling technologies.
To assist technology directors to plan for future programs beyond HPCC.
HTML version of Basic Foils prepared Sept 19, 1996

Foil 6 Title of foil 6

From PetaFlop(JNAC) Overview Presentations -- Results of Studies and Next Steps Sep 19,96 NSTC Committee Presentation -- Sept 19,1996. *
Full HTML Index
I. Workshop series... background: Coordinating Chairs
Dr. Paul H. Smith.....................................................................General
Special Assistant, Advanced Computing Technology
U.S.. Department of Energy
Dr. David Bailey .....................................................................Algorithms
NASA/Ames Research Center
Dr. Ian Foster ...........................................................................Software
Division of Mathematics and Computer Science
Argonne National Laboratory
Prof.. Geoffrey Fox ............................................................................................Architecture
Departments of Physics & Computer Science
Prof.. Peter Kogge ...................................................................Architecture
McCourtney Professor of Computer Science & Engineering
University of Notre Dame
HTML version of Basic Foils prepared Sept 19, 1996

Foil 7 Title of foil 7

From PetaFlop(JNAC) Overview Presentations -- Results of Studies and Next Steps Sep 19,96 NSTC Committee Presentation -- Sept 19,1996. *
Full HTML Index
I. Workshop series... background: Coordinating Chairs
Prof.. Sidney Karin .......................................................................General
Director for Advanced Computational Science & Engineering
University of California, San Diego
Dr Paul Messina ...........................................................................PetaFLOPS-I
Director, Center for Advanced Computing
California Institute of Technology
Dr. Thomas Sterling .....................................................................Architecture
Senior Scientist
Jet Propulsion Laboratory
Dr. Rick Stevens ..........................................................................Applications
Director, Mathematics & Computer Science Division
Argonne National Laboratory
Dr. John Van Rosendale ..............................................................Point Design
Division of Advanced Scientific Computing
National Science Foundation
HTML version of Basic Foils prepared Sept 19, 1996

Foil 8 II. Major Findings & Recommendations: Findings.

From PetaFlop(JNAC) Overview Presentations -- Results of Studies and Next Steps Sep 19,96 NSTC Committee Presentation -- Sept 19,1996. *
Full HTML Index
PetaFLOPS possible; accelerate goals to 10 years.
Many important application drivers exist.
Memory dominant implementation factor.
Cost, power & efficiency dominate.
Innovation critical, new technology necessary.
Layered SW architecture mandatory.
Opportunities for immediate SW effort.
HTML version of Basic Foils prepared Sept 19, 1996

Foil 9 II. Major Findings & Recommendations: Findings.

From PetaFlop(JNAC) Overview Presentations -- Results of Studies and Next Steps Sep 19,96 NSTC Committee Presentation -- Sept 19,1996. *
Full HTML Index
New technology means paradigm shift.
  • Superconductivity technology is example.
Memory bandwidth.
Latency.
Software important.
Closer relationship between architecture and programming is needed.
Role of algorithms must improve.
HTML version of Basic Foils prepared Sept 19, 1996

Foil 10 II. Major Findings & Recommendations: Recommendations

From PetaFlop(JNAC) Overview Presentations -- Results of Studies and Next Steps Sep 19,96 NSTC Committee Presentation -- Sept 19,1996. *
Full HTML Index
Conduct point design studies.
  • in hardware and software.
  • of promising architecture
Develop engineering prototypes.
  • Multiple technology track demonstrations
Start SW now, independent of HW.
Develop layered software architecture for scalability and code reuse
Explore algorithms for special purpose & reconfigurable structures.
HTML version of Basic Foils prepared Sept 19, 1996

Foil 11 II. Major Findings & Recommendations: Recommendations

From PetaFlop(JNAC) Overview Presentations -- Results of Studies and Next Steps Sep 19,96 NSTC Committee Presentation -- Sept 19,1996. *
Full HTML Index
Support & accelerate R&D in paradigm shift technologies:
  • Superconductor RSFQ
  • Holographic photo-refractive storage
  • Optical guided and free-space interconnect
  • New semiconductor materials.
Perform detailed applications studies at scale.
Develop petaFLOPS scale latency management.
HTML version of Basic Foils prepared Sept 19, 1996

Foil 12 PP Presentation

From PetaFlop(JNAC) Overview Presentations -- Results of Studies and Next Steps Sep 19,96 NSTC Committee Presentation -- Sept 19,1996. *
Full HTML Index
Nation's experts participated:
  • Academia
  • Private Sector
  • Federal Government
Strong need for computing at the high end.
PetaFLOPS levels of performance are feasible.
Preliminary set of goals for the next decade formulated with a PetaFLOPS system as the end product.
II. Major Findings & Recommendations:
Workshops Summaries.
HTML version of Basic Foils prepared Sept 19, 1996

Foil 13 III. Key drivers for advanced computational capabilities beyond HPCC. Why PetaFLOPS??

From PetaFlop(JNAC) Overview Presentations -- Results of Studies and Next Steps Sep 19,96 NSTC Committee Presentation -- Sept 19,1996. *
Full HTML Index
There are compelling applications that need that level of performance.
PetaFLOPS levels of performance are feasible, but substantial research is needed.
Private sector is not going to do it alone.
HTML version of Basic Foils prepared Sept 19, 1996

Foil 14 III. Key drivers: The State of the Art

From PetaFlop(JNAC) Overview Presentations -- Results of Studies and Next Steps Sep 19,96 NSTC Committee Presentation -- Sept 19,1996. *
Full HTML Index
TeraFLOPS machine architecture in hand.
Programming still is explicit message passing.
TeraFLOPS applications are coarse grain
Latency management not showstopper for TeraFLOPS.
Operating systems and tools provide relatively little support for the users
Parallelism has to be managed explicitly
HTML version of Basic Foils prepared Sept 19, 1996

Foil 15 III. Key drivers: The Need for PetaFLOPS Computing

From PetaFlop(JNAC) Overview Presentations -- Results of Studies and Next Steps Sep 19,96 NSTC Committee Presentation -- Sept 19,1996. *
Full HTML Index
Applications that require petaFLOPS can already be identified
  • (DOE) Nuclear weapons stewardship
  • (NSA) Cryptology and digital signal processing
  • (NASA and NSF) Satellite data assimilation and climate modeling
The need for ever greater computing power will remain.
PetaFLOPS systems are right step for the next decade
HTML version of Basic Foils prepared Sept 19, 1996

Foil 16 III. Key drivers: Broad-Scale Applications

From PetaFlop(JNAC) Overview Presentations -- Results of Studies and Next Steps Sep 19,96 NSTC Committee Presentation -- Sept 19,1996. *
Full HTML Index
Realistic 3-D Heart Models
Genome comparisons
Drug Design
Real-time image compensation.
Real-time atmospheric turbulence compensation.
New materials
Modeling US/World economy.
HTML version of Basic Foils prepared Sept 19, 1996

Foil 17 III. Key drivers: Technological Limitations

From PetaFlop(JNAC) Overview Presentations -- Results of Studies and Next Steps Sep 19,96 NSTC Committee Presentation -- Sept 19,1996. *
Full HTML Index
Semiconductor component technology
  • feature size, other issues will finally put us in a regime in which Moore's law no longer holds
Architecture
  • levels of parallelism must be used
  • memory hierarchy due to increased processor speeds
System software
  • latency management
  • efficient handling of
    • millions of concurrent threads
    • thousands of I/O devices
HTML version of Basic Foils prepared Sept 19, 1996

Foil 18 III. Key drivers: Summary

From PetaFlop(JNAC) Overview Presentations -- Results of Studies and Next Steps Sep 19,96 NSTC Committee Presentation -- Sept 19,1996. *
Full HTML Index
There are compelling applications
New architectures need to be investigated
Component technologies need to developed
Major advances are needed in system software and tools
Industry is less likely than ever to push limits.
HTML version of Basic Foils prepared Sept 19, 1996

Foil 19 IV. Architecture Point Designs & SW Design Studies: Point Design Study:

From PetaFlop(JNAC) Overview Presentations -- Results of Studies and Next Steps Sep 19,96 NSTC Committee Presentation -- Sept 19,1996. *
Full HTML Index
Sponsored by NSF, DARPA and NASA
Eight awards made of $100,000 each
6 month study of architecture /
SW environment / algorithms
HTML version of Basic Foils prepared Sept 19, 1996

Foil 20 IV. Architecture Point Designs & SW Design Studies: 1996 Point Design Awards

From PetaFlop(JNAC) Overview Presentations -- Results of Studies and Next Steps Sep 19,96 NSTC Committee Presentation -- Sept 19,1996. *
Full HTML Index
Reconfigurable OO architecture
Processor in memory architecture
Algorithmic focus
Hierarchical design
Aggressive cache only architecture
Architecture for N-body problems
Single quantum flux superconducting design
Optical interconnect
HTML version of Basic Foils prepared Sept 19, 1996

Foil 21 IV. Architecture Point Designs & SW Design Studies: Architectural Framework

From PetaFlop(JNAC) Overview Presentations -- Results of Studies and Next Steps Sep 19,96 NSTC Committee Presentation -- Sept 19,1996. *
Full HTML Index
PetaFLOPS Applications which are grouped into sets with an interface to their own
Problem Solving Environments
Application Level or Virtual Problem Interface ADI
Operating System Services
Multi Resolution Virtual Machine Interfaces joining at lowest levels with
Machine Specific Software
Hardware Systems
HTML version of Basic Foils prepared Sept 19, 1996

Foil 22 IV. Architecture Point Designs & SW Design Studies: Key SW Development Areas

From PetaFlop(JNAC) Overview Presentations -- Results of Studies and Next Steps Sep 19,96 NSTC Committee Presentation -- Sept 19,1996. *
Full HTML Index
The mission critical applications
Development of shared problem solving environments with rich set of application targeted libraries and resources
Development of common systems software
Programming environments from compilers to multi-level runtime support at the machine independent ADI's
Machine specific software including lowest level of data movement/manipulation
HTML version of Basic Foils prepared Sept 19, 1996

Foil 23 IV. Architecture Point Designs & SW Design Studies: Software Implementation Strategy

From PetaFlop(JNAC) Overview Presentations -- Results of Studies and Next Steps Sep 19,96 NSTC Committee Presentation -- Sept 19,1996. *
Full HTML Index
Start now on initial studies to explore the possible system architectures.
These "PetaFLOPS software point studies" should be interdisciplinary involving hardware, systems software and applications expertise.
HTML version of Basic Foils prepared Sept 19, 1996

Foil 24 V. A National program concept: Basis

From PetaFlop(JNAC) Overview Presentations -- Results of Studies and Next Steps Sep 19,96 NSTC Committee Presentation -- Sept 19,1996. *
Full HTML Index
Key, focused R&D must be explicitly funded
Program is mostly D augmented with increases in R in HW/SW.
Advanced systems designed and prototyped by the program.
D will need strong central management.
Applications tightly coupled with coordinated SW development groups.
HTML version of Basic Foils prepared Sept 19, 1996

Foil 25 V. A National program concept: Scope & Strategy

From PetaFlop(JNAC) Overview Presentations -- Results of Studies and Next Steps Sep 19,96 NSTC Committee Presentation -- Sept 19,1996. *
Full HTML Index
Target dozens of applications (not 100's)
100's of programmers not thousands
Deploy PF class systems < 10 years
Starting in FY98
Multiple technology options
New technologies and architectures
Balance vendor vs direct development
Open RFP for future systems
HTML version of Basic Foils prepared Sept 19, 1996

Foil 26 V. A National program concept: Technology Projection Model

From PetaFlop(JNAC) Overview Presentations -- Results of Studies and Next Steps Sep 19,96 NSTC Committee Presentation -- Sept 19,1996. *
Full HTML Index
Three "tracks" for illustration (might be more or less)
  • current trends (SIA roadmap)
  • new architecture w/commercial process tech.
  • new arch and new process tech.
Deploy systems continuously
Span generations with software model
Pull with RFPs
Push with technology investments
HTML version of Basic Foils prepared Sept 19, 1996

Foil 27 V. A National program concept: Structure & Flow

From PetaFlop(JNAC) Overview Presentations -- Results of Studies and Next Steps Sep 19,96 NSTC Committee Presentation -- Sept 19,1996. *
Full HTML Index
HTML version of Basic Foils prepared Sept 19, 1996

Foil 28 V. A National program concept: Technology Model

From PetaFlop(JNAC) Overview Presentations -- Results of Studies and Next Steps Sep 19,96 NSTC Committee Presentation -- Sept 19,1996. *
Full HTML Index
HTML version of Basic Foils prepared Sept 19, 1996

Foil 29 V. A National program concept: Research Projects - Technology

From PetaFlop(JNAC) Overview Presentations -- Results of Studies and Next Steps Sep 19,96 NSTC Committee Presentation -- Sept 19,1996. *
Full HTML Index
Chip Interface:
  • Fabrication Technology
  • Laser & CMOS chip integration
Optical Networks:
  • Pbps bandwidths
  • 1000 ports
Superconducting Memories:
  • 100 billion accesses/sec.
Holographic Memories
HTML version of Basic Foils prepared Sept 19, 1996

Foil 30 V. A National program concept: Research Projects - Architecture

From PetaFlop(JNAC) Overview Presentations -- Results of Studies and Next Steps Sep 19,96 NSTC Committee Presentation -- Sept 19,1996. *
Full HTML Index
Natural Evolution Systems:
  • Likely path of COTS technology.
Special Purpose Architecture:
  • Driven by Specific algorithms
  • Develop proof of concept.
Hybrid Technology Architecture Development:
  • Exploit advanced technologies.
  • Integrate advanced technologies into system.
HTML version of Basic Foils prepared Sept 19, 1996

Foil 31 V. A National program concept: Research Projects - System Software

From PetaFlop(JNAC) Overview Presentations -- Results of Studies and Next Steps Sep 19,96 NSTC Committee Presentation -- Sept 19,1996. *
Full HTML Index
PetaFLOPS Languages:
  • Develop consistent set of languages
  • Develop programming interfaces.
  • Support multiple architecture projects
Operating Systems:
  • Highly scalable.
  • Massive concurrency
  • High bandwidth & virtual memory.
Runtime Systems
HTML version of Basic Foils prepared Sept 19, 1996

Foil 32 V. A National program concept: Research Projects - Applications & Algorithms

From PetaFlop(JNAC) Overview Presentations -- Results of Studies and Next Steps Sep 19,96 NSTC Committee Presentation -- Sept 19,1996. *
Full HTML Index
Algorithms to reduce latency associated with
petaFLOPS scale:
memory hierarchies &
processor ensembles.
Driver Applications:
  • Important to national objectives
  • Includes scaling up to petaFLOPS
  • Supports multiple architecture projects
HTML version of Basic Foils prepared Sept 19, 1996

Foil 33 V. A National focused program concept: Early Program Milestones

From PetaFlop(JNAC) Overview Presentations -- Results of Studies and Next Steps Sep 19,96 NSTC Committee Presentation -- Sept 19,1996. *
Full HTML Index
SW level interface definitions
Projection of performance requirements to lower levels (performance based design)
Applications analysis wrt specific programming models (machines)
Experimental testbeds simulated/modeled on existing MPP
HTML version of Basic Foils prepared Sept 19, 1996

Foil 34 VI. Future actions necessary to mold an R&D program: The Message

From PetaFlop(JNAC) Overview Presentations -- Results of Studies and Next Steps Sep 19,96 NSTC Committee Presentation -- Sept 19,1996. *
Full HTML Index
Need to invest in computing at the high end.
PetaFLOPS level of performance are feasible.
Private sector is not going to do it alone.
HTML version of Basic Foils prepared Sept 19, 1996

Foil 35 VI. Future actions necessary to mold an R&D program: Near Term Recommendation

From PetaFlop(JNAC) Overview Presentations -- Results of Studies and Next Steps Sep 19,96 NSTC Committee Presentation -- Sept 19,1996. *
Full HTML Index
Conduct detailed PetaFLOPS architecture design & simulation studies.
Initiate early software development of layered architecture.
Develop PetaFLOPS scale latency management
Accelerate R&D in advanced technologies.
Invent algorithms for special purpose and reconfigurable structures.
HTML version of Basic Foils prepared Sept 19, 1996

Foil 36 VI. Future actions necessary to mold an R&D program: Next Steps

From PetaFlop(JNAC) Overview Presentations -- Results of Studies and Next Steps Sep 19,96 NSTC Committee Presentation -- Sept 19,1996. *
Full HTML Index
The PetaFLOPS Frontier (Oct.. 96)
  • Open community, international
PetaFLOPS Algorithms Workshop (Apr.. 97)
PetaFLOPS II Conference (Sep.. 97)
  • Algorithm driven Architecture
  • Based on Point Designs against components
  • Applications drivers/scenarios
  • Leap Technology elements
Engage community in establishing challenges, directions, topics for research
HTML version of Basic Foils prepared Sept 19, 1996

Foil 37 VI. Future actions necessary to mold an R&D program: PetaFLOPS Algorithms Workshop (PAL`97)

From PetaFlop(JNAC) Overview Presentations -- Results of Studies and Next Steps Sep 19,96 NSTC Committee Presentation -- Sept 19,1996. *
Full HTML Index
Location: Williamsburg Hospitality House, Williamsburg, VA; April 20-25, 1997
Chair; David Bailey, NASA Ames
Objectives:
  • Identify novel algorithmic approaches that may be better suited to future PetaFLOPS systems.
  • Present quantitative analysis of PetaFLOPS algorithms
  • Plan future PetaFLOPS algorithm research activities.
  • Present and analyze new PetaFLOPS architecture designs.
HTML version of Basic Foils prepared Sept 19, 1996

Foil 38 VI. Future actions : Next Steps Integrate into Federal R&D Planning

From PetaFlop(JNAC) Overview Presentations -- Results of Studies and Next Steps Sep 19,96 NSTC Committee Presentation -- Sept 19,1996. *
Full HTML Index
Coordinate with High End Computing & Computation (HECC) Working Group.
Develop Technical Approach --NOW
Strategy for developing National Initiative.
Multi-agency efforts.
Federal agencies plan for FY'98 budget submission
Northeast Parallel Architectures Center, Syracuse University, npac@npac.syr.edu

If you have any comments about this server, send e-mail to webmaster@npac.syr.edu.

Page produced by wwwfoil on Sun Apr 11 1999