Find this at
http://www.npac.syr.edu/users/gcf/cps615intro96/
CPS615-Introduction-Course,Driving Technology and HPCC Current Status and Futures
Given by Geoffrey C. Fox at CPS615 Basic Simulation Track for Computational Science on Fall Semester 96. Foils prepared 27 August 1996
|
Overview of Course Itself! -- and then introductory material on basic curricula
|
|
Overview of National Program -- The Grand Challenges
|
|
Overview of Technology Trends leading to petaflop performance in year 2007 (hopefully)
|
|
Overview of Syracuse and National programs in computational science
|
|
Parallel Computing in Society
|
|
Why Parallel Computing works
|
Simple Overview of Computer Architectures
-
SIMD MIMD Distributed (shared memory) Systems ... PIM ... Quantum Computing
|
|
General Discussion of Message Passing and Data Parallel Programming Paradigms and a comparison of languages
|
This mixed presentation uses parts of the following base foilsets which can also
be looked at on their own!
CPS615Master96 Master Set of Foils for 1996 Session of
CPS615
CPS615-95B Master Set B of Overview Material on
Parallel Computing for CPS615 Foils
CornellHPCCOverview96MasterMaster Foils for A Short Overview of HPCC
-- From GigaFlops to PetaFlops and From
Tightly Coupled MPP's to the World Wide
Web
CPS615-95A Master Set A of Overview Material on
Parallel Computing for CPS615 Foils
CPS615-Master95-1 Master Material for Initial CPS615 Course
and Parallel Computing Overview
HPCS95master Master Foilset for HPCS95 Keynote
Presentation
InfoMall95 Overview of InfoMall -- A Virtual
Corporation for HPCC Systems and Software
Leskiw-ChinaJune95-1 Overview foils of Status of HPCC with NPAC
Bias
CompSciMay95 Overview foils for Computational Science
Overview at Illinois -- May 1995
Programming Paradigms A Part A:Overview of Programming Paradigms
and Relation to Applications
Leskiw-ChinaJune95-3 Overview foils of Status of HPCC with NPAC
Bias -3- Auxiliary(Tall) Foils
HPFApplicationsB An Applications Perspective on High
Performance Fortran
CRPCAnnualMeetingMay96 General Collection of Foils for CRPC Annual
Meeting
MillsScreenDumps Kim Mills Collection of GIF Images for NPAC
Projects 96-
Ida2 Dual Issues and a discussion of HPCC
Defense Applications
CPS 615 Lectures 1996 Fall Semester -- Introduction
Start new Section:Overall Structure of Course
- Personnel Grading and Topics
CPS615Master96 001 001 CPS615 -- Base Course for the
Simulation Track of Computational
Science
Fall Semester 1996 --
Introduction to Driving Technology
and HPCC
Current Status and Futures
CPS615Master96 002 002 Abstract of The Current Status and
Futures of HPCC
CPS615Master96 003 003 Basic Course CPS615 Contact Points
CPS615Master96 004 004 Course Organization
CPS615Master96 005 005 Basic Structure of Complete CPS615
Base Course on Computational
Science Simulation Track -- I
CPS615Master96 006 006 Basic Structure of Complete CPS615
Base Course on Computational
Science Simulation Track -- II
CPS615Master96 007 007 Basic Structure of Complete CPS615
Base Course on Computational
Science Simulation Track -- III
Performance Reality/Dreams
CPS615-95B 074 008 Performance of High End Machines
Years 1940-2000
CPS615-95B 075 009 Performance of High End Machines
Years 1980-2000
CornellHPCCOverview96Master 018 010 Peak Supercomputer Performance
Start new Section:Technology Driving Forces
- What does device physics and semiconductor industry say?
- Note CMOS will dominate for next 10-20 years
- Maybe superconducting technology will be interesting at end of this era
CPS615-95A 003 011 The Technology
Driving Forces for HPCC
CPS615-95A 004 012 Effect of Feature Size on
Performance
CPS615-95A 005 013 Growing Logic Chip Density
CPS615-95A 006 014 Trends in Feature and Die Size as
a Function of Time
CPS615-95A 007 015 Supercomputer Memory Sizes and
trends in RAM Density
CPS615-95A 008 016 Comparison of Trends in RAM
Density and CPU Performance
Increases
CPS615Master96 008 017 Three Major Markets --
Logic,ASIC,DRAM
CPS615Master96 009 018 Chip and Package Characteristics
CPS615Master96 010 019 Fabrication Characteristics
CPS615Master96 011 020 Electrical Design and Test Metrics
CPS615-95A 009 021 National Roadmap for Semiconductor
Technology --1992
Start new Section: Overview of HPCC Nationally
- National Program and Driving Applications
CPS615-Master95-1 007 022 Status of Parallel Computing and
High Speed Networks --
The Grand Challenges and the
National Information
Infrastructure
Start new Subsection:General Overview of Parallel Computing Technology
HPCS95master 003 023 Superficial Observations on High
Performance Computing-I
InfoMall95 006 024 We have learnt that Parallel
Computing Works !
InfoMall95 004 025 Advances in Parallel Computer and
High Speed Network (HPCC)
Technology
HPCS95master 004 026 Superficial Observations on High
Performance Computing-II
InfoMall95 007 027 When will Parallel Computing Take
Over ?
InfoMall95 008 028 Some Hardware/Software Trends over
next 5 years
Leskiw-ChinaJune95-1 019 029 Who Uses High Performance
Computers?
Start new Subsection:Federal HPCC Initiative 1992-1996
- From Grand Challenges to the NII(National Information Infrastructure)
CPS615-Master95-1 010 030 The Federal High Performance
Computing and Communication
Initiative 1992--1996
InfoMall95 009 031 The Federal High Performance
Computing and Communication
Initiative (HPCCI)
Leskiw-ChinaJune95-1 028 032 The High Performance Computing and
Communications Initiative
Leskiw-ChinaJune95-1 029 033 HPCCI Goals
Start new Subsection:Note the Trend to the NII
- And Importance of Communication and its integration with computing
CPS615-Master95-1 011 034 Note the Trend from Large Scale
Numerical Computing to the
Integration of Computing and
Communication in the NII
Leskiw-ChinaJune95-1 030 035 The Blue Books
Supplements to the President's
Fiscal Year Budget
Leskiw-ChinaJune95-1 031 036 http://www.hpcc.gov/
Leskiw-ChinaJune95-1 032 037 The Blue Book Covers
HPCS95master 005 038 Superficial Observations on High
Performance Communication
HPCS95master 006 039 Some Implications of HPCC
Observations
Start new Section:What is Computational Science?
- Nationally and at Syracuse
CPS615-95A 011 040 What and Why is Computational
Science ?
CPS615-95A 012 041 Parallelism Implies Major Changes
which have significant educational
Implications
CompSciMay95 003 042 What is Computational Science?
CompSciMay95 004 043 What do we have at Syracuse
University?
CompSciMay95 005 044 Program in Computational Science
Implemented within current
academic framework
Leskiw-ChinaJune95-1 021 045 Methodology for Computation
CompSciMay95 008 046 Usefulness of Computational
Science Degrees:
CompSciMay95 009 047 Syracuse Computational Science
Academic Programs -- Masters
Degree
CompSciMay95 011 048 Syracuse Graduate Computational
Science Academic Programs
CompSciMay95 013 049 Computational Science Courses --
Typical CPS615 Module
CompSciMay95 015 050 Computational Science Courses --
CPS713
CompSciMay95 024 051 Some Academic Areas and their
Relation to Computational Science
CompSciMay95 028 052 Program in Information Age
Computational Science Implemented
Within Current Academic Program
Elementary Discussion of Parallel Computing
- Including Analogies with Society
CPS615-95A 026 053 Parallel Processing and Society
CPS615-95A 027 054 Concurrent Construction of a Wall
Using N = 8 Bricklayers
Decomposition by Vertical Sections
CPS615-95A 028 055 Quantitative Speed-Up Analysis for
Construction of Hadrian's Wall
CPS615-95A 029 056 Amdahl's law for Real World
Parallel Processing
CPS615-95A 030 057 Pipelining --Another Parallel
Processing Strategy for Hadrian's
Wall
CPS615-95A 031 058 Hadrian's Wall Illustrates that
the Topology of Processor Must
Include Topology of Problem
CPS615-95A 032 059 General Speed Up Analysis
CPS615-95A 038 060 Nature's Concurrent Computers
CPS615-95A 039 061 Comparison of Concurrent
Processing in Society and
Computing
Start new Section:The Fundamental Reasons Why Parallel Computing is Easy
- In Principle
- Most Problems are naturally parallel and most can be naturally broken up
- Into parts for execution on separate Processors
- This is however fraught with technical difficulties
Programming Paradigms A 011 062 Data Parallelism is a Universal
Source of Scaling Parallelism
Programming Paradigms A 012 063 We have learnt that Parallel
Computing Works !
Programming Paradigms A 013 064 Methodology of Parallel Computing
Programming Paradigms A 014 065 Concurrent Computation as a
Mapping Problem -I
Programming Paradigms A 015 066 Concurrent Computation as a
Mapping Problem - II
Programming Paradigms A 016 067 Concurrent Computation as a
Mapping Problem - III
CPS615-95A 023 068 Finite Element Mesh From Nastran
(mesh only shown in upper half)
CPS615-95A 024 069 A Simple Equal Area Decomposition
CPS615-95A 025 070 Decomposition After Annealing
(one particularly good but
nonoptimal decomposition)
More Complex Problem Issues in the Society Analogy
CPS615-95A 033 071 Comparison of The Complete Problem
to the subproblems formed in
domain decomposition
CPS615-95A 034 072 Hadrian's Wall Illustrating an
Irregular but Homogeneous Problem
CPS615-95A 035 073 Some Problems are Inhomogeneous
Illustrated by:
An Inhomogeneous Hadrian Wall with
Decoration
CPS615-95A 036 074 Global and Local Parallelism
Illustrated by Hadrian's Wall
CPS615-95A 037 075 Parallel I/O Illustrated by
Concurrent Brick Delivery for
Hadrian's Wall
Bandwidth of Trucks and Roads
Matches that of Masons
A Brief Discussion of Computer Architectures
- Enough to motivate Introductory Technologies
- Start with ncube2 Pictures
CPS615-95A 016 076 Single nCUBE2 CPU Chip
CPS615-95A 017 077 64 Node nCUBE Board
CPS615Master96 012 078 Technologies for High Performance
Computers
CPS615Master96 013 079 Architectures for High Performance
Computers - I
CPS615Master96 014 080 Architectures for High Performance
Computers - II
CPS615Master96 015 081 There is no Best Machine!
CPS615Master96 016 082 Quantum Computing - I
CPS615Master96 017 083 Quantum Computing - II
CPS615Master96 018 084 Quantum Computing - III
CPS615Master96 019 085 Superconducting Technology -- Past
CPS615Master96 020 086 Superconducting Technology --
Present
CPS615Master96 021 087 Superconducting Technology --
Problems
CPS615Master96 022 088 Architecture Classes of High
Performance Computers
CPS615Master96 023 089 von Neuman Architecture in a
Nutshell
CPS615Master96 024 090 Illustration of Importance of
Cache
CPS615Master96 025 091 Vector Supercomputers in a
Nutshell - I
CPS615Master96 026 092 Vector Supercomputing in a picture
CPS615Master96 027 093 Vector Supercomputers in a
Nutshell - II
CPS615-95A 042 094 Instruction Flow in A Simple
Machine Pipeline
CPS615Master96 028 095 Flynn's Classification of HPC
Systems
CPS615Master96 029 096 Parallel Computer Architecture
Memory Structure
CPS615Master96 030 097 Comparison of Memory Access
Strategies
CPS615Master96 031 098 Types of Parallel Memory
Architectures -- Physical
Characteristics
CPS615Master96 032 099 Diagrams of Shared and Distributed
Memories
CPS615Master96 033 100 Parallel Computer Architecture
Control Structure
CPS615Master96 034 101 Some Major Hardware Architectures
- MIMD
CPS615Master96 035 102 MIMD Distributed Memory
Architecture
CPS615Master96 036 103 Some Major Hardware Architectures
- SIMD
CPS615Master96 037 104 SIMD (Single Instruction Multiple
Data) Architecture
CPS615Master96 038 105 Some Major Hardware Architectures
- Mixed
CPS615Master96 039 106 Some MetaComputer Systems
CPS615Master96 040 107 Comments on Special Purpose
Devices
CPS615Master96 041 108 The GRAPE N-Body Machine
CPS615Master96 042 109 Why isn't GRAPE a Perfect
Solution?
CPS615Master96 043 110 Granularity of Parallel Components
- I
CPS615Master96 044 111 Granularity of Parallel Components
- II
CPS615Master96 045 112 Classes of Communication Networks
CPS615Master96 046 113 Switch and Bus based Architectures
CPS615Master96 047 114 Examples of Interconnection
Topologies
CPS615Master96 048 115 Useful Concepts in Communication
Systems
CPS615Master96 049 116 Communication Performance of Some
MPP's
CPS615Master96 050 117 Implication of Hardware
Performance
CPS615-95B 021 118 Latency and Bandwidth of a Network
CPS615-95B 022 119 Transfer Time in Microseconds for
both Shared Memory Operations and
Explicit Message Passing
CPS615-95B 023 120 Latency/Bandwidth Space for 0-byte
message(Latency) and 1 MB
message(bandwidth).
Start new Subsection:The Federal 1996 Program in Detail
- with special attention to Grand Challenges which are best documented successes
CPS615-Master95-1 012 121 The Federal Program Focusing on
1996 Highlights with many exciting
Applications
Leskiw-ChinaJune95-3 004 122 1996 Blue Book
Leskiw-ChinaJune95-3 005 123 1996 Blue Book (1 of 3)
Leskiw-ChinaJune95-3 006 124 1996 Blue Book (2 of 3)
Leskiw-ChinaJune95-3 007 125 1996 Blue Book (3 of 3)
Start new Section:The Many Grand Challenges
- which are large scale simulations
- With emerging National Challenges
Grand Challenges
CPS615-Master95-1 013 126 The Application Motivation for
HPCC
Leskiw-ChinaJune95-1 050 127 High Performance Computing
Research Facilities
Leskiw-ChinaJune95-1 052 128 Grand Challenge Applications
Leskiw-ChinaJune95-1 053 129 Applied Fluid Dynamics
Leskiw-ChinaJune95-1 055 130 Coupled Field Problems and GAFD
Turbulence
Leskiw-ChinaJune95-1 057 131 Numerical Tokamak Project
Leskiw-ChinaJune95-1 058 132 Meso- to Macro-Scale Environmental
Modeling
Leskiw-ChinaJune95-1 059 133 Mathematical Modeling of Air
Pollution Dynamics
Leskiw-ChinaJune95-1 062 134 Global Climate Modeling
Leskiw-ChinaJune95-1 063 135 4-D Data Assimilation
Leskiw-ChinaJune95-1 064 136 Eco Simulations
Leskiw-ChinaJune95-1 069 137 Biomedical Imaging and
Biomechanics
Leskiw-ChinaJune95-1 072 138 Molecular Biology
Leskiw-ChinaJune95-1 073 139 Molecular Design
Leskiw-ChinaJune95-1 075 140 Biomolecular Modeling and
Structure Determination
Leskiw-ChinaJune95-1 080 141 Fundamental Computational Sciences
Black Hole Grand Challenge
HPFApplicationsB 011 142 Binary Black Holes Simulation
CRPCAnnualMeetingMay96 032 143 The Binary Black Hole Grand
Challenge Alliance
HPFApplicationsB 012 144 BBH: Computational Challenge
CRPCAnnualMeetingMay96 033 145 Adaptive Multilevel Parallel
Infrastructure
Back to Grand Challenges
Leskiw-ChinaJune95-1 081 146 First Principal Simulation of
Materials Properties
Leskiw-ChinaJune95-1 083 147 Large Scale Structure and Galaxy
Formation
Leskiw-ChinaJune95-1 084 148 Grand-Challenge-Scale Applications
MillsScreenDumps 030 149 Visible Human
Leskiw-ChinaJune95-1 087 150 A Realistic Ocean Model
Leskiw-ChinaJune95-1 090 151 Shoemaker-Levy 9 Collision with
Jupiter
Leskiw-ChinaJune95-1 093 152 Advanced Simulation of Crash
Simulation
Leskiw-ChinaJune95-1 096 153 National Challenge Applications
Industry Survey
HPCS95master 009 154 A Survey of New York State
Industrial Opportunities for HPCC
was very influential for me and my
group(NPAC)
InfoMall95 025 155 Categories of Industrial and
Government Applications of HPCC
(with reference to academic
applications)
HPCS95master 010 156 The 33 Application areas were
studied in detail:
Simulation (Roughly the Grand
Challenges)
HPCS95master 011 157 The 33 Application areas were
studied in detail:
Information Analysis -- DataMining
HPCS95master 012 158 The 33 Application areas were
studied in detail:
InfoVision: Information, Video,
Imagery and Simulation on Demand
HPCS95master 013 159 The 33 Application areas were
studied in detail:
Information Integration combining
Simulation, Analysis and
InfoVision
Summary of HPCC in Industry?
HPCS95master 014 160 Some detailed Analysis of
Opportunities for HPCC in the
Science and Engineering Simulation
Arena
Ida2 006 161 Opportunities for HPCC in the
Science and Engineering Simulation
Arena
Ida2 007 162 Some Simulation Areas which will
be Difficult to exploit in near
term
Ida2 008 163 Suprisingly Difficult and
Suprisingly Promising Areas for
HPCC in Simulation
Ida2 009 164 Why is it hard to use HPCC in
Manufacturing-I?
Ida2 010 165 Why is it hard to use HPCC in
Manufacturing-II?
Ida2 011 166 Multidisciplinary Analysis and
Design as a Critical use of HPCC
in Manufacturing?
Ida2 012 167 Role of Government and DoD in HPCC
Simulation Applications
Ida2 013 168 The HPCC Software Industry is not
Viable in Simulation Area ?
Ida2 014 169 Anecdotes from HPCC Software
Industry Arena
Ida2 015 170 National Challenges will drive the
adoption of HPCC in the
"Real World"
And now we must look at National Challenges
HPCS95master 015 171 From the Grand(Simulation)
Challenges to the National
(information) Challenges
InfoMall95 014 172 Characteristics of Grand
Challenges
Ida2 019 173 Federal 1994 Blue Book Comparison
of National and Grand Challenges
CPS615-Master95-1 014 174 Come to CPS616 for a detailed
discussion of the National
Challenges and the National
Information Infrastructure
List of Foils Used as they occur
CPS615Master96 Master Set of Foils for 1996 Session of
CPS615
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50
CPS615-95B Master Set B of Overview Material on
Parallel Computing for CPS615 Foils
74 75 21 22 23
CornellHPCCOverview96MasterMaster Foils for A Short Overview of HPCC
-- From GigaFlops to PetaFlops and From
Tightly Coupled MPP's to the World Wide
Web
18
CPS615-95A Master Set A of Overview Material on
Parallel Computing for CPS615 Foils
3 4 5 6 7 8 9 11 12 26 27 28 29 30 31 32 38 39 23 24 25 33 34 35 36 37 16 17 42
CPS615-Master95-1 Master Material for Initial CPS615 Course
and Parallel Computing Overview
7 10 11 12 13 14
HPCS95master Master Foilset for HPCS95 Keynote
Presentation
3 4 5 6 9 10 11 12 13 14 15
InfoMall95 Overview of InfoMall -- A Virtual
Corporation for HPCC Systems and Software
6 4 7 8 9 25 14
Leskiw-ChinaJune95-1 Overview foils of Status of HPCC with NPAC
Bias
19 28 29 30 31 32 21 50 52 53 55 57 58 59 62 63 64 69 72 73 75 80 81 83 84 87 90 93 96
CompSciMay95 Overview foils for Computational Science
Overview at Illinois -- May 1995
3 4 5 8 9 11 13 15 24 28
Programming Paradigms A Part A:Overview of Programming Paradigms
and Relation to Applications
11 12 13 14 15 16
Leskiw-ChinaJune95-3 Overview foils of Status of HPCC with NPAC
Bias -3- Auxiliary(Tall) Foils
4 5 6 7
HPFApplicationsB An Applications Perspective on High
Performance Fortran
11 12
CRPCAnnualMeetingMay96 General Collection of Foils for CRPC Annual
Meeting
32 33
MillsScreenDumps Kim Mills Collection of GIF Images for NPAC
Projects 96-
30
Ida2 Dual Issues and a discussion of HPCC
Defense Applications
6 7 8 9 10 11 12 13 14 15 19
Sorted List of Foils Used
CPS615Master96 Master Set of Foils for 1996 Session of
CPS615
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50
CPS615-95B Master Set B of Overview Material on
Parallel Computing for CPS615 Foils
21 22 23 74 75
CornellHPCCOverview96MasterMaster Foils for A Short Overview of HPCC
-- From GigaFlops to PetaFlops and From
Tightly Coupled MPP's to the World Wide
Web
18
CPS615-95A Master Set A of Overview Material on
Parallel Computing for CPS615 Foils
3 4 5 6 7 8 9 11 12 16 17 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 42
CPS615-Master95-1 Master Material for Initial CPS615 Course
and Parallel Computing Overview
7 10 11 12 13 14
HPCS95master Master Foilset for HPCS95 Keynote
Presentation
3 4 5 6 9 10 11 12 13 14 15
InfoMall95 Overview of InfoMall -- A Virtual
Corporation for HPCC Systems and Software
4 6 7 8 9 14 25
Leskiw-ChinaJune95-1 Overview foils of Status of HPCC with NPAC
Bias
19 21 28 29 30 31 32 50 52 53 55 57 58 59 62 63 64 69 72 73 75 80 81 83 84 87 90 93 96
CompSciMay95 Overview foils for Computational Science
Overview at Illinois -- May 1995
3 4 5 8 9 11 13 15 24 28
Programming Paradigms A Part A:Overview of Programming Paradigms
and Relation to Applications
11 12 13 14 15 16
Leskiw-ChinaJune95-3 Overview foils of Status of HPCC with NPAC
Bias -3- Auxiliary(Tall) Foils
4 5 6 7
HPFApplicationsB An Applications Perspective on High
Performance Fortran
11 12
CRPCAnnualMeetingMay96 General Collection of Foils for CRPC Annual
Meeting
32 33
MillsScreenDumps Kim Mills Collection of GIF Images for NPAC
Projects 96-
30
Ida2 Dual Issues and a discussion of HPCC
Defense Applications
6 7 8 9 10 11 12 13 14 15 19
© Northeast Parallel Architectures Center, Syracuse University, npac@npac.syr.edu
If you have any comments about this server, send e-mail to webmaster@npac.syr.edu.
Page produced by wwwfoil on Wed Aug 27 1997