Given by Geoffrey C. Fox at CPSP713 Master for Overview on Autumn Semester 1994. Foils prepared 15 March 1996
Abstract * Foil Index for this file
These foils contain the overview of the three areas: |
I) Statistical Physics and Optimization |
II) Computational Fluid Dynamics and Numerical Relativity i.e. the solution of partial differential equations |
III) Some Technologies and Applications of the Information Age |
This was meant to be enough Information to allow student to choose which area to do project in -- as project had to be chosen after this overview but before any detailed discussions of any of the areas |
This table of Contents Abstract
Geoffrey Fox |
NPAC |
Syracuse University |
Syracuse NY 13244-4100 |
These foils contain the overview of the three areas: |
I) Statistical Physics and Optimization |
II) Computational Fluid Dynamics and Numerical Relativity i.e. the solution of partial differential equations |
III) Some Technologies and Applications of the Information Age |
This was meant to be enough Information to allow student to choose which area to do project in -- as project had to be chosen after this overview but before any detailed discussions of any of the areas |
Instructor: Geoffrey Fox 4432163 |
No Grader -- Course graded by projects. One project per student to be decided by September 12 when we can discuss options in class. Initially we will discuss topics to be covered in enough detail so that students will be able to choose a project synergistic with course content. |
Nancy McCracken 4434687 is backup when I am not available |
Firstly we overview the 3 areas and then we discuss them sequentially in detail
|
Geoffrey Fox |
NPAC |
Syracuse University |
Syracuse NY 13244-4100 |
Statistical approaches underly most approaches to study of physical systems with many particles as detailed dynamics become both impossible and irrelevant. The Central Limit Theorem or Law of Large Numbers implies that most observable quantities only depend on average properties of system. |
We will give a list of topics in course labelling them
|
Note there is natural link T --> C --> A and
|
Further one can nearly always formulate the detailed laws of physics as "variational principles" with integrals over possible states. |
In the case of high energy physics (QCD or Quantum Chromodynamics theory of fundamental particles), this variational principle is Feynman's path integral. |
Using Monte Carlo methods for these variational principles leads to a formulation just like statistical physics. |
Note QCD is a theory of particles moving in 3D space but is formulated as integrals over a four dimensional space time i.e. looks like a 4D statistical problem. |
Variational principles minimize functions, and generally Mother Nature minimizes energy. |
Thus statistical physics is (nearly) always solving optimization problems. We can turn around and use physical analogies and use "physical optimization" methods to solve general optimization methods. |
Here Simulated Annealing, Simulating Tempering, Genetic Algorithms, and neural networks are some of algorithms in this class. |
Note the so called NP Complete problems in optimization; physics is NP complete (one cannot solve Nature's equations in polynomial time) and so physical optimization is very suitable for NP complete optimization problems. |
A: Why Statistical Processes can be used to describe Nature with examples |
T: Monte Carlo Integration (review from CPS615) |
A: Introduction to Spin Models with the Ising model (an array of two component, up and down, entities) as simplest example |
A: Phase Transitions as a pervasive property of systems and common focus of statistical physics computations
|
C: Use of Monte Carlo Methods in Statistical Physics
|
C: Application of Metropolis Algorithm to the Ising Model |
C: Software Implementing Metropolis for the Ising Model |
C: After we have generated some physical states by Metropolis, what do we do?
|
A: Study of Phase Transitions |
C: Tricks of the trade: Computational Issues
|
A: Critical Slowing Down -- systems change slowly near critical points as "domains form"
|
T: Acceleration Methods
|
A: Potts Model -- Spin systems with more than two components |
A: Percolation -- Physical system with properties related to some cluster determination methods |
T: Cluster Methods in Detail
|
T: Basic Parallel (single site at a time) Metropolis Algorithm
|
C: Software for Parallel Metropolis for Spin Model |
A: Study of Ising Model with Parallel Metropolis |
C: Efficiency of Parallel Metropolis Algorithm |
T: Parallelization of Measurement Phase of computation
|
T: Comparison of Statistical Mechanics and PDE Solvers |
T: Parallelization by replication of problem in different nodes of a MIMD parallel machine
|
Note these are quite hard as clusters are dynamic and irregular in shape. Further parallelism sometimes restricted as have to cope with modest numbers of clusters which restricts some parallelism |
T: SIMD and MIMD Parallel Cluster Labelling |
T: Relation of Cluster Determination and Region Finding in Image Processing |
T: Multigrid and Hierarchical Labelling Methods |
T: Shiloach-Vishkin SIMD Method (This problem is classic in theoretical computer science community) |
T:Parallel Algorithms for growing a single cluster |
A: Spin Glass and other Generalizations of Ising Model
|
T: Optimization via Simulated Annealing
|
T: Neural Networks as mean field approximation to Simulated Annealing |
T: Parallel Simulated Annealing |
T: Simulated Tempering for
|
T: The Travelling Salesperson Problem and NP Complete Optimization
|
T: Genetic Algorithms
|
A: Some real world Optimization Problems
|
T: General theory of Physical Computation and Complex Systems |
C/A: Historical and Physics Background on QCD and its Simulation |
A: A short description of High Energy Physics: The Study of the fundamental Description of Matter |
A: Gauge Theories and QCD as a gauge theory
|
C: Gauge Theories on a lattice and relation between
|
C: The difficult limit from Lattice to Continuum theory |
C: Measurements on a Lattice |
T: Parallel Computation of both Sites and Measurements in Lattice Gauge Theories |
A: Current Status of Computation of particle masses
|
C: Adding Fermions (quarks) to a theory of Gluons (The "carrier" of strong interaction force)
|
T: Hybrid Monte Carlo
|
T: Basic Methods for Pseudo Random Number Generation -- one doesn't use true random numbers!
|
T: Parallel Random Number Generation |
T: Testing Quality of Pseudo Random Number Generators
|
Geoffrey Fox |
NPAC |
Syracuse University |
Syracuse NY 13244-4100 |
CFD (Computational Fluid Dynamics) and NR (Numerical Relativity) both involve the solution of second order partial differential equations (PDE's) describing physical phenomena. |
This case study will study both applications and then look at the computer science (computational) issues which are both common and distinct. |
This will allow us to study the requirements of a computational toolkit for general solution of second order PDE's. |
These two applications are by no means the only applications but they cover a broad range of issues. |
CFD can be defined narrowly as confined to aerodynamic flow around vehicles but it can be generalized to include as well such areas as weather and climate simulation, flow of pollutants in the earth, and flow of liquids in oil fields (reservoir modelling). |
Our numerical relativity example will be the collision of two black holes which is focus of a major NSF Grand Challenge involving NPAC with seven other institutions in a collaboration led by Richard Matzner at Texas. |
Note that Numerical Relativity involves solution of Einstein's equations which include as a special case Maxwell's equations used to describe electromagnetic phenomena. |
Thus issues of relevance to computational electromagnetics (used in study of antennas and radar cross-sections of military aircraft) are implicitly included in this case study. |
Nearly all partial differential equations which are commonly encountered can be found by choosing parameters or limits in CFD or NR. |
Motivation for CFD -- why we need Teraflop and Petaflop performance to design new aircraft and model oil reservoirs and polluted chemical dump sites |
Introduction to NAS benchmarks and remarks on performance of today's machines. |
Motivation of Numerical Relativity with Collision of two black holes as expected signature for LIGO gravitational wave detector -- expected need for Teraflop performance |
General Discussion of Continuum Physics as a model for Nature |
The Navier Stokes Equation -- Basic equations of CFD |
General discussion of Computational Issues for CFD |
Introduction to Numerical formulation of Einstein's Equations |
General discussion of computational issues for Numerical Relativity |
Comparison of Similarities and differences between CFD and NR |
The NAS benchmarks were introduced by a group at NASA Ames as a novel approach to benchmarking high performance machines. |
Most benchmarks (call these software benchmarks) are presented as specific pieces of software which must be run on a target machine to measure its performance
|
The NAS Benchmarks are described in a basic document:
|
The material used in class selects results from 4 benchmarks described in detail in above citations:
|
There are several striking results in NAS results with SGI Power Challenge and IBM SP2 leading the way in performance per node. Full document discusses performance per dollar and the full set of benchmarks. |
We will later use mathematical definition of CFD contained in BT and SP benchmarks as a way of indicating key computer science issues in CFD. We will generalize this approach and try to specify numerical relatively in a similar fashion. |
We will use AIAA-94-2249 "Computational Toolkit for Colliding Black Holes and CFD" by N.P. Chrisochoides, G.C. Fox and T. Haupt as an overview of issues that need to be studied in producing a PDE (CFD and NR) Computational toolkit
|
Relate CFD to NAS benchmark discussion |
Review of various PDE solution methods and their parallel implementations |
Discuss in detail numerics and parallel implementation of NAS CFD model problems |
Present NR in NAS benchmark form |
Discuss model problems from wave equation to simple realistic NR problem |
Return to general toolkit Issues:
|
Numerical Relativity is a coupled set of partial differential equations
|
Equations can be divided into two classes
|
For CFD, the "physics" determines computational issues
|
For Numerical relativity, one can change the nature of solution by changing "space itself"
|
The Magnetic Field is given in terms of vector potential by |
Components of vector potential are not independent as expressed by gauge transformation
|
Choosing implies choosing gauge |
The Constraint equations are: |
The evolution Equations are: |
These give waves at infinity |
The theory is very nonlinear:
|
Boundary Conditions at Infinity are those of computational electromagnetics (CEM)
|
There are no small coefficients of second order derivative terms
|
Numerical Relativity has the world's most significant singularity -- Black Holes
|
Boundary conditions at Black Holes involve physics and numerics |
Certainly finite difference mesh needs some sort of special treatment |
Physics says that any information inside black hole is irrelevant
|
However we don't know where Black Hole is until we get full solution! |
This issue is "Show-Stopper". It may be that difficulties in this area will prevent reliable solutions without a major algorithmic breakthrough or new physics insight
|
It is possible that a teraflop computer may be sufficient to "solve" the collision of two black holes
|
NASA has documented carefully estimates of computer needs for various CFD approaches.
|
Snapshot results are:
|
Both problems are coupled systems of second order partial differential equations |
Both can involve solution of metaproblems -- coupling between different systems of equations
|
Both problems require numerical experimentation to develop working codes
|
Both problems have elliptic and hyperbolic equations |
Similarities suggest we develop a toolkit applicable for either or both applications |
Portable means runs on (nearly) all of today's high performance (parallel) computers |
Scalable means code written today will run on future high performance machines
|
High Performance Fortran and C++ ; scalable data parallel support |
Fortran-M and CC++ ; scalable support of task parallelism |
AVS ; industry standard for visualization and software integration |
PVM and MPI ; standard message passing support |
ADIFOR ; differentiate Fortran code ; critical tool for optimization problems |
Prototyping Software ; needs development of Interpreters and other tools |
Domain Specific Software where user interfaces at level of mathematical equations -- not C++ or Fortran
|
Runtime support and libraries
|
PDE Solvers for both Elliptic, Hyperbolic and mixed equations |
Geometry packages to define solution space (mainly for CFD used in design of real vehicles) |
Visualization including Virtual Reality (VR)
|
Optimization needed for Multidisciplinary Analysis and Design |
Boundary Conditions can be application specific as sensitive to physical system
|
Grid Generation has several important characteristics:
|
Geoffrey Fox |
NPAC |
Syracuse University |
Syracuse NY 13244-4100 |
This case study is a prototype for a new course referred to informally as CPS714 which is focussed applications supporting CPS616 which is a new course offered first as CPS600 in Spring 95 and then CPS616 in spring 96 |
CPS615 is Computational Science for scientific and Engineering Applications |
CPS616 is proposed as Computational Science for Information-oriented applications. |
CPS615 and CPS616 are aimed as base technology courses and CPS713 fulfills the application requirement for the Syracuse University Computational Science Academic Curricula. |
We have chosen from the CPS616 Curricula, four broad topics for the Case Study III) of CPS713 this fall |
The Four Topics are:
|
Draft 1: Geoffrey Fox August 7,1994 |
Background
|
We propose to offer the full course CPS600 in the first semester (January to April) of 1995 with a trial run of reduced scope as part of CPS713 (Applications of Computational Science) this fall. We will make all teaching material available electronically and have discussed producing a textbook (electronic and conventional). Many authors and teachers will be needed to cover field. Not all of these teachers will be at Syracuse University and videoconferencing may be used for part of the course. The course is currently structured as about ten independent modules of about three to six hours per module. We are now seeking comments and offers of help and collaboration. |
The conference proceedings "R and D for the NII: Technical Challenges" obtainable from EDUCOM (nii-forum@educom.com) is one useful general resource. It would be important to collect other useful general and specialized reference books for either teachers and/or students. There are currently 10 modules listed below. Possible material for each module will be found in the next sections., |
1) The Internet and Specialized Testbeds as Prototypes of the GII (Global Information Infrastructure) |
2) Physical Network |
3) The Consumer Multimedia Enterprise: Multimedia Videogames, PC's, Settop boxes, and Workstations |
4) Digital Media: Audio, Video, Graphics and Images |
5) User, Application and Service Interfaces |
6) Client and Server High Performance Multimedia Computer Requirements and Architecture |
7) Base Software and Systems Architecture of the GII |
8) Pervasive and Niche Applications for the GII |
9) Generic Services and Middleware on the GII |
10) The Emerging GII Enterprise in Industry, Academia and Society |
1) What is Internet including History, Phenomenology and base Technologies ** CPS 713 Topic A |
2) Learn to use gopher, Mosaic etc. ** CPS 713 Topic A |
3) Peruse examples of text, image, video, Information systems ** CPS 713 Topic A |
4) How to prepare and convert HTML, JPEG, MPEG ** CPS 713 Topic A |
5) Gigabit Testbeds |
1) Local Home Delivery -- THE GII Offramps -- Copper pair, coax, fiber, wireless, Cellular, ADSL |
2) Trunk Transmission -- fiber, Satellite |
3) Switching -- ATM, ISDN |
4) Architectures: Cable and Telephone Company, Distributed, Centralized, Multivendor, Military (Global Grid) |
1) CD-ROM |
2) Settop Box |
3) CD-I, 3DO, Nintendo, Sega, Atari(Jaguar) |
4) Specialized Hardware: DVI, Video Accelerator cards |
5) SGI and other high end systems |
6) Multimedia Authoring |
7) Edutainment |
8) Anatomy of selected videogames and Multimedia titles: SIMCITY, MYST, NBA Jam, Crash and Burn, Mortal Kombat, Encarta |
1) Rendering and Modeling ** CPS 713 Topic B |
2) Photo-CD |
3) Compression of Images, Video, Audio and Text -- MPEG, JPEG, Wavelet, Fractal |
4) Individual and "crowd" display technology |
5) Computer Animation for movies such as Jurassic Park |
6) Video browsing |
7) Video indexing -- speech recognition |
8) Displays: HDTV |
1) Virtual Reality |
2) X, Motif |
3) Mosaic and its future |
4) ATM Layers (AAL) |
5) Interfaces for real world users such as children |
1) Multimedia Clients (see module 3) |
2) Parallel Video and other Information servers ** CPS 713 Topic C |
3) Parallel I/O Issues ** CPS 713 Topic C |
4) Disk and Archival Storage Issues ** CPS 713 Topic C |
5) Specialized versus General Purpose Architectures (Workstation, Mainframe, Teradata, nCUBE, IBM SP-2 and equivalent) ** CPS 713 Topic C |
1) World Wide Web -- URL and futures |
2) Network Protocols, Management and Switching -- data transport |
3) What is right/wrong with TCP/IP, PVM, MPI, ISIS etc. |
4) Fault Tolerance |
5) Distributed Operating Systems |
6) Televirtuality |
7) Network Resource Allocation |
8) Caching |
1) Movies on Demand |
2) Interactive TV |
3) Digital Library ** CPS 713 Topic D |
4) Telemedicine |
5) Education |
6) Global Grid(Defense) |
7) Commerce |
8) Manufacturing |
9) Distributed Scientific Computing |
1) Parallel and Distributed Databases ** CPS 713 Topic C |
2) Security, Privacy -- cipher/decipher |
3) Collaboration -- distributed whiteboards etc. |
4) Digital cash |
5) Decision Support and Datamining Tools ** CPS 713 Topic C |
6) Geographic Information Systems -- Terrain data ** CPS 713 Topic B |
7) Organization of Material in Multimedia Systems on the World Wide Web with URL's -- the nonlinear Information Model ** CPS 713 Topic D |
1) Early (successful) commercial services |
2) Convergence of industries |
3) Convergence of Academic Fields ** CPS 713 Topic A |
4) Convergence of Computing and Communication ** CPS 713 Topic A |
5) What (if anything) will happen to society from the GII -- Quality of Life, Jobs, Education --are there important negative implications? ** CPS 713 Topic A |
6) Intellectual property rights on the GII |
7) What information is available now (free or more money) and what could be made available ** CPS 713 Topic D |
8) Current Internet Assets ** CPS 713 Topic D |
9) Kodak Picture Exchange |
Geographic Information Systems (called GIS) are of growing importance in areas such as
|
NASA's Mission to planet Earth will dramatically increase the availability of data such as that gotten today from Satellites such as LANDSAT and SPOT. Their multi-spectrum data can be used for many applications such as studying state of environment, crop growth etc.
|
Note that the GIS is natural multimedia Interface to Spatially labelled data (E.g. video footage for tourism arranged by vacation location). This contrasts with Mosaic as natural multimedia document interface |
The magazine GIS World has a wealth of information about real world GIS applications and companies |
Map data is available (almost free) from the USGS (Geological Survey) and with additional features from several commercial companies. (See memo by Paul Coddington) |
Rendering refers to process of creating images from a model of them |
We will only look at case where image is of three dimensional world but much of our analysis will be generalizable |
We intend to use such a 3D renderer to produce a 3D Image of New York State which can be navigated by children and teachers to provide a virtual field trip
|
Current GIS systems tend only to support two dimensions properly with 3D either done crudely or in non real time mode. The Living Textbook project intends to use power of parallel machine to produce full 3D GIS.
|
Much rendering research uses ray tracing and optimizes for the best possible Image quality |
We will study texture mapped polygon method which is much faster and can give you ability to trade-off performance versus Image quality and guarantee real time constraint met. |
NPAC has unusually good expertise in this area with the availability of Parallel Oracle (the largest commercial relational database) and parallel DB2 (IBM's relatively new relational database) |
Note that industry standard access language is SQL
|
Academia is studying Object oriented databases which have attractive features but currently one expects relational databases to dominate parallel database field. |
Databases contain data which is converted to Information by Datamining |
This use of a database is often called a Data warehouse |
You extract data and the apply Decision Support tools which are essentially Optimization systems to extract Information |
High Visibility Commercial Applications are:
|
Optimization tools will be those we study in Case Study I)
|
A traditional book is a relatively consistent set of information arranged in modules (paragraphs and chapters) and typically read in a linear fashion from beginning to end. |
An encyclopedia on the other hand arranges information in modules of chapter to paragraph size but one expects to read "randomly" or nonlinearly as each module "points" you to other modules. |
The world wide web is similar to encyclopedia generalized to dynamic rather than static links and with information spatially distributed and accessed by Network. |
Note that looking at commercial CD-ROM products, my family evaluates the electronic encyclopedia's (Encarta, Compton, Grolier) as superior by far to electronic (illustrated) books. |
One must enforce standards to allow linked modules to address information in a consistent fashion
|
We refer to our Information enterprise as the "Encyclopedia Galactica" to reflect the importance of the nonlinear model and the prescience of the Hitchhikers guide to the Galaxy. |