Given by Geoffrey C. Fox at IDA Presentation on October 31,1994. Foils prepared April 9,1995
Abstract * Foil Index for this file
This presentation was prepared for a talk by Geoffrey Fox at the Institute of Defense Analysis on Halloween Day 1994. It describes a classification and analysis of possible defense and industrial applications of HPCC and parallel computers in particular. This is based on a survey of New York State Industry conducted by the ACTION (forerunner of InfoMall) project of Syracuse University with New York State funding. Later results from the NYNET project with especially Rome Laboratory and NYNEX are included. |
This table of Contents Abstract
Background for Institute for Defense Analysis |
Meeting October 31,1994 |
Geoffrey C. Fox |
Northeast Parallel Architectures Center |
111 College Place |
Syracuse University, Syracuse, NY 13244-4100 |
315.443.2163 |
gcf@npac.syr.edu |
This presentation was prepared for a talk by Geoffrey Fox at the Institute of Defense Analysis on Halloween Day 1994. It describes a classification and analysis of possible defense and industrial applications of HPCC and parallel computers in particular. This is based on a survey of New York State Industry conducted by the ACTION (forerunner of InfoMall) project of Syracuse University with New York State funding. Later results from the NYNET project with especially Rome Laboratory and NYNEX are included. |
Define information generally to include both CNN headline news and the insights on QCD gotten from lattice gauge theories |
Information Production e.g. Simulation
|
Information Analysis e.g. Extraction of location of oil from seismic data, extraction of customer preferences from purchase data
|
Information Access and Dissemination - InfoVision e.g. Transaction Processing, Video-On-Demand
|
Information Integration Decision support in business Command and Control for Military Concurrent Engineering and Agile Manufacturing
|
These involve combinations of Information Production, Analysis, Access and Dissemination and thus need the Integration of the various Software and Machines Architecture Issues discussed there |
Sometimes Called System of Systems |
25: Military and Civilian Command and Control (C2, C3, C4I ....)
|
26 to 28: Applications of InfoVision Services
|
29: Real-Time Control Systems
|
30: Electronic Banking
|
31: Electronic Shopping |
32: Agile Manufacturing -- Multidiscplinary Design and Concurrent Engineering
|
33: Education
|
PVM, Express, Linda, MPI |
ISIS (Cornell) |
High Performance Fortran (HPF) Compiler |
High Performance C, C++ Compiler |
HPF Extensions - PARTI |
Parallel / Distributed Computing Runtime Tools |
ADIFOR (Differentiate Fortran Code) |
AVS and Extensions |
High Performance Fortran Interpreter |
Image Processing |
Parallel Debugger |
Parallel Performance Visualization |
Parallel Operating Systems
|
Virtual Reality |
Event Driven Simulator |
Mesh Generation |
SCALAPACK |
Sparse Matrix Solvers - Templates and libraries (Direct and Iterative) |
Particle Dynamics Kernels - Templates and Libraries ( O(N2) to fast multipole) |
Optimization Methodology and Templates
|
Scheduling (neural-net, parallel) Templates |
Parallel (Relational) Database e.g. Oracle 7.0 |
Object database |
High Speed Networks |
Multilevel Mass Storage |
Integration Software ("glue") |
Integration of Parallel and Distributed Computing |
Multimedia Support
|
ATM Network Protocols and Management |
Compression |
Parallel Rendering |
Linkage Analysis (between records of database) |
Sorting (large databases) |
Collaboration Services
|
Security and Privacy |
Usage and Charging Algorithms |
Televirtuality
|
Human-Computer Interfaces
|
Information Organization
|
Image Processing
|
Geographical Information Systems
|
Carrier (Syracuse) competing with Japanese who build quiet air conditioners. Need 3-D CFD simulations including acoustics. |
Major aerospace company - engineers are using a network of RS6000's for large CFD simulations.
|
Teraflop machine in a submarine will allow adaptive 3-D beamforming.
|
Global competition and DoD cutbacks ----> Aerospace and other manufacturing companies are typically cutting back in personnel and research ----> Hard to integrate new technologies ..... |
Several diverse applications Global warming Pollution Oil reservoir Acoustic signals in a real ocean to detect (hide) submarines |
Share partial differential equation algorithms between disciplines and with CFD, structures Direct solvers Conjugate gradient Domain decomposition Multigrid Adaptive meshes |
Major federal activities in
|
Caltech (Kuppermann, McKoy) showed successful hypercube implementations of reactions such as e- Si, H2 + H scattering ----> such problems important for catalysts |
These and MOPAC Gaussian90 (find potentials) dominated by matrix algorithms - multiplication, inversion and eigenvalues
|
Computational Electromagnetics has similar computational structure |
CHARMM used extensively in industry 100,000 lines - hard to parallelize
|
Academic astrophysics code with new algorithm (fast multipole) running with > 106 particles on Delta at Caltech |
Niagara Mohawk's transmission system described by 4000 X 4000 sparse matrix (~12 nonzero elements in each row) |
Use to plan and control electrical distribution and to recover from circuit damage |
NiMo could use small parallel MIMD machine - problem not very big |
Large teraflop machine could control nation's power? |
NYNEX currently does not use sophisticated simulations in planning new installations. Has large databases of information to guide simulation |
All are physical networks with mainly local connections |
Defense (SDI ...) Technology Sensors and Image Processing Command and Control (decision aids) Tracking |
Has interesting applications to the next war ( i.e. to global economy) Entertainment Sports Medicine Robotics Manufacturing General information systems .......... |
This is dominant use of computers in business and ~80% of business use involves transactions which are short, taking < 1 second ----> can parallelize simply by processing several users simultaneously
|
OLTP unlikely to need a "teraflop" machine unless we add sophisticated processing to database access |
Teradata ( --> NCR --> AT and T ) is largest parallel computer vendor whose systems are used to summarize inventories (etc.) and parallelized similarly over several small records. |
Empire Blue Cross / Blue Shield in Syracuse processes
|
SIAC runs the New York and American stock exchanges |
Already uses parallel computing implemented appropriately on distributed networks ("embarrassingly parallel") |
2 acres (~300) Tandem computers interfacing network of PC/workstations to calls from brokers |
2000 stocks in NYSE decomposed in load balanced fashion over traders and associated PC's (~500) |
Fault tolerance and network management are key issues |
A few minutes downtime per year are allowed ........ |
Large NY State Insurance Company spends $70M a year in Syracuse on data processing. |
Hardware and operation costs "negligible" (<10%) for modest IBM3090 |
Cost is application programmers developing new software or maintaining old code - your grandfather's policy is an important dusty COBOL deck.
|
Where should they use high performance computing? |
Innovative insurance companies scan documents but don't need HPC |
Clearly need a more productive software model |
Parallel computing is clearly applicable for the myriad of small transactions
|
But there are important "batch jobs" typically written in COBOL
|
This is the dusty COBOL deck problem. Both
|
Need "High Performance COBOL" compilers? |
Dowquest already uses two CM-2's to extract information from an online database of financial articles.
|
A small Rochester company making CD-ROM's would like to complete task more quickly as need to run several times to get error free CD-ROM. |
Low end (PC) multimedia systems will revolutionize information presentation (DVI specialized hardware for realtime CDROM animation)
|
SIAC uses 3090's after hours to find unusual correlations which could signify fraudulent trading |
Otis has ~1 million elevators and is considering a central database to accumulate operating history. One could then analyze with neural networks or an expert system to find "signatures" that allow one to schedule preventive maintenance and avoid "callbacks" - customer induced repair calls
|
DOD maybe only will sponsor about two new airframes in the next ten years doe to peace dividend ----> maybe no more aircraft for given company |
But we can consider replacing all existing computers in:
|
What will factor of 1000 increase in performance allow us to do in:
|
CRDA - Government-Industry Research and Development Agreement - allows government (laboratory staff and in principle subcontracts) and industry to work together
|
Current(1993) Membership: Large Organizations: Aerospace Grumman (Data Systems) ITT MITRE Motorola (Federal Systems) Raytheon
|
Cooperative is focussed on software Operating systems, Languages, tools and system integration for
|
Even if little new military equipment is funded by DOD, could and should upgrade control systems in existing ships, tanks, aircraft, control centers ........ |
What is the appropriate virtual machine(s) i.e. (industry standard) computing model for BMC3IS ? |
How important is ADA ?
|
Does parallel software engineering mean anything to a wide community? |
New York Health Department Syracuse office only has home PC's and old (? 6 years) UNIX systems rescued from bankrupt hospitals
|
Large utility is interested in expert system/neural networks which can be used to analyze bill payment data and predict when payments expected |
Large credit card company rumored to be interested in analyzing credit card receipts to discover more than you know about your family's buying habits |
Wall Street already has some parallel machines installed and likely to increase use of parallel computers |
Rapid prototyping critical as financial instrument, mix of investments in portfolio and models change rapidly |
Mortgage backed securities (Zenios) at Wharton School and option pricing well studied. New optimization methods very promising |
One Wall Street company makes major use of C and C++ - 200,000 lines of code in just one application. |
Another company says modeling is very appealing but information processing is the real problem for corporation |
New Optimization Methods and Monte Carlo Simulations of growing Interest |
Is " by definition " the highest bandwidth and richest human-computer interface |
Thus natural HPC user interface |
Need HPCC to create virtual worlds |
VR is high end multimedia - multimedia is rapidly evolving "low end" technology |
VR is used by customer to "experience" new car which will be built by "Agile Motors Inc."(Car company employing Agile Manufacturing) |
VR is used in medical rehabilitation and diagnosis. Patient can be stimulated and motivated as virtual world fills in for impaired patient capabilities |
VR is used in new sports delivery systems to experience "world according to favorite player" as detected by sensors and HPC image processing |
Industry imitations provide strong incentive for collaboration between firms and with universities and government |
MADIC organized through NPAC in March 1992 |
Initial organization supported by NASA, New York State (NPAC INFOMALL program) |
Member firms pay annual fee for administrative expenses |
NASA regards MADIC as its "CAS (Computational Aerosciences) Consortium" |
MADIC members form teams to address specific projects |
Define systems architecture and software requirements for an automated multidisciplinary analysis and design system implemented in a heterogeneous computer environment |
Identify gaps in existing technology base |
Facilitate joint ventures
|
Influence Federal HPCC program
|
Provide a mechanism for technology transfer |
Allison Gas Turbines |
Boeing |
Ford Motors |
General Electric (Corporate R&D, aircraft engines) |
General Motors |
Grumman |
Lockheed |
McDonnell Douglas Aircraft |
Northrup |
Rockwell |
United Technologies Research Center representing (Otis, Pratt & Whitney, Sikorsky) |
Vought Aircraft |
Integrated Environment |
Multiple discipline
|
Engineering analysis |
Design optimization |
Each of three components (network connections, clients, servers) has capital value of order $10 to $100 Billion |
InfoVision is ultimate client server application
|
Democracy on the NII (Gore)
|
Every Military "Unit", "Every" Business Office, Every school "desk", "Every" home (approximately any place on cable or accessible by wireless ot other communication device) will have a two-way high speed link to the NII
|
"Resolution" of Military Unit and School Desk Unclear |
What does this factor of 1000 increase in performance do for the home?
|
These consumer developments will drive MPP use
|
Information Video Imagery and Simulation on Demand |
Defense (Dual-Use), Business and Research environments will be set up in a similar way to leverage mass market and common NII. Obviously different services in detail and different functionality trade offs. |