Given by Geoffrey C. Fox at MAME Seminar on 11 October 95. Foils prepared 10 November 1995
Abstract * Foil Index for this file
See also color IMAGE
This sets the NII scene with broad service areas supported by a WebWindows Environment |
In looking at application areas such as
|
We focus on the complex system manufacturing of particular interest to MAME discussing the challenges and opportunities |
This table of Contents
Abstract
Geoffrey Fox |
NPAC |
Syracuse University |
111 College Place |
Syracuse NY 13244-4100 |
This sets the NII scene with broad service areas supported by a WebWindows Environment |
In looking at application areas such as
|
We focus on the complex system manufacturing of particular interest to MAME discussing the challenges and opportunities |
Analysis to define the flow physics involved in compressor stall. It suggested a variety of approaches to improve the performance of compression systems, while providing increased stall margins. A Cray Research C-90, IBM SP-1, and IBM workstation cluster were used to formulate and develop this model. |
An image from a video illustrating the flutter analysis of a FALCON jet under a sequence of transonic speed maneuvers. Areas of high stress are red; areas of low stress are blue. |
Parallel Computing Works! |
Technology well understood for Science and Engineering
|
Supercomputing market small (few percent at best) and probably decreasing in size
|
No silver programming bullet -- I doubt if new language will revolutionize parallel programmimng and make much easier
|
Social forces are tending to hinder adoption of parallel computing as most applications are areas where large scale computing already common
|
ATM ISDN Wireless Satellite advancing rapidly in commercial arena which is adopting research rapidly |
Social forces (deregulation in the U.S.A.) are tending to accelerate adoption of digital communication technologies
|
Not clear how to make money on Web(Internet) but growing interest/acceptance by general public
|
Integration of Communities and Opportunities
|
Technology Opportunities in Integration of High Performance Computing and Communication Systems
|
New Business opportunities linking Enterprise Information Systems to Community networks to current cable/network TV journalism |
New educational needs at interface of computer science and communications/information applications |
Major implications for education -- the Virtual University |
1992: Grand Challenges |
1993: Grand Challenges |
1994: Toward a National Information Infrastructure |
1995: Technology for the National Information Infrastructure |
1996: Foundation for America's Information Future |
Each of three components (network connections, clients, servers) has capital value of order $10 to $100 Billion |
InfoVision is ultimate "client-server" application
|
Democracy on the NII (Gore)
|
High Performance (Parallel) Computers on High Speed (ATM) Networks linked to clients at a network performance that supporting realtime Video at a resolution between VHS,HDTV . |
MPP's as Internet/Web/NII/GII Servers
|
Dual-Use Philosophy must be extended to Multi-Use
|
Standards must be used
|
One must provide real time video to some 100 million NII off ramps and there are many choices such as: |
Optical Fibre Trunk System (ATM)
|
Satellites for Trunk System |
Local Cable Delivery (Optical --> Cable Switch) - several megabits/sec
|
ISDN (0.1 megabits/sec) down twisted pair |
ADLS (several megabits/sec) down twisted pair |
Full Optical Fibre Link |
Mobile Computing |
"Every" Business Office, Every doctor's Office, "Every" school desk, "Every" home(potential patient) (approximately any home on cable) will have a two-way high speed link to the NII
|
What does this factor of 1000 increase in performance do for the home?
|
These consumer developments will drive MPP use
|
Information Video Imagery and Simulation on Demand |
The different application areas such as business, defence, government, education and healthcare can leverage off the infrastructure and services motivated by home use. |
Clearly each areas needs somewhat different functionality and trade-offs in services |
COMMERCIAL AIRCRAFT COST REDUCTIONS ARE TARGETED AT 25% NEAR TERM |
THREE OF FIVE MILITARY FIXED-WING AIRCRAFT FAMILIES IDENTIFY REDUCING COSTS BY 20-40% (BY 2015) AS A PRIORITY TECHNOLOGY DEVELOPMENT |
Browsers have SAME interface on ALL Computers |
CGI Programs are typically written in PERL but can be essentially ANY UNIX Process and so do simulation, database access, advanced document processing etc. |
Clients (such as Mosaic and Netscape) support browsing of hyperlinked documents but have no internal interactive/compute capability |
Servers read HTTP and deliver requested service to client |
HTML -- a document format supporting hyperlinks |
HTTP -- a Transport Protocol defining Interaction between Web servers and Clients |
MIME -- a data format allowing agent-like (extended email) communication |
CGI -- a standard interface allowing sophisticated server extensions |
PERL -- a rapid prototyping language(script) aimed at text and file manipulation |
Web Search engines such as YAHOO, HARVEST, WAIS -- early distributed database access technology supporting search and indexing |
net.Thread, WebTools, RealAudio are early Web Interactive services |
Application Specific NII Specific Services for
|
Desktop Publishing and Productivity Tools in WebWindows (WebTop Productivity/Publishing)
|
InfoVision: Delivery on Demand of Information from:
|
Commerce -- digital Cash and signatures with appropriate authentication and security. Enables both Web Commerce (shopping) and use of Web for proprietary information |
Like UNIX or MS-DOS or Windows 3.1(NT,95), WebWindows is an operating system for a "computer" |
The "computer" is a metacomputer consisting of the 20,000 Webservers (currently--eventually hundreds of millions) on Internet for the World Wide Web |
WebWindows can also be used for the metacomputer (collection of heterogeneous networked computers) which is a business enterprise system
|
WebWindows is a multi-client multi-server technology
|
World wide multimedia File access and dissemination -- current Mosaic Service |
Initial agent technology such as World Wide Web Worm, Harvest etc. |
WebTools is initial NPAC Project to develop WebWindows |
File management (create,delete etc.) -- Implented in WebTools |
Hyperspace Navigation -- Preliminary Prototype in WebTools |
Ultimate Navigation built around agents, knowledge stored in caches (databases) and powerful search capabilities |
HTML editor -- simple version in WebTools (best with client extensions) |
Electronic Mail -- Webtools version very high functionality |
Project Management and Decision Support
|
Personal Digital Assistant -- Merging of Web and Telescript(Magic Cap) |
Collaboration -- multiple video streams of participants, whiteboards, forums, MOO etc.
|
Computation -- harness the world wide web as a distributed computer -- WebWork project at NPAC, Boston University, Cooperating Systems Corp.
|
Initial webfoil 0.1 release Halloween 1995 |
Relational databases -- Oracle,DB2 have Web Interfaces |
Collaboration from Console Units (PIctureTel, CLI), Desktop (SGI Inperson) to MOOs |
Compression from MPEG and Wavelet to host of proprietary solutions -- a faction of 20 to 200 saving in space and bandwidth |
Geographical Information Systems |
Security will enable commerce on the Internet -- essential for Defence as well |
Oracle 7 Interface to Usenet-Prepared October 27,1995 |
Associated material may be found starting at Oracle-Web Interface to Usenet and other Services |
Produced by Gang Cheng April 1995 |
There is a larger Better Quality Image available |
Produced by Gang Cheng April 1995 |
There is a larger Better Quality Image available |
Interactive and "batch" Collaboration
|
Metacomputing -- the collection of world wide computers as a coordinated (in subgroups of computers) computational engine (for simulation or information processing)
|
ATM, ISDN, Wireless, Satellite will be hybrid physical implementation of NII |
CORBA, Opendoc, OLE, SGML, Hytime are critical file and document standards |
High Performance Multimedia servers to enable digital information delivery on demand |
Data transport from MPI/MSGWAY/PVM to AAL to CBR/VBR |
Windows95/NT -- the last of the the non social(Web) operating systems -- will follow dinosaurs(IBM mainframes) into extinction |
Personal Digital Assistants -- WebNewtons done right -- Telescript (agent based communication) and Magic Cap operating system |
WebWindows -- the open nonproprietary operating system of future supplanting UNIX, Windows95/NT, Apple etc. -- manages with a single interface all machines either individually or collectively on the NII |
WebWork -- Implements Computing for both Simulation and Information underneath WebWindows -- the correct implementation of HPCC ideas such as HPF,MPI with pervasive technologies |
Personal Servers -- Newton was correct but too early. The Web is a server - server technology |
Televirtuality -- All Web Users are linked into a single virtual world |
Java -- an interpreted C++ like language (script) allowing fully interactive clients which execute applets. Has full set of classes to make clients such as HOTJava. Licensed by Netscape |
VRML -- a 3 dimensional HTML allowing universal description of physical objects and allowing interchange of virtual worlds, commercial product designs etc. |
PERL5 -- an extension of PERL4 with full object oriented characteristics and extended pointer(array) constructs -- allows construction of Web Software obeying good software engineering practices |
Multithreaded WebServers integrating current Web, Compute and digital multimedia delivery services -- future Enterprise Systems |
WebTools -- Early NPAC Prototype of WebWindows Equivalent to Program Manager with Navigation, File manipulation, Mail |
WebDeskTop Publishing -- an early killer application under WebWindows supplanting Word, Wordperfect, LOTUS123 , Persuasion etc. Java allows clear powerful implementation. |
WebRDBMS -- Integration of Relational and Distributed databases with both agent based heuristics, formal indices and free text search |
Metadata -- Common attributes to allow integration and search of heterogeneous databases |
WebSpace -- Televirtual implementation of full 3D MOO like environment building on LabSpace at Argonne for the virtual scientific laboratory |
WebFlow -- NPAC prototype of Web based extended Khoros/AVS supporting dataflow linkage of computers for simulation and people and data for workflow management |
WebScript -- the evolving Middleware of scripted languages including extended PERL5, Java, Telescript, MOVIE(NPAC compute oriented script) etc. |
This is distributed databases for supporting cost effective healthcare with less fraud, better use of existing information for establishing care-plans etc |
This is collaboration, remote instrument control for telemedicine |
Could be full televirtuality for virtual-reality controlled remote surgery in battlefield or accident scenarios |
This is basis of Virtual University and NII can be expected to be much more succesful than videosystems because interactive, collaborative, explorative and full multimedia information at student and teachers fingertips |
Base of Distance Education is InfoVision for full interactive curricula
|
Rich Collaboration environments including televirtual MOO's for student-student and student-teacher interactions |
InfoVision is "successor" to TV with any multimedia information delivered on demand( choice from infinite number of channels) |
Community Networks will define local societies and will have significant impact on local government |
Shopping on the Web will include multimedia digital yellow pages , Commerce, online catalogs (which is InfoVision again) as well as perhaps powerful VR interfaces where you can try out new clothes and cars |
Collaboration (gossip as in computer forums) could be an important and dominant use but perhaps not initial major one |
OLTP (Online Transaction Processing) such as approving and recording credit card transactions. This is a type of InfoVision and Commerce which is operational today
|
Decision Support varies from fraud detection, inventory planning and market segmentation for optimizing shopping by mail |
Decision support can vary from search of a single giant relational database to galaxy-wide search of heterogeneous distributed database |
Workflow Support as in LOTUS Notes integrates Collaboration, Project Management and Distributed Databases. This supports ongoing distributed enterprise -- this is also essential in collaboratory |
Web Servers use "Web Technology" to service World Wide Web and other forms of networked multimedia information |
Critical feature is realtime, "come as you are" adaptive linked computers and people |
Judgement support extends decision support into an "exploratorium" scenario as crises tend to be unexpected |
Major need to search community and government databases for immediate information on resource location and availability etc. Metadata(summaries) essential |
Collaboration between commander in field , specialized anchor desks (domain experts) and those in field. |
User Interface essential as user will be tired and searching unfamiliar data |
Geographical Information Systems and browsing multiple video sources (InfoVision again) will be critical as judgements will depend critically on spatial data. |
This is future model for (inter)national distributed research |
Rich Collaboration environment essential as collaborative research requires nontrivial person to person interactions |
Searching distributed databases basis of much scholarly work (infoVision and Digital Library) |
Metacomputing for multidisciplinary, multi-institutional simulations and for control and data storage and analysis from remote instruments whether satellites, telescopes, accelerators etc. |
Distributed (people) Software Engineering support for production of distributed computing software |
Needs workflow support as distributed enterprise |
Critical feature is closely integrated collaboration of very many people and computers requiring |
Metacomputing Simulation and distributed database support as in Collaboratory |
Workflow support including configuration management and central CAD databases |
Rich collaboration environment to support distributed design decisions |
Standards and Security to allow interlinking of people and software from different organizations |
Key special requirement is distributed coordination |
A set of manufacturing companies -- Rockwell International, Northrop Grumman, McDonnell Douglas, General Electric and General Motors is studying the NII implications for a particular MAD system "Affordable Systems Optimization Process" (ASOP) |
Interesting parameters are that next major aircraft to be built could involve:
|
A set of manufacturing companies -- Rockwell International, Northrop Grumman, McDoinnell Douglas, General Electric and General Motors is studying the NII implications for a particular MAD system "Affordable Systems Optimization Process" (ASOP) |
Interesting parameters are that next major aircraft to be built could involve:
|
Return on Investment Unclear:
|
The Industry is in a very competitive situation and focussed on short term needs |
The role of HPCC in Manufacturing is quite clear and will be critical to
|
On the other hand for
|
Some areas which may adopt HPCC for simulation in relatively near future
|
In spite of the large and very succesful national activity, simulation will not be a large "real world" sales opportunity for MPP's
|
However some areas of national endeavor will be customers for MPP's used for simulation
|
Eight requisite subsystems comprise the ASOP design environment |
Provides Local Infrastructure for Team
|
Required for participation in ASOP
|
Supports emulation of full NII capabilities
|
A sample VRML page produced by Black Hole Simulation group at NCSA and displayed by SGI WebSpace, cooperating with Netscape Navigator. |
A set of 3D spaces related to gravity research is represented as Netscape icons and linked to the corresponding VRML worlds. |
WebSpace window displays one of these spaces -- a space-time diagram for two black hole collision ('Pair of Pants' diagram) |
A Set of Application domains and each with its own natural (interpreted) language manipulating domain-specific data structures. WebScript links the domains together |
Examples are:
|
This implies that we look at both Grand Challenges and National Challenges but we suggest this is not enough: |
WebWork Builds HPCC technologies on a broad not niche base starting at bottom (Web,PC's) |
not top (MPP's, Supercomputers) of computing pyramid |
Implements the "Viable Base" Enterprise Model of HPCC Software identified in Pasadena2 workshop
|
Implements a powerful software engineering framework for parallel computing by integrating parallel programming with the World Wide Web Productivity Tools |
WebTools is a prototype developed at NPAC which is a base on which to build the Compute and Software Engineering Capabilities of WebWork |
An early development will be WebFlow -- a AVS/Khoros like system built on the Web which can be used for BOTH Computing (modules are executable software) and for management of Software Development task (modules are source code and people) |
Later can develop the full WebHPL -- a hybrid compiled/Interpreted environment implenting HPF/HPC++ etc system with Web infrastructure and front end |
WebWork is an open, world-wide distributed computing environment based on computationally extended Web Technologies |
The backend computation and information infrastructure is provided by the World-Wide Virtual Machine -- a mesh of computationally extended Web Servers (called Compute Servers) |
These servers manage (via CGI mechanisms) a collection of standardized computational units called WebWork Modules. |
Geographically distributed and Web-published WebWork modules interact by HTTP/MIME based message/object passing and form distributed computing surfaces called Compute-Webs |
The front-end user/client interfaces are provided by evolving Web browsers with increasing support for two-way interactivity (e.g. Java, VRML) that facilitates client side control and authoring. |
A natural user-level metaphor -- WebFlow -- is supported in terms of visual interactive compute-web authoring tools. |
PCRC embodies the Parallel Computing Synchronization and collective parallel algorithms and runtime that will enable efficient Web-based computing |
Replace user interface of HPF or HPC++ with the Web(work) and use pervasive Web Technologies in infrastructure (World Wide Virtual Machine -- WWVM) |
Three Dimensions of Multimedia Extensions for Interactive Services
|
Illustrates 3 base layers of WebWork architecture and all main system components. |
A 4--node compute-web is represented
|
Java/HotJava model is used for WebFlow front-end implementation |
The paper describing this project is available at SCCS715 in NPAC technical report series |
Illustrates implementation of WebWork message passing in terms of
|
This diagram illustrates point-to-point communication between Web servers, used to implement a webflow channel between compute-web modules. Two extreme implementation modes are described: a) based on today's Web server technology, and b) based on thread memory mapped high performance implementation, expected in future Web compute-servers. Subsequent steps, represented by a sequence of labelled lines in the figure, are described below in both implementation modes. |
a) Today's Web server mode: (1) -- M1 locks O1 on S1 disk. (2) -- M1 sends POST HTTP message to S2 with M2 URL in the header sector and with O1 URL in the body sector. (3) -- S2 activates M2 via CGI and passes O1 URL as a command-line argument. (4) -- M2 sends GET method to S1 with O1 URL in the header. (5) -- S1 fetches O1 from its document tree. (6) -- S1 sends the content of O1 to M2 which completes the GET exchange. (7) -- M2 saves O1 by overwriting current I2 on the S2 disk. If I2 is locked, M2 waits (blocks). (8) -- After O1 is saved on the S2 disk, M2 returns 'end-of-transfer' acknowledgment to M1 which completes the POST exchange. (9) -- M1 unlocks O1 and exists. |
b) Compute-server (future Web server) mode: (1) - M1 locks its memory object O1. (2) - M1 checks if socket connection to M2 is in M1 connection table. If yes, go to (5) below. Otherwise, M1 connects to S2 and sends M2 creation script. (3) - S2 spawns M2 and acknowledges. (4) - M1 receives acknowledge message and saves new socket in connection table. (5) - M1 gets O1 handle. (6) - M1 writes O1 to M2 using socket lib calls. (7) - M2 reads O1 using socket lib calls. If I2 is free, O1 buffer is copied directly to I2 buffer. If I2 is locked, M2 creates O1 clone and blocks. (8) - M2 sends acknowledge to M1. (9) - M1 unlocks O1 and blocks. |
Latest results prepared for HPDC95 Tutorial August 1,1995 |
User-level WebWork metaphor is given by WebFlow -- a distributed dataflow model built in terms of WebWork modules and MIME object/document communication channels.
|
WebWork users will build and control distributed computing applications (compute-webs) using Web browsers based visual interactive editors and monitors. |
We are currently prototyping such WebFlow front-ends at NPAC using Java/HotJava model. WebWork modules are represented by Java threads (Screen 6) and visualized as interactive interconnected icons (Screen 7) |
Early prototype of AVS or Khoros like visual compute-web editor. |
Two interactive modes are supported:
|
In mode a), each click in the active editor window places a new module box there. |
In mode b), each click on module port generates links with all other modules. |
One current WebWork/WebFlow application, prototyped at NPAC, is Software Project Manager (Screen 8). Each software developer runs his/her WebTools server and uses HySource CASE tools. These servers are WWVM-connected to agent and manager servers. Agent server receives automatic notifications from developers servers on each software volume update, and uses customizable thresholds to decide when to fire a report to the manager or a deadline reminder to a developer. |
Software Project Manager tools contains a simple agent server that mediates between client/consumer ( here manager) and servers/producers (here developers). |
A front-end for the software project manager tool. |
Three types of modules are supported:
|
Developer modules are linked to the agent module and report automatically all changes in the software volume (handled by WebTools CASE toolkit integrated with WebTools editor). |
The agent module integrates the results and uses customizable threshold to decide when to fire a report to the manager or a deadline reminder to a developer. |
More generally, this Middleware Layer 2 will be rather complex and populated by a spectrum of proprietary (e.g. Telescript, ScriptX, CORBA) and public (e.g. Perl, Tcl, Harvest, Java, VRML) scripted languages, brokers, agents, wrappers, mediators etc. see Screens |
In WebWork, we refer collectively by WebScript to the whole ensable of these models. |
At the current stage, it isn't clear if WebScript as a common intermediate language is a practical concept. An alternative is to live in the multi-language Web medium and emply interoperability agents to translate between various protocols. |
Practical initial implementation platfrom for this dual approch is provided in WebWork by an integrated collection of WebTools CASE tools based HySource Worlds for various languages. |
HyPerl World page, generated automatically by the WebTools CASE package, and integrating documentation with the source. |
More generally, we call by HySource the hypertext documentation with navigable source code included. |
Function calls and external variable references are 'blue' and point to the corresponding HySource pages. |