Given by Geoffrey C. Fox at Kickoff Meeting at NPAC on October 17,1995. Foils prepared October 17,1995
Abstract * Foil Index for this file
See also color IMAGE
Develop Technologies and demonstrate a set of four applications enhanced by use of innovative Collaborative Interaction and Visualization. |
Point the way to Paradigm shifts in
|
i.e. Paradigm shift in both applications and software development for the applications
|
Demonstrate Applications and Approach in JWID and/or similar activities |
This table of Contents
Abstract
Geoffrey Fox |
NPAC |
Syracuse University |
111 College Place |
Syracuse NY 13244-4100 |
Develop Technologies and demonstrate a set of four applications enhanced by use of innovative Collaborative Interaction and Visualization. |
Point the way to Paradigm shifts in
|
i.e. Paradigm shift in both applications and software development for the applications
|
Demonstrate Applications and Approach in JWID and/or similar activities |
Principal Technical SETA to NMD BMC3 program at BMDO (OSD).
|
SETA to National Test Facility (just won recompete)
|
USMC Comm/Nav/Intel HQ Support |
Electromagnetic Simulation
|
Weather Information System
|
Command and Control Information System
|
Telemedicine enhanced with Digital Informatics and collaboration as shown to be required by early experiments
|
Develop basic Infrastructure and test 3D Interactive Displays of Physical Phenomena using Electromagnetic Simulation |
Apply this to a Weather Simulation of local or national interest which is enhanced by overlays on 3D Geographic Information Systems |
Design a Collaborative Environment with multiple interactive simulations, databases, multimedia information streams using Medical and Command and Control Applications for requirements |
Integrate Weather as one "Applet" in this Interactive Collaborative Environment |
Evaluate and Refine technologies |
Demonstrate Prototype Systems |
Virtual Reality and Display Technology connected to high speed networks and computers |
Compression of audio images and video |
Network Management |
Collaboration |
Geographical Information Systems |
Multimedia Databases |
Parallel and Distributed Computing |
The World Wide Web, CORBA and other Industry and Community standards
|
Crisis 2005 -- refined from National Research Council Scenario -- describes civilian crisis and how collaboration services would support |
Starting hyperlink of Crisis 2005 to technologies |
Bottom Up -- Expand Electromagnetics --> Weather System --> Full Information System |
Link with other bottom up projects such as Teachers and Kids Collaborating in Living Textbook |
Top Down -- Command and Control/Telemedicine rquirements link to and integrate with technology/bottom-up subprojects |
Use analysis of multiple application areas (also manufacturing(NASA/NRC), Health Care(NSF/NRC) digital libraries(NRC) education(SU/Livingtextbook)) to ensure properly build layered multi-use services on NII/HPCC |
The trip to the opera was the high point for the thousands of international visitors to the conference. |
They were streaming out of the new center which had been built in a decaying downtown area. Here old warehouses were still mixed with the proud new buildings of the economic redevelopment zone. |
Luke CyberCzar was in charge of the crisis center when the first 911 video dial tones showed the horrifying sight. A gigantic set of explosions rocked a set of old chemical warehouses and fires and fumes of unknown composition ringed the new opera complex. The frightened audience panicked and scattered this way and that into the surrounding alleys. Of course the digital video crews covering the opera immediately switched their cameras to this catastrophe. Just a few seconds after those 911 calls, all the MPEG decoders on the GII were presenting the chaos, damage and injuries live to a world whose cybereyes were trained on Luke. |
Injury and Damage implying major field operations with international scope |
Telemedicine accessing world wide records |
MPP and distributed cluster Simulations of Chemical fires and Wind blown transport of fumes |
Remote Command and Control supported by Televirtual Environment |
Digital Multimedia streams of data from on the spot video |
Universal common WebTop envirtonment from WebNewton to Supercomputer |
Adaptive network management including ISDN exploiting advanced compression |
Cellullar Connections and Electromagnetic simulations to optimize antenna placement for emergency communications |
Disparate distributed databases searched in real time using metadata |
3D Geographical Information Systems with real-time overlays for tactical decisions |
Training and Education from Maxwell(Electronic Intuition) to Computer Science and Testbeds such as FEMA and JWID |
Luke benefits from the natural convenient interface maximizing the effectiveness of the tired harried judgment maker. This build on advanced MOO and VR ideas and tailors the computer interface to the problem at hand. |
Luke sees a three dimensional GIS (Geographical Information System) when viewing the spatial confusion of the catastrophe; a virtual podium when he briefs cyberworld; a boardroom when defending his actions to angry foreign politicians; a summer wildflower meadow in moments of thought. |
He shares this virtual environment with Jane who is in charge of tactical operations for the crisis and by his electronic side at all times. |
They share this televirtual environment with other judgment makers and those facing the crisis in the field. |
Whether supported by supercomputer or hand held personal assistant, all access the same WebTop environment with a full range of collaboration and productivity tools whose capability adjusts to the available compute and communication resource. |
In this way the GII enables the best adaptive linking of "come-as-you-are" computational, communication and personnel resources. |
SGI Onyx SMP
|
ATM cluster
|
ISDN connectivity
|
VR displays
|
SGI Onyx SMP
|
ATM cluster
|
ISDN connectivity
|
VR displays
|
Simulation on Demand for Tactical Decision Support
|
Project to Demonstrate:
|
Identify Suitable Weather Simulation Code
|
Use of NPAC/Rome-Lab GIS Project
|
Interfaces to Visualisation Module
|
A Simulation on Demand InfoVision application using CM5 for simulation and AVS for coarse grain software decomposition support |
There is a larger Better Quality Image available |
C3I Systems are evolving from command flowdown to collaboration and visualization technologies |
Multi-Use COTS Technology (Hardware and Software) increasingly critical to cost effective and responsive systems |
Exploitation of synergy with other fields, such as medicine and collaboratory research critical to evolution of C3I capability. |
Develop/Apply technologies for collaborative, MPP supported C3I environment. |
Demonstrate alternative approach to reuse in C3I development:
|
Develop technical architecture that allows for:
|
Reviewed JWID-95 and C4I for the Warrior; also JWID-96 plans and Smart Push/Warrior Pull working group report |
Reviewed Fort Franklin III |
Now need to identify specific C3I missions and functions for RL support |
Presently investigating DMA databases and formats |
Identify key C3 concepts and objectives |
Ensure consistency with other tasks |
Incorporate existing service requirements or technology needs analysis |
Provide concept and application demonstrations |
Support involvement in exercises i.e., Joint Warrior Interoperability Demonstration |
NPAC and SRC, ARPA and EMCC Funded, Computational Electromagnetics on MPPs |
SRC ParaMoM - Large-scale Industrial Application, MoM-based CEM package for modeling Radar Cross Section of Full-Scale Aerospace Vehicles |
NPAC/CRPC - State-of-the-art Parallel Algorithms, Linear Algebra Software (ScaLAPACK), and Architectures |
Portable Parallel Implementation on Multiple MPPs and Cluster Architectures - IBM SP2, Intel Paragon, CM5 and PVM Workstation Clusters |
Good Speedup,Scalability,Portability Achieved |
A simple AVS-based visualization prototype system developed |
More Information - http://www.npac.syr.edu/users/gcheng/CEM/home.html |
Goal: Development of electromagnetic simulation for C3I missions and functions |
Have reviewed GEMACS (D. Leskiw of Ultra - note: GEMACS is RL software, but restricted access) |
Now need to define electromagnetic simulation demonstration and integration requirements for C3I |
Cooperation with SUNY Health Science Center (Dr. Robert Corona, neuropathologist, Director of Telemedicine and Medical Informatics) |
RL "Collaboratory and Telecommunication Experiments" project, progress in medical area:
|
Videoconferencing (Communique with Digital Video Everywhere environment) |
Application of volume visualization methods integrated with medical collaboratory system (David Warner, Nason Fellow in "Interventional Informatics") |
Virtual reality and its integration with WWW (VRML, WebSpace,...); real-time communication between people in the VR; visualizing people and their behavior |
Patient Record Database
|
Image Visualization, Image Processing, 3D reconstruction
|
Utilization of ongoing medicine activities on NYNET
|
Browsers have SAME interface on ALL Computers |
CGI Programs are typically written in PERL but can be essentially ANY UNIX Process and so do simulation, database access, advanced document processing etc. |
Application Specific NII Specific Services for
|
This implies that we look at both Grand Challenges and National Challenges but we suggest this is not enough: |
WebWork Builds HPCC technologies on a broad not niche base starting at bottom (Web,PC's) |
not top (MPP's, Supercomputers) of computing pyramid |
Illustrates 3 base layers of WebWork architecture and all main system components. |
A 4--node compute-web is represented
|
Java/HotJava model is used for WebFlow front-end implementation |
The paper describing this project is available at SCCS715 in NPAC technical report series |
Latest results prepared for HPDC95 Tutorial August 1,1995 |
A sample VRML page produced by Black Hole Simulation group at NCSA and displayed by SGI WebSpace, cooperating with Netscape Navigator. |
A set of 3D spaces related to gravity research is represented as Netscape icons and linked to the corresponding VRML worlds. |
WebSpace window displays one of these spaces -- a space-time diagram for two black hole collision ('Pair of Pants' diagram) |
Latest results prepared for HPDC95 Tutorial August 1,1995 |
Desktop Publishing and Productivity Tools in WebWindows (WebTop Productivity/Publishing)
|
InfoVision: Delivery on Demand of Information from:
|
Commerce -- digital Cash and signatures with appropriate authentication and security. Enables both Web Commerce (shopping) and use of Web for proprietary information |
Interactive and "batch" Collaboration
|
Metacomputing -- the collection of world wide computers as a coordinated (in subgroups of computers) computational engine (for simulation or information processing)
|
This is distributed databases for supporting cost effective healthcare with less fraud, better use of existing information for establishing care-plans etc |
This is collaboration, remote instrument control for telemedicine |
Could be full televirtuality for virtual-reality controlled remote surgery in battlefield or accident scenarios |
This is basis of Virtual University and NII can be expected to be much more succesful than videosystems because interactive, collaborative, explorative and full multimedia information at student and teachers fingertips |
Base of Distance Education is InfoVision for full interactive curricula
|
Rich Collaboration environments including televirtual MOO's for student-student and student-teacher interactions |
InfoVision is "successor" to TV with any multimedia information delivered on demand( choice from infinite number of channels) |
Community Networks will define local societies and will have significant impact on local government |
Shopping on the Web will include multimedia digital yellow pages , Commerce, online catalogs (which is InfoVision again) as well as perhaps powerful VR interfaces where you can try out new clothes and cars |
Collaboration (gossip as in computer forums) could be an important and dominant use but perhaps not initial major one |
OLTP (Online Transaction Processing) such as approving and recording credit card transactions. This is a type of InfoVision and Commerce which is operational today
|
Decision Support varies from fraud detection, inventory planning and market segmentation for optimizing shopping by mail |
Decision support can vary from search of a single giant relational database to galaxy-wide search of heterogeneous distributed database |
Workflow Support as in LOTUS Notes integrates Collaboration, Project Management and Distributed Databases. This supports ongoing distributed enterprise -- this is also essential in collaboratory |
Critical feature is realtime, "come as you are" adaptive linked computers and people |
Judgement support extends decision support into an "exploratorium" scenario as crises tend to be unexpected |
Major need to search community and government databases for immediate information on resource location and availability etc. Metadata(summaries) essential |
Collaboration between commander in field , specialized anchor desks (domain experts) and those in field. |
User Interface essential as user will be tired and searching unfamiliar data |
Geographical Information Systems and browsing multiple video sources (InfoVision again) will be critical as judgements will depend critically on spatial data. |
This is future model for (inter)national distributed research |
Rich Collaboration environment essential as collaborative research requires nontrivial person to person interactions |
Searching distributed databases basis of much scholarly work (infoVision and Digital Library) |
Metacomputing for multidisciplinary, multi-institutional simulations and for control and data storage and analysis from remote instruments whether satellites, telescopes, accelerators etc. |
Distributed (people) Software Engineering support for production of distributed computing software |
Needs workflow support as distributed enterprise |
Critical feature is closely integrated collaboration of very many people and computers requiring |
Metacomputing Simulation and distributed database support as in Collaboratory |
Workflow support including configuration management and central CAD databases |
Rich collaboration environment to support distributed design decisions |
Standards and Security to allow interlinking of people and software from different organizations |
Key special requirement is distributed coordination |
Collaboration Services - support distributed, virtual collocation of aeronautics development teams |
Configuration Control Services - provide configuration management for complex product data relationships |
Metacomputing Services - facilitate effective use of powerful, distributed computing services |
Security and Access Services - safeguard information and ensure validity of access to ASOP capabilities |
Object and Data Service - implement for data transformations and resource integration |
Demonstrate ability to produce a C3I functional framework without development of classic interface, integration and message handling software
|
Provide inherent evolution through incorporation of open, supported standards, rather than development of application code |
Key challenges: Integration standards that are appropriate for both internal system construction and for interface to web components, such as CORBA Extend the integration mechanism to support massively parallel domain processes (closely and loosely coupled) to support collaboration and visualization. |
Key requirement is development of an open standard to link standalone C3I applications to open services
|
Object Broker interfaces offer practical mechanism for:
|
CORBA - HTML/WEB Linkage Offers:
|
Technology Challenges
|
Virtual Reality -- Build on Rome Laboratory and Dave Warner locally as well Argonne/UIC(DeFanti EVL) nationally |
Compression critical for delivering quality digital video and audio which are essential in both "talking heads" and multimedia information systems (text-indexed video databases) |
Network Management uses Rome Laboratory and NYNEX sponsored work -- ensures adaptive reliable networks with high Quality of Service |
Collaboration -- currently digital video (InSoft, Proshare, SGI InPerson) is outside Web. It must as in Argonne Webspace/Labspace project be integrated with Web as this has other critical services |
Geographical Information Systems store and display (in 3D) spatially labelled data -- complementary to Web Browsers and relational databases for non spatial data |
Multimedia databases are linked to the Web and delivered indexing of associated text and synchronized audio and video streams delivered to clients |
World Wide Web supports general productivity tools(WebTools and WebFoil), Clustered Computing and Software Engineering environment(WebWork) as well as workflow(WebFlow) and databases -- Java and VRML critical developments |
High Performance Computers supply simulation, visualization and large database server support. They are linked by ATM networks and we use same software on MPP's as on clustered heterogeneous machines (metacomputing) |
CORBA and The World Wide Web are illustrative of pervasive standards to be used in next generation software |
Focussed effort at providing robust, usable, supported and well documented software to meet all NPAC's needs. |
Practical Integration Within NPAC:
|
Three Dimensions of Multimedia Extensions for Interactive Services
|
Rome Laboratory Collaborative and Interactive Visualization |
Rome Laboratory Collaborative and Interactive Visualization |
Supports the transport of large images and animation (video) with high resolution |
Eliminates redundant or less critical information
|
Decreases the time and cost of transmission and storage requirements |
Investigation of several image compression technologies
|
Power of wavelet-based methods - high quality, fast encoding / decoding, solid mathematical background |
Wavelet compression is represented by the weighted sum of basis functions together with quantization and coding |
Software available
|
Implementation of 2D still image wavelet compressor
|
Investigation of various video compression technologies
|
Wavelet-based implementation of hierarchical motion compensation and 3D subband coding already reported in the literature |
Wavelet video compressor
|
Focus: transport over low bandwidth ISDN network (BRI 2B + D = 144 Kbps) |
NPACBoard is a WWW based forum/bulletin board developed, written and support by NPAC. |
Based on CGI Perl scripts that create HTML pages and forms for processing the received Email messages. |
Key Features:
|
- Simple user interface and navigation |
- Email text automatically formatted into HTML pages |
- Support for WWW hypertext links, images and forms |
- Complete on-line help |
- Ability to age and remove old messages |
- Password protection of individual discussion groups |
- Automated installation procedure |
We use Landsat Satellite 30 meter horizontal resolution data for 2D images of New York State |
Digital Line Graphs are overlaid on map to show:
|
LULC (Land Use Land Cover) codes are overlaid on map |
Weather Extensions
|
From foilset WebTools (Spring '95) |
Associated Foil can be found |
Postscript also Available |
Shown with example of November 3 Presentation to Trustee Spouses |
We use Landsat Satellite 30 meter horizontal resolution data for 2D images of New York State |
Digital Line Graphs are overlaid on map to show:
|
LULC (Land Use Land Cover) codes are overlaid on map |
Weather Extensions
|
From Living Schoolbook Project |
Hot buttons linking to weather page in Albany area |
From Living Schoolbook Project |
This uses same 30 meter Landsat images combined with Digital Elevation Model (DEM) at 100 meter (horizontal) resolution |
This has applications not only to education (Living Schoolbook) but also to business and scientific visualization -- for instance ....... ! |
Enjoy a high altitude fly-by (virtual field trip for kids) of your city, state, country or Mars (courtesy of JPL) |
Analyse your business competition by showing the relation between population density and the location of competing businesses and their profits |
Animation of weather formations -- such as thunderstorms and lake effect snow -- on realistic background |
Demonstrate the effect of geographical features on weather and ocean current |
Analyse the relationship between pollution and population density |
From Living Schoolbook Project |
Goal: Enable dynamic data, scene contents and object behavior, and dynamic object interaction to support GIS |
Current VRML: flat files storage |
Disadvantages:
|
Proposed extension: |
Use of an object-oriented database system to store |
VRML data |
(*) extended semantics: objects modeled as world objects rather than as a set of polygons; composite objects possible; |
(*) objects have generic VRML descriptions; |
(*) boundaries of the world perceived by a user are not correlated with the way this world is described in the database; |
(*) world descriptions distributable; |
(*) objects behavior stored as scripting language; |
(*) database model not coupled to current VRML definition |
Advantages of Object-Oriented Model |
(+) ability to select only the relevant information; |
(+) multiple world views; |
(+) incremental world delivery to the browser; |
(+) world objects dynamic; |
(+) ability to introduce users to the world; |
(+) ability to support multiversioning |
No changes to the server side. All functionality provided by the database system |
Client side: the browser needs to be able to
|
Communication: not crucial for the proposed model |
Proposed implementation: |
Using San Diego VRML Viewer Webview |
Little Neck Bay in Northern Long Island (altitude exaggerated by factor 7) |
Using SGI VRML Viewer Webspace |
Little Neck Bay in Northern Long Island (altitude exaggerated by factor 7) |
Video acquisition infrastructure for digitization and compression of the video material is operational |
Video on demand environment has been installed. The environment includes a number of video server platforms and network infrastructure using switched ethernet and ATM delivery trunk. |
Living Schoolbook application testbed is operational. |
Client-server video on demand architectures have been implemented on a number of platforms. Streaming, real time video delivery has been implemented and integrated with Web front ends. |
Video indexing via closed-caption free texts search is ongoing. |
Integration with commercial Video for Windows technology is ongoing. |
Implementation of the new IP protocol dedicated to video delivery. Applications of the emerging RSVP and RTP protocols. |
Variable bit rate to constant bit rate conversion: theoretical framework completed, ongoing implementation. |
Simulation framework for realistic video server architectures has been set up and is being used to simulate and study different architectures and to assess their impact on the video server performance and functionality |
Use of the wavelet compression technology for video delivery. |
Searched on Inventions |
Web as a generic networking interface to access information systems built on RDBMS technology |
RDBMS as a powerful backend data engine to manage and manipulate information entities |
Web + RDBMS provides maximum information sharing,global user access and multimedia based GUI towards a truly collaborative information environment |
Current status
|
More Information - http://kayak.npac.syr.edu:1963 |
A Collaborative Information Environment for USENET Newsgroups and Mailing List |
Service-oriented information systems using Web server and Parallel Database Technology |
Data Mining in USENET Newsgroups and Mailing List Archives - User Search Pattern, News-on-Demand, Server Utilization Statistics, etc. |
Web Search System for Web Space on Remote/Global Web Servers
|
Full-Index Search System for Video-on-demand Server |
Integration of VRML and Object-Oriented Database Systems |
Integration of Java and RDBMS |
Oracle 7 Interface to Usenet-Prepared October 27,1995 |
Associated material may be found starting at Oracle-Web Interface to Usenet and other Services |
Oracle 7 Interface to Usenet-Prepared October 27,1995 |
Associated material may be found starting at Oracle-Web Interface to Usenet and other Services |
Produced by Gang Cheng April 1995 |
There is a larger Better Quality Image available |
Produced by Gang Cheng April 1995 |
There is a larger Better Quality Image available |
User-level WebWork metaphor is given by WebFlow -- a distributed dataflow model built in terms of WebWork modules and MIME object/document communication channels.
|
WebWork users will build and control distributed computing applications (compute-webs) using Web browsers based visual interactive editors and monitors. |
We are currently prototyping such WebFlow front-ends at NPAC using Java/HotJava model. WebWork modules are represented by Java threads (Screen 6) and visualized as interactive interconnected icons (Screen 7) |
Early prototype of AVS or Khoros like visual compute-web editor. |
Two interactive modes are supported:
|
In mode a), each click in the active editor window places a new module box there. |
In mode b), each click on module port generates links with all other modules. |
One current WebWork/WebFlow application, prototyped at NPAC, is Software Project Manager (Screen 8). Each software developer runs his/her WebTools server and uses HySource CASE tools. These servers are WWVM-connected to agent and manager servers. Agent server receives automatic notifications from developers servers on each software volume update, and uses customizable thresholds to decide when to fire a report to the manager or a deadline reminder to a developer. |
Software Project Manager tools contains a simple agent server that mediates between client/consumer ( here manager) and servers/producers (here developers). |
A front-end for the software project manager tool. |
Three types of modules are supported:
|
Developer modules are linked to the agent module and report automatically all changes in the software volume (handled by WebTools CASE toolkit integrated with WebTools editor). |
The agent module integrates the results and uses customizable threshold to decide when to fire a report to the manager or a deadline reminder to a developer. |
HyPerl World page, generated automatically by the WebTools CASE package, and integrating documentation with the source. |
More generally, we call by HySource the hypertext documentation with navigable source code included. |
Function calls and external variable references are 'blue' and point to the corresponding HySource pages. |
Implements the "Viable Base" Enterprise Model of HPCC Software identified in Pasadena2 workshop
|
Implements a powerful software engineering framework for parallel computing by integrating parallel programming with the World Wide Web Productivity Tools |
WebTools is a prototype developed at NPAC which is a base on which to build the Compute and Software Engineering Capabilities of WebWork |
An early development will be WebFlow -- a AVS/Khoros like system built on the Web which can be used for BOTH Computing (modules are executable software) and for management of Software Development task (modules are source code and people) |
Later can develop the full WebHPL -- a hybrid compiled/Interpreted environment implenting HPF/HPC++ etc system with Web infrastructure and front end |
Demonstrations keyed to specific technologies developed on contract. |
Provide C4I context to investigate utility/application of these technologies. |
Objectives keyed to:
|
Demonstrations keyed to program technologies |
Specific demos selected after target technology integration initiated.
|
Objectives established early in technology program. |
Anticipate investigating up to 6 candidates |
Final selection of 2 demos for development.
|
First decision
|
Second Decision
|
Candidates programs to be provided in next 90 days |
Joint RL-Syracuse working group should be initiated |