Given by Geoffrey C. Fox, Marek Podgorny at CEWES HPC Collaborative Methods and Tools Meeting on Februray 27 1997. Foils prepared February 25 97
Outside Index
Summary of Material
We describe ongoing and planned applications of the collaboration system TANGOsim to
|
Outside Index Summary of Material
Geoffrey Fox NPAC Syracuse University |
111 College Place |
Syracuse NY 13244-4100 |
We describe ongoing and planned applications of the collaboration system TANGOsim to
|
Entirely Web-based system (runtime implemented in Java) |
Able to tap any information resources |
Self-distributing software model (applets not applications) |
Unrestricted inter-applet communication |
Supports all basic collaboratory functions:
|
Control Application layout (started in Netscape browser). Two users logged in. List of available applications visible. |
Language independent: support for non-Java applications
|
Archiving system for session replays
|
Dynamic and flexible master-slave mode |
Entirely open, extensible system with growing set of applications |
Multiplatform: SGI/Sun/Win 95/NT |
TANGOsim mode provides support for discrete event simulations |
Used in Command and Control, telemedicine, and weather application in Rome Laboratory Project that funded. |
TANGOsim |
Basic |
Replicated Applications |
1)Virtual Users 2)Customized Views |
Feb 97 Demonstration of Tango |
TANGO Java |
Collaboratory |
Server |
HTTP |
Server |
MultiMedia Mail |
C2 Commander |
Chat |
VTC |
Event Driven |
Simulation |
Engine |
C2 Radar Officer |
3D GIS |
Scripting |
Language |
C2 Weather Officer |
Message Routing |
SW/Data Distrib. |
Other |
Collaborators |
MultiMedia Mail |
Chat |
Simulation |
Engine Controller |
All Clients |
Typical Clients |
Unmanned terrorist plane carrying bacterial weopen overflies New York with possible fighter intercept before crashing near Syracuse and requiring emergency response |
NORAD Air Defense Command and Control with participants
|
Participants can be real or virtual and have access to rich set of GIS and basic collaborative tools |
TANGOsim extends TANGO architecture by adding a discrete event simulator
|
Allows customizable server filters to support scenario and client dependent views of given application |
Allows real and virtual participants to be intermixed |
Provides natural Collaborative Computing framework with people and simulations/virtual people intermixed |
implements main C2 screen emulation |
multiscale georeferenced map sets with dynamic GUI |
selectable radar tracking and visualization |
multiple flying object visualization with interactive control |
intercept ovals calculation and visualization |
integrated tabular information display (State of forces) |
Driven by Simulation Engine |
Can to be driven by sensor output |
Serves as Interface to 3D Geographical Information System |
Feb 97 Demonstration of Tango |
3D Geographical Information System offers full 3D terrain and flying objects visualization
|
implemented in C++ using OpenInventor technology (started as VRML but too slow!) |
supports advanced data compression designed for adaptivity to heterogeneous network support |
Shows TANGO ability to integrate non-Java applications |
Feb 97 Demonstration of Tango |
distributed architecture based on OpenDVE/LiveMedia run time |
completely rewritten conference engine (lightweight - low latency) |
automatic discovery of potential collaborators |
integrated with TANGO
|
integrated with Netscape browser
|
multiplatform (UNIX, Windows 95/NT), interoperable |
supports multiple codecs (audio and video) |
Feb 97 Demonstration of Tango |
Feb 97 Demonstration of Tango |
Chatboard |
Collaboratory Web browser |
Collaboratory search engine |
Mmail - TANGO multimedia mail
|
Weather with 2D and 3D views and simulation and sensor data displays |
All apps collaboratory and compatible with Simulation Engine, hence scriptable. |
Screen of User1. Weather Report, Hopfield Neural Network and Cross Product applets started. |
Screen of User1. Chat and Collaborative HTML Browser applet started. |
Feb 97 Demonstration of Tango |
Pervasive technologies
|
Pervasive Technologies, cont.
|
Tango-Sim powerful functionality provides:
|
Tango-Sim database capabilities:
|
Will use public domain GIS data for CIV project
|
3D GIS viewers are being extended to provide "point and click" link capabilty as provided in VRML |
This capability will be supplemented by spatial query capabilities against the TIGER/Line/Census database |
Will use small Denver and full New York State 25 meter EOSTAT multispectral data |
NPAC VoD architecture has been integrated with TANGO
|
Java can help in both dissemination and collaboration aspects of education |
A Java GreenBoard |
Presented July 22 at Harbin Institute of Technology by Geoffrey Fox |
Web technologies have potential for interactive rich environments which are clearly superior to existing video based conferencing and distance education
|
Java Collaboration systems such as Habanero (NCSA), Shaking Hands(IBM) and Tango(NPAC) very important
|
CGI scripts and client side Javascript is straight forward today |
Virtual Programming Laboratory -- MPI, HPF on the Web -- deployed in Syracuse course CPS615 and next Cornell Virtual Workshop |
Java Applets for simulation as in Syracuse's Phy105/307
|
Multimedia databases with database search of close captions and other text material
|
Database supported Mail, FAQ, User support etc. |
VRML 2.0 for virtual environments and scientific visualization
|
Set of innovative interfaces (pressure, optical, muscle movement) linked to Java applets |
Link to web disseminated education |
http://www.npac.syr.edu/projects/pulsar
|
see http://www.npac.syr.edu/projects/pulsar |
Includes text triangle where every letter just requires 3 Gestures |
see http://www.npac.syr.edu/projects/pulsar |
From work of Ed Lipson and Dave Warner |
We have made Good Progress here using Web Technology |
WebWisdom is our System at NPAC built from PERL and JavaScript and features |
Built-in Audio |
Hierarchically Arranged Information |
Parameterized HTML |
Automatic Logging of pages accessed |
Set of Illustrations of JavaScript WebWisdom Education and Presentation Delivery System |
Set of Illustrations of JavaScript WebWisdom Education and Presentation Delivery System |
Uses linkage of TANGO to JavaScript WebWisdom which supports Persuasion, Powerpoint, HTML and Screendump mixed Presentations with audio (tagged to specific foils) and notes |
Full Webwisdom used by Teacher allows access to full curricula and options |
Client (Slave) WebWisdom displays pages chosen by teacher (with same audio and notes) and generates automatic HTML index
|
Currently WebWisdom used in non TANGO mode with classic large screen display |
TANGO WebWisdom allows one to use same approach to distributed PC's which is surely more attractive (Web font sizes designed for monitors -- not classroom displays) |
To allow use on low speed lines (28.8 kbaud modems), distribute CD ROM of material to students |
Client WebWisdom will map URL sent from Teacher WebWisdom to link on PC (if exists) and so ONLY control information is sent on Web |
Standard low bit rate codecs support audio and video conferencing over phone lines |
For asynchronous learning, ship HTML Index with lesson audio to clients and students use offline with TANGO used to support synchronous audio and video conferencing |
Will use in China (already succesfully used material Spring 96 Semester between Syracuse and Harbin) and for Syracuse University "Limited Residency" continuing programs where students visit University once to three times per semester (see Computing for the Future Certificates)
|
Most of the real world WebTop Systems will involve multi-user collaboratory modules. Even for scientific computing, complex toolkits such as WebAMR will be most conveniently supported by interactive consultation between developers and users. |
Collaboratory multi-user components will be further enhanced in enterprise, commerce and community systems. |
This is illustrated in our recent telemedicine prototype for nursing triage. Here we start from the collaboratory component involving nurses, nurse practioners and pediatricians and add HPCC components such as medical imaging and agent based diagnosis. |
We view the Bridge topology (Warner & Balch '95), underlying such telemedicine systems, as a promising generic framework, applicable also for other problem domains. |
A generic bridge includes "points of need", "points of expertise" and intelligent middleware that manages information resources and provides connectivity between customers and optimal services.
|
We present here examples of the bridge topology, instantiated in various application domains: |
Domain Points of Need Points of Expertise Typical Services |
TeleMedicine Nurses, Nurse Practioners Diagnosis
|
Command Troops Commanders Decision |
and Control Making |
Distance Learners Teachers Mentoring |
Education Students Consultants |
Commerce Consumers Vendors Product Support |
Science Schools Scientists Popular Science |
Collaboratory Small Businesses Technology Transfer |
There are several natural applications as Tango supports the "Bridge" concept of warner and Balch which effectively claims that Tango like approach is better model for TeleMedicine than classic videoconferencing/distributed sensor data model |
As well as rural distance medicine, we can see many opportunities for home health care especially for geriatric applications.
|
TANGOsim has interesting applications to medical education with "scenario" playing through particular medical test cases such as pathology images which residents in training are asked to diagnose in collaboration with experts discussing cases. Such events are typically observed by many largely passive people. |
In another example suggested by Saltz (John Hopkins) Tango could be used in team health care which involves both spontaneous collaboration and the asynchronous case represented by later expert consultants.
|
Clearly Java Collaboration Systems are natural implementations of general environments that mix computers and people |
Computational Steering -- a simulation is like a participant in a Tango session which has
|
Need to link to Tango, Java data analysis/visulaization front ends as well as distributed resource management systems such as ARMS from Cornell |
1)Classic solution of large scale PDE or Particle dynamics problem
|
2)Modest Grain size Functional Parallelism as seen in overlap of communication and computation in a node process of a parallel implementation.
|
3)Object parallelism seen in Distributed Simulation where "world" modelled (typically by event driven simulation) as set of interacting macroscopic (larger than grid points) objects
|
4)MetaProblems consisting of several large grain functionally distinct components such as
|
Java: 1) Not Supported, 2) is Thread mechanism, 3) is Java Objects or Applets, 4) is JavaBeans or equivalent |
Fortran: 1)is supported in HPF, 2--4) are not supported |
Note synergy with Java Server based distributed computing such as WebFlow which builds an AVS like environment with graphical interfaces to software Integration |
More ambitious to upgrade discrete event simulation component of TANGOsim to support full SIMNET/DSI (Distributed Simulation Internet) functionality. |
Note that Java is natural language for DSI/Forces Modelling because these typically use object parallelism which fits both language and applet/JavaBean capabilities. |
See discussion in http://www.npac.syr.edu/projects/javaforcse |