Given by TangoInteractive Team at Tango Presentation San Diego MRA on June 26 98 Datemod;June 26 98. Foils prepared
Outside Index
Summary of Material
Distance Education and the Virtual University where we also cover database issues |
Overview of Tango Architecture and Capabilities |
Health Care including Telemedicine |
Command and Control or Crisis Management |
We discuss Collaborative Engineering Design |
Collaborative Visualization and Computational Steering or more generally Collaborative Research |
In each case one needs a mix of Asynchronous and Synchronous collaboration and a mix of real-time and archival information. |
Outside Index Summary of Material
June 26-27 1998 San Diego MRA Meeting |
http://www.npac.syr.edu/users/gcf/mrajune98/tangooverview |
http://www.npac.syr.edu/tango |
Tango Team (Presented by Geoffrey Fox) |
Syracuse University |
NPAC |
111 College Place Syracuse NY 13244 4100 |
3154432163 |
Distance Education and the Virtual University where we also cover database issues |
Overview of Tango Architecture and Capabilities |
Health Care including Telemedicine |
Command and Control or Crisis Management |
We discuss Collaborative Engineering Design |
Collaborative Visualization and Computational Steering or more generally Collaborative Research |
In each case one needs a mix of Asynchronous and Synchronous collaboration and a mix of real-time and archival information. |
Let us assume that distributed users and cost in time and travel dollars implies that distance learning attractive |
Choice 1: Education or Training (more focused material typically without university credit)
|
Choice 2: Asynchronous (access to web based material) or Synchronous (teacher interacting with students in real time) or both
|
Authoring: Produce High Quality Curricula |
Store Conveniently: Use Web dissemination and some sort of database (from a file system to commercial database such as Oracle or Microsoft Access)
|
Deliver: Synchronous or Asynchronous Collaboration |
Collaboration also supports research as well as education/training -- builds "Learning Communities" |
Collaborative Systems share information between students and teachers either synchronously
|
or asynchronously as in Lotus Notes
|
All can be integrated using web export of database/Lotus Notes as a common interface (XML is particularly attractive here) |
Taught using Tango over Internet (now DREN via CEWES) every Tuesday and Thursday from Syracuse
|
Jackson State major HBC University with many computer science graduates |
Do not compete with base courses but offer addon courses with "leading edge" material (Web Technology) which give JSU graduates skills that are important in their career
|
Needs guaranteed 30 (audio) to 100 (video) kilobits per second bandwidth assuming course material mirrored at JSU
|
This illustrates that synchronous delivery is a "guided tour" of large asynchronous resource -- 250 megabytes in total |
Universities "specialize" and deliver courses in areas of expertise
|
JSU will lead HBCU wide deployment |
NPAC is studying use internationally |
Pilot for distance training for DoD |
NPAC Web Server |
JSU Web Server |
JSU Tango Server |
... |
Audio Video Conferencing Chat Rooms etc. |
Address at JSU of Curriculum Page |
Teacher's View of Curriculum Page |
Student's View of Curriculum Page |
Participants at JSU |
Teacher/Lecturer at NPAC |
Students liked the job relevant skills taught |
Important to have curricula mentor and technology expert at remote site; important to visit 2 or 3 times a semester |
Digital Audio/video less stressful to lecturer than speaker phone |
"Shy" students are helped by remote format as digital interactions are "personality neutral" |
Need to keep to the point -- digressions, which are often helpful in standard lectures, tend to lose students |
Need to keep everything synchronized -- chat as we tended to use it caused confusing delay |
Experiments were successful but conservative -- we deliberately tried to reproduce "time honored approach" -- we can expect there to be different optimal approach in distance case than in face to face case -- find by more experiments! |
Major technical problems
|
Several obvious technology improvements
|
Most interesting is new modes with graduate assistant manning ancillary tools such as chat rooms to enhance richness of interactive sessions
|
Extend use of Tango to other collaborative applications |
Shared display (SIMD Model of Collaboration): |
Single instance of application, user input & display replicated via conference agent
|
Event broadcasting (MIMD model of collaboration): each workstation runs its own copy of application.
|
As primary Web function is asynchronous information publishing, Web-based collaboratories inherently link two models
|
Web database linkage technology (based on JDBC/ Enterprise JavaBeans) promotes complex asynchronous collaboration by exposing rich data models of industrial-strength relational and OO DBMS's |
Need Both! Tango can be linked to Oracle, Lotus Notes and similar systems -- XML seems a powerful interface for such linkage |
95 |
Java application
|
100% maintenance free |
Industry-strength stability |
Platform-independent
|
Available for download from http://www.npac.syr.edu/tango |
Java Tango |
Server |
Netscape Browser |
Tango |
Daemon |
Shared Applet 1 |
Shared Applet 2 |
Shared |
Java/C++/.. |
Application |
Socket Connections |
Client Side Bus |
Netscape's |
LiveConnect |
Typical Client |
Other |
Collaborating |
Clients |
Shared |
JavaScript/ Web Page |
Tango CA |
N: Netscape Browser |
LD: Local Daemon |
CA: Control Application |
AP: Applet |
LA: Local Application |
CS: Central Server |
DB: Back-end Database |
(for archiving -- NOT implemented yet) |
HTTP: Web server |
Daemon provides a mechanism for TANGO components such as Java applets, central server, JavaScript scripts etc. to talk to each other. |
TANGO daemon has been implemented as a plug-in. |
Using LiveConnect mechanisms, each applet residing in the same page with the plug-in may obtain its handle. |
Message passing between plug-in and an applet is achieved by calling appropriate methods of each other |
Tango supports a synchronous shared event model of collaboration |
Tango supports (more than) enough (over 40) applications |
Core Collaboration Capabilities
|
Databases Linkage (Under Development)
|
Office and Authoring Tools
|
Critical for Education |
General Virtual University Applications
|
Special Virtual University Applications
|
WebWisdom |
Chat |
Shared Browser |
Audio Control |
Tango Control App |
CONTROL |
Shared Planetary Motion Applet |
Shared Cross Product Educational Applet |
Shared Neural Net |
Have some fun with Multi-player games
|
"Other" Applications
|
CONTROL |
Shared VRML 3D Visible Human |
Shared Browser Page |
Chat |
Tango provides for any developer:
|
If you have a set of Web pages defined by their URL's -- then use today the Shared Browser and later on can store in WebWisdomNT database for a more powerful model |
If you have some enhanced Web Pages using Cookies and Forms (and wish say, to share form input), then we need to use shared JavaScript API -- we can provide this as general capability |
If you wish to share server side results as in Lotus Notes (or CGI Scripts), then exploit web export of these servers -- XML very powerful here -- with a variant of shared browser |
If you have a client side program, then you need to know an API to it which allows one to get and set all the properties (or events which are change of properties) |
Most elegant interface is a TangoBean which implements shared Javabeans
|
In any case, you choose events to be shared; meaning of master/slave relationship (if any) and consequence of sharing on disparate machines
|
Note that in Audio-Video Conferencing, Video on Demand, and Microsoft NetMeeting applications, Tango "just" provides session control to another application which provides itself all the necessary data distribution
|
It is a much more robust system than a few months ago and major activity recently has been in changing architecture and working around browser bugs/features to improve reliability
|
We are mainly focussing on applications and would like collaborators |
Intend to support two types of use
|
Download Tango 1.0X now |
We intend enhancements to some applications -- such as full annotation (on the Java Whiteboard) with database access and archiving in WebWisdomNT |
We will evaluate Internet Explorer version (prototype available), Macintosh and AIX support |
Archive audio-video conferencing, text chat etc. |
Looking into a built in window manager, more automatic support for mirror (content) servers |
Link Tango user module with administrative (class) database -- link Tango and conventional mail |
Lots of interesting assessment opportunities |
Could build Collaboratory tools -- scientific visualization will be supported but also could do debuggers, performance visualizers etc. |
EOT PACI has identified NCSA Biology Workbench, BU Biology database, and for K-12 Belvedere annotation system |
Can offer "Certificates in Internetics or Computational Science" (Total of 6 semester classes) |
Can offer internally Web and Java classes for K-12 level |
All these courses are in form suitable for synchronous/asynchronous delivery |
Taught two semesters from Syracuse over Internet a Senior Undergraduate Class in Java for web applications at Jackson State Mississippi using Tango collaboration system |
This fall will combine with local CDROM to teach computational science at Jackson using full asynchronous and synchronous support |
Collaboration with Peking University to set up ICWU or "International Collaborative Web University" with initial focus on Internetics |
At K-14 education level, dominant emphasis is "building learning communities" and tools to support collaborative learning
|
Web collaboration is central to many other applications |
Thus there are many leverage points
|
We have discussed Distance/Collaborative Learning Community Education and training-- teachers and students (and administrators) |
Not so directly relevant to this group, we have: |
Forums and Chattering on the Web -- the world! |
(Tele)medicine -- Doctors (primary and specialist referrals), Nurses, Patients and administrators |
Business Enterprise (strategic) Support as in Lotus Notes -- Employees of Business including especially managers |
On next page, we find there are applications of direct relevance to DoD HPC users |
Crisis Management and Command and Control or more generally distributed (tactical) real-time decision support -- decision makers and gatherers of information |
Multidisciplinary Applications including Collaborative design -- teams of up to 10,000 engineers |
Collaborative Visualization/Data Analysis and Computational Steering -- one or more computational scientist and visualization device |
Consulting and shared software/systems development |
In each case Collaboration involves support for dynamic interactive shared distributed objects and one needs both synchronous (as in Tango/Habanero) and asynchronous (basic Web/Lotus Notes/Email) support |
The shared objects are both client and server side |
There are several natural applications as Tango supports the "Bridge" concept of Warner and Balch which effectively claims that dynamic collaboration ("Interventional Informatics") approach (as supported by Tango) is better model for TeleMedicine than classic videoconferencing/distributed sensor data model |
As well as rural distance medicine, we can see many opportunities for home health care especially for geriatric applications.
|
Note analogies between C2 and medical planning and decision support with several different experts and people with different skills in the field
|
Tango has interesting applications to medical education with "scenario" playing through particular medical test cases such as pathology images which residents in training are asked to diagnose in collaboration with experts discussing cases. Such events are typically observed by many largely passive people. |
In another example suggested by Saltz (John Hopkins/Maryland) Tango could be used in team health care which involves both spontaneous collaboration and the asynchronous case represented by later expert consultants.
|
Unmanned terrorist plane carrying bacterial weapon overflies New York with possible fighter intercept before crashing near Syracuse and requiring emergency response |
NORAD Air Defense Command and Control with participants
|
Participants can be real or virtual and have access to rich set of GIS and basic collaborative decision support (planning) tools |
TANGOsim processes human and computer generated events -- latter come from an event driven simulator |
TANGO Java |
Collaboratory |
Server |
HTTP |
Server |
MultiMedia Mail |
C2 Commander |
Chat |
VTC |
Event Driven |
Simulation |
Engine |
C2 Radar Officer |
3D GIS |
Scripting |
Language |
C2 Weather Officer |
Message Routing |
SW/Data Distrib. |
Other |
Collaborators |
MultiMedia Mail |
Chat |
Simulation |
Engine Controller |
All Clients |
Clearly Java Collaboration Systems are natural implementations of general environments that mix computers and people |
Computational Steering -- a simulation is like a participant in a Tango session which has
|
Distributed Modeling and Simulation (from DMSO) with "humans and computers in the loop" already has this type of architecture |
NCSA has developed a prototype collaborative visualization system using Tango (2D and 3D images can be shared by participants with viewpoint and choice of rendering replicated) |
This combines TANGO for collaboration with web and distributed object based computing and database systems on the server side |
Whatever the computation one can link to it by exporting the results to CORBA or the Web and using this interface to get synchronous or asynchronous collaboration
|
NPAC is demonstrating a prototype of this type of system using WebFlow |
On client one can share tools such as CAD systems like CATIA or AUTOCAD so Tango interfaces with API to these system and drives "slaves" from state extracted from linkage to master. |
Computing Systems like NPAC's WebFlow control flow of information between linked objects. For example, in dataflow model, user must supply routines to process input of data that drives a given module and output of data for other modules |
TANGO supports shared objects and user supplies routines that read or write either
|
In each case one needs an API to object which can either be proprietary (as in AUTOCAD or ArcoInfo GIS) or generic as in CORBA or Web Middle tier linkage |
Wearable computers (with components such as battery, disks, CPU) wore on a belt with a handheld monitor (640 by 480 today) allow us to bring a computational grid to the warfighter |
There would be a wireless link using low speed digital cellular connection |
There is enough memory and disk to run a browser and Tango client on the remote unit |
This links implementers in field together and to central decision support |
The 1997 wearable computer technology is shown in foil but perhaps most intriguing are devices like the JavaRing where 14,000 distributed at 97 JavaOne conference
|
Database query and access including indexed video clips |
Delivery including specialized VRML, GIS (virtual worlds), Simulations as well as classic HTML |
Collaboration or sharing of interactive objects
|
User interfaces for disabled individuals (universal access) |
Security for proprietary material and personal information |
Quality of Service based on replication and bandwidth trade-offs
|
Conversion and Integration of Legacy material |
Authoring (object creation) tools |
Assessment Administration and Logging Tools |
Specialized services such as programming laboratories |
Use a database to store material so as to
|
Database has curricula material of all (4) levels of sophistication and supports both synchronous and asynchronous learning
|
Educational Objects i.e. |
Data Defining Curricula Material at all levels from "University" to "foil" |
Server side |
Java(JDBC) |
as servlets |
Metadata |
Web/Video Server |
Conventional HTML Pages |
Dynamically Generated |
(IMS/ADL) Metadata |
Streaming Audio/Video |
Web Browser |
Templates Defining How educational data stored in Pages |