Given by Geoffrey Fox at CPS616 Basic Information Track for Computational Science on Winter-Spring Semester 96. Foils prepared 22 January 1996
Abstract * Foil Index for this file
See also color IMAGE
HealthCare including Telemedicine |
Education including K-12 and Virtual University |
The mass market -- "Society" ! |
(Business) Enterprise Systems |
Defence Command and Control and civilian Crisis Management |
Collaboratory -- the new way of doing research |
Manufacturing of Complex Systems (aircraft) |
These are related to multi-use NII Services and Technologies |
This table of Contents
Abstract
Instructor: Geoffrey Fox |
teamed with Wojtek Furmanski, Nancy McCracken |
Syracuse University |
111 College Place |
Syracuse |
New York 13244-4100 |
HealthCare including Telemedicine |
Education including K-12 and Virtual University |
The mass market -- "Society" ! |
(Business) Enterprise Systems |
Defence Command and Control and civilian Crisis Management |
Collaboratory -- the new way of doing research |
Manufacturing of Complex Systems (aircraft) |
These are related to multi-use NII Services and Technologies |
Desktop Publishing and Productivity Tools in WebWindows (WebTop Productivity/Publishing)
|
InfoVision: Delivery on Demand of Information from:
|
Commerce -- digital Cash and signatures with appropriate authentication and security. Enables both Web Commerce (shopping) and use of Web for proprietary information |
Interactive and "batch" Collaboration
|
Metacomputing -- the collection of world wide computers as a coordinated (in subgroups of computers) computational engine (for simulation or information processing)
|
This is distributed databases for supporting cost effective healthcare with less fraud, better use of existing information for establishing care-plans etc |
This is collaboration, remote instrument control for telemedicine |
Could be full televirtuality for virtual-reality controlled remote surgery in battlefield or accident scenarios |
SUNY HSC is juxtaposed to Syracuse University Campus and hopefully NYNET will extend from NPAC to SUNY HSC |
Initial Experiments demonstrated to Hillary Clinton and involved:
|
SUNY HSC responsible for large rural area including Adirondacks |
Image Processing on MPP for Pathology Images using multi-resolution browsing techniques
|
Patient Records and Results of Medical Instruments and emergency room analysis can be viewed by specialist doctors from either their home or central hospitals |
Telemedicine concepts until mid '95 were based on the assumption of rapid onset of the broadband wide area networking infrastructure. |
Dominant anticipated medium was direct life video linkage between patients and physicians. |
However this is not considered by some to be very succesful and new approach to Telemedicine is based on decision support for doctors with an environment very similar to that needed by Command and Control in the military or the LOTUSNotes like environment in Business
|
Slowdown in the ATM deployment, rapid explosion of Web technologies with variable bandwidth conditions, and new social and economic needs for the managed care based medicine, implies currently the paradign shift in the near term telemedicial environments. |
this the first step in the systematic conversion of poorly organized Web HealthCare material into a set of (Oracle) databases - this particular one stores individual URLs with short descriptions as RDBMS records (so they are automatically searchable, editable etc) |
Next steps will include grouping into subdomains, linkage with patient records as on-line aid for the medical personel (nurses) etc. |
Warner' team came up with the Bridge Concept which was prototyped by his organization I3 and ECU and succesfully demonstrated with Web Components from NPAC at WWVR'96 in San Diego |
The Bridge connects patients/care portals with quality healthcare professionals (DOCking stations) via the intelligent middleware station(this will be Web), offering suitable routing and optimizing the message traffic, service quality and expert time utilization. |
The emerging Web based framework (WebMed) addresses near term implementation in terms of today's networks and matches the social/patients and HMO/economy needs in terms of pervasive low cost infrastructure. |
New Web based telemedicine initiative WebMed at NPAC addresses these issues in a set of planned pilot projects. |
Rome Laboratory Collaborative and Interactive Visualization Jan 31,96 |
Rome Laboratory Collaborative and Interactive Visualization Jan 31,96 |
Robert Corona - previously family practitioner, now neuropathologist at SUNY HSC, provides both general and specialized medical expertise and connectivity (via CareNet program) with CNY telemedicine activities. |
Wojtek Furmanski - SU/Physics & NPAC, expertise in interactive Web technologies, distributed software engineering and system integration. |
Edward Lipson - SU/Physics, expertise in biophysics, medical imaging, connectivity with other SU activities in telemedicine. |
Roman Markowksi - SU/NPAC, expertise in ATM, networking infrastructure and core technologies (streamlined media, databases) |
Dave Warner - I3/Loma Linda and SU/NPAC (Nason Fellow), expertise in use of human sensory interfaces for rehabilitation and disabilities, overall vision of and connectivity across domains of the telemedical society. |
Syracuse University School of Nursing |
WWW already offers a vast amount of useful information in the healthcare area but its localization and maintenance becomes increasingly complex with the Web expansion. |
The goal of this thrust is to develop a systematic procedure for scanning the Web, selecting information relevant for the pilot projects, and constructing a set of relational or OO/MultiMedia databases. |
Natural approach is to use relational (text) or object(2D and 3D images) databases to store this information which will become the background "information sea" for future Web based TeleMedicine |
Oracle database with Java/JavaScript Frontend is Natural Web based patient care database
|
Rome Laboratory Collaborative and Interactive Visualization Jan 31,96 |
Rome Laboratory Collaborative and Interactive Visualization Jan 31,96 |
Rome Laboratory Collaborative and Interactive Visualization Jan 31,96 |
Rome Laboratory Collaborative and Interactive Visualization Jan 31,96 |
School Nurse - Web based patient record database with links to medical information (diagnosis, treatment) and 3 hierarchy levels:
|
This is a Pilot project to prototype an instance of the telemedicine Bridge concept. |
Home care terminals - Our initial project is a Web (Java/JavaScript) version of Warner's "neat thing" sensory front-end, with rehabilitation and disabilities as initial application target.
|
This allows Doctors to interact with Patients at the Home with Instruments monitoring their health
|
By dragging and clicking the mouse, one can assign up to 16 data channels to various input and output devices. Here the interface box is connected to serial port #2 of the PC and its four pairs of electrodes (leads) are assigned respectively to channels 1 through 4. One can also specify running-average or other filters to the individual data channels. |
Channels are calibrated to select "windows" of their ranges of signal amplitude. The green and red lines, which are set by mouse dragging and clicking, set the lower and upper limits of the range of interest. When a signal is within range, the button turns from blue to green, and this condition can correspondingly control a binary output device. |
A multichannel oscilloscope-type display is available to monitor continuously the time course of an input signal. This mode is particularly useful for training a disabled subject, such as a quadriplegic, to activate certain channels for actions such as a) wheelchair control or b) mouse-cursor control for Web surfing (by conscious activity of various facial muscles). |
Medical Imaging Web Server - an advanced image processing toolkit, including publicly available and in-house developed (e.g. wavelet compression or pattern recognition) algorithms, packaged and published as a Web service to aid (possibly collaboratory) diagnosis process in the areas of radiology and pathology.
|
Other, very recently identified possible projects include
|
This is basis of Virtual University and NII can be expected to be much more succesful than videosystems because interactive, collaborative, explorative and full multimedia information at student and teachers fingertips |
Base of Distance Education is InfoVision for full interactive curricula
|
Rich Collaboration environments including televirtual MOO's for student-student and student-teacher interactions |
We can use Web technologies to develop new very important tools for education enabling
|
We can teach these new technologies as world hungry for people understanding these technologies
|
http://www.npac.syr.edu/users/gcf/npacaddons -- see foil 105 |
Java provides a convenient way to build flexible graphics interfaces |
The screendump shows the message passing traffic and status of (36) parallel nodes used in a sorting algorithm |
In the example, the 36 threads are running the explicit algorithm on the client |
Alternatively and more generally, the threads are replaying a trace of the program which is or was running on a separate set of nodes |
If one uses Web Servers to control master parallel computation or more generally integrates Web into computing, these Web servers can naturally feed event traces into Java based display
|
Living Schoolbook -- Prototype of K-12 Educational Environment of year 2000
|
HPDC95 Tutorial and Other Computational Science Courses CPS600, CPS615
|
Physics 105/106 -- Science for the 21st Century (for non-Scientists) -- Some course modules built around Multimedia Information Systems
|
This hyperlinked material accounts for about 10% Phy 105, 20% Phy 106 and expect to increase if success continues
|
The Living Schoolbook is a New York State funded Initiative to create K-12 educational applications that exploit leading information technologies |
Living Schoolbook Base Educational Services are:
|
Living Schoolbook Leverages Information Technologies
|
The Project Team
|
Upstate Project Schools
|
Downstate (New York City) Project Schools
|
askERIC Educational Database for teachers with consultation |
The Discovery Channel -- Video Content Provider |
NewsBank -- Text Content Provider |
Reuters News Service |
Syracuse Language Systems -- Learn Foreign Languages on Demand |
TravelVenture -- Interactive travel information on Demand |
US Air Force Rome Laboratory -- InfoVision technologies |
WorldView Corp. : Interactive Client-Server Geographic Information System |
FLAG is an enterprise in which NYNEX Network Systems Company is a major (roughly 40%) investor. |
Current fiber link from U.K. to Japan (via Africa) is being constructed at an approximate $1.4B cost |
Natural Strategy is for Web Servers in U.S.A.. to deliver educational material via FLAG to Africa and Far East |
This would set up hierarchically as:
|
Real-Time Compression critical for interactive use of FLAG as lines are costly -- note Internet is free but needs compression as overloaded .... |
Many students from these countries come to the U.S.A.. now but ...
|
In Virtual University, one sets up a partnership between U.S.A.. and overseas University where key curricula and its delivery are provided over GII (Global Information Infrastructure of which FLAG is one example) |
High-end PC's should be included as possible Web server for Africa even we use SP-2, multi-processor SGI etc. as server in U.S.A.. University |
A NYNEX Joint Venture |
This shows fiber draping Africa with coast off ramps |
See electronically for actual home page |
Computational Science is an interdisciplinary field that integrates computer science and applied mathematics with a wide variety of application areas that use significant computation to solve their problems |
Includes the study of computational techniques
|
Includes the study of new algorithms, languages and models in computer science and applied mathematics required by the use of high performance computing and communications in any (?) important application
|
Includes computation of complex systems using physical analogies such as neural networks and genetic optimization. |
IMM is a Joint Program Set Up Between
|
IMM could be cornerstone of proposed "Information Initiative" |
IMM degree involves 36 units -- 12 courses of which 6 are required |
Courses are divided into Four Tracks |
6 required Courses are:
|
Track1: Multimedia Systems and Tools -- this is
|
Track 2: Multimedia Design and Applications -- this is
|
Track 3: Aesthetics and Ethics in Multimedia -- this is
|
Track 4: Management and Evaluation of Multimedia --
|
Each track has a core required course and a set of introductory and advanced electives |
Student must take 6 electives -- one of which must be in each track |
Electives will be offerred at various times but basic cycle is summer to summer (1.3 year time) |
Summer: Proseminar |
Fall: Core course for Track 1: Multimedia Systems
|
Fall: Core course for Track 2: Multimedia Design
|
Spring: Core course for Track 3: Aesthetics and Ethics
|
Spring: Core course for Track 4: Management and
|
Summer: Capstone Experience |
SImulation Track -- Graduate
|
Masters in Computational Science built around these core copurses CPS615,713 |
Simulation Track -- Undergraduate
|
CPS 401/601 IMM 601 Multimedia Systems and Tools -- Core course for Track 1 of IMM degree |
CPS 403/703 Computational Science Elective: 1 Lecture a week -- rest Laboratory -- elective for IMM |
CPS 406/606 Introduction to Information technologies and Systems -- designed as elementary elective for IMM |
CPS 616 Overview of Information Track Computational Science -- advanced elective for IMM |
CPS 714 Case Studies in Information Applications of Computational Science -- advanced elective for IMM |
"Web Technology"/Information Track of Computational Science Masters built around CPS 616,703,714 |
Certificate in Computational Science offered at Peking University and Harbin Institute of Technology Spring 1996 is a prototype of Syracuse University (ECS/NPAC) based extension school |
As Internet Connections to China are not guaranteed to be great(!) we will use Web Technology but assume that Electronic Course material will be packaged at NPAC(SU) in a Pentium PC running WindowsNT and Java
|
This will be updated in batch mode by Syracuse -- China Connection |
Students in China will Interact with mentors in China and with NPAC via Internet (web and email) |
Project designed by Fox,Leskiw(NPAC), Xiaoming Li(Harbin and Peking visiting NPAC) |
Graduate Students -- initially 5 to 10 at each of 2 University |
4 Courses -- each 10 1 hour lectures -- offered Spring 1996 over 20 week period |
ICPS 700: Introduction to Simulation Track of Computational Science
|
ICPS 701: Parallel Programming Laboratory
|
ICPS710: World Wide Web Technology
|
ICPS711: Web Programming
|
InfoVision is "successor" to TV with any multimedia information delivered on demand( choice from infinite number of channels) |
Community Networks will define local societies and will have significant impact on local government |
Shopping on the Web will include multimedia digital yellow pages , Commerce, online catalogs (which is InfoVision again) as well as perhaps powerful VR interfaces where you can try out new clothes and cars |
Collaboration (gossip as in computer forums) could be an important and dominant use but perhaps not initial major one |
Video and Server Technology Network is prototype of Wire Service of future using Web Technology to service Mass Communications Industry |
Partner with this field (Newhouse School) to find out how to author on-line video and other multimedia material |
NYNET ATM network extended internally to allow linkage of NPAC to Newhouse School of Public Communications and University Electronic Media Production Unit |
Faculty and students -- the multimedia digital journalists of the future will use:
|
Study Integration digital editing (AVID) technology of media field with digital web and powerful computer technology. |
Industrial partners from traditional print and analog video fields
|
OLTP (Online Transaction Processing) such as approving and recording credit card transactions. This is a type of InfoVision and Commerce which is operational today
|
Decision Support varies from fraud detection, inventory planning and market segmentation for optimizing shopping by mail |
Decision support can vary from search of a single giant relational database to galaxy-wide search of heterogeneous distributed database |
Workflow Support as in LOTUS Notes integrates Collaboration, Project Management and Distributed Databases. This supports ongoing distributed enterprise -- this is also essential in collaboratory |
The World Wide Web will develop a marvellous WebTop Environment allowing users to access Web versions of Word Excel(Lotus123) Persuasion(Powerpoint) Databases Lotus Notes etc.
|
This (as developed) enables a wonderful new software industry as Microsoft no longer has key advantages |
This (as used) enables very effective (business) enterprise systems where "Web" used internally to an enterprise
|
Focus on manufacturing industry
|
Large industry typically has
|
WWW information system support
|
Incorporate database in WWW information system
|
WWW internal information server
|
With incorporated database support
|
Groupware is major new direction for many industries |
Huge market for Lotus Notes groupware |
Groupware elements (according to Lotus Notes)
|
Information systems and database operations of Lotus Notes
|
Network (including WWW) based open systems Groupware
|
Current interactivity: CGI perl, C, database
|
Java or Java-like capabilities
|
VRML for 3-D visualization
|
WebTools: server to server communication
|
Critical feature is realtime, "come as you are" adaptive linked computers and people |
Judgement support extends decision support into an "exploratorium" scenario as crises tend to be unexpected |
Major need to search community and government databases for immediate information on resource location and availability etc. Metadata(summaries) essential |
Collaboration between commander in field , specialized anchor desks (domain experts) and those in field. |
User Interface essential as user will be tired and searching unfamiliar data |
Geographical Information Systems and browsing multiple video sources (InfoVision again) will be critical as judgements will depend critically on spatial data. |
The trip to the opera was the high point for the thousands of international visitors to the conference. |
They were streaming out of the new center which had been built in a decaying downtown area. Here old warehouses were still mixed with the proud new buildings of the economic redevelopment zone. |
Luke CyberCzar was in charge of the crisis center when the first 911 video dial tones showed the horrifying sight. A gigantic set of explosions rocked a set of old chemical warehouses and fires and fumes of unknown composition ringed the new opera complex. The frightened audience panicked and scattered this way and that into the surrounding alleys. Of course the digital video crews covering the opera immediately switched their cameras to this catastrophe. Just a few seconds after those 911 calls, all the MPEG decoders on the GII were presenting the chaos, damage and injuries live to a world whose cybereyes were trained on Luke. |
Injury and Damage implying major field operations with international scope |
Telemedicine accessing world wide records |
MPP and distributed cluster Simulations of Chemical fires and Wind blown transport of fumes |
Remote Command and Control supported by Televirtual Environment |
Digital Multimedia streams of data from on the spot video |
Universal common WebTop envirtonment from WebNewton to Supercomputer |
Adaptive network management including ISDN exploiting advanced compression |
Cellullar Connections and Electromagnetic simulations to optimize antenna placement for emergency communications |
Disparate distributed databases searched in real time using metadata |
3D Geographical Information Systems with real-time overlays for tactical decisions |
Training and Education from Maxwell(Electronic Intuition) to Computer Science and Testbeds such as FEMA and JWID |
Luke benefits from the natural convenient interface maximizing the effectiveness of the tired harried judgment maker. This build on advanced MOO and VR ideas and tailors the computer interface to the problem at hand. |
Luke sees a three dimensional GIS (Geographical Information System) when viewing the spatial confusion of the catastrophe; a virtual podium when he briefs cyberworld; a boardroom when defending his actions to angry foreign politicians; a summer wildflower meadow in moments of thought. |
He shares this virtual environment with Jane who is in charge of tactical operations for the crisis and by his electronic side at all times. |
They share this televirtual environment with other judgment makers and those facing the crisis in the field. |
Whether supported by supercomputer or hand held personal assistant, all access the same WebTop environment with a full range of collaboration and productivity tools whose capability adjusts to the available compute and communication resource. |
In this way the GII enables the best adaptive linking of "come-as-you-are" computational, communication and personnel resources. |
This is future model for (inter)national distributed research |
Rich Collaboration environment essential as collaborative research requires nontrivial person to person interactions |
Searching distributed databases basis of much scholarly work (infoVision and Digital Library) |
Metacomputing for multidisciplinary, multi-institutional simulations and for control and data storage and analysis from remote instruments whether satellites, telescopes, accelerators etc. |
Distributed (people) Software Engineering support for production of distributed computing software |
Needs workflow support as distributed enterprise |
Critical feature is closely integrated collaboration of very many people and computers requiring |
Metacomputing Simulation and distributed database support as in Collaboratory |
Workflow support including configuration management and central CAD databases |
Rich collaboration environment to support distributed design decisions |
Standards and Security to allow interlinking of people and software from different organizations |
Key special requirement is distributed coordination |
A set of manufacturing companies -- Rockwell International, Northrop Grumman, McDonnell Douglas, General Electric and General Motors is studying the NII implications for a particular MAD system "Affordable Systems Optimization Process" (ASOP) |
Interesting parameters are that next major aircraft to be built could involve:
|
Customizes general NII technologies to ASOP specific requirements |
Provides the object, wrapper and agent services to share data in the ASOP design environment |
Conforms to applicable protocol, ontological and data standards |
Defines management, retrieval, and control functions for heterogeneous data and methods distribution |
Interfaces to Team Infrastructures |
Employs emerging "open" NII services to support aeronautics teams and collaboration
|
Expanded for large concurrent user base
|
Access additional NII bandwidth as needed |
Focused on configuration control for aeronautics products and associated data
|
Provides services for managing common product model across distributed team
|
Supports rollback of configurations and long-term archive of product and data configurations |
Facilitates distributed "computing" services available across an ASOP project team |
Supports access to shared "supercomputer" resources on as needed basis for aeronautics ASOP projects |
Interfaces to "open" NII services for ASOP users
|
Provides range of data/system security for ASOP
|
Support access control to ASOP capabilities
|
Insure only authorized users access, modify, use ASOP services and information |
Specializes generic "object/wrapper/agent" technologies to ASOP requirements |
Provides object management; distribution; control and retrieval services |
Stores and archives ASOP related data objects for re- use |
Implements specific data exchange standards for data objects; i.e. STEP Application Protocols |
Ranges from desktop video conferencing to 3-D graphics to full televirtual interactions |
Includes CAD conferencing / whiteboard capabilities |
Enables collaboratories - geographically distributed laboratories to support product development |
Requires interactive and "batch" data exchange services |
Supports collaboration among dispersed development community |
Open NII services driven by ASOP requirements for rigorous configuration control / management |
Broadly applicable to wide range of product development efforts beyond aeronautics |
Collection of world wide computers as coordinated computational engine |
Supports distribution of high compute problems across widely distributed systems |
Enables world wide searches for information to resolve user queries |
Includes control of remote scientific instruments |
Multiple levels and types of security requirements supplied to meet military and commercial needs |
Extended to support large dataset security as opposed to small transaction protection |
Includes access (login) permissions; user roles; to reach available services |
Address administration of services to user community - billing/authorization/pricing/approvals |
For instance as part of my New York State Industrial HPCC outreach program InfoMall, I found that a major manufacturer of large consumer machines had no interest in MPP's for simulating them to improve design |
However very interested in
|
Here Perl manipulates text from database to HTML |
Java enables down-loaded simulations |
VRML enables universal definition of 3D objects -- products and buildings |