Given by Geoffrey Fox at NASA ICASE Tutorial on June 10-13 1996. Foils prepared June 6 1996
Abstract * Foil Index for this file
See also color IMAGE
We describe some of the applications and services that can be built with Web Technologies |
Services such as Commerce, InfoVision, Collaboration, MetaComputing are generic applications |
We stress need for maximal re-use of software components |
Applications discussed include HealthCare, Command and Control, Manufacturing, Business Enterprise IntraNets and Education |
InfoVision and Computing Services are discussed in detail |
Collaboratories, The Bridge Concept and Problem Solving Environments are linked! |
This table of Contents Abstract
http://www.npac.syr.edu/users/gcf/webapplservjune96/index.html |
Presented at NASA ICASE Meeting June 10-13 1996 |
Presented during Trip to China July 12-28,1996 |
Geoffrey Fox |
NPAC |
Syracuse University |
111 College Place |
Syracuse NY 13244-4100 |
We describe some of the applications and services that can be built with Web Technologies |
Services such as Commerce, InfoVision, Collaboration, MetaComputing are generic applications |
We stress need for maximal re-use of software components |
Applications discussed include HealthCare, Command and Control, Manufacturing, Business Enterprise IntraNets and Education |
InfoVision and Computing Services are discussed in detail |
Collaboratories, The Bridge Concept and Problem Solving Environments are linked! |
Application Specific NII Specific Services for
|
Desktop Publishing and Productivity Tools in WebWindows (WebTop Productivity/Publishing)
|
InfoVision: Delivery on Demand of Information from:
|
Commerce -- digital Cash and signatures with appropriate authentication and security. Enables both Web Commerce (shopping) and use of Web for proprietary information |
Interactive and "batch" Collaboration
|
Metacomputing -- the collection of world wide computers as a coordinated (in subgroups of computers) computational engine (for simulation or information processing)
|
This popular word is meant to summarize fact that most problems these todays require not just a fast computer but rather a heterogeneous mix of resources including people, computers, information, visualization etc. |
Collaboration technologies link people to people and computers and this linkage is heart of PSE's -- Problem Solving Environments |
The Bridge Concept of Warner and Balch is heart of PSE for TeleMedicine |
We expect this type of system to grow in importance in all applications! |
Such as CareWeb |
CareWeb for Telemedicine -- local community network to support electronic student health record database and collaborative diagnosis by nurses, nurse practitioners and pediatricians. |
Command and Control -- innovative use of Web technologies for integrating a suite of large scale applications (weather, electromagnetic scattering, telemedicine, GIS) contributing to a military Command and Control. |
Distance Education and Science Collaboratory -- content (Virtual University, Living Schoolbook) and technology (WebFoil, WebSpace/LabSpace) development for delivering education over the Internet and providing collaboratory links between students and mentors. |
Large Scale Numerical Computing -- A set of pilot projects that explore Web based HPCC starting from simple computational topologies. Current prototypes include: RSA Factoring-by-Web, Adaptive Mesh Refinement for PDEs, 3D Visible Human. |
Most of the real world WebTop Systems will involve multi-user collaboratory modules. Even for scientific computing, complex toolkits such as WebAMR will be most conveniently supported by interactive consultation between developers and users. |
Collaboratory multi-user components will be further enhanced in enterprise, commerce and community systems. |
This is illustrated in our recent telemedicine prototype for nursing triage. Here we start from the collaboratory component involving nurses, nurse practioners and pediatricians and add HPCC components such as medical imaging and agent based diagnosis. |
We view the Bridge topology (Warner & Balch '95), underlying such telemedicine systems, as a promising generic framework, applicable also for other problem domains. |
A generic bridge includes "points of need", "points of expertise" and intelligent middleware that manages information resources and provides connectivity between customers and optimal services.
|
We present here examples of the bridge topology, instantiated in various application domains: |
Domain Points of Need Points of Expertise Typical Services |
TeleMedicine Nurses, Nurse Practioners Diagnosis
|
Command Troops Commanders Decision |
and Control Making |
Distance Learners Teachers Mentoring |
Education Students Consultants |
Commerce Consumers Vendors Product Support |
Science Schools Scientists Popular Science |
Collaboratory Small Businesses Technology Transfer |
This is distributed databases for supporting cost effective healthcare with less fraud, better use of existing information for establishing care-plans etc |
This is collaboration, remote instrument control for telemedicine |
Could be full televirtuality for virtual-reality controlled remote surgery in battlefield or accident scenarios |
Telemedicine concepts until mid '95 were based on the assumption of rapid onset of the broadband wide area networking infrastructure. |
Dominant anticipated medium was direct life video linkage between patients and physicians. |
However this is not considered by some to be very succesful and new approach to Telemedicine is based on decision support for doctors with an environment very similar to that needed by Command and Control in the military or the LOTUSNotes like environment in Business
|
Slowdown in the ATM deployment, rapid explosion of Web technologies with variable bandwidth conditions, and new social and economic needs for the managed care based medicine, implies currently the paradign shift in the near term telemedicial environments. |
this the first step in the systematic conversion of poorly organized Web HealthCare material into a set of (Oracle) databases - this particular one stores individual URLs with short descriptions as RDBMS records (so they are automatically searchable, editable etc) |
Next steps will include grouping into subdomains, linkage with patient records as on-line aid for the medical personel (nurses) etc. |
Warner' team came up with the Bridge Concept which was prototyped by his organization I3 and ECU and succesfully demonstrated with Web Components from NPAC at WWVR'96 in San Diego |
The Bridge connects patients/care portals with quality healthcare professionals (DOCking stations) via the intelligent middleware station(this will be Web), offering suitable routing and optimizing the message traffic, service quality and expert time utilization. |
The emerging Web based framework (WebMed) addresses near term implementation in terms of today's networks and matches the social/patients and HMO/economy needs in terms of pervasive low cost infrastructure. |
New Web based telemedicine initiative WebMed at NPAC addresses these issues in a set of planned pilot projects. |
Rome Laboratory Collaborative and Interactive Visualization Jan 31,96 |
Rome Laboratory Collaborative and Interactive Visualization Jan 31,96 |
School Nurse - Web based patient record database with links to medical information (diagnosis, treatment) and 3 hierarchy levels:
|
This is a Pilot project to prototype an instance of the telemedicine Bridge concept. |
Home care terminals - Our initial project is a Web (Java/JavaScript) version of Warner's "neat thing" sensory front-end, with rehabilitation and disabilities as initial application target.
|
This allows Doctors to interact with Patients at the Home with Instruments monitoring their health
|
TeleMedicine and (Interventional) Medical Informatics leads to Bridge |
East Carolina University School of Medicine TeleMedicine Program |
Institute for Interventional Informatics at San Diego |
WebWindows approach to Software Systems linking databases and Web front ends leads to WebMed implementation of Bridge |
Northeast Parallel Architectures Center at Syracuse University |
WebMed applied to School Nursing leads to CareWeb |
Syracuse University School of Nursing |
Syracuse City School District |
SUNY Health Science Center |
Community collaboration including NPAC, SU College of Nursing, Syracuse City School District and SUNY Health Science Center (Univ. Hospital). |
Initial goal is to provide electronic student health record database, healthcare education and Web based interactive consultation between nurses, nurse practitioners and pediatricians. |
Trial demo implementation completed May'96. Trial deployment in select New York and North Carolina schools expected in fall '96. |
CareWeb core module is given by Oracle database at NPAC with WOW/OWA/Internet gateway, remotely accessed by CareWeb customers. |
The system integrates and offers customized access to ~30 databases, managing information about users, health education resources, and patient health records. |
Typical CareWeb databases include: Customers, Connections, Transactions, Schools, Teachers, Nurses, Nurse Practitioners, Doctors, and Record Components such as Immunizations, Screening Tests, Health Histories, Progress Notes, Visit Logs, Assessment Forms etc. |
CareWeb Information Pages offer customized educational support for healthcare personnel as well as students and parents, as well as decision tree support to be used in the next project stage for the agent-based automated diagnosis generation and verification. |
Interactive consulting is based on shared record pages, optionally synchronized via phone chat or/and WebCast support, and VIC/VAT video support for 'talking heads' and/or video feeds from (Welch Allyn) multi-purpose fiberscopes for ear, nose and throat inspection. |
The system offers multi-level security, including Internet guests (with anonymous limited access), CareWeb friends (with registered restricted access) and CareWeb customers (nurses, nurse practitioners, doctors, parents) with secure password based access, individual home pages and customized information/operational spaces. |
From CareWeb Collaboration NPAC-SU School of Nursing-SUNY HSC-Syracuse City School District |
NPAC Team led by Wojtek Furmanski-Ed Lipson-Roman Markowski |
From CareWeb Collaboration NPAC-SU School of Nursing-SUNY HSC-Syracuse City School District |
NPAC Team led by Wojtek Furmanski-Ed Lipson-Roman Markowski |
From CareWeb Collaboration NPAC-SU School of Nursing-SUNY HSC-Syracuse City School District |
NPAC Team led by Wojtek Furmanski-Ed Lipson-Roman Markowski |
From CareWeb Collaboration NPAC-SU School of Nursing-SUNY HSC-Syracuse City School District |
NPAC Team led by Wojtek Furmanski-Ed Lipson-Roman Markowski |
From CareWeb Collaboration NPAC-SU School of Nursing-SUNY HSC-Syracuse City School District |
NPAC Team led by Wojtek Furmanski-Ed Lipson-Roman Markowski |
From CareWeb Collaboration NPAC-SU School of Nursing-SUNY HSC-Syracuse City School District |
NPAC Team led by Wojtek Furmanski-Ed Lipson-Roman Markowski |
From CareWeb Collaboration NPAC-SU School of Nursing-SUNY HSC-Syracuse City School District |
NPAC Team led by Wojtek Furmanski-Ed Lipson-Roman Markowski |
From CareWeb Collaboration NPAC-SU School of Nursing-SUNY HSC-Syracuse City School District |
NPAC Team led by Wojtek Furmanski-Ed Lipson-Roman Markowski |
From CareWeb Collaboration NPAC-SU School of Nursing-SUNY HSC-Syracuse City School District |
NPAC Team led by Wojtek Furmanski-Ed Lipson-Roman Markowski |
From CareWeb Collaboration NPAC-SU School of Nursing-SUNY HSC-Syracuse City School District |
NPAC Team led by Wojtek Furmanski-Ed Lipson-Roman Markowski |
From CareWeb Collaboration NPAC-SU School of Nursing-SUNY HSC-Syracuse City School District |
NPAC Team led by Wojtek Furmanski-Ed Lipson-Roman Markowski |
From CareWeb Collaboration NPAC-SU School of Nursing-SUNY HSC-Syracuse City School District |
NPAC Team led by Wojtek Furmanski-Ed Lipson-Roman Markowski |
Based on Warner's NeatTools |
We are experimenting with home care terminals based on David Warner's "neat thing" sensory front-end, with rehabilitation and disabilities as initial application target.
|
This allows Doctors to interact with Patients at the Home with Instruments monitoring their health |
But it also allows Disabled access to Web and to Education on the Web as "neat thing" allow us to replace Mouse/Key board input with any measurable human signal |
For structured data at least, we have full control over both Patient and User Interface.
|
By dragging and clicking the mouse, one can assign up to 16 data channels to various input and output devices. Here the interface box is connected to serial port #2 of the PC and its four pairs of electrodes (leads) are assigned respectively to channels 1 through 4. One can also specify running-average or other filters to the individual data channels. |
Channels are calibrated to select "windows" of their ranges of signal amplitude. The green and red lines, which are set by mouse dragging and clicking, set the lower and upper limits of the range of interest. When a signal is within range, the button turns from blue to green, and this condition can correspondingly control a binary output device. |
A multichannel oscilloscope-type display is available to monitor continuously the time course of an input signal. This mode is particularly useful for training a disabled subject, such as a quadriplegic, to activate certain channels for actions such as a) wheelchair control or b) mouse-cursor control for Web surfing (by conscious activity of various facial muscles). |
From work of Ed Lipson and Dave Warner |
From work of Ed Lipson and Dave Warner |
Medical Imaging Web Server - an advanced image processing toolkit, including publicly available and in-house developed (e.g. wavelet compression or pattern recognition) algorithms, packaged and published as a Web service to aid (possibly collaboratory) diagnosis process in the areas of radiology and pathology.
|
Other, very recently identified possible projects include
|
WorldWide LifeLong Learning |
New Curricula |
This is basis of Virtual University and NII can be expected to be much more succesful than videosystems because interactive, collaborative, explorative and full multimedia information at student and teachers fingertips |
Base of Distance Education is InfoVision for full interactive curricula
|
Rich Collaboration environments including televirtual MOO's for student-student and student-teacher interactions |
We can use Web technologies to develop new very important tools for education enabling
|
We can teach these new technologies as world hungry for people understanding these technologies
|
Living Schoolbook -- Prototype of K-12 Educational Environment of year 2000
|
HPDC95 Tutorial and Other Computational Science Courses CPS600, CPS615
|
Physics 105/106 -- Science for the 21st Century (for non-Scientists) -- Some course modules built around Multimedia Information Systems
|
This hyperlinked material accounts for about 10% Phy 105, 20% Phy 106 and expect to increase if success continues
|
The Living Schoolbook is a New York State funded Initiative to create K-12 educational applications that exploit leading information technologies |
Living Schoolbook Base Educational Services are:
|
Living Schoolbook Leverages Information Technologies
|
The Project Team
|
Upstate Project Schools
|
Downstate (New York City) Project Schools
|
askERIC Educational Database for teachers with consultation |
The Discovery Channel -- Video Content Provider |
NewsBank -- Text Content Provider |
Reuters News Service |
Syracuse Language Systems -- Learn Foreign Languages on Demand |
TravelVenture -- Interactive travel information on Demand |
US Air Force Rome Laboratory -- InfoVision technologies |
WorldView Corp. : Interactive Client-Server Geographic Information System |
FLAG is an enterprise in which NYNEX Network Systems Company is a major (roughly 40%) investor. |
Current fiber link from U.K. to Japan (via Africa) is being constructed at an approximate $1.4B cost |
Natural Strategy is for Web Servers in U.S.A.. to deliver educational material via FLAG to Africa and Far East |
This would set up hierarchically as:
|
Real-Time Compression critical for interactive use of FLAG as lines are costly -- note Internet is free but needs compression as overloaded .... |
Many students from these countries come to the U.S.A.. now but ...
|
In Virtual University, one sets up a partnership between U.S.A.. and overseas University where key curricula and its delivery are provided over GII (Global Information Infrastructure of which FLAG is one example) |
High-end PC's should be included as possible Web server for Africa even we use SP-2, multi-processor SGI etc. as server in U.S.A.. University |
A NYNEX Joint Venture |
This shows fiber draping Africa with coast off ramps |
See electronically for actual home page |
Computational Science is an interdisciplinary field that integrates computer science and applied mathematics with a wide variety of application areas that use significant computation to solve their problems |
Includes the study of computational techniques
|
Includes the study of new algorithms, languages and models in computer science and applied mathematics required by the use of high performance computing and communications in any (?) important application
|
Includes computation of complex systems using physical analogies such as neural networks and genetic optimization. |
SImulation Track -- Graduate
|
Masters in Computational Science built around these core copurses CPS615,713 |
Simulation Track -- Undergraduate
|
CPS 401/601 IMM 601 Multimedia Systems and Tools -- Core course for Track 1 of IMM degree |
CPS 403/703 Computational Science Elective: 1 Lecture a week -- rest Laboratory -- elective for IMM |
CPS 406/606 Introduction to Information technologies and Systems -- designed as elementary elective for IMM |
CPS 616 Overview of Information Track Computational Science -- advanced elective for IMM |
CPS 714 Case Studies in Information Applications of Computational Science -- advanced elective for IMM |
"Web Technology"/Information Track of Computational Science Masters built around CPS 616,703,714 |
Certificate in Computational Science offered at Harbin Institute of Technology (China) Spring 1996 -- started March 1,1996 -- is a prototype of Syracuse University extension school |
Although Internet Connections to China are not guaranteed to be great(!) we can still use Web Technology but assume that Electronic Course material will be packaged at NPAC(SU) in a Pentium PC running WindowsNT and Java
|
This will be updated in batch mode by Syracuse -- China Connection |
Students in China will Interact with mentors in China and with NPAC via Internet (web and email) |
Project designed by Fox,Leskiw(NPAC), Xiaoming Li(Harbin and Peking visiting NPAC) |
Graduate Students -- initially 5 guinea pigs |
4 Courses -- each 10 1 hour lectures -- offered Spring 1996 over 20 week period |
ICPS 700: Introduction to Simulation Track of Computational Science
|
ICPS 701: Parallel Programming Laboratory
|
ICPS710: World Wide Web Technology
|
ICPS711: Web Programming
|
We suggest that Universities historically are "approved" to give "licenses" i.e. certification that students have a certain level of knowledge |
In the emerging Web based Virtual University, the traditional type and length of learening cycles is not obviously appropriate |
Further we need to bootstrap WebWisdom and "suck customers in" a little bit at a time! |
Thus suggest Scalable Certificates
|
Note these certificates are also portable as can take anywhere at any time! |
Traditionally, University courses are 1/3 interaction and 2/3 study/homework
|
I expect Java to be the the dominant implementation language for everything on the Web from Servers, Clients, MOO's, filters, Animations, Simulations etc. |
Can build neat clickable images including Visible Human (biology education!) and our 2D "Interactive Journey" clickable GIS for New York State |
This has several obvious near term applications including some examples of education in HPCC arena:
|
The above examples are quite interesting reasons for introduction of electronic journals as you should be able to explain complex ideas better this way |
Note Web was initially book/libraries done digitally. |
Now we are the second wave of opportunities exploiting the specific advantages of distributed computing backbone |
VRML allows user annotated 3D visualizations so that you can explain features of results of simulation in a universal fashion which can be viewed on any machine
|
VRML is Very good GIS (Geographical Information System) technology and can be used by NASA/EPA etc for presentation of spatial data with again clickable annotations |
VRML is currently and perhaps intrinsically (numbers ascii) inefficient and Java is alternative / augmentation technology
|
VRML 2.0 will allow projects like Argonne Labspace to produce collaborative televirtual environments |
You can use structured databases such as Oracle to store resource data such as Glossaries in an organized fashion with (well-known technology) to generate HTML on the fly
|
Can also store unstructured information as illustrated by Usenet computer and other relevant newsgroups |
Use the powerful Search engines with domain (i.e. particular courses) specific keywords . These can be attached to commercial (e.,g. altavista) or inhouse Web Search sites so search confined to subset of curricula material |
Object databases can be very useful for VRML and other data which is naturally of this form such as images and output of simulations |
Clearly digital audio and video supports the type of collaborative environments needed for good teaching
|
Digital video (in fashion similar to VRML 2.0) can be annotated to provide much more interactive results of scientific simulations
|
Digital Audio and Video is currently less than 5% of web data but eventually it will be dominant (95%) form of digital information and serving will be major Web activity. |
Broad distribution requires ISDN-ATM speeds but can deliver from local WebServers as only needs Ethernet or less for each client
|
There are some cases where JavaScript is a rapid prototyping alternative to Java (Java can in principle do anything!) |
Current use (demonstrated in WebWisdom) is for customized display's of information where base information, simulations, audio(video), and indices can be linked in a friendly fashion. |
Syracuse is extending to a set of WebTools (originally developed as Server CGI scripts) with which you can build customized front-ends with user defined configurations choosing between type of access (administrator and naive user would be different) and display capabilities (resolution, color) of terminal |
Note client side and so fast even though interpreted |
However does not yet have (but needs) text processing capabilities of Perl |
Digital Video and Servers |
InfoVision is "successor" to TV with any multimedia information delivered on demand( choice from infinite number of channels) |
Community Networks will define local societies and will have significant impact on local government |
Shopping on the Web will include multimedia digital yellow pages , Commerce, online catalogs (which is InfoVision again) as well as perhaps powerful VR interfaces where you can try out new clothes and cars |
Collaboration (gossip as in computer forums) could be an important and dominant use but perhaps not initial major one |
NII is/will be digital superhighway provided to you by
|
Current NII is INTERNET and World Wide Web |
Currently access NII through Internet directly or through an intermediary such as America On-line |
Currently use a Computer and modem on POTS -- plain old telephone service |
In future Computers/TV set sets will ÒconvergeÓ and access will be dedicated cable/optical fiber which will be much faster and allow high quality video delivery |
ÒEveryÓ Business Office, Every doctorÕs Office, ÒEveryÓ school desk, ÒEveryÓ home(potential patient) (approximately any home on cable) will have such a two-way high speed link to the NII |
High Performance (Parallel) Computers on High Speed (ATM) Networks linked to clients at a network performance that supporting realtime Video at a resolution between VHS,HDTV . |
MPP's as Internet/Web/NII/GII Servers
|
Dual-Use Philosophy must be extended to Multi-Use
|
Standards must be used
|
Each of three components (network connections, clients, servers) has capital value of order $10 to $100 Billion |
InfoVision is ultimate "client-server" application
|
Democracy on the NII (Gore)
|
ÒAllÓ children will have the equivalent of todays $20,000 business or university computer processing capability in |
BOTH Settop Boxes and in Video Game Controllers which will ÒjustÓ be Personal Computers |
Information Video Imagery and Simulation on Demand |
Tomorrows Communities will be centered not just on roads, libraries, schools and local businesses but EVERY community will have a High Speed Digital Community network that will both drive the community internally but also tell the outside world about business services, tourist attractions etc. |
Web Servers use "Web Technology" to service World Wide Web and other forms of networked multimedia information |
President of ThinkMedia is Robert Frye who is an independent television and film producter and director
|
Linked with NPAC through Newhouse and other University Contacts |
Exploring combining his expertise in video documentaries with NPACÕs collaborative Web technology (developed with Rome lab and NYNEX support) |
Result will be a generalized forum where people from around the world can interact in a rich electronic environment |
Bob Frye has donated some of his video material to NPAC for use in Living Schoolbook |
Living SchoolBook Material for SC95 San Diego Dec 95 |
Living SchoolBook Material for SC95 San Diego Dec 95 |
The simplest VOD applications treat InfoVision server as a "glorified" digital VCR with a huge stock of readily accessible prerecorded tapes
|
Interactive VOD will have granularity of order a minute
|
Can use same approach as for text -- relational databases -- to search for material |
Video and Server Technology Network is prototype of Wire Service of future using Web Technology to service Mass Communications Industry |
NYNET ATM network extended internally to allow linkage of NPAC to Newhouse School of Public Communications and University Electronic Media Production Unit |
Faculty and students -- the multimedia digital journalists of the future will use:
|
Allows University to understand Integration of media and computer fields both at technology and academic level |
Industrial partners from traditional print and analog video fields
|
Living SchoolBook Material for SC95 San Diego Dec 95 |
Living SchoolBook Material for SC95 San Diego Dec 95 |
The Web for Enterprise Information Systems |
OLTP (Online Transaction Processing) such as approving and recording credit card transactions. This is a type of InfoVision and Commerce which is operational today
|
Decision Support varies from fraud detection, inventory planning and market segmentation for optimizing shopping by mail |
Decision support can vary from search of a single giant relational database to galaxy-wide search of heterogeneous distributed database |
Workflow Support as in LOTUS Notes integrates Collaboration, Project Management and Distributed Databases. This supports ongoing distributed enterprise -- this is also essential in collaboratory |
The World Wide Web will develop a marvellous WebTop Environment allowing users to access Web versions of Word Excel(Lotus123) Persuasion(Powerpoint) Databases Lotus Notes etc.
|
This (as developed) enables a wonderful new software industry as Microsoft no longer has key advantages |
This (as used) enables very effective (business) enterprise systems where "Web" used internally to an enterprise
|
InterNet versus IntraNet Web Business |
From Information Week Jan 29, 96 issue |
Focus on manufacturing industry
|
Large industry typically has
|
WWW information system support
|
Incorporate database in WWW information system
|
WWW internal information server
|
With incorporated database support
|
Groupware is major new direction for many industries |
Huge market for Lotus Notes groupware |
Groupware elements (according to Lotus Notes)
|
Information systems and database operations of Lotus Notes
|
Network (including WWW) based open systems Groupware
|
Current interactivity: CGI perl, C, database
|
Java or Java-like capabilities
|
VRML for 3-D visualization
|
WebTools: server to server communication
|
or Command and Control for military |
Critical feature is realtime, "come as you are" adaptive linked computers and people |
Judgement support extends decision support into an "exploratorium" scenario as crises tend to be unexpected |
Major need to search community and government databases for immediate information on resource location and availability etc. Metadata(summaries) essential |
Collaboration between commander in field , specialized anchor desks (domain experts) and those in field. |
User Interface essential as user will be tired and searching unfamiliar data |
Geographical Information Systems and browsing multiple video sources (InfoVision again) will be critical as judgements will depend critically on spatial data. |
The trip to the opera was the high point for the thousands of international visitors to the conference. |
They were streaming out of the new center which had been built in a decaying downtown area. Here old warehouses were still mixed with the proud new buildings of the economic redevelopment zone. |
Luke CyberCzar was in charge of the crisis center when the first 911 video dial tones showed the horrifying sight. A gigantic set of explosions rocked a set of old chemical warehouses and fires and fumes of unknown composition ringed the new opera complex. The frightened audience panicked and scattered this way and that into the surrounding alleys. Of course the digital video crews covering the opera immediately switched their cameras to this catastrophe. Just a few seconds after those 911 calls, all the MPEG decoders on the GII were presenting the chaos, damage and injuries live to a world whose cybereyes were trained on Luke. |
Injury and Damage implying major field operations with international scope |
Telemedicine accessing world wide records |
MPP and distributed cluster Simulations of Chemical fires and Wind blown transport of fumes |
Remote Command and Control supported by Televirtual Environment |
Digital Multimedia streams of data from on the spot video |
Universal common WebTop envirtonment from WebNewton to Supercomputer |
Adaptive network management including ISDN exploiting advanced compression |
Cellullar Connections and Electromagnetic simulations to optimize antenna placement for emergency communications |
Disparate distributed databases searched in real time using metadata |
3D Geographical Information Systems with real-time overlays for tactical decisions |
Training and Education from Maxwell(Electronic Intuition) to Computer Science and Testbeds such as FEMA and JWID |
Luke benefits from the natural convenient interface maximizing the effectiveness of the tired harried judgment maker. This build on advanced MOO and VR ideas and tailors the computer interface to the problem at hand. |
Luke sees a three dimensional GIS (Geographical Information System) when viewing the spatial confusion of the catastrophe; a virtual podium when he briefs cyberworld; a boardroom when defending his actions to angry foreign politicians; a summer wildflower meadow in moments of thought. |
He shares this virtual environment with Jane who is in charge of tactical operations for the crisis and by his electronic side at all times. |
They share this televirtual environment with other judgment makers and those facing the crisis in the field. |
Whether supported by supercomputer or hand held personal assistant, all access the same WebTop environment with a full range of collaboration and productivity tools whose capability adjusts to the available compute and communication resource. |
In this way the GII enables the best adaptive linking of "come-as-you-are" computational, communication and personnel resources. |
Real--time decision support for military |
Includes telemedicine as a special case for miltary medical activities
|
HPCC applications include Image Processing, Tracking, Spatial Assessment, Weather, Electromagnetic Simulation |
Incorporates a Java/VRML based GIS in which we hope to integrate 3D terrain with output of weather simulations |
Netscape2/JavaScript prototype is "exact" copy of deployed system at Cheyenne Mountain -- consistent with COTS phylosophy |
From Wojtek Furmanski |
From Wojtek Furmanski |
From Wojtek Furmanski |
Tightly Coordinated Distributed People and Computers |
This is future model for (inter)national distributed research |
Rich Collaboration environment essential as collaborative research requires nontrivial person to person interactions |
Searching distributed databases basis of much scholarly work (infoVision and Digital Library) |
Metacomputing for multidisciplinary, multi-institutional simulations and for control and data storage and analysis from remote instruments whether satellites, telescopes, accelerators etc. |
Distributed (people) Software Engineering support for production of distributed computing software |
Needs workflow support as distributed enterprise |
Critical feature is closely integrated collaboration of very many people and computers requiring |
Metacomputing Simulation and distributed database support as in Collaboratory |
Workflow support including configuration management and central CAD databases |
Rich collaboration environment to support distributed design decisions |
Standards and Security to allow interlinking of people and software from different organizations |
Key special requirement is distributed coordination |
A set of manufacturing companies -- Rockwell International, Northrop Grumman, McDonnell Douglas, General Electric and General Motors is studying the NII implications for a particular MAD system "Affordable Systems Optimization Process" (ASOP) |
Interesting parameters are that next major aircraft to be built could involve:
|
Customizes general NII technologies to ASOP specific requirements |
Provides the object, wrapper and agent services to share data in the ASOP design environment |
Conforms to applicable protocol, ontological and data standards |
Defines management, retrieval, and control functions for heterogeneous data and methods distribution |
Interfaces to Team Infrastructures |
Employs emerging "open" NII services to support aeronautics teams and collaboration
|
Expanded for large concurrent user base
|
Access additional NII bandwidth as needed |
Focused on configuration control for aeronautics products and associated data
|
Provides services for managing common product model across distributed team
|
Supports rollback of configurations and long-term archive of product and data configurations |
Facilitates distributed "computing" services available across an ASOP project team |
Supports access to shared "supercomputer" resources on as needed basis for aeronautics ASOP projects |
Interfaces to "open" NII services for ASOP users
|
Provides range of data/system security for ASOP
|
Support access control to ASOP capabilities
|
Insure only authorized users access, modify, use ASOP services and information |
Specializes generic "object/wrapper/agent" technologies to ASOP requirements |
Provides object management; distribution; control and retrieval services |
Stores and archives ASOP related data objects for re- use |
Implements specific data exchange standards for data objects; i.e. STEP Application Protocols |
Ranges from desktop video conferencing to 3-D graphics to full televirtual interactions |
Includes CAD conferencing / whiteboard capabilities |
Enables collaboratories - geographically distributed laboratories to support product development |
Requires interactive and "batch" data exchange services |
Supports collaboration among dispersed development community |
Open NII services driven by ASOP requirements for rigorous configuration control / management |
Broadly applicable to wide range of product development efforts beyond aeronautics |
Collection of world wide computers as coordinated computational engine |
Supports distribution of high compute problems across widely distributed systems |
Enables world wide searches for information to resolve user queries |
Includes control of remote scientific instruments |
Multiple levels and types of security requirements supplied to meet military and commercial needs |
Extended to support large dataset security as opposed to small transaction protection |
Includes access (login) permissions; user roles; to reach available services |
Address administration of services to user community - billing/authorization/pricing/approvals |
For instance as part of my New York State Industrial HPCC outreach program InfoMall, I found that a major manufacturer of large consumer machines had no interest in MPP's for simulating them to improve design |
However very interested in
|
Here Perl manipulates text from database to HTML |
Java enables down-loaded simulations |
VRML enables universal definition of 3D objects -- products and buildings |
The Web Originated as an Information system but we can clearly use it as a base for distributed computing and as parallel computing is just a special case of this with low latency and tight synchronization, for parallel Computing as Well! |
WebWork was our first Concept (with Boston University and Cooperating Systems) which concentrated on software engineering gotten by using information capabilities of Web linked to computing environments |
DataFlow (for coarse grain software integration) and Embarassingly Parallel applications are natural first Web thrusts as not so sensitive to performance issues |
Overview --- http://www.npac.syr.edu/projects/webbasedhpcc |
WebTools --- http://king.syr.edu:2006/WebTools.html |
RSA Factoring-by-Web -- http://www.npac.syr.edu/factoring |
Distance Education / Virtual University -- -- http://www.npac.syr.edu/users/gcf/foilsbyarea.html |
WebSpace/Labspace -- http://www.npac.syr.edu/projects/webspace |
Web based Telemedicine -- http://www.npac.syr.edu/projects/careweb |
Embarassingly Parallel: Succesful RSA130 Factorization |
Linkage of Databases with MPP's: Financial Modelling on Demand |
Java GUI for Distributed Computing and Performance Visualization |
Java as WebFlow -- AVS done with the Web and applied to Image Processing |
HPF on the Web -- General Principles and use in Education as a web programming laboratory |
Putting it together -- Java frontend to a domain specific problem solving environment -- WebAMR -- Adaptive Mesh Refinement
|
This is both Grand Challenges augmented by National Challenges but also |
Build HPCC technologies on a broad not niche base starting at bottom not top of computing pyramid |
WebWork is an open, world-wide distributed computing environment based on computationally extended Web Technologies |
The backend computation and information infrastructure is provided by the World-Wide Virtual Machine -- a mesh of computationally extended Web Servers (called Compute Servers) |
These servers manage (via CGI mechanisms) a collection of standardized computational units called WebWork Modules. |
Geographically distributed and Web-published WebWork modules interact by HTTP/MIME based message/object passing and form distributed computing surfaces called Compute-Webs |
The front-end user/client interfaces are provided by evolving Web browsers with increasing support for two-way interactivity (e.g. Java, VRML) that facilitates client side control and authoring. |
A natural user-level metaphor -- WebFlow -- is supported in terms of visual interactive compute-web authoring tools. |
Implements the "Viable Base" Enterprise Model of HPCC Software identified in Pasadena2 workshop |
This will allow good programming tools to be developed and mnaintained as larger enough base to support software industry |
Implements a powerful software engineering framework for parallel computing by integrating parallel programming with the World Wide Web Productivity Tools |
Collaboration with Arjen Lenstra and Boston/CSC. New NFS factoring algorithm successfully applied to RSA130 factoring on a tree of Web+CGI servers (FAFNER by Jim Cowie/CSC). |
SC'95 Teraflop Challenge Award. |
Next Challenge -- RSA155. |
RSA security systems based on numbers
|
Bank of England and English Savings and Loan based on m=155 (512 binary digits) |
RSA129 cracked by factoring with email team using sophisticated version of Quadratic Sieve. RSA155 will use better Number Field Sieve |
Need x2 = y2 mod(RSAm) as then gcd(x+y,RSAm) likely to be interesting factor |
Find x and y by finding lots of interesting a's
|
Given these a's factored into primes, multiply together so powers of primes are even. This gves desired x |
This last step requires graph theory and solution (for Bank of England) of 5 million linear equations |
RSA155 requires about 300 teraops hours to solve with NFS |
RSA129 needed about an order of magnitude less time. Can be done today faster if use Number Field Sieve |
We have roughly one to five million independent calculations which form the rows of matrix (after clever graph theory manipulates and combines) |
Set of master servers publish problem to solved with suitable demos, description of algorithm and full marketing attention.
|
Clients return results -- not so easy except by email and cut and paste |
Best done as a set of cooperating servers where server performing factorization publishs it solution as a file on the WWW. |
Cooperating servers also better for computer administrators as can control set of clients at a given site |
Initially use humans but replace by agents when software ready |
Proposed Architecture of WWVM |
http://cooperate.com/cgi-bin/FAFNER/factor.pl |
Features
|
months of runtime, dozens of collaborators, |
eight nations, four continents |
hardware platforms from an i386 laptop to an IBM SP/2 (including HPs, Alphas, MIPS, Suns, SGI machines, RS6000s) |
Most Heterogeneous and Geographically Dispersed Award, 3rd Annual HPC Challenge, Supercomputing '95. |
Implemented as Perl scripts, invoked via CGI |
Hierarchy of cooperating World-Wide Web servers used for many functions in the collaboration:
|
General Number Field Sieve (GNFS)
|
GNFSD Wrapper Code
|
http://www.npac.syr.edu/factoring/status.html |
Web Sieving started in September 1995. |
On April 10, 1996, we found that |
RSA-130 = 1807082088687404805951656164405905566278102516769401349170127021450056662540244048387341127590812303371781887966563182013214880557 has the following factorization: RSA-130 = 39685999459597454290161126162883786067576449112810064832555157243 * 45534498646735972188403686897274408864356301263205069600999044599 |
Factoring on the Web Project |
Can grab stock data from real-time services |
Combine with historical data stored in databases (such as Oracle) |
Use in Monte Carlo simulations of sophisticated financial instruments |
Cooperative distributed (and parallel) computing will become mainstream in financial engineering due to a convergence of the following factors: |
Increased volatility due to globalization of financial markets |
Global distribution of data sources |
Increase in complexity of derivatives and risk management vehicles |
Increased demand for real-time asset allocation decision support |
Increased volume of raw data and need to process large databases |
Increased volume on the retail side of the spectrum in part due to on-line technologies (Internet and WWW) |
HPCC is becoming indispensable in the application domains such as:
|
NPAC is engaged in development of new tools for quantitative financial modeling which take advantage of scalable computer architectures |
The ultimate goal is to integrate various quantitative analysis transparently using Web technologies into a seamless cooperative computing environment, capable of supporting all aspects of enterprise-wide risk management. |
We developed new algorithms for risk neutral valuation of derivative financial instruments |
Theoretical prices of derivative instruments are obtained by discounting their expected payoffs under the equivalent martingale measure using money market interest rate. |
The core algorithm is Path Integral Monte Carlo which used to generate arbitrary distributions of underlying risk factors (stocks, bonds, short interest rates, commodities, indices etc.) |
The advantage of the new algorithm is that sensitivities of derivative prices with respect to changes in all model parameters are computed in a single simulation.
|
Parallel version of the algorithm is written in C and MPI and relies on task parallelism and functional decomposition (could also use HPF) |
Monte Carlo samples are generated on multiple processors in embarrassingly parallel fashion |
Pricing modules can either run in lock-step with the Monte Carlo module which generates histories of risk factors or asynchronously perform valuation functions on the histories which are broadcast as they are generated by the Monte Carlo module |
We are linking this flexible algorithm with a novel scheme based on Maximum Entropy method which generates implied probability distributions from reported option prices. |
The implied distributions can be used within the Path Integral Monte Carlo module to price exotic contracts consistently with exchange-traded contracts and they can also be used to search for arbitrage opportunities |
Estimation of implied distributions requires large scale global optimizers. |
We are developing two parallel stochastic optimizers based on mean field approximation (Laplace formula) and Langevin equation |
Derivative valuation functions are integrated using Web technologies into a service which can be accessed from any platform which supports a graphical browser |
Using a combination of HTML forms or Java front-end, CGI mechanism, Perl scripts and modules written in C and MPI, which are executed on multiple NPAC RS 6000 and Sun workstations and the SP-2, the user can:
|
In the next stage, flat files will be replaced with a parallel Oracle server |
Ultimately, the graphical user interface will be supplemented with an agent-based middleware layer, implemented in Java, where derivative pricing and risk management services will be requested and dispatched to the parallel Monte Carlo engine and returned to the client using an EDI-like protocol encapsulated within the KQML envelope. |
This will be a prototype of the new service economy that will flourish on the Web. |
We can exploit the convenience of Java to build sophisticated user interfaces |
Further if computing (such as HPF programs) is linked in real-time to the web, we can get a rich window into execution using Web to process and display information produced by the programs
|
New powerful Web'96 technologies from Netscape, JavaSoft, Oracle, NeXT etc. will result in a new generation of interactive services |
A natural next step is to start Chaining (Integrating) such services to a distributed PSE by providing a server to server communication and dataflow support |
However Web'96 becomes also increasingly complex with its competing and overlapping multi-lingual standards
|
Visual Programming for a multi-server Web (We call it WebVM) based dataflow (we call it WebFlow) is a natural next generation user-friendly programming environment |
We view the area of distributed Web based computing for PSE as a promising niche for NPAC and academic R and D where we expect industry to continue their focus on client-server aspects of the Web where near term profits can be made |
From Gregor von Laszewski |
From Gregor von Laszewski |
From Gregor von Laszewski |
From Gregor von Laszewski |
From Gregor von Laszewski |
http://www.npac.syr.edu/users/gcf/npacaddons -- see foil 105 |
Java provides a convenient way to build flexible graphics interfaces |
The screendump shows the message passing traffic and status of (36) parallel nodes used in a sorting algorithm |
In the example, the 36 threads are running the explicit algorithm on the client |
Alternatively and more generally, the threads are replaying a trace of the program which is or was running on a separate set of nodes |
If one uses Web Servers to control master parallel computation or more generally integrates Web into computing, these Web servers can naturally feed event traces into Java based display
|
From Kemal Ispirli with 36 threads running client-side |
Colors represent node status and links message-passing |
Visible->Virtual Human -- 3D reconstruction of the human body, based on the image database from the National Library of Medicine. |
Currently implemented is color segmentation stage (embarrassingly parallel), to be followed by WebVM/WebFlow based algorithms with non-trivial internode communication (surface reconstruction, object labelling and grouping). |
We show original AVS (still most powerful) and Java prototype |
From Wojtek Furmanski and Zeynep Odcikin Ozdemir |
From Wojtek Furmanski and Zeynep Odcikin Ozdemir |
From Wojtek Furmanski and Zeynep Odcikin Ozdemir |
From Wojtek Furmanski and Zeynep Odcikin Ozdemir |
From Wojtek Furmanski and Zeynep Odcikin Ozdemir |
From Wojtek Furmanski and Zeynep Odcikin Ozdemir |
From Wojtek Furmanski and Zeynep Odcikin Ozdemir |
From Wojtek Furmanski and Zeynep Odcikin Ozdemir |
From Wojtek Furmanski and Zeynep Odcikin Ozdemir |
Web front-end to HPF compiler and PVM-based distributed runtime. |
Supports CASE tools for program development, process management and performance monitoring. |
We have illustrated Java Pablo and Distributed Computing Interfaces already |
This will be initially deployed as a Programming Lab Interface for Web Courses |
PCRC embodies the Parallel Computing Synchronization and collective parallel algorithms and runtime that will enable efficient Web-based computing |
Replace user interface of HPF or HPC++ with the Web(work) and use pervasive Web Technologies in infrastructure (World Wide Virtual Machine -- WWVM) |
The compilation system is accessed through a Web Browser. The HPF program and requests are POSTed to the HTTP Server using HTTP Protocol. |
HTTP Server analyzes the incoming request and activates the HPF Service Master which is a CGI module. |
HPF Service Master starts the Compile module which translates a given HPF program into Fortran 77 with message passing calls (i.e.MPI), and produces an object file using a node compiler. |
Link module links the generated object code with Common Runtime Support (CRS) and MPI libraries. |
Run module forks copies of the executable code on the nodes of a workstation cluster. |
After the request has been satisfied, HPF Service Master puts the results into HTML format and sends back to the HTTP Server. |
HTTP Server sends the results to the Web Browser via the HTTP Protocol. |
The WWVM is accessed through a Web Browser and requests are sent to the server through HTTP Protocol. |
HTTP Server starts a service master which translates given HPF program to F90 with message passing calls and starts-up other client servers. |
HTTP Servers at the client side get the requests through the HTTP protocol connection, and activates a Interpreter CGI module. |
Interpreter makes calls to the Runtime Support and Communication Server that sends and receives messages using PVM daemons. |
From Kivanc Dincer |
From Kivanc Dincer |
We illustrate here how the individual component technologies cooperate in a complete application, WebAMR (Adaptive Mesh Refinement) |
A mesh of computationally extended Web servers, connected via HTTP based message passing, acts as WebVM that runs PDE solver modules for individual grids |
In a simple static AMR topology (WebWork model), a tree of refined meshes is constructed by the user via the AVS like visual programming tools (WebFlow) |
Dynamic AMR trees require interpreted programming support -- a pilot "little language" design towards WebHPL |
WebAMR applications can be configured and run on heterogeneous clusters, including any WebWindows compliant platform |
Example of WebTop System in this domain in a set of WebVM/WebFlow modules, packaged and customized as a PDE Toolkit for a given Grand Challenge community. |
We need to use compilers on tightly coupled systems such as MPP's (shared and distributed memory) |
But for metacomputing, the hardware intrinsically has latencies that suggests increased flexibility of interpreters is more appropriate
|
Maybe frontends should be built with interpreters such as object-oriented PERL5 so easier to link with Web. |
Note that interpreted environment will have best software engineering support and so suggestion is -- taking SP2 as example:
|
This implies that we should allow hybrid model not just for task (interpreted) versus data parallelism(compiled)
|
Current Web Interpreters include Java TCL and PERL(5) which are optimized for different application domains
|
This leads to WebScript Concept of interoperable interpreters optimized for different domains
|
Java is a C++ subset which interestingly does not have pointers as these are unsafe in necessary secure metacomputing environment. |
Thus Java has removed the part of C++ which is hardest to parallelize |
Java may not "survive" but if it doesnt something better will! Thus it makes sense to study and experiment with it |
Natural first step is to use Java to build the interpreted "shell" which we called HPFCL for HPF coordination Language.
|
Java is partially compiled as you take basic Java high-level code and compile down to a universal Java machine language. This is very similar to concepts in ANDF (Architecture Neutral Distribution Format) but with a different goal
|
VRML -- Virtual Reality Model Language -- is an object oriented database built as a subset of the SGI Inventor System |
VRML can be considered as another script optimized for graphics but not many interesting processing (compute) capabilities are in current standard |
VRML can be considered as an example of a universal data structure allowing exchange of 3D objects over the Web.
|
Thus useful to consider data parallel VRML and building CC++ or HPF(Fortran90) modules to support VRML |
HPCC community should join with the Web to ensure that standards such as VRML can be implemented efficiently either in parallel (maybe a niche) but also in a distributed network (similar issues where HPCC can contribute and clearly very important) |
Features of the Java language and runtime
|
Can build on existing work on HPF HPC++ -- especially latter |
Two basic types of opportunities:
|
Applet mechanism naturally incorporates task parallelism -- need to add "channel" class (as in Fortran-M, CC++) to augment "thread" and "socket" classes
|
Java can be used both on Server and Client side as expect soon good Java based clients and servers |
See the E language http://www.communities.com/e.html |
or my class notes http://www.npac.syr.edu/users/gcf/cps616java96 or |
http://www.npac.syr.edu/users/gcf/cps616tech96 |