Given by Geoffrey C. Fox at Minnesota Presentations at Cray Research and University on 13-14 November 95. Foils prepared 10 November 1995
Abstract * Foil Index for this file
See also color IMAGE
We describe an analysis of possible industrial uses of HPCC indicating that "NII" (Multimedia servers) applications will dominate. |
Looking at applications such as education and manufacturing show important opportunities for linking database and simulations. |
This suggests that there are several advantages in building HPCC services such as parallel compilers and messaging systems in terms of Web Technologies. |
This brings tremendous leverage of existing and emerging WebTop productivity tools and allows an excellent parallel software engineering environment. |
We comment on theimpact of computational science education and our program at Syracuse which now has two tracks -- simulation and Information based. |
This table of Contents Abstract
Geoffrey Fox |
NPAC |
Syracuse University |
111 College Place |
Syracuse NY 13244-4100 |
We describe an analysis of possible industrial uses of HPCC indicating that "NII" (Multimedia servers) applications will dominate. |
Looking at applications such as education and manufacturing show important opportunities for linking database and simulations. |
This suggests that there are several advantages in building HPCC services such as parallel compilers and messaging systems in terms of Web Technologies. |
This brings tremendous leverage of existing and emerging WebTop productivity tools and allows an excellent parallel software engineering environment. |
We comment on theimpact of computational science education and our program at Syracuse which now has two tracks -- simulation and Information based. |
Firstly we can use this technology to implement HPCC on a broad technology base
|
Secondly we can use technology to implement Virtual University to teach internally and across the Globe |
Thirdly we can teach our students about these concepts
|
Parallel Computing Works! |
Technology well understood for Science and Engineering
|
Supercomputing market small (few percent at best) and probably decreasing in size
|
No silver programming bullet -- I doubt if new language will revolutionize parallel programmimng and make much easier
|
Social forces are tending to hinder adoption of parallel computing as most applications are areas where large scale computing already common
|
ATM ISDN Wireless Satellite advancing rapidly in commercial arena which is adopting research rapidly |
Social forces (deregulation in the U.S.A.) are tending to accelerate adoption of digital communication technologies
|
Not clear how to make money on Web(Internet) but growing interest/acceptance by general public
|
Integration of Communities and Opportunities
|
Technology Opportunities in Integration of High Performance Computing and Communication Systems
|
New Business opportunities linking Enterprise Information Systems to Community networks to current cable/network TV journalism |
New educational needs at interface of computer science and communications/information applications |
Major implications for education -- the Virtual University |
This is both Grand Challenges augmented by National Challenges but also |
Build HPCC technologies on a broad not niche base starting at bottom not top of computing pyramid |
It provides a pervasive and highly innovative technology base
|
Note Intel Teraflop computer will have 9000 P6's but WWW will have at least one thousand times as many possible nodes varying (eventually) from supercomputers to settop boxes |
WWW is important as it allows rich (world wide linkage of simulation and information capabilities) open and portable environment |
Each of three components (network connections, clients, servers) has capital value of order $10 to $100 Billion |
InfoVision is ultimate "client-server" application
|
Democracy on the NII (Gore)
|
Application Specific NII Specific Services for
|
Clients (such as Mosaic and Netscape) support browsing of hyperlinked documents but have no internal interactive/compute capability |
Servers read HTTP and deliver requested service to client |
HTML -- a document format supporting hyperlinks |
HTTP -- a Transport Protocol defining Interaction between Web servers and Clients |
MIME -- a data format allowing agent-like (extended email) communication |
CGI -- a standard interface allowing sophisticated server extensions |
PERL -- a rapid prototyping language(script) aimed at text and file manipulation |
Web Search engines such as YAHOO, HARVEST, WAIS -- early distributed database access technology supporting search and indexing |
net.Thread, WebTools, RealAudio are early Web Interactive services |
Relational databases -- Oracle,DB2 have Web Interfaces |
Collaboration from Console Units (PIctureTel, CLI), Desktop (SGI Inperson) to MOOs |
Compression from MPEG and Wavelet to host of proprietary solutions -- a faction of 20 to 200 saving in space and bandwidth |
Geographical Information Systems |
Security will enable commerce on the Internet -- essential for Defence as well |
Produced by Gang Cheng April 1995 |
There is a larger Better Quality Image available |
Oracle 7 Interface to Usenet-Prepared October 27,1995 |
Associated material may be found starting at Oracle-Web Interface to Usenet and other Services |
Oracle 7 Interface to Usenet-Prepared October 27,1995 |
Associated material may be found starting at Oracle-Web Interface to Usenet and other Services |
ATM, ISDN, Wireless, Satellite will be hybrid physical implementation of NII |
CORBA, Opendoc, OLE, SGML, Hytime are critical file and document standards |
High Performance Multimedia servers to enable digital information delivery on demand |
Data transport from MPI/MSGWAY/PVM to AAL to CBR/VBR |
Windows95/NT -- the last of the the non social(Web) operating systems -- will follow dinosaurs(IBM mainframes) into extinction |
Personal Digital Assistants -- WebNewtons done right -- Telescript (agent based communication) and Magic Cap operating system |
WebWindows -- the open nonproprietary operating system of future supplanting UNIX, Windows95/NT, Apple etc. -- manages with a single interface all machines either individually or collectively on the NII |
WebWork -- Implements Computing for both Simulation and Information ontop of WebWindows-- the correct implementation of HPCC ideas such as HPF,MPI with pervasive technologies and good software engineering |
WebScript -- The evolving Middleware of scripted languages including PERL5, Java, Telescript, MOVIE (NPAC early prototype), domain specific Problem Solving Environments |
This will lead upto Ultimate Goal! Televirtuality -- All Web Users are linked into a single virtual world |
Java -- an interpreted C++ like language (script) allowing fully interactive clients which execute applets. Has full set of classes to make clients such as HOTJava. Licensed by Netscape |
VRML -- a 3 dimensional HTML allowing universal description of physical objects and allowing interchange of virtual worlds, commercial product designs etc. |
PERL5 -- an extension of PERL4 with full object oriented characteristics and extended pointer(array) constructs -- allows construction of Web Software obeying good software engineering practices |
Telescript -- forced into semiopen by Java (!?) -- dynamic Web Transport and Server technology replacing HTTP,MIME .. |
Multithreaded WebServers integrating current Web, Compute and digital multimedia delivery services -- future Enterprise Systems |
An example of HotJava applet that makes essential use of Java multithreading. |
Three different sorting algorithms are visualized on a single HotJava page. |
Each algorithm can be started independently or they can all run concurrently. |
Concurrent mode allows for real-time visual comparison of various algorithms and their performance. |
Latest results prepared for HPDC95 Tutorial August 1,1995 |
HotJava Demonstration |
HotJava Demonstration |
In future one will NOT write software for either
|
Rather one will write software for WebWindows defined as the operating environment for World Wide Web |
WebWindows builds on top of Web Servers and Web Client open interfaces as in
|
Applications written for WebWindows will be portable to all computers running Web Servers or Clients
|
From foilset WebTools (Spring '95) |
Associated Foil can be found |
Postscript also Available |
It does not provide multi-threading/multiu-user support, memory management, device drivers and such base services -- these are supplied by UNIX, Windows or Mac O/S |
Rather it provides equivalent of higher level O/S services such as available under UNIX shell or applications supplied under Windows |
In the future one will build applications for WebWindows not UNIX / PC windows etc. |
Very interesting is WebWindows version of Lotus Notes to support Business Enterprise systems -- build from Web components such as those prototyped in WebTools
|
Persuasion and Powerpoint are rather similar monolithic packages which can for instance only be clumsily ported to UNIX as cannot access internal data-structures defining foils |
WebFoil (NPAC prototype WebWindows presentation package) has |
Extended open HTML source manipulated by powerful PERL5 scripts allowing global changes and linkages of foils from many sources
|
WebFoil Uses Hotjava to display HTML with full Web Power including applets to enable Multimedia and dynamic presentations |
Initial webfoil 0.1 release Halloween 1995 |
The WebTop Productivity environment will be built in a more modular fashion than current PC Windows or Macintosh arena
|
Java is key to understanding how WebWindows application/service software will look as it allows balanced client server applications to be built |
Note require an open display software so can produce appropriate customized interfaces for browsing, presenting, word processing etc. |
Java may or may not be accepted by Web Community and Sun/Netscape may or may not allow it to used openly |
However the concept is essential and roughly right -- one or more such open technologies will become available and used on the Web |
Initial webfoil 0.1 release Halloween 1995 |
Desktop Publishing and Productivity Tools in WebWindows (WebTop Productivity/Publishing)
|
InfoVision: Delivery on Demand of Information from:
|
Commerce -- digital Cash and signatures with appropriate authentication and security. Enables both Web Commerce (shopping) and use of Web for proprietary information |
Interactive and "batch" Collaboration
|
Metacomputing -- the collection of world wide computers as a coordinated (in subgroups of computers) computational engine (for simulation or information processing)
|
This is distributed databases for supporting cost effective healthcare with less fraud, better use of existing information for establishing care-plans etc |
This is collaboration, remote instrument control for telemedicine |
Could be full televirtuality for virtual-reality controlled remote surgery in battlefield or accident scenarios |
This is basis of Virtual University and NII can be expected to be much more succesful than videosystems because interactive, collaborative, explorative and full multimedia information at student and teachers fingertips |
Base of Distance Education is InfoVision for full interactive curricula
|
Rich Collaboration environments including televirtual MOO's for student-student and student-teacher interactions |
InfoVision is "successor" to TV with any multimedia information delivered on demand( choice from infinite number of channels) |
Community Networks will define local societies and will have significant impact on local government |
Shopping on the Web will include multimedia digital yellow pages , Commerce, online catalogs (which is InfoVision again) as well as perhaps powerful VR interfaces where you can try out new clothes and cars |
Collaboration (gossip as in computer forums) could be an important and dominant use but perhaps not initial major one |
OLTP (Online Transaction Processing) such as approving and recording credit card transactions. This is a type of InfoVision and Commerce which is operational today
|
Decision Support varies from fraud detection, inventory planning and market segmentation for optimizing shopping by mail |
Decision support can vary from search of a single giant relational database to galaxy-wide search of heterogeneous distributed database |
Workflow Support as in LOTUS Notes integrates Collaboration, Project Management and Distributed Databases. This supports ongoing distributed enterprise -- this is also essential in collaboratory |
The World Wide Web will develop a marvellous WebTop Environment allowing users to access Web versions of Word Excel(Lotus123) Persuasion(Powerpoint) Databases Lotus Notes etc.
|
This (as developed) enables a wonderful new software industry as Microsoft no longer has key advantages |
This (as used) enables very effective (business) enterprise systems where "Web" used internally to an enterprise
|
Critical feature is realtime, "come as you are" adaptive linked computers and people |
Judgement support extends decision support into an "exploratorium" scenario as crises tend to be unexpected |
Major need to search community and government databases for immediate information on resource location and availability etc. Metadata(summaries) essential |
Collaboration between commander in field , specialized anchor desks (domain experts) and those in field. |
User Interface essential as user will be tired and searching unfamiliar data |
Geographical Information Systems and browsing multiple video sources (InfoVision again) will be critical as judgements will depend critically on spatial data. |
This is future model for (inter)national distributed research |
Rich Collaboration environment essential as collaborative research requires nontrivial person to person interactions |
Searching distributed databases basis of much scholarly work (infoVision and Digital Library) |
Metacomputing for multidisciplinary, multi-institutional simulations and for control and data storage and analysis from remote instruments whether satellites, telescopes, accelerators etc. |
Distributed (people) Software Engineering support for production of distributed computing software |
Needs workflow support as distributed enterprise |
Critical feature is closely integrated collaboration of very many people and computers requiring |
Metacomputing Simulation and distributed database support as in Collaboratory |
Workflow support including configuration management and central CAD databases |
Rich collaboration environment to support distributed design decisions |
Standards and Security to allow interlinking of people and software from different organizations |
Key special requirement is distributed coordination |
A set of manufacturing companies -- Rockwell International, Northrop Grumman, McDonnell Douglas, General Electric and General Motors is studying the NII implications for a particular MAD system "Affordable Systems Optimization Process" (ASOP) |
Interesting parameters are that next major aircraft to be built could involve:
|
For instance as part of my New York State Industrial HPCC outreach program InfoMall, I found that a major manufacturer of large consumer machines had no interest in MPP's for simulating them to improve design |
However very interested in
|
Here Perl manipulates text from database to HTML |
Java enables down-loaded simulations |
VRML enables universal definition of 3D objects -- products and buildings |
VRML illustrates how one can store real world objects in a universal fashion |
Game vendors can build modules that interact and enable development of amazing profitable virtual worlds! |
Manufacturers can use VRML as basis of universal product definitions enabling collaborations between several vendors needed for Multidisciplinary analysis and design cf: PDES/STEP standards |
The Web "levels" the playing field for all software products
|
For instance VRML allows new powerful versions of Geographical Information Systems |
Using San Diego VRML Viewer Webview |
Little Neck Bay in Northern Long Island (altitude exaggerated by factor 7) |
From Living Schoolbook Project |
Hot buttons linking to weather page in Albany area |
From Living Schoolbook Project |
We can use Web technologies to develop new very important tools for education enabling
|
We can teach these new technologies as world hungry for people understanding these technologies
|
Living Schoolbook -- Prototype of K-12 Educational Environment of year 2000
|
HPDC95 Tutorial and Other Computational Science Courses CPS600, CPS615
|
Physics 105/106 -- Science for the 21st Century (for non-Scientists) -- Some course modules built around Multimedia Information Systems
|
This hyperlinked material accounts for about 10% Phy 105, 20% Phy 106 and expect to increase if success continues
|
The Living Schoolbook is a New York State funded Initiative to create K-12 educational applications that exploit leading information technologies |
Living Schoolbook Base Educational Services are:
|
Living Schoolbook Leverages Information Technologies
|
The Project Team
|
Upstate Project Schools
|
Downstate (New York City) Project Schools
|
askERIC Educational Database for teachers with consultation |
The Discovery Channel -- Video Content Provider |
NewsBank -- Text Content Provider |
Reuters News Service |
Syracuse Language Systems -- Learn Foreign Languages on Demand |
TravelVenture -- Interactive travel information on Demand |
US Air Force Rome Laboratory -- InfoVision technologies |
WorldView Corp. : Interactive Client-Server Geographic Information System |
Video and Server Technology Network is prototype of Wire Service of future using Web Technology to service Mass Communications Industry |
Partner with this field (Newhouse School) to find out how to author on-line video and other multimedia material |
NYNET ATM network extended internally to allow linkage of NPAC to Newhouse School of Public Communications and University Electronic Media Production Unit |
Faculty and students -- the multimedia digital journalists of the future will use:
|
Study Integration digital editing (AVID) technology of media field with digital web and powerful computer technology. |
Industrial partners from traditional print and analog video fields
|
High Performance (Parallel) Computers on High Speed (ATM) Networks linked to clients at a network performance that supporting realtime Video at a resolution between VHS,HDTV . |
MPP's as Internet/Web/NII/GII Servers
|
Dual-Use Philosophy must be extended to Multi-Use
|
Standards must be used
|
Web Servers use "Web Technology" to service World Wide Web and other forms of networked multimedia information |
Dr. Smith of SUNY Health Science Center demonstrates Telemedicine over ATM in area of pediatric cardiology |
There is a larger Better Quality Image available |
Searched on Inventions |
FLAG is an enterprise in which NYNEX Network Systems Company is a major (roughly 40%) investor. |
Current fiber link from U.K. to Japan (via Africa) is being constructed at an approximate $1.4B cost |
Natural Strategy is for Web Servers in U.S.A.. to deliver educational material via FLAG to Africa and Far East |
This would set up hierarchically as:
|
Real-Time Compression critical for interactive use of FLAG as lines are costly -- note Internet is free but needs compression as overloaded .... |
Many students from these countries come to the U.S.A.. now but ...
|
In Virtual University, one sets up a partnership between U.S.A.. and overseas University where key curricula and its delivery are provided over GII (Global Information Infrastructure of which FLAG is one example) |
High-end PC's should be included as possible Web server for Africa even we use SP-2, multi-processor SGI etc. as server in U.S.A.. University |
A NYNEX Joint Venture |
This shows fiber draping Africa with coast off ramps |
Caching can either be teacher driven (preselect material) or student driven as in computer paging
|
Caching helps with both bandwidth and ensuring students browse relevant and appropriate material
|
Datamine the WWW for resources relevant to K-12 Classroom
|
Selection by teachers provides high-value materials, efficiency in teacher preparation time and K-12 appropriate material
|
Could be useful to produce selections on CDROM for targeted application areas. |
We will need caching anyway for both the Global University and indeed general hierarchical Web Server/ InfoVision scenario |
Comparison with InfoVision and the Entertainment Analogy: |
Suppose Jurassic Park VI is released on the Hollywood NII Server |
Without Caching -- perhaps 20 million people will videodial Hollywood to get their simultaneous showings at 1.5 megabits/second each
|
With Caching, average person will find new movie cached on local server only a few optical fiber miles away. Will reduce needed bandwidth by about a factor of 100 as must travel about 15 miles not 1500 miles to get movie. |
See electronically for actual home page |
Computational Science is an interdisciplinary field that integrates computer science and applied mathematics with a wide variety of application areas that use significant computation to solve their problems |
Includes the study of computational techniques
|
Includes the study of new algorithms, languages and models in computer science and applied mathematics required by the use of high performance computing and communications in any (?) important application
|
Includes computation of complex systems using physical analogies such as neural networks and genetic optimization. |
World Wide Web basics : HTTP,MIME, servers,clients |
PERL4 and object-oriented features in PERL5(to be finished) |
Wavelet and Other Compression Technologies |
Collaboration Technologies from MBONE to CLI |
ATM Networks with comparison with ISDN and traditional LAN |
Parallel Relational Databases and Web Integration |
Thread based Communication Environments |
Video servers and network management for good quality |
Parallel Web Servers (to be finished) |
Advanced Web Technologies -- agents, VRML, Java (to be finished) |
IMM is a Joint Program Set Up Between
|
IMM could be cornerstone of proposed "Information Initiative" |
IMM degree involves 36 units -- 12 courses of which 6 are required |
Courses are divided into Four Tracks |
6 required Courses are:
|
Track1: Multimedia Systems and Tools -- this is
|
Track 2: Multimedia Design and Applications -- this is
|
Track 3: Aesthetics and Ethics in Multimedia -- this is
|
Track 4: Management and Evaluation of Multimedia --
|
Each track has a core required course and a set of introductory and advanced electives |
Student must take 6 electives -- one of which must be in each track |
Electives will be offerred at various times but basic cycle is summer to summer (1.3 year time) |
Summer: Proseminar |
Fall: Core course for Track 1: Multimedia Systems
|
Fall: Core course for Track 2: Multimedia Design
|
Spring: Core course for Track 3: Aesthetics and Ethics
|
Spring: Core course for Track 4: Management and
|
Summer: Capstone Experience |
SImulation Track -- Graduate
|
Masters in Computational Science built around these core copurses CPS615,713 |
Simulation Track -- Undergraduate
|
CPS 401/601 IMM 601 Multimedia Systems and Tools -- Core course for Track 1 of IMM degree |
CPS 403/703 Computational Science Elective: 1 Lecture a week -- rest Laboratory -- elective for IMM |
CPS 406/606 Introduction to Information technologies and Systems -- designed as elementary elective for IMM |
CPS 616 Overview of Information Track Computational Science -- advanced elective for IMM |
CPS 714 Case Studies in Information Applications of Computational Science -- advanced elective for IMM |
"Web Technology"/Information Track of Computational Science Masters built around CPS 616,703,714 |
Certificate in Computational Science offered at Peking University and Harbin Institute of Technology Spring 1996 is a prototype of Syracuse University (ECS/NPAC) based extension school |
As Internet Connections to China are not guaranteed to be great(!) we will use Web Technology but assume that Electronic Course material will be packaged at NPAC(SU) in a Pentium PC running WindowsNT and Java
|
This will be updated in batch mode by Syracuse -- China Connection |
Students in China will Interact with mentors in China and with NPAC via Internet (web and email) |
Project designed by Fox,Leskiw(NPAC), Xiaoming Li(Harbin and Peking visiting NPAC) |
Graduate Students -- initially 5 to 10 at each of 2 University |
4 Courses -- each 10 1 hour lectures -- offered Spring 1996 over 20 week period |
ICPS 700: Introduction to Simulation Track of Computational Science
|
ICPS 701: Parallel Programming Laboratory
|
ICPS710: World Wide Web Technology
|
ICPS711: Web Programming
|
WebWork is an open, world-wide distributed computing environment based on computationally extended Web Technologies |
The backend computation and information infrastructure is provided by the World-Wide Virtual Machine -- a mesh of computationally extended Web Servers (called Compute Servers) |
These servers manage (via CGI mechanisms) a collection of standardized computational units called WebWork Modules. |
Geographically distributed and Web-published WebWork modules interact by HTTP/MIME based message/object passing and form distributed computing surfaces called Compute-Webs |
The front-end user/client interfaces are provided by evolving Web browsers with increasing support for two-way interactivity (e.g. Java, VRML) that facilitates client side control and authoring. |
A natural user-level metaphor -- WebFlow -- is supported in terms of visual interactive compute-web authoring tools. |
Implements the "Viable Base" Enterprise Model of HPCC Software identified in Pasadena2 workshop |
This will allow good programming tools to be developed and mnaintained as larger enough base to support software industry |
Implements a powerful software engineering framework for parallel computing by integrating parallel programming with the World Wide Web Productivity Tools |
They have communication difficulties hampering best use of their team of over 200 software engineers in Madras India |
As with other large companies, problem reports are rotated around world on 24 hour basis. If East Coast hasn't solved by COB, customer problem sent to open office the the West so that by 8 am EST, solution is waiting for customer with perhaps many offices having worked on it as it moved (virtually) around the globe. |
We have proposed to them that local database solution is Oracle but World Wide Web linkage be in terms of WebWindows (WebSpace/WebWork). |
RSA security systems based on numbers
|
Bank of England and English Savings and Loan based on m=155 (512 binary digits) |
RSA129 cracked by factoring with email team using sophisticated version of Quadratic Sieve. RSA155 will use better Number Field Sieve |
Need x2 = y2 mod(RSAm) as then gcd(x+y,RSAm) likely to be interesting factor |
Find x and y by finding lots of interesting a's
|
Given these a's factored into primes, multiply together so powers of primes are even. This gves desired x |
This last step requires graph theory and solution (for Bank of England) of 5 million linear equations |
RSA155 requires about 300 teraops hours to solve with NFS |
RSA129 needed about an order of magnitude less time. Can be done today faster if use Number Field Sieve |
We have roughly one to five million independent calculations which form the rows of matrix (after clever graph theory manipulates and combines) |
Set of master servers publish problem to solved with suitable demos, description of algorithm and full marketing attention.
|
Clients return results -- not so easy except by email and cut and paste |
Best done as a set of cooperating servers where server performing factorization publishs it solution as a file on the WWW. |
Cooperating servers also better for computer administrators as can control set of clients at a given site |
Initially use humans but replace by agents when software ready |
Factoring on the Web Project |
Factoring on the Web Project |
Factoring on the Web Project |
WebWork is based on a three-layer architecture shown in figure 2, including: World_Wide Virtual Machine (WWVM) in the (bottom) layer 1, Middleware layer 2 of agents, wrappers, mediators etc., and high level programming environments (e.g. HPFCL) and user interfaces (e.g. WebFlow) in the (top) layer 3. |
All base WebWork concepts can be implemented in terms of today's Web technologies (HTTP, MIME, CGI) and a prototype is under development at NPAC. |
The overall design is open and ready to upgrade the existent (e.g. browsers or servers) and include new (e.g. agents or distributed object brokers) Internet/Web technologies |
One starting point for the WebWork construction is provided by NPAC WebTools -- a CGI-extended Web server with enhanced content authoring and database navigation functionalities. WebTools Server is used as a prototype WebWork node server. |
Illustrates 3 base layers of WebWork architecture and all main system components. |
A 4--node compute-web is represented
|
Java/HotJava model is used for WebFlow front-end implementation |
The paper describing this project is available at SCCS715 in NPAC technical report series |
WebWork pilot project is a collaboration between NPAC, Boston University and Cooperative Systems Corporation, MA. It will prototype a candidate VSL, WWVM, Java based user interfaces, and port selected Grand/National Challenge applications to this platform. |
The project will use NPAC WebTools to bootstrap the software process and will prototype WWVM in terms of current Web technologies (Screen 1) |
Technically, early WWVM will include existent Web Servers with add-on CGI (Perl) scripts that build server-to-server communication and offer document database management, and module publication and linkage/instantiation support. |
This base model will be further extended and refined by using and driving evolving Web technologies. For example, the disk-based model in Screen1a will likely evolve towards memory-mapped model based on multi-threaded interpreted compute-servers (Screen 1b) |
Illustrates implementation of WebWork message passing in terms of
|
This diagram illustrates point-to-point communication between Web servers, used to implement a webflow channel between compute-web modules. Two extreme implementation modes are described: a) based on today's Web server technology, and b) based on thread memory mapped high performance implementation, expected in future Web compute-servers. Subsequent steps, represented by a sequence of labelled lines in the figure, are described below in both implementation modes. |
a) Today's Web server mode: (1) -- M1 locks O1 on S1 disk. (2) -- M1 sends POST HTTP message to S2 with M2 URL in the header sector and with O1 URL in the body sector. (3) -- S2 activates M2 via CGI and passes O1 URL as a command-line argument. (4) -- M2 sends GET method to S1 with O1 URL in the header. (5) -- S1 fetches O1 from its document tree. (6) -- S1 sends the content of O1 to M2 which completes the GET exchange. (7) -- M2 saves O1 by overwriting current I2 on the S2 disk. If I2 is locked, M2 waits (blocks). (8) -- After O1 is saved on the S2 disk, M2 returns 'end-of-transfer' acknowledgment to M1 which completes the POST exchange. (9) -- M1 unlocks O1 and exists. |
b) Compute-server (future Web server) mode: (1) - M1 locks its memory object O1. (2) - M1 checks if socket connection to M2 is in M1 connection table. If yes, go to (5) below. Otherwise, M1 connects to S2 and sends M2 creation script. (3) - S2 spawns M2 and acknowledges. (4) - M1 receives acknowledge message and saves new socket in connection table. (5) - M1 gets O1 handle. (6) - M1 writes O1 to M2 using socket lib calls. (7) - M2 reads O1 using socket lib calls. If I2 is free, O1 buffer is copied directly to I2 buffer. If I2 is locked, M2 creates O1 clone and blocks. (8) - M2 sends acknowledge to M1. (9) - M1 unlocks O1 and blocks. |
User-level WebWork metaphor is given by WebFlow -- a distributed dataflow model built in terms of WebWork modules and MIME object/document communication channels.
|
WebWork users will build and control distributed computing applications (compute-webs) using Web browsers based visual interactive editors and monitors. |
We are currently prototyping such WebFlow front-ends at NPAC using Java/HotJava model. WebWork modules are represented by Java threads (Screen 6) and visualized as interactive interconnected icons (Screen 7) |
Early prototype of AVS or Khoros like visual compute-web editor. |
Two interactive modes are supported:
|
In mode a), each click in the active editor window places a new module box there. |
In mode b), each click on module port generates links with all other modules. |
More generally, this Middleware Layer 2 will be rather complex and populated by a spectrum of proprietary (e.g. Telescript, ScriptX, CORBA) and public (e.g. Perl, Tcl, Harvest, Java, VRML) scripted languages, brokers, agents, wrappers, mediators etc. see Screens |
In WebWork, we refer collectively by WebScript to the whole ensable of these models. |
At the current stage, it isn't clear if WebScript as a common intermediate language is a practical concept. An alternative is to live in the multi-language Web medium and emply interoperability agents to translate between various protocols. |
Practical initial implementation platfrom for this dual approch is provided in WebWork by an integrated collection of WebTools CASE tools based HySource Worlds for various languages. |
One current WebWork/WebFlow application, prototyped at NPAC, is Software Project Manager (Screen 8). Each software developer runs his/her WebTools server and uses HySource CASE tools. These servers are WWVM-connected to agent and manager servers. Agent server receives automatic notifications from developers servers on each software volume update, and uses customizable thresholds to decide when to fire a report to the manager or a deadline reminder to a developer. |
Software Project Manager tools contains a simple agent server that mediates between client/consumer ( here manager) and servers/producers (here developers). |
A front-end for the software project manager tool. |
Three types of modules are supported:
|
Developer modules are linked to the agent module and report automatically all changes in the software volume (handled by WebTools CASE toolkit integrated with WebTools editor). |
The agent module integrates the results and uses customizable threshold to decide when to fire a report to the manager or a deadline reminder to a developer. |
HyPerl World page, generated automatically by the WebTools CASE package, and integrating documentation with the source. |
More generally, we call by HySource the hypertext documentation with navigable source code included. |
Function calls and external variable references are 'blue' and point to the corresponding HySource pages. |
We need to do more than make HPF available on PC/Workstation networks and shared memory multiprocessors |
We need to make HPF (and similar HPCC technologies) the languages that typical(many) PC/WS user will adopt because it supports the distributed computing opportunities of the World Wide Web |
This implies that we need to build HPF on top of common Web or distributed computing standards.
|
Portable and Scalable Multi-platform Runtime Support
|
Integrated Multilanguage Support
|
Syracuse University
|
Cooperating Systems
|
Harvard University
|
Indiana University
|
Rice University
|
University of Maryland
|
University of Rochester
|
University of Texas, Austin
|
PCRC embodies the Parallel Computing Synchronization and collective parallel algorithms and runtime that will enable efficient Web-based computing |
Replace user interface of HPF or HPC++ with the Web(work) and use pervasive Web Technologies in infrastructure (World Wide Virtual Machine -- WWVM) |
We need to use compilers on tightly coupled systems such as MPP's (shared and distributed memory) |
But for metacomputing, the hardware intrinsically has latencies that suggests increased flexibility of interpreters is more appropriate
|
Maybe frontends should be built with interpreters such as object-oriented PERL5 so easier to link with Web. |
Note that interpreted environment will have best software engineering support and so suggestion is -- taking SP2 as example:
|
This implies that we should allow hybrid model not just for task (interpreted) versus data parallelism(compiled)
|
Current Web Interpreters include Java TCL and PERL(5) which are optimized for different application domains
|
This leads to WebScript Concept of interoperable interpreters optimized for different domains
|
Java is a C++ subset which interestingly does not have pointers as these are unsafe in necessary secure metacomputing environment. |
Thus Java has removed the part of C++ which is hardest to parallelize |
Java may not "survive" but if it doesnt something better will! Thus it makes sense to study and experiment with it |
Natural first step is to use Java to build the interpreted "shell" which we called HPFCL for HPF coordination Language.
|
Java is partially compiled as you take basic Java high-level code and compile down to a universal Java machine language. This is very similar to concepts in ANDF (Architecture Neutral Distribution Format) but with a different goal
|
VRML -- Virtual Reality Model Language -- is an object oriented database built as a subset of the SGI Inventor System |
VRML can be considered as another script optimized for graphics but not many interesting processing (compute) capabilities are in current standard |
VRML can be considered as an example of a universal data structure allowing exchange of 3D objects over the Web.
|
Thus useful to consider data parallel VRML and building CC++ or HPF(Fortran90) modules to support VRML |
HPCC community should join with the Web to ensure that standards such as VRML can be implemented efficiently either in parallel (maybe a niche) but also in a distributed network (similar issues where HPCC can contribute and clearly very important) |
WebWork Interpolates and Integrates pervasive Web HPCC and (nonHPCC) commercial software as in following table comparing computing concepts in three "worlds"; HPCC -- Commercial mainstream -- Web |
Current Web model needs computational extensions for banking/financial applications, manufacturing, interactice shopping/videogames etc |
HPCC can provide Web both parallel computing programming models, libraries and language/runtime concepts which coordinate components of distributed or parallel system |
HPCC needs the Web (or equivalent) to give it viable distributed computing and software engineering base |
The Web interpolates between "flaky" research software and solid but closed corporate solution. Clear trend away from proprietary towards open software models. |
Current HPCC, Current Commercial Mainstream, Current and conjectured future Web |
Print this from Postscript Version |
The paper describing this project is available at SCCS715 in NPAC technical report series |