Given by Geoffrey Fox at IBM Poughkeepsie on February 7 1996. Foils prepared February 11,1996
Abstract * Foil Index for this file
See also color IMAGE
Web Technologies (Java, JavaScript, VRML, TeleScript, Perl, HTML, CGI, HTTP etc.) will probably revolutionize all computing converting todays client/server to WebServer/WebClient and DeskTop to WebTop. |
Certainly these technologies provide a pervasive base supporting data transport, 3D object specification, coarse and fine grain objects as well integration with other capabilities such as databases. |
We examine the implications for HPCC and suggest that a sustainable HPCC business model can be based around
|
In the WebWindows Operating System Approach this is implemented on a compute-web of WebServers running on each node of an MPP or distributed cluster. |
We examine this picture for MultiDisciplinary Optimization and other applications. |
This table of Contents
Abstract
Presentation to Power Parallel Group within IBM on February 7,1996 at Poughkeepsie |
Geoffrey Fox |
NPAC |
Syracuse University |
111 College Place |
Syracuse NY 13244-4100 |
Web Technologies (Java, JavaScript, VRML, TeleScript, Perl, HTML, CGI, HTTP etc.) will probably revolutionize all computing converting todays client/server to WebServer/WebClient and DeskTop to WebTop. |
Certainly these technologies provide a pervasive base supporting data transport, 3D object specification, coarse and fine grain objects as well integration with other capabilities such as databases. |
We examine the implications for HPCC and suggest that a sustainable HPCC business model can be based around
|
In the WebWindows Operating System Approach this is implemented on a compute-web of WebServers running on each node of an MPP or distributed cluster. |
We examine this picture for MultiDisciplinary Optimization and other applications. |
Parallel Computing Works! |
Technology well understood for Science and Engineering
|
Supercomputing market small (few percent at best) and probably decreasing in size
|
No silver programming bullet -- I doubt if new language will revolutionize parallel programmimng and make much easier
|
Social forces are tending to hinder adoption of parallel computing as most applications are areas where large scale computing already common
|
Technology Opportunities in Integration of High Performance Computing and Communication Systems
|
New Business opportunities linking Enterprise Information Systems to Community networks to current cable/network TV journalism |
New educational needs at interface of computer science and communications/information applications |
Major implications for education -- the Virtual University |
This is both Grand Challenges augmented by National Challenges but also |
Build HPCC technologies on a broad not niche base starting at bottom not top of computing pyramid |
It provides a pervasive and highly innovative technology base
|
Note Intel Teraflop computer will have 9000 P6's but WWW will have at least one thousand times as many possible nodes varying (eventually) from supercomputers to settop boxes |
WWW is important as it allows rich (world wide linkage of simulation and information capabilities) open and portable environment |
Each of three components (network connections, clients, servers) has capital value of order $10 to $100 Billion |
InfoVision is ultimate "client-server" application
|
Democracy on the NII (Gore)
|
Firstly we can use this technology to implement HPCC on a broad technology base
|
Secondly we can use technology to implement Virtual University to teach internally and across the Globe |
Thirdly we can teach our students about these concepts
|
Application Specific NII Specific Services for
|
Browsers have SAME interface on ALL Computers |
CGI Programs are typically written in PERL but can be essentially ANY UNIX Process and so do simulation, database access, advanced document processing etc. |
Clients (such as Mosaic and Netscape) support browsing of hyperlinked documents but have no internal interactive/compute capability |
Servers read HTTP and deliver requested service to client |
HTML -- a document format supporting hyperlinks |
HTTP -- a Transport Protocol defining Interaction between Web servers and Clients |
MIME -- a data format allowing agent-like (extended email) communication |
CGI -- a standard interface allowing sophisticated server extensions |
PERL -- a rapid prototyping language(script) aimed at text and file manipulation |
Web Search engines such as YAHOO, HARVEST, WAIS -- early distributed database access technology supporting search and indexing |
net.Thread, WebTools, RealAudio are early Web Interactive services |
There are evolving/confusing/overlapping capabilities ... |
Java -- Objected Oriented version of C/C++ supporting Interactive Distributed Computing. Previous Web computing (eg CGI) was server-side. Java allows design and Implementation of balanced Client Server Applications
|
JavaScript -- only superficially related to Java and was called LiveScript -- is Netscape's fully interpreted Client side extension of HTML. This is a good integration/customization technology where flexibility more impotant than performance
|
HotJava Demonstration |
From Living Schoolbook Project |
From Meryem Ispirli |
l Good l Fair l Poor |
This prints in applet window, the classic Hello World string! |
import java.awt.Graphics |
public class HelloWorld extends java.applet.Applet {
|
} |
g which is of class Graphics, is window in which applet runs (i.e. is displayed) |
Applications are .java files with a main class which reads arguments and is excuted first |
One uses javac to compile the application converting .java to .class |
Then run the interpreter java with the .class file as argument |
.java files are in Java; .class files are in universal bytecodes |
The resources javac and java are part of JDK and are not in Netscape and so are currently not broadly available. You must log in to our servers to use them |
So instead in this course we will use applets so all the Java threads are distributed around and don't grind our servers to a halt |
Applets should NOT have main method but rather init, stop, paint etc. |
They should be run through javac compiler getting a .class file as before |
Create an HTML file (say HelloWorld.HTML in same directory as .class file) and include in this |
<applet code="Example.class" width=500 height=200 > </applet> in simplest case with no parameters where applet will run in window of given width and height (in pixels) |
If you have JDK on one's machine, one can run the applet with appletviewer HelloWorld.html |
Alternatively run Netscape 2.0 essentially anywhere and applet is interpreted and run by Java interpreter built into Netscape. |
This way we can compile on places with JDK installed but run almost anywhere! |
Rome Laboratory Collaborative and Interactive Visualization Jan 31,96 |
Rome Laboratory Collaborative and Interactive Visualization Jan 31,96 |
Rome Laboratory Collaborative and Interactive Visualization Jan 31,96 |
Rome Laboratory Collaborative and Interactive Visualization Jan 31,96 |
From Meryem Ispirli |
Release of Beta/1.0 HotJava expected soon and could be very interesting technically for certainly alpha HotJava was very helpful in building customized Graphical User Interfaces
|
Hooked on Java by Java developers Arthur van Hoff, Sami Shaio, Orca Starbuck is (first) serious (but still rather high-level) book on beta Java |
Substantial tutorial and report material available on line http://www.javasoft.com |
Netscape renames Livescript as Javascript and this is an interesting variant of Java which is fully interpreted -- use for overall customization of client |
Use Java for detailed programming and JavaScript for overall integration of client interface and system |
JavaScript: Interpreted by client and NOT compiled |
Java: Compiled on Server before execution on client
|
JavaScript: Object based -- no classes or inheritance -- built in extensible objects |
Java: Object-oriented. Programs consist of object classes with inheritance |
PERL is a relatively old technology which is being overtaken by Java tidal wave. Still PERL has much better Systems and Document handling capability than Java
|
The Web provides a convenient integration environment for "mature" technologies migrating from existing computer environments. |
Relational databases are a good example where it is now straightforward in Oracle, DB2, Sybase etc. to provide a Web Interface which can be used by programs ( with say HPF also integrated with Web) or Users (Forms based Interfaces |
Object databases such as Illustra also interfaced to web |
Produced by Gang Cheng April 1995 |
There is a larger Better Quality Image available |
Oracle 7 Interface to Usenet-Prepared October 27,1995 |
Associated material may be found starting at Oracle-Web Interface to Usenet and other Services |
Oracle 7 Interface to Usenet-Prepared October 27,1995 |
Associated material may be found starting at Oracle-Web Interface to Usenet and other Services |
Combines strengths of Web and Database Information models to eliminate many weaknesses of each |
Uses Oracle's WOW Web-Oracle-Web Interface |
Many capabilities demonstrated in NPAC's implementations with mh mail, newsgroups, education databases, remote data entry |
Important for research, education and industry |
Characteristics
|
Strengths
|
Weaknesses
|
Characteristics
|
Strengths
|
Weaknesses
|
Database techniques used in Web technology: data storage; data caching; index searching; data processing |
Networking techniques used in distributed database technology: distributed database; two-phase commit; data replication; client/server model |
Web server integrated with database is enhanced with:
|
Database server linked to web server is enhanced with:
|
Mail databases: internal corporate utility
|
Usenet Newsgroups: http://asknpac.npac.syr.edu/
|
Education databases
|
Health care: demo patient record database |
Oracle SQL*TextRetrieval full text search of 3 online books |
Corporate product databases (under development) |
Education
|
Research
|
Industry
|
Note: the gateway wowstub program simply passes PL/SQL program name and input parameters gathered from forms to DB server. |
The DB server does both SQL query and HTML processing/formatting |
We describe the general architecture and major components of a Web Search System |
(a short version prepared for SC'95) |
See longer HPDC95 Version for more details |
Information Discovery - Locate Relevant Sources (URLs) with Reasonable Efforts/Time |
A Centralized Web Data Repository- Cache/Replicate Information to Alleviate Regional Network and Server Overhead |
A Unified Internet Search Interface - Search for Various Information Sources, HTTP, FTP, Gopher, WAIS, Usenet Newsgroups, Archive, On-line Databases and Libraries, etc. |
Data Volume
|
Data Diversity
|
User Base
|
There are at least 30 web search systems on the net |
InfoSeek - free service for web search (text database indexed from 400K URLs, total 2GB), paid-service for 15,000 USENET newsgroups (most recent 4 weeks, 2 million articles, total 7GB) and other on-line databases. Full-text indexing. Database and web servers run on 8 SUN10s |
Lycos - free service for web search (database indexed from ~10 million URLs, 1.8 GB summary text, 1.1 GB inverted index (10-20% of full text), run on 7 replicated workstations) |
OpenText - free service (text from ~1 million URLs, 985 million words, run on a worstation cluster). Full-text indexing. |
WebCrawler - free service for web search. Partial-text indexing. |
Yahoo - hierarchical listing of URLs by topics. A web site, not a search service (custom-made database system and web servers, run on several SGI Indy's and Pentium-based PCs running UNIX) |
Gather WWW pages/files from remote web servers and filter them into indexed text database |
Use 'Web Robot' or 'Web Agent' technology - a class of programs that automatically traverse network hosts and bring back information via various network protocols (e.g. HTTP) |
Major issues - direct impact on database size, search coverage and performance
|
How text of web documents/files are internally stored/indexed in the text database to efficiently and effectively support searching |
Common approach - 'inverted index' |
Major issues - direct impact on database size and search performance
|
Built on the indexed database |
Basic functions/algorithms - keyword-based search
|
Advanced functions - concept-based search
|
Form-based CGI - integration of a Web server and the backend database search engine |
Requires high-performance server to support large number of concurrent users - parallel technology can play a big role here ! |
Major issues
|
VRML 1.0 is now available and specifies static 3D scenes through which you can navigate. Already provides universal visualization environment and we have examples of use In Geographical Information Systems
|
VRML 2.0 is subject of active debate led by Mark Pesce. This is designed to support full interactivity (televirtuality) with texture mapped video, avatars etc.
|
Texture node defines the texture map used to subsequent shapes. |
VRML illustrates how one can store real world objects in a universal fashion |
Game vendors can build modules that interact and enable development of amazing profitable virtual worlds! |
Manufacturers can use VRML as basis of universal product definitions enabling collaborations between several vendors needed for Multidisciplinary analysis and design cf: PDES/STEP standards |
The Web "levels" the playing field for all software products
|
For instance VRML allows new powerful versions of Geographical Information Systems |
Living SchoolBook Material for SC95 San Diego Dec 95 |
Living SchoolBook Material for SC95 San Diego Dec 95 |
Using San Diego VRML Viewer Webview |
Little Neck Bay in Northern Long Island (altitude exaggerated by factor 7) |
From Chris Walczak |
From Chris Walczak |
The creation of VRML files is automatic - a special translator has been developed. |
The elevation data is transformed to a set of points. |
The color data defines colors of particular points. |
The points are linked to obtain surfaces. |
For each area two VRML files are created: with higher and lower resolution for use with LOD nodes. |
The following VRML structures are used to model the terrain data:
|
In future one will NOT write software for either
|
Rather one will write software for WebWindows defined as the operating environment for World Wide Web |
WebWindows builds on top of Web Servers and Web Client open interfaces as in
|
Applications written for WebWindows will be portable to all computers running Web Servers or Clients which hide hardware and native O/S specifics |
Further WebWindows Software will be modular and allow plug and play insertion of capabilities developed around the Web World -- not a bunch of isolated stovepipe solutions
|
As an example NPAC's WebTools implements UNIX shell/PC file manager capabilities in terms CGI scripts -- allows universal access to these capabilities including powerful Web based mh mail |
NPAC's WebFoil is HotJava Open replacement for Powerpoint/Persuasion |
Particular Application areas (Business, Healthcare, Education) will be built on top of generic NII services so that for instance
|
From foilset WebTools (Spring '95) |
Associated Foil can be found |
Postscript also Available |
Like UNIX or MS-DOS or Windows 3.1(NT,95), WebWindows is an operating system for a "computer" |
The "computer" is a metacomputer consisting of the 50,000 Webservers (currently--eventually hundreds of millions) on Internet for the World Wide Web |
WebWindows can also be used for the metacomputer (collection of heterogeneous networked computers) which is a business enterprise system
|
WebWindows is a multi-client multi-server technology
|
It does not provide multi-threading/multiu-user support, memory management, device drivers and such base services -- these are supplied by UNIX, Windows or Mac O/S |
Rather it provides equivalent of higher level O/S services such as available under UNIX shell or applications supplied under Windows |
In the future one will build applications for WebWindows not UNIX / PC windows etc. |
Very interesting is WebWindows version of Lotus Notes to support Business Enterprise systems -- build from Web components such as those prototyped in WebTools
|
Persuasion and Powerpoint are rather similar monolithic packages which can for instance only be clumsily ported to UNIX as cannot access internal data-structures defining foils |
WebFoil (NPAC prototype WebWindows presentation package) has |
Extended open HTML source manipulated by powerful PERL5 scripts allowing global changes and linkages of foils from many sources
|
WebFoil Uses Hotjava to display HTML with full Web Power including applets to enable Multimedia and dynamic presentations |
Initial webfoil 0.1 release Halloween 1995 |
The WebTop Productivity environment will be built in a more modular fashion than current PC Windows or Macintosh arena
|
Java is key to understanding how WebWindows application/service software will look as it allows balanced client server applications to be built |
Note require an open display software so can produce appropriate customized interfaces for browsing, presenting, word processing etc. |
Java may or may not be accepted by Web Community and Sun/Netscape may or may not allow it to used openly |
However the concept is essential and roughly right -- one or more such open technologies will become available and used on the Web |
Initial webfoil 0.1 release Halloween 1995 |
Will Windows NT take over the world and swamp UNIX?
|
The WebWindows concept says that NT versus UNIX isn't the key issue -- rather most software will not be written for NT, UNIX, MVS, VMS etc but rather to "Web Interfaces" |
One can expect that a new class of optimized operating systems will be developed that are designed solely to support web interfaces and web technology
|
Timing of these trends is unclear and could be critical |
Here each letter N S U O O represents a module |
Each green O is a separate "plug-in" or module or applet enhancing client |
Each yellow O is a a CGI PERL (or Java in future) server side enhancement |
The set of N's represent a monolithic client with many bundled capabilities |
The set of S's represent a monolithic (HTTP) server |
The set of U represents a monolithic (UNIX) operating system |
In future the set of Green O's represent a modular client side system including customizable modular browser |
There is an unclear server-client boundary as model is in fact server-server |
Now the yellow O's represent a corresponding modular server |
Supported by a new "WebUnix" or "WebNT" operating system optimized to support Web technology and interfaces |
Users ONLY talk to Web Clients and Servers |
Natural Storage Format for particular type of Information |
Optimal Format for network transmission incorporating synchronization as in audio and video streams as well as compression |
Local Client formatting to (HTML,VRML) needed for standard browser display standards |
Desktop Publishing and Productivity Tools in WebWindows (WebTop Productivity/Publishing)
|
InfoVision: Delivery on Demand of Information from:
|
Commerce -- digital Cash and signatures with appropriate authentication and security. Enables both Web Commerce (shopping) and use of Web for proprietary information |
Interactive and "batch" Collaboration
|
Metacomputing -- the collection of world wide computers as a coordinated (in subgroups of computers) computational engine (for simulation or information processing)
|
This is distributed databases for supporting cost effective healthcare with less fraud, better use of existing information for establishing care-plans etc |
This is collaboration, remote instrument control for telemedicine |
Could be full televirtuality for virtual-reality controlled remote surgery in battlefield or accident scenarios |
SUNY HSC is juxtaposed to Syracuse University Campus and hopefully NYNET will extend from NPAC to SUNY HSC |
Initial Experiments demonstrated to Hillary Clinton and involved:
|
SUNY HSC responsible for large rural area including Adirondacks |
Image Processing on MPP for Pathology Images using multi-resolution browsing techniques
|
Patient Records and Results of Medical Instruments and emergency room analysis can be viewed by specialist doctors from either their home or central hospitals |
This is basis of Virtual University and NII can be expected to be much more succesful than videosystems because interactive, collaborative, explorative and full multimedia information at student and teachers fingertips |
Base of Distance Education is InfoVision for full interactive curricula
|
Rich Collaboration environments including televirtual MOO's for student-student and student-teacher interactions |
We can use Web technologies to develop new very important tools for education enabling
|
We can teach these new technologies as world hungry for people understanding these technologies
|
http://www.npac.syr.edu/users/gcf/npacaddons -- see foils 106,7 |
Many concepts in computer science are very complex and dynamic and both idea as well as implementation are hard to understand |
In particular, parallel algorithms for areas such as FFT, matrix algebra, sorting, "fast multipole" required complex data movement which is difficult (for me) to visualize from the basic mathematics. |
I suggest using Java as a pedagogical tool to animate such algorithmic data movement
|
One can view this as an example of how Web-based technical reprts can represent and transmit knowledge better than printed papers |
From Meryem Ispirli |
Prototype of Algorithmic Visualization System |
Living Schoolbook -- Prototype of K-12 Educational Environment of year 2000
|
HPDC95 Tutorial and Other Computational Science Courses CPS600, CPS615
|
Physics 105/106 -- Science for the 21st Century (for non-Scientists) -- Some course modules built around Multimedia Information Systems
|
This hyperlinked material accounts for about 10% Phy 105, 20% Phy 106 and expect to increase if success continues
|
The Living Schoolbook is a New York State funded Initiative to create K-12 educational applications that exploit leading information technologies |
Living Schoolbook Base Educational Services are:
|
Living Schoolbook Leverages Information Technologies
|
The Project Team
|
Upstate Project Schools
|
Downstate (New York City) Project Schools
|
askERIC Educational Database for teachers with consultation |
The Discovery Channel -- Video Content Provider |
NewsBank -- Text Content Provider |
Reuters News Service |
Syracuse Language Systems -- Learn Foreign Languages on Demand |
TravelVenture -- Interactive travel information on Demand |
US Air Force Rome Laboratory -- InfoVision technologies |
WorldView Corp. : Interactive Client-Server Geographic Information System |
FLAG is an enterprise in which NYNEX Network Systems Company is a major (roughly 40%) investor. |
Current fiber link from U.K. to Japan (via Africa) is being constructed at an approximate $1.4B cost |
Natural Strategy is for Web Servers in U.S.A.. to deliver educational material via FLAG to Africa and Far East |
This would set up hierarchically as:
|
Real-Time Compression critical for interactive use of FLAG as lines are costly -- note Internet is free but needs compression as overloaded .... |
Many students from these countries come to the U.S.A.. now but ...
|
In Virtual University, one sets up a partnership between U.S.A.. and overseas University where key curricula and its delivery are provided over GII (Global Information Infrastructure of which FLAG is one example) |
High-end PC's should be included as possible Web server for Africa even we use SP-2, multi-processor SGI etc. as server in U.S.A.. University |
A NYNEX Joint Venture |
This shows fiber draping Africa with coast off ramps |
See electronically for actual home page |
Computational Science is an interdisciplinary field that integrates computer science and applied mathematics with a wide variety of application areas that use significant computation to solve their problems |
Includes the study of computational techniques
|
Includes the study of new algorithms, languages and models in computer science and applied mathematics required by the use of high performance computing and communications in any (?) important application
|
Includes computation of complex systems using physical analogies such as neural networks and genetic optimization. |
Certificate in Computational Science offered at Peking University and Harbin Institute of Technology Spring 1996 is a prototype of Syracuse University (ECS/NPAC) based extension school |
As Internet Connections to China are not guaranteed to be great(!) we will use Web Technology but assume that Electronic Course material will be packaged at NPAC(SU) in a Pentium PC running WindowsNT and Java
|
This will be updated in batch mode by Syracuse -- China Connection |
Students in China will Interact with mentors in China and with NPAC via Internet (web and email) |
Project designed by Fox,Leskiw(NPAC), Xiaoming Li(Harbin and Peking visiting NPAC) |
Graduate Students -- initially 5 to 10 at each of 2 University |
4 Courses -- each 10 1 hour lectures -- offered Spring 1996 over 20 week period |
ICPS 700: Introduction to Simulation Track of Computational Science
|
ICPS 701: Parallel Programming Laboratory
|
ICPS710: World Wide Web Technology
|
ICPS711: Web Programming
|
InfoVision is "successor" to TV with any multimedia information delivered on demand( choice from infinite number of channels) |
Community Networks will define local societies and will have significant impact on local government |
Shopping on the Web will include multimedia digital yellow pages , Commerce, online catalogs (which is InfoVision again) as well as perhaps powerful VR interfaces where you can try out new clothes and cars |
Collaboration (gossip as in computer forums) could be an important and dominant use but perhaps not initial major one |
Video and Server Technology Network is prototype of Wire Service of future using Web Technology to service Mass Communications Industry |
Partner with this field (Newhouse School) to find out how to author on-line video and other multimedia material |
NYNET ATM network extended internally to allow linkage of NPAC to Newhouse School of Public Communications and University Electronic Media Production Unit |
Faculty and students -- the multimedia digital journalists of the future will use:
|
Study Integration digital editing (AVID) technology of media field with digital web and powerful computer technology. |
Industrial partners from traditional print and analog video fields
|
OLTP (Online Transaction Processing) such as approving and recording credit card transactions. This is a type of InfoVision and Commerce which is operational today
|
Decision Support varies from fraud detection, inventory planning and market segmentation for optimizing shopping by mail |
Decision support can vary from search of a single giant relational database to galaxy-wide search of heterogeneous distributed database |
Workflow Support as in LOTUS Notes integrates Collaboration, Project Management and Distributed Databases. This supports ongoing distributed enterprise -- this is also essential in collaboratory |
The World Wide Web will develop a marvellous WebTop Environment allowing users to access Web versions of Word Excel(Lotus123) Persuasion(Powerpoint) Databases Lotus Notes etc.
|
This (as developed) enables a wonderful new software industry as Microsoft no longer has key advantages |
This (as used) enables very effective (business) enterprise systems where "Web" used internally to an enterprise
|
Critical feature is realtime, "come as you are" adaptive linked computers and people |
Judgement support extends decision support into an "exploratorium" scenario as crises tend to be unexpected |
Major need to search community and government databases for immediate information on resource location and availability etc. Metadata(summaries) essential |
Collaboration between commander in field , specialized anchor desks (domain experts) and those in field. |
User Interface essential as user will be tired and searching unfamiliar data |
Geographical Information Systems and browsing multiple video sources (InfoVision again) will be critical as judgements will depend critically on spatial data. |
The trip to the opera was the high point for the thousands of international visitors to the conference. |
They were streaming out of the new center which had been built in a decaying downtown area. Here old warehouses were still mixed with the proud new buildings of the economic redevelopment zone. |
Luke CyberCzar was in charge of the crisis center when the first 911 video dial tones showed the horrifying sight. A gigantic set of explosions rocked a set of old chemical warehouses and fires and fumes of unknown composition ringed the new opera complex. The frightened audience panicked and scattered this way and that into the surrounding alleys. Of course the digital video crews covering the opera immediately switched their cameras to this catastrophe. Just a few seconds after those 911 calls, all the MPEG decoders on the GII were presenting the chaos, damage and injuries live to a world whose cybereyes were trained on Luke. |
Injury and Damage implying major field operations with international scope |
Telemedicine accessing world wide records |
MPP and distributed cluster Simulations of Chemical fires and Wind blown transport of fumes |
Remote Command and Control supported by Televirtual Environment |
Digital Multimedia streams of data from on the spot video |
Universal common WebTop envirtonment from WebNewton to Supercomputer |
Adaptive network management including ISDN exploiting advanced compression |
Cellullar Connections and Electromagnetic simulations to optimize antenna placement for emergency communications |
Disparate distributed databases searched in real time using metadata |
3D Geographical Information Systems with real-time overlays for tactical decisions |
Training and Education from Maxwell(Electronic Intuition) to Computer Science and Testbeds such as FEMA and JWID |
Luke benefits from the natural convenient interface maximizing the effectiveness of the tired harried judgment maker. This build on advanced MOO and VR ideas and tailors the computer interface to the problem at hand. |
Luke sees a three dimensional GIS (Geographical Information System) when viewing the spatial confusion of the catastrophe; a virtual podium when he briefs cyberworld; a boardroom when defending his actions to angry foreign politicians; a summer wildflower meadow in moments of thought. |
He shares this virtual environment with Jane who is in charge of tactical operations for the crisis and by his electronic side at all times. |
They share this televirtual environment with other judgment makers and those facing the crisis in the field. |
Whether supported by supercomputer or hand held personal assistant, all access the same WebTop environment with a full range of collaboration and productivity tools whose capability adjusts to the available compute and communication resource. |
In this way the GII enables the best adaptive linking of "come-as-you-are" computational, communication and personnel resources. |
This is future model for (inter)national distributed research |
Rich Collaboration environment essential as collaborative research requires nontrivial person to person interactions |
Searching distributed databases basis of much scholarly work (infoVision and Digital Library) |
Metacomputing for multidisciplinary, multi-institutional simulations and for control and data storage and analysis from remote instruments whether satellites, telescopes, accelerators etc. |
Distributed (people) Software Engineering support for production of distributed computing software |
Needs workflow support as distributed enterprise |
Critical feature is closely integrated collaboration of very many people and computers requiring |
Metacomputing Simulation and distributed database support as in Collaboratory |
Workflow support including configuration management and central CAD databases |
Rich collaboration environment to support distributed design decisions |
Standards and Security to allow interlinking of people and software from different organizations |
Key special requirement is distributed coordination |
A set of manufacturing companies -- Rockwell International, Northrop Grumman, McDonnell Douglas, General Electric and General Motors is studying the NII implications for a particular MAD system "Affordable Systems Optimization Process" (ASOP) |
Interesting parameters are that next major aircraft to be built could involve:
|
For instance as part of my New York State Industrial HPCC outreach program InfoMall, I found that a major manufacturer of large consumer machines had no interest in MPP's for simulating them to improve design |
However very interested in
|
Here Perl manipulates text from database to HTML |
Java enables down-loaded simulations |
VRML enables universal definition of 3D objects -- products and buildings |
WebWork is an open, world-wide distributed computing environment based on computationally extended Web Technologies |
The backend computation and information infrastructure is provided by the World-Wide Virtual Machine -- a mesh of computationally extended Web Servers (called Compute Servers) |
These servers manage (via CGI mechanisms) a collection of standardized computational units called WebWork Modules. |
Geographically distributed and Web-published WebWork modules interact by HTTP/MIME based message/object passing and form distributed computing surfaces called Compute-Webs |
The front-end user/client interfaces are provided by evolving Web browsers with increasing support for two-way interactivity (e.g. Java, VRML) that facilitates client side control and authoring. |
A natural user-level metaphor -- WebFlow -- is supported in terms of visual interactive compute-web authoring tools. |
Implements the "Viable Base" Enterprise Model of HPCC Software identified in Pasadena2 workshop |
This will allow good programming tools to be developed and mnaintained as larger enough base to support software industry |
Implements a powerful software engineering framework for parallel computing by integrating parallel programming with the World Wide Web Productivity Tools |
RSA security systems based on numbers
|
Bank of England and English Savings and Loan based on m=155 (512 binary digits) |
RSA129 cracked by factoring with email team using sophisticated version of Quadratic Sieve. RSA155 will use better Number Field Sieve |
Need x2 = y2 mod(RSAm) as then gcd(x+y,RSAm) likely to be interesting factor |
Find x and y by finding lots of interesting a's
|
Given these a's factored into primes, multiply together so powers of primes are even. This gves desired x |
This last step requires graph theory and solution (for Bank of England) of 5 million linear equations |
RSA155 requires about 300 teraops hours to solve with NFS |
RSA129 needed about an order of magnitude less time. Can be done today faster if use Number Field Sieve |
We have roughly one to five million independent calculations which form the rows of matrix (after clever graph theory manipulates and combines) |
Set of master servers publish problem to solved with suitable demos, description of algorithm and full marketing attention.
|
Clients return results -- not so easy except by email and cut and paste |
Best done as a set of cooperating servers where server performing factorization publishs it solution as a file on the WWW. |
Cooperating servers also better for computer administrators as can control set of clients at a given site |
Initially use humans but replace by agents when software ready |
Factoring on the Web Project |
Factoring on the Web Project |
Factoring on the Web Project |
WebWork is based on a three-layer architecture shown in figure 2, including: World_Wide Virtual Machine (WWVM) in the (bottom) layer 1, Middleware layer 2 of agents, wrappers, mediators etc., and high level programming environments (e.g. HPFCL) and user interfaces (e.g. WebFlow) in the (top) layer 3. |
All base WebWork concepts can be implemented in terms of today's Web technologies (HTTP, MIME, CGI) and a prototype is under development at NPAC. |
The overall design is open and ready to upgrade the existent (e.g. browsers or servers) and include new (e.g. agents or distributed object brokers) Internet/Web technologies |
One starting point for the WebWork construction is provided by NPAC WebTools -- a CGI-extended Web server with enhanced content authoring and database navigation functionalities. WebTools Server is used as a prototype WebWork node server. |
Illustrates 3 base layers of WebWork architecture and all main system components. |
A 4--node compute-web is represented
|
Java/HotJava model is used for WebFlow front-end implementation |
The paper describing this project is available at SCCS715 in NPAC technical report series |
PCRC embodies the Parallel Computing Synchronization and collective parallel algorithms and runtime that will enable efficient Web-based computing |
Replace user interface of HPF or HPC++ with the Web(work) and use pervasive Web Technologies in infrastructure (World Wide Virtual Machine -- WWVM) |
http://www.npac.syr.edu/users/gcf/npacaddons -- see foil 105 |
Java provides a convenient way to build flexible graphics interfaces |
The screendump shows the message passing traffic and status of (36) parallel nodes used in a sorting algorithm |
In the example, the 36 threads are running the explicit algorithm on the client |
Alternatively and more generally, the threads are replaying a trace of the program which is or was running on a separate set of nodes |
If one uses Web Servers to control master parallel computation or more generally integrates Web into computing, these Web servers can naturally feed event traces into Java based display
|
From Kemal Ispirli with 36 threads running client-side |
Colors represent node status and links message-passing |
The compilation system is accessed through a Web Browser. The HPF program and requests are POSTed to the HTTP Server using HTTP Protocol. |
HTTP Server analyzes the incoming request and activates the HPF Service Master which is a CGI module. |
HPF Service Master starts the Compile module which translates a given HPF program into Fortran 77 with message passing calls (i.e.MPI), and produces an object file using a node compiler. |
Link module links the generated object code with Common Runtime Support (CRS) and MPI libraries. |
Run module forks copies of the executable code on the nodes of a workstation cluster. |
After the request has been satisfied, HPF Service Master puts the results into HTML format and sends back to the HTTP Server. |
HTTP Server sends the results to the Web Browser via the HTTP Protocol. |
The WWVM is accessed through a Web Browser and requests are sent to the server through HTTP Protocol. |
HTTP Server starts a service master which translates given HPF program to F90 with message passing calls and starts-up other client servers. |
HTTP Servers at the client side get the requests through the HTTP protocol connection, and activates a Interpreter CGI module. |
Interpreter makes calls to the Runtime Support and Communication Server that sends and receives messages using PVM daemons. |
From Kivanc Dincer |
From Kivanc Dincer |
We need to use compilers on tightly coupled systems such as MPP's (shared and distributed memory) |
But for metacomputing, the hardware intrinsically has latencies that suggests increased flexibility of interpreters is more appropriate
|
Maybe frontends should be built with interpreters such as object-oriented PERL5 so easier to link with Web. |
Note that interpreted environment will have best software engineering support and so suggestion is -- taking SP2 as example:
|
This implies that we should allow hybrid model not just for task (interpreted) versus data parallelism(compiled)
|
Current Web Interpreters include Java TCL and PERL(5) which are optimized for different application domains
|
This leads to WebScript Concept of interoperable interpreters optimized for different domains
|
Java is a C++ subset which interestingly does not have pointers as these are unsafe in necessary secure metacomputing environment. |
Thus Java has removed the part of C++ which is hardest to parallelize |
Java may not "survive" but if it doesnt something better will! Thus it makes sense to study and experiment with it |
Natural first step is to use Java to build the interpreted "shell" which we called HPFCL for HPF coordination Language.
|
Java is partially compiled as you take basic Java high-level code and compile down to a universal Java machine language. This is very similar to concepts in ANDF (Architecture Neutral Distribution Format) but with a different goal
|
VRML -- Virtual Reality Model Language -- is an object oriented database built as a subset of the SGI Inventor System |
VRML can be considered as another script optimized for graphics but not many interesting processing (compute) capabilities are in current standard |
VRML can be considered as an example of a universal data structure allowing exchange of 3D objects over the Web.
|
Thus useful to consider data parallel VRML and building CC++ or HPF(Fortran90) modules to support VRML |
HPCC community should join with the Web to ensure that standards such as VRML can be implemented efficiently either in parallel (maybe a niche) but also in a distributed network (similar issues where HPCC can contribute and clearly very important) |