Full HTML for
Given by Geoffrey C. Fox at ARPA Environments PI Meeting Washington on June 9-10 97. Foils prepared 6 July 97
Outside Index
Summary of Material
| This describes overall goals of PCRC and |
| Statement of Problem, approach, Results, Collaboration with China |
3 Examples of Future activities are:
|
We did not describe the older technologies:
|
Denote Foils where Image Critical
Denote Foils where HTML is sufficient
Parallel Compiler Runtime Consortium
Parallel Compiler Runtime Consortium
Common Runtime Support for High Performance Languages
Statement of Problem and Proposed Solution!
Innovations in Project
Technology Impact
Future Activities
International Collaboration
WebFlow Software Integration Model
WebFlow Integration
WebFlow and PCRC
General Web Integration Model
Common Runtime Support for High Performance Languages-1
Integrated Compiled and Interpreted Environment
Integrated Compiled and Interpreted Environments II
Use of PCRC Infrastructure -- The HPF front-end to produce an Integrated Environment for HPF Compiler and Interpreter
Architecture of the Integrated Interpreter/Compiler System
Switching between compiled and interpreted modes
Use for Interactive Visualizations
Linkage of HPF Interpreter to Compiler
Integration of Classic HPCC with DoD Modeling and Simulation
Technology Convergence Roadmap - Overview for Forces Modeling, Integrated Modeling and Testing for DoD
DIS Distributed Event Driven Simulation Web Prototype at NPS 1997
Architecture of the WebDIS Prototype at the NPS - Overview
Details of the WebDIS Prototype at the NPS
The Next Big Web Technology Advance: Object Web and CORBA
CORBA Web Architecture
Aspects of Java ORB based Middleware
Integration of DIS with Object Web Based Computing
Aspects of Object Web based HPCC
Aspects of HPCORBA Architecture
Diagram of HPCORBA Architecture
Common Runtime Support for High Performance Languages-2
PCRC HPC Infrastructure
HPFfe: Front-end for HPF
HPFtester-1
HPFtester-2
PCRC Runtime: MPI-Based
Outside Index
Summary of Material
HTML version of Scripted Foils prepared 6 July 97 
Full HTML Index
| Presentation on June 10 1997 by Geoffrey Fox at DARPA Systems Environments PI Meeting |
| gcf@npac.syr.edu Phone 3154432163 |
| http://www.npac.syr.edu/users/gcf/pcrcjune97 (this talk) |
| http://www.npac.syr.edu/projects/pcrc |
| http://www.npac.syr.edu/projects/javaforcse (resource for Java in Computational Science and Engineering) |
| http://www.npac.syr.edu/users/gcf/PCRCWebFlow/script.html (demonstration available in videotape) |
| Parallel Compiler Runtime Consortium |
HTML version of Scripted Foils prepared 6 July 97
Full HTML Index
| University of Texas |
| Austin |
| Cooperating |
| Systems |
| Corporation |
| Indiana University |
HTML version of Scripted Foils prepared 6 July 97
Full HTML Index
| CRS for Irregular Distributed Arrays (Maryland) |
| Rice |
| Syracuse |
| CSC |
| Indiana |
| HPF Compilers |
| HPC++ Compilers |
| Retargeting Existing Compilers |
| Developing New Compilers |
| Harvard |
| Other Compilers |
| Common computational functions (SU) |
| Common data movement routines (SU) |
| CRS for Regular Distributed Arrays (Syracuse) |
| Common Runtime System Interface (Indiana) |
| Common code and data descriptors for arrays in HPC languages |
| Common compiler data movement interface specifications |
| Other |
| CRS Inter-operability |
| with other RTS |
| (Maryland/ |
| Indiana) |
| Address translation mechanisms (UoM) |
| Common data movement deriving and optimizing routines (IU) |
| Rochester |
| Texas (DAGH) |
| http://www.npac.syr.edu/ |
| Other |
| Rochester |
| Future Compilers |
| HPJava |
HTML version of Scripted Foils prepared 6 July 97 
Full HTML Index
| http://www.npac.syr.edu/projects/pcrc/ |
| Problem: Compilers and other major HPCC software systems involve so much software that it is hard for typical academic groups to contribute deployable systems |
| Solution(Significance of Project): Enable Production of high quality and high functionality HPCC programming environments by developing public domain documented software infrastructure for HPF, and parallel C++ and Java in compiled or SPMD mode |
HTML version of Scripted Foils prepared 6 July 97
Full HTML Index
Community Driven Investigation of sequential and parallel Java as a scientific and engineering programming language
|
| New algorithms and high performance implementations for combine, scatter runtime |
| High level SPMD Programming Model above MPI |
| New approaches to integrating HPF, C++, Java in interpreted and compiled modes using Web technology |
| New ways of detecting optimal collective communication needed by HPF statements |
| Compiler front end test suite |
HTML version of Scripted Foils prepared 6 July 97
Full HTML Index
Over 100,000 lines of C/C++ public domain software directly produced by project and divided between
|
| Test suites for HPF Compiler front-end and for its implementation (set of base HPF codes) |
| Integration with DAGH, HPC++ and metachaos (most of this funded outside PCRC) |
HTML version of Scripted Foils prepared 6 July 97
Full HTML Index
| Several approaches to "HPJava" on both distributed and shared memory architectures |
| Integration of Interpreters and Compilers using PCRC infrastructure (see example) |
| Other compilers (such as shpf in Europe) use infrastructure |
| WebFlow with graphical interface for integration of multi-language and multi-function modules (see example) |
| Bridge to simulation community (HLA and DIS) using common object(CORBA) web server technology |
HTML version of Scripted Foils prepared 6 July 97
Full HTML Index
| Significant part of public domain software has been produced by Xiaoming Li's collaborators in computer science departments at Harbin Institute of Technology and Peking University |
In exchange NPAC has taught computational science courses in workshops in China and with Internet course to Harbin
|
| http://www.npac.syr.edu/projects/pcrc/cpswt/index.htm |
HTML version of Scripted Foils prepared 6 July 97
Full HTML Index
| Could Evolve to general component based HPCC visual programming environment |
| Natural Technology for Collaborative Computing and Multidisciplinary Applications |
HTML version of Scripted Foils prepared 6 July 97
Full HTML Index
| WebFlow gives an AVS like Interface to integrate multilanguage modules |
HTML version of Scripted Foils prepared 6 July 97
Full HTML Index
| A C++ PCRC SPMD Physics simulation is linked with disparate modules to filter output display |
| This demo is available on a video tape and with RealAudio narration |
HTML version of Scripted Foils prepared 6 July 97
Full HTML Index
| This model can be combined with emerging Web Collaboration, Object broker and database capabilities to support multidisciplinary applications and computational steering |
HTML version of Scripted Foils prepared 6 July 97
Full HTML Index
Distributed Array Descriptor Specification
|
Common Runtime Interface Specification
|
HTML version of Scripted Foils prepared 6 July 97
Full HTML Index
| Uses a Java Front End and shows how data parallel Java could be implemented as with HPF back-ends |
| One can invoke general client side (visualization) or server side (additional simulations) at HPF Extrinsic Interfaces |
| Uses PCRC HPF Front End |
HTML version of Scripted Foils prepared 6 July 97
Full HTML Index
| User Interpreted Commands |
| invoking preloaded |
| Java/Javascript objects |
| Server invokes extrinsic |
| processor |
| (true interpreter |
| or compiler invoked |
| dynamically) |
| Running Program |
| interruptable at |
| extrinsic interfaces |
HTML version of Scripted Foils prepared 6 July 97
Full HTML Index
Compiler offers:
|
Interpreter offers:
|
HTML version of Scripted Foils prepared 6 July 97
Full HTML Index
| JAVA applet |
| HTTP |
| server |
| HPF |
| server |
| Node 1 |
| Node 2 |
| Node 3 |
| Node 4 |
| Node 5 |
| Node 6 |
| Web Browser |
| Server Host |
HTML version of Scripted Foils prepared 6 July 97
Full HTML Index
| 1. Contact HTTP server to download the Java applet |
| 2. Use the applet to start instrumented HPF application |
| 3. HPF server starts (implemented as an HPF extrinsic) |
| 4. Java applet establishes communication with the HPF server |
| 5. HPF server accepts user's requests: |
| - suspend/resume execution of the HPF code |
| - send data |
| - interpret new HPF statements |
| - dynamically link and execute shared objects |
HTML version of Scripted Foils prepared 6 July 97
Full HTML Index
HTML version of Scripted Foils prepared 6 July 97
Full HTML Index
| HPF statements and Visualization requests in Java, HPF etc. |
| HPF extrinsic procedure |
| Shared Object |
| Lexical Analysis: PCRC frontend. |
| HPF compilation: pghpf |
| Pool of shared objects |
| HPF RTS |
| HPF |
| server |
| Dynamical linking |
| Instrumented HPF |
| JAVA |
| applet |
HTML version of Scripted Foils prepared 6 July 97
Full HTML Index
| The Emerging object Web offers opportunity to integrate time stepped and event driven methodologies |
HTML version of Scripted Foils prepared 6 July 97
Full HTML Index
HTML version of Scripted Foils prepared 6 July 97
Full HTML Index
| There is a web-based DIS project at the Naval Postgraduate School (NPS) at Monterey, CA, led by Don Brutzman who is NPS faculty, member of VRML Consortium and Moderator of newly formed dis-java-vrml mailing list. |
| The goal of the project is to explore Java for DIS protocol implementation and networking, VRML2 for visualization of the simulated virtual DIS worlds, and Web browsers for the GUI packaging and integration. |
| The current NPS experiment uses exclusively Java, VRML and HTML to implement a proof-of-the-concept demo. In a more complete Web DIS, the actual simulation engines will be likely provided by the optimized legacy codes, suitably interfaced to Java based communication and VRML based rendering. |
HTML version of Scripted Foils prepared 6 July 97
Full HTML Index
HTML version of Scripted Foils prepared 6 July 97
Full HTML Index
| Front-end is provided by Netscape running one vehicle simulation applet on each node and by Cosmo Player VRML2 browser displaying the multi-vehicle simulated world. |
| Java applet propagates local vehicle and communicates via the bridge daemon with other nodes, sending local vehicle PDUs and reading remote vehicles PDUs. |
| Java applet and VRML browser interact via EAI (External API) as specified by SGI/Cosmo Player add-on to the VRML2 protocol. JavaScript is used to acquire handle to the VRML scene and LiveConnect is used to pass this handle to the Java applet. |
| Applet performs dynamic real-time updates of the scene graph based on local vehicle simulation and remote vehicle locations received via PDUs. |
| This prototype is successful and demonstrates that one can use Web technology for Distributed Event Driven Simulation -- the major use of simulation in DoD |
HTML version of Scripted Foils prepared 6 July 97
Full HTML Index
| Web'97 is already quite elaborate at the client/browser side but still rather simplistic at the server side (base HTTP with CGI extensions). |
| New Java Frameworks (Enterprise, Media) bring new family of Java servers that can implement an object based middleware and backend layers for the Web based services including computing. |
| One critical development in the distributed objects domain is the IIOP (Internet Inter-ORB Protocol), mandatory in CORBA2 and offering a new server-to-server communication standard between commercial ORBs from various vendors. |
| At the moment, Web Server market is dominated by customized or/and proprietary systems but there is a new strong tendency to standardize the Web middleware around the CORBA paradigm. |
| 'Java based ORB' is a CORBA2 compliant ORB written exclusively in Java, and hence fully portable and ready to run also on the Wintel platform, where distributed objects were so far under control of Microsoft DCOM/ActiveX model. |
HTML version of Scripted Foils prepared 6 July 97
Full HTML Index
HTML version of Scripted Foils prepared 6 July 97
Full HTML Index
| The new emergent Object Web framework includes Web servers in the middleware, Java applets in the front-end and Java ORBs on both sides. |
| Client-side ORB (or ORBlet) can be either downloaded as part of the applet, or resident on the client host, or embedded in the browser (as planned by Netscape). |
| Applet downloads via HTTP and connects via ORBlet's IIOP to a middleware ORB. This middleware ORB can be either another server or part of the Web server. |
| Middleware ORB connects via IIOP to other ORBs on the CORBA bus. This mechanism enables global connectivity via CORBA white/yellow page services such as Naming Service or Trader Service and their federations. |
| Client-side ORBlet is also a lightweight server - hence clients can be called by servers via the CORBA callback mechanism. This enables interactive feedback, asynchronous notification and a variety of collaboratory frameworks over the CORBA bus. |
HTML version of Scripted Foils prepared 6 July 97
Full HTML Index
| DoD modeling community is currently evolving towards the HLA(High level Architecture) framework with the RTI (Run Time Infrastructure) based communication bus. |
| The goal of HLA/RTI is to enhance interoperability across more diverse simulators than in the DIS realm, ranging from real-time to time-stepped to event-driven paradigms. |
| HLA defines a set of rules governing how simulators (federates) interact with each others. Federates describe their objects via Object Model Template (OMT) and agree on a common Federation Object Model (FOM). |
| The overall HLA/RTI model is strongly influenced by the CORBA architecture and in fact the current prototype development is indeed CORBA based. |
| We next step is to combine CORBA2 (Initial HLA/RTI is CORBA1) with NPS prototype ideas to give a fully object and Web integrated event driven simulation environment. |
| Java3D is natural visualization environment in this scenario |
HTML version of Scripted Foils prepared 6 July 97
Full HTML Index
| Our HPCC Server model is consistent with the Object Web trends |
| The servers provide high functionality CORBA2 services with an event based control mechanisms |
| A new HPCORBA data transfer layer implements high performance object method invocations |
| Current WebFlow functionality, limited to classical dataflow, can be extended to support also visual authoring of CORBA business objects and in a component based software approach, WebFlow will be a CORBA vertical framework aimed at distributed computing. |
| JavaBeans are the base software components which have a visual programming model which links ideas in systems such as Hence CODE AVS WebFlow with modern software engineering practice. |
| In summary, we propose HPCORBA based WebFlow with JavaBeans front-ends as an effective delivery platform for integrating HPCC and DoD Modeling, Simulation and Testing environments with modern high productivity software development environments. |
HTML version of Scripted Foils prepared 6 July 97
Full HTML Index
| The following figure illustrates a possible CORBA-HPCC integration framework ( HPCORBA ) |
| Each node of a parallel machine runs a lightweight (e.g. Nexus based ) ORBlet which enables both local and remote object services. |
| Coming CORBA3/MOM based messaging and object-by-value frameworks adapted to provide high-performance (e.g. MPI based) object-oriented (IIOP based) inter-node communication. |
| Parallel Computation graphs are represented by Interface Definition Language (IDL) in a language independent way and optimized by parallel compiler technologies. |
| Specific language bindings would result in HPF, HPC++ or HPJava implementations. |
| This framework provides interoperability with the emergent Object Web software industry and offers an elegant solution for scalable parallel I/O ( linking HPCORBA with Oracle CORBA ) |
HTML version of Scripted Foils prepared 6 July 97
Full HTML Index
HTML version of Scripted Foils prepared 6 July 97
Full HTML Index
Multi-Runtime Library Interoperability Specification
|
Advanced Compiler Development
|
HTML version of Scripted Foils prepared 6 July 97
Full HTML Index
| HPFfe: A front-end for HPF 1.0 |
| HPFtester: a comprehensive test-suite for HPF frontend validation |
| HPFrt: an MPI-based runtime system for HPF compilers |
HTML version of Scripted Foils prepared 6 July 97
Full HTML Index
| Full HPF 1.0 syntax support (including full Fortran 90) |
| Four modules: syntax parsing, semantics checking, IR rendering, and unparsing |
| Extensive semantics checking |
| Validated by HPFtester |
| Releasable to Public Domain |
HTML version of Scripted Foils prepared 6 July 97
Full HTML Index
Simple test segment:
|
Comprehensive test segment:
|
HTML version of Scripted Foils prepared 6 July 97
Full HTML Index
Invalidation test segment:
|
HPFtester Augmentation segments:
|
HTML version of Scripted Foils prepared 6 July 97
Full HTML Index
Regular (based on Syracuse Fortran 90D runtime)
|
Irregular (based on Maryland Chaos)
|