WebHLA - An Interactive Programming and Training Environment for High Performance Modeling and Simulation

 

D. Bernholdt, G. C. Fox, W. Furmanski, B. Natarajan, H. T. Ozdemir, Z. Odcikin Ozdemir and T. Pulikal

Northeast Parallel Architectures Center, Syracuse University

 

Presented at the DoD HPC 98 Users Group Conference, Rice University, Houston, TX, June 1-5 1998.

http://tapetus.npac.syr.edu/iwt98/pm/documents/dodugc98/paper.doc

 


1. Introduction

Our technology roadmap for High Performance Modeling and Simulation, outlined in NPAC PET FMS White Paper [1] is based on several ongoing and rapid technology evolution processes such as: a) transition of the DoD M&S standards from DIS to HLA; b) extension of Web technologies from passive information dissemination to interactive distributed computing based on enterprise standards offered by CORBA, Java and DCOM; c) transition of HPCC systems from custom (such as dedicated MPPs) to commodity base (such as NT clusters).

 

Figure 1: Web, Enterprise, HPC and DoD M&S Technology Evolution Roadmap  which underlies our WebHLA, approach.


One common aspect of all these threads is the enforcement of reusability and shareability of products or components based on new technology standards. DMSO HLA makes the first major step in this direction by offering the interoperability framework between a broad spectrum of simulation paradigms, including both real-time and logical time models. However, HLA standard specification leaves several implementation decisions open and to be made by the application developers - this enables reusability and integrability of existing codes but often leaves developers of new simulations without enough guidance. In WebHLA, we fill this gap by using the emergent standards of Web based distributed computing, referred by some as the Object Web [2] that integrate Java, CORBA, W3C and DCOM models for distributed componentware. Traditional HPCC, dominated by data parallel MPP didn’t make significant inroads into the DoD M&S where the focus is on task parallel heterogeneous distributed computing. Recent trends towards commodity based HPCC systems such as NT clusters offer a new promising framework for new generation high performance high fidelity M&S environments such as addressed by JSIMS, JWARS, JMASS or Wargame2000 programs.

We therefore believe that WebHLA, defined as the convergence point of the standardization processes outlined above will offer a powerful modeling and simulation framework, capable to address the new challenges of DoD computing in the areas of Simulation Based Design, Testing, Evaluation and Acquisition.

We are addressing WebHLA design and prototype development at NPAC in a set of PET FMS tasks at ARL and CEWES, including:

·         Object Web based RTI which offers DMSO RTI (Run-Time Infrastructure) layer of HLA as a set of Java/CORBA objects, managed by JWORB - Java Web Object Request Broker under development at NPAC.

·         Web based distance training for FMS systems and technologies such as core HLA, Object Web RTI, SPEEDES and later on also other FMS CHSSI systems under development.

·         Designing Data Mining tools for the Virtual Proving Ground (VPG) project at ARL/ATC, Aberdeen, MD.

·         Parallelizing CMS (Comprehensive Mine Simulator) developed at Ft. Belvoir, VA.

·        

Visual Authoring Tools for HLA simulations, using the WebFlow system at NPAC.

The overall architecture of our WebHLA prototype follows the 3-tier architecture of what we call Pragmatic Object Web [3]  (see Fig. 2) with the RTI-over-JWORB based middleware, backend simulation modules (given by CMS, ModSAF etc. libraries, wrapped via CORBA/COM as FOM or SOM objects) and WebFlow based visual authoring front-ends.  

In the following sections, we describe in more detail the WebHLA components listed above, followed by a summary and outlook towards WebHLA based Virtual Prototyping Environments for Simulation Based Design and Acquisition.

 

2. Object Web RTI

High performance simulation require integration of several M&S software modules, including simulators for tested objects, their parts, and suitable synthetic environments they operate in and interact with. Such integration of diverse simulation paradigms will be soon most conveniently performed within the new High Level Architecture (HLA) promoted by DMSO to enforce DoD-wide simulation interoperability. HLA includes the object models specified by the Object Model Template (OMT) and the Run-Time Infrastructure (RTI), acting as a software bus that supports interaction between HLA objects (federates) within applications (federations).

In parallel with these developments in the DoD M&S, new Web/Commodity standards are emerging or consolidating in the area of distributed objects and componentware such as CORBA, Java/RTI and DCOM. Current HLA is a custom distributed object model but DMSO’s longer range plan includes transferring HLA to industry as CORBA Facility for Modeling and Simulation. Anticipating these developments, we are currently building within our HPCMP FMS PET activities at NPAC an Object Web based RTI prototype which builds on top of our new JWORB (Java Web Object Request Broker) middleware integration technology.

JWORB is a multi-protocol Java network server, currently integrating HTTP (Web) and IIOP (CORBA) and hence acting both as a Web server and a CORBA broker. Such server architecture enforces software economy and allows us to efficiently prototype new interactive Web standards such as XML, DOM or RDF in terms of an elegant programming model of Java, while being able to wrap and integrate multi-language legacy software within the solid software engineering  framework of CORBA.

Figure 2: Illustration of the communication protocol integration within our JWORB based Pragmatic Object Web. JWORB uses Java to integrate HTTP with IIOP and then it connects with NT clusters via COM/CORBA bridge.

We are now testing this concept and extending JWORB functionality by building Java CORBA based  RTI implementation structured as a JWORB service and referred to as Object Web RTI [4]. Our implementation includes two base user-level distributed objects: RTI Ambassador and Federate Ambassador, built on top of a set of system-level objects such as RTI Kernel, Federation Execution or  Event Queues (including both time-stamp- and receive-order models). RTI Ambassador is further decomposed into a set of management objects, maintained by the Federation Execution object, and including: Object Management, Declaration Management, Ownership Management, Time Management and Data Distribution Management.

To be able to run C++ RTI demo examples, we developed a C++ library which: a) provides RTI C++ programming interface; and b) it is packaged as a CORBA C++ service and, as such, it can easily cross the language boundaries to access Java CORBA objects that comprise our Java RTI. Our C++ DMSO/CORBA glue library uses public domain OmniORB2.5 as a C++ Object Request Broker to connect RTI Kernel object running in Java based ORB. RTI Ambassador glue/proxy object forwards all method calls to its CORBA peer and Federate Ambassador, defined as another CORBA object running on the client side, forwards all received callbacks to its C++ peer.

3. Distance Training for the FMS Technologies and Systems

DoD M&S is a broad and rapidly evolving domain of distributed computing. Given the coming DoD-wide paradigm shift towards virtual prototyping, simulation based design and simulation based acquisition, we anticipate the growing demand on Web based distance training services in the M&S domain. DMSO is making the first step in this direction by publishing HLA specification, manuals and tutorials on the Web but more such services are needed, including interactive virtual programming laboratories in the M&S area.


Figure 3: Illustration of the interplay between  DMSO RTI (running on  Intranets), Parallel RTI (running on HPC facilities) and Commodity (such as Object Web) RTI. The latter is running in the Web / Internet Domain and connects geographically distributed  MSRCs and DCs.

We are developing and extensive electronic training space for FMS within the PET program, using our Object Web RTI as a core technology framework for distance training. In the HLA lingo, each participant of a training session becomes a federate, and so are their trainers/mentors as well as the particular M&S systems or technology modules selected as the current training target. The training session itself becomes a federation which follows the HLA rules for joining, participating, sharing the information, managing assets such as time, space or objects etc. Such training federations can be naturally made World-Wide distributed within our WebHLA framework (since Object Web RTI builds on top of JWORB which includes HTTP i.e. Web Server support) and given real-time interactive Web browser based interfaces (via ORBlets or equivalent ActiveX based dynamic connectivity channels to the CORBA/COM based training control components in the middleware).

Our current suite of FMS training materials in the development pipeline includes: a) HLA/RTI itself (including Web/distributed access to DMSO HLA demos); b) our Object Web RTI implementation; c) SPEEDES (Synchronous Parallel Environment for Emulation and Discrete-Event Simulation) training; d) CMS (Comprehensive Mine Simulator) training; e) ModSAF training (as required for CMS simulation). We are also interacting with FMS CHSSI projects and we plan to include other systems under development such as E-ModSAF, IMPORT, TEMPO or Thema into our evolving training suite.

4. Data Mining for the Virtual Proving Ground (VPG)

Our FMS user community includes currently the following groups: a) FMS CHSSI team where we provide PET training services for the FMS software (previous sections); b) Selected advanced M&S project teams such as the CMS team at Ft. Belvoir (next section); b) Virtual Proving Ground team at ARL/ATC in Aberdeen where we currently start providing help with the data mining services (this section) for the T&E historical test data.

In particular, we received recently from the VPG a MS Access database with a vehicle engineering and testing information and we analyzed it using some selected Web and data Mining technologies.

First, the VPG data was made accessible over the Web using Active Server pages for ease of access across workstations and network, and for use with future distributed datamining applications. An SQL Query tool was written on top of this data which can be used to run simple queries and analyze the results

In the second step, we decided to use simple classification algorithm, C4.5, for initial Data Mining experiments. We choose one of the attributes from the incident data table as our target class, dividing the values into two classes Major and Minor. We used a small subset of attributes that we thought would affect the classification process namely the subsystem, course condition and course type for our analysis. The public domain tool that we used was See5 from RuleQuest, which implements the C5.0 KDD algorithm which is a successor to Quinlan’s C4.5 decision tree algorithm. Training data and test data were randomly selected with the help of the query tool. The See5 tool was used to run the algorithm over the training data to generate a decision tree and ruleset with an error rate of 3.8%. On the test cases the error rate was found to be 12%, which indicates the abnormalities in the training set selection and the decision tree generation. We are in the process of refining this to get a lower error rate and to generate a better decision tree. We also calculated the information ratio for each of the selected attributes and the course condition was selected as the root node.

Data Mining experiments as described above allow us to become familiar with the large datasets and the high performance computational challenges of T&E. In the longer run, we view VPG as a promising testbed for WebHLA based virtual prototyping environments as envisioned in Section 7.

Figure 4: Minefield Editor front-end within the Comprehensive Mine Simulator (CMS) environment from Ft. Belvior, VA.

5. Parallelizing Comprehensive Mine Simulator (CMS)

CMS is a computationally demanding DIS system at Ft. Belvior, VA that simulates mines, mine fields, minefield components, standalone detection systems and countermine systems including ASTAMIDS, SMB and MMCM. The system can be viewed as a virtual T&E tool to facilitate R&D in the area of new countermine systems and detection technologies of relevance both for the Army and the Navy.  We are currently analyzing the CMS source code and planning the parallel port of the system to Origin2000.

CMS simulates mine and other minefield objects, and their interactions with vehicles. Major CMS objects include: a) Mine (landmines including several conventional or custom types); b) Component (a collection of mines of one type), c) Minefield (a collections of components enclosed within a terrain perimeter). The CMS user interface supports a number of functions for editing mines during their creation, such as specifying their location or type.


Within CMS, a mine may interact with  externally or internally simulated vehicles. Conceptually, the simulation objects operate largely independently. The control system allows these conceptually independent and autonomous objects to operate and interact without knowing whether other objects are on the same or other computer. In addition it controls the simulation timing. The control scheme uses messages to schedule and then execute processes that are conceptully independent. Due to well defined granularity and indepdendency of the simulation objects, parallel port of CMS to Origin2000 seems to be feasible even if the code is large and includes ModSAF libraries. We are currently identifying the critical loops over messages, mines, components and minefields that need to be optimized or/and paralleled and we intend to address the actual parallel port implementation in Year 3.

6. Visual Authoring Tools for HLA Simulations

DMSO has emphasized the need to develop automated tools with open architectures for creating, executing and maintaining HLA simulations and federations. The associated Federation Development Process (FEDEP) guidelines enforce interoperability in the tool space by standardizing a set of Data Interchange Formats (DIF) that are mandatory as input or output streams for the individual HLA tools. In consequence, one can envision a high-level user friendly e.g. visual dataflow authoring environment in which specialized tools can be easily assembled interactively in terms of computational graphs with atomic tool components as graph nodes and DIF-compliant communication channels as graph links.

Within our HPCMP FMS PET project at NPAC we are building such visual HLA tool assembly framework on top of the NPAC WebFlow [5] system. WebFlow is a Web/Java based visual dataflow environment with the Web browser based computational graph editor and the runtime given by a mesh of interconnected Java Web Servers, used to manage WebFlow middleware module wrappers and acting as proxies to the backend computational modules.

Through WebFlow linkage with HPC via modules/wrappers for Globus Metacomputing as well as support for database and visualization, our approach offers a natural platform for adressing HPC and HLA integration issues.

We started this project by analyzing currently existing tools and their limitations. In particular, we inspected the Object Model Development Tool (OMDT) by Aegis Research Center, Huntsville, AL as a representative current generation DMSO FEDEP tool, and the OSim Tool by OriginalSim, Montreal, CA as a representative current commercial product in this area.

OMDT is a Windows 95/NT-based application that supports building HLA Object Model Template (OMT) tables such as Class, Interaction or Attribute Tables using a spreadsheet-like user interface OSim is a suite of commercial simulation development frameworks designed to facilitate the federate building process through automation and visual authoring.

Figure 5: An illustration of a Virtual Prototyping Environment for Simulation Based Acquisition – an eventual goal for the WebHLA approach presented in this document.

We found that current tools, albeit useful in the standalone mode, are not yet fully ready to act as standardized reusable components in larger toolkits. For example, OMDT is a standalone MFC application accessible only via a human-driven GUI, not a COM server with automation/scripting support, whereas OSim’s custom visual builder can be now more naturally addressed in terms of the UML (Uniform Modeling Language) extensible standard for visual modeling.

Based on lessons learned in the analysis of the current generation tools, we are in the process of building an OMDT-like editing tool based on Microsoft Component Object Model (COM) architecture. Rather than building our sample tool from scratch, we construct it by customizing Microsoft Excel Component using the Visual Basic for Applications and the OLE automation methodology. Using this approach, we were able to emulate the look-and-feel of the OMDT tool, while at the same time packaging our tool as a reusable COM or ActiveX component that can smoothly cooperate with other visual authoring tools within the WebFlow model.

7. Summary and Outlook


We have presented an overview of a set of ongoing FMS PET activities at NPAC that collectively develop WebHLA – an interactive programming and training environment for high performance modeling and simulation.  We described first our JWORB based Object Web RTI which integrates Web, Enterprise and M&S protocols and offers a core framework for interactive hands-on FMS training. Next, we discussed a few specific high level tools such as Data Mining for VPG datasets or visual FOM/SOM authoring, and selected high performance M&S applications such as CMS.

Fig 5 illustrates our envisioned end product in the WebHLA realm – a distributed, Web / Commodity based, high performance and  HLA compliant Virtual Prototyping Environment for Simulation Based Acquisition with Object Web RTI based software bus, integrating a spectrum of M&S tools and modules, wrapped as commodity (CORBA or COM) components and accessible via interactive Web browser front-ends. Such environments, currently operated only by large industry such as Bowing, become affordable within the current technology convergence process as envisioned in Fig. 1 and quantified in our WebHLA integration program.

 

8. References

 

[1] D. Bernholdt, W. Furmanski and G. C. Fox, Towards High Performance Object Web based FMS,  White Paper for the FMS CTA, Sept 1997.

 

[2] Robert Orfali and Dan Harkey, Client/Server Programming with Java and CORBA , 2nd Edition, Wiley 1998.

 

[3] G. C. Fox, W. Furmanski and S. Pallickara, Building Distributed Systems for the Pragmatic Object Web, Wiley 1998 book in progress.

 

[4] G. C. Fox, W. Furmanski and H. T. Ozdemir, Java/CORBA based Real-Time Infrastructure to Integrate Event-Driven  Simulations, Collaboration and Distributed Object/Componentware Computing,

submitted to PDPTA’98, Las Vegas, July 98.

 

[5]  D. Bhatia, V. Burzevski, M. Camuseva, G. Fox, W. Furmanski and G. Premchandran, WebFlow - a visual programming paradigm for Web/Java based coarse grain distributed computing , June '97, in Concurrency: Practice and Experience.