Full HTML for

Basic foilset Seamless Interfaces, Multi-Tier Gateway Systems, Comments on Sandia DRM Design

Given by Geoffrey C. Fox, Wojtek Furmanski at Analysis of ASCI DRM Design on August 98. Foils prepared September 13 98
Outside Index Summary of Material

We comment on Sandia DRM preliminary document and attach three background presentations describing
1) Community project to define standards for seamless interfaces allowing universal access to general hosts
  • can be CORBA facility or Java framework
2) NPAC's hierarchical access Gateway multi-tier architecture and illustrate it with
3) NPAC Projects using NPAC's WebFlow and JWORB object broker combined with Globus to illustrate viability of hierarchical model for NCSA (NSF Alliance) and DoD HPC modernization applications

Table of Contents for full HTML of Seamless Interfaces, Multi-Tier Gateway Systems, Comments on Sandia DRM Design

 Denote Foils where Image Critical
Denote Foils where HTML is sufficient
1 Seamless Interfaces Multi Tier Gateway Systems Comments on Sandia DRM Design
2 Abstract of Sandia DRM Comments
3 General Comments on DRM Architecture
4 More detailed Comments - I
5 More detailed Comments - II
6 More detailed Comments - III
7 What Follows
8 Java Seamless Computing Framework or CORBA Facility for Computation
9 What/Why is a Framework?
10 JDBC Software Architecture
11 Proposed Java Computing Services Framework
12 Possible Services in a Java Computing Framework - I
13 Possible Services in a Java Computing Framework - II
14 Gateway System Architecture Linking Clients, HPCC, and Modern Multi Tier Enterprise Systems with CORBA Java COM ..
15 Multi Tier Architectures
16 Multi Tier Gateway Architecture
17 Multi-Server Gateway Tier
18 Gateway Model for HPCC Multidisciplinary applications
19 What are General Capabilities in Gateway Tier?
20 What Particular Programs could run in Gateway Tier I?
21 What Particular Programs could run in Gateway Tier II?
22 Comments on GrandeGateway
23 Tango and GrandeGateways
24 WebFlow and JWORB over GLOBUS
25 Gateway Building Blocks: JWORB WebFlow on GLOBUS
26 WebFlow as front end for Globus in Alliance Quantum Chemistry Simulations
27 WebFlow over Globus for NCSA Alliance Quantum Chemistry Application View
28 WebFlow on Globus -- LMS at CEWES
29 Summary of NPAC's JWORB natural Building Block of the Gateway

Outside Index Summary of Material

HTML version of Basic Foils prepared September 13 98

Foil 1 Seamless Interfaces Multi Tier Gateway Systems Comments on Sandia DRM Design

From Seamless Interfaces, Multi-Tier Gateway Systems, Comments on Sandia DRM Design Analysis of ASCI DRM Design -- August 98. *
Full HTML Index
September 5 98
Geoffrey Fox
Northeast Parallel Architectures Center
Syracuse University
111 College Place
Syracuse NY
gcf@npac.syr.edu
http://www.javagrande.org
http://www.npac.syr.edu/europowsept98
http://www.npac.syr.edu/users/gcf/jgeurosept98
HTML version of Basic Foils prepared September 13 98

Foil 2 Abstract of Sandia DRM Comments

From Seamless Interfaces, Multi-Tier Gateway Systems, Comments on Sandia DRM Design Analysis of ASCI DRM Design -- August 98. *
Full HTML Index
We comment on Sandia DRM preliminary document and attach three background presentations describing
1) Community project to define standards for seamless interfaces allowing universal access to general hosts
  • can be CORBA facility or Java framework
2) NPAC's hierarchical access Gateway multi-tier architecture and illustrate it with
3) NPAC Projects using NPAC's WebFlow and JWORB object broker combined with Globus to illustrate viability of hierarchical model for NCSA (NSF Alliance) and DoD HPC modernization applications
HTML version of Basic Foils prepared September 13 98

Foil 3 General Comments on DRM Architecture

From Seamless Interfaces, Multi-Tier Gateway Systems, Comments on Sandia DRM Design Analysis of ASCI DRM Design -- August 98. *
Full HTML Index
We have two major comments on overall architecture
Firstly it does not appear to include some commodity services such as collaboration, training, consultant interactions, (commodity) database, "personal web server"
Secondly it suggests a uniform architecture whereas we suggest designing for a hierarchical system supporting different protocols, performances and capabilities at each level or tier (terminology used later)
  • We suggest such a multi-tier architecture has significantly more flexibility and lower cost (in development and maintenance) as it enables commodity and HPCC systems to co-exist
  • We assume users want a mix of HPCC and commodity services which are often linked in a single session
HTML version of Basic Foils prepared September 13 98

Foil 4 More detailed Comments - I

From Seamless Interfaces, Multi-Tier Gateway Systems, Comments on Sandia DRM Design Analysis of ASCI DRM Design -- August 98. *
Full HTML Index
1) In first foil (criteria/principles) we suggest adding
  • leverage of commodity investment
  • appropriate development and especially maintenance cost (only you can say what this is!)
2) We suggest that the establishment of an agreed object model for jobs and computers (or more generally resources) is implied by architecture
  • Our attempts to establish this community standard are described later as the "Java Seamless Computing Framework" -- next step in this activity (general meeting) is supported by both Globus and Java Grande Forum
  • In principle, such a standard would make it easier for HPCC systems such as Globus and Legion to co-exist with each other and with commodity services
HTML version of Basic Foils prepared September 13 98

Foil 5 More detailed Comments - II

From Seamless Interfaces, Multi-Tier Gateway Systems, Comments on Sandia DRM Design Analysis of ASCI DRM Design -- August 98. *
Full HTML Index
In resource material at end, we define 3 basic tiers
  • client, (Grande)Gateway and backend (Grandecomputer)
Sandia CPLANT machines would appear in both gateway and backend tiers
  • In gateway, one would use full NT (or perhaps Linux environments) and in backend, systems optimized for performance
  • High end gateway machines would be typical large SMP's
  • Commodity protocols would link both UNIX and NT -- HPCC backend systems could be specialized
As described in following, we suggest gateway can be viewed as linked servers -- each hosting some sort of service -- and linked either by user-set, agent negotiated or fixed channels
Sun's new JINI resource management system seems possibly very important
HTML version of Basic Foils prepared September 13 98

Foil 6 More detailed Comments - III

From Seamless Interfaces, Multi-Tier Gateway Systems, Comments on Sandia DRM Design Analysis of ASCI DRM Design -- August 98. *
Full HTML Index
Globus/Legion and others have identified difficulties stemming from existing batch schedulers such as LSF and Codine which do not immediately support synchronicity between jobs on different machines as is required in metacomputing
  • This needs to be addressed in any deployed system and we would suggest building such schedulers to respect hierarchy with coarse grain scheduling at commodity layer and finer grain decisions in the backend
Do you need services such as WebFlow in following foils which supports composition of compound jobs or metaproblems?
The Gateway would be distributed with systems deployed at each site
  • The Sandia GrandeGateway would link to local and remote machines
HTML version of Basic Foils prepared September 13 98

Foil 7 What Follows

From Seamless Interfaces, Multi-Tier Gateway Systems, Comments on Sandia DRM Design Analysis of ASCI DRM Design -- August 98. *
Full HTML Index
1) Description of "Java Seamless Computing Framework"
2) Description of "GrandeGateway" hosting "Grandecomputers" as developed for four DoD HPC modernization sites and slightly modified for Sandia
3)WebFlow over Globus NPAC project illustrating hierarchical concept
HTML version of Basic Foils prepared September 13 98

Foil 8 Java Seamless Computing Framework or CORBA Facility for Computation

From Seamless Interfaces, Multi-Tier Gateway Systems, Comments on Sandia DRM Design Analysis of ASCI DRM Design -- August 98. *
Full HTML Index
Allows Universal Access to all computers from the same Java Applet Front End
Infrastructure for Metacomputing, Performance Modeling, Interfacing computers and data to distributed computational objects
We expect to hold soon an open meeting sponsored by Globus and Java Grande Forum (working group led by Dennis Gannon) to start definition of these ideas
To be realized as Java Interfaces; CORBA IDL or XML
HTML version of Basic Foils prepared September 13 98

Foil 9 What/Why is a Framework?

From Seamless Interfaces, Multi-Tier Gateway Systems, Comments on Sandia DRM Design Analysis of ASCI DRM Design -- August 98. *
Full HTML Index
Java Calls (mainly Interfaces and not methods) to capabilities expressed in implementation neutral form
Drivers convert these general calls to vendor specific implementation of service
Java code can either be all on client (2-tier) or on client and middle tier (3 tier)
e.g. JDBC (Java Database Connectivity) is a universal interface to all relational databases
Adoption of this JDBC implies that vendor specific solutions are immediately less attractive
  • All vendors must however support JDBC because of importance of "seamless" interfaces!
HTML version of Basic Foils prepared September 13 98

Foil 10 JDBC Software Architecture

From Seamless Interfaces, Multi-Tier Gateway Systems, Comments on Sandia DRM Design Analysis of ASCI DRM Design -- August 98. *
Full HTML Index
Java applications
JDBC API
JDBC Driver manager
JDBC API
JDBC Driver API
HTML version of Basic Foils prepared September 13 98

Foil 11 Proposed Java Computing Services Framework

From Seamless Interfaces, Multi-Tier Gateway Systems, Comments on Sandia DRM Design Analysis of ASCI DRM Design -- August 98. *
Full HTML Index
Enables development of Web Interfaces to run a given job on any computer with any data source compliant with this framework just as JDBC gives a universal interface to any relational database
  • i.e. enables seamless computing
The Computing Services Framework will allow vendors to compete on either User Front End (GUI) or back end services with the JavaCS framework providing universal linkage
The framework is implemented at the backend as a set of drivers which map generic Java Interfaces to particular software (e.g. a compiler) on particular machines.
Requires agreement by "suitable interested parties" on
  • what are the services
  • what are the interfaces for a given service
  • As with JDBC and Oracle's PL/SQL can lead to difficult choices!
HTML version of Basic Foils prepared September 13 98

Foil 12 Possible Services in a Java Computing Framework - I

From Seamless Interfaces, Multi-Tier Gateway Systems, Comments on Sandia DRM Design Analysis of ASCI DRM Design -- August 98. *
Full HTML Index
"Old" (seamless workshop Sept 97) link is http://www.sis.port.ac.uk/~mab/Computing-FrameWork/
Abstract ideas developed in Condor Globus Legion and PACE POEMS PetaSIM for harder problems (metacomputing / performance specification) and developed for seamless problem by Sweb (Cornell) WebSubmit (NIST) or UNICORE (Europe)
Compiling, Executing, Specification of features needed for execution optimization
  • This includes parameters needed by MPI/HPF decompositions such as number of processors
  • Resource Management and Scheduling jobs as in Codine or LSF or commercial NT environments
Accounting -- integrate with Web commerce technology?
Authenication, Security (especially hard in metacomputing as link several different management policies)
  • Public Key Infrastructure expected from Internet commerce very important
HTML version of Basic Foils prepared September 13 98

Foil 13 Possible Services in a Java Computing Framework - II

From Seamless Interfaces, Multi-Tier Gateway Systems, Comments on Sandia DRM Design Analysis of ASCI DRM Design -- August 98. *
Full HTML Index
Sharing, Accessing and Storing into File Systems
Data and Performance Visualization Interface (how applets access server side information)
Performance measurement and recording (cf: Pablo SDDF)
Interfaces for Programming Tools
  • Debuggers
  • Computational Steering / Interpreted Execution
Libraries including names in generalized Math class and
  • Java Grande defining this in numerics working group
Resource Discovery, Allocation and Scheduling
  • Recent JINI Sun technology looks attractive
Module linkage model for metaproblems (multidisciplinary applications) -- can we use standard JavaBean approach?
HTML version of Basic Foils prepared September 13 98

Foil 14 Gateway System Architecture Linking Clients, HPCC, and Modern Multi Tier Enterprise Systems with CORBA Java COM ..

From Seamless Interfaces, Multi-Tier Gateway Systems, Comments on Sandia DRM Design Analysis of ASCI DRM Design -- August 98. *
Full HTML Index
HTML version of Basic Foils prepared September 13 98

Foil 15 Multi Tier Architectures

From Seamless Interfaces, Multi-Tier Gateway Systems, Comments on Sandia DRM Design Analysis of ASCI DRM Design -- August 98. *
Full HTML Index
Middle Tier (Business) Logic links user and system view of data and services
Generalized distributed object (database record is "just" a distributed object) specification
Different but linkable transport protocols
Client
Client Tier Middle (Gateway) Tier Back End
HTML version of Basic Foils prepared September 13 98

Foil 16 Multi Tier Gateway Architecture

From Seamless Interfaces, Multi-Tier Gateway Systems, Comments on Sandia DRM Design Analysis of ASCI DRM Design -- August 98. *
Full HTML Index
High Performance Computing and Communication Tier
Clients
Gateway Systems as Middle Tier
HTML version of Basic Foils prepared September 13 98

Foil 17 Multi-Server Gateway Tier

From Seamless Interfaces, Multi-Tier Gateway Systems, Comments on Sandia DRM Design Analysis of ASCI DRM Design -- August 98. *
Full HTML Index
Database
Matrix Solver
Optimization Service
MPP
MPP
Parallel DB Proxy
NEOS Control Optimization
Origin 2000 Proxy
NetSolve Linear Alg. Server
IBM SP2 Proxy
Gateway Control
Agent-based Choice of Compute Engine
Multidisciplinary Control (WebFlow)
Data Analysis Server
HTML version of Basic Foils prepared September 13 98

Foil 18 Gateway Model for HPCC Multidisciplinary applications

From Seamless Interfaces, Multi-Tier Gateway Systems, Comments on Sandia DRM Design Analysis of ASCI DRM Design -- August 98. *
Full HTML Index
We have multiple supercomputers in the backend -- one doing CFD simulation of airflow; another structural analysis while in more detail you have linear algebra servers (Netsolve); Optimization servers (NEOS); image processing filters(Khoros);databases (NCSA Biology workbench); visualization systems(AVS, CAVEs)
  • One runs 10,000 separate programs to design a modern aircraft which must be scheduled and linked .....
All linked to collaborative information systems in a sea of middle tier servers(as on previous page) to support design, crisis management, multi-disciplinary research
HTML version of Basic Foils prepared September 13 98

Foil 19 What are General Capabilities in Gateway Tier?

From Seamless Interfaces, Multi-Tier Gateway Systems, Comments on Sandia DRM Design Analysis of ASCI DRM Design -- August 98. *
Full HTML Index
Seamless Interface -- an Enterprise Javabean which processes input from user's Java Applet interface and maps user generic commands to those on specific machine
  • Uses agents to determine optimal execution platform
  • Accounting, Security, Compiling Interface, Seamless Tools Interface, global data and file system interface
Coarse Grain Resource management of heterogeneous MPP backend (linked to seamless interface)
Performance Estimation Service
Database and Object Brokers; Network servers like NetSolve
Collaboration Servers such as Habanero, Tango, Lotus Notes ...
Visualization Servers
"Business Logic" to map user data view (e.g. objects) to persistent store (e.g. Oracle database) and simulation engine (MPP) preferred format
HTML version of Basic Foils prepared September 13 98

Foil 20 What Particular Programs could run in Gateway Tier I?

From Seamless Interfaces, Multi-Tier Gateway Systems, Comments on Sandia DRM Design Analysis of ASCI DRM Design -- August 98. *
Full HTML Index
The 90% of users who only need HPCC occasionally
Any commodity applications such as modern enterprise information systems
The collection of (Java) servers using commodity protocols -- including IIOP HTTP etc. -- and providing key services not necessarily requiring high performance (MPP's available in backend tier if high performance, large storage etc. needed)
Most of a Command and Control Application which would then interface to backend computational service (e.g. to simulate crisis as in Los Alamos Delphi project)
Several FMS (Forces Modeling) and IMT (Integrated Modeling and Testing) DoD Applications i.e. DMSO style distributed simulation
Some I/O Intensive applications
HTML version of Basic Foils prepared September 13 98

Foil 21 What Particular Programs could run in Gateway Tier II?

From Seamless Interfaces, Multi-Tier Gateway Systems, Comments on Sandia DRM Design Analysis of ASCI DRM Design -- August 98. *
Full HTML Index
High value services with modest computational needs e.g. grid generation and other pre-processing, data manipulation and other post-processing
Video Servers and multi media databases for Training
Design and Planning Tools -- programs that could be on client but in multi-tier "thin-client" models are run as middle tier services
Processors (Java servlets) for JSCF (Java Seamless Computing Framework) and proposed (by NPAC) HLA/RTI control services
"Glue" for Multidisciplinary Interactions
Control of Metacomputing applications
JINI Java Resource Registration and Discovery Service
HTML version of Basic Foils prepared September 13 98

Foil 22 Comments on GrandeGateway

From Seamless Interfaces, Multi-Tier Gateway Systems, Comments on Sandia DRM Design Analysis of ASCI DRM Design -- August 98. *
Full HTML Index
The following diagram illustrates features of the "gateway concept"
The hardware to support gateway may be different from that natural for HPCC backends
  • typical would be "corporate enterprise servers" such as high-end Unix (SUN, Linux?) servers or PC NT systems
Several services would be controlled in "GrandeGateway" -- we illustrate this for collaboration which would allow sharing of information from clients and also backend Super(Grande) computers represented by proxies (e.g. Java or CORBA wrappers) at this level
  • Tango supports user-consultant and multi-user interactions
  • Habanero would show same logical diagram as Tango
There is no clean 1:1 mapping of hardware and software tiers
  • For instance a "logically backend" Oracle database could be hosted on the same SUN Enterprise server running Java servers supporting collaboration, access and other services
HTML version of Basic Foils prepared September 13 98

Foil 23 Tango and GrandeGateways

From Seamless Interfaces, Multi-Tier Gateway Systems, Comments on Sandia DRM Design Analysis of ASCI DRM Design -- August 98. *
Full HTML Index
Geographically
Distributed
Grandecomputer
Resources
GrandeGateway
System
hosting Seamless Access
TangoInteractive,
Visualization and other Services
Geographically Distributed users
and consultants
High Speed HPCC Network Nexus etc.
Commodity Network IIOP HTTP etc.
HTML version of Basic Foils prepared September 13 98

Foil 24 WebFlow and JWORB over GLOBUS

From Seamless Interfaces, Multi-Tier Gateway Systems, Comments on Sandia DRM Design Analysis of ASCI DRM Design -- August 98. *
Full HTML Index
NPAC Project illustrating multi tier Gateway incorporating Java Applet Program Composition at Client
DMSO HLA/RTI Compliance (FMS,IMT)
CORBA COM Java Web Interoperable Gateway GLOBUS High Performance Backend inherits Gateway Services: Collaboration, Distributed Objects, Databases, Visualization .....
HTML version of Basic Foils prepared September 13 98

Foil 25 Gateway Building Blocks: JWORB WebFlow on GLOBUS

From Seamless Interfaces, Multi-Tier Gateway Systems, Comments on Sandia DRM Design Analysis of ASCI DRM Design -- August 98. *
Full HTML Index
Client (Tier 1): Java Graph Editor for Webflow linked to interpreted debuggers, visualization, performance estimation and other client side tools
  • All access in concordance with JFSC (Proposed Java framework for seamless computing)
  • In four tier model, these Java tools would run on Java Web Server with pure HTML client
Middle Tier 2: Network of JWORB or Java Servers running on Gateway Tier linking to CORBA COM and HTTP(Internet)
  • Java Servlet wraps non Java Application (Apache Java Server) or CORBA using JWORB gateway tier server handles any language
Back-end Tier 3: Simple MPI or Globus (or similar) where available and where necessary
Next foils show
  • Customized "database" solution for NCSA Alliance Grand Challenge in Quantum Monte Carlo
  • LMS Landscape Modeling System linking multiple (possibly parallel) simulation modules with diverse data from the Internet
HTML version of Basic Foils prepared September 13 98

Foil 26 WebFlow as front end for Globus in Alliance Quantum Chemistry Simulations

From Seamless Interfaces, Multi-Tier Gateway Systems, Comments on Sandia DRM Design Analysis of ASCI DRM Design -- August 98. *
Full HTML Index
Client Tier
IIOP High Functionality
Middle Tier
Future Globus
Globus
Future Parallel I/O
HTML version of Basic Foils prepared September 13 98

Foil 27 WebFlow over Globus for NCSA Alliance Quantum Chemistry Application View

From Seamless Interfaces, Multi-Tier Gateway Systems, Comments on Sandia DRM Design Analysis of ASCI DRM Design -- August 98. *
Full HTML Index
HTML version of Basic Foils prepared September 13 98

Foil 28 WebFlow on Globus -- LMS at CEWES

From Seamless Interfaces, Multi-Tier Gateway Systems, Comments on Sandia DRM Design Analysis of ASCI DRM Design -- August 98. *
Full HTML Index
WebFlow
server
WebFlow
server
WebFlow
server
EDYS
CASC2D
Data Retrieval
High Performance SubSystem
CASC2D
proxy
IIOP
Web Browser
Data Wizard
WMS interface
Toolbar
HTTP
WMS
File Transfer
File Transfer
GLOBUS
Internet
WebFlow modules
(back-end)
WebFlow
middle-tier
WebFlow applet
(front-end)
HTML version of Basic Foils prepared September 13 98

Foil 29 Summary of NPAC's JWORB natural Building Block of the Gateway

From Seamless Interfaces, Multi-Tier Gateway Systems, Comments on Sandia DRM Design Analysis of ASCI DRM Design -- August 98. *
Full HTML Index
JWORB - Java Web Object Request Broker - multi-protocol middleware network server (HTTP + IIOP + DCE RPC + RMI transport)
Current prototype integrates HTTP and IIOP i.e. acts as Web Server and CORBA Broker
  • HTTP Services built in terms of CORBA services
  • Gives you immediately web interfaces to CORBA
  • CORBA supports applications in any language
Next step: add DCE RPC support to include Microsoft COM
JWORB - our trial implementation of Pragmatic Object Web
First non DMSO implementation of RTI -- HLA (distributed event driven simulation) Runtime
© Northeast Parallel Architectures Center, Syracuse University, npac@npac.syr.edu

If you have any comments about this server, send e-mail to webmaster@npac.syr.edu.

Page produced by wwwfoil on Sat Nov 28 1998