Full HTML for

Basic foilset Overview of WebFlow Applications as Multi-Tier HPCC MetaComputing

Given by Tom Haupt at Technical Session SC98 Orlando on November 10-12 1998. Foils prepared January 31 99
Outside Index Summary of Material

WebFlow
WebFlow over Globus
WebFlow Applications
  • LMS
  • Quantum Simulations
Comments on DATRR

Table of Contents for full HTML of Overview of WebFlow Applications as Multi-Tier HPCC MetaComputing

 Denote Foils where Image Critical
Denote Foils where Image has important information
Denote Foils where HTML is sufficient
1 WebFlow High-Level Programming Environment and Visual Authoring Toolkit for HPDC (desktop access to remote resources)
2 Outline
3 WebFlow Mission
4 WebFlow Applications
5 WebFlow Implementation
6 WebFlow Architecture
7 Middle-Tier
8 Backend Modules
9 Run Method
10 WebFlow over Globus
11 WebFlow Applications
12 LMS Objectives
13 LMS: Changes in Vegetation
14 LMS: Changes in Vegetation
15 LMS Front End
16 LMS Front End (3)
17 PPT Slide
18 PPT Slide
19 LMS Front End (4)
20 Visualizations
21 Watershed Simulation
22 Quantum Simulations using WebFlow - a High Level Visual Interface for Globus
23 Quantum Simulations
24 QS: WebFlow implementation
25 QS Front End
26 PPT Slide
27 Lessons learned
28 Lessons learned (2)
29 Lessons learned (3)

Outside Index Summary of Material

HTML version of Basic Foils prepared January 31 99

Foil 1 WebFlow High-Level Programming Environment and Visual Authoring Toolkit for HPDC (desktop access to remote resources)

From Overview of WebFlow Applications as Multi-Tier HPCC MetaComputing Technical Session SC98 Orlando -- November 10-12 1998. *
Full HTML Index
Tomasz Haupt
Northeast Parallel Architectures Center
Syracuse University
HTML version of Basic Foils prepared January 31 99

Foil 2 Outline

From Overview of WebFlow Applications as Multi-Tier HPCC MetaComputing Technical Session SC98 Orlando -- November 10-12 1998. *
Full HTML Index
WebFlow
WebFlow over Globus
WebFlow Applications
  • LMS
  • Quantum Simulations
Comments on DATRR
HTML version of Basic Foils prepared January 31 99

Foil 3 WebFlow Mission

From Overview of WebFlow Applications as Multi-Tier HPCC MetaComputing Technical Session SC98 Orlando -- November 10-12 1998. *
Full HTML Index
The visual HPDC framework that offers an intuitive Web browser based interface and a uniform point of interactive control for a variety of computational modules and applications, running at various labs on different platforms.
Our technology goal is to build a high-level user friendly commodity software based visual programming and runtime environment for HPDC.
HTML version of Basic Foils prepared January 31 99

Foil 4 WebFlow Applications

From Overview of WebFlow Applications as Multi-Tier HPCC MetaComputing Technical Session SC98 Orlando -- November 10-12 1998. *
Full HTML Index
WebFlow applications are composed of independent reusable modules
Modules are written by module developers
  • people who have only limited knowledge of the system on which the modules will run.
The WebFlow system hides module management and coordination functions
  • allocating and running the modules on various machines, creating connections among the modules, sending and receiving data across these connections, or running several modules concurrently on one machine.
HTML version of Basic Foils prepared January 31 99

Foil 5 WebFlow Implementation

From Overview of WebFlow Applications as Multi-Tier HPCC MetaComputing Technical Session SC98 Orlando -- November 10-12 1998. *
Full HTML Index
WebFlow is implemented as a modern three-tier system
  • Tier 1 is a high-level front-end for visual programming built on top of the Web and OO commodity standards.
  • Distributed object-based, scalable, and reusable Web server and Object broker Middleware forms Tier 2.
  • Back-end services comprise Tier 3. In particular, high performance services are implemented using the metacomputing toolkit of Globus.
HTML version of Basic Foils prepared January 31 99

Foil 6 WebFlow Architecture

From Overview of WebFlow Applications as Multi-Tier HPCC MetaComputing Technical Session SC98 Orlando -- November 10-12 1998. *
Full HTML Index
HTML version of Basic Foils prepared January 31 99

Foil 7 Middle-Tier

From Overview of WebFlow Applications as Multi-Tier HPCC MetaComputing Technical Session SC98 Orlando -- November 10-12 1998. *
Full HTML Index
Mesh of Web Servers running servlets that manage and coordinate distributed computation.
  • Session Manager,
  • Module Manager,
  • Connection Manager.
Front End
HTML version of Basic Foils prepared January 31 99

Foil 8 Backend Modules

From Overview of WebFlow Applications as Multi-Tier HPCC MetaComputing Technical Session SC98 Orlando -- November 10-12 1998. *
Full HTML Index
are Java objects that implement WebFlow specific module interface:
  • initialize
    • register itself to the module manager, and registers its input and output ports to the connection manager
  • run
    • implements the actual functionality of the module
  • destroy
    • release resources
HTML version of Basic Foils prepared January 31 99

Foil 9 Run Method

From Overview of WebFlow Applications as Multi-Tier HPCC MetaComputing Technical Session SC98 Orlando -- November 10-12 1998. *
Full HTML Index
The functionality of the module (run method) can be implemented entirely in Java
Existing applications written in languages different than Java can be easily encapsulated
Execution of the module can be delegated to an external system capable of resource allocation such as Globus, Condor, etc.
HTML version of Basic Foils prepared January 31 99

Foil 10 WebFlow over Globus

From Overview of WebFlow Applications as Multi-Tier HPCC MetaComputing Technical Session SC98 Orlando -- November 10-12 1998. *
Full HTML Index
In order to run WebFlow over Globus there must be at least one WebFlow node capable of executing Globus commands, such as globusrun
Jobs that require computational power of massively parallel computers are directed to the Globus domain, while others can be launched on much more modest platforms, such as the user's desktop or even a laptop running Windows NT.
Bridge between WebFlow and Globus
HTML version of Basic Foils prepared January 31 99

Foil 11 WebFlow Applications

From Overview of WebFlow Applications as Multi-Tier HPCC MetaComputing Technical Session SC98 Orlando -- November 10-12 1998. *
Full HTML Index
Landscape Management System
  • CEWES: MSRC/PET
Quantum Simulations
  • Alliance/NCSA
HTML version of Basic Foils prepared January 31 99

Foil 12 LMS Objectives

From Overview of WebFlow Applications as Multi-Tier HPCC MetaComputing Technical Session SC98 Orlando -- November 10-12 1998. *
Full HTML Index
To develop a web based system that implements a "navigate-and-choose" paradigm and allows the end user to:
  • Select (a set of) computational modules that provide answers to the problem at hand
  • Retrieve input data sets from remote sources
  • Use adequate (remote) computational resources
  • Visualize and analyze output data on the local host
Anytime, anywhere, using any platform
(e.g., a connected to the internet laptop PC)
HTML version of Basic Foils prepared January 31 99

Foil 13 LMS: Changes in Vegetation

From Overview of WebFlow Applications as Multi-Tier HPCC MetaComputing Technical Session SC98 Orlando -- November 10-12 1998. *
Full HTML Index
A decision maker (the end user of the system) wants to evaluate changes in vegetation in some geographical region over a long time period caused by some short term disturbances such as a fire or human's activities.
One of the critical parameters of the vegetation model is soil condition at the time of the disturbance.
This in turn is dominated by rainfalls that possibly occur at that time
HTML version of Basic Foils prepared January 31 99

Foil 14 LMS: Changes in Vegetation

From Overview of WebFlow Applications as Multi-Tier HPCC MetaComputing Technical Session SC98 Orlando -- November 10-12 1998. *
Full HTML Index
Data retrieval
Data preprocessing
Simulation: two interacting codes
  • EDYS
  • CASC2D
Visualization
WMS
EDYS
CASC2D
DEM
Land Use
Soil
Texture
Vegetation
HTML version of Basic Foils prepared January 31 99

Foil 15 LMS Front End

From Overview of WebFlow Applications as Multi-Tier HPCC MetaComputing Technical Session SC98 Orlando -- November 10-12 1998. *
Full HTML Index
HTML version of Basic Foils prepared January 31 99

Foil 16 LMS Front End (3)

From Overview of WebFlow Applications as Multi-Tier HPCC MetaComputing Technical Session SC98 Orlando -- November 10-12 1998. *
Full HTML Index
HTML version of Basic Foils prepared January 31 99

Foil 17 PPT Slide

From Overview of WebFlow Applications as Multi-Tier HPCC MetaComputing Technical Session SC98 Orlando -- November 10-12 1998. *
Full HTML Index
HTML version of Basic Foils prepared January 31 99

Foil 18 PPT Slide

From Overview of WebFlow Applications as Multi-Tier HPCC MetaComputing Technical Session SC98 Orlando -- November 10-12 1998. *
Full HTML Index
HTML version of Basic Foils prepared January 31 99

Foil 19 LMS Front End (4)

From Overview of WebFlow Applications as Multi-Tier HPCC MetaComputing Technical Session SC98 Orlando -- November 10-12 1998. *
Full HTML Index
HTML version of Basic Foils prepared January 31 99

Foil 20 Visualizations

From Overview of WebFlow Applications as Multi-Tier HPCC MetaComputing Technical Session SC98 Orlando -- November 10-12 1998. *
Full HTML Index
HTML version of Basic Foils prepared January 31 99

Foil 21 Watershed Simulation

From Overview of WebFlow Applications as Multi-Tier HPCC MetaComputing Technical Session SC98 Orlando -- November 10-12 1998. *
Full HTML Index
HTML version of Basic Foils prepared January 31 99

Foil 22 Quantum Simulations using WebFlow - a High Level Visual Interface for Globus

From Overview of WebFlow Applications as Multi-Tier HPCC MetaComputing Technical Session SC98 Orlando -- November 10-12 1998. *
Full HTML Index
(Alliance Team B)
HTML version of Basic Foils prepared January 31 99

Foil 23 Quantum Simulations

From Overview of WebFlow Applications as Multi-Tier HPCC MetaComputing Technical Session SC98 Orlando -- November 10-12 1998. *
Full HTML Index
HTML version of Basic Foils prepared January 31 99

Foil 24 QS: WebFlow implementation

From Overview of WebFlow Applications as Multi-Tier HPCC MetaComputing Technical Session SC98 Orlando -- November 10-12 1998. *
Full HTML Index
HTML version of Basic Foils prepared January 31 99

Foil 25 QS Front End

From Overview of WebFlow Applications as Multi-Tier HPCC MetaComputing Technical Session SC98 Orlando -- November 10-12 1998. *
Full HTML Index
HTML version of Basic Foils prepared January 31 99

Foil 26 PPT Slide

From Overview of WebFlow Applications as Multi-Tier HPCC MetaComputing Technical Session SC98 Orlando -- November 10-12 1998. *
Full HTML Index
HTML version of Basic Foils prepared January 31 99

Foil 27 Lessons learned

From Overview of WebFlow Applications as Multi-Tier HPCC MetaComputing Technical Session SC98 Orlando -- November 10-12 1998. *
Full HTML Index
Access to data from many different sources
  • data sources identification
  • support for standard protocols (fire walls!)
  • support for high performance data transfer
  • authentication and authorization
  • security (encryption)
  • filtering and preprocessing
HTML version of Basic Foils prepared January 31 99

Foil 28 Lessons learned (2)

From Overview of WebFlow Applications as Multi-Tier HPCC MetaComputing Technical Session SC98 Orlando -- November 10-12 1998. *
Full HTML Index
Resource identification & allocation
  • small tasks
  • access to commodity components
  • HPCC (usually batch systems)
  • coallocation of resources
  • resource brokers
  • resource allocation language
  • authentication and authorization
HTML version of Basic Foils prepared January 31 99

Foil 29 Lessons learned (3)

From Overview of WebFlow Applications as Multi-Tier HPCC MetaComputing Technical Session SC98 Orlando -- November 10-12 1998. *
Full HTML Index
Monitoring (generic and custom)
Fault tolerance
Quality of service
Security of Web access and Web transactions
Front-End API
© Northeast Parallel Architectures Center, Syracuse University, npac@npac.syr.edu

If you have any comments about this server, send e-mail to webmaster@npac.syr.edu.

Page produced by wwwfoil on Sun Jan 31 1999