|
This Presentation summarizes the current status of the Rome Laboratory funded Collaborative Interaction and Visualization Project performed by NPAC and Vanguard
|
|
This uses 5 component technologies (VR, Network Support, Compression, Video Conferencing, GIS, Multimedia Databases) with Web based Integration
|
|
These are used with SGI based large screen stereo displays in 4 applications (Electromagnetic and Weather Simulation, Command and Control, Medical Information Systems and Telemedicine)
|
|
This second quarterly review concentrates on applications
|
|
This is third presentation of project which started in September 1995.
|
|
This Presentation summarizes the current status of the Rome Laboratory funded Collaborative Interaction and Visualization Project performed by NPAC and Vanguard
|
|
This uses 5 component technologies (VR, Network Support, Compression, Video Conferencing, GIS, Multimedia Databases) with Web based Integration
|
|
These are used with SGI based large screen stereo displays in 4 applications (Electromagnetic and Weather Simulation, Command and Control, Medical Information Systems and Telemedicine)
|
|
This second quarterly review concentrates on applications
|
|
This is third presentation of project which started in September 1995.
|
|
Non-hydrostatic, compressible dynamics in a terrain-following vertical coordinate.
|
|
6 water phases microphysics (water vapor, cloud water, rain water, cloud ice, snow, and hail/graupel).
|
|
Cloud water, rain water, cloud ice, snow, and hail/graupel.
|
|
Code is designed for incorporating spherical coordinate Doppler radar and other data.
|
|
Storm-tracking capability.
|
|
Code is run the following way:
|
|
Input the data from the national weather service.
|
|
Run the code in the mesoscale mode, which is accurate to locations within 50 km.
|
|
Use this run as the input parameters for the storm scale length run.
|
|
Run the Storm scale length, which is accurate to within 10 km.
|
|
Use this data to initialize the final run, the micro-scale stage.
|
|
This stage is accurate for location of events to within 1km.
|
|
This last stage will predict lake effect snow
|
|
Focus: 3D interactive visualization of human internal organs in their true form and shape; supported by Web-based (video) conferencing
|
3D imaging - visualization, manipulation, extraction and analysis of multidimensional medical structures
-
Slice imaging (extract 2D images)
-
Projective imaging (allows 2.5D mode)
-
Surface rendering - visualization based on object boundaries
-
Volume rendering - direct visualization of voxel data
-
Volume imaging (holography) - true 3D mode
|
|
Traditionally, volume renderers produce their images by one of three methods: ray casting, splatting and forward projection
|
|
The result is displayed on the 2D screen - illusion of depth is created via shading, showing only visible parts, transparency, stereo display, and animation
|
|
Funded by the National Library of Medicine; implemented at the University of Colorado HSC
|
|
39 - year old white male who donated his body to science after being convicted of murder and sentenced to death
|
Magnetic Resonance Images (MRI - 256x256x12) - head scanned axially, the other sections scanned coronally
-
Density of the voxel represents an aggregate of several magnetic properties of the tissue molecules within the voxel
|
Computed Tomography (CT - 512x512x12) - soft tissue and bones
-
Attenuation of X-rays passing through the voxel (tissue)
|
|
Anatomical color photographs - 1878 transverse slices, each 1 millimeter wide; Each slice of the original data is a 2048 x 1216 pixel 24-bit color image
|
|
NPAC has obtained a copy of the Visible Human data set 14GB (FTP:// nlmpubs.nlm.nih.gov) and license to use
|
|
Female not downloaded: 5,000 cross sections ( 40 gigabytes) - good for three-dimensional reconstructions (cubic voxels): slices and resolution - 0.33 mm
|
|
The NPAC Visible Human Viewer is an interactive graphical interface written in Java
|
|
Java applet allows you to select and view high-resolution images of 2-dimensional slices (axial, coronal, sagittal) of a human body
|
|
We have cropped the original images and removed the gelatin background
|
|
We have constructed slices in two orthogonal planes (sagittal and coronal views)
|
|
The resulting images were converted to JPEG format using a 75%
|
|
We have also created lower resolution data for easier downloading (medium and low resolution)
|
|
In December 1995, NPAC's Visible Human Viewer was awarded two JARS (JAVA Applet Rating Service) Awards and was featured on the February 17, 1996 episode of "Computer Chronicles" on PBS
|
|
http://www.npac.syr.edu/projects/vishuman/VisibleHuman.html
|
|
Done (in C) : 3D Reconstruction Of Human Head from VH MRI data set
|
The original data set consists of 28 slices (spaced 4 mm apart)
-
Connectivity algorithm - the tissue of interest is isolated from surrounding data
-
Marching cube algorithm - identifies polygons that make up the surface
-
Visualization step - construction of 3D transformation matrix for any rotations
-
Z-buffer algorithm - visible surface determination
-
Gourad shading algorithm - intensity values for vertices
|
|
In the 3D virtual tour through reconstructed tissue, we have to consider transparency and opacity factors, light sources, shading, rotation and enlargement, the ability to "fly in" the tissue sample from arbitrary angles; interaction
|
|
CD ROMs available "The Dynamic Human", "Dissectable Human" from Engineering Animation, Inc
|
|
AVS or IRIS Explorer may be used to generate a polygon set and then use SGI's Performer to do the fly-through. The Onyx system has 3D texture memory and can render voxel data in real time
|
|
OPEN GL - this is the industry standard 3D API (building the texture data, coloring, rendering)
|
OPEN INVENTOR is built on top of OpenGL -
-
Object-oriented 3D toolkit to create interactive 3D graphics applications
-
Node: surface, material, shape, geometric information, light
|
VRML - Virtual Reality Modeling Language - interpreted language
-
Based on the Open Inventor ASCII file format (minimal operational subset of Open Inventor)
-
Language for describing multi-participant interactive simulations - virtual worlds networked by global Internet
-
Versions 1.0, 1.1available now. Version 2.0 expected in May 96
-
Animation, behavior, interaction will be included in version 2.0
-
Browsers: WebSpace, WebView (source available), WebFX, VRWeb, etc...
-
Modelers: WebSpace Author, World Builder, etc...
|
|
Survey of algorithms for volume visualization
|
|
Reconstruction from anatomical serial sections (high resolution, color images, voxels are not cubic)
|
|
MRI, CT - gray-scale images; due to the resolution are of limited use for volume renderings
|
|
Aligning (linear interpolation between slices; best fit of features as a function of translation and rotations)
|
Store data in rich semantic format in a database system (Illustra) and dynamically synthesize VRML worlds on request
-
3D virtual tour through reconstructed, selected part of the body
-
VRML WebSpace viewer (performance problems expected)
|
|
JAVA applets - dynamic, interactive visualization
|
Volumetric display
-
Only selected plane is seen (other info in dataset is not used)
-
or, the whole data set is used and seen (not good for complex structures)
|
|
Integration 3D interactive imaging with (video) conferencing and Web technologies
|
|
Web/MBONE based videoconferencing and teleconferencing
|
|
In progress : investigation/implementation of new MBONE software (VIC/VAT/WB/SD/VCR). Software installed and tested
|
|
Investigation of Digital Video Everywhere (InSoft)
|
|
Oracle based Web Chat
|
|
Started exploring MOO technologies (JavaMOO, WOO, WOODS)
|
|
In progress - delivery of video stream over low bandwidth communication links (H.263/wavelets)
|
|
Integration of video server and videoconferencing technology
|
|
Netscape works on LiveMedia - new framework for delivering audio/video based on InSoft Network Television and Open DVE (Digital Video Everywhere) technology, RTP protocol (transport of realtime data over packet switched networks), RSVP (Reservation Setup protocol - QoS)
|
|
Plug-ins technology available for Windows and MacIntosh; UNIX version available soon
|
Abstract * Foil Index for this file
