Grids used in Digital libraries and Information Management

Applying Grid Computing Research to Commercial Information Retrieval Applications

Organized by: Sol Lederman Deep Web Technologies

Tuesday June 28 2005 3:15p – 4:00p

Presentation

Carl Sylvia Deep Web Technologies Applying Grid Computing Research to Commercial IR Applications

Abstract

Los Alamos New Mexico-based Deep Web Technologies (DWT) is developing technology that will replace the search engine powering Science.gov with a cutting edge Grid-based application. DWT's next-generation search, retrieval, and analysis technology will advance the state-of-the art of Distributed Information Retrieval and make possible a new generation of Grid-based commercial applications. Science.gov is a strategic first deployment of DWT's new technology as Science.gov is a showcase search portal for the Federal government; it is a collaborative effort of 12 Federal agencies (the Science.gov Alliance) to share the output of their best research with the public. The work also helps to unite the CENDI community, comprised of senior government scientific and technical information managers. DWT, with US Department of Energy funding, will be deploying the new technology in October, 2005. Carl Sylvia, lead architect for DWT's Grid technologies presents a technical overview of the company's highly distributed, scalable, and modular IR framework that will take federated searching and analysis of deep web content, not easily accessible to Google and other search engines, to a whole new level. Mr. Sylvia discusses how the fruits of the research of the Grid community combined with the support of the Science.gov Alliance and of CENDI, have proven critical to the development of the novel architecture needed to power the development and deployment of commercial next generation Grid-based IR products.

Comments

There was an interesting discussion on the synergy between this SBIR project and GGF's GridIR standard under development. We expect further interactions between DWT and GGF in this regard.

Geoffrey Fox gave a presentation on Grids April 25 2005 to CENDI which is an interagency working group of senior Scientific and Technical Information (STI) Managers from 12 U.S. federal agencies: