Share |

iSGTW Feature - New bridge over muddled waters of grid storage


Feature - New bridge over muddled waters of grid storage

Interoperability between the two islands of SRM and SRB opens up opportunities for different grids to share data; for example, scientists using the Worldwide LHC Computing Grid could now process data from the U.S. TeraGrid
Image courtesy of The Gentle

Two islands of storage technology have been joined, according to a presentation at the EGEE User Forum in Clermont-Ferrand, France, last week.

Jens Jensen, of Rutherford Appleton Laboratory in the UK, told attendees how his team have successfully bridged two key grid technologies: the Storage Resource Broker (SRB) and Storage Resource Management (SRM).

A demonstration of the bridging was first run at SC07 in Reno, Nevada, on behalf of the GridPP-led team.

Two storage islands 

SRM and SRB are both ways of accessing the storage available on a grid—either using tapes, disks or disk arrays. Usually, storage elements running SRB can’t be seen by a grid running SRM, and vice versa. Most grids run one or the other technology, but if different grids are to interoperate, the two standards will need to work together.

“SRM and SRB are traditionally the two separate ‘storage islands’ in grids,” says Jensen, “each providing interoperability within its own island, but not between the islands. We used the GridFTP protocol and advanced data management tools from the EGEE project to transfer data between SRM and SRBs, and bridge these islands.”

Interoperability between different grids and grid technologies is key to the success of many applications, and essential to the idea of a universal, interoperable “Grid.”
Images courtesy of wsdot

GridPP and NGS: our powers combined

The team built on a GridFTP server developed for SRB by the San Diego Supercomputer Center and Argonne National Laboratory, to make an SRB look like a Classic Storage Element. This allowed the gLite tools to transfer files between SRMs and SRBs.

One of Jensen’s activities is working on interoperability between the UK’s two main science grids: GridPP, the UK particle physics grid, which runs various implementations of SRM, and the UK National Grid Service, which mainly runs SRB.

This work also opens up opportunities for other grids to share data—for example between Worldwide LHC Computing Grid and the U.S. TeraGrid.

Grid Interoperation Now

Erwin Laure, technical director of the EGEE project, is also coordinator of the Grid Interoperation Now activities in the Open Grid Forum. He says interoperability of different grid infrastructures is a necessity for many applications. “The OGF GIN community is aiming at pragmatic solutions for achieving interoperation,” he says. “This interoperation between the two most commonly deployed data solutions, SRM and SRB, achieved by Jens’ team, is a great step forward towards achieving this goal.”

Alex Sim of Lawrence Berkeley National Laboratory in the U.S. demonstrated the data transfer for the UK team at SC07.

“The demo showed interoperability of eleven different SRM implementations around the world based on the same specification, including data transfers between an SRB at Rutherford Appleton Laboratory and BeStMan SRM at Lawrence Berkeley National Laboratory,” Sim explains. “This caused great interest among delegates, and it is of interest for scientists—especially in the Worldwide LHC Computing Grid Project, as they can now access data directly in SRB.”

Jensen is particularly enthusiastic about how well the current work fits the GIN group. “The important aspect of this work is that it builds on existing tools and requires no development effort. It really is Grid Interoperability Now!”

- Sarah Pearce, GridPP

No votes yet


Post new comment

By submitting this form, you accept the Mollom privacy policy.