Share |

Content about Open Science Grid

November 14, 2007

  Announcement - SURA releases Grid Technology Cookbook The Grid Technology Cookbook has something for everyone, offering a comprehensive and detailed look at grid technologies developing around the world.Image courtesy of SURA The Southeastern Universities Research Association (SURA) has released the Grid Technology Cookbook as part of their effort to increase the breadth and effective use of cyberinfrastructure. The Grid Technology Cookbook follows in the spirit of similar Cookbook productions, such as the ViDe Video Conferencing Cookbook, which have been supported or facilitated by SURA but driven by recognized need and content contributions from the academic and research community. The Cookbook’s educational value and reach will be further extended by interactive feedback mechanisms and a future print version. This initial version covers topics ranging from broadly useful ideas—such as the concepts behind grid technology and case studies of its usage—to more specific sections geared to individual

November 14, 2007

  Images of the week - Scenes from SC07 Pumping at the pinnacle of energy, innovation and computing power, SC07 is serving up the latest and greatest in IT to a record crowd this week in Reno, Nevada.Image courtesy of Douglas Mansell The Stony Brook University team are all smiles just prior to beginning their 44-hour race against the clock and five other undergraduate teams as part of the Cluster Challenge.Image courtesy of Douglas Mansell The Enabling Grids for E-sciencE stand showcases the achievements of EGEE, a project which brings together partners from 45 countries to create a grid strongly focused on interoperability and accessibility.Image courtesy of Jerry Newton Photography The Fermilab team, members of Open Science Grid, are demonstrating high bandwidth Tier-1 to Tier-2 LHC data transmission. The OSG duck can be found on OSG member stands throughout the exhibition.Image courtesy of John Urish Projects including AstroGrid, OMII, National Grid Service, NaCTeM, the London e-Science Centre and GridPP are highl

November 14, 2007

Links of the week - The latest on the Large Hadron Collider The LHC project is the first large-scale scientific endeavor to depend on the success of grid computing for its own success. Screen shot courtesy of US/LHC The latest on the Large Hadron Collider—which is set to become the world’s most powerful particle accelerator when it starts up in 2008—is increasingly available in living rooms around the planet.LHC news, updates and resources are now available from an international trio of Web sites produced by CERN, the UK and the most recent, released last month by the U.S.You can also track the progress of the project using LHC milestones. Coming to proton-crunch time For more than a decade, an international team of thousands of scientists, engineers, technicians and students has been designing, constructing and assembling the 27-kilometer-long LHC and the four huge experiments it will host. Alongside this effort, a slightly smaller, but no less dedicated, team of computer scientists and computing-savvy phy

November 14, 2007

  Opinion - Celebrating one year of International Science Grid This Week iSGTW celebrates one year of reporting on grid computing initiatives across the globe. In the last six months, visits to the iSGTW Web site have increased almost six-fold and are continuing to rise. Images courtesy of iSGTWThis issue, International Science Grid This Week celebrates its first anniversary. Since our launch last year, interest in grids, cyberinfrastructure and distributed computing has skyrocketed. As one indicator, visits to the iSGTW.org site have increased almost six-fold over the last six months. The number of scientists using grid computing is also increasing, as is the level of resources now available to them.In the last year, the number of jobs run on the UK’s GridPP has more than doubled to approach one million jobs during October 2007. Altogether, in the last twelve months GridPP computers have run the equivalent of 26 million normalized CPU hours.The Open Science Grid e-infrastructure is now averaging 80,000 jobs a day&md

November 14, 2007

  Opinion - Me, my friends, our grid: bringing people together for great science “The biggest challenges in grid technology are not technological; they’re social. Building new communities is as important as building new computer centers.” Image courtesy of Graham Ramsay Frank Würthwein is a particle physicist with University of California San Diego and a user of Open Science Grid. He is also the OSG applications coordinator and a member of the CMS collaboration at the Large Hadron Collider, and says grids are as much about sociology as they are about science.As the clock ticks towards startup for the Large Hadron Collider, particle physics draws ever closer to what many hope will be a revolution for the field: a giant step forward in our understanding of the universe.For many physicists, the greatest fear is that we will find the Higgs Boson, and that in the wake of this success, nothing will change. More exciting, more fascinating, is the possibility that finding the Higgs will bring with it a new pa

November 7, 2007

Announcement - OSG site administrators to discuss deployment of OSG 0.8.0 Fermilab, or the Fermi National Accelerator Laboratory, is a member of the OSG consortium and the venue for the December site administrators meeting.Image courtesy of FermilabOpen Science Grid site adminstrators will be meeting 12 and 13 December at Fermilab, Illinois, to discuss deployment of OSG 0.8.0 as well as to exchange experiences and challenges and plan for the second year of Open Science Grid.The program includes presentations from Rob Gardner of the University of Chicago, Tod Tanenbaum from the University of Wisconsin, Chris Green from Fermilab and Rob Quick from Indiana University.Anyone interested in deploying the OSG software or providing processing or storage resources for the OSG are welcomed to attend the meeting. Please contact OSG for more information. 

November 7, 2007

  Feature - Distributed security: keeping Open Science Grid closed to intruders “A feeling of false safety is much more dangerous than always being on our toes.” Head of OSG Security Mine Altunay says constant vigilance is essential.Images courtesy of Marcos Papapopolus One of the most essential parts of operating the Open Science Grid is keeping it closed. Closed to malicious intruders. And protected from inadvertent as well as malevolent attack.Head of OSG Security, Mine Altunay, says she’d always prefer to be safe than sorry.“A feeling of false safety is much more dangerous than always being on our toes,” Altunay says. “So far we’ve never had an incident that has prevented us from running, but this doesn’t mean we don’t have vulnerabilities. We are constantly thinking of our response to potential incidents: Will our communications channels be open? Is our technical knowledge up to date? Will everybody know what to do?”Aiming for automationAltunay’s team are

October 31, 2007

  Feature - Grids work like a CHARMM for molecular dynamics X-ray crystallography at room temperature revealed only one water molecule (shown as a red sphere) near the protein residue of interest (shown in the box). The protein is a variant of staphylococcal nuclease. Images courtesy of Johns Hopkins University In 1963, Richard Feynman said that “everything that living things do can be understood in terms of the jiggling and wiggling of atoms.” (1)  Molecular dynamics aims to better understand these jiggles and wiggles, using numerical methods to simulate the ways in which atoms and molecules move. One tool facilitating this work is CHARMM—or Chemistry at HARvard Macromolecular Mechanics—a software application developed at Harvard University for modeling the structure and behavior of molecular systems.CHARMM has multiple applications, but for Ana Damjanovic of the National Institutes of Health and Johns Hopkins University in Baltimore, Maryland, U.S., molecular dynamics simulations are the name o

October 17, 2007

  Feature - Open Grid Forum maintains focus on the 2010 goal Grids are about scaling IT, and community organizations such as Open Grid Forum are essential to guiding and managing this growth process, says John Ehrig, Open Grid Forum enterprise and marketing program manager.Images courtesy of Open Grid Forum Now involving more than 300 organizations from 50 countries, the Open Grid Forum community has gathered at this week's OGF21 to continue progress towards grids standards development. Open Grid Forum Enterprise and Marketing Program Manager, John Ehrig, explains the goals and progress of this community-initiated not-for-profit organization.Driven by accelerating globalization, organizations and individuals are being challenged to work in new ways—often across departments, disciplines and large geographical areas. Technology silos that inhibit the flow of information, innovation and commerce are being broken apart and rebuilt to better serve this new business paradigm. Grid and grid-like technologies—including

October 3, 2007

  Feature - Keeping up with Moore’s Law The NanoWire user interface.Image courtesy of nanoHUB Silicon nanowire transistors are promising devices for future integrated circuits. Researchers in this field are interested in geometries and properties of materials that vary on an atomic length scale; they study quantum states and the relationship between voltages and currents at these scales.  But not all nano-device engineers are nuts for computers. Many prefer to let other people worry about the computational end of things. Since this research depends heavily on simulations of nano-device behavior under varying conditions, the door is wide open for the development of accessible and intuitive computational tools.Enter Gerhard Klimeck of Purdue University, technical director of the National Science Foundation Network for Computational Nanotechnology. Klimeck and his colleagues have developed the user-friendly NanoWire computational tool, accessible via the web-based nanoHUB.  On nanoHUB, researchers set up a NanoW

October 3, 2007

Learn: Choose and start to use your grid

A few of the many grid projects available.Image courtesy of NorduGrid and Vicky White

Grid technology continues to improve and new grids and grid projects are appearing across the planet. From campus grids to massive international projects, opportunities to get involved with grids and e-science are growing.
But how do you get started? What jobs do the different grids support? Who can join? Will you need a computing degree to work it all out?
This article provides a quick snapshot of four very different grid infrastructures—Enabling Grids for E-sciencE, Open Science Grid, GridPP and TeraGrid—and provides an overview of what they’re doing and how you can get involved.
Enabling Grids for E-sciencE
Open Science Grid
GridPP
TeraGrid
 
Enabling Grids for E-SciencE
What do you do?
The Enabling Grids for E-sciencE project provides scientists and engineers from 48 countries with a seamless grid infrastructure for e-sc

September 19, 2007

  Feature - ATLAS: the data chain works Tracks recorded in the muon chambers of the ATLAS detector can now be expressed to physicists all over the world, enabling simultaneous analysis at sites across the globe. The European and U.S. sites are connected via the Enabling Grids for E-sciencE and Open Science Grid infrastructures.Image courtesy of ATLAS This month particle physics experiment ATLAS went “end-to-end” for the first time. Buried in Switzerland, 90 meters under the ground at the base of the French Jura mountains, ATLAS (A Torroidal LHC ApparatuS) is one of four high energy physics experiments attached to the Large Hadron Collider, a 27-kilometer particle accelerator nearing the final stages of completion.When the LHC is turned on, physicists worldwide will be waiting by their computers. They’ll be expecting express and non-stop delivery of massive amounts of data, streamed in a virtually seamless sequence direct to their doorstep.And this month, for the first time, ATLAS proved that this data dist

September 12, 2007

Feature - Six petabytes: Fermilab hits new record The volume of data sent from the Tier-1 Fermilab computing center to Tier-2 sites continues to increase. The sites form part of the international grid being constructed in readiness for the start-up of the Large Hadron Collider.Image courtesy of FermilabThe U.S. national accelerator laboratory Fermilab recently reached a record six petabytes—six million gigabytes—of data permanently recorded on tape, while data sent from the lab exceeded two petabytes, more than double the amount leaving the lab three months earlier.“Our traffic has been growing in terms of the amount of bytes we move onto the site as the Large Hadron Collider and Compact Muon Solenoid experiments ramp up,” said Matt Crawford, the department head for Data Movement and Storage in Fermilab’s Computing Division.Prior to a year ago, traffic never exceeded a fourth of a petabyte in a month, Crawford said. He attributes the increase in both outgoing and incoming data to CMS, DZero and Collid

August 29, 2007

  Feature - Joining the dots: creating interoperable grids Interoperability is now making grids bigger and more able than ever before.Images courtesy of OSG (top) and Marijke Unger (bottom)Pooling computers into grids is enabling scientific discoveries that would not otherwise be possible. Always looking to the future, grid developers are now asking: is there a compelling case for connecting these grids together?As grid usage grows and more researchers discover grid power, many predict that scientific appetite for this power will also grow. Already satisfying large appetites as individual ventures, two U.S.-based grids—Open Science Grid and TeraGrid—agree that interoperability between their infrastructures is the next step.The interoperative idealTo a scientist, grid interoperability should mean nothing beyond reliable and continuous access to highly responsive computing and data storage resources. These resources, provided by one or any number of computing grids, could ideally respond interchangeably to user requ

August 22, 2007

Announcement - Jacquard, DaVinci and Bassi join Open Science Grid One of the NERSC clusters is named for Italian scientist Laura Bassi, who taught Newtonian physics for 28 years. Bassi was the first woman to officially teach at a college in Europe.  The National Energy Research Scientific Computing Center, part of the Open Science Grid, has announced the introduction of their Jacquard, DaVinci and Bassi clusters to the OSG infrastructure. The move marks a significant increase in the ability of OSG users to perform complex and high performance parallel processing, such as that required for interdependent rather than “embarrassingly parallel” problems.Traditionally OSG has been geared towards serial or distributed processing: applications that pose hundreds of variations of a similar problem, such as typical applications in high energy physics or bioinformatics.The NERSC clusters will enable complex or high performance parallel processing, such as that required for composite climate or flame simulations, as well as

August 22, 2007

  Feature - Many millions of manuscripts: data mining and digitized objects As this Computation Institute conference room wall suggests, pen and “paper” is still a popular way to record information. But, as is also suggested, digitization can offer much in the way of improving the accessibility and utility of written materials.Image courtesy of the Computation Institute. Just three years old, the Computation Institute’s Teraport has already consumed 2.5 million hours of computing time on more than 800,000 jobs.James Evans, Assistant Professor in Sociology at the University of Chicago, is a Teraport regular, routinely occupying up to 30 processors at a time for his work on citation network analysis.Multiplying resultsCrunching through hundreds of CPU hours, Evans identifies patterns of interaction between universities and the biotechnology industry, using Teraport to compare the citations of every article with those of every other article in his database—more than 25 million citations.In work that re

August 15, 2007

  Roaming mike - Voices from the OSG Great Plains Summer School Cristy Burne, iSGTW editorThree months in to the job and I still understood only a fraction of the three-letter acronyms required to have an ordinary conversation about grids. It was time for me to study up, and what better place than the University of Nebraska in Lincoln, Nebraska, home of the mighty Huskers and center of activity for this year’s Open Science Grid Great Plains Summer School.As a grid novice I found this school a real eye-opener. What an opportunity to learn and create: we had 40 enthused scientists and academics, an endless supply of hot coffee, and an intensive schedule of lectures and hands-on grid computing. Anything was possible.Three days later I am shattered, but come away knowing more about the guts of grid computing than I thought there was to know. How it all fits together and does what it does is a wonder to me, and a credit to everyone involved.But what did everyone else think? I was keen to find out... Ben Clifford, Grid Train

August 1, 2007

Link of the week - Open Science Grid: a collaborative approach Total jobs per Virtual Organization: Plot showing number of simultaneous jobs running on Open Science Grid computing facilities for a recent six–month period. Each color denotes jobs run by a distinct Virtual Organization.Image courtesy of Open Science Grid Open Science Grid: Building and Sustaining General Cyberinfrastructure Using a Collaborative Approach is a paper discussing the creation and operation of the Open Science Grid. Published in June in First Monday, it covers:An introduction to Open Science GridPractical lessons learned from operating a large cyberinfrastructureScalability, scalability, scalabilityChallenges faced by Open Science Grid“OSG’s experience broadly illustrates the breadth and scale of effort that a diverse, evolving collaboration must undertake in building and sustaining large–scale cyberinfrastructure serving multiple communities,” writes author Paul Avery, a professor at the University of Florida and resource m

August 1, 2007

  Technology - GridWay: interoperability without the headache The GridWay metascheduler can schedule jobs across several grids, including Open Science Grid, EGEE and TeraGrid.Image courtesy of GridWay What looks and feels like your Local Resource Management system, but lets you submit jobs to multiple heterogeneous grids? Sounds like the beginning of a bad joke or pipe dream? You might need to upgrade your metascheduler.So says Tino Vazquez Blanco, a grid technology engineer working on the GridWay metascheduler project.“GridWay allows you to do much more than your local LRM system. You can of course use GridWay to submit, monitor, and control your jobs; the added bonus is that you can do this across several different grids.”GridWay is a scheduler for other schedulers, Blanco explains. “It simulates a familiar environment, so it’s as if you’re working on a local cluster, but in fact you’re working across grids formed by heterogeneous clusters. You don’t need to worry about where the cl

July 4, 2007

  Feature - Summer of learning: what’s with all these grid schools? Grid summer schools are a catalyst for the creation of long-lasting international and inter-disciplinary networks. This image was taken at the Biomed GRID School, held 14-19 May 2007, in Varenna, Italy.Image courtesy of David FergussonIt’s that time of year again: the snow melts, the skies turn blue, and grid summer schools appear across the planet. David Fergusson is something of an old hand when it comes to grid education: he has organised and attended numerous training events, workshops and summer schools; managed the NA3 Training Activity as part of EGEE; and is currently the deputy director for Training Outreach and Education at the National e-Science Centre, Edinburgh, UK, as well as the Manager of ICEAGE, a project dedicated to advanced grid education events. Fergusson found time between summer schools to chat with EGEE’s Alison McCall.Alison McCall: Why hold grid summer schools?David Fergusson: Grid summer schools bring together expe

June 20, 2007

Announcement - Open Science Grid Users’ Meeting: 26 and 27 July An early morning view of Fermilab’s Wilson Hall from across Swan Lake.Image courtesy of Fermilab The Open Science Grid Users’ Meeting will be held at Fermilab, Batavia, U.S., on the 26th and 27th of July, 2007. The meeting is aimed at OSG users who: • are responsible for or develop applications that run on OSG;• are Virtual Organization managers or their delegates;• are involved in any aspect of VO-specific infrastructure for OSG use, for example: workflow, meta-scheduling or portal management.Also welcomed are prospective users of the OSG in any capacity, those interested in discussing grid-related issues and their solutions, and those who would like to hear about others’ issues and how they may have been solved.The emphasis in this meeting will be on sharing issues and ideas and discussing current and future needs across the users of and participants in OSG. The goal is to help each other and have ideas on how to help new entr

June 20, 2007

  Feature - Protein origami: function follows form One protein can fold in many ways. This computationally designed protein switches between a zinc finger structure and a coiled-coil structure, depending on its environment.Image courtesy of Kuhlman LaboratoryScientists in the Kuhlman Laboratory at the University of North Carolina at Chapel Hill are using the Open Science Grid to perform protein origami. They’re running Rosetta: a powerful tool for predicting and designing the incredibly complex three-dimensional structures that proteins can adopt.Why does protein folding matter? If you change the way a protein is folded, you can change the way it functions, and can even stop it from functioning at all.Nature’s ultimate nano-machinesProteins are nature’s ultimate nano-machines, performing sophisticated functions on a scale much smaller than any machine we can construct.  They can speed up chemical reactions, turn chemical energy into mechanical force, regulate the way cells grow and divide, and even fo

June 6, 2007

  Feature - Indiana Universities Prepare for New Speed Record Indiana universities will soon be setting all new records for speed.Stock image from morguefile Many people associate Indiana with high-speed car racing. But universities in Indiana are working to build a new reputation: one for high-speed, high-throughput computing.As the world gears up for more speed records at the U.S. Formula 1 Grand Prix in Indianapolis this month, Indianan universities are gearing up to help create new records for handling data: they are part of an international collaboration preparing to manage the petabytes of data that will soon be generated by the largest physics experiment ever.The experiment has a name only a scientist could love: the CMS project, which stands for compact muon solenoid, a type of electromagnet. The CMS is currently being constructed at CERN, the European Organization for Nuclear Research. CERN is the Tier-0 site of the Worldwide LHC Computing Grid, from which all data produced by CMS will be distributed. This data will g

May 23, 2007

  Feature - DZero: Doing Double DutySummer 2006: A new layer of silicon detector is ready to fit in the center of the DZero detector.Image courtesy of Dmitri Densiov, FermilabOn the hunt for physics beyond the Standard Model, some DZero physicists search for traces of super-symmetry, lepto-quarks, quark substructure and other curiosities. Others continue to probe the Model, the theoretical backbone of modern high energy physics, by making ever more precise measurements. DZero, located at Fermi National Accelerator Laboratory, Illinois, U.S., is a “general-purpose high energy physics experiment.” As such, the DZero detector slices and dices a broad range of particles and phenomena that only Fermilab’s Tevatron, currently the world’s highest energy particle accelerator, can produce.Last summer the DZero detector was treated to a substantial upgrade, including the addition of new components. After any significant change to a detector, a precise calibration is required to properly quantify subsequent data.&n

May 9, 2007

  Feature - Midwest Grid WorkshopMidwest prarie outside Chicago, Illinois, U.S.Stock image from sxc.huAdjacent to the skyscrapers that make up the Chicago skyline and overlooking the “Little Italy” neighborhood, about 70 participants convened at the University of Illinois at Chicago March 24 and 25 for the Midwest Grid Workshop. Organized by Open Science Grid, TeraGrid and their partners, the attendees ranged from undergraduates with a passing knowledge of grid computing to professionals who already use a grid for science applications and are interested in using it in more powerful ways. Professor Muhammad Ali of Tuskegee University in rural Alabama, United States, came to the school with three goals: to learn about grid computing in general; to bring back information for science applications at the university that could benefit from grid technology; and to find out if students in his parallel processing course could run their lab exercises on the grid, so that Tuskegee wouldn’t need to maintain a local c