Share |

Content about Open Science Grid

December 15, 2010

A new grid application may help biologists solve the structures of mystery proteins.

August 25, 2010

Feature - OSG and TeraGrid join forces for ExTENCI

Image courtesy of Jayanta Behera.

Last week marked the kick-off for ExTENCI, the first major technical collaboration between TeraGrid and Open Science Grid.
“The idea is to have Open Science Grid and TeraGrid work together on a joint project as an experiment,” explained Paul Avery, the principle investigator for ExTENCI (which stands for Extending Science Through Enhanced National CyberInfrastructure). Although the two infrastructures have worked together to agree on principles and attend each others’ meetings, ExTENCI marks the first time that they will work together, sharing milestones and goals.
In order to make the partnership possible, the National Science Foundation’s Office of Cyberinfrastructure and Math and Physics Directorate each awarded ExTENCI approximately one million U.S. dollars over two years, for a grand total of just over two million U.S. dollars.
The limitations imposed by a small budget

August 18, 2010

Feature - OSG Summer School a success

The summer school in progress. Image courtesy of OSG.

Last month, Open Science Grid hosted its first summer school, and by all reports, it was a hit with both teachers and students.
“The OSG Summer School was a great experience,” said Vishagan Ratnaswamy, who will begin work on his doctorate in aeronautics this fall at Caltech. “I was able to learn more about the script files I was using as well as the systems I was running my simulations on.”
Before attending the summer school at the University of Wisconsin-Madison, Ratnaswamy was already an OSG user. But by attending, he said, he learned more about the available computational resources and the many ways in which grid computing can be applied to various types of research.
Ratnaswamy was one of 17 students chosen from a pool of 45 applicants to receive funding to attend the summer school, the TeraGrid ’10 conference, and next year’s OSG All-Hands Meeting. At

August 18, 2010

 

Link of the Week - TeraGrid ’10 Proceedings

People mingle as they browse the research projects on display at the TeraGrid ’10 poster session. Image courtesy of Miriam Boon, iSGTW.

Earlier this month, researchers and computer experts gathered in Pittsburgh for TeraGrid ’10, the annual conference organized and sponsored by TeraGrid.
Not everyone could attend, of course, so it’s a good thing that the proceedings are now available online at this week’s link of the week.
The conference included a wide variety of programming, including tracks dedicated to science, technology, science gateways, and EOT (education, outreach and training). A poster session and visualization showcase featured posters and visualizations related to computational biology, molecular dynamics, computational chemistry, signal processing, computer science, computational fluid dynamics, computational multi-body dynamics, computational materials (nano-composites), grid computing

July 21, 2010

Announcement - OSG Site Administrator's Workshop

The next OSG site administrator's workshop will be held at Vanderbilt University in Nashville, Tennessee 10-11 August.
The workshop will overlap with the CMS Tier 3 workshop, which takes place 11-12 August in the same location. The focus will be on upgrading OSG CE's and SE's with the OSG 1.2 production release. The focus is on practical, hands-on issues relating to OSG site administration.
Please visit the twiki page to see reference material and tutorials that will be used during the session.
Click here for the planning page on the Twiki. 

July 21, 2010

Announcement - OSG Storage Forum, 21-22 September

OSG Storage Forum will be held at the University of Chicago 21-22 September 2010.
Discussions will cover scalability, performance and tuning of the storage technologies adopted by T2 and T3 sites. We will also discuss analysis jobs storage requirements.
The storage software developers and expert storage administrators will be invited to share tips on how to improve stability and scalability of deployed storage systems. OSG storage administrators and representatives of various Virtual Organizations are encouraged to share their experiences and discuss common problems.
For more information, please visit the event’s Indico website.

May 26, 2010

Announcement - Applications for OSG HTC Summer School due

This photo shows the Madison skyline, where the summer school will take place.
Photo courtesy of Dori.

Applications are due 2 June for Open Science Grid’s new summer school on High Throughput Computing, taking place in Madison, Wisconsin, 19-22 July 2010.
Students will learn to use high-throughput computing systems - at their own campuses or using the national Open Science Grid - to run large-scale computing applications that are at the heart of today’s cutting-edge science. Through lectures, discussions, and lots of hands-on activities with experienced OSG staff, students will learn how HTC systems work, how to run and manage lots of jobs and huge datasets to implement a scientific computing workflow, and where to turn for more information and help.
The school is ideal for graduate students in computer science or other sciences where large-scale computing is a vital part of the research process, but any qualifi

May 26, 2010

Feature - New result could shed light on the existence of the Universe

The DZero collaboration has found evidence for a new effect which could explain the matter-antimatter asymmetry of nature. CP violations, such as this effect, are in disagreement with the predictions of the theoretical framework known as the Standard Model of particles and their interactions. The effect ultimately may help to explain why the universe is filled with matter while antimatter disappeared shortly after the Big Bang. Image courtesy of the DZero collaboration. 

The Big Bang should have created a universe with equal amounts of matter and anti-matter. Instead, we only see antiparticles when they are produced in nuclear reactions, cosmic rays, and particle colliders.
The dominance of matter that we observe in the universe is possible only if there is ‘CP violation’ – differences in the behavior of particles and antiparticles. Although physicists first observed certain forms of CP vio

May 19, 2010
Feature - Magellan explores scientific clouds - scientifically

Magellan explores scientific clouds – scientifically

The Magellan management and network control racks at NERSC. To test cloud computing for scientific capability, NERSC and the ALCF installed purpose-built test beds for running scientific applications on the IBM iDataplex cluster. Magellan systems at both NERSC and the ALCF will be built using QDR InfiniBand fabric. Image courtesy R. Kaltschmidt, LBNL

It’s clear that cloud computing is today’s hot computing buzzword. All the cool kids are doing it, and scientists are no exception. But how much do we really know about the intersection between science and cloud?
“Cloud computing has become a very exciting new field with several companies making offerings that are already being used by scientists around the world,” said Pete Beckman, director of Argonne Leadership Computing Facility and leader of the ALCF Magellan team. “The question the Department of Energy has is pretty straightforward: what kind

April 14, 2010

Research Report - Turning the microscope inwards: Studying scientific software ecosystems As an example, this slide displays the logos of all of the software in the Eclipse software ecosystem. Image courtesy of James Howison and James Herbsleb. Almost every workflow that generates scientific results today involves software: from configuration and control of instruments, to statistical analysis, simulation and visualization. This means that creating and maintaining software is a significant activity in scientific laboratories, including science and engineering virtual organizations. Our research group at Carnegie Mellon University is examining scientific software as an ecosystem, seeking to understand the circumstances in which software is created and shared. The goal of this Open Science Grid project is to identify effective practices and provide input to science funding policy. Towards this end, the OSG/CMU Scientific Software Ecosystem Workshop was held 16-17 February 2010 in Los

March 31, 2010

Campus grids secret to productive grid sites A picture of FermiGrid, the campus grid at Fermi National Accelerator Laboratory. Image courtesy of Fermilab Visual Media Services.Photo by Reidar Hahn. Fostering a local campus grid may be the secret to running a super-productive grid site, according to Rob Gardner, integration coordinator for Open Science Grid. “We noticed certain sites on Open Science Grid that were very productive relative to their peers,” Gardner said. “The common denominator was that they were accessing resources beyond the scope of their research domain by accessing resources on their campus.” That realization prompted OSG to look more deeply into existing campus grids. The idea, Gardner said, was to find out what the sites were doing right, and to learn from them in three key areas: job management, data management, and identity management. The ultimate goal? To arrive at a set of best practices for establishing and running campus grids.

March 31, 2010

Video of the week - Monitoring with the fishes

If the fish in this week’s video of the week look familiar, it’s because iSGTW readers have seen them before, in the article entitled “Fish business.”
But unlike earlier editions of the program, in which each fish represented a node in a cluster, this version monitors the whole of Open Science Grid.
“They used Ganglia in order to get information about the cluster – the bigger the fish the more work that node was doing, and if it was dead or it was not reporting it would float to the top like a dead fish,” explained Derek Weitzel, a graduate student at the University of Nebraska, who is responsible for the last few editions of this open source program.
In the current version, if a fish is flashing, it means that the cluster that particular fish represents is overloaded, with 20 percent or more of total jobs waiting in queue. To find out more about that clusterÂ’s status, just click on its fish.
Upgrading the program to interact wi

March 24, 2010

Feature - Q&A: Grid Colombia warms up

A group photo at an Open Science Grid-sponsored Grid Colombia workshop, which took place in October 2009. Image courtesy of Open Science Grid.

With a little help from colleagues at Open Science Grid and EGEE (via EELA-2), Colombia is on the cusp of launching its first national grid infrastructure. iSGTW caught up with Jose Caballero to learn more about the present and future of this promising project. Caballero currently does software development for ATLAS, and serves as the OSG liaison to South America. Previously, he spent five years working with the gLite grid software for the CMS experiment.
iSGTW: How did Grid Colombia get started?
Caballero: EELA-2 (E-science grid facility for Europe and Latin America) chose Colombia to host one of its main conferences in 2008, and that brought the worldwide grid movement to the attention of both academia and government in Colombia. After that, universities started to study the creation of a national

March 24, 2010

Video of the week - RHIC’s hot quark soup

Earlier this month, two separate groups of scientists at the Relativistic Heavy Ion Collider announced new results.
For the first result, scientists rolled back the clock to measure the temperature in the first instants of the formation of a quark-gluon plasma “soup.” They found that at that instant, the temperature is a whopping four trillion degrees. To put things in perspective, the temperature at the sun’s core is a mere 15 million degrees Kelvin, while the temperature at the core of a collapsed Type II supernova is only 100 billion degrees.
The second group of scientists discovered that, in the magnetic field induced by the accelerator’s colliding charged particles and the vortices that form in the resulting quark-gluon soup, positively charged quarks tend to move in one direction, and negatively charged quarks in the other. That makes it an example of asymmetry, an asymmetry that could give physicists clues as to

March 17, 2010

Feature - OSG All Hands Meeting

Attendees visited vendor tables to network and watch demonstrations at the first ever vendor and e-demonstration session to run at an OSG All Hands Meeting.
Image by Miriam Boon.

Last week, 183 researchers and vendors gathered at Fermilab in Batavia, Illinois for the Open Science Grid’s annual All Hands Meeting.
In addition to hosting workshops for CMS and ATLAS computing meetings, sessions covered a variety of topics, including security, virtualization, cloud computing, biology applications, reports from European colleagues, and the future of US cyberinfrastructure. This year also marked the first vendor and e-demonstration session.
Several people expressed pleasure at the dynamic discussions that occurred during the panel-style sessions, said Paul Avery, a researcher at the University of Florida and co-chair of the OSG Consortium Council. Kent Blackburn, Avery’s fellow co-chair and a researcher with LIGO Caltech, suggested that the inc

February 10, 2010

Bringing LHC data to US Tier-3s

Computer racks at the Fermilab Grid Computer Center. Image courtesy of Fermilab.

It’s a challenge for smaller research groups to get set up on a grid, but that’s exactly what physicists at over 40 sites across the United States need to do to get access to data from the Large Hadron Collider.
The new US Tier-3 centers – evenly split between the ATLAS and the Compact Muon Solenoid experiments – have each received about $30,000 in funding as part of the American Recovery and Reinvestment Act. Physicists scattered around the country will be able to use them to do their own analysis of data generated by two of the LHC experiments.
To get these sites online, a great deal of expertise will be needed. And that’s where the US LHC Tier-3 support group comes into the picture.
“What we are trying to do is to help them get their systems set up and connected to the grid, to make it easier for them to get access to data and addi

November 4, 2009

Feature - Getting GPUs on the grid

Russ Miller, principal investigator at CI Lab, stands in front of the server rack that holds Magic, a synchronous supercomputer that can achieve up to 50 Teraflops. Image courtesy of CI Lab.

Enhancing the performance of computer clusters and supercomputers using graphical processing units is all the rage. But what happens when you put these chips on a full-fledged grid?
Meet “Magic,” a supercomputing cluster based at the University of Buffalo’s CyberInfrastructure Laboratory (CI Lab). On the surface, Magic is like any other cluster of Dell nodes. “But then attached to each Dell node is an nVidia node, and each of these nVidia nodes have roughly 1000 graphical processing units,” said Russ Miller, the principal investigator for CI Lab. “Those GPUs are the same as the graphical processing unit in many laptops and desktops.”
That’s the charm of these chips: because they are mass-manufactured for use in your

October 21, 2009

Feature - Here to help: embedded cyberinfrastructure experts

It isn’t easy designing software that can run on a cluster like Fermilab's Grid Computing Center. That’s why advanced technical support is so essential. Photo by Reidar Hahn, Fermilab Visual Media Services.

Although much of today’s scientific research relies on advanced computing, for many researchers learning how to adapt and optimize applications to run on supercomputers, grids, clouds, or clusters can be daunting.
To help newcomers, many cyberinfrastructure providers offer in-depth support tailored to fit each user’s needs. This is much more than the typical technical support that helps users write scripts to enable their jobs to run. Instead, cyberinfrastructure experts are embedded directly into a user team to provide longer-term assistance.
One example is TeraGrid User Support and Services, led by director Sergiu Sanielevici.
“The designation of a supercomputer is that it’s basicall

September 23, 2009

Feature – New organization shakes up earthquake consortium

Earthquake engineers at University of Nevada, Reno test a 110-ft bridge model to failure. Image courtesy of Joan Dixon/University of Nevada, Reno.

We cannot stop earthquakes and tsunamis from happening. But with well-engineered buildings, we can prevent some of the death and damage these natural disasters leave in their wake.
First, however, engineers must understand how buildings react when shaken by earthquakes or pummeled by tsunami waves. To accomplish that goal, researchers use a combination of specialized equipment: giant tables that shake, wave tables filled with water, and high-end computing resources that can simulate just about anything.
To find out how sound a building will be during an earthquake, researchers can build a model on top of a large shake table. But most of the shake tables in the United States are not large enough to accommodate an entire building. Instead, they accommodate individual building com

September 16, 2009

Newsflash - Fall conference line-up

At the EGEE conference in Barcelona, attendees can take sessions on ‘Grids, new media and video’ and ‘From abstract to international news story.’ Image courtesy stock.xchng

The fall conference season will take iSGTW readers to the shores of the Mediterranean in Barcelona, the heights of the Canadian Rocky Mountains in Banff, and the banks of the Columbia River in Portland. Read on to find out more about some of the booths and workshops you’ll find at each conference!
Enabling Grids for E-sciencE ’0921-25 September, Barcelona, Spain
Next week (21-25 September), the bulk of the European grid community will gather in Barcelona for the final conference of Europe’s flagship computing grid project, EGEE.
“With the transition from EGEE to the new European Grid Initiative at the forefront of everyone's minds, this final EGEE conference will be the perfect time for members of the grid community to promote their wo

September 2, 2009

Feature – Superlinks to identify genetic culprits

A graphic map of a particularly complex family tree. The squares represent males, while the circles represent females. Individuals affected by a genetic mutation are represented with red squares or circles. Yellow lines indicate a marriage between relatives. Image courtesy of Kwanghyuk (Danny) Lee, Baylor College of Medicine.

Once scientists know which mutation causes a disease, they can apply that knowledge in their search for a cure. Likewise, doctors can recommend lifestyle changes that will alter the course of the disease. But the computer analysis used to identify these mutations would take years to complete on a single computer.
Superlink-online, a distributed system developed at the Technion-Israel Institute of Technology, helps researchers perform their analyses in a matter of days by distributing the computations over thousands of computers worldwide. Geneticists submit their data through the web portal with a single click

August 19, 2009

Feature – Grid helps to filter LIGO’s data

Workers at LIGO adjust the optic suspensions in situ. The suspension system is one of the physical measures LIGO takes to isolate the detector from false signals such as seismic activity. Courtesy of LIGO Lab.

Tiny ripples in the fabric of space-time may provide scientists with a way to study cosmic processes that are invisible to optical telescopes, such as the collision of two black holes.
In his theory of general relativity, Einstein predicted that such ripples, called gravitational waves, would be created when a mass accelerates. However, gravitational waves are so small – about one thousand times smaller than a proton – that even the relatively large ones generated by massive astrophysical events are very difficult to detect.
The Laser Interferometer Gravitational Wave Observatory (LIGO), which has sites in Washington and Louisiana, uses lasers to search for these minute cosmic ripples that carry information abou

June 10, 2009
Opinion - Grids, clouds and communities: an Open Grid Forum perspective

Opinion - Grids, clouds and communities: an Open Grid Forum perspective

Image courtesy BELIEF

(Editor’s note: Below, Open Grid Forum’s Paul Strong and Craig Lee give their view of the future of grids and clouds.)
OGF’s initial focus on grids has broadened over time, reflecting evolution in community needs and in technologies such as virtualization and cloud computing.
Grids have been widely adopted across academia and industry. Their evolution and deployment has been driven by several desires: to share data and computational resources, to get results faster, to improve efficiency and to collaborate.
Clouds are driven by different needs, primarily the desire for financial flexibility, offered by platforms such as “pay-per-use,” and business agility, such as reduced time to market and the ability to engage in fast, low-risk experimentation. The cloud model relies on the provider first achieving economies of scale, through sharing resources, and then offer

May 20, 2009

Feature - Identifying network bottlenecks Internet2 and the Open Science Grid have formed a partnership to deploy advanced network monitoring and diagnostic tools on the grid. Image courtesy of invoice-factoring.com.au. Network performance problems bedevil scientists and network operators alike.  Troubleshooting requires a multi-pronged approach, and problem resolution often drags – holding back scientific progress. To address this in the grid community, Internet2, the leading U.S. networking consortium in the research and education community, has formed a partnership with the Open Science Grid to deploy a set of advanced network monitoring and diagnostic tools on the grid.Network users and operators solve problems most quickly when given transparent access to the entire network path involved. Typically, however, separate organizations operate different segments along a full network path and each so-called “domain” controls access to its own diagnostic and p

April 15, 2009
Feature - PanDA lets scientists stay cool

Feature - PanDA makes huge job sets more bearable

Simplified view of core PanDA architecture. Click on image to see the complete diagram in a larger size. Image courtesy of BNL.

Keeping track of huge job sets processed on hundreds of compute clusters around the world through the LHC Computing Grid might send the most organized of logical thinkers into a tizzy. The PanDA (Production and Distributed Analysis) system, developed for the ATLAS collaboration at the Large Hadron Collider, lets scientists stay cool while it takes charge of distributing jobs, collecting results and managing workflow.An important feature of PanDA is that it allows the user to submit one job, called a pilot job, which coordinates a series of jobs that the user has put together and configured. When launched, the pilot job contacts the PanDA server, which in turn locates available resources and sends the collected jobs to run based on their relative priorities. The pilot system manages the workflow efficiently,