Share |

Content about EGEE

December 19, 2007

  Feature - Grids don’t take vacation A big thanks to those who are giving up their time over the end of year break to keep grids all over the world on-line.Image adapted from SouthPole.com While the rest of us are on vacation, enjoying a snowy (or scorching) end of year break, the grids we depend on keep crunching through jobs, sending a stream of data around the world. In fact, the end of year break sees many grid services working harder than ever. How does it happen? iSGTW took time off from our own hectic holiday schedule to see what goes on while the users’ away. Nicholas Thackray – CERN grid services Frank Würthwein – Open Science Grid applications coordinator Nicholas Thackray – CERN grid servicesOur users rely on continual service, even when they’re away on vacation. If this stops working we’re going to have a queue of people at the door, all wanting to beat us over the head with a stick. Previously things were so brand new that it was difficult to have an emergency prese

December 19, 2007

  Opinion - Five years on: the Asia Pacific in the global grid Author Simon Lin at the recent EGEE conference in Budapest Hungary. Image courtesy of TWGrid Around five years ago, we first began to realize that grid middleware and toolkits alone are insufficient to achieve the vision of grid computing. For success, we must focus on deployment, taking advantage of user needs—such as the needs of the high energy physics community and the Large Hadron Collider—to drive a production infrastructure. On 4 October 2002, the Grid Deployment Board of the Worldwide LHC Computing Grid held their first meeting in Milano, Italy. The meeting was chaired by Mirco Mazzucato and included 26 participants as well as WLCG project leader Les Robertson, computing coordinators from the four LHC experiments, and numerous country representatives. At this inaugural meeting, this group discussed the goal of providing a common production infrastructure on which to run experimental data challenges: the result was the LCG-1. The collaboration

December 12, 2007

Image of the week - DILIGENT crunches Flickr over EGEE The DILIGENT team used the EGEE computing grid to process 37 million images from the online Flickr database in just 16 weeks. Approximately 1,000 grid jobs were submitted per day, with each job processing around 1,000 images. Image courtesy of SAPIREver wished for a more reliable way of searching for images on the Web?  Grid-enabled digital library project DILIGENT has recently completed a data challenge on image feature extraction that has taken us one step closer to just that: next-generation image searching.Executed on the EGEE infrastructure, the recent DILIGENT challenge has created one of the world’s largest collections of multimedia metadata to be made publicly available for research purposes.37 million Flickr images in a flashThe DILIGENT team used the EGEE computing grid to process 37 million images from the online Flickr database in just 16 weeks. This computation generated approximately 112 million text and image objects—nearly 5 terabytes of

December 5, 2007

  Feature - The world’s climate data from a one-stop-shop In the recent report from the Intergovernmental Panel on Climate Change, data from various models and sources were combined to project the future climate. This image shows Scenario A1B: simulated mean temperature change relative to 1980-1999.Image © DKRZ / IPCC DDCHow can you study something as interconnected as climate without using interconnected models? This was one of the biggest questions facing Kerstin Ronneberger during her early research in earthsystem science modeling.When Ronneberger found an opportunity to get into grid computing, she was immediately interested. “I wanted to study the human influence on climate change,” she explains, “which involved coupling models of biosphere, economy and climate to get a consistent simulation of their dynamic interactions. Without access to grids the relevant data was often hard to obtain and even harder to combine”“In earthsystem science, everyone is using a different system to st

November 28, 2007

  Feature - Achieving interoperability between Shibboleth and gLite The Short Lived Credential Service allows users to access the grid with easy-to-use credentials.Image copyright Marcel Reich Grid security has long relied on public key infrastructure (PKI) technology, yet in recent years other security models have become widespread, most notably the concept of federated identity. Can these models achieve interoperability? Grid users are traditionally authenticated using X.509 certificates, which are issued by accredited Certification Authorities and are valid for one year. When interacting with grid services, these users typically present a short-lived proxy certificate, derived from this longer-lived X.509 certificate. In an environment based on federated identity, users identify themselves differently. This newer process comprises two clearly decoupled steps: authentication, which takes place at an Identity Provider; and authorization, which occurs at the Service Provider. Each Service Provider is free to decide whether to

November 28, 2007

  Feature - The path more travelled by: grids help track human migration Nicolas Ray uses Approximate Bayesian Computation—developed in 2002—to track the migration of humans through the centuries.Images courtesy of Rakesh Rampertab Today, families interested in an intercontinental move will probably go by plane, train or automobile. Several thousand years ago, adventurers had a harder time of it. Thanks to the plucky, pioneering efforts of early families, humans have managed to explore and settle every habitable region of the globe. Surviving the “bottlenecks” Two ancient migrations have particularly affected the shape of future generations: the “Out of Africa” event and the North to South colonization of the Americas. These migrations left traces in our genes still observable today. Described as “bottlenecks”—events where only a few individuals get through—the migrations may have caused a drastic reduction in population size and a corresponding drop

November 14, 2007

Announcement - International Science Grid This Week celebrates one year iSGTW continues to cover the truly international effort behind grid computing.Image courtesy of GridPP, OSG and EGEEOn 14 November 2007 International Science Grid This Week will celebrate its one-year anniversary. Now with more than 3400 subscribers, iSGTW attracted over 70,000 visitors during October, an almost six-fold increase over the last six months. A collaboration between Open Science Grid in the U.S. and Enabling Grids for E-sciencE in Europe, iSGTW promotes the success of grid computing as a tool for scientists and researchers.Able to complete in minutes what might take an average PC many months, grid computing offers scientists a new level of computing power, allowing them to delve deeper in to research questions with big answers. Grid computing works by coordinating the power of ordinary computing resources, linking this power into massive multifunctional computing “grids.”Scientists are using grid computing to fight disease, develop n

November 14, 2007

  Images of the week - Scenes from SC07 Pumping at the pinnacle of energy, innovation and computing power, SC07 is serving up the latest and greatest in IT to a record crowd this week in Reno, Nevada.Image courtesy of Douglas Mansell The Stony Brook University team are all smiles just prior to beginning their 44-hour race against the clock and five other undergraduate teams as part of the Cluster Challenge.Image courtesy of Douglas Mansell The Enabling Grids for E-sciencE stand showcases the achievements of EGEE, a project which brings together partners from 45 countries to create a grid strongly focused on interoperability and accessibility.Image courtesy of Jerry Newton Photography The Fermilab team, members of Open Science Grid, are demonstrating high bandwidth Tier-1 to Tier-2 LHC data transmission. The OSG duck can be found on OSG member stands throughout the exhibition.Image courtesy of John Urish Projects including AstroGrid, OMII, National Grid Service, NaCTeM, the London e-Science Centre and GridPP are highl

November 14, 2007

Links of the week - The latest on the Large Hadron Collider The LHC project is the first large-scale scientific endeavor to depend on the success of grid computing for its own success. Screen shot courtesy of US/LHC The latest on the Large Hadron Collider—which is set to become the world’s most powerful particle accelerator when it starts up in 2008—is increasingly available in living rooms around the planet.LHC news, updates and resources are now available from an international trio of Web sites produced by CERN, the UK and the most recent, released last month by the U.S.You can also track the progress of the project using LHC milestones. Coming to proton-crunch time For more than a decade, an international team of thousands of scientists, engineers, technicians and students has been designing, constructing and assembling the 27-kilometer-long LHC and the four huge experiments it will host. Alongside this effort, a slightly smaller, but no less dedicated, team of computer scientists and computing-savvy phy

November 14, 2007

  Opinion - Celebrating one year of International Science Grid This Week iSGTW celebrates one year of reporting on grid computing initiatives across the globe. In the last six months, visits to the iSGTW Web site have increased almost six-fold and are continuing to rise. Images courtesy of iSGTWThis issue, International Science Grid This Week celebrates its first anniversary. Since our launch last year, interest in grids, cyberinfrastructure and distributed computing has skyrocketed. As one indicator, visits to the iSGTW.org site have increased almost six-fold over the last six months. The number of scientists using grid computing is also increasing, as is the level of resources now available to them.In the last year, the number of jobs run on the UK’s GridPP has more than doubled to approach one million jobs during October 2007. Altogether, in the last twelve months GridPP computers have run the equivalent of 26 million normalized CPU hours.The Open Science Grid e-infrastructure is now averaging 80,000 jobs a day&md

November 14, 2007

  Opinion - Me, my friends, our grid: bringing people together for great science “The biggest challenges in grid technology are not technological; they’re social. Building new communities is as important as building new computer centers.” Image courtesy of Graham Ramsay Frank Würthwein is a particle physicist with University of California San Diego and a user of Open Science Grid. He is also the OSG applications coordinator and a member of the CMS collaboration at the Large Hadron Collider, and says grids are as much about sociology as they are about science.As the clock ticks towards startup for the Large Hadron Collider, particle physics draws ever closer to what many hope will be a revolution for the field: a giant step forward in our understanding of the universe.For many physicists, the greatest fear is that we will find the Higgs Boson, and that in the wake of this success, nothing will change. More exciting, more fascinating, is the possibility that finding the Higgs will bring with it a new pa

November 7, 2007

  Feature - “CIC-On-Duty”: smooth operations behind the scenes Hélène Cordier presents at the Regional Operations Center Managers’ Meeting during EGEE ’07, speaking on developments in “CIC on Duty” operations.Image courtesy of Toth Csilla  As a grid user, you want to send jobs to your grid, and you want results back. Hélène Cordier is one of the hidden coordinators working behind-the-scenes to ensure this happens as smoothly and as often as possible.An integral part of operations in the Enabling Grids for E-sciencE project, Cordier is deputy of the French Regional Operations Center and also deals with French operations for the Large Hadron Collider Computing Grid. “CIC-On-Duty” Cordier has been the driving force behind “CIC-On-Duty,” where CIC stands for Core Infrastructure Center. Dubbed COD, Cordier’s scheme helps ensure smooth operation of the EGEE grid. All EGEE federations contribute one COD team of two to three people.&

November 7, 2007

  Feature - I’m being shadowed: voices from the GAP Eleven female staff from CERN’s IT department were kept under close surveillance yesterday, shadowed by female students from a local high school as part of the Enabling Grids for E-sciencE project. The Shadowing Day aimed to inspire young women into careers in information technology by passing on the message that careers in science are open to both men and women, and can be rewarding and fun.The students were given a tour of physics experiment ATLAS and the CERN Computer Centre, as well as the opportunity for one-on-one interaction with CERN IT staff.  Traditionally, fewer women work in the IT sector; women currently represent 21% of EGEE staff. The Shadowing Day was held as part of the EGEE Gender Action Plan, reflecting a commitment to reducing this gender gap. Other initiatives include the adoption of best practices and equal opportunity policies for EGEE and collaborating projects.iSGTW headed to CERN to hear from those involved in the Shadowing Day

October 31, 2007

  Announcement - Call for abstracts: 3rd EGEE User Forum, Clermont-Ferrand, France The Enabling Grids for EsciencE (EGEE) grid infrastructure is now operated by more than 90 partners spanning 45 countries. Image courtesy of EGEE Authors are now invited to submit abstracts for the 3rd EGEE User Forum, to be held in Clermont-Ferrand, France on 11-14 February, 2008.Submitted abstracts should follow online guidelines and be submitted online. The deadline for abstract submission is 3 December 2007.Abstracts should address one of three general themes:scientific results produced with the help of grid technology, with emphasis on how grid technology enhanced the result,functional requirements for application porting and deployment, existing or prospective grid services, explaining the purpose, typical use cases and interactions with other grid services.Tutorials and TrainingsThose interested in organizing a tutorial or meeting in conjunction with the User Forum, should contact the Program and Local Organization Committee chairs. Tu

October 24, 2007

  Technology - “Grid in a Box” makes virtual grids a piece of cake Do you ever wish there was an easier solution to setting up a grid? Perhaps “grid in a box” could be your answer. Image copyright © 2000 George Eastman House Creating a cake became much easier in the late 40s when Betty Crocker released cake mix in a box.Do you ever wish there was an equivalent for computing grids? Now there is, almost. An approach known as “grid in a box” is making it possible to gather all the ingredients required to make grid computing more affordable and accessible for participating grid centers. “The idea of ‘grid in a box’ is to put all needed grid services on one piece of hardware,” says Oliver Oberst, Forschungszentrum Karlsruhe. “Instead of having several machines working together to host the infrastructure of a grid site, there are several virtual machines working on one computer—the ‘box.’” Traditionally, building a grid site with gLite&m

October 17, 2007

  Feature - Open Grid Forum maintains focus on the 2010 goal Grids are about scaling IT, and community organizations such as Open Grid Forum are essential to guiding and managing this growth process, says John Ehrig, Open Grid Forum enterprise and marketing program manager.Images courtesy of Open Grid Forum Now involving more than 300 organizations from 50 countries, the Open Grid Forum community has gathered at this week's OGF21 to continue progress towards grids standards development. Open Grid Forum Enterprise and Marketing Program Manager, John Ehrig, explains the goals and progress of this community-initiated not-for-profit organization.Driven by accelerating globalization, organizations and individuals are being challenged to work in new ways—often across departments, disciplines and large geographical areas. Technology silos that inhibit the flow of information, innovation and commerce are being broken apart and rebuilt to better serve this new business paradigm. Grid and grid-like technologies—including

October 10, 2007

  Announcement - EGEE announces dates for EGEE ’08 and calls for User Forum abstracts More than 600 delegates from 47 countries attended last week’s EGEE ’07 conference in Budapest, Hungary, taking the opportunity to forge new partnerships and strengthen existing relationships among the global grid community.Images courtesy of Toth Csilla The next Enabling Grids for E-sciencE conference—EGEE ’08—will be held in Istanbul, Turkey, from 22-26 September 2008.EGEE ’08 will be the seventh EGEE conference since the first phase of the project was launched in April 2004. The next EGEE User Forum will be held 11-14 February 2007 in Clermont Ferrand, France, and authors are now invited to submit abstracts.   

October 3, 2007

  Feature - EGEE ’07 stresses opportunities for cooperation, commercialization and continued innovation “In five years 80 percent of all scientific papers in all areas will be made in virtual laboratories. Fifty percent of social science documents will go the same way in five to ten years.” Ulf Dahlsten stressed the invaluable role of cyberinfrastructure in science.Images courtesy of Toth Csilla   This week’s EGEE ’07 conference is being held in the wake of a record-breaking quarter for the Enabling Grids for E-sciencE consortium, which has supported 100,000 jobs a day for the last three months using a grid infrastructure spanning 41,000 CPUs. Collaborators from 45 countries worked to achieve these results, combining the resources of 250 computing centers to create the EGEE grid. This kind of cooperation is the key to EGEE’s continued success, according to many of the conference’s plenary speakers.  “We cannot be good at everything,” said Ilona Vass, vice-president

October 3, 2007

Image of the week - European Grid Initiative steps out with EGEE crowd Delegates from the EGEE ’07 conference are enjoying a packed program of sessions covering grid operations, applications, security, interoperability, middleware and more. The European Grid Initiative Design Study workshop attracted many and marked a concrete step towards realization of the EGI project.Images courtesy of Toth Csilla This week’s EGEE ’07 conference attracted more than 600 delegates and it felt like most of them attended Tuesday’s workshop on the status of the European Grid Initiative. The room was bulging before the session had even started. When Dieter Kranzlmüller of Johannes Kepler University Linz, Austria, opened proceedings with an overview of the EGI Design Study (EGI_DS) project, he was speaking to an audience straining to see more.Vision for a pan-European grid infrastructureThis first EGI_DS workshop marked a very concrete step towards realization of the EGI project: an endeavor that has already garnered the

September 26, 2007

  Announcement - EGEE ’07 women’s networking lunch The global distribution of EGEE members as at the end of the fourth quarter of EGEE-II, July-September 2007. Males are represented in yellow; females in blue.Image courtesy of EGEE As part of EGEE ’07 , held in Budapest, Hungary, next week, the Enabling Grids for E-sciencE project will hold a women’s networking lunch on Thursday 4 October at 12:30pm. The lunch is an opportunity for women in science and in the grid community to network with other women. Places are limited so lunch will be on a first come first served basis. Attendees should follow signs from the main restaurant. For more information please contact the organizers. This event is being held as part of the EGEE Gender Action Plan, reflecting a commitment to reducing the gender gap in the scientific workplace. Other initiatives include the adoption of best practices and equal opportunity policies for EGEE and collaborating projects. EGEE ’07 begins on Monday; registration is ava

September 19, 2007

  Feature - ATLAS: the data chain works Tracks recorded in the muon chambers of the ATLAS detector can now be expressed to physicists all over the world, enabling simultaneous analysis at sites across the globe. The European and U.S. sites are connected via the Enabling Grids for E-sciencE and Open Science Grid infrastructures.Image courtesy of ATLAS This month particle physics experiment ATLAS went “end-to-end” for the first time. Buried in Switzerland, 90 meters under the ground at the base of the French Jura mountains, ATLAS (A Torroidal LHC ApparatuS) is one of four high energy physics experiments attached to the Large Hadron Collider, a 27-kilometer particle accelerator nearing the final stages of completion.When the LHC is turned on, physicists worldwide will be waiting by their computers. They’ll be expecting express and non-stop delivery of massive amounts of data, streamed in a virtually seamless sequence direct to their doorstep.And this month, for the first time, ATLAS proved that this data dist

September 12, 2007

Announcement - Grids and e-Science course: 24-28 September, Santander, Spain The port city of Santander is on the north coast of Spain.Image courtesy of Maria Victoria Gomez Fernandez Registration is now open for Grids and e-Science 2007, a course organized by the Spanish National Research Council and held from 24-28 September at Instituto de Física de Cantabria in Santander, Spain.The course program gives an overview of the current status of grid infrastructure and covers morning presentations and afternoon practical sessions. Monday and Tuesday’s programs deal with the use and deployment of e-infrastructures based on gLite and will cover an Enabling Grids for E-sciencE tutorial as well as developments related to Globus Toolkit 4. There will be speakers from IFCA, Rediris, Barcelona Supercomputer Center and University Complutense of Madrid. Wednesday will cover middleware with a focus on the problems of resource allocation, monitoring and general broking and scheduling on the grid. University of Barcelona develo

September 12, 2007

Announcement - Third EELA Conference: abstracts due 30 September The 3rd EELA Conference will be held at the University of Catania in Catania, Italy. Founded in 1434, the university  hosts more than 60,000 students.Image courtesy of EELA Authors are invited to submit abstracts on original work for inclusion in the 3rd EELA Conference, which will be held 3-5 December in Catania, Italy.The deadline for submissions is 30 September 2007.Topics of interest include work on grid communities and applications as well as case studies and development of e-infrastructures.The conference will present a selection of scientific results obtained in the last two years by EELA, Enabling Grids for E-scienceE and other related projects. The conference will also provide an outlook to the near future with special attention to the sustainability of regional e-infrastructures.The EELA Project (E-infrastructure shared between Europe and Latin America) is a European Commission initiative whose objective is to enhance the e-Infrastructures of Latin A

September 12, 2007

  Feature - ViroLab: a grid-based decision support system for HIV infections According to UNAIDS reports, 38.6 million people were living with HIV/AIDS in 2005, up from 36.2 million in 2003.Image courtesy of ViroLab Medical doctors and researchers have more information at their fingertips than ever before. They can now study diseases from the DNA level all the way up to medical responses, thanks to the increasing availability of genetic information, extensive patient records, and large, high quality clinical and pharmacological databases.  To coordinate this wealth of information medical doctors and researchers must have integrative technology that bridges existing gaps in multi-scale models, data fusion and cross-disciplinary collaboration. It is here that distributed computing—and grid technology in particular—can play a crucial role in helping researchers to understand the processes involved in new biomedical e-science, from bioinformatics to heath informatics.Virtualized tools; personalized treatment Vi

September 12, 2007

Image of the week - CERN’s PC grid goes TOP500 CERN’s computer cluster recently rated 115 in a list of the 500 most powerful computing systems in the world. It is the Tier-0 site for the Large Hadron Collider Computing Grid and consists of 340 servers with two Intel Xeon 5160 (Woodcrest) processors and a total of 1360 cores.Image courtesy of CERNCERN’s computer cluster consists of 340 servers with two Intel Xeon 5160 (Woodcrest) processors and a total of 1360 cores. The cluster recently made its first appearance on the prestigious TOP500 Supercomputing Sites, a sign that the processing power of the individual computing centers comprising grids is reaching levels comparable to top supercomputers.The CERN cluster is one of only a few commodity clusters in the most recent TOP500 list and ranked a respectable 115th in the world—not bad for a bunch of PCs! Significantly, CERN achieved this result using only about 20% of the computing power available in its computer centre, which in turn is only a fraction of the