Share |

Content about Infrastructure

December 17, 2008

Acronym of the week - EUCALYPTUS: an open source cloud architecture Rich Wolski wrapping up his keynote address at eScience 2008.  Image courtesy of eScience 2008Elastic Utility Computing Architecture for Linking Your Programs To Useful Systems This mouthful-of-a-name came after the acronym, according to Rich Wolski, Professor in the Department of Computer Science at the University of California, Santa Barbara and lead developer of EUCALYPTUS (and coiner of the cleverly appropriate full name).Wolski covered clouds, grids and the EUCALYPTUS architecture in his dynamic and forward-thinking keynote address last week at the eScience 2008 conference in Indianapolis. Before starting EUCALYPTUS, he said, the team investigated both grids and clouds. These architectures share the metaphor in which users connect to an opaque resource that delivers computing and storage capability.  Grids use networks to link to distributed resources operated by independent institutions, and “glue” them together via middleware. Clouds

December 10, 2008

Feature - Massive new digital storage library for atmospheric research  The Nested Regional Climate Model is an initiative of the NCAR in collaboration with university, government and private-industry colleagues. With added support the NRCM will be able to simulate a variety of 21st-century climates, from which statistical portraits of the future atmosphere can be produced. The simulations can give a better idea of how and where weather patterns are likely to shift from decade to decade and how specific high-impact weather events, such as hurricanes, may change in frequency, intensity, size and rainfall. Images courtesy of UCAR;NASA-GSFC, NOAA GOES The National Center for Atmospheric Research (NCAR) recently installed a massive new digital storage library planned to hold nearly 30 petabytes of data— the equivalent of more than 6 million DVDs. The new system, AMSTAR (Augmentation of the Mass Storage Tape Archive Resources), will be one of the largest archives in the world dedicated to geoscience research, and will store

November 19, 2008

Announcement - Joint symposium BELIEF and 6CHOICE: Distance Learning as e-Infrastructure application Image courtesy of beliefproject.org  Symposium Dates: 28-29 January 2009Venue:  India Habitat Centre, New Delhi, IndiaEvent Web site  Cost: noneRegistration   Contact Important dates: 28 November 2008 - Abstract submission deadline5 December 2008 - Notification of acceptance/rejection16 December 2008 - Camera ready copy submission deadlineThe BELIEF and 6CHOICE consortia are organising a joint symposium, supported by the GLOBAL and 6DEPLOY projects. The event will provide a valuable platform to foster networking and support discussions on e-Infrastructure for Distance Learning which has become one of the top priorities not only of the Indian Government, but of the whole global Learning Society. The scope of the symposium is to understand, together with researchers, developers, users and policy makers, how European and Indian e-Infrastructure links can evolve.Representatives from the Secretary of State for Educat

November 5, 2008

Link of the week - We'll always have Paris: ESFRI meets grid Research Infrastructures are at the core of the knowledge triangle. From Hervé Pero′s presentation Utilizing the full potential of research infrastructures for strengthening the European Research Area (ERA). Image courtesy of H Pero Less intimate than Ilsa and Rick, close to 100 participants attended a Reflection Group (e-IRG) workshop in Paris on 21-22 October to discuss management of massive data sets, access for users to these data sets, and access to computing resources. Projects from ESFRI, the European strategy forum on research infrastructures, representing many scientific disciplines, are important potential grid users. This was the first event where the ESFRI and cyberinfrastructure (CI) worlds came together.  ESFRI, formed in 2002 at the behest of the European Council, works to strengthen the scientific integration of Europe and its international outreach.  ESFRI facilitates policy-making on research infrastructures, the faciliti

October 22, 2008

Announcement - PRACE hosts scientific workshop during ICT 2008 Image courtesy of PRACE  Scientific Computing in the Petascale Regime: a European HPC Infrastructure PRACE, the Partnership for Advanced Computing in Europe, is arranging a scientific computing workshop in Lyon on 26 November, to be held in parallel with ICT 2008.The themes of the scientific workshop are applications, architectures and training needs for petascale computing. Participants will receive first-hand information outlining the current status of the PRACE project, including its progress with hardware infrastructure, software applications and training.The workshop will include a networking session at ICT 2008, an evening session and dinner. This is a unique opportunity for additional information sharing and discussions.Both the networking session and the PRACE workshop are designed for European scientists who are likely to benefit from the use of a Europe-wide supercomputing infrastructure.Participation in the first PRACE scientific workshop and dinner is f

October 1, 2008

Announcement - OnTheMove federated conference, Mexico, 9-14 Nov Image courtesy of starlab.vub.ac.be  Dates: 9-14 November 2008Location: Monterrey, MexicoWeb page Registration OnTheMove (OTM) returns to the North American continent co-locating five related and complementary conferences: DOA: infrastructure, ODBASE: meaning of data, CoopIS: application in organizations, GADA: grid computing, high-performance and distributed applications, IS: information security. All five conferences share the scientific study of the distributed, conceptual and ubiquitous aspects of modern computing systems, and share the resulting application-pull created by the Web. For DOA'08, the primary emphasis will be on the distributed objects underlying the required archtitectures; ODBASE'08 concentrates on the knowledge bases and methods required for enabling semantical use; CoopIS'08 will report on the state of the art on interaction of such technology and methods within an enterprise or networked organization; and for GADA'08, the fo

October 1, 2008

Feature - We must not be afraid of the future: EGEE to EGI Time to turn off this road and transition to the next.Image courtesy of www.gerards.be. At last week’s Enabling Grids for E-sciencE (EGEE) conference in Istanbul, the audience received a piece of sound advice during the welcome address from the European Commission, eScience grids: Where does Europe stand?, delivered by Mário Campolargo:  “We must not be afraid of the future.” Within the European Grid Initiative (EGI), planning is underway for the implementation of a sustainable, pan-European grid infrastructure to support collaborative eScience. The building blocks of this infrastructure are national grid initiatives—autonomous, national grid bodies, able to mobilize their own national funding and computing resources and to support their own research communities. The projected transition of grids from the current short-term, project-based approach to a new long-term model will require significant reorganization for the grid community; EG

September 24, 2008

Feature - Office of Cyberinfrastructure at NSF: the first two years Daniel Atkins is a professor in the School of Information and the College of Engineering at the University of Michigan and Associate Vice President for Research Cyberinfrastructure.Image courtesy of Daniel Atkins. Cyberinfrastructure (CI) has become a vital tool for scientific research and discovery.  A system of distributed computing, storage, software and management using the network as its backplane, and for which the complexity is largely hidden from the user, CI has the potential for revolutionizing the way science and engineering research is conducted, says Daniel Atkins, former and initial director of the National Science Foundation’s  Office of Cyberinfrastructure.With an initial annual budget of $185 million, the office coordinates and supports the development of CI resources, tools, and services. In its conception, the office focused almost exclusively on high performance computing. Over the course of Atkins’ tenure, its vision bro

September 3, 2008
iSGTW Feature - Mega grid for mega science

Feature - Mega grid for mega science From left, Ian Foster, Carl Kesselman and Steve Tuecke who together created the Globus software for grid computing.Image courtesy of ANL. An editorial chronicling the development of grid computing and its relationship to the Large Hadron Collider, which originally appeared in the October 2006 print issue of R&D Magazine and ran again at rdmag.com last Friday (29 August), has been adapted and reprinted with permission. In 1995, Ian Foster at Argonne National Laboratory and the Univ. of Chicago, Ill., and Carl Kesselman in the Information Sciences Institute at the Univ. of Southern California, Los Angeles, known as the fathers of grid computing, looked at ways of using network technology to build very large, powerful systems, getting machines in different locations to work on parts of a problem and then combine for the result. Ultimately, these ideas together formed I-WAY, which enlisted high-speed networks to connect end resources at 17 sites across North America, marking the start of

August 20, 2008
iSGTW Feature - BNL takes a cue

Feature - BNL takes a cue from nuclear physics Deep in the bowels of Brookhaven's RACF. Image courtesy of BNL Even though real data from the Large Hadron Collider (LHC) has yet to touch the Grid, scientists at Brookhaven National Laboratory’s ATLAS Tier-1 center already have their hands dirty. Working on a daily basis with the Relativistic Heavy Ion Collider (RHIC) – a massive particle accelerator that smashes together beams of gold atoms to explore the complex world of nuclear physics – the almost 40 staff members at Brookhaven’s RHIC and ATLAS Computing Facility (RACF) are no strangers to storing and distributing large amounts of data. “The benefit of an integrated facility like this is the ability to move around highly skilled and experienced IT experts from one project to the other, depending on what’s needed at the moment,” said RACF Director Michael Ernst. “There are many different flavors of physics computing, but the requirements for these two facilities are very sim

August 13, 2008
iSGTW Feature - STAR of the show

Feature - STAR  of the show The world made smaller, with the help of a new Tier-2 site in Prague. Image courtesy of EPSRC Without the need to connect remotely to Brookhaven National Laboratory (BNL) from all the way across the world to get analysis data, collaborating scientists in Prague can now do their analysis at lightning speed, thanks to their new local Tier2 site. In an experiment called STAR, researchers aim to recreate the quark-gluon plasma (a soup-like state of the matter) that permeated the universe less than a second after the Big Bang. To do this, they analyze data from BNL’s high-energy heavy nuclei collisions. Before installation of the Tier2 site at the Nuclear Physics Institute of the Academy of Sciences of the Czech Republic (NPI ASCR) in Prague, STAR collaborators had to connect to BNL remotely each time they needed to retrieve analysis data, and network latencies made this a tedious task.For the Prague collaborators to analyze data more efficiently, the datasets from BNL needed to be brought onsite

August 6, 2008
iSGTW - Opinion: What clouds and grids can learn from each other

  Opinion - What clouds and grids can learn from each other Cloud computing adds an extra dimension of flexibility.Image courtesy of Ben Rhydding, sxc.hu  During the past 10 years, hundreds of grid projects have come and gone, passing away after funding ran dry. Most didn’t have a realistic strategy for sustainability, let alone a viable business model for their infrastructures, tools, applications or services. Often, the only asset left after the project’s end was the hands-on expertise gained by those involved, which is certainly valuable in the long run, but doesn’t justify the effort and funding. So far, in my opinion, grids didn’t keep up to their full promise.What went wrong?Sure, grids, by their very nature, are complex to design, build and maintain; and applications are cumbersome to run. It might take another 10 years of trial and error (and re-writing grid middleware?) to navigate the labyrinth of new technologies and paradigms, such as Utility Computing, Autonomic Co

July 9, 2008
iSGTW Feature - Taking the LEAD on adaptive weather forecasting

Feature - Taking the LEAD on adaptive weather forecasting A sample comparison of a LEAD forecast of radar reflectivity to the observed radar. Reflectivity is a measure of the radio energy scattered back to the radar by precipitation. Large raindrops and hail have high reflectivity whereas drizzle and snow have low. The graph displays decibel units, dBZ (factors of 10), of reflectivity. "WRF" refers to Weather Research and Forecasting, a numerical weather prediction system. Click to see a comparison of the LEAD forecasts from June 7, 2007 to the observed radar and the 4-km NMM Weather Research and Forecasting member from the ensemble (a collection of numerical forecasts with different parameter values that are valid at the same time for the same area). The forecasts were run on  the University of Indiana's Big Red TeraGrid resource. Image courtesy of LEAD. Watch LEAD's six and a half minute video, below, to learn how cyberinfrastructure helps meteorologists integrate signals from the atmosphere into simulati

June 25, 2008

Bonus Feature: Readers talk back about standards —Paul Strong, e-Bay “For all of us, standards are a means to an end: interoperability that enables integration, collaboration, choice of vendor products/components and reduced costs. As scientists, government bodies or businesses, all of us have slightly differing priorities, but ultimately we all need the benefits that standards bring. The real challenge is how to deliver relevant standards in a timely fashion. My belief is that community-driven standards are the way forward and that standards driven through implementation are the most likely to be successful for those of us driven by quarterly and yearly results. We need interoperability and we need it fast!” —Mario Campolargo, European Commission "The e-infrastructures initiative of the European Commission delivers cutting-edge ICT-based infrastructures and services to solve real-worldproblems. Already today, there are more than 300 different organizationsparticipating in the e-infr

June 25, 2008
iSGTW - Grid computing walks the standard line

Grid computing walks the standard line: thinking inside the box With many projects involved, truly seamlesss interoperability can be a challenge.Image courtesy of NorduGrid and Vicky White“Standard” is often equated with “average” or “boring.” How can you innovate or invent when you’re bound by standards and regulations? How can you push the boundaries when you’re stuck inside a box?Yet how can you create something on a grand scale—something that can slot into place with other grand things—unless you create something interoperable. Something . . . standard.In this special feature, former iSGTW editor (and now GridTalk editor) Cristy Burne reports on this easily overlooked aspect of grid computing. Why should we care? Standardizing grids: the current landscape Challenges for the future The way forward A standard in action: GridFTP A “de facto” standard: VOMSBONUS FEATURE: What does the grid community have to say about standards? (See what people from inst

May 21, 2008
iSGTW Feature - CMS data transfer

Feature - CMS readies network links for LHC data CMS data transfer rate in MB/s during the data transer debugging task, from September through November 2007.Image courtesy of CMS. Transfer 300 thousand million bytes (300 Gigabytes) per day for six out of seven consecutive days and move a total of 2.3 Terabytes during that same seven-day period—that’s 2.3 million million bytes—these are the criteria that each major network link in the Compact Muon Solenoid’s computing structure must satisfy when the Large Hadron Collider turns on this summer. Together they will transfer tens of Terabytes a day.The CMS computing structure comprises an internationally distributed system of services and resources that interact over the network through the Worldwide LHC Computing Grid (WLCG). The three-tiered architecture, fetchingly illustrated in a Flash animation from the GridCafe, functions as a single coherent system. Data collected at CERN, the top tier (dubbed Tier-0), is distributed to a set of seven

November 7, 2007

  Feature - “CIC-On-Duty”: smooth operations behind the scenes Hélène Cordier presents at the Regional Operations Center Managers’ Meeting during EGEE ’07, speaking on developments in “CIC on Duty” operations.Image courtesy of Toth Csilla  As a grid user, you want to send jobs to your grid, and you want results back. Hélène Cordier is one of the hidden coordinators working behind-the-scenes to ensure this happens as smoothly and as often as possible.An integral part of operations in the Enabling Grids for E-sciencE project, Cordier is deputy of the French Regional Operations Center and also deals with French operations for the Large Hadron Collider Computing Grid. “CIC-On-Duty” Cordier has been the driving force behind “CIC-On-Duty,” where CIC stands for Core Infrastructure Center. Dubbed COD, Cordier’s scheme helps ensure smooth operation of the EGEE grid. All EGEE federations contribute one COD team of two to three people.&

October 17, 2007

  iSGTW Announcement - UK National Grid Service Applications Repository released The National Grid Service Applications Repository is designed to help users already familiar with specific applications to get started using grid resources. This image was produced using the AMBER or Assisted Model Building with Energy Refinement application, which is featured in the NGS repository.Image courtesy of AMBER and Matt Lee The UK National Grid Service (NGS) recently released the NGS Applications Repository, a new and easy way to access NGS computing resources and installed applications. “We would like to open up the grid to a whole new community of users,” explains Dave Meredith, the lead developer. “Researchers who want to use the software they are familiar with can now use the portal to describe, publish and submit their job, without the need for middleware commands or grid knowledge.”The Repository offers users access to the expertise of domain-experts and resource providers. No certificate or account is req

October 17, 2007

  Link of the week - Visualizing the state of your grid with GridMaps The GridMap prototype show the status of different sites in the Worldwide Large Hadron Collider Computing Grid. Green indicates the site is “OK,” orange indicates degraded service and red indicates that the site is down. Image © CERN openlab/EDSWhich of your grid sites are operational at any instant?How much does each site contribute to which virtual organization?How can you have all this information and more at your fingertips?With GridMaps, a top-level grid services monitoring visualization produced as a collaboration, initiated by EDS Fellow Rolf Kubli, between CERN openlab and EDS undertaken within the Grid Deployment Group at CERN.“This style of data monitoring requires much less space than conventional tables or bar charts,” says EDS senior engineer Max Böhm, architect and developer of the GridMap prototype. “It also allows you to page quickly through different points or focus on different metrics to help di

October 3, 2007

Image of the week - European Grid Initiative steps out with EGEE crowd Delegates from the EGEE ’07 conference are enjoying a packed program of sessions covering grid operations, applications, security, interoperability, middleware and more. The European Grid Initiative Design Study workshop attracted many and marked a concrete step towards realization of the EGI project.Images courtesy of Toth Csilla This week’s EGEE ’07 conference attracted more than 600 delegates and it felt like most of them attended Tuesday’s workshop on the status of the European Grid Initiative. The room was bulging before the session had even started. When Dieter Kranzlmüller of Johannes Kepler University Linz, Austria, opened proceedings with an overview of the EGI Design Study (EGI_DS) project, he was speaking to an audience straining to see more.Vision for a pan-European grid infrastructureThis first EGI_DS workshop marked a very concrete step towards realization of the EGI project: an endeavor that has already garnered the

September 26, 2007

Link of the week - One-stop shop for WorldWideScience Representatives of the U.S. Department of Energy, the British Library and the International Council for Scientific and Technical Information were observers at a signing ceremony to partner on the development of WorldWideScience.org.Image courtesy of WorldWideScience.orgWorldWideScience.org is a global science gateway that allows users to search interconnected national and international scientific databases with the aim of accelerating scientific discovery and progress.WorldWideScience.org works by distributing a search query to its various constituent databases or portals. Each database independently ranks its own results and then returns these results to WWS.org, which then ranks these results again to ensure the patron sees only the most relevant of the aggregated results. Databases currently represented include:African Journals Online (South Africa)Article@INIST (France)Australian Antarctic Data Centre (Australia)Canada Institute for Scientific and Technical Information (Cana

September 19, 2007

  Feature - ATLAS: the data chain works Tracks recorded in the muon chambers of the ATLAS detector can now be expressed to physicists all over the world, enabling simultaneous analysis at sites across the globe. The European and U.S. sites are connected via the Enabling Grids for E-sciencE and Open Science Grid infrastructures.Image courtesy of ATLAS This month particle physics experiment ATLAS went “end-to-end” for the first time. Buried in Switzerland, 90 meters under the ground at the base of the French Jura mountains, ATLAS (A Torroidal LHC ApparatuS) is one of four high energy physics experiments attached to the Large Hadron Collider, a 27-kilometer particle accelerator nearing the final stages of completion.When the LHC is turned on, physicists worldwide will be waiting by their computers. They’ll be expecting express and non-stop delivery of massive amounts of data, streamed in a virtually seamless sequence direct to their doorstep.And this month, for the first time, ATLAS proved that this data dist

September 19, 2007

  Feature - Coming ready or not: will we be ready for the LHC? The GridPP team are assessing the readiness of clusters across the UK, including this cluster at Birmingham University, part of SouthGrid.Image courtesy of GridPP With the Large Hadron Collider starting up next year, grid sites worldwide are ramping up their equipment and service levels in preparation for an expected flood of data. But, will they be ready—and can any problems they’re having be fixed in time? GridPP tests its readinessIn the UK, a team from GridPP, the UK particle physics grid, has recently completed a round of visits to 17 GridPP sites, aiming to assess how ready they are for the onslaught of data that will mark the beginning of the Large Hadron Collider experiment. Dave Britton, GridPP’s Project Manager, coordinated the process. “We wanted to check that each site would be ready for next year, and find out how we could help with any difficulties. The best way to do this was to visit each site individually, so we could tal

September 12, 2007
iSGTW Announcement - CNRS launches Institut des Grilles

  Announcement - CNRS launches Institut des Grilles The new Institut des Grilles will federate CNRS work on production and research grid computing. Image courtesy of CNRS The French Centre National De La Recherche Scientifique (CNRS) has just announced the creation of a new Institut des Grilles (Grids Institute), which federates all CNRS actions concerning computing grids and distributed computing systems. More than 15 CNRS laboratories from four scientific departments and two national institutes are taking part in the new institute, which aims to consolidate the existing grid production infrastructures, to reinforce research in grid computing and to increase synergy between the various stakeholders.  

September 12, 2007

Announcement - Third EELA Conference: abstracts due 30 September The 3rd EELA Conference will be held at the University of Catania in Catania, Italy. Founded in 1434, the university  hosts more than 60,000 students.Image courtesy of EELA Authors are invited to submit abstracts on original work for inclusion in the 3rd EELA Conference, which will be held 3-5 December in Catania, Italy.The deadline for submissions is 30 September 2007.Topics of interest include work on grid communities and applications as well as case studies and development of e-infrastructures.The conference will present a selection of scientific results obtained in the last two years by EELA, Enabling Grids for E-scienceE and other related projects. The conference will also provide an outlook to the near future with special attention to the sustainability of regional e-infrastructures.The EELA Project (E-infrastructure shared between Europe and Latin America) is a European Commission initiative whose objective is to enhance the e-Infrastructures of Latin A