Share |

Feature - The Large Hadron Collider

Feature - LHC open to all


An actual recorded event from the Compact Muon Solenoid experiment—this event shows radiation and charged particles spilling into the detector from the beam colliding with material in the beam pipe.

Image courtesy Carl Lundstedt

Occasionally, iSGTW runs across stories in other publications related to the fields we cover. Below is an excerpt from Linux Journal, containing one person’s view of the whole process.

One of the items at the heart of the Large Hadron Collider (LHC) experiments is open-source software. The following will provide a glimpse into how scientific computing embraces open-source software and its open-source philosophy.

The LHC at CERN near Geneva, Switzerland, is nearly 100 meters underground and produces the highest-energy subatomic particle beams on Earth. The Compact Muon Solenoid experiment is one of the many collider experiments within the LHC. One of its goals is to give physicists a window into the universe fractions of a second after the big bang.

The primary computing resource for CMS is located at CERN and is called Tier-0. Its function is to record data as it comes off the detector, archive and transfer it to Tier-1 facilities around the globe. Each Tier-1 facility is tasked with storing this data, as well as particle event reconstruction and analysis, and the transferring of data to secondary centers: Tier-2s.

The jobs

How does a physicist in Europe run a scientific job using data stored in Nebraska? With grid computing of course. Sites in Europe use the World LHC Computing Grid (WLHCG) software, while US sites use the Open Science Grid (OSG) to deploy jobs remotely.

OSG’s mission is to help enable sharing of computing resources. A Virtual Organization (VO) can participate in OSG by providing computing resources and simultaneously use computing resources provided by other VOs. An analogy of this relationship is SETI@home: what it does with people’s desktops, OSG does for research using university computing centers.

A week-by-week accounting of Open Science Grid usage by user VO for the past year. During the past year, OSG has provided 280 million hours of computing time to participating VOs. This image shows the breakdown of those hours by VO during the past year. Forty million of those hours were provided to VOs not associated with particle physics.  Image courtesy Open Science Grid

OSG provides centralized packaging and support for open-source grid middleware and gives administrators with easy installation of certificate authority credentials. Furthermore, OSG monitors sites and manages a ticketing system to alert administrators of problems.

Screens from left to right: Condor View of Jobs; PhEDEx Transfer quality; Hadoop Status Page; MyOSG Site Status; CMS Dashboard Job Status; Nagios Monitoring of Nebraska Cluster; CMS Event Display of November 7 Beam Scrape Event; OSG Resource Verification Monitoring of US CMS Tier-2 Sites HadoopViz Visualization of Packet Movement Image courtesy Carl Lundstedt

The data

Since data transfer and management is such a crucial element for CMS, developing the underlying system has been ongoing for years. The transfer volume of Monte Carlo samples and real physics data has already surpassed 54 petabytes (or 54,000 terabytes) worldwide. Nebraska alone has downloaded 900 terabytes during the past calendar year. All this data circulation has been done via commodity servers running open-source software.

Data movement is managed using a custom framework called PhEDEx (Physics Experiment Data Export). PhEDEx does not actually move data but serves as a mechanism to initiate transfers between sites. PhEDEx agents running at each site interface with database servers located at CERN to determine which data is needed at that site. X509 proxy certificates are used to authenticate transfers between gridftp doors at the source and destination sites.

However, the volume of material is huge: CMS generates more than one terabyte of data per day and each Tier-2 site stores hundreds of terabytes for analysis. This raises the question: How do you effectively store hundreds of terabytes and allow for analysis from grid-submitted jobs?

The answer, when CMS Tier 2s were created at Nebraska, was dCache, a distributed filesystem package written at Germany’s DESY high-energy physics experiment. It acts as a front end for large tape storage (for some applications, tape is still considered superior).

The CMS computing model; however, did not allow funding for large tape storage at Tier-2 sites. It was much cheaper to purchase hard drives and deploy them in worker nodes, than to buy large disk vaults. This means the real strength of dCache was not being exploited at Tier-2 sites.

This prompted Nebraska to look to open source for a solution: HDFS, a distributed filesystem provided by Hadoop — a software framework for distributed computing. HDFS allows easy use of available hard drive slots in computer worker nodes and at low cost.

A student at the University of Nebraska-Lincoln, Derek Weitzel, completed a student project that shows the real-time transfer of data in the HDFS system. Called HadoopViz, this visualization shows all packet transfers in the HDFS system as ‘raindrops’ arcing from one server to another.

The analysis

Once the data is stored at a Tier-2 site, physicists analyze it using the Linux platform. The Tier-2 at Nebraska runs CentOS as its primary platform.

With data files at about 2GB in size and data sets hovering in the low terabyte range, full data set analysis on a typical desktop is impractical. Once the coding and debugging phase is completed, the analysis is run over the entire data set at a Tier-2 site. Submitting an analysis to a grid computing site has been automated with software developed by CMS called CRAB (CMS Remote Analysis Builder).

How a physicist sees CMS—this is the event display of a single simulated event.  

Image courtesy Carl Lundstedt

The Grateful conclusion

The LHC will enable physicists to investigate the inner workings of the universe. The accelerator and experiments have been decades in design and construction and are now setting new benchmarks for energetic particle beams. Even if you don't know your quark from your meson, your contributions to open-source software are helping physicists at the LHC and around the world.

A version of this article first appeared in the November issue (#199) of Linux Journal. To see the full original article, click here.

—Carl Lundstedt, University of Nebraska Grid Computing Center, with edits by Miriam Boon

Your rating: None Average: 5 (1 vote)

Comments

The purpose is no other but

The purpose is no other but to let you know that when you have already had the hot tub, it is better for you to think about angry birds flash games

Trade to create product. It

Trade to create product. It is also a mass product. Then, the product sells commercially. Thanks!!!RushFit

collagen skin

I fit in with your conclusions and will thirstily look forward to your forthcoming updates. collagen for skin

Amazon.com

Hey, you used to write great, but the last few posts have been kinda boring… come on! Amazon.com

Business Development Strategy Template

Excellent Blog! I would like to thank for the efforts you have made in writing this post. I am hoping the same best work from you in the future as well. I wanted to thank you for this websites! Thanks for sharing. Great websites!
Business development strategy template

Hiya, I am really glad I've

Hiya, I am really glad I've found this info. Today bloggers publish just about gossips and net and this is really irritating. A good website with interesting content, this is what I needThank you for keeping this web site, I'll be visiting itDo you do newsletters? Can't find it.

Another interest entry Sekolah Belajar Forex FBS Indonesia also don't forget click interest article Konsumen Cerdas Paham Perlindungan Konsumen, also don't forget click interest article ESER Unlimited Power Bank also best Cipto Junaedy dan juga Cipto Junaedy also best article Iconia PC tablet dengan Windows 8 and also nulis that interesting. Thank you

Each & every tips of your

Each & every tips of your post are awesome. Thanks a lot for sharing. Keep blogging. crystal earbuds

your post is informative keep

your post is informative keep the good work mate pen tool Photoshop get free tutorials

jacket korea

Each & every tips of your post are awesome. Thanks a lot for sharing. Keep blogging.jacket korea

oakley sunglasses

Industry is among the trade to create product. It is also a mass product. Then, the product sells commercially. oakley sunglasses

Family Vacation Ideas

I like the way you described the topic with such clarity.Family Vacation Ideas

This is my first opportunity

This is my first opportunity to chat this website I found some entertaining things. and I will apply to the development of my blog.Chatrandom.com

laser hair removal reviews

I think I saw your article is very lucky. Continue, I will pay attention to your.laser hair removal reviews

I'll remember to bookmark it

I'll remember to bookmark it and keep returning to see additional of the helpful information . Kerudung Modis Produk Kecantikan Cetak Yasin Kado Unik

new benchmarks for energetic

new benchmarks for energetic particle beams. Even if you don't know your quark from your meson, your contributions to open-source software are helping physicists at the LHC and around the world. binary option

Bear Point Mitigation Bank

Bear Point Mitigation Bank Modern Warfare 2 is multiplayer is back, and truly better than ever. There's an overwhelming amount East Central Florida Mitigation Bank of content to experience, but with each mode being 100% standalone in nature, you're getting three completely different experiences all in one. That, however, also plays a huge factor into how your final opinion of Modern Warfare 2 as a whole turns out. First and foremost is the single-player experience. Tampa Bay Mitigation Bank This is only complemented further by the increased attention to sound design, with the effects of many like an action movie through and through, with the production values alone dating Infinity Ward's last game ,Fort Lauderdale CPA Call of Duty 4, quite a bit. At the same time, the single-player campaign has its issues. For starters, it's short. I've , actually having a thicker blood layer added to up the realism. There's been some discussion on whether the splatter is too distracting, and in my experience with the game it's far from an issue. You'll be able to take more hits on easier difficulty settings, so while a few well-placed shots will drop players on hardened or veteran modes the added splatter is an acceptable trade-off for more overall health Boca Raton Accountant As the anchor of the Call of Duty world, campaign mode is back, and it's intense. You'll instantly get a . , and the overall sense of action and chaos that comes with so many visual improvements. Lake Swamp Mitigation Bank

Bear Point Mitigation Bank

Bear Point Mitigation Bank Modern Warfare 2 is by far the least traditional of the series, with the core package broken up into three main pillars of gameplay. Single-player fans have their main campaign, if you're down for more co-op gameplay either locally or via online connection you've got the new Spec Ops mode, and Modern Warfare's groundbreaking multiplayer is back, and truly better than ever. There's an overwhelming amount East Central Florida Mitigation Bank of content to experience, but with each mode being 100% standalone in nature, you're getting three completely different experiences all in one. That, however, also plays a huge factor into how your final opinion of Modern Warfare 2 as a whole turns out. First and foremost is the single-player experience. As the anchor of the Call of Duty world, campaign mode is back, and Tampa Bay Mitigation Bank This is only complemented further by the increased attention to sound design, with the effects of many returning weapons being re-recorded,even more in-level chatter amongst your allies, and a truly captivating score by Hans Zimmer which builds based on specific in-game moments. Modern Warfare 2 feels like an action movie through and through, with the production values alone dating Infinity Ward's last game ,Fort Lauderdale CPA Call of Duty 4, quite a bit. At the same time, the single-player campaign has its issues. For starters, it's short. I've been playing Call of Duty 4 steadily since its release, and my first completion of the Modern Warfare 2 campaign came in at just under five hours on regular difficulty. Playing through on hardened will add another hour and a half onto that. Modern Warfare 2 is definitely more chaotic this time around – partially due to the new visual effects and upped production values – and with the improved enemy AI and tough scenario design you'll be fighting for every checkpoint. One of the larger visual changes to the game's heads-up display this time around is the blood splatter system. In previous Call of Duty offerings you'd get damaged, the screen would start to shade red, and you'd be required to seek cover before your vision returned to normal. Modern Warfare 2 employs a new system, actually having a thicker blood layer added to up the realism. There's been some discussion on whether the splatter is too distracting, and in my experience with the game it's far from an issue. You'll be able to take more hits on easier difficulty settings, so while a few well-placed shots will drop players on hardened or veteran modes the added splatter is an acceptable trade-off for more overall health Boca Raton Accountant

Bear Point Mitigation Bank

Bear Point Mitigation Bank Modern Warfare 2 is by far the least traditional of the series, with the core package broken up into three main pillars of gameplay. Single-player fans have their main campaign, if you're down for more co-op gameplay either locally or via online connection you've got the new Spec Ops mode, and Modern Warfare's groundbreaking multiplayer is back, and truly better than ever. There's an overwhelming amount East Central Florida Mitigation Bank of content to experience, but with each mode being 100% standalone in nature, you're getting three completely different experiences all in one. That, however, also plays a huge factor into how your final opinion of Modern Warfare 2 as a whole turns out. First and foremost is the single-player experience. As the anchor of the Call of Duty world, campaign mode is back, and Tampa Bay Mitigation Bank This is only complemented further by the increased attention to sound design, with the effects of many returning weapons being re-recorded,even more in-level chatter amongst your allies, and a truly captivating score by Hans Zimmer which builds based on specific in-game moments. Modern Warfare 2 feels like an action movie through and through, with the production values alone dating Infinity Ward's last game ,Fort Lauderdale CPA Call of Duty 4, quite a bit. At the same time, the single-player campaign has its issues. For starters, it's short. I've been playing Call of Duty 4 steadily since its release, and my first completion of the Modern Warfare 2 campaign came in at just under five hours on regular difficulty. Playing through on hardened will add another hour and a half onto that. Modern Warfare 2 is definitely more chaotic this time around – partially due to the new visual effects and upped production values – and with the improved enemy AI and tough scenario design you'll be fighting for every checkpoint. One of the larger visual changes to the game's heads-up display this time around is the blood splatter system. In previous Call of Duty offerings you'd get damaged, the screen would start to shade red, and you'd be required to seek cover before your vision returned to normal. Modern Warfare 2 employs a new system, actually having a thicker blood layer added to up the realism. There's been some discussion on whether the splatter is too distracting, and in my experience with the game it's far from an issue. You'll be able to take more hits on easier difficulty settings, so while a few well-placed shots will drop players on hardened or veteran modes the added splatter is an acceptable trade-off for more overall health Boca Raton Accountant

larger

Hot tub covers can be said to be one of many things that we can talk when we are talking about hot tub. Nowadays, people who decide to have hot tubs in their houses start to consider about the items called as hot tub covers too. Because of this fact, it can of course be concluded that those things surely have benefits that will be good not only for the hot tubs but also for people who own them. Here, we are going to talk about the benefits of hot tub covers in general. The purpose is no other but to let you know that when you have already had the hot tub, it is better for you to think about hot tub covers as well.

This is the perfect blog for

This is the perfect blog for anyone who wants to know about this topic. You definitely put a new spin on a subject thats been written about for years. Great stuff, just great! cufflink

apotek online

This is a great inspiring article.I am pretty much pleased with your good work.apotek online

Conan

I have bookmarked it and I am looking forward to reading new articles. Keep up the good work!Conan

Daley

I discovered your web site by accident, and I'm stunned why this accident didn't took place earlier! I bookmarked it. Daley

sbobet

I’ve read the topic with great interest and definitely will stick your blog routinely for other great postssbobet

sbobet casino

Stimulating me to read more of your articles.Keep up the good work hoping more excellent articles from you soon. sbobet casino

sbobet casino

I would like to thank you for the efforts you have made in writing this article. I am hoping the same best work from you in the future as well.sbobet casino

I did with Ezra's, once he or

I did with Ezra's, once he or she joins us in February, I think there will be lots of posts.xbox 360 repair service

Because of there team spirit

Because of there team spirit which make them to fight with other till the end of the game.Boca Raton Financial Advisor

Just a Thought

If a physicist in Europe can run a scientific job using data stored in Nebraska can they also use data stored in the Caribbean and create some much needed Caribbean Jobs

Your content is shows

Your content is shows potential, m gona add this to my bookmarks.
mesothelioma compensation

Wonderful blog and better

Wonderful blog and better artcle!
Thank you!

biblioteka

I see the greatest contents

I see the greatest contents on your blog and I absolutely love reading them.
letmewatchthis

I have just started

I have just started researching it on the internet and I found your post to be informative.backyardsgalore.com

Post new comment

By submitting this form, you accept the Mollom privacy policy.