iSGTW Feature - Pegasus invites new communities to saddle up

Feature | September 19, 2007 | By Cristy Burne

Feature - Pegasus invites new communities to saddle up

This mosaic image of the Orion Nebula was created by Montage using Pegasus and DAGMan tools. Workflow softare Pegasus chains dependent tasks together, so that multiple tasks can be automatically completed in the correct order. Image courtesy of Pegasus

Grid workflow system Pegasus recently earned new wings with a share in a US$1.7 million grant from the U.S. Office of CyberInfrastructure, awarded over three years to make further improvements to Pegasus’ usability and breadth of support.

Pegasus’ principal investigator, Ewa Deelman from the University of Southern California’s Information Sciences Institute, says the grant has come at the perfect time.

“We’re now in a position to work with more communities and more users, including those using Open Science Grid and TeraGrid, to bring Pegasus technologies to their computing work.”

Pegasus allows researchers to translate complex computational tasks into workflows that link and manage ensembles of dependent tasks and related data files.

“Pegasus automatically chains dependent tasks together, so that a single scientist can complete complex computations that once required many different people,” explains Deelman. “It compiles not only software and data, but also the expertise of the people who developed the software.”

Deelman says the OCI grant will allow her team to introduce Pegasus with a host of new capacities.

“We’re planning to improve ease of deployment, introduce new debug capabilities, support richer workflow representations and enhance monitoring. We really want to work with new communities; we’re keen to get them started and help them benefit from this technology.”

Comparison of actual and simulated earthquake waves used by the Southern California Earthquake Center CyberShake workflows
Image courtesy of Robert Graves, SCEC

Efficient, hands-free workflow management

Pegasus takes a modular approach to workflow systems, working in partnership with workflow execution engine DAGMan, which was developed by the Condor team at the University of Wisconsin and shares in this month’s OCI grant.

The Pegasus/DAGman combination is already used in a variety of scientific applications, including gravitational-wave physics project LIGO, astronomy software Montage and applications at the Southern California Earthquake Center, and can scale to manage large numbers of tasks.

“Some workflows consume terabytes of data and can also produce terabytes of data,” says Deelman. “Some of the SCEC workflows have in the order of 100,000 tasks.”

Another bonus is that Pegasus cleans as it works.

“It minimizes its workflow storage requirements by cleaning up the data produced by the workflow as the computation progresses; it removes data that has already been processed to keep the workflow footprint as small as possible, which helps improve efficiency.”

“Pegasus can also cluster tasks in the workflow,” she adds. “This reduces waiting times, which can add up when you need to manage lots of smaller tasks. This can significantly improve efficiency when you’re dealing with workflows with hundreds of thousands of nodes.”

Deelman says she hopes to continue to leverage collaborations with science communities to advance the state of the art in workflow technology.

Pegasus and DAGMan were first developed under the National Science Foundation GriPhyN project.

- Cristy Burne, iSGTW

Comments

Add New Comment

by Anonymous | April 23, 2013 - 12:05am

It reduces its work-flow

It reduces its work-flow storage space specifications by cleaning up the information created by the work-flow as the calculations progresses; it eliminates information that has already been prepared to keep the work-flow impact as small as possible, which helps enhance efficiency.
Digital Marketing Agency

by Anonymous | April 22, 2013 - 5:30am

as

You put really helpful information. koltuk yıkama | kabin | su deposu | prefabrik |

by Anonymous | April 22, 2013 - 2:35am

Very good points you wrote

Very good points you wrote here..Great stuff...I think you've made some truly interesting points.Keep up the good work. globe load online

by Anonymous | April 21, 2013 - 10:19am

Taking advantage from this

Taking advantage from this resources I believe will really be a good read for visitors. Meanwhile, you have a very interesting blogging style anyway tennis blog news

by Anonymous | April 20, 2013 - 3:11am

I’m glad I found this

I’m glad I found this article. It has helped me a lot. Keep up the good work. band t-shirts

by Anonymous | April 22, 2013 - 1:05am

Montage (full name Montage

Montage (full name Montage Astronomical Image Mosaic Engine) is a software toolkit used in astronomy to assemble astronomical images in Flexible Image Transport System (FITS) format into composite images, called mosaics, that preserve the calibration and positional fidelity of the original input images.
Lloyd Irvin

by Anonymous | April 20, 2013 - 2:43am

I am glad to find your

I am glad to find your distinguished and stylished blogpost. rubber band powered car

by Anonymous | April 20, 2013 - 1:31am

I have lost all day searching

I have lost all day searching for some articles about this. I wish I knew of this site earlier, it was a fantastic read and really helped me out.
фотошоп скачать

by Anonymous | April 19, 2013 - 8:11pm

happy

including cell phone, tablet pc, watches for my friend, I have also bought some cosplay costumes for my kids. They like so much. Every time I bought a thing from this site, it will make me happy to make a great deal with this online shop.
gsm Phone

by Anonymous | April 18, 2013 - 7:29am

This is a good post. This

This is a good post. This post give truly quality information.I’m definitely going to look into it.Really very useful tips are provided here.thank you so much.Keep up the good works.High Pagerank Backlinks social bookmarking Video Submissions Link Wheel Article Writing german directory submission SEO Packages

by Anonymous | April 18, 2013 - 1:17am

exciting publish.

exciting publish. i have been thinking about this problem, so thanks for publishing. this weblog is give such excellent details to us.i really appreciate it.great publish.!
Banquetes

by Anonymous | April 16, 2013 - 5:47pm

Fantastic blog post. The post

Fantastic blog post. The post touches many urgent challenges in our society. It is impossible to be indifferent to these issues. Your post gives a lot of great information and inspiration. Very informative and practical. amlodipine

by Anonymous | April 16, 2013 - 5:44pm

This is quite fantastic post.

This is quite fantastic post. Your post touches many urgent problems in our society. We can not be indifferent to these challenges. Your post gives the light in which we are able to watch our real life. I appreciate the information and the effort you put into this article.
Albenza

by Anonymous | April 16, 2013 - 5:44pm

Excellent post. Your article

Excellent post. Your article affects a lot of urgent challenges in our society. We can not be uninvolved to these challenges. Your article gives the light in which we may observe the life. Very professional. norvasc

by Anonymous | April 16, 2013 - 5:39pm

Interesting article. Your

Interesting article. Your article touches many urgent problems in our minds. It is impossible to be indifferent to these challenges. This article gives good ideas and concepts. Very informative and practical. Albendazole

by Anonymous | April 13, 2013 - 5:11am

Thank you for the great

Thank you for the great article I did enjoyed reading it, I will be sure to bookmark your blog and definitely will come back from again.I want to encourage that you continue your great job, have a good day. SEO Los Angeles

by michaelje | April 12, 2013 - 4:38am

Century batteries this

Century batteries this website While we seldom think about the performance of our car battery when we get babul-ilm behind the wheel of the car we expect to go on our journey without any problems. Please keep in mind that negative cable should not be connected to the dead battery itself.

by Anonymous | April 12, 2013 - 12:14am

Interesting blog! Is your

Interesting blog! Is your theme custom made or did you download it from somewhere? A design like yours with a few simple tweeks would really make my blog jump out. Please let me know where you got your theme. Bless you. Call Girls

by Anonymous | April 11, 2013 - 10:03am

GriPhyn project

Was the GriPhyn project not something that was initially started in Australia - and more specificallyhere in Perth?

by Anonymous | April 10, 2013 - 6:06am

Thanks for making such a cool

Thanks for making such a cool post which is really very well written.will be referring a lot of friends about this.Keep blogging. ergebnisse-live

by Anonymous | April 9, 2013 - 10:47pm

A couple of papers

Thanks! Here are links to a couple of papers I found very interesting while writing the piece: windows 7 professional product key

by Anonymous | April 9, 2013 - 4:41am

nice blog.....

Thank you for presenting your points and providing this information. I have learned something about this topic.
Yoga Munich

by Anonymous | April 7, 2013 - 1:40pm

This is quite wonderful

This is quite wonderful article. The post affects a lot of urgent problems of our society. It is impossible to be uninvolved to these issues. Your post gives a lot of awesome information and inspiration. Keep it up.
http://webmedsdirect.com/

by Anonymous | April 7, 2013 - 1:39pm

Very interesting article.

Very interesting article. Your post touches a lot of urgent challenges of our society. We can not be untouched to these problems. Your post gives good ideas and concepts. I really enjoyed simply reading.
albendazole

by Anonymous | April 6, 2013 - 12:06am

Thank you for the great

by Anonymous | April 5, 2013 - 9:45am

yeni

Your article affects many urgent issues in our society. katalog and sandalye

by Anonymous | April 1, 2013 - 5:47am

yeni

Stimulating me to read more of your articles.
web tasarim

by Anonymous | March 31, 2013 - 10:39am

This is quite fantastic post.

This is quite fantastic post. Your post affects a lot of urgent issues of our society. We can not be uninvolved to these issues. This post gives good ideas and concepts. This is something that worth doing.
lamisil

by Anonymous | March 31, 2013 - 9:09am

Wonderful article. Your post

Wonderful article. Your post touches a lot of urgent problems of our minds. It is impossible to be uninvolved to these issues. Your post gives good ideas and concepts. This was very interesting to read.

norvasc 5

by Anonymous | March 29, 2013 - 9:17am