Video of the week - Monitoring with the fishes
If the fish in this weekÂ’s video of the week look familiar, itÂ’s because iSGTW readers have seen them before, in the article entitled Â“Fish business.Â”
Â“They used Ganglia in order to get information about the cluster – the bigger the fish the more work that node was doing, and if it was dead or it was not reporting it would float to the top like a dead fish,Â” explained Derek Weitzel, a graduate student at the University of Nebraska, who is responsible for the last few editions of this open source program.
In the current version, if a fish is flashing, it means that the cluster that particular fish represents is overloaded, with 20 percent or more of total jobs waiting in queue. To find out more about that clusterÂ’s status, just click on its fish.
Upgrading the program to interact with Open Science Grid may have yielded other benefits.
Â“In order to use the Open Science Grid, it had to query out to an external script in order to get the information,Â” Weitzel explained. Â“And that can be expanded much further in order to query all types of different information.Â”
A web portal where visitors could watch a given gridÂ’s status would require a great deal of work, according to Weitzel, given that the current program is very platform dependent.
At first glance, the program may seem cute and frivolous. But the cluster-monitoring version runs around-the-clock at the Holland Computing Center.
Â“ItÂ’s a good way to look at, from a very high level, how the clusterÂ’s doing,Â” Weitzel said. Â“If the entire clusterÂ’s down and all your fish are floating at the top, you know somethingÂ’s wrong. If all of them are huge and flashing, you know somethingÂ’s wrong. So itÂ’s a good way to see how your entire clusterÂ’s doing at any one time at a very quick glance.Â”