[Bioclusters] Fwd: Re: [PBS-USERS] LSF vs its "Closest Competitor"
Ron Chen
bioclusters@bioinformatics.org
Sun, 18 May 2003 20:14:48 -0700 (PDT)
One correction: I submitted 100000 jobs to my test
cluster, and the size of the SGE scheduler is only
around 450MB, which is 4.5KB per job (down from 9KB I
mentioned in an earlier e-mail). This is far lower
than what Platform Computing claimed about its
"Closest Competitor".
Also, some comments from the PBS users list:
--- Harley Gorrell wrote:
> 460k jobs so far on a 120 cpu farm. There is
> room for
> improvement, but openpbs is hard to beat for the
> price.
>
> harley.
--- John Kochmar <kochmar@psc.edu> wrote:
========================================================
> > Performance, Scalability, Robustness
> >
> > LSF 5 Closest
> Competitor
> >
> > Clusters 100+ 1
> >
> > CPUs 200000+ 300
> >
> > Jobs 500000+ ~10000+
> > (active across clusters)
> >
> > Fairshare Utilization ~100% ~50%
> >
> > Query Time 20% better than 40%
> slower
> > LSF 4.2 than
> LSF 5
> >
> > Scheduler Usage 4K/job 28K/job
> >
>
========================================================
> >
> > I would love to hear from the people here, at
> least a
> > number of things above are not true.
>
> I'm not sure how to interpret these numbers, or who
> they define their
> "closest competitor" (PBSPro?), but we run OpenPBS
> on Lemieux (TCS-1),
> which has 3000+ cpus (we have live spares in the
> cluster, the scheduler
> adds those spare nodes when a compute node drops
> out) in 750+ compute
> nodes, and our utilization is regularly up around
> 85% (it would be
> better, but TCS-1 runs a smaller number of large
> jobs, so there are
> under-utilized nodes as a result of scheduling holes
> and machine drains
> -- when we've allowed smaller jobs w/out draining,
> we've seen
> utilization percentages in the high 90's.) The
> current PBS job id's are
> over 123,000, and again, this would be better if out
> users ran rafts of
> small jobs instead of large MPI jobs.
>
> As for how they came up with these numbers ... no
> clue. You'll have to
> ask them. I suspect it has to due with how they
> define "closest"
> competitor.
>
> J
>
> --
> John Kochmar <kochmar@psc.edu>
> Pittsburgh Supercomputing Center
>
__________________________________________________________________________
> To unsubscribe: email majordomo@OpenPBS.org with
> body "unsubscribe pbs-users"
> For message archives:
> http://www.OpenPBS.org/UserArea/pbs-users.html
> - - - - - - - - - -
> - - - -
> OpenPBS and the pbs-users mailing list are sponsored
> by Altair.
>
__________________________________________________________________________
__________________________________
Do you Yahoo!?
The New Yahoo! Search - Faster. Easier. Bingo.
http://search.yahoo.com