[BiO BB] Bioinformatics Benchmark System version 3 released

Joe Landman landman at scalableinformatics.com
Fri Aug 13 17:13:24 EDT 2004


Hi Martin:

  This is definitely in the works.  Should be ready shortly, and we will 
announce then.  Thanks!

Joe

On Fri, 13 Aug 2004 13:52:33 -0700, Martin Gollery wrote
> Thanks Joe. One addition that might be useful would be to have a space 
> where people could post their results, with complete information about 
> the system, of course. This would allow people to see how their system 
> compares to any other.
> 
> Marty
> 
> Joe Landman wrote:
> 
> > Version 3 of the Bioinformatics Benchmark System (BBS v3) has been 
> > released. Many new features, bug fixes, and suggested changes have been 
> > made. New benchmarks have been added and updated for mpiBLAST, HMMer, 
> > NCBI BLAST, and others in the baseline tests.  The version 1 tests are 
> > still there if you wish to run them.
> > 
> > The Bioinformatics Benchmark System is an attempt to build a flexible 
> > and power testing framework, and meaningful tests,  to enable end users 
> > and vendors to probe the performance of their systems.  As the most 
> > important benchmark is your benchmark, and not a pre-packaged benchmark, 
> > the system is specifically designed to allow you to easily modify or add 
> > new tests.
> > 
> > Moreover, the source to these tests are available under GPL, and are 
> > hosted on Bioinformatics.org (http://bioinformatics.org/bbs) and 
> > Scalable Informatics (http://www.scalableinformatics.com/BBS).
> > 
> > For those who wish to run their own tests by hand without any testing 
> > framework, the --dryrun switch will emit the final command line that 
> > would be run.
> > Additional documentation on the XML input format is forthcoming.  A 
> > submission system for results, and baseline curation and data set 
> > tagging will commence in short order.  Better handling of errors is in 
> > place, as are better IPC methods.
> > 
> > You can pull the binary tarball from 
> > http://downloads.scalableinformatics.com/downloads/bbs/bbsv3.tar.gz .  
> > Please note that this includes data for a rather large mpiBLAST job.  If 
> > someone has a sizeable cluster they are willing to play with, mpiBLAST 
> > installed and some time, we would like to see the speedup curve for 16 - 
> > 256 nodes (or higher).  We would be happy to help out with this.
> > 
> > Joe
> >
> 
> -- 
> Martin Gollery
> Associate Director
> Center For Bioinformatics
> University of Nevada at Reno
> Dept. of Biochemistry / MS330
> 775-784-7042
> -----------
> Marty's Law- the number of Bioinformatics acronyms will double every 
> 18 months. _______________________________________________ 
> BiO_Bulletin_Board maillist  -  BiO_Bulletin_Board at bioinformatics.org 
https://bioinformatics.org/mailman/listinfo/bio_bulletin_board


--
Joseph Landman, Ph.D
Scalable Informatics LLC,
email: landman at scalableinformatics.com
web  : http://scalableinformatics.com
phone: +1 734 612 4615




More information about the BBB mailing list