[Bioclusters] Best ways to tackle migration to dedicated cluster/Farm

Malay bioclusters@bioinformatics.org
Thu, 25 Mar 2004 12:16:17 -0500

Farul Mohd. Ghazali wrote:
> On Wed, 24 Mar 2004, Chris Dwan (CCGB) wrote:
>>>Also, our existing farm uses "node pull"...
>>This is very cool.
>>I've heard stories about folks with big clusters using a "pull" based
>>system like Condor to backfill empty cycles on their scheduled cluster.
> Excuse my ignorance, I've never used Condor but what's a pull based
> system? What would be the advantages over PBS/SGE (which I assume are push
> type systems)?
> _______________________________________________
> Bioclusters maillist  -  Bioclusters@bioinformatics.org
> https://bioinformatics.org/mailman/listinfo/bioclusters

The present BLAST queing system in NCBI uses node pulling using MSSQL as 
database repository and a custom made daemon in each node to pull jobs 
from the database. The way it works seems node pulling is faster than 
using NFS. Most of the time NFS becomes a bottle-neck for distributing 
jobs. Node pulling really works great because of the database is highly 
efficient to serve request to large number of nodes.