[Bioclusters] Best ways to tackle migration to dedicated cluster/Farm

[Malay]

Farul Mohd. Ghazali wrote:
> On Wed, 24 Mar 2004, Chris Dwan (CCGB) wrote:
> 
> 
>>>Also, our existing farm uses "node pull"...
>>
>>This is very cool.
>>
>>I've heard stories about folks with big clusters using a "pull" based
>>system like Condor to backfill empty cycles on their scheduled cluster.
> 
> 
> Excuse my ignorance, I've never used Condor but what's a pull based
> system? What would be the advantages over PBS/SGE (which I assume are push
> type systems)?
> 
> TIA
> 
> _______________________________________________
> Bioclusters maillist  -  Bioclusters@bioinformatics.org
> https://bioinformatics.org/mailman/listinfo/bioclusters

The present BLAST queing system in NCBI uses node pulling using MSSQL as 
database repository and a custom made daemon in each node to pull jobs 
from the database. The way it works seems node pulling is faster than 
using NFS. Most of the time NFS becomes a bottle-neck for distributing 
jobs. Node pulling really works great because of the database is highly 
efficient to serve request to large number of nodes.

Malay
mbasu(at)ncbi.nlm.nih.gov