[Bioclusters] download blast db with rsync in uncompressed format
Guy Coates
bioclusters@bioinformatics.org
Mon, 1 Dec 2003 17:28:41 +0000 (GMT)
> The problem is this one :
> in fact rsync can't be used at its "best performances" because the databases
> are already compressed. Thus the transmitted data to update a local version
> is very high and could be much lower if using rsync with uncompressed
> databases (by usind the rsync switch to compress data that is being
> transmitted).
One thing to be aware of is that many versions of rsync silently corrupt
files when doing incremental updates on Large Files (>2Gig), or when the
copy is being done cross architecture system.
I'd checksum your rsynced files with freshly downloaded ones until you
are happy it all works.
Cheers,
Guy Coates
--
Guy Coates, Informatics System Group
The Wellcome Trust Sanger Institute, Hinxton, Cambridge, CB10 1SA, UK
Tel: +44 (0)1223 834244 ex 7199