recipes that save time
Can be run from ` /n/app/bcbio/dev/anaconda/bin/aws or from /usr/bin/aws` on the O2 transfer nodes.
Setup your S3 bucket with:
foo/aws configure
You will need your
--dryrun to test a command| Problem | Unix rationale | AWS spell |
|---|---|---|
| copy files | cp * destination_dir |
aws s3 sync . s3://bucket/dir/ |
| get file sizes | ls -lh |
aws s3 ls --human-readable s3://bucket/dir/ |
| copy bam files | cp */*.bam /target_dir |
options order matters! aws s3 sync s3://bucket/dir/ . --exclude "*" --include "*.bam" |