ojob.io/s3/syncBuckets

Usage

ojob ojob.io/s3/syncBuckets sourceBucket=my-source-bucket targetBucket=my-target-bucket sourcePrefix=my-prefix/ targetPrefix=my-target-prefix/ sourceRegion=us-west-2 targetRegion=us-east-1 sourceURL=https://s3.us-west-2.amazonaws.com/my-source-bucket targetURL=https://s3.us-east-1.amazonaws.com/my-target-bucket sourceAccessKey=AKIAIOSFODNN7EXAMPLE sourceSecretKey=wJalrXUtnFEMI/K7MDENG/bQR9zv3rXU targetAccessKey=AKIAIOSFODNN7EXAMPLE targetSecretKey=wJalrXUtnFEMI/K7MDENG/bQR9zv3rXU dryRun=true useETag=true useModified=true noFinalList=true noS3Copy=true noDelete=true 

Description

Syncs a source S3 bucket with a target S3 bucket.

Expects

Name Description
sourceBucket The source S3 bucket to sync from.
targetBucket The target S3 bucket to sync to.
sourcePrefix The prefix in the source bucket to sync from.
targetPrefix The prefix in the target bucket to sync to.
sourceRegion The AWS region of the source bucket.
targetRegion The AWS region of the target bucket.
sourceURL The URL of the source S3 bucket.
targetURL The URL of the target S3 bucket.
sourceAccessKey The AWS access key for the source bucket.
sourceSecretKey The AWS secret key for the source bucket.
targetAccessKey The AWS access key for the target bucket.
targetSecretKey The AWS secret key for the target bucket.
dryRun If true, the job will only simulate the sync without making any changes (default is false).
useETag If true, the job will use ETag to determine if files need to be copied or overwritten (default is false).
useModified If true, the job will use last modified date to determine if files need to be copied or overwritten (default is false).
noFinalList If true, the job will not output the final list of items processed (default is false).
noS3Copy If true, the job will not perform any S3 copy operations and fallback for get/put operations (default is false).
noDelete If true, the job will not delete any objects in the target bucket (default is false).