ojob ojob.io/s3/syncBuckets sourceBucket=my-source-bucket targetBucket=my-target-bucket sourcePrefix=my-prefix/ targetPrefix=my-target-prefix/ sourceRegion=us-west-2 targetRegion=us-east-1 sourceURL=https://s3.us-west-2.amazonaws.com/my-source-bucket targetURL=https://s3.us-east-1.amazonaws.com/my-target-bucket sourceAccessKey=AKIAIOSFODNN7EXAMPLE sourceSecretKey=wJalrXUtnFEMI/K7MDENG/bQR9zv3rXU targetAccessKey=AKIAIOSFODNN7EXAMPLE targetSecretKey=wJalrXUtnFEMI/K7MDENG/bQR9zv3rXU dryRun=true useETag=true useModified=true noFinalList=true noS3Copy=true noDelete=true
Syncs a source S3 bucket with a target S3 bucket.
Name | Description |
---|---|
sourceBucket | The source S3 bucket to sync from. |
targetBucket | The target S3 bucket to sync to. |
sourcePrefix | The prefix in the source bucket to sync from. |
targetPrefix | The prefix in the target bucket to sync to. |
sourceRegion | The AWS region of the source bucket. |
targetRegion | The AWS region of the target bucket. |
sourceURL | The URL of the source S3 bucket. |
targetURL | The URL of the target S3 bucket. |
sourceAccessKey | The AWS access key for the source bucket. |
sourceSecretKey | The AWS secret key for the source bucket. |
targetAccessKey | The AWS access key for the target bucket. |
targetSecretKey | The AWS secret key for the target bucket. |
dryRun | If true, the job will only simulate the sync without making any changes (default is false). |
useETag | If true, the job will use ETag to determine if files need to be copied or overwritten (default is false). |
useModified | If true, the job will use last modified date to determine if files need to be copied or overwritten (default is false). |
noFinalList | If true, the job will not output the final list of items processed (default is false). |
noS3Copy | If true, the job will not perform any S3 copy operations and fallback for get/put operations (default is false). |
noDelete | If true, the job will not delete any objects in the target bucket (default is false). |