Automatically sync two Amazon S3 buckets, besides s3cmd?

后端 未结 4 1263
逝去的感伤
逝去的感伤 2021-02-09 05:48

Is there a another automated way of syncing two Amazon S3 bucket besides using s3cmd? Maybe Amazon has this as an option? The environment is linux, and every day I would like to

4条回答
  •  故里飘歌
    2021-02-09 06:15

    I'm looking for something similar and there are a few options:

    1. Commercial applications like: s3RSync. Additionally, CloudBerry for S3 provides Powershell extensions for Windows that you can use for scripting, but I know you're using *nix.
    2. AWS API + (Fav Language) + Cron. (hear me out). It would take a decently savvy person with no experience in AWS's libraries a short time to build something to copy and compare files (using the ETag feature of the s3 keys). Just providing a source/target bucket, creds, and iterating through keys and issuing the native "Copy" command in AWS. I used Java. If you use Python and Cron you could make short work of a useful tool.

    I'm still looking for something already built that's open source or free. But #2 is really not a terribly difficult task.

    EDIT: I came back to this post and realized nowadays Attunity CloudBeam is also a commercial solution many folks.

提交回复
热议问题