AWS DataSync
- Synchronise data, move a lot of data to and from
- From on-premises to cloud AWS (NFS, SMB, HDFS, S3, API) - Need agent
- AWS to AWS (different storage services) - No agent needed
- From on-premises to cloud AWS (NFS, SMB, HDFS, S3, API) - Need agent
- Can synchronise to
- S3 (any storage classes including Glacier)
- EFS
- FSx (Windows, Lustre, ...)
- Replication tasks can be scheduled hourly, daily, weekly
- File permissions and metadata are preserved (NFS POSIX, SMB)
- One agent task can use up 10Gbps, can setup bandwidth limit