Snow Ball to Glacier
To move data from snow ball to S3 glacier, we have to first import to S3 first then move them with life cycle policy.
FSx
Fully managed service to launch 3rd party high performance file system on AWS.
FSx for windows
Has SSD and HDD storage options.
A fully managed windows file system share drive.
FSx Lustre
Use for high performance computing, machine learning.
Has SDD and HDD storage options.
Has Seamless integration with S3.
Can do both reading and writing back to S3 using FSx.
FSx Lustre lives in only one single AZ
Deployment Options
- Scratch file system
- Persistent file system
Scratch File Syste
Use for temporary storage service.
For short term processing, optimize cost
Persistent File System
Use for long term.
Data within same AZ.
Replace files within minutes.
Storage Gateway
Use for hybrid cloud storage, backup/restore and disaster recovery.
Types of Gateways:
- S3 Gateway
- Volume Gateway
- Tape Gateway
S3 Gateway
Uses https to transfer data.
Most recent used data is cached in the gateway.
Volume Gateway
Block storage using iSCSI protocol backed by S3.
S3 is backed by EBS.
Cached Volume: low latency access to recent data
Stored Volume: entire data set is on premises, schedule backup to S3.
Tape Gateway
Used for some service that are using physical tape for data storage.
Via Tape Gateway stored in the S3 then store and Tape Archive. Glacier & Glacier deep archive.
Transfer Family
Overview
Fully managed service for file transfers into and out of S3 and EFS via FTP protocol.
Supported Protocols
- FTP
- FTPS
- SFTP
Pay per provisioned endpoints and data transfer.
Data Sync
Move Large amount of data to and from
On-premises/other cloud to AWS - need agent
AWS to AWS - doesn't need agent
Can sync to S3, EFS, FSx.
Can Sync between S3, EFS and FSx too.
File Permissions and metadata are preserved