AWS DataSync
AWS DataSync is a secure, online service that automates and accelerates moving data between on-premises storage and AWS Storage services. It simplifies migration planning and reduces expensive on-premises data movement costs with a fully managed service that seamlessly scales as data loads increase. DataSync can copy data between Network File System (NFS) shares, Server Message Block (SMB) shares, Hadoop Distributed File Systems (HDFS), self-managed object storage, AWS Snowcone, Amazon Simple Storage Service (Amazon S3) buckets, Amazon Elastic File System (Amazon EFS) file systems, Amazon FSx for Windows File Server file systems, Amazon FSx for Lustre file systems, Amazon FSx for OpenZFS file systems, and Amazon FSx for NetApp ONTAP file systems. It also supports moving data between other public clouds and AWS Storage services, enabling replication, archival, or sharing of application data easily. DataSync provides end-to-end security, including data encryption and data integrity.
Learn more
Media Shuttle
Signiant Media Shuttle is the easiest way to send and share any size file, anywhere fast. As a SaaS solution it is simple to deploy, manage and use and offers enterprise-grade capabilities to monitor and control all file transfer activity. Media Shuttle is used by more than 400,000 professionals worldwide moving petabytes of data for companies of all sizes.
- Patented file acceleration technology, up to 100x faster than FTP
- Checkpoint Restart to automatically resume any interrupted transfer
- Unlimited, brandable portals for all file sharing use cases
- Works with your on-premises storage and/or cloud storage
- Easy to set-up, administer and use. Up and running in a day
- Unrivaled customer support with a 95% NPS score to prove it
Learn more
Amazon FSx for Lustre
Amazon FSx for Lustre is a fully managed service that provides high-performance, scalable storage for compute-intensive workloads. Built on the open-source Lustre file system, it offers sub-millisecond latencies, up to hundreds of gigabytes per second of throughput, and millions of IOPS, making it ideal for applications such as machine learning, high-performance computing, video processing, and financial modeling. FSx for Lustre integrates seamlessly with Amazon S3, allowing you to link file systems to S3 buckets. This integration enables transparent access and processing of S3 data from a high-performance file system, with the ability to import and export data between FSx for Lustre and S3. The service supports multiple deployment options, including scratch file systems for temporary storage and persistent file systems for long-term storage, as well as SSD and HDD storage types to optimize cost and performance based on workload requirements.
Learn more
Amazon EC2 UltraClusters
Amazon EC2 UltraClusters enable you to scale to thousands of GPUs or purpose-built machine learning accelerators, such as AWS Trainium, providing on-demand access to supercomputing-class performance. They democratize supercomputing for ML, generative AI, and high-performance computing developers through a simple pay-as-you-go model without setup or maintenance costs. UltraClusters consist of thousands of accelerated EC2 instances co-located in a given AWS Availability Zone, interconnected using Elastic Fabric Adapter (EFA) networking in a petabit-scale nonblocking network. This architecture offers high-performance networking and access to Amazon FSx for Lustre, a fully managed shared storage built on a high-performance parallel file system, enabling rapid processing of massive datasets with sub-millisecond latencies. EC2 UltraClusters provide scale-out capabilities for distributed ML training and tightly coupled HPC workloads, reducing training times.
Learn more