A solutions architect needs to design a managed storage solution for a company's application that includes high-performance machine learning functionality. This application runs on AWS Fargate and the connected storage needs to have concurrent access to files and deliver high performance.
Which storage option should the solutions architect recommend?
The best storage option for an application running on AWS Fargate that requires high-performance machine learning functionality and concurrent access to files is Amazon Elastic File System (Amazon EFS). Amazon EFS is a fully managed, scalable, and highly available file storage service that supports concurrent access from multiple Fargate tasks, ensuring the necessary performance for machine learning workloads. Amazon FSx for Lustre is optimized for high-throughput workloads but is not supported with AWS Fargate, making it an unsuitable choice in this scenario. Amazon S3 and Amazon EBS do not provide the needed file system semantics and concurrent access capabilities.
answer is C
C Fargat not supported for luster plus "it must support concurrent file access and give good performance." it didn't say HPC
Fargate does not work with FSx for Lustre
Mounting FSx for Lustre on an AWS Fargate launch type isn't supported. https://docs.aws.amazon.com/fsx/latest/LustreGuide/mounting-ecs.html
Mounting FSx for Lustre on an AWS Fargate launch type isn't supported. aws document
Lustre support by ECS not Fargate Mentioning here: https://docs.aws.amazon.com/fsx/latest/LustreGuide/mounting-ecs.html#:~:text=Mounting%20FSx%20for%20Lustre%20on%20an%20AWS%20Fargate%20launch%20type%20isn%27t%20supported.
Who decides what the right answer is? I'm confused Most people write one answer but the correct answer looks different
Since AWS Fargate does not support Amazon FSx for Lustre file systems, the best option would be C. Create an Amazon Elastic File System (Amazon EFS) file share and establish an IAM role that allows Fargate to communicate with Amazon EFS.
Mounting FSx for Lustre on an AWS Fargate launch type isn't supported. https://docs.aws.amazon.com/fsx/latest/LustreGuide/mounting-ecs.html
FSx for Lustre makes it easy and cost-effective to launch and run the popular, high-performance Lustre file system. You use Lustre for workloads where speed matters, such as machine learning, high performance computing (HPC), video processing, and financial modeling.
C is the answer
here is the note from aws: Note Mounting FSx for Lustre on an AWS Fargate launch type isn't supported.
CHATGPT ALSO AGREES WITH C To design a managed storage solution for the company's application that includes high-performance machine learning functionality running on AWS Fargate, the solutions architect should consider Amazon Elastic File System (EFS). Amazon EFS is a managed, scalable, and highly available file system for use with EC2 instances and containers, including Fargate. EFS supports concurrent access to files from multiple Fargate tasks, which is required for high-performance machine learning workloads. Additionally, EFS provides high performance and low latency access to files, which is necessary for machine learning workloads that require fast access to large amounts of data. EFS can be mounted on Fargate containers as a shared file system, enabling multiple containers to access the same files. EFS also provides automatic scaling of storage capacity and throughput, which makes it easy to handle changing workloads and storage requirements.
chatGPT changed decision :) Given the requirement of concurrent access to files and high performance, the best option would be to use Amazon FSx for Lustre file share, which is a fully managed file system optimized for compute-intensive workloads like machine learning, high-performance computing, and video processing. Amazon FSx for Lustre is designed to deliver high throughput and low latency performance to achieve a high degree of parallel access, and can be accessed concurrently from multiple compute instances.
mounting FSx lust is not supported with AWS Farget
the documentation says: "Mounting FSx for Lustre on an AWS Fargate launch type isn't supported." at https://docs.aws.amazon.com/fsx/latest/LustreGuide/mounting-ecs.html
Q. Can I access my Amazon EFS file system concurrently from my on-premises datacenter servers as well as Amazon EC2 instances? Yes. You can access your Amazon EFS file system concurrently from servers in your on-premises datacenter as well as Amazon EC2 instances in your Amazon VPC. Amazon EFS provides the same file system access semantics, such as strong data consistency and file locking, across all EC2 instances and on-premises servers accessing a file system. https://aws.amazon.com/efs/faq/
concurrently/simultaneously==> fargate