A company stores daily records of the financial performance of investment portfolios in .csv format in an Amazon S3 bucket. A data engineer uses AWS Glue crawlers to crawl the S3 data.
The data engineer must make the S3 data accessible daily in the AWS Glue Data Catalog.
Which solution will meet these requirements?
The solution involves creating an IAM role that includes the AWSGlueServiceRole policy, which is specifically designed for AWS Glue operations. The role should be associated with the crawler. The S3 bucket path containing the source data needs to be specified as the crawler's data store. Additionally, creating a daily schedule will ensure that the crawler runs on a daily basis. It is important to specify a database name for the output to ensure that the crawled data is properly cataloged in the AWS Glue Data Catalog. This setup meets all the stated requirements effectively.
B. Create an IAM role that includes the AWSGlueServiceRole policy. Associate the role with the crawler. Specify the S3 bucket path of the source data as the crawler's data store. Create a daily schedule to run the crawler. Specify a database name for the output. Explanation: Option B correctly sets up the IAM role with the necessary permissions using the AWSGlueServiceRole policy, which is designed for use with AWS Glue. It specifies the S3 bucket path of the source data as the crawler's data store and creates a daily schedule to run the crawler. Additionally, it specifies a database name for the output, ensuring that the crawled data is properly cataloged in the AWS Glue Data Catalog.
A,C are wrong because you use don't need full S3 access. D is wrong because you don't need to provision DPU and the destination should be a database, not an s3 bucket. so it's B
Glue Crawlers are serverless. Assigning DPUs is the point where i decided it option B
answer B is incomplete. Even we include AWSGlueServiceRole policy on IAM role, S3 access is not garantee
How does Glue get access to S3 if you don't do B?
I meant A
S3 access is part of the AWSGlueServiceRole Policy https://docs.aws.amazon.com/aws-managed- policy/latest/reference/AWSGlueServiceRole.html
It adds only for the glue related buckets, but it doesnt grant permissions for S3 that we need to read in order to fetch data, isnt it ?
It adds only for the glue related buckets, but it doesnt grant permissions for S3 that we need to read in order to fetch data, isnt it ?
S3 access is part of the AWSGlueServiceRole Policy https://docs.aws.amazon.com/aws-managed- policy/latest/reference/AWSGlueServiceRole.html
It adds only for the glue related buckets, but it doesnt grant permissions for S3 that we need to read in order to fetch data, isnt it ?
It adds only for the glue related buckets, but it doesnt grant permissions for S3 that we need to read in order to fetch data, isnt it ?