Professional Data Engineer Exam QuestionsBrowse all questions from this exam

Professional Data Engineer Exam - Question 274


You have a BigQuery table that ingests data directly from a Pub/Sub subscription. The ingested data is encrypted with a Google-managed encryption key. You need to meet a new organization policy that requires you to use keys from a centralized Cloud Key Management Service (Cloud KMS) project to encrypt data at rest. What should you do?

Show Answer
Correct Answer: B

To meet the organization's policy that requires using keys from a centralized Cloud Key Management Service (Cloud KMS) project to encrypt data at rest, you need to create a new BigQuery table that uses customer-managed encryption keys (CMEK). This ensures that the data is encrypted with the specified keys. Since the existing data is already encrypted with a Google-managed key, you need to migrate the data from the old BigQuery table to the new one to comply with the new policy. This approach directly addresses the requirement without unnecessary changes to other parts of the data ingestion process.

Discussion

22 comments
Sign in to comment
raaadOption: B
Jan 10, 2024

- New BigQuery Table with CMEK: This option involves creating a new BigQuery table configured to use a CMEK from Cloud KMS. It directly addresses the need to use a CMEK for data at rest in BigQuery. - Migrate Data: Migrating data from the old table (encrypted with a Google-managed key) to the new table (encrypted with CMEK) ensures that all existing data complies with the new policy.

Matt_108
Jan 13, 2024

But also pub/sub has some data at rest, e.g. messages with retention period. To comply with the organisation policy, we need to adapt also pub/sub

AllenChen123
Jan 21, 2024

No, "The ingested data is encrypted with a Google-managed encryption key", target is ingested data in BigQuery.

ML6
Feb 18, 2024

Correct, but the question states 'use keys from a centralized Cloud KMS project', so only D is correct.

cloud_rider
Nov 29, 2024

PubSub is an application and holds data on the fly, this data does not mean data at rest. The data that is ingested in GSC only means data at rest so B is the right answer.

Blackstile
Feb 25, 2025

The question did not say anything about the retention policy. Therefore, the correct answer is B. A tip for the exam: never answer what was not asked.

Blackstile
Feb 25, 2025

The question did not say anything about the retention policy. Therefore, the correct answer is B. A tip for the exam: never answer what was not asked.

cloud_rider
Nov 29, 2024

PubSub is an application and holds data on the fly, this data does not mean data at rest. The data that is ingested in GSC only means data at rest so B is the right answer.

Blackstile
Feb 25, 2025

The question did not say anything about the retention policy. Therefore, the correct answer is B. A tip for the exam: never answer what was not asked.

Blackstile
Feb 25, 2025

The question did not say anything about the retention policy. Therefore, the correct answer is B. A tip for the exam: never answer what was not asked.

ML6
Feb 18, 2024

Correct, but the question states 'use keys from a centralized Cloud KMS project', so only D is correct.

cloud_rider
Nov 29, 2024

PubSub is an application and holds data on the fly, this data does not mean data at rest. The data that is ingested in GSC only means data at rest so B is the right answer.

Blackstile
Feb 25, 2025

The question did not say anything about the retention policy. Therefore, the correct answer is B. A tip for the exam: never answer what was not asked.

Blackstile
Feb 25, 2025

The question did not say anything about the retention policy. Therefore, the correct answer is B. A tip for the exam: never answer what was not asked.

cloud_rider
Nov 29, 2024

PubSub is an application and holds data on the fly, this data does not mean data at rest. The data that is ingested in GSC only means data at rest so B is the right answer.

Blackstile
Feb 25, 2025

The question did not say anything about the retention policy. Therefore, the correct answer is B. A tip for the exam: never answer what was not asked.

Blackstile
Feb 25, 2025

The question did not say anything about the retention policy. Therefore, the correct answer is B. A tip for the exam: never answer what was not asked.

AllenChen123
Jan 21, 2024

No, "The ingested data is encrypted with a Google-managed encryption key", target is ingested data in BigQuery.

ML6
Feb 18, 2024

Correct, but the question states 'use keys from a centralized Cloud KMS project', so only D is correct.

cloud_rider
Nov 29, 2024

PubSub is an application and holds data on the fly, this data does not mean data at rest. The data that is ingested in GSC only means data at rest so B is the right answer.

Blackstile
Feb 25, 2025

The question did not say anything about the retention policy. Therefore, the correct answer is B. A tip for the exam: never answer what was not asked.

Blackstile
Feb 25, 2025

The question did not say anything about the retention policy. Therefore, the correct answer is B. A tip for the exam: never answer what was not asked.

cloud_rider
Nov 29, 2024

PubSub is an application and holds data on the fly, this data does not mean data at rest. The data that is ingested in GSC only means data at rest so B is the right answer.

Blackstile
Feb 25, 2025

The question did not say anything about the retention policy. Therefore, the correct answer is B. A tip for the exam: never answer what was not asked.

Blackstile
Feb 25, 2025

The question did not say anything about the retention policy. Therefore, the correct answer is B. A tip for the exam: never answer what was not asked.

ML6
Feb 18, 2024

Correct, but the question states 'use keys from a centralized Cloud KMS project', so only D is correct.

cloud_rider
Nov 29, 2024

PubSub is an application and holds data on the fly, this data does not mean data at rest. The data that is ingested in GSC only means data at rest so B is the right answer.

Blackstile
Feb 25, 2025

The question did not say anything about the retention policy. Therefore, the correct answer is B. A tip for the exam: never answer what was not asked.

Blackstile
Feb 25, 2025

The question did not say anything about the retention policy. Therefore, the correct answer is B. A tip for the exam: never answer what was not asked.

cloud_rider
Nov 29, 2024

PubSub is an application and holds data on the fly, this data does not mean data at rest. The data that is ingested in GSC only means data at rest so B is the right answer.

Blackstile
Feb 25, 2025

The question did not say anything about the retention policy. Therefore, the correct answer is B. A tip for the exam: never answer what was not asked.

Blackstile
Feb 25, 2025

The question did not say anything about the retention policy. Therefore, the correct answer is B. A tip for the exam: never answer what was not asked.

Matt_108Option: D
Jan 13, 2024

Option D - I get the discussion about B and D, but also pub/sub has some data at rest, e.g. messages with retention period. To comply with the organisation policy, we need to adapt also pub/sub

Smakyel79Option: D
Jan 7, 2024

This option ensures that both the ingestion mechanism (Pub/Sub) and the storage component (BigQuery) are aligned with the organization's policy of using CMEK, providing end-to-end encryption control.

KirkD
Jan 8, 2024

I considered also A as they are asking about encryption at rest. The BigQuery is the one but Pub/Sub, not sure.

raaad
Jan 9, 2024

I think option A is a partial solution as using Cloud KMS key in Dataflow for ingestion does not change the encryption of the data at rest in the BigQuery table.

raaad
Jan 9, 2024

Why not B??

raaad
Jan 9, 2024

I think option A is a partial solution as using Cloud KMS key in Dataflow for ingestion does not change the encryption of the data at rest in the BigQuery table.

raaad
Jan 9, 2024

Configuring a Pub/Sub topic with a CMEK is not necessary for encrypting data at rest in BigQuery.

Matt_108
Jan 13, 2024

to me it's D because also pub/sub has some data at rest, e.g. messages with retention period. To comply with the organisation policy, we need to adapt also pub/sub encryption

ML6
Feb 18, 2024

But they mention that ingested data is already encrypted?

ML6
Feb 18, 2024

But they mention that ingested data is already encrypted?

BIGQUERY_ALT_ALT
Jan 11, 2024

Requirement is encrypt bq data - " The ingested data is encrypted with a Google-managed encryption key" so pubsub encryption from ingestion is not needed. Option B is correct.

Matt_108
Jan 13, 2024

to me it's D because also pub/sub has some data at rest, e.g. messages with retention period. To comply with the organisation policy, we need to adapt also pub/sub encryption

ML6
Feb 18, 2024

But they mention that ingested data is already encrypted?

ML6
Feb 18, 2024

But they mention that ingested data is already encrypted?

GCP001
Jan 7, 2024

D. We should use new CMSK for both pubsub topic and BQ tables along with migrating old data.

ML6
Feb 18, 2024

Only option D complies with the organisation policy: - By creating a new Pub/Sub topic with customer-managed encryption keys (CMEK), any new data ingested into Pub/Sub will be encrypted with the (!) organization's desired encryption keys (!). - Creating a new BigQuery table with CMEK ensures that all data stored in BigQuery, both newly ingested and migrated historical data, is encrypted according to organizational policies. - Migrating the data from the old BigQuery table to the new one ensures that historical data is also encrypted with the new keys, thus meeting the organization's requirements for encryption at rest for both Pub/Sub and BigQuery.

Izzyt99
Mar 23, 2024

D - 'as new organization policy that requires you to use keys from a centralized Cloud Key Management Service (Cloud KMS) project to encrypt data at rest.' Therefore, the Pub/Sub default Google-managed encryption key is not sufficient as the organization requires it's own CMEK that is to be generated from a centralized Cloud KMS project.

josechOption: D
May 26, 2024

BigQuery and Pub/Sub shall be encrypted using CMEK using new versions of each one. https://cloud.google.com/pubsub/docs/encryption#using-cmek

Anudeep58Option: D
Jun 15, 2024

D. Create a new BigQuery table and Pub/Sub topic by using customer-managed encryption keys (CMEK), and migrate the data from the old BigQuery table. This approach comprehensively addresses the requirement to use CMEK from a centralized Cloud KMS project for encrypting data at rest: Create a new Pub/Sub topic configured to use CMEK from the centralized Cloud KMS project. Create a new BigQuery table with CMEK enabled, using the same centralized Cloud KMS project. Update the ingestion process to use the new Pub/Sub topic to feed data into the new BigQuery table. Migrate existing data from the old BigQuery table to the new BigQuery table to ensure all data complies with the new encryption policy.

LaxmanTiwariOption: B
Apr 25, 2024

B. Create a new BigQuery table by using customer-managed encryption keys (CMEK), and migrate the data from the old BigQuery table. Most Voted

LaxmanTiwari
Apr 25, 2024

it should be B as the data in pub sub is already encrypted , please read it carefully and use Copilot or chat gpt to have confirmation.

chrissamharrisOption: B
May 18, 2024

Data at rest in requirement = Big Query ONLY. Pub/Sub is data in movement - overkill for the solution

AlizCertOption: B
Jun 5, 2024

B, been there, done that...

AlizCert
Jun 5, 2024

sry, I mean D

carmltekaiOption: B
Jul 15, 2024

"The best solution here is B. Create a new BigQuery table by using customer-managed encryption keys (CMEK), and migrate the data from the old BigQuery table. Here's why: Customer-Managed Encryption Keys (CMEK): CMEKs allow you to have granular control over your encryption keys, complying with the organization's policy to use keys from a centralized Cloud KMS project. Data Migration: Since the data in the existing table is already encrypted with a Google-managed key, you cannot retroactively change the encryption key for that table. Migrating the data to a new table with the correct encryption is the most efficient way to meet compliance.

carmltekai
Jul 15, 2024

Why other options aren't suitable: A: Dataflow can't retroactively change the encryption of data that's already in BigQuery. C: Creating a new Pub/Sub topic with CMEK wouldn't address the data that's already in BigQuery. D: While creating a new Pub/Sub topic might be useful in the long run, it's not necessary for solving the immediate compliance issue with the existing data."

iooj
Aug 3, 2024

You have some data in Pub/Sub at rest as well which is immediate compliance issue.

iooj
Aug 3, 2024

You have some data in Pub/Sub at rest as well which is immediate compliance issue.

SamuelTschOption: B
Oct 31, 2024

should be B. Pub/Sub is not designed for storing data at rest.

plum21Option: D
Jan 30, 2025

There is data at rest in Pub/Sub, which is stated here in the docs: https://cloud.google.com/pubsub/docs/encryption At rest data -> Application layer -> CMEK encryption

cuadradobertolinisebastiancamiOption: D
Feb 28, 2024

Agree with ML6 and Smakyel. To encrypt data at rest we should encrypt the data in PubSub and BigQuery

amanbawa96Option: B
Apr 4, 2024

BigQuery allows you to encrypt data at rest using either Google-managed encryption keys or customer-managed encryption keys (CMEK) from Cloud KMS. Since the new policy requires using keys from a centralized Cloud KMS project, you need to create a new BigQuery table that is configured to use CMEK for encryption. After creating the new table with CMEK, you can migrate the data from the old table (encrypted with Google-managed keys) to the new table (encrypted with CMEK). This approach ensures that the data in the BigQuery table is encrypted using the required CMEK while preserving the existing data. Creating a new BigQuery table and Pub/Sub topic with CMEK is not necessary because the focus is on encrypting the data at rest in BigQuery. The existing Pub/Sub subscription can still be used to ingest data into the new BigQuery table.

f74ca0cOption: D
May 18, 2024

D- BigQuery and Pub/sub are automatically encrypted but here we need to apply a more secured policy by using CMEK so we need to use it for bigquery and pub/sub to meet this policy

shanks_tOption: D
Aug 24, 2024

Requirement for Cloud KMS keys: The new organization policy requires using keys from a centralized Cloud KMS project for encrypting data at rest. This necessitates the use of customer-managed encryption keys (CMEK). BigQuery table encryption: The existing BigQuery table is encrypted with a Google-managed key. To meet the new policy, a new table needs to be created with CMEK. Pub/Sub topic encryption: Since the data is ingested directly from a Pub/Sub subscription, the Pub/Sub topic also needs to use CMEK to ensure end-to-end encryption with customer-managed keys. Data migration: The existing data in the old BigQuery table needs to be migrated to the new CMEK-encrypted table to ensure all data complies with the new policy

gr3yWindOption: B
Oct 25, 2024

Agree with raaad

m_a_p_sOption: B
Dec 13, 2024

B. You don't need to create a new topic in order to use the new CMEK. Existing topic can be updated to use the new key: https://cloud.google.com/pubsub/docs/encryption#update_cmek_for_a_topic

Pime13Option: B
Jan 6, 2025

B. There is no need to create a new pubsub topic since it can be updated with the note that change is not retroactive. https://cloud.google.com/pubsub/docs/encryption#update_cmek_for_a_topic

Blackstile
Feb 25, 2025

The question did not say anything about the retention policy. Therefore, the correct answer is B. A tip for the exam: never answer what was not asked.