Your company wants to migrate their 10-TB on-premises database export into Cloud Storage. You want to minimize the time it takes to complete this activity, the overall cost, and database load. The bandwidth between the on-premises environment and Google Cloud is 1 Gbps. You want to follow Google-recommended practices. What should you do?
Using the Data Transfer appliance is recommended for large-scale data transfers. With a bandwidth of 1 Gbps, transferring 10 TB would take around 30 hours, but this method would impose a significant load on the database. The Data Transfer appliance allows for an offline migration, which minimizes database load, adheres to best practices for large datasets, and offers a more efficient, cost-effective solution despite the longer total transfer time due to shipping and processing.
This is pretty simple. Time to transfer using Transfer Appliance: 1-3 weeks (I've used it twice and had a 2-3 week turnaround total) Time to transfer using 1Gbps : 30 hours (https://cloud.google.com/architecture/migration-to-google-cloud-transferring-your-large-datasets) Answer is D, using gsutil
This is the correct article to support this question but the article proves the transfer appliance is the correct answer. Right below the transfer calc chart is recommended amount of data for gsutil. Gsutil should be used for data transfer under 1 tb “Your private data center to Google Cloud Enough bandwidth to meet your project deadline for less than 1 TB of data gsutil”
Not about time but "Google-recommended practices"
If I can do it in 30hrs, why choose 1 week? i'd go with B
I mean I'd go with A rather...questions says to spend minimum time and we have 1Gbps to do 10Tb in 30hrs
Transfer appliance -A
Go home you are drunk
Will that not increase the Database load?, one of the requirement is to reduce the load of the DB during this operation.
No perfect answer as B and D both have flaws. B is time latency as transfer appliance usually takes weeks; D gsutil applies for less than 1TB. The answer should be storage transfer service for on-premises data, which is not available here. If have to choose one I go for B
Storage transfer service is for online data. It can't serve the purpose if you don't have the connectivity established between on prem and gcp. Which is what we can't assume ourselves in this question.
Answer B. Cp limit is 5 TB max
It is B
https://cloud.google.com/architecture/migration-to-google-cloud-transferring-your-large-datasets
I chose D. According to the link below, 10TB of data can be transferred in 30h. The light blue area is the acceptable line for online transfer. https://cloud.google.com/architecture/migration-to-google-cloud-transferring-your-large-datasets?hl=ja#online_versus_offline_transfer
D says compress data, in a single file? it will be more than the limit 5 TB of gsutil
Compressing the data and uploading it with gsutil -m can be a good optimization for your transfer, but it has limitations to consider: Compression Overhead: While compressing the data can reduce upload size and potentially speed up transfer, the compression and decompression processes themselves take time and resources. Depending on your data type, the benefit of reduced size might be offset by the processing overhead. Transfer Appliance: The recommended approach with the Transfer Appliance already utilizes parallel transfers for faster uploads, potentially making gsutil -m less impactful. I will go with B
Option B (Data Transfer appliance) is the best choice for efficient and cost-effective data migration while minimizing database load and transfer time. This solution bypasses network limitations and reduces the impact on the on-premises environment, making it ideal for migrating large data sets to the cloud.
D will be most cost effective where as B will incur cost (question asking to consider cost effective solution as well) so D is my answer
it is D. it is far more faster to send this 10TB data over network, than 'call' for Transfer Applience.
https://cloud.google.com/architecture/migration-to-google-cloud-transferring-your-large-datasets#online_versus_offline_transfer
Option B and D are most feasible options Option B will be okay if the size of the data is too huge Option D will be good for a few TBs of data. I am assuming 10 TB will fit in this case. https://cloud.google.com/blog/topics/developers-practitioners/how-transfer-your-data-google-cloud
with 1 Gbps it will take only 30 hrs so best option is D
Compressing the data and uploading it with gsutil -m can be a good optimization for your transfer, but it has limitations to consider: Compression Overhead: While compressing the data can reduce upload size and potentially speed up transfer, the compression and decompression processes themselves take time and resources. Depending on your data type, the benefit of reduced size might be offset by the processing overhead. Transfer Appliance: The recommended approach with the Transfer Appliance already utilizes parallel transfers for faster uploads, potentially making gsutil -m less impactful. I will go with B
B fo sho
I think the answer is B. The main consideration is between B and D. Just thinking if they want the answer to be online transfer, they should have added Online Transfer Service instead of gsutils. Just guessing Google must want us to choose B :)
D says compress data, ¿in a single file? it will be more than the limit 5 TB of gsutil, so it is B.