Google BigQuery Data Transfer Service Pros and Cons

The best thing was to use google cloud run and to test it for real time task - that is using faas approach - testing the deep learning seq2seq model for classification task of the video frame in real time. Gcloud run offer multiple parameters like public and private URL to test the app internally ( in the gcloud Ip addresses) or externally ( making the app available for the public), scalability, CPU boost to boost the request from the clients and scalability using minimum and maximum number of instances. And I got results in real time for 20 clients efficiently, accurately and quickly.

Also google offered my project with the grant of 25K$ so I can use the services for free and experiment them. Review collected by and hosted on G2.com.

Although I'm able to get real time results which I expected - but there I faced cold start problem - even though I set the minimum instances set to 1; but after remaining idle for above 1 to 2 hours - when there is the request of the user to the server - the model started to load and thus - the gcloud run app/link couldn't give results faster and even sometimes give no results.

Secondly, I faced Domain Sharing issue here, even though I have admin acces of my account but I solved after doing experimenting multiple things - there was no proper documentation on how to give access to the user inside the account other users. Review collected by and hosted on G2.com.

I am working on Mahindra as cloud engineer , all use case that we have on our company I will work on , like deploy application on Compute instance , GKE and pass servcie cloud run also . and data analytic part : we used cloud composer , big query , data proc cluster .. as storage we use cloud spanner , gcs , sql .. at ui and servcie side google cloud is ok , Review collected by and hosted on G2.com.

google cloud ui for IAM releted not good , speed also not good network side . google team need to work on documention also . google team aslo team to wrok on avilablity of instance on all region . Review collected by and hosted on G2.com.

Easy to create and schedule data transfer form cloud bucket to destination table with advanced functionality Review collected by and hosted on G2.com.

It is not allowing me to change/edit the destination table name and source path in an existing transfer. Because of this, I always need to create a new transfer. Review collected by and hosted on G2.com.

Best and cheaper services provided by Google cloud and with best scalability and some services and fully managed with best UI. Review collected by and hosted on G2.com.

There are some services needs some clarity like some configuration which is blocked by Google itself. Review collected by and hosted on G2.com.

A killer product that most cloud platforms can't match is BigQuery. But overall the interfaces are easy to use, the cli tools are oustanding and new products and improvements launch incredibly often. The global reaching self owned fiber optic network is also truly a USP. Review collected by and hosted on G2.com.

The prices has definitly gone up the last couple of years. Google Cloud use to be the cheaper Cloud, but has gotten more expensive every year. I guess it's inevitable but it's tough when youre already locked in. Review collected by and hosted on G2.com.

We use the service to transfer data from Bigquery which aggregates the Google Analytics data, to AWS S3, the data store layer for our enterprise data platform.

The BQ command line tool makes it easy to set up and helps to make seamless data transfer between Google cloud storage and S3

The performance of data transfer is very good compared to manually downloading the file local and then upload to S3 Review collected by and hosted on G2.com.

There is some manual effort in setting up the authentication using the credential file during the initial setup, but the operation is seamless once it is up and running. Review collected by and hosted on G2.com.

The UI of the interface is quite user friendly. It's very easy to connect various source and destination for data transfer. Review collected by and hosted on G2.com.

Used this service over a year now and there are no dislikes at all. Review collected by and hosted on G2.com.

Bigquery is easy to set up and connect to data sources using Fivetran. Exploring data is intuitive, queries (SQL-like) are easy to learn and familiar. There are some innovative features, like automatically nesting tables (which is very interesting and not typical in a traditional database). Review collected by and hosted on G2.com.

If data sources (from DBT, for example) update, there is no option to reload data in Bigquery without refreshing the whole page, which is heavy and takes a moment to load.

Working in a schema with 18 tables, I quickly have a ton of tabs open, and the interface is not super for navigating so many tabs at the same time, at least not on a laptop screen. Review collected by and hosted on G2.com.

Easy to Set up with the Google BigQuery Data Transfer, good options to decide on the frequency of youtube data extraction. Review collected by and hosted on G2.com.

I have no dislikes, as I found the service easy to use. Review collected by and hosted on G2.com.