1 – Create a GC account
2 – Create A project and enable billing for that project.
If you have some data from your current DWH or some files on somewhere;
3 – Create a Cloud Storage for BQ
set getting data from some sources
4 – Create a Sync Job for s3 or wherever you want to get data sources
I’m getting my data from s3, you have to set a name for source and one name for a destination, so I mention that like s3toGCstorage source and for destination destinations3toGCstorage.
And now you have your data on GC Storage, it scheduled and it works fine.
5 – Create a dataset on BigQuery
bq mk BigTableau
6 – Create a Table and Load Data from GCStorage
On webui or activate cloud shell
bq –location=[LOCATION] load –source_format=[FORMAT] [DATASET].[TABLE] [PATH_TO_SOURCE] [SCHEMA]
In the end, you scheduled your task on GC Storage, that task getting your data from your sources, you created a BQ table to the struct that your data, and now we have to create a dashboard or whatever.
I will install tableau server for my issue, but you can use data studio in GC or whatever you want, in last a few years lots of Dashboard tools support to BQ for sourcing.
I will mention that in another post.