Experimentation Agency Message Testing Training Pricing Fast Marketing Community Blog Resources Help

Move data into Google BigQuery

Use case

Get better insights from a wider database and analyze your website data with ease.

Upgrade for unlimited access to thousands of playbooks on increasing traffic, improving ROAS and more.

Start 7-day trial for $1

1. Decide what data you’ll need for your dashboards and analysis, such as data from CRM, back end or GA.

Look at the reporting that you want to automate: what data do you have there?

  • Sales data from your CRM
  • Form submits from your back end system.
  • Sessions per source from your GA data.
Join the discussion on how to complete this step.

2. Use a database schema tool or draw a schema of your data tables with table fields.

Think of what fields from these data sources you’ll need – for example, only 5 columns/fields from your CRM data: crmId, UserId, agency, date, revenue.

Join the discussion on how to complete this step.

3. Open Google Cloud Console and create a new Cloud Project.

Join the discussion on how to complete this step.

4. Create datasets on Google BigQuery - one dataset per data source that you previously identified.

  1. Click on your project name in the lower left corner and click Create dataset on your right
  2. Choose a Name and Location where your data will be stored (you will not be able change it afterwards).
  3. Click on a Dataset and then click on Create table.
Join the discussion on how to complete this step.

5. Import tables manually by uploading CSV or Avro files, or import data from Cloud Storage.

  1. Give your table a name and use Schema Autodetection if possible.
  2. When uploaded, your table is ready for use.
  3. You can do your analysis on this table using SQL in BigQuery.

Join the discussion on how to complete this step.

6. To automate the process, ask your developers to send CSV files to Cloud Storage that you can transfer into your BigQuery tables using Cloud Function.

Paid connectors such as Owox, Supermetrics, SegmentStream will connect your Google, Facebook, or Salesforce data to BigQuery.

Join the discussion on how to complete this step.

7. To create your dashboard based on your BigQuery data, open Google Studio, select Create New Data Source > Add Data > BigQuery to import your table.

Join the discussion on how to complete this step.

Current Playbook:

Move data into Google BigQuery

Mar 14, 2022

0 votes

Request a playbook

Get unlimited access

Thousands of playbooks on increasing traffic, improving ROAS and more.

Sign up now