Google BigQuery Connector

Our platform enables you to quickly and easily connect a data source to a Google BigQuery table.

This enables a one-way synchronization to occur - where any changes in the Google BigQuery table are downloaded into your data source on a regular basis.

Your data source will be automatically updated in this way until you remove the connector or an error occurs (such as losing authorization to access the database).

Note: You must ensure that you have a valid Google Cloud Platform Connection set up on your organisation before adding a Google BigQuery Connector. You also need to set up a few basic things in the GCP console.

• Adding a Google BigQuery Data Source Connector
• Configuring a Google BigQuery Data Source Connector

Adding a Google BigQuery Data Source Connector

Navigate to the Settings page of the data source you'd like to import rows into.

• Connected Data>Data Sources
• In the list of available data sources, hover your mouse over the listing of the data source you wish to connect.
  A set of options will show, click on the Settings link.

• On the Settings page, after Basic and Advanced Options is the Connector option, click the Add Connector link.
  
  

  
  
  

• A new window with connectors to choose from will appear, click the Google BigQuery option.
  
  
  
   

The page should refresh with your newly added connector to be configured.

Configuring a Google BigQuery Data Source Connector

Next, configure the following:

• Project Id
  Specify the Google Cloud Platform Project ID that contains your target BigQuery dataset.
• Dataset Name
  Specify the Dataset Name where the table is located.
• Table Name
  The Google BigQuery database table from which rows will be retrieved.
• Ignore Internal Columns
  If enabled, this connector will ignore all columns where the column name starts with an underscore e.g. _lastupdated

  If your table has a column named _identity and internal columns are not ignored, this column will always be the first column of the data source. Other internal columns are added to the end.

• Refresh Frequency
  The frequency that data is pulled by this connector.

When you save your changes, the connector will be fired for the first time and after that will run at the interval you specified in the connector settings.

Wait a minute or so and then check the Rows page of your data source.

If rows are not downloaded, then there may be an error with the connection to the Google BigQuery API.

You can check errors by clicking on the View Logs link shown next to your connector on the Settings page.