Create a connection in Anaplan Data Orchestrator to import data from Google BigQuery. Then use the connection to extract data and create a source dataset.

You will need your BigQuery credentials to connect the BigQuery data with Data Orchestrator. View the BigQuery documentation for more information about your credentials.

To create a connection:

  1. Select Data Orchestrator from the top-left navigation menu.
  2. Select Connections from the left-side panel.
  3. Select Create connection.
  4. Select BigQuery and then select Next.
    If you can't find the connector, enter a search term in the Find... field.
  5. On the Connection details page, enter these details and select Next:
    • Name: Create a name for your connection. The name can contain alphanumeric characters and underscores.
    • Description: Enter a description about your connection.
  6. On the Connection credentials page, enter your BigQuery credentials and select Next:
    • Project ID: The identifier for the BigQuery project that contains the dataset (for example, myproject-1234)
    • Credentials Json: The BigQuery JSON code for authentication.
    • Dataset ID: The BigQuery dataset ID.
      (When you extract data to add source data from a Google BigQuery connection, only the views defined under the Dataset ID for the connection definition are visible under Path name.)
  7. After the connection test is complete, select Done.

You can extract data from the Google BigQuery connection to add source data to Data Orchestrator. The data extract creates a source dataset.

To extract data:

  1. Select Data Orchestrator from the top-left navigation menu.
  2. Select Source data from the left-side panel.
  3. Select Add data > From connection.
  4. On the Dataset details page, enter these details and select Next:
    • Connection
    • Dataset name
    • Description
    • Namespace
    • Path name
  5. On the Choose an upload type page, enter these details and select Next:
    1. Select the Load type:
      • Full replace: Completely replaces the current loaded data with the new data.
      • Append: Adds the new data to the end of the current table.
      • Incremental: Takes the data and incrementally updates what was previously loaded.
    2. Select the columns to import.

 Notes: 

  • The _ab fields are added by Data Orchestrator and aren't user data.
  • If you selected Incremental as the load type (partial replace): 
    • Select a Primary key checkbox. You can select more than one checkbox.
    • Data Orchestrator uses the  _ab fields as cursor keys to identify what's changed. The values aren't used for a Full replace
    • The Cursor Field is preselected.
  • If you selected Append as the load type (partial replace):
    • Data Orchestrator uses the  _ab fields as cursor keys to identify what's changed. The values aren't used for a Full replace
    • The Cursor Field is preselected.
  1. Select Create in the confirmation dialog.

For datasets imported from Google BigQuery, the table below displays those data types supported by Anaplan Data Orchestrator. You can also reference the Data Orchestrator data types they map to.

Google BigQuery data typesData Orchestrator data types
BOOLBoolean
INT64Integer
FLOAT64String
NUMERICString
BIGNUMERICString
STRINGString
BYTESString
DATEString
DATETIMEString
TIMESTAMPString
TIMEString
ARRAYString
STRUCTString
GEOGRAPHYString