You can create a read pipeline that transfers data from Snowflake into Anaplan Data Orchestrator (ADO).

In a read pipeline, the source data flows through the pipeline to the final sink (target) step. The sink must use a connection to an Anaplan object, such as a model or dataset.

Prerequisites

You need a connection to Snowflake to create the pipeline. Make sure you meet the prerequisites in these sections before you create a connection to Snowflake and a read pipeline.

Create a connection with Snowflake

Use the Snowflake connector in Data Orchestrator to create a connection.

You need your Snowflake credentials to connect the Snowflake data with Data Orchestrator. View the Snowflake documentation for more information about your credentials.

To create a connection:

  1. Select Data Orchestrator from the top-left navigation menu.
  2. Choose a dataspace from the list.
  3. Select Connections from the left-side panel.
  4. Select Create connection.
  5. Select the Snowflake connector and then select Next.
    If you can't find the connector, enter a search term in the Find... field.
  6. Enter these details on the Connection details screen, and then select Next:
    • Name: Create a name for your connection. The name can contain alphanumeric characters and underscores.
    • Description: Enter a description about your connection.
  7. Enter your Snowflake credentials on the Connection credentials screen, and then select Next.
    For information about the fields on the Connection credentials screen, see Authentication options for Snowflake connections.
  8. After the connection test is complete, select Done.

Create a read pipeline

Use the Snowflake connection you created to configure the read pipeline. The read pipeline uses the connection to import data from a table in Snowflake to an Anaplan object.

To create a read pipeline:

  1. Select Data Orchestrator from the top-left navigation menu.
  2. Choose a dataspace from the list.
  3. Select Pipelines from the left-side panel.
  4. Select Create pipeline.
  5. Enter a Name for your pipeline and then select Create.
    You are taken to the pipeline designer view.
  6. Select the Source icon, and then complete these steps in the right-side panel:
    1. Select Snowflake from the Connection type dropdown. 
    2. Select the Snowflake connection you created from the Choose connection dropdown.
    3. Enter a new Label to change the name that displays in the pipeline source node.
    4. Select a Source location > Source, and then select a table from Snowflake that you want to connect​ to.
    5. Select Columns, choose which columns from the Snowflake table you want to include, and then select Done.
      You can also optionally choose a cursor column.
    6. Optionally, select Filter at source to add row-based filters.
      For more information, see Row-based filtering at the source for pipelines.
  7. Optionally, select the add icon that appears between the Source and Sink nodes.
    You can add steps to your pipeline to process data.
  8. Select the Sink icon, and then complete these steps in the right-side panel:
    1. Select Anaplan from the Connection type dropdown.
    2. Choose an Anaplan object you want to connect to from the Choose connection dropdown.
      You can choose either Model or Datasets.
    3. Complete the sink details based on the Anaplan object you selected.
      See the sink details in these pages for more information:
  9. Select Publish, and then select Run to execute the data transfer.