You can use Anaplan models as a source or sink in a pipeline. You can also use Anaplan models as both the source and sink within the same pipeline.
When used as a source, model data is exported out of the model. When used as a sink, data is imported into the model.
Anaplan model connections
To connect your pipeline to an Anaplan model, you can create the model connection when you create the pipeline. Once created, the model connection can be used for other pipelines.
Overview of using models in pipelines
In the sections below, the procedures are similar and involve how to set up an Anaplan model as either a source or sink. The key differentiator between the use cases is where you specify the Anaplan model.
This table summarizes the process of how to create a pipeline with a model for various use cases.
| Use case | Source and sink steps |
| Model as a source | When you set an Anaplan model as a source, data from the model is brought into the pipeline. Use the steps in the Anaplan models as a pipeline source section. Here’s an overview of how to configure the source and sink steps in this type of pipeline:
|
| Model as a sink | When you set an Anaplan model as a sink, data is transferred from the pipeline into the model. Use the steps in the Anaplan models as a pipeline sink section. Here’s an overview of how to configure the source and sink steps in this type of pipeline:
|
| Models as a source and sink | You can set an Anaplan model as both the source and the sink. For the sink, you can either choose another Anaplan model, or a different object within the same model. This type of pipeline can be used when data from the source model needs to be transformed to match the structure of the sink model, when the same data needs to be copied into multiple sinks, or both. Here’s an overview of how to configure the source and sink steps in this type of pipeline:
|
Anaplan models as a pipeline source
This section describes how to create a pipeline with an Anaplan model as the data source.
To create a pipeline with an Anaplan model as a source:
- Select Data Orchestrator from the top-left navigation menu.
- Choose a dataspace from the list.
- Select Pipelines from the left-side panel.
- Select Create pipeline.
- Enter a Name for your pipeline and then select Create.
You are taken to the pipeline designer view. - Select the Source icon to configure the data source:
- Select Anaplan from the Connection type dropdown.
- Select Model from the Choose connection dropdown.
- Enter a new Label to change the name that displays in the pipeline source node.
- Choose a connection method:
- Saved connection: From the dropdown, select a previously created connection to an Anaplan model.
- Create a new connection: Select the link to create a new connection to a model. In the Create new connection dialog, select the Workspace and Model you want to connect to, enter a Name and Description (optional) for the connection, and then select Done.
- Select Source location > Choose Object, and choose a model source object.
You can select a module, saved view, list, or hierarchy. - Optionally, enable these settings based on the object you selected:
- Modules: You can enable the Use code when available switch.
- Saved views: You can enable these switches: Omit Summary and Use code when available.
- Lists: You can enable the Use code when available switch.
- Hierarchies: You can enable the Use code when available switch.
- Select the Sink icon to configure the target destination:
- Select a Connection type from the dropdown.
You can select an external system (for example S3) or Anaplan. - Select a connection from the Choose Connection dropdown:
- External system: If you selected an external system as the connection type, select an existing connection.
- Model or Datasets: If you selected Anaplan as the connection type, select Model or Datasets.
- Enter a new Label to change the name that displays in the pipeline sink node.
- Complete the remaining fields that display in the Targets panel, based on the connection you selected:
- External system: See the relevant writeback pipeline page for your external system for more information.
- Anaplan model: If you choose this, then Anaplan models are both the source and sink in this pipeline. For information on configuring the sink, see Step 7 in the Anaplan models as a pipeline sink section.
- Anaplan dataset: See Anaplan dataset connections in pipelines for more information.
- Select a Connection type from the dropdown.
- Select Publish, and then select Run to execute the data transfer.
Anaplan models as a pipeline sink
This section describes how to create a pipeline with an Anaplan model as the sink destination.
To create a pipeline with an Anaplan model as a sink:
- Select Data Orchestrator from the top-left navigation menu.
- Choose a dataspace from the list.
- Select Pipelines from the left-side panel.
- Select Create pipeline.
- Enter a Name for your pipeline and then select Create.
You are taken to the pipeline designer view. - Select the Source icon to configure the data source:
- Select a Connection type from the dropdown.
You can select an external system (for example S3) or Anaplan. - Select a connection from the Choose Connection dropdown:
- External system: If you selected an external system as the connection type, select an existing connection.
- Model or Datasets: If you selected Anaplan as the connection type, select Model or Datasets.
- Enter a new Label to change the name that displays in the pipeline source node.
- Complete the fields that display in the Source panel, based on the connection you selected:
- External system: See the relevant read pipeline page for your external system for more information.
- Anaplan model: If you choose this, then Anaplan models are both the source and sink in this pipeline. For information on configuring the source, see Step 6 in the Anaplan models as a pipeline source section.
- Anaplan dataset: See Anaplan dataset connections in pipelines for more information.
- Select a Connection type from the dropdown.
- Select the Sink icon to configure the target destination:
- Select Anaplan from the Connection type dropdown.
- Select Model from the Choose connection dropdown.
- Enter a new Label to change the name that displays in the pipeline sink node.
- Choose a connection method:
- Saved connection: From the dropdown, select a previously created connection to an Anaplan model.
- Create a new connection: Select the link to create a new connection to a model. In the Create new connection dialog, select the Workspace and Model you want to connect to, enter a Name and Description (optional) for the connection, and then select Done.
- Select Source location > Choose Object, and choose a model target object.
You can select a module, saved view, list, or hierarchy. - Select Target mapping > Mapping, and map the source values to the target values.
- If you selected a hierarchy, you can select the Balance hierarchy checkbox.
For more information, see the Balanced vs. unbalanced hierarchies page. - Select a Match option for the target object you selected.
See the Match options section below. - Select an Update type:
- Upsert: Updates existing rows and adds new rows if needed.
- Replace: Replaces all existing data with the new data being extracted, and overwrites any previous data.
- Select Publish, and then select Run to execute the data transfer.
Match options
When the pipeline data is pushed to the target model, the match option determines how to match the items in the target model object with the data in the pipeline.
Use this table to determine which match option to select for the model target object. If you selected a list, the match options differ depending on if you selected a standard list or numbered list.
| Target | Match options |
| Modules |
|
| Standard list |
|
| Numbered list | No match options available. The items are always matched by code. The code is required and the name can't be mapped. |
| Hierarchy | The match option you select applies to every level in the hierarchy.
|