Connection Type Reference

Access

Description

Used for sourcing data from Microsoft Access

Task Type Support

This connection type supports the following task types:

  • Data Migration

Data Migration Support

This connection can be used in a Data Migration.

Usable as Source Usable as Target Usable as Incremental Source Usable as Incremental Target

Connection String Templates

Template Name Description
Access The standard connection string for Access, uses DataSource

Connection Notes

  • The username and password fields are the same fields you’d use to log into Access.

Aconex

Description

Aconex is a project management tool, predominately used for mail organisation. It is used to import mail data and metadata through our data migration task type.

Task Type Support

This connection type supports the following task types:

  • Data Migration

Data Migration Support

This connection can be used in a Data Migration.

Usable as Source Usable as Target Usable as Incremental Source Usable as Incremental Target

The Aconex API is extremely throttled especially with concurrent requests. If you are experiencing connection dropouts during Data Migrations of multiple tables it’s recommended that you either turn off parallel data migrations or lower the degree of parallelism.

Connection String Templates

Template Name Description
Aconex Requires an Aconex Username and Password, as well as an application key and host.

Connection Notes

Amazon DynamoDB

Description

Used for migrating Data in and out of AWS’ NoSQL & Big Data DynamoDB

Task Type Support

This connection type supports the following task types:

  • Data Migration

Data Migration Support

This connection can be used in a Data Migration.

Usable as Source Usable as Target Usable as Incremental Source Usable as Incremental Target

Connection String Templates

Template Name Description
Amazon DynamoDB The standard connection string for DynamoDB, uses Access Key, Secret Key, Domain and Region.

Connection Notes

  • The Region Code for your instance can be found using this reference or by copying the value highlighted in the url of your AWS Console:

s3 1

Amazon S3 Account

Description

Used for migrating data in and out of AWS’ Simple Storage Service (S3) Buckets.

Task Type Support

This connection type supports the following task types:

  • Data Migration

Data Migration Support

This connection can be used in a Data Migration.

Usable as Source Usable as Target Usable as Incremental Source Usable as Incremental Target

Connection Notes

  • The Region Code for your instance can be found using this reference or by copying the value highlighted in the url of your AWS Console:

s3 1

Azure Batch Account

Description

Used for executing scripts on the Azure Batch service.

Task Type Support

This connection type supports the following task types:

  • Azure Batch Task

Connection Notes

  • Learn how to create an Azure Batch Account in the Azure Portal in the Azure Documentation Quickstart.

  • The fields for the Azure Batch Account connection can be found easily in the “Keys” section of the Azure Resource.

azure batch in dg

azure batch in portal

Azure Blob Storage

Description

Used for connecting to Azure Blob Containers.

Task Type Support

This connection type supports the following task types:

  • Data Migration

Data Migration Support

This connection can be used in a Data Migration.

Usable as Source Usable as Target Usable as Incremental Source Usable as Incremental Target

Connection Notes

Azure Active Directory Application

Description

Used as a flexible, secure means of integrating Data Governor with Azure Products and Services.

Task Type Support

This connection type supports the following task types:

  • Azure Data Factory

Connection Notes

To create an Azure Enterprise Application Registration for usage in Data Governor:

Search for App Registrations in Azure Portal

azure app 1

Create a new Application Registration

azure app 2

Fill out the form, giving the app a meaningful name, setting the type to “Web App / API” and putting the Data Governor URL as the sign-on URL.

azure app 3

Copy the “Application Id” as this is the same “Application Id” required in your Data Governor connection, then click settings.

Open the “Keys” blade, create a new Password and save. The value that you are prompted to copy is the “Password” used in your connection.

azure app 5

Click the directory icon on the top right of the Portal, copy the ID of your current directory (cirecled in red). This is your “Tenant ID” for your new connection.

azure app 6

Type “Subscriptions” in the search bar, open the subscriptions page and copy the subscription ID for the resources you wish to access. This is the “Subscription ID” for your new connection. To ensure your application is able to easily list resources it can use in Data Governor, open up Access Control and give the newly created application “Reader” permissions.

Once you have filled out all the fields you now have a direct connection to your Azure Subscription through that app registration.

You will need to assign that application “Contributor” permissions to the resources it needs to use. Learn more about Azure Active Directory permissions here.

Azure Data Lake Storage Gen2

Description

A connector used for importing data to and from Azure Data Lake Storage Gen2.

Task Type Support

This connection type supports the following task types:

  • Data Migration

Data Migration Support

This connection can be used in a Data Migration.

Usable as Source Usable as Target Usable as Incremental Source Usable as Incremental Target

Connection String Templates

Template Name Description
Azure Data Lake Storage Gen2 The standard connection string for Azure Data Lake Storage Gen2, that also requires an Account Access Key.

Connection Notes

Azure Table Storage

Description

Used as a flexible, secure means of integrating Data Governor with Azure Table Storage.

Task Type Support

This connection type supports the following task types:

  • Data Migration

Data Migration Support

This connection can be used in a Data Migration.

Usable as Source Usable as Target Usable as Incremental Source Usable as Incremental Target

Connection String Templates

Template Name Description
Azure Storage The standard connection string for Azure Tables. Uses AccessKey and Account.

Connection Notes

Bing Ads

Description

Used for importing Data from Bing Ads.

Task Type Support

This connection type supports the following task types:

  • Data Migration

Data Migration Support

This connection can be used in a Data Migration.

Usable as Source Usable as Target Usable as Incremental Source Usable as Incremental Target

Connection Notes

  • The username and password fields are the same fields you’d use to log into Bing Ads

Description

Used for Importing Data from the Bing Search Cognitive Services.

Refer to Connection Notes for how to import data from Bing Search using Query as a Source.

Task Type Support

This connection type supports the following task types:

  • Data Migration

Data Migration Support

This connection can be used in a Data Migration.

Usable as Source Usable as Target Usable as Incremental Source Usable as Incremental Target

Connection Notes

  • Bing Search requires a Microsoft Cognitive Services application which can be created in the Azure Portal.

  • The Api Key is used in the Connection String

  • You must use Query as a source and provide a search using the SearchTerm column eg:

bing search example

When using the Target filter feature with Bing Search, you must first apply the target filter ‘SearchTerms’. You can then add other filters to refine your data. Learn more about Target Filters here.

Cassandra

Description

Used for importing Data from Apache Cassandra.

Task Type Support

This connection type supports the following task types:

  • Data Migration

Data Migration Support

This connection can be used in a Data Migration.

Usable as Source Usable as Target Usable as Incremental Source Usable as Incremental Target

Connection String Templates

Template Name Description
Apache Cassandra The standard connection string for Cassandra, uses Database, Port and Server.

Connection Notes

  • The username and password fields are the same fields you’d use to log into Cassandra.

Couchbase

Description

Used for importing data from Couchbase.

Task Type Support

This connection type supports the following task types:

  • Data Migration

Data Migration Support

This connection can be used in a Data Migration.

Usable as Source Usable as Target Usable as Incremental Source Usable as Incremental Target

Connection String Templates

Template Name Description
Couchbase Server The standard connection string for Couchbase, uses User, Password and Server

Connection Notes

  • The username and password fields are the same fields you’d use to log into CouchBase.

DataBricks

Description

Used for interacting with an Azure or AWS hosted Databricks instance.

Task Type Support

This connection type supports the following task types:

  • Databricks
  • Data Migration
  • Spark SQL Statement

Data Migration Support

This connection can be used in a Data Migration.

Usable as Source Usable as Target Usable as Incremental Source Usable as Incremental Target

Connection Notes

  • Databricks connection do not require a typical connection string, instead it requires just the hostname of the URL you use to access the Databricks UI.

  • The Access token for Databricks can be generated using the following tutorial.

Dynamics CRM

Description

Used for importing Data from Microsoft Dynamics CRM.

Task Type Support

This connection type supports the following task types:

  • Data Migration

Data Migration Support

This connection can be used in a Data Migration.

Usable as Source Usable as Target Usable as Incremental Source Usable as Incremental Target

Connection String Templates

Template Name Description
Microsoft Dynamics CRM The standard connection string for Dynamics CRM, uses basic authentication with a username and password.

Connection Notes

  • It is highly recommended that for the Dynamics CRM connector you create a designated service account for Data Governor as this will avoid the potential of having any actual user information passed through Data Governor.

  • Currently Data Governor does not support including the user information through the secure user-password inputs, this feature is coming soon.

Excel

Description

Used for importing data from Excel (.xls/.xsls) files.

Task Type Support

This connection type supports the following task types:

  • Data Migration

Data Migration Support

This connection can be used in a Data Migration.

Usable as Source Usable as Target Usable as Incremental Source Usable as Incremental Target

Connection String Templates

Template Name Description
Excel Files The standard Excel connection string which imports data from a file located at the provided path.

Connection Notes

Facebook

Description

Used for importing Data from the Facebook Application using OAuth.

Task Type Support

This connection type supports the following task types:

  • Data Migration

Data Migration Support

This connection can be used in a Data Migration.

Usable as Source Usable as Target Usable as Incremental Source Usable as Incremental Target

Connection Notes

  • A Developer Application can be created here: https://developers.facebook.com

  • For the OAuth Connection, the Client ID for Facebook is your App ID. While your Client Secret is your App Secret.

  • Add the Generated Redirect URI to Facebook.

  • Add the following to the Connection String InitiateOauth=OFF;Target=YOUR_TARGET_ID

Currently there is no way to refresh the Facebook Token automatically so you will need to reauthorize your Facebook Connection every 90 Days.

FTP

Description

Used for importing file structure and from an FTP server.

Task Type Support

This connection type supports the following task types:

  • Data Migration

Data Migration Support

This connection can be used in a Data Migration.

Usable as Source Usable as Target Usable as Incremental Source Usable as Incremental Target

Connection Notes

  • The username and password fields are the same fields you’d use to log into FTP.

Google Adwords

Description

Connector for Google AdWords. Provides easy access to Google AdWords data, including Campaigns, AdGroups, Performance and more.

Task Type Support

This connection type supports the following task types:

  • Data Migration

Data Migration Support

This connection can be used in a Data Migration.

Usable as Source Usable as Target Usable as Incremental Source Usable as Incremental Target

Connection String Templates

Template Name Description
Google AdWords OAuth Access Token, Developer Token, Client Customer

Connection Notes

  • Google AdWords uses the OAuth authentication standard. In addition to the connection string Parameters, the Callback URL also should be specified for this connector. Set the OAuth Properties (OAuth Client ID and OAuth Client Secret), Developer Token and ClientCustomerID. Set the CallBack URL also for this Connector. Once the Callback URL is set the OAuthAccessToken will be generated in the Connection string when you verify the Connection using the Verify Connection option.

Google Analytics

Description

Used for importing data from Google Analytics. Requires the additional configuration of an OAuth application.

Task Type Support

This connection type supports the following task types:

  • Data Migration

Data Migration Support

This connection can be used in a Data Migration.

Usable as Source Usable as Target Usable as Incremental Source Usable as Incremental Target

Connection Notes

  • All Google based connection types utilise additional connection security, learn more here.

  • Strict security rules around the usage of Google Applications means that you may need to verify your application with Google before you use it.

Google BigQuery

Description

A connector used for importing data to and from Google BigQuery.

Task Type Support

This connection type supports the following task types:

  • Data Migration
  • SQL Statement Task

Data Migration Support

This connection can be used in a Data Migration.

Usable as Source Usable as Target Usable as Incremental Source Usable as Incremental Target

Connection String Templates

Template Name Description
Google BigQuery The standard connection string for Google BigQuery, that also requires an authentication file.

Connection Notes

  • A guide on how to get the required Google BigQuery authentication file can be found here.

Google Cloud Storage Bucket

Description

A connector used to import data to and from Google Cloud Storage Bucket.

Task Type Support

This connection type supports the following task types:

  • Data Migration

Data Migration Support

This connection can be used in a Data Migration.

Usable as Source Usable as Target Usable as Incremental Source Usable as Incremental Target

Connection String Templates

Template Name Description
Google Cloud Storage Bucket The standard connection string for Google Cloud Storage Bucket, requires bucket url and credentialfile.

Connection Notes

  • To connect to Google Cloud Storage Bucket, you will need to create a GCP Service Account and retrieve a Credential File. Learn more about creating a credential file here.

  • To retrieve the url, you can get it from the Link for gsutil section of the bucket overview.

gcp-1

Some table names including special characters such as ‘$’ and ‘.’ may not work with Google Cloud Storage Buckets as they cannot be safely expressed as a URI on Google Cloud Platform.

HBase

Description

Used for importing data from HBase.

Task Type Support

This connection type supports the following task types:

  • Data Migration

Data Migration Support

This connection can be used in a Data Migration.

Usable as Source Usable as Target Usable as Incremental Source Usable as Incremental Target

Connection String Templates

Template Name Description
Apache HBase The standard connection string for HBase, uses Server and Port.

Connection Notes

  • The username and password fields are the same fields you’d use to log into HBase.

HDFS

Description

Used for migrating data from various sources into the Hadoop File System over WebHDFS.

Task Type Support

This connection type supports the following task types:

  • Data Migration

Data Migration Support

This connection can be used in a Data Migration.

Usable as Source Usable as Target Usable as Incremental Source Usable as Incremental Target

Connection String Templates

Template Name Description
Hadoop The standard connection string for HDFS using WebHDFS.

Connection Notes

  • By default, WebHDFSPort=50070;.
  • Kerberos Authentication requires the Kerberos Domain and Username to impersonate to be provided.

Hive

Description

Used for running Hive SQL statements on a Hadoop instance.

Task Type Support

This connection type supports the following task types:

  • Hive

Connection String Templates

Template Name Description
Hive (Default Security) The default connection string for Hive using Host and DefaultSecurityUser
Hive (Kerberos) The Kerberos Credentials connection for Hive using Host.

Connection Notes

  • The username, password and domain fields are the same fields you’d use to log into Hive.

HPCC

Description

Used for importing Data from HPCC.

Task Type Support

This connection type supports the following task types:

  • Data Migration

Data Migration Support

This connection can be used in a Data Migration.

Usable as Source Usable as Target Usable as Incremental Source Usable as Incremental Target

Connection String Templates

Template Name Description
HPCC Systems The Standard Connection for HPCC uses URL, User, Password, Version and Cluster.

HubSpot 2018

Description

Used for pulling in Marketing & CRM data from a HubSpot instance.

HubSpot uses the OAuth Authentication standard. Additional Security required when using HubSpot. A Modal will display when generating a HupSpot connection asking for Client ID & Client Secret.

Unlike other OAuth based connections, Hubspot does not require a redirect URI so there is no need to generate one in Data Governor Online.

Task Type Support

This connection type supports the following task types:

  • Data Migration

Data Migration Support

This connection can be used in a Data Migration.

Usable as Source Usable as Target Usable as Incremental Source Usable as Incremental Target

Connection String Templates

Template Name Description
HubSpot Standard Standard OAuth refresh connection String

Connection Notes

  • The username and password fields are the same fields you’d use to log into HPCC.

  • The only required scope for a DG HubSpot account is “Basic OAuth Functionality” as Data Governor Online will automatically ask for all possible scopes associated with an account.

hubspot 1

JSON

Description

Json Standard for pulling in Data from the JSON format.

Task Type Support

This connection type supports the following task types:

  • Data Migration

Data Migration Support

This connection can be used in a Data Migration.

Usable as Source Usable as Target Usable as Incremental Source Usable as Incremental Target

Connection String Templates

Template Name Description
JSON The Standard JSON Connection Type

Connection Notes

  • JSON does not support OAUTH Connected Data Points.

JIRA

Description

The Connector importing data from JIRA.

Task Type Support

This connection type supports the following task types:

  • Data Migration

Data Migration Support

This connection can be used in a Data Migration.

Usable as Source Usable as Target Usable as Incremental Source Usable as Incremental Target

Connection String Templates

Template Name Description
JIRA The standard JIRA Connection String

Connection Notes

  • The username and password fields are the same fields you’d use to log into JIRA

Livy

Description

Used for connecting to a Hadoop cluster’s Spark instance so that Data Governor can execute Spark jobs remotely.

Task Type Support

This connection type supports the following task types:

  • Spark

Connection Notes

  • Like with Databricks and Azure Blob, the Livy connection type does not require a typical connection string and instead only needs the host URL of your Hadoop cluster.

  • If you require Kerberos/SPNEGO authentication you will need to provide the username and domain of the Kerberos user to impersonate.

MailChimp

Description

Marketing Automation platform that helps you share email.

Task Type Support

This connection type supports the following task types:

  • Data Migration

Data Migration Support

This connection can be used in a Data Migration.

Usable as Source Usable as Target Usable as Incremental Source Usable as Incremental Target

Connection String Templates

Template Name Description
MailChimp The Standard connection uses an APIKey that Mail Chimp Provides.

Connection Notes

  • The APIKey can be found on the MailChimp website under account.

Marketo

Description

Used to import marketing data from Marketo.

Task Type Support

This connection type supports the following task types:

  • Data Migration

Data Migration Support

This connection can be used in a Data Migration.

Usable as Source Usable as Target Usable as Incremental Source Usable as Incremental Target

Connection String Templates

Template Name Description
Marketo The connection string will require OAuth Client ID and Client Secret, as well as your Web Services REST API Endpoint.

Connection Notes

  • When creating a connection to Marketo, you will need to create an API user on Marketo to be able to connect.
  • Go into ‘LaunchPoint’ and create a new service.
  • Your Service field should be set to ‘Custom’ and then, select the API Only User to create credential details.
  • If you click into ‘view details’ of this created service you can find the ‘Client ID’ and ‘Client secret’ that will be used in the connection string.
  • The REST Endpoint can be found in ‘Web Services’ under ‘REST API Endpoint’.

Microsoft SQL Server

Description

Used for working with Microsoft SQL Server, works with both On-Premise and Azure Hosted SQL Server instances.

Task Type Support

This connection type supports the following task types:

  • Data Migration
  • SQL Statement
  • Stored Procedure

Data Migration Support

This connection can be used in a Data Migration.

Usable as Source Usable as Target Usable as Incremental Source Usable as Incremental Target

Connection String Templates

Template Name Description
SQL Server Standard The standard connection string for connecting to a SQL Server instance on the same server as the Agent, uses integrated SSPI security.
SQL Server SSAS Uses SSAS to connect to a SQL Server instance.
SQL Server Trusted Uses trusted security to connect to a SQL Server instance. This requires the agent to be running as a trusted account.
SQL Azure Standard Uses the Azure standard URL naming convention to connect to SQL Server.

Connection Notes

Microsoft Genomics Service

Description

Used for MSGen tasks

Task Type Support

This connection type supports the following task types:

  • MSGen

Connection Notes

  • The access key and Azure Genomics Service URL is used to log into the Microsoft Genomics Service

MongoDB

Description

Connection used for importing into and out of MongoDB.

Task Type Support

This connection type supports the following task types:

  • Data Migration

Data Migration Support

This connection can be used in a Data Migration.

Usable as Source Usable as Target Usable as Incremental Source Usable as Incremental Target

Connection String Templates

Template Name Description
MongoDB The Standard Connection for MongoDB that uses Server, Port, Database, User and Password.

Connection Notes

  • The username and password fields are the same fields you’d use to log into the MongoDB

MYOB AccountRight

Description

Used for sourcing data from MYOB AccountRight.

Data Governor Online only supports MYOB AccountRight desktop at this current time.

Task Type Support

This connection type supports the following task types:

  • Data Migration

Data Migration Support

This connection can be used in a Data Migration.

Usable as Source Usable as Target Usable as Incremental Source Usable as Incremental Target

Due to the schema of MYOB AccountRight’s tables, it’s highly recommended that target connections for MYOB AccountRight include some form of JSON parsing capabilities. For SQL Server, versions later than 2016 support JSON parsing using the built in JSON functions.

Connection String Templates

Template Name Description
MYOB AccountRight Local The standard connection string for connecting to MYOB AccountRight desktop instances.

Connection Notes

  • The username and password fields are the same fields you’d use to log in to MYOB AccountRight.

  • You may need to manually install the MYOB AccountRight API connector, learn more here..

  • If you don’t know what your host is and MYOB AccountRight is installed on the same computer as the agent, your connection string will be host=http://localhost:8080/accountright/;.

MySQL

Description

Used for sourcing data from a MySQL server.

Task Type Support

This connection type supports the following task types:

  • Data Migration

Data Migration Support

This connection can be used in a Data Migration.

Usable as Source Usable as Target Usable as Incremental Source Usable as Incremental Target

Connection String Templates

Template Name Description
MySQL The standard MySQL connection string.

Connection Notes

  • The default port for MySQL Servers is 3306.

NationBuilder

Description

Used for sourcing data from NationBuilder.

Task Type Support

This connection type supports the following task types:

  • Data Migration

Data Migration Support

This connection can be used in a Data Migration.

Usable as Source Usable as Target Usable as Incremental Source Usable as Incremental Target

Connection String Templates

Template Name Description
NationBuilder The standard NationBuilder connection string.

Connection Notes

  • The connection string requires both a NationBuilder instance slug and API access token.

OData

Description

Used for importing data from an OData service.

Task Type Support

This connection type supports the following task types:

  • Data Migration

Data Migration Support

This connection can be used in a Data Migration.

Usable as Source Usable as Target Usable as Incremental Source Usable as Incremental Target

Connection String Templates

Template Name Description
OData (No Authentication) The standard OData connection string for working with unauthenticated endpoints.
OData (Basic Authentication) The OData connection string for working with Basic/Digest authentication.
OData (Authorization Header) The OData connection string for working with endpoints secured by tokens passed in the Authorization header.

Connection Notes

  • Providing multiple headers to the CustomHeaders property can be done by separating each header: value with a new line.

ODBC

Description

Used for connecting to a wide range of data sources over an ODBC DSN.

Task Type Support

This connection type supports the following task types:

  • Data Migration

Data Migration Support

This connection can be used in a Data Migration.

Usable as Source Usable as Target Usable as Incremental Source Usable as Incremental Target

Connection String Templates

Template Name Description
ODBC Uses the provided DSN name to connect over ODBC to the data source.

Connection Notes

  • The ODBC connection requires some additional configuration on the Agent host as a DSN must be configured before attempting to use the connection.

  • DSN’s should be configured at a System Level for best results.

  • Recommend DSN Configuration Guides

PostgreSQL

Description

Used for sourcing data from a PostgreSQL

Task Type Support

This connection type supports the following task types:

  • Data Migration

Data Migration Support

This connection can be used in a Data Migration.

Usable as Source Usable as Target Usable as Incremental Source Usable as Incremental Target

Connection String Templates

Template Name Description
PostgreSQL The Standard Connection for PostgreSQL that uses Server, Port, Database, User and Password.

Connection Notes

  • The username and password fields are the same fields you’d use to log into the PostgreSQL

SAGE 50 UK

Description

Used for sourcing data from Sage 50

Task Type Support

This connection type supports the following task types:

  • Data Migration

Data Migration Support

This connection can be used in a Data Migration.

Usable as Source Usable as Target Usable as Incremental Source Usable as Incremental Target

Connection String Templates

Template Name Description
Sage 50 UK The standard connection string for working with a Sage 50 UK application.

Connection Notes

  • The Connection is linked with a URL, User, Password.

Salesforce

Description

Used for importing data from a Salesforce service.

Task Type Support

This connection type supports the following task types:

  • Data Migration

Data Migration Support

This connection can be used in a Data Migration.

Usable as Source Usable as Target Usable as Incremental Source Usable as Incremental Target

Connection String Templates

Template Name Description
Salesforce Standard User, Password and the Security Token

Connection Notes

  • The security Token is from Salesforce
  • Users can use OAuth authentication

Salesforce Chatter

Description

Used for sourcing data from Salesforce Chatter

Task Type Support

This connection type supports the following task types:

  • Data Migration

Data Migration Support

This connection can be used in a Data Migration.

Usable as Source Usable as Target Usable as Incremental Source Usable as Incremental Target

Connection Notes

  • The username and password fields are the same fields you would use to log into Salesforce Chatter
  • Users can use OAuth authentication

Salesforce Marketing Cloud

Description

Used for importing data from Salesforce Marketing Cloud.

Task Type Support

This connection type supports the following task types:

  • Data Migration

Data Migration Support

This connection can be used in a Data Migration.

Usable as Source Usable as Target Usable as Incremental Source Usable as Incremental Target

Connection String Templates

Template Name Description
Salesforce Marketing Cloud Used for setting the instance of Marketing Cloud that is being targeted, that is S10 by default.

Connection Notes

  • Username and Password are that of the Salesforce Marketing Account API user you wish to login as.

  • The account used for the connection must have the API User setting enabled:

API user

  • The Administration permission must be allowed for the API user so that Data Governor is able to retrieve the schema for Marketing Cloud.

Admin Permission

Data Governor Online only performs read operations on Salesforce Marketing Cloud and will never modify or add any data to the instance.

SAP

Description

Used for importing Data from SAP.

Task Type Support

This connection type supports the following task types:

  • Data Migration

Data Migration Support

This connection can be used in a Data Migration.

Usable as Source Usable as Target Usable as Incremental Source Usable as Incremental Target

Connection String Templates

Template Name Description
SAP NetWeaver The Standard connection string requires Host, User, Password, Client, System Number, ConnectionType and Location.

Connection Notes

  • The username and password fields are the same fields you’d use to log into SAP.

SharePoint

Description

Used for importing Data from the SharePoint.

Task Type Support

This connection type supports the following task types:

  • Data Migration

Data Migration Support

This connection can be used in a Data Migration.

Usable as Source Usable as Target Usable as Incremental Source Usable as Incremental Target

Connection String Templates

Template Name Description
MicrosoftSharePoint (On-premise & Online) The Standard connection string requires User, Password, Auth Scheme, URL

Connection Notes

  • The username and password fields are the same fields you’d use to log into SharePoint Account.

Snowflake Data Warehouse

Description

Used for working with Snowflake data warehouse.

Task Type Support

This connection type supports the following task types:

  • Data Migration

Data Migration Support

This connection can be used in a Data Migration.

Usable as Source Usable as Target Usable as Incremental Source Usable as Incremental Target

Connection String Templates

Template Name Description
Snowflake The standard Snowflake connection string-requires details such as the host, account, database and warehouse to connect to.

Connection Notes

  • The username and password fields for this connection type should be your Snowflake Data Warehouse credentials.

  • When using the connection string the YOUR_FULL_HOST can contain your YOUR_ACCOUNT values as shown below:

  • Conection String Template:

 "account=YOUR_ACCOUNT;host=YOUR_FULL_HOST.snowflakecomputing.com;db=YOUR_DATABASE;"

  • Connection String Example:
 "account=Perspective;host=perspective.ap-southeast-2.snowflakecomputing.com;db=DEMO_WH;WAREHOUSE=DEMO_WH"

  • Reader Connection String Example:
"account=readeraccount01;host=perspective.ap-southeast-2.snowflakecomputing.com;db=DGDatabase;WAREHOUSE=DEMO_WH"

  • Snowflake Data Migrations require a staging connection and staging file definition that is a blob based connection such as Azure Blob and a blob file definition respectively.

  • When performing a Data Migration from a Snowflake Source to a different Snowflake Target it will require a staging connection or internal staging. SnowSQL is required to be installed on the same host as the Agent if you wish to perform internal staging.

  • Learn more about Snowflake Data Warehouse here.

When using an internal stage for Snowflake connections users will have to install SnowSQL. Users will also have to restart their Agent if they install SnowSQL in an existing running Agent.

Sugar CRM

Description

Used for importing data from a Sugar CRM instance.

Task Type Support

This connection type supports the following task types:

  • Data Migration

Data Migration Support

This connection can be used in a Data Migration.

Usable as Source Usable as Target Usable as Incremental Source Usable as Incremental Target

Connection String Templates

Template Name Description
Sugar CRM The default connection string for Sugar CRM.

Connection Notes

  • It is highly recommended that for the Sugar CRM Connection you create a designated service account for Data Governor as this will avoid the potential of having any actual user information passed through Data Governor.

  • Currently Data Governor does not support including the user information through the secure user-password inputs, this feature is coming soon.

Square

Description

Used for importing Data from the Square.

Task Type Support

This connection type supports the following task types:

  • Data Migration

Data Migration Support

This connection can be used in a Data Migration.

Usable as Source Usable as Target Usable as Incremental Source Usable as Incremental Target

Connection Notes

  • The username and password fields are the same fields you’d use to log into Square.

RSS

Description

Used for importing Data from an RSS.

Task Type Support

This connection type supports the following task types:

  • Data Migration

Data Migration Support

This connection can be used in a Data Migration.

Usable as Source Usable as Target Usable as Incremental Source Usable as Incremental Target

Connection String Templates

Template Name Description
RSS The standard connection string for working with a xBase, uses a URL

Connection Notes

  • The username and password fields are the same fields you’d use to log into the RSS.

xBase

Description

Used for importing Data from xBase.

Task Type Support

This connection type supports the following task types:

  • Data Migration

Data Migration Support

This connection can be used in a Data Migration.

Usable as Source Usable as Target Usable as Incremental Source Usable as Incremental Target

Connection String Templates

Template Name Description
XBase The standard connection string for working with a xBase, uses a Data Source, Include Files.

Connection Notes

  • The username and password fields are the same fields you’d use to log into SharePoint Account.

XERO

Description

Used for importing data from a Xero instance, includes support for Xero Payroll.

Task Type Support

This connection type supports the following task types:

  • Data Migration

Data Migration Support

This connection can be used in a Data Migration.

Usable as Source Usable as Target Usable as Incremental Source Usable as Incremental Target

Connection String Templates

Template Name Description
XERO Standard The standard connection string for working with a XERO private application.
Xero Payroll Australia The connection string for querying payroll data in an Australian based XERO Private application.
Xero Payroll USA The connection string for querying payroll data in a United States based XERO Private application.

Due to limitations in the XERO connector utilised by Data Governor Online, you must create separate Xero connections if you wish to import data from both the standard and payroll Xero connections.

Connection Notes

  • The XERO connection type requires the creation of a Xero private application, to learn more about creating a XERO private application and the associated certificate used by Data Governor visit the Xero documentation.

  • Using the XERO connection type with a container based Agent does require the mounting of a volume as the certificate is accessed based on a file path.

XML

Description

Used for Importing Data from XML

Task Type Support

This connection type supports the following task types:

  • Data Migration

Data Migration Support

This connection can be used in a Data Migration.

Usable as Source Usable as Target Usable as Incremental Source Usable as Incremental Target

Connection String Templates

Template Name Description
XML The standard connection string for working with a XML, uses a GenerateSchemaFiles, XPath, URI and Location

Connection Notes

  • The username and password fields are the same fields you’d use to log into the XML Files

YouTube Analytics

Description

YouTube Analytics uses the OAuth authentication standard. You can use the OAuth credentials embedded in the provider or you can register an application with Google to obtain you own.

Task Type Support

This connection type supports the following task types:

  • Data Migration

Data Migration Support

This connection can be used in a Data Migration.

Usable as Source Usable as Target Usable as Incremental Source Usable as Incremental Target

Connection String Templates

Connection Notes

  • The Connection String is: “OAuthClientId=MyOAuthClientId; OAuthClientSecret=MyOAuthClientSecret; CallbackURL=http://localhost; ContentOwnerId=MyContentOwnerId; ChannelId=ChannelId;

YouTube Data 2018

Description

YouTube uses the OAuth Authentication. Additionally, set the Callback URL property. Set the OAuth Properties (OAuth Client ID and OAuth Client Secret), Developer Token and ClientCustomerID.

Task Type Support

This connection type supports the following task types:

  • Data Migration

Data Migration Support

This connection can be used in a Data Migration.

Usable as Source Usable as Target Usable as Incremental Source Usable as Incremental Target

Connection String Templates

Connection Notes

  • Connection String is “OAuthAccessToken=MyOAuthAccessToken”

Zoho CRM 2018

Description

Zoho allows developers to Migrate Data using the Zoho

Task Type Support

This connection type supports the following task types:

  • Data Migration

Data Migration Support

This connection can be used in a Data Migration.

Usable as Source Usable as Target Usable as Incremental Source Usable as Incremental Target

Connection String Templates

Template Name Description
Zoho CRM Standard AuthToken used for Zoho CRM 2018 Configuration

Zuora

Description

Used for migrating data from Zuora.

Task Type Support

This connection type supports the following task types:

  • Data Migration

Data Migration Support

This connection can be used in a Data Migration.

Usable as Source Usable as Target Usable as Incremental Source Usable as Incremental Target

Connection Notes