Connect to HCL Domino Data in Airbyte ELT Pipelines

Airbyte empowers users to load your data into any data warehouse, data lake, or database. When combined with CData Connect Cloud, Airbyte users can create Extract, Load, Transform (ELT) pipelines directly from live HCL Domino data. This article illustrates the process of connecting to HCL Domino through Connect Cloud and constructing ELT pipelines for HCL Domino data within Airbyte.

CData Connect Cloud offers a dedicated SQL Server interface for HCL Domino, facilitating data querying without the need for data replication to a native database. With built-in optimized data processing capabilities, CData Connect Cloud efficiently directs all supported SQL operations, including filters and JOINs, straight to HCL Domino. This harnesses server-side processing to swiftly retrieve the desired HCL Domino data.

Configure HCL Domino Connectivity for Airbyte

Connectivity to HCL Domino from Airbyte is made possible through CData Connect Cloud. To work with HCL Domino data from Airbyte, we start by creating and configuring a HCL Domino connection.

1. Log into Connect Cloud, click Connections and click Add Connection
2. Select "HCL Domino" from the Add Connection panel
3. Enter the necessary authentication properties to connect to HCL Domino.

   Prerequisites

   The connector requires the Proton component to be installed. Normally, Proton is distributed as part of the AppDev pack. See the HCL documentation for instructions on acquiring and installing Proton or the AppDev pack.

   Once the Proton service is installed and running, you will also need to create a user account and download its Internet certificate. This certificate can be used to set the connector certificate connection properties.

   Authenticating to Domino

   • Server: The name or IP address of the server running Domino with the Proton service.
   • Port: The port number that the Proton service is listening on.
   • Database: The name of the database file, including the .nsf extension.
   • SSLClientCertType: This must match the format of the certificate file. Typically this will be either PEMKEY_FILE for .pem certificates or PFXFILE for .pfx certificates.
   • SSLClientCert: The path to the certificate file.
   • SSLServerCert: This can be set to (*) if you trust the server. This is usually the case, but if you want to perform SSL validation, you may provide a certificate or thumbprint instead. See the documentation for SSLServerCert for details.

   Additional Server Configuration

   The connector supports querying Domino views if any are defined. Before views can be queried by the connector they must be registered with the design catalog.

   Please refer to the Catalog Administration section of the AppDev pack documentation for details on how to do this.

4. Click Create & Test
5. Navigate to the Permissions tab in the Add HCL Domino Connection page and update the User-based permissions.

Add a Personal Access Token

If you are connecting from a service, application, platform, or framework that does not support OAuth authentication, you can create a Personal Access Token (PAT) to use for authentication. Best practices would dictate that you create a separate PAT for each service, to maintain granularity of access.

1. Click on your username at the top right of the Connect Cloud app and click User Profile.
2. On the User Profile page, scroll down to the Personal Access Tokens section and click Create PAT.
3. Give your PAT a name and click Create.
4. The personal access token is only visible at creation, so be sure to copy it and store it securely for future use.

Connect to HCL Domino from Airbyte

To establish a connection from Airbyte to CData Connect Cloud, follow these steps.

1. Log in to your Airbyte account
2. On the left panel, click Sources, then Add New Source
3. Set Source Type to MSSQL Server to connect the TDS endpoint
4. Set Source Name
5. Set Host URL to tds.cdata.com
6. Set Port to 14333
7. Set Database to the name of the connection you previously configured, e.g. Domino1.
8. Set Username to your Connect Cloud username
9. Set SSL Method to Encrypted (trust server certificate), leave the Replication Method as standard, and set SSH Tunnel Method to No Tunnel
10. (Optional) Set Schema to anything you want to apply to the source
11. Set Password to your Connect Cloud PAT
12. (Optional) Enter any needed JBDC URL Params
13. Click Test and Save to create the data source.

Create ELT Pipelines for HCL Domino Data

To connect HCL Domino data with a new destination, click Connections and then Set Up Connection to connect to your destination. Select the source created above and your desired destination, then allow Airbyte to process. When it is done, your connection is ready for use.

Get CData Connect Cloud

To get live data access to 100+ SaaS, Big Data, and NoSQL sources directly from Airbyte, try CData Connect Cloud today!