Search External Azure Data Lake Storage Objects in Salesforce Connect

CData Connect Server, enables you to access Azure Data Lake Storage data from cloud-based applications like the Salesforce console and mobile applications like the Salesforce1 Mobile App. In this article, you will use CData Connect Server and Salesforce Connect to access external Azure Data Lake Storage objects alongside standard Salesforce objects.

Configuring Connect Server

To work with live Azure Data Lake Storage data in Salesforce Connect, we need to connect to Azure Data Lake Storage from Connect Server, provide user access to the new virtual database, and create OData endpoints for the Azure Data Lake Storage data.

Add a Connect Server User

Create a User to connect to Azure Data Lake Storage from Reveal through Connect Server.

1. Click Users -> Add
2. Configure a User
3. Click Save Changes and make note of the Authtoken for the new user

Connect to Azure Data Lake Storage from Connect Server

CData Connect Server uses a straightforward, point-and-click interface to connect to data sources and generate APIs.

1. Open Connect Server and click Connections
2. Select "Azure Data Lake Storage" from Available Data Sources
3. Enter the necessary authentication properties to connect to Azure Data Lake Storage.
   
   

   Authenticating to a Gen 1 DataLakeStore Account

   Gen 1 uses OAuth 2.0 in Azure AD for authentication.

   For this, an Active Directory web application is required. You can create one as follows:

   1. Sign in to your Azure Account through the .
   2. Select "Azure Active Directory".
   3. Select "App registrations".
   4. Select "New application registration".
   5. Provide a name and URL for the application. Select Web app for the type of application you want to create.
   6. Select "Required permissions" and change the required permissions for this app. At a minimum, "Azure Data Lake" and "Windows Azure Service Management API" are required.
   7. Select "Key" and generate a new key. Add a description, a duration, and take note of the generated key. You won't be able to see it again.

   To authenticate against a Gen 1 DataLakeStore account, the following properties are required:

   • Schema: Set this to ADLSGen1.
   • Account: Set this to the name of the account.
   • OAuthClientId: Set this to the application Id of the app you created.
   • OAuthClientSecret: Set this to the key generated for the app you created.
   • TenantId: Set this to the tenant Id. See the property for more information on how to acquire this.
   • Directory: Set this to the path which will be used to store the replicated file. If not specified, the root directory will be used.

   Authenticating to a Gen 2 DataLakeStore Account

   To authenticate against a Gen 2 DataLakeStore account, the following properties are required:

   • Schema: Set this to ADLSGen2.
   • Account: Set this to the name of the account.
   • FileSystem: Set this to the file system which will be used for this account.
   • AccessKey: Set this to the access key which will be used to authenticate the calls to the API. See the property for more information on how to acquire this.
   • Directory: Set this to the path which will be used to store the replicated file. If not specified, the root directory will be used.
4. Click Save Changes
5. Click Privileges -> Add and add the new user (or an existing user) with the appropriate permissions (SELECT is all that is required for Reveal).

Add Azure Data Lake Storage OData Endpoints in Connect Server

After connecting to Azure Data Lake Storage, create OData Endpoints for the desired table(s).

1. Click OData -> Tables -> Add Tables
2. Select the Azure Data Lake Storage database
3. Select the table(s) you wish to work with and click Next
4. (Optional) Edit the table definition to select specific fields and more
5. Save the settings

(Optional) Configure Cross-Origin Resource Sharing (CORS)

When accessing and connecting to multiple different domains, there is a possibility of violating the limitations of cross-site scripting. In that case, configure the CORS settings in OData -> Settings.

• Enable cross-origin resource sharing (CORS): ON
• Allow all domains without '*': ON
• Access-Control-Allow-Methods: GET, PUT, POST, OPTIONS
• Access-Control-Allow-Headers: Authorization

Save the changes to the settings.

Connect to Azure Data Lake Storage Data as an External Data Source

Follow the steps below to connect to the feed produced by the API Server.

1. Log into Salesforce and click Setup -> Integrations -> External Data Sources.
2. Click New External Data Source.
3. Enter values for the following properties:
   • External Data Source: Enter a label to be used in list views and reports.
   • Name: Enter a unique identifier.
   • Type: Select the option "Salesforce Connect: OData 4.0".

   • URL: Enter the URL to the OData endpoint of the API Server. The format of the OData URL is CONNECT_SERVER_URL/api.rsc/

4. Select JSON in the Format menu.

5. In the Authentication section, set the following properties:
   • Identity Type: If all members of your organization will use the same credentials to access the API Server, select "Named Principal". If the members of your organization will connect with their own credentials, select "Per User".
   • Authentication Protocol: Select Password Authentication to use basic authentication.
   • Certificate: Enter or browse to the certificate to be used to encrypt and authenticate communications from Salesforce to your server.
   • Username: Enter the username for a user known to CData Connect Server.
   • Password: Enter the user's authtoken.

Synchronize Azure Data Lake Storage Objects

After you have created the external data source, follow the steps below to create Azure Data Lake Storage external objects that reflect any changes in the data source. You will synchronize the definitions for the Azure Data Lake Storage external objects with the definitions for Azure Data Lake Storage tables.

1. Click the link for the external data source you created.
2. Click Validate and Sync.
3. Select the Azure Data Lake Storage tables you want to work with as external objects.

Access Azure Data Lake Storage Data as Salesforce Objects

After adding Azure Data Lake Storage data as an external data source and syncing Azure Data Lake Storage tables as external objects, you can use the external Azure Data Lake Storage objects just as you would standard Salesforce objects.

• Create a new tab with a filter list view:

• Create reports of external objects:

Simplified Access to Azure Data Lake Storage Data from Applications

At this point, you have a direct connection to live Azure Data Lake Storage data from Salesforce. For more information on gaining simplified access to data from more than 100 SaaS, Big Data, and NoSQL sources in applications like Salesforce, refer to our Connect Server page.