Discover how a bimodal integration strategy can address the major data management challenges facing your organization today.
Get the Report →How to create an RPA flow for BigQuery Data in UiPath Studio
Use the BigQuery ODBC Driver to create workflows that access real-time BigQuery data without any coding.
UiPath is a Robotic Process Automation (RPA) platform with rich features and an easy-to-use UI that enables non-developers to create process automation. By using UiPath Studio, you can build an RPA program just like drawing a diagram. With the CData ODBC Driver for Google BigQuery, users can embed BigQuery data in the workflow.
This article walks through using the BigQuery ODBC Driver in UiPath Studio to create an RPA program that accesses BigQuery data.
About BigQuery Data Integration
CData simplifies access and integration of live Google BigQuery data. Our customers leverage CData connectivity to:
- Simplify access to BigQuery with broad out-of-the-box support for authentication schemes, including OAuth, OAuth JWT, and GCP Instance.
- Enhance data workflows with Bi-directional data access between BigQuery and other applications.
- Perform key BigQuery actions like starting, retrieving, and canceling jobs; deleting tables; or insert job loads through SQL stored procedures.
Most CData customers are using Google BigQuery as their data warehouse and so use CData solutions to migrate business data from separate sources into BigQuery for comprehensive analytics. Other customers use our connectivity to analyze and report on their Google BigQuery data, with many customers using both solutions.
For more details on how CData enhances your Google BigQuery experience, check out our blog post: https://www.cdata.com/blog/what-is-bigquery
Getting Started
Configure the Connection to BigQuery
If you have not already, first specify connection properties in an ODBC DSN (data source name). This is the last step of the driver installation. You can use the Microsoft ODBC Data Source Administrator to create and configure ODBC DSNs.
Google uses the OAuth authentication standard. To access Google APIs on behalf of individual users, you can use the embedded credentials or you can register your own OAuth app.
OAuth also enables you to use a service account to connect on behalf of users in a Google Apps domain. To authenticate with a service account, you will need to register an application to obtain the OAuth JWT values.
In addition to the OAuth values, you will need to specify the DatasetId and ProjectId. See the "Getting Started" chapter of the help documentation for a guide to using OAuth.
Connect UiPath Studio to BigQuery Data
Now you are ready to use BigQuery data ODBC DSN in UiPath Studio with the following steps.
- From the Start page, click Blank to create a New Project.
- Click Manage Packages then search for and install UiPath.Database.Activities.
- Navigate to the Activities and drop a Flowchart (Workflow -> Flowchart -> Flowchart) onto the process.
- Drop a database Connect activity (App Integration -> Datbase -> Connect) after the Start activity.
- Double-click the Connect activity and configure the Connection.
- Click the Connection Wizard
- Select "Microsoft ODBC Data Source"
- In Connection Properties, select your DSN (CData GoogleBigQuery Source) and click OK
- To store Connection info, create a variable and bind to Output in the Properties section. Choose DatabaseConnection in Output.
Create an Execute Query Activity
With the connection configured, we are ready to query BigQuery data in our RPA.
- From the Activities navigation, select Execute Query and drop it on the Flowchart.
- Double-click the Execute Query activity and set the properties as follows:
- ExistingDbConnection: Your Connection variable
- Sql: SELECT statement like SELECT OrderName, Freight FROM Orders
- DataTable: Create and use a variable with the Type System.Data.DataTable
Create Write CSV Activity
With the Connection and Execute Query activities configured, we are ready to add a Write CSV activity to the Flowchart to replicate the BigQuery data.
- From the Activities navigation, select Write CSV and drop it after the Execute Query activity.
- Double-click the Write CSV activity and set the properties as follows:
- FilePath: Set to a file (new or existing) on disk (i.e.: C:\UiPath[id]-data.csv
- DataTable: Set to the DataTable variable you created earlier
Connect the Activities and Run the Flowchart
If they are not already connected, connect each Activity that you created to complete the RPA project for extracting BigQuery data and exporting it to CSV.
Click Run to extract BigQuery data and create a CSV file.
In this article, we used the CData ODBC Driver for Google BigQuery to create an automation flow that accesses BigQuery data in UiPath Studio. Download a free, 30-day trial of the ODBC Driver and start working with live BigQuery data in UiPath Studio today!