Connector
Google BigQuery
Last updated:
Visier can retrieve data through this connector if the following requirements are met.
Prerequisites
Create an integration user in Google BigQuery.
Integration user
Create an integration user in your source system and assign it the appropriate security access so that Visier can retrieve your source data through this user.
Access | Description |
|---|---|
IAM roles | Assign the following roles to the integration user: BigQuery Data Viewer BigQuery Job User BigQuery User BigQuery Admin |
Connector credentials
You need to provide the following credentials to Visier so that we can retrieve data from your source system.
Credential | Description | Example |
|---|---|---|
Project ID | The unique identifier of the project to retrieve data from. | ID123 |
Dataset Region | The region in which your BigQuery data is stored. For more information, see BigQuery locations. | us-west1 |
OAuth Refresh Token | The integration user’s refresh token. For more information, see Token types. | 1//98jX00-AmKJdMCgYIARAAGAQSNwF-L9IrlUQlXl_Q-zIcluswxSJtJsz-sPKsv6j7X6vjRheKusfqPk9rGOtzhVM8kE6pZw55-PW |
Client ID | The integration user’s client ID. | IntegrationUser |
Client Secret | The integration user’s client secret. | RINKPX-7LwauKZg83WvY_98_OEZV2-Lill9 |
Default Dataset | The default schema for unqualified tables; for example, if a table does not have an assigned schema, use this dataset as the schema. | data_h |
Data files
The Google BigQuery data connector only retrieves data stored in BigQuery for use in Visier.
For other data, you must provide that data through alternative methods such as SFTP or Visier’s other data connectors.
How the connector loads data
Initially, data connectors retrieve a full history for each subject to generate an initial history of events. In each subsequent data retrieval, each connector handles the data load differently.
Full load: All data from the source system is loaded into Visier.
Delta load: Only changed data is loaded into Visier. A delta load may take either the entire history or a specific number of years of history for each changed record.
Snapshot load: All data at a particular point in time. A snapshot load does not contain historical records or show changes over time.
Partial load: A subset of data is loaded into Visier.
This connector retrieves snapshot data for a particular date and time.
However, the data type and key/updated fields can be configured so the connector only retrieves data for changed records.