Connector
Google BigQuery Connector
Connect your BigQuery data warehouse to the rest of your systems, using a Google Cloud service account and no code.
Rapidi connects to Google BigQuery through its ODBC connection, using the Simba ODBC Driver for Google BigQuery. You create a Google Cloud service account with access to your project, enable the BigQuery API, and send Rapidi the service account key file. Rapidi then reads the design of your dataset so its tables can be mapped.
- What it connects to
- Google BigQuery, Google's fully managed, serverless data warehouse, with one project and dataset per connection.
- How it signs in
- A Google Cloud service account and its JSON key file.
- What you need
- A Google Cloud admin to enable the BigQuery API and create the service account.
What does this connector actually do?
The short version: BigQuery is reached as an ODBC data source, signed in with a service account, and Rapidi reads the tables in your dataset so you can map them.
| What it connects to | Google BigQuery. Each connection points at one BigQuery project and a default dataset in it. |
|---|---|
| How it connects | The ODBC connection type, set to the 3.0 Driver, with the Simba ODBC Driver for Google BigQuery named in the Server Connect field. |
| How it signs in | A Google Cloud service account. The connection carries the service account email address and points to its JSON key file. |
| What Rapidi needs from you | The service account email, the JSON key file, your BigQuery project ID and the dataset ID. |
| What it reads | The tables in your dataset, loaded with Read Design so their fields can be mapped. |
| Writing into BigQuery | The setup guide covers connecting and reading the design. If you need data written into BigQuery, ask us and we will check it for your dataset. |
| How often it runs | On a schedule you set. The shortest interval depends on your plan, from one hour on Entry down to one minute on Unlimited. |
| Checks before go-live | Test confirms Rapidi can reach BigQuery, and Read Design loads the tables and fields. |
How do you set up the BigQuery connection?
Most of the work happens in Google Cloud. The rest is one connection string in MyRapidi.
- In the Google Cloud Console, create or select a project and make sure billing is enabled for it.
- In APIs and Services, enable the BigQuery API for that project.
- In IAM and Admin, create a service account with the permissions it needs, and download its key file in JSON format.
- Send Rapidi the key file. Rapidi adds its own service and database IDs to the key file path in the connection.
- In MyRapidi, create a connection of type ODBC, give it a description such as Google BigQuery service account, and choose 3.0 Driver as the ODBC version.
- In Server Connect, enter the Simba ODBC Driver for Google BigQuery with the service account email, the key file path, your project ID as the catalog, and your dataset ID as the default dataset, separated by semicolons.
- Press Test, then Read Design, to finish the connection.
What else connects this way?
BigQuery sits alongside the other databases Rapidi connects to.
Connector
Microsoft SQL Server
The other database connector with a page of its own, reached through RapidiConnector.
Databases and Warehouses
Category
Databases and Warehouses
SQL Server, MySQL, Oracle, IBM DB2, SQLite and BigQuery.
See the category
Platform
The Rapidi iPaaS
How Rapidi joins applications and databases in the cloud and on premises.
Platform
Where do you go next?
Connectors
Every system Rapidi connects to
The full list, A to Z, with versions and how each one connects.
All connectors
Pricing
What Rapidi costs
Four plans, priced per subscription rather than per connector.
Plans
Your setup
Ask about your BigQuery project
Tell us which dataset you use and where the data has to go, and we will say plainly what the setup involves.
Talk to a consultant
Frequently asked questions
Can Rapidi connect to Google BigQuery?
Yes. BigQuery is reached through the ODBC connection type with the Simba ODBC Driver for Google BigQuery, and the connection is set up in MyRapidi rather than written as code.
What do we need to set up in Google Cloud?
A project with billing enabled, the BigQuery API switched on, and a service account with the permissions it needs. You download that service account's key file in JSON format.
What does Rapidi need from us?
The service account email address, the JSON key file, your BigQuery project ID and the dataset ID for the connection.
Do we need to install anything?
The BigQuery setup guide lists no software to install on your side. The work is in Google Cloud, plus sending Rapidi the key file.
Can Rapidi write data into BigQuery?
The setup guide covers connecting and reading the design of your dataset. If you need data written into BigQuery, tell us what and where, and we will check it with you before you rely on it.
How often does the data move?
On a schedule you set. The shortest interval comes from your plan, from one hour on Entry down to one minute on Unlimited.
What does the BigQuery connector cost?
Nothing on its own. Rapidi is priced per subscription plan rather than per connector, so adding BigQuery does not change the licence.
Is BigQuery one of your systems?
Tell us which dataset you use and what it has to connect to, and we will tell you plainly what the setup involves.