Introduction
The BigQuery adapter can be used in maps and flows to read and write rows in BigQuery tables.
The features supported by the adapter include:
- Connecting to the BigQuery service using the provided GCP service account credentials
- Testing the configured connection at design time
- Discovering available datasets and tables at design time
- Generating schemas to represent the structure of tables or query results
- Retrieving records from a table or query
- Writing records to a table using SQL statement or load job
- Running SQL script once before or after reading and writing records
- Running parameterized query with named query parameters provided in the input data
- Using Null marker value to indicate NULL values of fields and query parameters
- Supporting multiple formats for representing BigQuery BOOL, FLOAT64, and BYTES data types