Introduction

The BigQuery adapter can be used in maps and flows to read and write rows in BigQuery tables.

The features supported by the adapter include:

  • Connecting to the BigQuery service using the provided GCP service account credentials
  • Testing the configured connection at design time
  • Discovering available datasets and tables at design time
  • Generating schemas to represent the structure of tables or query results
  • Retrieving records from a table or query
  • Writing records to a table using SQL statement or load job
  • Running SQL script once before or after reading and writing records
  • Running parameterized query with named query parameters provided in the input data
  • Using Null marker value to indicate NULL values of fields and query parameters
  • Supporting multiple formats for representing BigQuery BOOL, FLOAT64, and BYTES data types