Skip to main content

Google BigQuery

What you need​

  • GCP project and dataset. A Google Cloud project and the dataset that will hold KoraBridge tables.
  • Service account key. The service account email and private key, with BigQuery write access.

Where to find it​

  • Google Cloud Console. The project ID is in the project settings. The service account email and private key are in the JSON key file you download when you create a key.
  • BigQuery. Confirm the dataset name, or choose the dataset KoraBridge should create or use.

Project ID​

The ID of the Google Cloud project that owns the dataset. It is the project_id value in the service account JSON key file, and also shown in the project picker of the Cloud Console. Use the ID, not the display name.

Service account email​

The client_email value in the JSON key file. It ends in .iam.gserviceaccount.com. The account needs the BigQuery Data Editor and BigQuery Job User roles on the project.

Private key​

The private_key value in the same JSON file. Copy the whole block from -----BEGIN PRIVATE KEY----- to -----END PRIVATE KEY-----. KoraBridge stores it encrypted.

Dataset name​

Optional. Each pipeline loads into its own dataset, which KoraBridge creates in your project. The service account needs permission to create datasets there.

Common mistakes​

  • Pasting only part of the private key instead of the full PEM block.
  • Using a service account without BigQuery dataset write permissions.