BigQuery

Note

BigQuery does not need to specify protocol.

Warning

Currently, BigQuery does not support to apply paritition on Query with limit clause. For example, cx.read_sql(conn, 'select * from table limit 10', parition_num=3, partition_on='int') will fail. If you want to fetch result from query with limit clause, please do not use partitioning.

BigQuery Connection

Authentication File: BigQuery connection need an authentication json file from Google Cloud Platform. If you do not have an authentication json file, you can create your BigQuery authentication here.

import connectorx as cx
authentication_file_path = '/home/user/path/auth.json'      # path to your authentication json file
conn = 'bigquery://' + authentication_file_path             # connection token
query = 'SELECT * FROM `database.dataset.table`'            # query string
cx.read_sql(conn, query)                                    # read data from BigQuery

BigQuery-Pandas Type Mapping

BigQuery Type	Pandas Type	Comment
Bool, Boolean	bool, boolean(nullable)
Int64, Integer	int64, Int64(nullable)
Float64, Float	float64
Numeric	float64
String	object
BYTES	object
Time	object
DATE	datetime64[ns]
Datetime	datetime64[ns]
TIMESTAMP	datetime64[ns]	UTC