pombredanne / bigquery_helper Goto Github PK

BigQuery_Helper is a helper class to simplify common read-only BigQuery tasks. It makes it easy to execute queries while you're learning SQL, and provides a convenient stepping stone on the path to using the core BigQuery python API. You can try it for yourself by forking this Kaggle kernel.

You can install BigQuery_Helper with the following command in your console:

pip install -e git+https://github.com/SohierDane/BigQuery_Helper#egg=bq_helper.

If you aren't running BigQuery_Helper on Kaggle, you will also need to go through the standard BigQuery client setup and authentication process.

This repo has only been tested on Python 3.6+.

• Each helper instance now logs the total bytes counted towards your quota or bill used across all queries run with that helper instance. You can access it with BigQueryHelper.total_gb_used_net_cache. Repeated queries are likely to the cache and may show up as 0 GB used.
• Queries that take longer than the maximum wait time, which defaults to 3 minutes, will be cancelled.
• Contributing to bq_helper should be easier now that there is a set of tests.

• query_to_pandas now returns an empty DataFrame when the query returns no results. Previously, this returned None.