GPU Development in Python 101 tutorial

Ibis tutorial repository

Comparing DataFusion with DuckDB based on ClickBench, H2O, and TPC-H

Prepping tables for machine learning

Generate Parquet Files

This is the development home of the workflow management system Snakemake. For general information, see

A DSL for data-driven computational pipelines

Python pathlib-style classes for cloud storage services such as Amazon S3, Azure Blob Storage, and Google Cloud Storage.

The WeightWatcher tool for predicting the accuracy of Deep Neural Networks

A logical, reasonably standardized, but flexible project structure for doing and sharing data science work.

Reference implementation for real-time Data Lineage tracking for BigQuery using Audit Logs, ZetaSQL and Dataflow.

A massively parallel, high-level programming language

Code for the book "Software Engineering for Data Scientists"

Toolkit for installing and creating an initial database on Bare Metal Solution

Waverunner, a database migration tool to help organize and migrate databases at scale.

daft-hudi-examples

DMT is an end to end automation of data warehouse migration, focused on extraction, SQL translation, data migration, data validation, etc. The main goal is to reduce migration delivery time

Analyzing FEMA's National Flood Insurance Program (NFIP) Data With DuckDB.

Create backups of BigQuery datasets/tables

[DEPRECATED] GAE python based app which regularly collects information about GCP resources and stores them in BigQuery

A topic-centric list of HQ open datasets.

A list of publicly available datasets with real-time data maintained by the team at bytewax.io

Community Security Analytics provides a set of community-driven audit & threat queries for Google Cloud