This repository contains experimental tools we developed to forecast a clusters' resource (CPU or memory) usage.

Borg cluster traces from Google

Kolmogorov Arnold Networks

The official PyTorch implementation of Google's Gemma models

An Open Standard for lineage metadata collection

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

OWASP dependency-check is a software composition analysis utility that detects publicly disclosed vulnerabilities in application dependencies.

A simple Java command-line utility to mirror the CVE JSON data from NIST.

Apache Spark docker container image (Standalone mode)

A simple spark standalone cluster for your testing environment purposses

Manage your license(s)

Examples of how to use Cloud Bigtable both with GCE map/reduce as well as stand alone applications.

Scripts to analyze Spark's performance

Generation of reports and graphs from the Spark events log files

Spark-Log-Parser

Includes notes on using Apache Spark in general, notes on using Spark for Physics, how to run TPCDS on PySpark, how to create histograms with Spark, tools for performance testing CPUs, Jupyter note…

Spark metrics related custom classes and sinks (e.g. Prometheus)

Apache Spark docker image

Master the command line, in one page

Specifications for OpenTelemetry

OpenTelemetry Go API and SDK

Distributed, offline-first bug tracker embedded in git, with bridges

The Metadata Platform for your Data Stack

☁️♮🏛 This repo contains several documents related to the operation of the CNCF. File non-technical issues related to CNCF here.

Running YARN on Kubernetes with PetSet controller.

Scalable, redundant, and distributed object store for Apache Hadoop

GCE metadata command line tool

Interactive tools and developer experiences for Big Data on Google Cloud Platform.