Skip to content
#

spark-streaming

Star

Here are 1,039 public repositories matching this topic...

Language: All
Filter by language
All 1,039 Scala 279 Python 271 Java 168 Jupyter Notebook 146 Shell 23 HTML 21 JavaScript 17 XSLT 14 CSS 9 C# 5
Sort: Recently updated
Sort options
Most stars Fewest stars Most forks Fewest forks Recently updated Least recently updated
risingwave

risingwavelabs / risingwave

Star 6.6k

SQL stream processing, analytics, and management. We decouple storage and compute to offer efficient joins, instant failover, dynamic scaling, speedy bootstrapping, and concurrent query serving.

rust postgres real-time sql database kafka big-data serverless etl analytics postgresql stream-processing data-engineering spark-streaming distributed-database cloud-native flink real-time-analytics materialized-view ksqldb
  • Updated Jul 26, 2024
  • Rust

DebanjanSarkar / pyspark-maestro

Star 0

This repo contains implementations of PySpark for real-world use cases for batch data processing, streaming data processing sourced from Kafka, sockets, etc., spark optimizations, business specific bigdata processing scenario solutions, and machine learning use cases.

json kafka spark python3 pyspark spark-streaming kafka-streams spark-sql spark-mllib kafka-python pyspark-mllib pyspark-api pyspark-streaming pyspark-machine-learning
  • Updated Jul 24, 2024
  • Jupyter Notebook

adnanrahin / Spark-Flights-Data-Analysis

Star 1

The U.S. Department of Transportation's (DOT) Bureau of Transportation Statistics tracks the on-time performance of domestic flights operated by large air carriers. Summary information on the number of on-time, delayed, canceled, and diverted flights is published in DOT's monthly Air Travel Consumer Report and in this dataset of 2015 flight dela…

java docker spark apache-spark maven docker-compose docker-container spark-streaming spark-sql big-data-analytics
  • Updated Jul 17, 2024
  • Scala

databrickslabs / dbldatagen

Star 291

Generate relevant synthetic data quickly for your projects. The Databricks Labs synthetic data generator (aka `dbldatagen`) may be used to generate large simulated / synthetic data sets for test, POCs, and other uses in Databricks environments including in Delta Live Tables pipelines

python spark faker pyspark spark-streaming data-generation databricks synthetic-data datagen datagenerator deltalake datageneration delta-live-tables
  • Updated Jul 26, 2024
  • Python

Improve this page

Add a description, image, and links to the spark-streaming topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the spark-streaming topic, visit your repo's landing page and select "manage topics."

Learn more