Skip to content

Allow DataFusion to resolve queries across remote query engines while pushing down as much compute as possible down.

License

Notifications You must be signed in to change notification settings

rajantikare/datafusion-federation

 
 

Repository files navigation

DataFusion Federation

crates.io docs.rs

The goal of this repo is to allow DataFusion to resolve queries across remote query engines while pushing down as much compute as possible down.

Check out the examples to get a feel for how it works.

Potential use-cases:

  • Querying across SQLite, MySQL, PostgreSQL, ...
  • Pushing down SQL or Substrait plans.
  • DataFusion -> Flight SQL -> DataFusion
  • ..

Status

The project is in alpha status. Contributions welcome; land a PR = commit access.

About

Allow DataFusion to resolve queries across remote query engines while pushing down as much compute as possible down.

Resources

License

Stars

Watchers

Forks

Packages

No packages published

Languages

  • Rust 99.8%
  • JavaScript 0.2%