Skip to content

Commit

Permalink
update README (#8)
Browse files Browse the repository at this point in the history
  • Loading branch information
andygrove committed Jan 28, 2023
1 parent 99ccc19 commit ab23f22
Show file tree
Hide file tree
Showing 2 changed files with 8 additions and 11 deletions.
15 changes: 5 additions & 10 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,17 +1,8 @@
# RaySQL: DataFusion on Ray

This is an experimental research project to evaluate the concept of performing distributed SQL queries from Python, using
This is an experimental research project to evaluate the concept of performing distributed SQL queries from Python, using
[Ray](https://www.ray.io/) and [DataFusion](https://github.com/apache/arrow-datafusion).

## Motivation

This would make a good conference talk to demonstrate the power of building new query engines on top of the DataFusion
framework. This project currently contains of fewer than 1,000 lines of code.

## Status

- Prototype. Not ready for use at all.

## Example

See [examples/tips.py](examples/tips.py).
Expand All @@ -33,6 +24,10 @@ ctx.register_csv('tips', 'tips.csv', True)
ctx.sql('select sex, smoker, avg(tip/total_bill) as tip_pct from tips group by sex, smoker')
```

## Status

- Proof-of-concept. Not producing correct results yet.

## Features

- Mature SQL support (CTEs, joins, subqueries, etc) thanks to DataFusion
Expand Down
4 changes: 3 additions & 1 deletion src/proto/generated/protobuf.rs
Original file line number Diff line number Diff line change
Expand Up @@ -45,7 +45,9 @@ pub struct ShuffleWriterExecNode {
pub plan: ::core::option::Option<::datafusion_proto::protobuf::PhysicalPlanNode>,
/// how to partition - can be empty
#[prost(message, repeated, tag = "3")]
pub partition_expr: ::prost::alloc::vec::Vec<::datafusion_proto::protobuf::PhysicalExprNode>,
pub partition_expr: ::prost::alloc::vec::Vec<
::datafusion_proto::protobuf::PhysicalExprNode,
>,
/// number of output partitions
#[prost(uint32, tag = "4")]
pub num_output_partitions: u32,
Expand Down

0 comments on commit ab23f22

Please sign in to comment.