Spice.ai OSS
What is Spice?β
Spice is a small, portable runtime that provides developers with a unified SQL query interface to locally materialize, accelerate, and query data tables sourced from any database, data warehouse, or data lake.
Spice makes it easy to build data-driven and data-intensive applications by streamlining the use of data and machine learning (ML) in software.
The Spice runtime is written in Rust and leverages industry leading technologies like Apache DataFusion, Apache Arrow, Apache Arrow Flight, and DuckDB.
Why Spice?β
Spice makes querying data by SQL across one or more data sources simple and fast. Easily co-locate a managed working set of your data with your application or ML, locally accelerated in-memory with Arrow, with SQLite/DuckDB, or with an attached database like PostgreSQL for high-performance, low-latency queries.
Before Spiceβ
With Spiceβ
Example Use-Casesβ
1. Faster applications and frontends. Accelerate and co-locate datasets with applications and frontends, to serve more concurrent queries and users with faster page loads and data updates.
2. Faster dashboards, analytics, and BI. Faster, more responsive dashboards without massive compute costs.
3. Faster data pipelines, machine learning training and inferencing. Co-locate datasets in pipelines where the data is needed to minimize data-movement and improve query performance.
4. Easily query many data sources. Federated SQL query across databases, data warehouses, and data lakes using Data Connectors.
Spice is under active alpha stage development and is not intended to be used in production until its 1.0-stable release. If you are interested in running Spice in production, please get in touch below so we can support you.
Intelligent Applicationsβ
Spice enables developers to build both data and AI-driven applications by co-locating data and ML models with applications. Read more about the vision to enable the development of intelligent AI-driven applications.
Connect with usβ
We greatly appreciate and value your support! You can help Spice in a number of ways:
- βοΈ Star this repo.
- Build an app with Spice and send us feedback and suggestions at hey@spice.ai or on Discord, X, or LinkedIn.
- File an issue if you see something not quite working correctly.
- Join our team (Weβre hiring!)
- Contribute code or documentation to the project (see CONTRIBUTING.md).
Weβre also starting a community call series soon!
Thank you for sharing this journey with us. π