Data Storage Optimisation

Alluxio is a virtual distributed storage system that enables data orchestration between computation frameworks and under...

Apache Arrow is an in-memory columnar data format designed for efficient data interchange and analytics. It provides a s...

Apache Druid is a high-performance, column-oriented, distributed data store designed for real-time analytics on large da...

Apache Hudi is an open-source data lake platform that enables incremental data processing and upserts on large-scale dat...

Apache Iceberg is an open table format designed for large-scale analytics workloads, enabling ACID transactions, schema ...

Apache Ignite is an in-memory computing platform that functions as a distributed database, caching layer, and processing...

Apache Parquet is an open-source columnar storage format optimized for efficient data storage and retrieval. It is desig...

Apache Pinot is a realtime distributed OLAP datastore designed to deliver low-latency analytics on large-scale datasets....

Chroma is an open-source embedding database designed for storing and querying vector embeddings efficiently. It speciali...

ClickHouse is a high-performance, column-oriented database management system designed for online analytical processing (...

Delta Lake is an open-source storage layer that provides ACID transactions, scalable metadata handling, and unified batc...

EdgeDB is an open-source database system that enhances PostgreSQL with a modern data model, graph query capabilities, an...

GPTCache is an open-source library designed to create a semantic cache for large language model (LLM) queries, reducing ...

InfluxDB is a time-series database designed to handle high write and query loads for metrics, events, and real-time anal...

Marqo is an open-source vector search engine designed for efficient indexing and retrieval of high-dimensional vector da...

Milvus is an open-source vector database designed for efficient storage, indexing, and retrieval of high-dimensional emb...

pgvector is an open-source extension for PostgreSQL that enables efficient storage and retrieval of vector embeddings, s...

PostgresML is a PostgreSQL extension that integrates machine learning directly into the database, allowing users to trai...

Redis is an open-source, in-memory data store that supports vector similarity search. It is suitable for AI/ML applicati...

Safetensors is a library for safely storing and distributing tensors, the fundamental data structures in machine learnin...

TimescaleDB is an AI agent in the Data Storage Optimisation category. ![](https://img.shields.io/github/stars/timescale/...

Weaviate is an AI agent in the Data Storage Optimisation category. ![](https://img.shields.io/github/stars/weaviate/weav...

Zarr is an AI agent in the Data Storage Optimisation category. ![](https://img.shields.io/github/stars/zarr-developers/z...