llm-app

VectorFlow is an open-source, high-throughput vector embedding pipeline. It ingests raw data and transforms it into vectors. The tool writes the vectors to a vector database. VectorFlow provides a simple API endpoint for processing and storing vectors quickly and reliably.

mcp-clickhouse is a tool to connect ClickHouse to AI assistants. It allows execution of SQL queries on a ClickHouse cluster. The tool also provides functionalities to list all databases and tables on the cluster. It is available as an open-source project on GitHub.

cocoindex is a data transformation framework for AI applications. It is designed for high performance and supports incremental processing. The framework is open-source and aims to facilitate efficient data pipelines for AI model training. It enables data scientists and engineers to transform data effectively.

Kedro is a toolbox for creating production-ready data science pipelines. It uses software engineering best practices to help create reproducible, maintainable, and modular data engineering and data science pipelines. Kedro facilitates efficient and collaborative data science workflows.

Alluxio is an open-source data orchestration system for analytics and machine learning in the cloud. It provides a unified interface for accessing data stored in various storage systems. Alluxio helps improve data locality and reduces data access latency for AI and data-intensive applications. It is designed to be deployed in cloud environments.

Mosaico is a data platform designed for Robotics and Physical AI. It streamlines data management, compression, and search. Mosaico replaces monolithic files with a structured archive. It is powered by Rust and Python.