AI Agents & Automation

LookaheadDecoding is an open-source project designed to significantly accelerate Large Language Model (LLM) inference by breaking the traditional sequential dependency of token generation. This innovative approach utilizes a parallel decoding algorithm, eliminating the need for a draft model or a separate data store. Motivated by Jacobi decoding, LookaheadDecoding collects and caches n-grams from Jacobi iteration trajectories, enabling simultaneous processing of future tokens. The process is divided into a lookahead branch, which generates new n-grams within a defined window, and a verification branch, which validates promising candidates. This method has demonstrated substantial latency reductions, achieving speedups ranging from 1.5x to 2.3x on various datasets and models. The tool supports sampling and FlashAttention, and is implemented with an attention mask to maximize GPU parallel computing power, making it a valuable resource for optimizing LLM performance.

MCP-for-security provides a collection of Model Context Protocol (MCP) server implementations for various security testing tools, enabling their integration into AI workflows. This open-source project, developed by Cyprox, aims to combine artificial intelligence with security tools for advanced threat detection and automated responses. It supports a wide range of popular security tools including Amass, SQLmap, FFUF, NMAP, Masscan, and more, making them accessible through a standardized interface. Users can deploy these MCP servers via Docker or through manual setup, allowing for flexible integration into existing security and AI infrastructures. The project emphasizes community-driven development, speed, precision in automated threat detection, and a secure, transparent platform built on open standards.

Matterport3DSimulator is an AI research platform designed for deep reinforcement learning, computer vision, natural language processing, and robotics. It allows AI agents to interact with real 3D environments using visual information derived from panoramic RGB-D images. The simulator is based on the Matterport3D dataset, featuring 90 diverse indoor environments. Key capabilities include outputting real RGB and depth images, customizable image resolution and camera parameters, and support for off-screen rendering. It offers both C++ and Python APIs and is highly efficient, capable of around 1000 fps RGB-D off-screen rendering. The platform also includes the Room-to-Room (R2R) navigation dataset and task for training agents to follow natural language instructions.

Autotab is a general AI agent designed to automate repetitive tasks end-to-end with superhuman reliability. It learns workflows by observing human demonstrations, similar to how one would teach a human teammate. Autotab operates within its own secure, local browser, allowing it to navigate complex applications, collect data, fill out forms, and take actions such as sending messages or triggering refunds. It can be deployed in Fortune 500 companies and tech-forward businesses to scale operations where hiring and onboarding are bottlenecks. Users can teach Autotab specific workflows via video messages or prepared documents, and it can run these tasks 24/7, on demand, on a schedule, or triggered via API.

AMA - Medical AI is an iOS application designed to offer personalized health and wellness information. It serves as a comprehensive AI assistant for health, fitness, nutrition, and diet-related inquiries, aiming to provide precise, fast, and personalized answers. Users can download the app from the App Store and leverage its AI capabilities to better understand their health and make informed decisions to improve their well-being. The tool focuses on delivering accurate and reliable health information, answering specific questions, and offering tailored health advice, making it a valuable resource for individuals seeking to enhance their health knowledge.

ImageToText.info is a free online OCR tool designed to accurately extract text from various image formats, including JPG, PNG, GIF, and PDF. Leveraging advanced AI technology, specifically tesseract-ocr, it offers high accuracy in converting visual text into editable digital formats. Users can upload, drag-and-drop, or paste image URLs to quickly convert single or batch images. The tool supports over 20 languages, allowing for diverse text extraction needs. Extracted text can be downloaded as a text file or copied to the clipboard, making it convenient for editing or integration into other documents. ImageToText.info emphasizes user privacy, stating no data is transmitted or stored, and offers a simple, registration-free experience for quick text extraction.

Deep-Learning-in-Production is a comprehensive GitHub repository curated by ahkarami, designed to serve as a valuable resource for deploying deep learning-based models in production environments. The repository compiles useful notes and references across various deep learning frameworks, including PyTorch, TensorFlow, Keras, and MXNet. It covers essential topics such as model conversion (e.g., PyTorch to C++, Keras to C++), model serving with tools like Flask, TorchServe, and TensorFlow Serving, and deployment on platforms like AWS Lambda and Kubernetes. Additionally, it provides insights into model quantization, speed optimization, and general deep learning deployment toolkits like OpenVINO and NVIDIA Triton Inference Server. The repository also includes resources for front-end and back-end development, mobile/embedded device deployment, and MLOps, making it a holistic guide for machine learning engineers and data scientists looking to operationalize their models.

The live website content for SapienAPI is entirely in Chinese and primarily displays information related to industrial equipment, such as various types of saws, cutting machines, and related accessories. There is no discernible information or mention of AI, search engines, or any related technology. The meta tags and homepage content are also in Chinese, focusing on industrial products and contact information for a company in Shijiazhuang. The original description of SapienAPI as an AI-powered search tool utilizing LLMs and real-time web data to find websites is not supported by the current live website content.

Bonza.Chat is an advanced AI platform designed for creating and interacting with personalized virtual AI companions. Users can customize their AI's appearance, personality traits, communication style, and interests to craft their ideal digital partner. The platform supports uncensored conversations, remembers past interactions for a more natural experience, and offers features like AI image generation. It functions directly in a web browser, making it accessible across various devices without requiring app downloads. Bonza.Chat provides a free plan for basic chat and offers premium subscriptions for unlimited messaging, advanced features, and NSFW content, focusing on emotional connection and personalized digital relationships.

DeepTutor is an agent-native personalized learning assistant designed to enhance the educational experience through adaptive and intelligent tutoring. It features a unified chat workspace with six modes, including Deep Solve, Quiz Generation, Deep Research, Math Animator, and Visualize, all sharing the same context. The AI Co-Writer acts as a first-class collaborator in a multi-document Markdown workspace, drawing from your knowledge base and the web to rewrite, expand, or summarize text. Its Book Engine compiles structured, interactive "living books" with 14 block types, such as quizzes, flashcards, and interactive demos. DeepTutor also includes a Knowledge Hub for building RAG-ready knowledge bases from various document types and persistent memory that builds a living profile of the user's learning journey. Personal TutorBots offer autonomous tutoring with their own memory, personality, and skill sets, evolving with the user.

DeepSeek-V3 is a powerful Mixture-of-Experts (MoE) language model featuring 671B total parameters, with 37B activated for each token, ensuring efficient inference and cost-effective training. Building on the DeepSeek-V2 architecture, it introduces an innovative auxiliary-loss-free strategy for load balancing and a multi-token prediction training objective for enhanced performance. The model was pre-trained on 14.8 trillion diverse tokens and further refined through Supervised Fine-Tuning and Reinforcement Learning. DeepSeek-V3 demonstrates superior performance against other open-source models and rivals top closed-source alternatives, particularly excelling in math and code tasks. It supports local deployment on various hardware and open-source community software, including SGLang, LMDeploy, and TensorRT-LLM, with options for FP8 and BF16 inference.

micro_diffusion is an open-source repository from Sony Research that provides a minimalistic implementation for training large-scale diffusion models from scratch with an extremely low budget. Utilizing only 37 million publicly available real and synthetic images, it can train a 1.16 billion parameter sparse transformer for approximately $1,890, achieving a strong FID score on the COCO dataset. The repository includes training code, dataset code, and pre-trained model checkpoints for off-the-shelf generation. It supports progressive training from low to high resolution and incorporates patch masking for performance optimization and reduced training time.

Deepdrive is an open-source simulator designed to facilitate experimentation and advancement in self-driving AI. It enables anyone with a PC to develop and test state-of-the-art autonomous driving systems within a realistic simulated environment. The simulator supports various AI agent types, including forward-agents, remote agents, and baseline agents like Mnet2 and C++ FSM/PID. Users can record training data for imitation learning, convert data to TFRecords, and train models using provided datasets or their own. Deepdrive offers detailed observation data, including vehicle dynamics, camera feeds (image, depth), and environmental information, all adhering to Unreal Engine conventions for units and rotations. It requires Linux, Python 3.6+, 10GB disk space, and 8GB RAM, with optional GPU requirements for baseline agents.

Meshed-Memory Transformer (M²) is an open-source project that provides the reference code for the paper "Meshed-Memory Transformer for Image Captioning" presented at CVPR 2020. This tool is designed for researchers and developers working in computer vision and natural language processing. It allows users to set up a conda environment, download necessary data like COCO annotations and detection features, and then evaluate or train their own image captioning models. The repository includes scripts for both testing and training, with configurable arguments for batch size, number of memory vectors, and learning rate scheduling. It requires Python 3.6 and specific data preparation steps to function correctly.

DeepResearcher is an open-source framework designed to scale deep research by training LLM-based agents using reinforcement learning in real-world web environments. This comprehensive tool facilitates end-to-end training, allowing agents to engage in authentic web search interactions. Qualitative analysis of the framework reveals emergent cognitive behaviors, including the ability to formulate plans, cross-validate information from multiple sources, self-reflect to redirect research, and maintain honesty when definitive answers are unavailable. DeepResearcher demonstrates significant performance improvements over prompt engineering and RAG-based baselines, emphasizing the critical role of end-to-end training in real-world settings for developing robust research capabilities.

Supplai is an AI-powered logistics platform designed to streamline freight operations across Saudi Arabia. It connects businesses with carriers, offering both Less Than Truckload (LTL) and Full Truckload (FTL) solutions across over 30 cities, including Riyadh, Jeddah, and Dammam. The platform digitalizes the freight process, providing features like order creation, live shipment tracking, real-time notifications, and digital documentation. Supplai aims to make freight simpler and smarter by offering competitive pricing, faster delivery times, and a no-warehousing model that minimizes handling and risk. It also focuses on sustainability by maximizing truck utilization and reducing CO2 emissions, making it an efficient and environmentally conscious choice for logistics.

Tech Screen is an AI-powered tool designed to help job seekers excel in technical interviews by providing real-time, undetectable assistance. It operates invisibly during screen sharing on major platforms such as Zoom, Google Meet, and Microsoft Teams, ensuring interviewers see no trace of the application. Key features include lightning-fast responses, precise answers, and a conversation mode that listens to system audio to provide instant solutions. The tool is highly customizable, allowing users to tailor prompts, programming languages, and interview types. Tech Screen boasts a 100% undetectable track record and offers a clean, intuitive interface with keyboard shortcuts for seamless operation, making it an invaluable asset for anyone looking to boost their interview success.

EMPRESS is an observability platform specifically designed for AI agents, enabling users to track every action an AI agent takes in xAPI format. This comprehensive tracking helps prove compliance with regulations like the EU AI Act, optimize agent performance, and scale AI operations with confidence. The platform records what agents do, why they do it, and the resulting outcomes, providing a full decision history and audit-ready logs. It allows users to search and filter decisions instantly, understand the reasoning behind each action, and export complete audit trails for compliance reports. EMPRESS also offers hundreds of pre-built skills to help users build and deploy agents for various tasks, from account management to content moderation, ensuring explainable decisions and improved agent behavior.

DeepLearningFrameworks is an open-source GitHub repository designed to be a "Rosetta Stone" for deep learning frameworks. Its primary goal is to enable data scientists to easily transfer their expertise from one framework to another by providing common setups and comparisons across different GPUs, CUDA versions, precision levels, and languages (Python, Julia, R). The project includes notebooks demonstrating CNN, DenseNet-121, ResNet-50, and RNN models, along with detailed performance metrics like training times and feature extraction speeds across frameworks such as Caffe2, Chainer, CNTK, MXNet, Keras (with various backends), Tensorflow, Lasagne, PyTorch, and Julia-Knet. It also offers valuable lessons learned regarding API usage, data handling, and performance optimization for various frameworks.

obsidian-local-gpt is an Obsidian plugin designed to bring local AI assistance directly into your notes, ensuring maximum privacy and offline access. It integrates with Ollama and OpenAI-like GPT models, enabling users to perform various AI actions on selected text and even images. The plugin offers a context menu for quick actions and an Action Palette for one-time tasks. Key features include the ability to use context from links, backlinks, and PDF files (RAG), and support for community actions that can be browsed and installed directly from the plugin settings. It supports multiple languages and is available through the Obsidian plugin store or BRAT, requiring the AI Providers plugin for configuration.

DLTK (Deep Learning Toolkit) is an open-source Python library designed for medical image analysis, leveraging the TensorFlow framework. It aims to facilitate rapid prototyping of deep learning models and ensure reproducibility in research applications within the medical imaging field. The toolkit provides state-of-the-art methods and models, accelerating research and development. It includes example applications and tutorial notebooks to help users understand its interface with TensorFlow, write custom read functions, and develop their own model functions. DLTK also features a Model Zoo with implementations of current research methodologies.

NMT-Keras is an open-source library designed for Neural Machine Translation (NMT) using the Keras framework. It provides implementations of both attentional recurrent neural network NMT models and Transformer NMT models. Key features include multi-GPU training for TensorFlow, Tensorboard integration, and online learning capabilities. The library supports various attention mechanisms like Bahdanau and Luong, along with double stochastic attention. Users can leverage beam search decoding, ensemble decoding, and model averaging for improved translation quality. It also offers support for GRU/LSTM networks, label smoothing, N-best list generation, and unknown words replacement. NMT-Keras facilitates the use of pretrained word embeddings and includes a client-server architecture for web demos, making it suitable for researchers and developers in the machine translation domain.

DiffusionDPO is a code repository from SalesforceAIResearch, offering the training code for "Diffusion Model Alignment Using Direct Preference Optimization." This tool is designed for researchers and developers working with diffusion models, providing scripts adapted from the diffusers library. It supports the alignment of models such as StableDiffusion1.5 and StableDiffusion-XL-1.0, with examples for running training on these models. The repository includes utilities for scoring models using various AI feedback mechanisms like PickScore, HPS, Aesthetics, and CLIP, along with notebooks for visualizing results and comparing generations. It's a valuable resource for those looking to fine-tune and evaluate diffusion models for specific preferences.

DiffusionDrive is a cutting-edge AI agent tool that introduces a novel truncated diffusion model specifically designed for real-time end-to-end autonomous driving. This innovative approach significantly enhances performance, achieving a 10x reduction in diffusion denoising steps, 3.5 times higher PDMS on NAVSIM, and 64% higher mode diversity compared to traditional diffusion policies. Accepted as a CVPR 2025 Highlight, DiffusionDrive demonstrates record-breaking 88.1 PDMS on the NAVSIM benchmark with a ResNet-34 backbone, all while operating at a real-time speed of 45 FPS. It is highly flexible, allowing integration with onboard sensor data and existing perception modules, making it a robust solution for developing advanced autonomous driving systems.