Coding & Development

trackio is a lightweight, local-first, and free experiment tracking library built by Hugging Face, designed for both human users and AI agents. It stores logs in an SQLite database, supporting high throughput for parallel experiments, and allows for easy querying via a CLI interface. The library is API compatible with `wandb.init`, `wandb.log`, and `wandb.finish`, making it a drop-in replacement for existing logging code. It features a Gradio-inspired dashboard for viewing metrics, media, tables, and alerts, which can run locally or be deployed to Hugging Face Spaces. trackio is particularly useful for autonomous ML experiments, offering programmatic access and a Python API for run management, and supports embedding live dashboards on websites.

Faros AI is a comprehensive platform designed to enhance engineering productivity and intelligence by integrating data from various engineering tools and AI agents. It provides a unified view of engineering operations, allowing organizations to measure AI's impact, optimize SDLC workflows, and improve developer experience. The platform helps turn engineering bottlenecks into breakthroughs by unifying organizational knowledge and providing context for AI agents to produce reliable code. Faros AI also enables predictable roadmap delivery through real-time progress views and forecasting, ensuring commitments are met and risks are mitigated. It offers solutions for CTOs, VPs, AI Officers, DevEx, Platform Engineering, and Technical Program Managers, focusing on driving strategic impact and accelerating AI transformation.

vLLM is a fast and easy-to-use library designed for LLM inference and serving, originating from the Sky Computing Lab at UC Berkeley. It boasts state-of-the-art serving throughput and efficient memory management through PagedAttention. Key features include continuous batching, chunked prefill, prefix caching, and fast model execution with CUDA/HIP graphs. vLLM supports various quantization methods like FP8 and INT4, optimized attention kernels such as FlashAttention, and speculative decoding. It offers seamless integration with Hugging Face models, high-throughput serving with diverse decoding algorithms, and distributed inference capabilities. The tool also provides an OpenAI-compatible API server, multi-LoRA support, and broad hardware compatibility, including NVIDIA, AMD, and x86/ARM/PowerPC CPUs, along with plugins for TPUs and other accelerators. It supports over 200 model architectures, including decoder-only, Mixture-of-Expert, hybrid attention, multi-modal, embedding, and reward models.

Noteworthy AI provides an intelligence platform for the AI era, utilizing AI-powered smart cameras mounted on existing fleet vehicles to automatically identify pole defects, inventory components, and more. This solution, Noteworthy Inspect, helps electric utilities evaluate the condition of the distribution grid at-scale by collecting data passively during routine operations. The platform monitors, processes, and notifies users of equipment defects in real-time, offering an intuitive web-based UI for custom annotations and asset control. It significantly increases visibility into assets, reduces operating costs by up to 75%, and improves grid reliability, resiliency, and safety through proactive prevention. Key applications include asset inventory, asset inspection, lighting audits, storm intelligence, 3rd party/joint use management, and vegetation condition assessment.

Respan, formerly Keywords AI, is an LLM engineering platform designed to streamline the development and deployment of reliable AI applications. It offers a comprehensive suite of features including LLM observability, automated evaluations (evals), prompt optimization, and a unified LLM gateway. The platform allows developers to trace, log, and evaluate agent behavior, identify failures, and understand the impact of prompt or model changes. Respan supports over 500 models and integrates with popular frameworks like OpenAI, Anthropic, LangChain, and LlamaIndex, enabling teams to monitor, debug, and improve their AI systems efficiently. It is built to add observability without becoming a performance bottleneck, making it suitable for production use.

Kablator specializes in providing automated solutions for industrial processes, focusing on automated wiring, artificial vision, and robotics. The company designs and develops custom machines and robotic systems to enhance production efficiency and quality control. Utilizing deep learning for its KabVision artificial vision systems, Kablator offers advanced solutions for various industrial sectors including manufacturing, electrical panels, food, packaging, and agro-food. Based in Italy, Kablator aims to improve and empower production processes through state-of-the-art systems, machinery, and solutions, helping businesses become more competitive in the global market and elevate the value of human capital within the industrial world.

Occams Group specializes in helping organizations navigate complex business and technology challenges by providing comprehensive Talent Services and Solution Delivery. They focus on connecting the right talent with specific project needs, delivering programs, modernizing platforms, and scaling AI initiatives. Their unique model integrates research-driven staffing with robust solutions delivery across critical domains such as software development, data analytics, artificial intelligence, cloud computing, cybersecurity, and ERP systems. Occams Group is designed to provide specialized project teams and facilitate end-to-end transformation, ensuring clients achieve their strategic objectives with expert support.

Pontis Technology is a software development and AI engineering partner that assists modern companies in building unique software solutions and scaling their teams. They offer comprehensive services including core software development and specialized AI services, focusing on best industry practices. Pontis helps turn ideas into life with expert-level product development, covering a wide range of front-end and back-end competencies. Their expertise extends to implementing new applications, optimizing existing systems, and delivering custom software and AI solutions. They are committed to building bridges in the digital age, ensuring clients receive robust, user-friendly, and visually appealing solutions.

Solar Drone Ltd specializes in advanced drone solutions for the maintenance and optimization of solar fields and electric grid assets. The company develops and deploys fully autonomous drone-based technology for tasks such as solar panel cleaning, aerial inspection, and monitoring. Their systems are designed to support all types of solar panels and topographies, utilizing softened water and environmentally friendly materials. Key capabilities include routine and corrective cleaning, inspection of large-scale installations, and data-driven maintenance workflows, all aimed at reducing operational risk, improving system performance, and enhancing safety for critical infrastructure worldwide.

ZeroThreat is an AI-powered pentest tool designed to secure web applications and APIs through automated scanning and continuous penetration testing. It ensures compliance and provides actionable remediation insights, operating at 'dev speed' to support AI-generated code without slowing down development teams. The platform offers fast, automated security testing with 98.9% accuracy, scanning 5x faster than traditional DAST tools. It can re-scan single issues instantly and includes built-in API scanning. ZeroThreat scans for over 130,000 vulnerabilities, including OWASP Top 10, known CVEs, and business logic issues, and supports authenticated scans for areas behind login. It also assists with compliance needs like HIPAA, PCI, ISO 27001, and GDPR, providing audit-ready reports.

Aqueduct is an open-source MLOps framework designed to streamline the deployment and management of machine learning and LLM workloads across various cloud infrastructures. It offers a Python-native API, allowing users to define ML tasks in vanilla Python code and run them on platforms like Kubernetes, Spark, Airflow, or AWS Lambda. The tool provides centralized visibility into code, data, metrics, and metadata generated by each workflow run, ensuring confidence in pipeline performance and immediate alerts for issues. Aqueduct runs securely within your own cloud environment, maintaining data and code security. It is important to note that Aqueduct is no longer being maintained.

The AWS Neuron SDK is a comprehensive software development kit designed to enable high-performance deep learning acceleration on AWS's custom-designed machine learning accelerators, Inferentia and Trainium. It provides a complete ecosystem for developing, profiling, and deploying machine learning workloads on accelerated EC2 instances like Inf1 and Trn1. The SDK includes a compiler, runtime driver, and debugging/profiling utilities with a TensorBoard plugin for visualization. It is pre-integrated into popular machine learning frameworks such as PyTorch, TensorFlow, and MXNet, ensuring a seamless acceleration workflow for developers seeking blazing fast and cost-effective machine learning solutions.

Reiwa Engine is a System Integrator based in Sicily, Italy, dedicated to studying, designing, and implementing customized and versatile solutions in the fields of robotics, artificial intelligence, and industrial plants. Their primary objective is to develop innovative, tailor-made solutions for clients and produce market-ready automated machinery. The company has experience in industrial automation, clean tech, and industrial plant systems, where they have applied artificial intelligence solutions. Reiwa Engine operates as a startup, built on shared ideas, skills, and knowledge, guided by common values and principles. They aim to create revolutionary, practical, and effective projects to simplify industrial processes.

LocalAI is a versatile open-source AI engine designed to run a wide array of AI models, from large language models (LLMs) to vision, voice, image, and video models, on virtually any hardware, including CPU-only setups. It boasts impressive compatibility with APIs like OpenAI and Anthropic, making it a flexible alternative for developers. The platform supports over 36 backends, including llama.cpp, vLLM, and transformers, and offers hardware acceleration for NVIDIA, AMD, Intel, and Apple Silicon. Key features include multi-user support with API key authentication, built-in AI agents for autonomous tasks, and a privacy-first approach ensuring data remains within your infrastructure. LocalAI also provides capabilities for text generation, audio processing, image generation, and real-time APIs, making it a comprehensive solution for local AI inference.

NNPACK is an acceleration package specifically designed to optimize neural network computations on multi-core CPUs. It focuses on delivering high-performance implementations of convolutional neural network (convnet) layers. The tool is not intended for direct use by machine learning researchers but rather provides low-level performance primitives that are leveraged by leading deep learning frameworks such as PyTorch, Caffe2, MXNet, and Darknet. It supports various platforms including Linux, macOS, Android, and iOS, and offers multiple algorithms for convolutional layers, including Fourier transform, Winograd transform, and implicit matrix-matrix multiplication. Implemented in C99 and Python, NNPACK features multi-threaded SIMD-aware implementations and extensive unit test coverage.

Octelium is a free and open-source, self-hosted, unified zero-trust secure access platform designed for flexibility across various operational needs. It can operate as a modern zero-config remote access VPN, a comprehensive Zero Trust Network Access (ZTNA)/BeyondCorp platform, an ngrok/Cloudflare Tunnel alternative, an API gateway, an AI/LLM gateway, and a scalable infrastructure for building MCP gateways and AI agent-based architectures. Additionally, it serves as a PaaS-like deployment platform for containerized applications, a Kubernetes gateway/ingress, and a homelab infrastructure. Octelium provides identity-based, application-layer (L7) aware secretless secure access for both humans and workloads to private and publicly protected resources, utilizing context-aware access control on a per-request basis.

DevSecCops.ai provides expert cloud services, including AWS, Azure, and GCP, alongside CI/CD, SRE, and security solutions, to accelerate digital transformation. The platform offers end-to-end DevOps solutions with automated CI/CD and intelligent infrastructure management, seamless cloud migration across major providers with zero downtime, and significant cost optimization through rightsizing and FinOps governance. It embeds security at every stage with infrastructure scans, VAPT, and compliance automation for standards like SOC 2 and ISO 27001. DevSecCops.ai also facilitates accelerated Kubernetes onboarding and enhances system reliability using SLO-driven operations and proactive incident management. The platform is SOC 2, GDPR, ISO 27001, and HIPAA Ready, ensuring enterprise-grade security.

StackGen is an autonomous operations platform designed to revolutionize DevOps and SRE. It leverages AI, specifically its agentic AI called Aiden, to automate provisioning, ensure compliance, streamline incident triage, and enhance observability. The platform aims to free up engineers from manual toil, which reportedly consumes 64% of their time, allowing them to focus on more complex problems. StackGen offers solutions for Infrastructure Governance, SRE incident response, and DevOps workflow automation, integrating with a wide range of existing tools like Grafana, Prometheus, AWS, Google Cloud, GitHub, Terraform, and DataDog. It helps reduce IaC effort, manual work for platform teams, compliance issues, and production incidents.

CloudKeeper Tuner is an automated AWS usage optimization platform designed to help businesses achieve the lowest possible cloud costs without compromising performance. It acts as a real-time assistant for smarter AWS cost and usage optimization, seamlessly integrating into existing workflows across multiple AWS accounts. The platform delivers tailored recommendations, enabling effortless resource optimization while ensuring peak performance for AWS workloads. Key features include identifying zombie and unused resources, detecting and optimizing over-allocated compute and storage services, and recommending upgrades to the latest AWS resources for better performance and savings. It also offers a Scheduler to automatically shut down idle cloud resources and a SpotBot for dynamic switching between Spot and On-Demand instances to save up to 65%. CloudKeeper Tuner provides 150+ real-time recommendations across 50+ AWS services, with an average savings of 10% within the first 30 days of onboarding.

Quantiphi is an AI-first digital engineering company dedicated to helping enterprises reimagine and realize transformational opportunities in the AI era. The company specializes in AI-first digital engineering, combining industry experience with advanced cloud and data engineering practices, and cutting-edge AI research. Quantiphi aims to solve complex business problems by leveraging artificial intelligence, driving accelerated and quantifiable business results for its clients. Their approach focuses on enabling businesses to adapt and thrive through digital transformation powered by AI.

OpenLLMetry is an open-source observability tool designed for GenAI and LLM applications, built upon the OpenTelemetry framework. It offers comprehensive observability over your LLM application by providing extensions and instrumentations for various LLM providers and Vector DBs. The tool seamlessly integrates with existing observability solutions like Datadog, Honeycomb, and others, leveraging the underlying OpenTelemetry standard. Developed and maintained by Traceloop, OpenLLMetry includes a convenient SDK for easy setup, allowing developers to quickly start tracing their code. It supports a wide range of destinations and instruments calls to major LLM providers and Vector DBs, ensuring full visibility into your AI application's performance.

The National Supercomputing Centre (NSCC) Singapore, established in 2015 and funded by the National Research Foundation (NRF), manages Singapore’s national high-performance computing (HPC) resources. NSCC allocates these critical assets to support key National Research & Development (R&D) programmes and projects, aiming for significant economic outcomes and scientific imperatives for Singapore. The center leverages HPC to advance Singapore’s strategic interests, boost national research initiatives, and facilitate industry transformation in areas such as computational science, artificial intelligence (AI), visualisation, modelling & simulation, climate research, biomedicine, genetics, and big data analytics. NSCC also focuses on developing and training an HPC-enabled workforce to maintain Singapore’s global competitiveness.

DCAI, the Danish Centre for AI Innovation, serves as Denmark's national AI infrastructure, dedicated to advancing AI research and innovation. It offers sovereign and secure AI computing capabilities through Gefion, a high-performance supercomputer. This infrastructure aims to lower the barrier to accessing advanced computing resources for various stakeholders. DCAI collaborates with academia, startups, and enterprises, providing them with the necessary tools to accelerate their AI initiatives. The center focuses on enabling cutting-edge machine learning and research infrastructure, ensuring robust support for complex computational demands within the AI domain.

Divyam.AI is an adaptive AI infrastructure platform designed to scale AI applications from prototype to production for enterprise teams. It acts as a closed-loop system for optimizing production inference, continuously measuring real-world outcomes and evaluating quality against customer-specific standards. The platform features EvalMate for creating comprehensive evaluation pipelines, a Model Router for dynamic, agent-level intelligence in prompt routing, and continuous optimization to benchmark and adopt new models automatically. Divyam.AI aims to significantly reduce inference costs by routing prompts to optimal models while improving quality and providing full observability into every inference decision.