Shypd.aiThe largest open index of AI toolsLLM-Viewer is a Coding & Development tool that visualizes Language and Learning Models (LLMs) and analyzes their performance on different hardware platforms. It offers network-wise analysis, including peak memory consumption and inference time cost.
Trending
Also listed in
About
LLM-Viewer is a comprehensive tool designed for visualizing and analyzing the performance of Large Language Models (LLMs) across various hardware platforms. It provides in-depth network-wise analysis, allowing users to understand critical factors such as peak memory consumption and total inference time cost. The tool supports both a user-friendly web interface for easy configuration and visualization, and a command-line interface (CLI) for more programmatic use. LLM-Viewer helps users gain valuable insights into LLM inference and optimize performance by considering computation, storage, transmission, and hardware roofline models. It's an ongoing project with plans for expanded hardware and LLM compatibility.
Capabilities
Pricing & Plans
Open Source
Free
FAQs
Trending
