Back to Templates

๐Ÿš€ Local multi-LLM testing & performance tracker

Created by

Created by: Wildkick || davidmoneil
Wildkick

Last update

Last update 2 months ago

Share


๐Ÿš€ Local Multi-LLM Testing & Performance Tracker

This workflow is perfect for developers, researchers, and data scientists benchmarking multiple LLMs with LM Studio. It dynamically fetches active models, tests prompts, and tracks metrics like word count, readability, and response time, logging results into Google Sheets. Easily adjust temperature ๐Ÿ”ฅ and top P ๐ŸŽฏ for flexible model testing.


Level of Effort:

๐ŸŸข Easy โ€“ Minimal setup with customizable options.


Setup Steps:

  1. Install LM Studio and configure models.
  2. Update IP to connect to LM Studio.
  3. Create a Google Sheet for result tracking.

Key Outcomes:

  • Benchmark LLM performance.
  • Automate results in Google Sheets for easy comparison.

Version 1.0