Announcing LocalScore

We couldn’t be more pleased to introduce LocalScore, an open-source benchmarking tool designed to evaluate the performance of LLMs on local hardware. Built by CJ Pais, LocalScore measures Prompt Processing Speed, Generation Speed, and Time to First Token, providing a comprehensive metric to assess system capabilities for running LLMs locally. ​

Built atop Llamafile, LocalScore ensures portability across various systems, making benchmarking accessible regardless of your setup. The tool is 100% open source under the Apache 2.0 license, encouraging community contributions ranging from code improvements to feature suggestions. ​

Download LocalScore from localscore.ai/download to run the benchmark on your hardware. You can submit your results to our public database to assist the community. ​