Benchmarking llama.cpp on legacy hardware
Inspired by the benchmarking results on Apple Silicon published here, I have used the llama-bench tool to produce comparable results on some older and less powerful devices. This can perhaps help to give an idea of the rate of progress in LLM performance over a…
Continue reading...