Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models ...

Python -O won’t magically make every script faster, but in the right workloads it’s a free win—here’s how to test it safely.