Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.

Familiarity with basic networking concepts, configurations, and Python is helpful, but no prior AI or advanced programming ...