Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models ...
The company says its just a concept, and doesn't plan to advance the idea.
KittenTTS brings small text to speech models to edge devices; the Nano 8-bit model is about 25 MB, local playback is possible.