Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.
Subscribe to our weekly newsletter for the latest in industry news, expert insights, dedicated information security content and online events.