Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.

Combine AI-generated tests with intelligent test selection to manage large regression suites and speed up feedback ...

Isomorphic Lab’s proprietary drug-discovery model is a major advance, but scientists developing open-source tools are left guessing how to achieve similar results.