Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.
Adam Hayes, Ph.D., CFA, is a financial writer with 15+ years Wall Street experience as a derivatives trader. Besides his extensive derivative trading expertise, Adam is an expert in economics and ...