Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.

Abstract: Transition graphs or transition diagrams, describing the rates and probabilities with which a system changes between discrete states, are common throughout the sciences. In many cases, ...

Abstract: Temporal graph representation learning seeks to capture the intrinsic evolution of nodes in temporal graphs for various applications. While existing models primarily learn node ...