# LMEval

Source: [LMEval](<https://www.sota2.com/research/dataset/lmeval>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Benchmarks

Page 1 of 1. This is an index page, not the full collection.

- [Medical LLM Evaluation on LLMEval Med](<https://www.sota2.com/research/sota/medical-llm-evaluation-on-llmeval-med.md>): Medical LLM Evaluation; LLMEval Med.

- [Medical Question Answering on LLMEval-Med](<https://www.sota2.com/research/sota/medical-question-answering-on-llmeval-med.md>): Medical Question Answering; LLMEval-Med.

- [Multimodal Visual Question Answering on VLMEvalKit Image Benchmarks](<https://www.sota2.com/research/sota/multimodal-visual-question-answering-on-vlmevalkit-image-benchmarks.md>): Multimodal Visual Question Answering; VLMEvalKit Image Benchmarks.

- [Reasoning and Math on VLMEvalKit (test)](<https://www.sota2.com/research/sota/reasoning-and-math-on-vlmevalkit-test.md>): Reasoning and Math; VLMEvalKit (test).

- [Pairwise Comparison on LLMEval](<https://www.sota2.com/research/sota/pairwise-comparison-on-llmeval.md>): Pairwise Comparison; LLMEval.

- [Secure Code Generation on SecLLMEval](<https://www.sota2.com/research/sota/secure-code-generation-on-secllmeval.md>): Secure Code Generation; SecLLMEval.

- [Commonsense Reasoning on LMEval](<https://www.sota2.com/research/sota/commonsense-reasoning-on-lmeval.md>): Commonsense Reasoning; LMEval.

- [Visual Understanding on 18 Visual Understanding Assessments VLMEvalKit](<https://www.sota2.com/research/sota/visual-understanding-on-18-visual-understanding-assessments-vlmevalkit.md>): Visual Understanding; 18 Visual Understanding Assessments VLMEvalKit.

- [Financial Performance on FinLMEval](<https://www.sota2.com/research/sota/financial-performance-on-finlmeval.md>): Financial Performance; FinLMEval.
