# Rath

Source: [Rath](<https://www.sota2.com/research/dataset/rath>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Benchmarks

Page 1 of 1. This is an index page, not the full collection.

- [Audio Understanding on AudioMarathon](<https://www.sota2.com/research/sota/audio-understanding-on-audiomarathon.md>): Audio Understanding; AudioMarathon.

- [Named Entity Recognition on Marathi NER (test)](<https://www.sota2.com/research/sota/named-entity-recognition-on-marathi-ner-test.md>): NER; Marathi NER (test).

- [Sentiment Classification on Marathi (test)](<https://www.sota2.com/research/sota/sentiment-classification-on-marathi-test.md>): Sentiment Classification; Marathi (test).

- [Classification on MarathiSign](<https://www.sota2.com/research/sota/classification-on-marathisign.md>): Classification; MarathiSign.

- [Sub-workflow Execution on OS-Marathon Expense Report - Spreadsheet Environment](<https://www.sota2.com/research/sota/sub-workflow-execution-on-os-marathon-expense-report-spreadsheet-environment.md>): Sub-workflow Execution; OS-Marathon Expense Report - Spreadsheet Environment.

- [Sub-workflow Execution on OS-Marathon Expense Report - Website System Environment](<https://www.sota2.com/research/sota/sub-workflow-execution-on-os-marathon-expense-report-website-system-environment.md>): Sub-workflow Execution; OS-Marathon Expense Report - Website System Environment.

- [GUI Task Automation on OS-Marathon Transcript domain (Level 2)](<https://www.sota2.com/research/sota/gui-task-automation-on-os-marathon-transcript-domain-level-2.md>): GUI Task Automation; OS-Marathon Transcript domain (Level 2).

- [Long-Form Speech Understanding on AudioMarathon 1.0 (test)](<https://www.sota2.com/research/sota/long-form-speech-understanding-on-audiomarathon-1-0-test.md>): Long-Form Speech Understanding; AudioMarathon 1.0 (test).

- [Audio Classification on AudioMarathon 1.0 (test)](<https://www.sota2.com/research/sota/audio-classification-on-audiomarathon-1-0-test.md>): Audio Classification; AudioMarathon 1.0 (test).

- [Speaker Information Modeling on AudioMarathon 1.0 (test)](<https://www.sota2.com/research/sota/speaker-information-modeling-on-audiomarathon-1-0-test.md>): Speaker Information Modeling; AudioMarathon 1.0 (test).

- [Speech Content Extraction on AudioMarathon 1.0 (test)](<https://www.sota2.com/research/sota/speech-content-extraction-on-audiomarathon-1-0-test.md>): Speech Content Extraction; AudioMarathon 1.0 (test).

- [Sound Event Detection on AudioMarathon](<https://www.sota2.com/research/sota/sound-event-detection-on-audiomarathon.md>): Sound Event Detection; AudioMarathon.

- [Tokenization (NSL score) on Marathi (mr)](<https://www.sota2.com/research/sota/tokenization-nsl-score-on-marathi-mr.md>): Tokenization; Marathi (mr).

- [GUI Task Automation on OS-Marathon Transcript domain (Level 1)](<https://www.sota2.com/research/sota/gui-task-automation-on-os-marathon-transcript-domain-level-1.md>): GUI Task Automation; OS-Marathon Transcript domain (Level 1).

- [Supervised Fine-Tuning on Marathi Multilingual SFT (test)](<https://www.sota2.com/research/sota/supervised-fine-tuning-on-marathi-multilingual-sft-test.md>): Supervised Fine-Tuning; Marathi Multilingual SFT (test).

- [Supervised Fine-Tuning on MMMLU Marathi (test)](<https://www.sota2.com/research/sota/supervised-fine-tuning-on-mmmlu-marathi-test.md>): Supervised Fine-Tuning; MMMLU Marathi (test).

- [Medical Diagnosis on IndicMedDialog Marathi 1.0 (test)](<https://www.sota2.com/research/sota/medical-diagnosis-on-indicmeddialog-marathi-1-0-test.md>): Medical Diagnosis; IndicMedDialog Marathi 1.0 (test).

- [Automatic Speech Recognition on mucs Marathi](<https://www.sota2.com/research/sota/automatic-speech-recognition-on-mucs-marathi.md>): Automatic Speech Recognition; mucs Marathi.

- [Automatic Speech Recognition on kathbath Marathi](<https://www.sota2.com/research/sota/automatic-speech-recognition-on-kathbath-marathi.md>): Automatic Speech Recognition; kathbath Marathi.

- [Automatic Speech Recognition on indictts Marathi](<https://www.sota2.com/research/sota/automatic-speech-recognition-on-indictts-marathi.md>): Automatic Speech Recognition; indictts Marathi.

- [Automatic Speech Recognition on fleurs Marathi](<https://www.sota2.com/research/sota/automatic-speech-recognition-on-fleurs-marathi.md>): Automatic Speech Recognition; fleurs Marathi.

- [Named Entity Recognition on WikiANN Marathi (mr) (test)](<https://www.sota2.com/research/sota/named-entity-recognition-on-wikiann-marathi-mr-test.md>): Named Entity Recognition; WikiANN Marathi (mr) (test).

- [Question Answering on Marathi (MR)](<https://www.sota2.com/research/sota/question-answering-on-marathi-mr.md>): Question Answering; Marathi (MR).

- [Disfluency Correction on Marathi Real Data ASR (test)](<https://www.sota2.com/research/sota/disfluency-correction-on-marathi-real-data-asr-test.md>): Disfluency Correction; Marathi Real Data ASR (test).

- [Tokenization Efficiency on Marathi mr](<https://www.sota2.com/research/sota/tokenization-efficiency-on-marathi-mr.md>): Tokenization Efficiency; Marathi mr.

- [Automatic Speech Recognition on IndicVoices Marathi/mr](<https://www.sota2.com/research/sota/automatic-speech-recognition-on-indicvoices-marathi-mr.md>): Automatic Speech Recognition; IndicVoices Marathi/mr.

- [Multimodal Abstractive Summarization on MM-Sum Marathi low-resource](<https://www.sota2.com/research/sota/multimodal-abstractive-summarization-on-mm-sum-marathi-low-resource.md>): Multimodal Abstractive Summarization; MM-Sum Marathi low-resource.

- [Disfluency Correction on Marathi Manually Edited (test)](<https://www.sota2.com/research/sota/disfluency-correction-on-marathi-manually-edited-test.md>): Disfluency Correction; Marathi Manually Edited (test).

- [Disfluency Correction on Marathi Real Data ASR](<https://www.sota2.com/research/sota/disfluency-correction-on-marathi-real-data-asr.md>): Disfluency Correction; Marathi Real Data ASR.

- [Agent Drift Mitigation on Rath 847 workflows](<https://www.sota2.com/research/sota/agent-drift-mitigation-on-rath-847-workflows.md>): Agent Drift Mitigation; Rath 847 workflows.

- [Machine Translation on NTREX Marathi 128 (test)](<https://www.sota2.com/research/sota/machine-translation-on-ntrex-marathi-128-test.md>): Machine Translation; NTREX Marathi 128 (test).

- [Text-to-Speech on IndicTTS Database Marathi](<https://www.sota2.com/research/sota/text-to-speech-on-indictts-database-marathi.md>): Text-to-Speech; IndicTTS Database Marathi.

- [Knowledge Recall on Knowledge recall benchmark Marathi](<https://www.sota2.com/research/sota/knowledge-recall-on-knowledge-recall-benchmark-marathi.md>): Knowledge Recall; Knowledge recall benchmark Marathi.

- [Tokenization on AI4Bharat Sangraha Marathi](<https://www.sota2.com/research/sota/tokenization-on-ai4bharat-sangraha-marathi.md>): Tokenization; AI4Bharat Sangraha Marathi.

- [Cross-lingual Entity Linking on LR-XEL Marathi - MR DBpedia (test)](<https://www.sota2.com/research/sota/cross-lingual-entity-linking-on-lr-xel-marathi-mr-dbpedia-test.md>): Cross-lingual Entity Linking; LR-XEL Marathi - MR DBpedia (test).

- [Machine Translation on MQM Human Evaluation English→Marathi](<https://www.sota2.com/research/sota/machine-translation-on-mqm-human-evaluation-english-marathi.md>): Machine Translation; MQM Human Evaluation English→Marathi.

- [Passage Ranking on INDIC-MARCO Marathi Small (dev)](<https://www.sota2.com/research/sota/passage-ranking-on-indic-marco-marathi-small-dev.md>): Passage Ranking; INDIC-MARCO Marathi Small (dev).

- [Disfluency Correction on Marathi Real Data](<https://www.sota2.com/research/sota/disfluency-correction-on-marathi-real-data.md>): Disfluency Correction; Marathi Real Data.

- [Disfluency Correction on Marathi Manually Edited](<https://www.sota2.com/research/sota/disfluency-correction-on-marathi-manually-edited.md>): Disfluency Correction; Marathi Manually Edited.

- [Quality Estimation on Surrey Low-Resource dataset en-mr (Marathi)](<https://www.sota2.com/research/sota/quality-estimation-on-surrey-low-resource-dataset-en-mr-marathi.md>): Quality Estimation; Surrey Low-Resource dataset en-mr (Marathi).

- [Cross-lingual Entity Linking on LR-XEL Marathi - MR (test)](<https://www.sota2.com/research/sota/cross-lingual-entity-linking-on-lr-xel-marathi-mr-test.md>): Cross-lingual Entity Linking; LR-XEL Marathi - MR (test).