# Music Modeling on J.S. Bach Chorales 16th notes (val) Source: [Music Modeling on J.S. Bach Chorales 16th notes (val)]() Collection index: [llms.txt]() Data updated: 2026-02-26T06:08:07.237Z Evaluation of Music Modeling performance on the validation split of the J.S. Bach Chorales 16th notes dataset, measured by Validation NLL. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Music Modeling | | Dataset (including any stated split) | J.S. Bach Chorales 16th notes (val) | | Metric | Validation NLL | | Unit | SCALAR | | Direction | Lower is better | | Results loaded | 25 of 25 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Validation NLL](): Lower is better; unit: SCALAR. ## Recorded results | Method | Validation NLL | Result date | Report paper | | --- | --- | --- | --- | | TonicNet | 0.22 | Not recorded | 68fa6a7b1e209131cea28765 | | TonicNet | 0.224 | Not recorded | 68fa6a7b1e209131cea28765 | | TonicNet | 0.317 | Not recorded | 68fa6a7b1e209131cea28765 | | TonicNet | 0.321 | Not recorded | 68fa6a7b1e209131cea28765 | | Relative Transformer + cpsi + relative pitch and time | 0.335 | Not recorded | 68fa65341e209131cea08ebc | | Music Transformer | 0.335 | Not recorded | 68fa6a7b1e209131cea28765 | | Relative Transformer + concat positional sinusoids, instrument labels (cpsi) | 0.347 | Not recorded | 68fa65341e209131cea08ebc | | Relative Transformer | 0.357 | Not recorded | 68fa65341e209131cea08ebc | | TF baseline + concat positional sinusoids, instrument labels (cpsi) | 0.37 | Not recorded | 68fa65341e209131cea08ebc | | Transformer | 0.394 | Not recorded | 68fa6a7b1e209131cea28765 | | TF baseline + concat positional sinusoids (cps) | 0.398 | Not recorded | 68fa65341e209131cea08ebc | | Transformer (TF) baseline | 0.417 | Not recorded | 68fa65341e209131cea08ebc | | TonicNet | 0.422 | Not recorded | 68fa6a7b1e209131cea28765 | | COCONET (CNN, chronological) | 0.436 | Not recorded | 68fa65341e209131cea08ebc | | COCONET | 0.436 | Not recorded | 68fa6a7b1e209131cea28765 | | TonicNet | 0.497 | Not recorded | 68fa6a7b1e209131cea28765 | | Transformer | 0.503 | Not recorded | 68fa6a7b1e209131cea28765 | | TonicNet | 0.516 | Not recorded | 68fa6a7b1e209131cea28765 | | TonicNet | 0.521 | Not recorded | 68fa6a7b1e209131cea28765 | | TonicNet | 0.523 | Not recorded | 68fa6a7b1e209131cea28765 | | Transformer | 0.544 | Not recorded | 68fa6a7b1e209131cea28765 | | TonicNet | 0.555 | Not recorded | 68fa6a7b1e209131cea28765 | | TonicNet | 0.588 | Not recorded | 68fa6a7b1e209131cea28765 | | TonicNet | 0.716 | Not recorded | 68fa6a7b1e209131cea28765 | | TonicNet | 0.936 | Not recorded | 68fa6a7b1e209131cea28765 | ### TonicNet Validation NLL: 0.22. Result ID: 698e3a3cffc3901de09bd2a4. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Input parts":"CSATB","Repetition encoding (Z)":true,"Data Augmentation":"Tr+MM (Transposition + Major-to-Minor)","Evaluation Protocol":"NCL (No Chord Loss)"}. This record does not assert independent reproduction. ### TonicNet Validation NLL: 0.224. Result ID: 698e3a3cffc3901de09bd2a3. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Input parts":"CSATB","Repetition encoding (Z)":true,"Data Augmentation":"Tr (Transposition)","Evaluation Protocol":"NCL (No Chord Loss)"}. This record does not assert independent reproduction. ### TonicNet Validation NLL: 0.317. Result ID: 698e3a3cffc3901de09bd2a2. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Input parts":"CSATB","Repetition encoding (Z)":true,"Data Augmentation":"Tr+MM (Transposition + Major-to-Minor)","Evaluation Protocol":"Include chord loss"}. This record does not assert independent reproduction. ### TonicNet Validation NLL: 0.321. Result ID: 698e3a3cffc3901de09bd2a1. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Input parts":"CSATB","Repetition encoding (Z)":true,"Data Augmentation":"Tr (Transposition)","Evaluation Protocol":"Include chord loss"}. This record does not assert independent reproduction. ### Relative Transformer + cpsi + relative pitch and time Validation NLL: 0.335. Result ID: 698ca1cd0b614d12cff21587. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Layers":"5L","Hidden size":"512hs","Attention size":"512att","Filter size":"512ff","Relative distance (r)":"256r","Heads":"8h","cpsi":"true","relative pitch and time":"true"}. This record does not assert independent reproduction. ### Music Transformer Validation NLL: 0.335. Result ID: 698e3a3cffc3901de09bd29a. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Input parts":"SATB"}. This record does not assert independent reproduction. ### Relative Transformer + concat positional sinusoids, instrument labels (cpsi) Validation NLL: 0.347. Result ID: 698ca1cd0b614d12cff21586. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Layers":"5L","Hidden size":"512hs","Attention size":"512att","Filter size":"512ff","Relative distance (r)":"256r","Heads":"8h","cpsi":"true"}. This record does not assert independent reproduction. ### Relative Transformer Validation NLL: 0.357. Result ID: 698ca1cd0b614d12cff21585. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Layers":"5L","Hidden size":"512hs","Attention size":"512att","Filter size":"512ff","Relative distance (r)":"256r","Heads":"8h"}. This record does not assert independent reproduction. ### TF baseline + concat positional sinusoids, instrument labels (cpsi) Validation NLL: 0.37. Result ID: 698ca1cd0b614d12cff21584. [Reporting paper]() Recorded evaluation configuration: {"Layers":"5L","Hidden size":"256hs","Attention size":"256att","Filter size":"1024ff","Heads":"8h","cpsi":"true"}. This record does not assert independent reproduction. ### Transformer Validation NLL: 0.394. Result ID: 698e3a3cffc3901de09bd29f. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Input parts":"CSATB","Evaluation Protocol":"NCL (No Chord Loss)"}. This record does not assert independent reproduction. ### TF baseline + concat positional sinusoids (cps) Validation NLL: 0.398. Result ID: 698ca1cd0b614d12cff21583. [Reporting paper]() Recorded evaluation configuration: {"Layers":"5L","Hidden size":"256hs","Attention size":"256att","Filter size":"1024ff","Heads":"8h","cps":"true"}. This record does not assert independent reproduction. ### Transformer (TF) baseline Validation NLL: 0.417. Result ID: 698ca1cd0b614d12cff21582. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Layers":"5L","Hidden size":"256hs","Attention size":"256att","Filter size":"1024ff","Heads":"8h"}. This record does not assert independent reproduction. ### TonicNet Validation NLL: 0.422. Result ID: 698e3a3cffc3901de09bd2a0. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Input parts":"CSATB","Repetition encoding (Z)":true,"Data Augmentation":"None","Evaluation Protocol":"Include chord loss"}. This record does not assert independent reproduction. ### COCONET (CNN, chronological) Validation NLL: 0.436. Result ID: 698ca1cd0b614d12cff21581. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Type":"CNN, chronological","Layers":"64L","Filter":"128 3x3f"}. This record does not assert independent reproduction. ### COCONET Validation NLL: 0.436. Result ID: 698e3a3cffc3901de09bd29b. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Input parts":"SATB","Prediction Order":"chronological"}. This record does not assert independent reproduction. ### TonicNet Validation NLL: 0.497. Result ID: 698e3a3cffc3901de09bd29d. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Input parts":"SATB","Repetition encoding (Z)":true}. This record does not assert independent reproduction. ### Transformer Validation NLL: 0.503. Result ID: 698e3a3cffc3901de09bd29e. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Input parts":"CSATB","Evaluation Protocol":"Include chord loss"}. This record does not assert independent reproduction. ### TonicNet Validation NLL: 0.516. Result ID: 698e3a3cffc3901de09bd2aa. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Input parts":"CSB (Chords + Soprano + Bass)"}. This record does not assert independent reproduction. ### TonicNet Validation NLL: 0.521. Result ID: 698e3a3cffc3901de09bd2a7. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Input parts":"S (Soprano)"}. This record does not assert independent reproduction. ### TonicNet Validation NLL: 0.523. Result ID: 698e3a3cffc3901de09bd29c. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Input parts":"SATB","Repetition encoding (Z)":false}. This record does not assert independent reproduction. ### Transformer Validation NLL: 0.544. Result ID: 698e3a3cffc3901de09bd299. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Input parts":"SATB"}. This record does not assert independent reproduction. ### TonicNet Validation NLL: 0.555. Result ID: 698e3a3cffc3901de09bd2a9. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Input parts":"SB (Soprano + Bass)"}. This record does not assert independent reproduction. ### TonicNet Validation NLL: 0.588. Result ID: 698e3a3cffc3901de09bd2a8. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Input parts":"CS (Chords + Soprano)"}. This record does not assert independent reproduction. ### TonicNet Validation NLL: 0.716. Result ID: 698e3a3cffc3901de09bd2a6. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Input parts":"B (Bass)"}. This record does not assert independent reproduction. ### TonicNet Validation NLL: 0.936. Result ID: 698e3a3cffc3901de09bd2a5. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Input parts":"C (Chords)"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.