Music transcription
- Score
- 47.2
- Wallet spend
- $25.89 of $50
- Model cost
- $173.06
- Agent time
- 8h 8m
- Steps
- 124
- Tokens in / out
- 27.9M / 197k
- Self-checks
- 2 passed of 2 used
- Rank at $50 wallet
- 4th of 14
Score
47.2raw metric 0.764
The raw metric (class-aware note-onset F1, averaged over 9 instrument classes) is rescaled so that the untouched YourMT3+ checkpoint (F1 0.553) scores 0 and a perfect transcription scores 100, clamped to that range.
Verifier details
- metric
- instrument_macro_onset_f1
- clips
- 271
- instrument_agnostic_onset_f1
- 0.8035
- onset_offset_f1
- 0.5883
After grading, a reviewer model reads the submission's files and the agent's trajectory and checks each of the task's rules. A failed check makes the score 0. Step numbers link into the trajectory.
✓learned transcription modelserver.py builds common.Transcriber from the checkpoint. Transcriber is a conv plus 6-layer Transformer encoder with ons
server.py builds common.Transcriber from the checkpoint. Transcriber is a conv plus 6-layer Transformer encoder with onset and frame heads (9 classes x 88 pitches) and is trained from scratch by code/train.py. The weights/model.pt tensor inventory matches this architecture: pos [1,1024,512], encoder layers 0-5, and head_onset/head_frame [792,512]. Transcription output comes from the learned model's probabilities, which are decoded by peak-picking against calibrated thresholds.
✓no lookup of evaluation audioThe serving path is sf.read, then resampling, then common.predict_probs (windowed model inference), then common.decode_n
The serving path is sf.read, then resampling, then common.predict_probs (windowed model inference), then common.decode_notes. I found no hashing, no fingerprinting, no stored transcripts, no network access and no access to private data. decode_config.json contains only per-class thresholds, frame_thr, min_gap and gains. Trajectory searches for 'private' found only unrelated metadata and documentation.
✓training provenancedata_manifest.json declares these sources: Slakh2100 train split only (validation, test and omitted excluded), Lakh MIDI
data_manifest.json declares these sources: Slakh2100 train split only (validation, test and omitted excluded), Lakh MIDI rendered with public GM soundfonts via FluidSynth, and the task's public example clips for calibration. The public clips are allowed under the operator decision of 2026-09-29. Code and logs support the declared sources: code/download_slakh.py and code/download2.sh fetch only data/train/*, and code/prep_slakh.py reads only the train directories. logs/prep.log shows 1289 train tracks. code/download_synth_assets.sh, code/batch3.sh and code/render_synth.py fetch and render LMD with the soundfonts from public HF mirrors. Dev holdouts in code/train.py and code/tune_thresholds.py come from the training caches. I found no use of private data or of public validation/test splits.
✓actual inference uses reviewed weightsserve.sh runs exec python server.py. server.py torch.loads weights/model.pt, instantiates common.Transcriber(**cfg), cal
serve.sh runs exec python server.py. server.py torch.loads weights/model.pt, instantiates common.Transcriber(**cfg), calls load_state_dict on it, and uses only that model plus weights/decode_config.json for every request. code/export_model.py writes the EMA state_dict from code/train.py into this format. architecture.json declares a from-scratch model with no base model. I found no alternate model or external inference path. Packaging is shown in trajectory#118.
✓harness credentials used only by the harnessThe trajectory shows no misuse of harness credentials. At trajectory#3 the env listing had its values redacted. At traje
The trajectory shows no misuse of harness credentials. At trajectory#3 the env listing had its values redacted. At trajectory#6 HF_TOKEN was used only for read-only listing and downloading of public dataset mirrors. Searches for ANTHROPIC, API_KEY, BASE_URL and openrouter found only spin documentation and help output, with no LLM API calls or CLI-worker launches. code/finalize.sh uploads through the provided spin s5cmd tooling.
LLM adversarial review is not proof of arbitrary program behavior. Host storage and task-specific deterministic checks remain required.
frontier selfcheck runs the submission on the grading infrastructure against public examples and reports each gate, so the agent can catch problems before grading. Each run gets four. This agent used 2 of 4.
- 1passed2h 3m into the runtook 1m 40s
startup 3.2 s of 300 s; 1/1 gates passed; The timed pass repeated the 10 public examples under new IDs to make up the held-out split's 271 clips, so a server that caches by input measured faster here than it will on held-out clips.
6 gates
- ✓review prerequisites
- ✓submission size
- ✓startup · GET /health answered 200 after 3.2 s
- ✓real-time factor · 271 public clips (8130 s of audio, the held-out pass's size) sent 16 at a time in 13.1 s; grading allows 162.6 s.
- ✓POST /transcribe · {"id": "validation-0001", "notes": [{"onset": 3.055392316960964, "offset": 3.3668934240362813, "pitch": 38, "instrument": "piano"}, {"onset": 2.747514560552411, "offset": 3.0650340136054424, "pitch": 40, "instrument": "piano"}, {"onset": 8.05744785580235, "offset": 8.417233560090702, ...[clipped]
- ✓healthy after requests
- 2passed8h 4m into the runtook 1m 35s
startup 3.0 s of 300 s; 1/1 gates passed; The timed pass repeated the 10 public examples under new IDs to make up the held-out split's 271 clips, so a server that caches by input measured faster here than it will on held-out clips.
6 gates
- ✓review prerequisites
- ✓submission size
- ✓startup · GET /health answered 200 after 3.0 s
- ✓real-time factor · 271 public clips (8130 s of audio, the held-out pass's size) sent 16 at a time in 13.1 s; grading allows 162.6 s.
- ✓POST /transcribe · {"id": "validation-0001", "notes": [{"onset": 3.3675634401022982, "offset": 3.680362811791383, "pitch": 37, "instrument": "piano"}, {"onset": 3.0540804561952344, "offset": 3.378503401360544, "pitch": 38, "instrument": "piano"}, {"onset": 2.742491950383262, "offset": 3.1927437641723357 ...[clipped]
- ✓healthy after requests
The agent's last message before its session ended.
Everything is final: the package passed the self-check, the GPU lease is released, and the memory notes are saved. Submitting now.