Inverse dynamics model
- Score
- 31.6
- Wallet spend
- $39.92 of $200
- Model cost
- $75.94
- Agent time
- 11h 2m
- Steps
- 602
- Tokens in / out
- 198.8M / 357k
- Self-checks
- 0 passed of 0 used
- Rank at $200 wallet
- 10th of 14
Score
31.6raw metric 0.3159
The score is the raw metric (micro action F1), which already runs from 0 to 1, times 100.
Verifier details
- metric
- micro_action_f1
- tp
- 248
- fp
- 403
- fn
- 671
- precision
- 0.3810
- recall
- 0.2699
- failed_clip_limit_percent
- 5
- dropped_actions
- 0
- elapsed_seconds
- 533.4173
- deadline_seconds
- 3600
- request_timeout_seconds
- 300
After grading, a reviewer model reads the submission's files and the agent's trajectory and checks each of the task's rules. A failed check makes the score 0. Step numbers link into the trajectory.
✓training data provenanceThe training corpus is self-generated. It consists of 7471 synthetic Playwright-recorded clips from self-built apps and
The training corpus is self-generated. It consists of 7471 synthetic Playwright-recorded clips from self-built apps and public websites, labeled with the task's own GT code. It is declared in architecture.json and logs/DATA_MANIFEST.md, and the generation run is retained in logs/gen1.log ("DONE ok=7471/7514"). train.py selects the model on a random held-out synthetic split. The provided example clip and validation.jsonl were used only for validation and threshold sweeps, which the policy permits. The spotter and glyph models were also trained on synthetic renders and example-frame crops. No trajectory step accesses p-doom/idm-eval or inductionlabs/frontier-ml-tasks. The only p-doom string is typed text in build_scenario.py, not a download.
✓non specialist initializationThe only pretrained component is facebook/dinov2-with-registers-base, a general self-supervised vision model and not an
The only pretrained component is facebook/dinov2-with-registers-base, a general self-supervised vision model and not an IDM. The trajectory shows it was downloaded with Dinov2Model.from_pretrained and saved in fp16. The weights/dinov2 inventory holds standard Dinov2 tensors that match config.json (4 register tokens, hidden size 768, 12 layers). action_head.pt, spotter.pt and glyph_cell.pt hold custom architectures trained from scratch. Nothing shows p-doom/idm or any specialist IDM being used as initialization.
✓actual inference uses reviewed weightsserve.sh installs vendored wheels offline and runs server.py. server.py loads the shipped weights/spotter.pt, weights/di
serve.sh installs vendored wheels offline and runs server.py. server.py loads the shipped weights/spotter.pt, weights/dinov2 (local from_pretrained), weights/action_head.pt, weights/glyph_cell.pt and weights/thresholds.json. Inference is computed only from decoded video frames. The request id is ignored, and there are no hash lookups, cached answers or remote model calls. The hand-written key rules and phase-correlation scroll detector are allowed serving rules.
✓harness credentials used only by the harnessSearches of the trajectory found no use, echo or copying of harness API keys or base URLs, and no launch of extra model
Searches of the trajectory found no use, echo or copying of harness API keys or base URLs, and no launch of extra model CLIs. Spin was used only for compute leases. HF_TOKEN was used only to download DINOv2, which is permitted. The only curl call was to a localhost health endpoint.
LLM adversarial review is not proof of arbitrary program behavior. Host storage and task-specific deterministic checks remain required.
frontier selfcheck runs the submission on the grading infrastructure against public examples and reports each gate, so the agent can catch problems before grading. Each run gets four. This agent used 0 of 4.
- 1error10h 33m into the runtook 2m 57sfree (stopped before any GPU time)
The self-check could not finish (ImageBuildError: Image build for im-pNi5PCmDHXkqJpLMNl5oSo failed. View the build logs: modal image logs im-pNi5PCmDHXkqJpLMNl5oSo).
- 2error10h 38m into the runtook 2m 19sfree (stopped before any GPU time)
The self-check could not finish (ImageBuildError: Image build for im-pNi5PCmDHXkqJpLMNl5oSo failed. View the build logs: modal image logs im-pNi5PCmDHXkqJpLMNl5oSo).
- 3error10h 44m into the runtook 40sfree (stopped before any GPU time)
The self-check could not finish (ImageBuildError: Image build for im-pNi5PCmDHXkqJpLMNl5oSo failed. View the build logs: modal image logs im-pNi5PCmDHXkqJpLMNl5oSo).
- 4error10h 58m into the runtook 1m 48sfree (stopped before any GPU time)
The self-check could not finish (ImageBuildError: Image build for im-pNi5PCmDHXkqJpLMNl5oSo failed. View the build logs: modal image logs im-pNi5PCmDHXkqJpLMNl5oSo).
The agent's last message before its session ended.
The selfcheck infrastructure is down for everyone (even a trivial stub fails identically). My output is validated end-to-end (0.8387 on the official validator via a live server). Let me submit.