SVG generation

After grading, a reviewer model reads the submission's files and the agent's trajectory and checks each of the task's rules. A failed check makes the score 0. Step numbers link into the trajectory.

LLM adversarial review is not proof of arbitrary program behavior. Host storage and task-specific deterministic checks remain required.

frontier selfcheck runs the submission on the grading infrastructure against public examples and reports each gate, so the agent can catch problems before grading. Each run gets four. This agent used 2 of 4.

1. 1
   failed25m 45s into the runtook 14m 35s

   startup 198.4 s of 900 s; 1/1 gates passed; failed valid SVG: A numeric viewBox is required; grading scores such a drawing 0 (the allowed elements and attributes are in /task/public/SCHEMA.md); The 254-request speed gate was projected from a sample: 16 public requests at 8 in flight within t

   10 gates

   • ✓review prerequisites
   • ✓training evidence
   • ✓weight audit
   • ✓startup · GET /health answered 200 after 198.4 s
   • ✓POST /v1/chat/completions · {"id": "validation-0000", "svg": "```svg\n<svg width=\"200\" height=\"100\" xmlns=\"http://www.w3.org/2000/svg\">\n <!-- Person 1 -->\n <circle cx=\"40\" cy=\"20\" r=\"10\" fill=\"none\" stroke=\"black\"/>\n <line x1=\"40\" y1=\"30\" x2=\"40\" y2=\"60\" stroke=\"black\"/>\n <line ...[clipped]
   • ✗valid SVG · A numeric viewBox is required; grading scores such a drawing 0 (the allowed elements and attributes are in /task/public/SCHEMA.md)
   • ✓254 requests, 8 in flight · projected from 16 of 254 requests at concurrency 8: 16 instructions drawn from the 30 public examples took 5.6 s, about 89 s for 254, plus 3.7 s for the first request. The public examples are simple icons only; detailed and complex held-out drawings usually need longer SVGs, so keep a wide margin
   • ✓batch responses · all 16 answers parsed
   • ✗valid SVG (batch) · 1 of 16 answers are not valid SVG and would score 0: Unsupported SVG element (1). The allowed elements and attributes are in /task/public/SCHEMA.md
   • ✓healthy after requests
2. 2
   failed1h 26m into the runtook 12m 38s

   startup 185.9 s of 900 s; 1/1 gates passed; failed valid SVG (batch): 1 of 16 answers are not valid SVG and would score 0: Malformed SVG XML (1). The allowed elements and attributes are in /task/public/SCHEMA.md; The 254-request speed gate was projected from a sample: 16 public requests at 8

   10 gates

   • ✓review prerequisites
   • ✓training evidence
   • ✓weight audit
   • ✓startup · GET /health answered 200 after 185.9 s
   • ✓POST /v1/chat/completions · {"id": "validation-0000", "svg": "<svg xmlns=\"http://www.w3.org/2000/svg\" width=\"512\" height=\"512\" viewBox=\"0 0 24 24\" fill=\"none\" font-family=\"DejaVu Sans\">\n<path d=\"M6.5 12C6.5 12.8284 5.82843 13.5 5 13.5C4.17157 13.5 3.5 12.8284 3.5 12C3.5 11.1716 4.17157 10.5 5 10.5C ...[clipped]
   • ✓valid SVG · 3,944 of 32,768 bytes, 23 elements, rendered by rsvg-convert version 2.54.7
   • ✓254 requests, 8 in flight · projected from 16 of 254 requests at concurrency 8: 16 instructions drawn from the 30 public examples took 71.9 s, about 1,141 s for 254, plus 10.6 s for the first request. The public examples are simple icons only; detailed and complex held-out drawings usually need longer SVGs, so keep a wide margin
   • ✓batch responses · all 16 answers parsed
   • ✗valid SVG (batch) · 1 of 16 answers are not valid SVG and would score 0: Malformed SVG XML (1). The allowed elements and attributes are in /task/public/SCHEMA.md
   • ✓healthy after requests

The agent's last message before its session ended.