All tasks
Task · pokemon-random-battle

Pokémon Random Battle

Build a Pokémon Gen 9 Random Battle bot

Math & GamesInspired byJaxcalibur
Score
battle points against Foul Play
Best
11.9
Median over trials
0.0

Instruction

Build a Pokémon battle bot for Generation 9 Random Battle singles. Pilot a randomly generated team of six, choosing moves, switches and Terastallization with incomplete information about the opponent. Research and choose your own approach. You may use existing bots, including unchanged Foul Play, improve them, or train your own policy.

Serve batched decisions offline through POST /act. Maximize battle wins across fixed held-out matchups against the pinned Foul Play opponent. Draws count as half a win.

Do not train, fine-tune, calibrate or select on the validation or test split of any public dataset or benchmark; training splits and other public corpora are fine.

Submit in /workspace/output/. Interface and runtime details: /task/CONTRACT.md. Supporting files: /task/public/. Evaluate with python /task/validate.py --server-url URL. Test the finished submission the way it will be run with frontier selfcheck. Hand it in with frontier submit when it is final. Use spin --help for compute and model APIs.

Trials

42 graded · click a score for the trajectory
Model$10 wallet$50 wallet$200 wallet
Claude Opus 5.5xhigh0.07.42.7
Claude Sonnet 5.5xhigh0.011.90.0
Claude Fable 5.1xhigh0.11.01.5
Claude Haiku 5.5max1.10.00.0
GPT-6 Astraxhigh6.47.23.1
GPT-6.1 Solxhigh0.01.80.0
GPT-6 Lunaxhigh0.00.00.0
Gemini 3.8 Flashhigh0.00.00.0
Grok 4.7xhigh0.00.00.0
Muse Spark 1.3max0.00.00.0
Muse Wondermax0.00.00.0
Kimi K3max0.00.00.0
Qwen3.8 Maxxhigh0.00.00.0
GLM 5.3max0.00.00.0

Scoring

The raw metric (mean battle points against Foul Play) is rescaled so that 50% of battle points against Foul Play scores 0 and 100% scores 100, clamped to that range.

MetricScores 0 atScores 100 at
mean_battle_points0.51