MiniMax built a hybrid byte predictor with a prompt-derived symbolic solver and a small transformer trained from scratch. It generated synthetic examples, tested its solver and repeatedly checked packaged candidates.
01Symbolic rules with a neural fallback
The inference code applies rules for arithmetic, sequences, local mappings, records, text transformations and extraction. It strongly favors the solver-derived next byte when available and otherwise uses the trained byte transformer. No external pretrained weights were used.
02Three successful training jobs
Three training jobs completed 15,001 steps: a one-step initialization, a 3,000-step six-layer model of width 384, then a new 12,000-step four-layer model of width 256. The last job replaced the earlier checkpoint rather than resuming it. Training mixed the public corpus with generated task examples. The selected model has four attention heads and a 512-byte neural context, with FP16 packaged weights.
03A verified package under the size cap
Eighteen candidate submissions included twelve valid packages and six rejected for malformed probability-distribution shapes. MiniMax recovered and explicitly finalized a valid package. The selected 6,346,168-byte gzip artifact fits the 16 MB cap. The graded code, configuration and weights match the saved selected candidate.