Will we find tree search in a vanilla transformer trained on chess games by 2026?
Mini
7
Ṁ123
2026
22%
chance
Get Ṁ1,000 play money
Sort by:

https://arxiv.org/abs/2402.04494

TLDR:

... we train a 270M parameter transformer model [on chess]

Lichess blitz Elo of 2895 against humansWe also show that our model outperforms AlphaZero's policy and value networks (**without MCTS**) and GPT-3.5-turbo-instruct.