Don’t use Forsyth-Edwards notation (FEN) to play chess with LLMs: limitations and alternatives

3 Likes

Here is the corresponding Raku Advent Calendar blog post referenced in the notebook.

Here is a quick list from the perspective of LLMs playing chess:

  • PGN provides game history, context, and metadata, aiding in strategic learning.
  • FEN only describes a single board position, lacking historical context.
    • The development of a game using FEN would be a list of fully specified chess positions, over the whole chessboard, with only few changes between the corresponding FEN strings.
    • PGN using Algebraic Notation (AN) represents gave development move-by-move.
      • I.e. much easier for sequential prediction.
  • PGN allows LLMs to learn from move sequences and game annotations easier than with FEN.
    • (Related to the point above.)
  • PGN is versatile for game simulation; FEN for specific position analysis.
  • PGN integrates well with extensive game databases for LLM training. It seems to me that:
    • Many PGN databases exist, which are rich sources for LLMs to learn from a wide array of games, providing a vast corpus for training or analysis.
    • While FEN is used in chess engines and tools for position analysis, its use is more limited in scope. (Hence, WWW representation.)

BTW, “Wolfram/Chess” is using (strict) FEN strings as input. Looking at the documentation of Chessboard no other type of input is allowed. Ideally, other formats would be allowed soon…

news-congrads-kkluyshnik-02-04-19.jpg – you have earned Featured Contributor Badge 2015-11-02_10-07-11.png
Your exceptional post has been selected for our editorial column Staff Picks http://wolfr.am/StaffPicks and Your Profile is now distinguished by a Featured Contributor Badge and is displayed on the Featured Contributor Board. Thank you!

1 Like

Thank you for the recognition, Moderation Team!