AI Championship in Street Fighter – Who Won?

AI models compete in classic Street Fighter. Which model won? Are you ready to explore how these digital fighters face off in a legendary battle? Your invitation awaits, step into the arena.

Share
AI Championship in Street Fighter – Who Won?

Sure, Llama and GPT-4 might be better at mimicking human speech, but which AI model is best at pummeling its opponent in Street Fighter? At a hackathon in San Francisco, a group of AI enthusiasts came up with a new benchmark for large language models, reports Tom's Hardware. The test pits different AI models against each other – in Street Fighter 3. Since Street Fighter is all about timing and reaction speed, the test is best suited to small, fast models.

The winner of the first tournament, with 342 matches, was GPT-3.5 Turbo, which finished with 1,776 Elo ranking points, followed by Mistral Small with 1,586 points and GPT-4 (version 1106-preview) with 1,584 points.

The test itself works by reading the current position of both characters in the match and constructing a text prompt that asks the AI to decide what to do next. This is repeated over and over until the match is decided. So far, matches are limited to Ken vs. Ken. LLM Colosseum, as the test is called, is open source, so anyone can install it on their own computer and try it out. There are also instructions for adding other language models.