AI Models from Major Companies Show Low Accuracy in Predicting Premier League Soccer Outcomes

AI systems developed by several leading technology companies have demonstrated limited effectiveness in predicting outcomes of soccer matches in the English Premier League. According to a report from Ars Technica, models from major companies were tested on their ability to simulate betting decisions.

The evaluation focused on the 2023-2024 Premier League season, where teams compete in a 38-match schedule per club.

The study involved prompting the AI models with match details, team statistics, and historical performance data to forecast winners and scorelines. The models frequently mispredicted results, leading to simulated betting losses. Ars Technica reported that across multiple tests, the overall accuracy remained below 50 percent, indicating challenges in processing complex variables like player injuries, weather conditions, and tactical shifts.

tests highlighted inconsistencies among the systems.

For instance, one model correctly predicted fewer than one-third of match outcomes in a sample of games. Other models showed similar patterns, with success rates varying by a few percentage points depending on the prompt structure. The report noted that none of the models consistently outperformed random chance in high-stakes scenarios.

One model was particularly scrutinized due to its data capabilities. In simulations, it achieved an accuracy of around 40 percent for outright winner predictions but dropped to 25 percent for exact scorelines. Ars Technica's analysis included comparisons to baseline betting odds from bookmakers, where AI predictions aligned poorly with market consensus.

The evaluation was conducted by researchers who fed the models publicly available data sources, such as league tables and recent form guides.

No proprietary training data specific to soccer was used beyond the models' general knowledge. The Premier League, featuring 20 teams, provides a dataset of matches annually, making it a standard benchmark for predictive testing. Stakes in such predictions extend to sports betting industries, where accurate forecasts influence odds and user decisions.

Fans, bettors, and analysts rely on tools for insights, but the study's results suggest AI remains unreliable for precise wagering. Future improvements may involve specialized fine-tuning for sports data, though no timelines were specified in the report.

Those affected include AI developers seeking to expand applications in entertainment and finance, as well as soccer enthusiasts using tech for game analysis.

Next steps could involve broader testing across other leagues or sports to assess generalizability. Regulatory bodies in gambling may monitor AI's role in betting platforms for fairness.