AI at the 2026 World Cup: How 16 Cameras and Neural Networks Help Referees Make the Call

The 1.5 Billion Eyeballs Problem

than 1.5 billion people worldwide are expected to watch the 2026 World Cup finals. A lot of fans will be watching every pass, touch and goal. This puts a lot of pressure on referees. One wrong call can change a match. Even define a referees career.

FIFA is using technology to help. This years tournament officiating toolkit includes Sonys Hawk-Eye technology. It's a system that supports video assistant referees (VAR) goal-line technology advanced semi-automated offside technology and a "last touch" feature for corner and goal kicks.

Chenliang Xu, a computer science expert says, "Hawk-Eye technology is very sophisticated. It uses computer vision techniques. There are calibrated cameras and real-time vision models to detect the ball, players and their poses. It also has a decision layer to identify when some sort of intervention needs to happen."

 How It Works

During each match 16 optical tracking cameras are positioned around the stadium. They feed data to the tracking systems.

 Multiple cameras are used so that if one camera view is blocked or misleading the others can provide a picture. This enables triangulation creating 3D reconstructions of the ball, players and boundaries.

Chenliang Xu explains, " like with humans if you block one of your eyes it's very hard to perceive depth.. When you have both of your eyes open you can actually fill out the depth and 3D location of the object you're looking at."

The system relies on neural networks. These are machine-learning systems inspired by the brain. They have been trained on millions of annotated images and videos.

Xu says, "Training a computer-vision algorithm to detect a pose is like teaching a child how to recognize things. You feed it examples."

Speed Through Specialization

FIFA estimates the tracking cameras provide than 150 million tracking data points per match. That's a lot of data to manage. The speed comes from specialization.

Xu says, "When FIFA deploys these neural networks they only need them to work well in very particular scenarios. You don't necessarily need your algorithm to recognize a bird, fans or anything else unrelated to the match; you just need them to recognize the players."

A model may begin as a neural network trained on many kinds of images. Then it gets. Scaled back for the specific problems it needs to solve on the pitch.

 The Two Breakthroughs That Made This Possible

Xu says these applications would have been hard to imagine a decade ago. Two advances made todays systems

1.      Deep neural networks dramatically improved performance on recognition and tracking tasks.

2.      Graphics processing units (GPUs) capabilities jumped significantly in the 2010s making todays large-scale AI systems possible.

Xu says, "Neural networks have changed the paradigm. It's no longer necessary to have designed features that we need to train the system to look for. You input the image and the system automatically learns the representations needed for the task."

 Beyond the Pitch

systems are used for measuring first downs in NFL games line-calling at the US Open and goaltending in the NBA. Xu says the technology has applications beyond sports.

"This is very similar to the technology that you deploy in self-driving cars. Those systems need to figure out the vehicles environment detect traffic participants and track them over time and have a decision system built inside to choose whether to accelerate apply the brakes or change lanes."

The underlying computer vision technology could also be used for security, surveillance and other settings where cameras need to follow activity across a physical space.

The Human Element Remains

Even as the technology becomes faster and more sophisticated Xu says the human element remains at the heart of the game. Computer vision can help officials determine whether a players toe drifted offside or who touched the ball last.

It cannot predict the brilliance of a last-minute goal the agony of a missed penalty kick or the collective joy and heartbreak that keep billions of fans watching until the final whistle. The 2026 World Cup finals will still be exciting, for the 1.5 billion people watching.