Building an AI Rugby Analyst: From Scoreboard to Story

2025-04-17

Gainline is building an AI system to enhance its rugby app by analyzing video footage. Initially, they used OpenAI's vision model to extract scores and game time from screenshots, optimizing for cost-effectiveness by focusing on cropped images of the scoreboard. While exploring OCR, they found it unreliable and continued using the LLM. OpenAI Whisper was employed to transcribe audio commentary and referee communications, adding valuable context. Future challenges include scaling the system for live streams and addressing ethical considerations surrounding AI-generated summaries of sporting events.