Building a High-Accuracy Aviation Speech Annotation System at Enhanced Radar
2025-03-03
Enhanced Radar built an in-house aviation speech annotation system, Yeager, to meet its need for high-accuracy data for AI model training. The system leverages incentive mechanisms (pay-per-character, penalties for errors), a user-friendly interface (keyboard shortcuts, audio waveforms, pre-fetching), and respect for annotators (explaining rules, referring to them as 'reviewers') to significantly improve annotation efficiency and accuracy. It also incorporates testing, dispute resolution, and contextual information to ensure data quality and standardization, ultimately achieving near-perfect annotation accuracy.