LLMs and Humans Exhibit Bias: A TTS Voice Attractiveness Ranking Experiment
2025-03-10
Last year, the author used LLMs to rank Hacker News users and discovered a bias where the models consistently favored the first user mentioned in the prompt. This year, a new experiment ranking TTS voice attractiveness revealed a similar bias in human participants, who favored voices presented on the right side of the screen. This reinforces the author's previous findings and highlights the importance of sample size and randomization when using both AI and human judgments to mitigate bias.