# The Future of Open Human Feedback

Authors: Shachar Don-Yehiya, Ben Burtenshaw, Ramon Fernandez Astudillo, Cailean Osborne, Mimansa Jaiswal, Tzu-Sheng Kuo, Wenting Zhao, Idan Shenfeld, Andi Peng, Mikhail Yurochkin, Atoosa Kasirzadeh, Yangsibo Huang, Tatsunori Hashimoto, Yacine Jernite, Daniel Vila-Suero, Omri Abend, Jennifer Ding, Sara Hooker, Hannah Rose Kirk, Leshem Choshen
Venue: Nature Machine Intelligence (2025)

## Abstract
Human feedback on conversations with language models is central to how these systems learn about the world, improve their capabilities and are steered towards desirable and safe behaviours. However, this feedback is mostly collected by frontier artificial intelligence labs and kept behind closed doors. Here we bring together interdisciplinary experts to assess the opportunities and challenges to realizing an open ecosystem of human feedback for artificial intelligence. We first look for successful practices in the peer-production, open-source and citizen-science communities. We then characterize the main challenges for open human feedback. For each, we survey current approaches and offer recommendations. We end by envisioning the components needed to underpin a sustainable and open human feedback ecosystem. In the centre of this ecosystem are mutually beneficial feedback loops, between users and specialized models, incentivizing a diverse stakeholder community of model trainers and feedback providers to support a general open feedback pool. Don-Yehiya et al. explore creating an open ecosystem for human feedback on large language models, drawing from peer-production, open-source and citizen-science practices, and addressing key challenges to establish sustainable feedback loops between users and specialized models.

## Links
- arXiv: https://arxiv.org/abs/2408.16961
- PDF: https://arxiv.org/pdf/2408.16961
- HTML: https://arxiv.org/html/2408.16961
- Hugging Face: https://huggingface.co/papers/2408.16961
- alphaXiv: https://www.alphaxiv.org/abs/2408.16961
- DOI: https://doi.org/10.1038/s42256-025-01038-2
- Semantic Scholar: https://www.semanticscholar.org/paper/272310324
- Publisher: https://api.semanticscholar.org/CorpusID:272310324

## How to cite
@inproceedings{DonYehiya2024TheFO,
title={The Future of Open Human Feedback},
  author={Shachar Don-Yehiya and Ben Burtenshaw and Ramon Fernandez Astudillo and Cailean Osborne and Mimansa Jaiswal and Tzu-Sheng Kuo and Wenting Zhao and Idan Shenfeld and Andi Peng and Mikhail Yurochkin and Atoosa Kasirzadeh and Yangsibo Huang and Tatsunori Hashimoto and Yacine Jernite and Daniel Vila-Suero and Omri Abend and Jennifer Ding and Sara Hooker and Hannah Rose Kirk and Leshem Choshen},
  year={2025},
booktitle={Nature Machine Intelligence},
  url={https://api.semanticscholar.org/CorpusID:272310324}
}