TY - GEN
T1 - A Synthetic Prediction Market for Estimating Confidence in Published Work
AU - Rajtmajer, Sarah
AU - Griffin, Christopher
AU - Wu, Jian
AU - Fraleigh, Robert
AU - Balaji, Laxmaan
AU - Squicciarini, Anna
AU - Kwasnica, Anthony
AU - Pennock, David
AU - McLaughlin, Michael
AU - Fritton, Timothy
AU - Nakshatri, Nishanth
AU - Menon, Arjun
AU - Modukuri, Sai Ajay
AU - Nivargi, Rajal
AU - Wei, Xin
AU - Lee Giles, C.
N1 - Funding Information:
We acknowledge support by DARPA W911NF-19-2-0272. This work does not necessarily reflect the position or policy of DARPA and no official endorsement should be inferred.
Publisher Copyright:
Copyright © 2022, Association for the Advancement of Artificial Intelligence (www.aaai.org). All rights reserved.
PY - 2022/6/30
Y1 - 2022/6/30
N2 - Explainably estimating confidence in published scholarly work offers opportunity for faster and more robust scientific progress. We develop a synthetic prediction market to assess the credibility of published claims in the social and behavioral sciences literature. We demonstrate our system and detail our findings using a collection of known replication projects. We suggest that this work lays the foundation for a research agenda that creatively uses AI for peer review.
AB - Explainably estimating confidence in published scholarly work offers opportunity for faster and more robust scientific progress. We develop a synthetic prediction market to assess the credibility of published claims in the social and behavioral sciences literature. We demonstrate our system and detail our findings using a collection of known replication projects. We suggest that this work lays the foundation for a research agenda that creatively uses AI for peer review.
UR - http://www.scopus.com/inward/record.url?scp=85143910937&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85143910937&partnerID=8YFLogxK
M3 - Conference contribution
AN - SCOPUS:85143910937
T3 - Proceedings of the 36th AAAI Conference on Artificial Intelligence, AAAI 2022
SP - 13218
EP - 13220
BT - IAAI-22, EAAI-22, AAAI-22 Special Programs and Special Track, Student Papers and Demonstrations
PB - Association for the Advancement of Artificial Intelligence
T2 - 36th AAAI Conference on Artificial Intelligence, AAAI 2022
Y2 - 22 February 2022 through 1 March 2022
ER -