One connector, four scholarly indexes, real DOIs and legal free PDFs. Works in Claude and ChatGPT.
Paste it into Claude or ChatGPT as a custom connector. 3-day free trial.
Thomas W. Malone, Michelle Anna Vaccaro, Andres Campero, Jaeyoon Song, Haoran Wen, Abdullah Almaatouq
Inspired by the increasing use of artificial intelligence (AI) to augment humans, researchers have studied human-AI systems involving different tasks, systems and populations. Despite such a large body of work, we lack a broad conceptual understanding of when combinations of humans and AI are better than either alone. Here we addressed this question by conducting a preregistered systematic review and meta-analysis of 106 experimental studies reporting 370 effect sizes. We searched an interdisciplinary set of databases (the Association for Computing Machinery Digital Library, the Web of Science and the Association for Information Systems eLibrary) for studies published between 1 January 2020 and 30 June 2023. Each study was required to include an original human-participants experiment that evaluated the performance of humans alone, AI alone and human-AI combinations. First, we found that, on average, human-AI combinations performed significantly worse than the best of humans or AI alone (Hedges' g = -0.23; 95% confidence interval, -0.39 to -0.07). Second, we found performance losses in tasks that involved making decisions and significantly greater gains in tasks that involved creating content. Finally, when humans outperformed AI alone, we found performance gains in the combination, but when AI outperformed humans alone, we found losses. Limitations of the evidence assessed here include possible publication bias and variations in the study designs analysed. Overall, these findings highlight the heterogeneity of the effects of human-AI collaboration and point to promising avenues for improving human-AI systems.
Formatted from the source metadata, not typed by hand. For a whole reference list, use the citation generator or ask your assistant through Find Research.
Malone, T. W., Vaccaro, M. A., Campero, A., Song, J., Wen, H., & Almaatouq, A. (2024). When combinations of humans and AI are useful: A systematic review and meta-analysis. Nature Human Behaviour, 8(12), 2293–2303. https://doi.org/10.1038/s41562-024-02024-1
Malone, Thomas W., et al. "When combinations of humans and AI are useful: A systematic review and meta-analysis." Nature Human Behaviour, vol. 8, no. 12, 2024, pp. 2293–2303, https://doi.org/10.1038/s41562-024-02024-1.
Malone, Thomas W., Michelle Anna Vaccaro, Andres Campero, Jaeyoon Song, Haoran Wen, and Abdullah Almaatouq. "When combinations of humans and AI are useful: A systematic review and meta-analysis." Nature Human Behaviour 8, no. 12 (2024): 2293–2303. https://doi.org/10.1038/s41562-024-02024-1.
Malone T. W., Vaccaro M. A., Campero A. [и др.] When combinations of humans and AI are useful: A systematic review and meta-analysis // Nature Human Behaviour. — 2024. — Vol. 8, № 12. — P. 2293–2303. — URL: https://doi.org/10.1038/s41562-024-02024-1
@article{malone2024when,
title = {{When combinations of humans and AI are useful: A systematic review and meta-analysis}},
author = {Thomas W. Malone and Michelle Anna Vaccaro and Andres Campero and Jaeyoon Song and Haoran Wen and Abdullah Almaatouq},
journal = {Nature Human Behaviour},
year = {2024},
volume = {8},
number = {12},
pages = {2293--2303},
doi = {10.1038/s41562-024-02024-1},
url = {https://doi.org/10.1038/s41562-024-02024-1}
}TY - JOUR AU - Malone, Thomas W. AU - Vaccaro, Michelle Anna AU - Campero, Andres AU - Song, Jaeyoon AU - Wen, Haoran AU - Almaatouq, Abdullah TI - When combinations of humans and AI are useful: A systematic review and meta-analysis JO - Nature Human Behaviour VL - 8 IS - 12 SP - 2293 EP - 2303 PY - 2024 DA - 2024/10/28 DO - 10.1038/s41562-024-02024-1 UR - https://doi.org/10.1038/s41562-024-02024-1 ER -
Add Find Research to Claude or ChatGPT and ask in plain language. The assistant reads this record, finds the papers around it and cites only what it actually found:
Setup takes about a minute: add the connector, then start the free trial.
Record from OpenAlex; open-access location from Unpaywall and the indexes. Find Research links only to legal copies.