One connector, four scholarly indexes, real DOIs and legal free PDFs. Works in Claude and ChatGPT.
Paste it into Claude or ChatGPT as a custom connector. 3-day free trial.
Connor Shorten, Taghi M. Khoshgoftaar, Borko Furht
Natural Language Processing (NLP) is one of the most captivating applications of Deep Learning. In this survey, we consider how the Data Augmentation training strategy can aid in its development. We begin with the major motifs of Data Augmentation summarized into strengthening local decision boundaries, brute force training, causality and counterfactual examples, and the distinction between meaning and form. We follow these motifs with a concrete list of augmentation frameworks that have been developed for text data. Deep Learning generally struggles with the measurement of generalization and characterization of overfitting. We highlight studies that cover how augmentations can construct test sets for generalization. NLP is at an early stage in applying Data Augmentation compared to Computer Vision. We highlight the key differences and promising ideas that have yet to be tested in NLP. For the sake of practical implementation, we describe tools that facilitate Data Augmentation such as the use of consistency regularization, controllers, and offline and online augmentation pipelines, to preview a few. Finally, we discuss interesting topics around Data Augmentation in NLP such as task-specific augmentations, the use of prior knowledge in self-supervised learning versus Data Augmentation, intersections with transfer and multi-task learning, and ideas for AI-GAs (AI-Generating Algorithms). We hope this paper inspires further research interest in Text Data Augmentation.
Formatted from the source metadata, not typed by hand. For a whole reference list, use the citation generator or ask your assistant through Find Research.
Shorten, C., Khoshgoftaar, T. M., & Furht, B. (2021). Text Data Augmentation for Deep Learning. Journal Of Big Data, 8(1), 101. https://doi.org/10.1186/s40537-021-00492-0
Shorten, Connor, et al. "Text Data Augmentation for Deep Learning." Journal Of Big Data, vol. 8, no. 1, 2021, pp. 101, https://doi.org/10.1186/s40537-021-00492-0.
Shorten, Connor, Taghi M. Khoshgoftaar, and Borko Furht. "Text Data Augmentation for Deep Learning." Journal Of Big Data 8, no. 1 (2021): 101. https://doi.org/10.1186/s40537-021-00492-0.
Shorten C., Khoshgoftaar T. M., Furht B. Text Data Augmentation for Deep Learning // Journal Of Big Data. — 2021. — Vol. 8, № 1. — P. 101. — URL: https://doi.org/10.1186/s40537-021-00492-0
@article{shorten2021text,
title = {{Text Data Augmentation for Deep Learning}},
author = {Connor Shorten and Taghi M. Khoshgoftaar and Borko Furht},
journal = {Journal Of Big Data},
year = {2021},
volume = {8},
number = {1},
pages = {101},
doi = {10.1186/s40537-021-00492-0},
url = {https://doi.org/10.1186/s40537-021-00492-0}
}TY - JOUR AU - Shorten, Connor AU - Khoshgoftaar, Taghi M. AU - Furht, Borko TI - Text Data Augmentation for Deep Learning JO - Journal Of Big Data VL - 8 IS - 1 SP - 101 PY - 2021 DA - 2021/07/19 DO - 10.1186/s40537-021-00492-0 UR - https://doi.org/10.1186/s40537-021-00492-0 ER -
Add Find Research to Claude or ChatGPT and ask in plain language. The assistant reads this record, finds the papers around it and cites only what it actually found:
Setup takes about a minute: add the connector, then start the free trial.
Record from OpenAlex; open-access location from Unpaywall and the indexes. Find Research links only to legal copies.