One connector, four scholarly indexes, real DOIs and legal free PDFs. Works in Claude and ChatGPT.
Paste it into Claude or ChatGPT as a custom connector. 3-day free trial.
Daniyal Rajput, Wei-Jen Wang, Chun‐Chuan Chen
BACKGROUND: An appropriate sample size is essential for obtaining a precise and reliable outcome of a study. In machine learning (ML), studies with inadequate samples suffer from overfitting of data and have a lower probability of producing true effects, while the increment in sample size increases the accuracy of prediction but may not cause a significant change after a certain sample size. Existing statistical approaches using standardized mean difference, effect size, and statistical power for determining sample size are potentially biased due to miscalculations or lack of experimental details. This study aims to design criteria for evaluating sample size in ML studies. We examined the average and grand effect sizes and the performance of five ML methods using simulated datasets and three real datasets to derive the criteria for sample size. We systematically increase the sample size, starting from 16, by randomly sampling and examine the impact of sample size on classifiers' performance and both effect sizes. Tenfold cross-validation was used to quantify the accuracy. RESULTS: The results demonstrate that the effect sizes and the classification accuracies increase while the variances in effect sizes shrink with the increment of samples when the datasets have a good discriminative power between two classes. By contrast, indeterminate datasets had poor effect sizes and classification accuracies, which did not improve by increasing sample size in both simulated and real datasets. A good dataset exhibited a significant difference in average and grand effect sizes. We derived two criteria based on the above findings to assess a decided sample size by combining the effect size and the ML accuracy. The sample size is considered suitable when it has appropriate effect sizes (≥ 0.5) and ML accuracy (≥ 80%). After an appropriate sample size, the increment in samples will not benefit as it will not significantly change the effect size and accuracy, thereby resulting in a good cost-benefit ratio. CONCLUSION: We believe that these practical criteria can be used as a reference for both the authors and editors to evaluate whether the selected sample size is adequate for a study.
Formatted from the source metadata, not typed by hand. For a whole reference list, use the citation generator or ask your assistant through Find Research.
Rajput, D., Wang, W.-J., & Chen, C. (2023). Evaluation of a decided sample size in machine learning applications. BMC Bioinformatics, 24(1), 48. https://doi.org/10.1186/s12859-023-05156-9
Rajput, Daniyal, et al. "Evaluation of a decided sample size in machine learning applications." BMC Bioinformatics, vol. 24, no. 1, 2023, pp. 48, https://doi.org/10.1186/s12859-023-05156-9.
Rajput, Daniyal, Wei-Jen Wang, and Chun‐Chuan Chen. "Evaluation of a decided sample size in machine learning applications." BMC Bioinformatics 24, no. 1 (2023): 48. https://doi.org/10.1186/s12859-023-05156-9.
Rajput D., Wang W.-J., Chen C. Evaluation of a decided sample size in machine learning applications // BMC Bioinformatics. — 2023. — Vol. 24, № 1. — P. 48. — URL: https://doi.org/10.1186/s12859-023-05156-9
@article{rajput2023evaluation,
title = {{Evaluation of a decided sample size in machine learning applications}},
author = {Daniyal Rajput and Wei-Jen Wang and Chun‐Chuan Chen},
journal = {BMC Bioinformatics},
year = {2023},
volume = {24},
number = {1},
pages = {48},
doi = {10.1186/s12859-023-05156-9},
url = {https://doi.org/10.1186/s12859-023-05156-9}
}TY - JOUR AU - Rajput, Daniyal AU - Wang, Wei-Jen AU - Chen, Chun‐Chuan TI - Evaluation of a decided sample size in machine learning applications JO - BMC Bioinformatics VL - 24 IS - 1 SP - 48 PY - 2023 DA - 2023/02/14 DO - 10.1186/s12859-023-05156-9 UR - https://doi.org/10.1186/s12859-023-05156-9 ER -
Add Find Research to Claude or ChatGPT and ask in plain language. The assistant reads this record, finds the papers around it and cites only what it actually found:
Setup takes about a minute: add the connector, then start the free trial.
Record from OpenAlex; open-access location from Unpaywall and the indexes. Find Research links only to legal copies.