- Published
- 2022-03-28
- Venue
- Information and Software Technology, vol. 147, pp. 106908
- Cited by
- 434
- Open access
- Yes, hybrid
- DOI
- 10.1016/j.infsof.2022.106908
Abstract
A good search strategy is essential for a successful systematic literature study. Historically, database searches have been the norm, which was later complemented with snowball searches. Our conjecture is that we can perform even better searches if combining these two search approaches, referred to as a hybrid search strategy. Our main objective was to compare and evaluate a hybrid search strategy. Furthermore, we compared four alternative hybrid search strategies to assess whether we could identify more cost-efficient ways of searching for relevant primary studies. To compare and evaluate the hybrid search strategy, we replicated the search procedure in a systematic literature review (SLR) on industry–academia collaboration in software engineering. The SLR used a more “traditional” approach to searching for relevant articles for an SLR, while our replication was executed using a hybrid search strategy. In our evaluation, the hybrid search strategy was superior in identifying relevant primary studies. It identified 30% more primary studies and even more studies when focusing only on peer-reviewed articles. To embrace individual viewpoints when assessing research articles and minimise the risk of missing primary studies, we introduced two new concepts, wild cards and borderline articles, when performing systematic literature studies. The hybrid search strategy is a strong contender for being used when performing systematic literature studies. Furthermore, alternative hybrid search strategies may be viable if selected wisely in relation to the start set for snowballing. Finally, the two new concepts were judged as essential to cater for different individual judgements and to minimise the risk of excluding primary studies that ought to be included.
Cite this paper
Formatted from the source metadata, not typed by hand. For a whole reference list, use the citation generator or ask your assistant through Find Research.
- APA 7
Wohlin, C., Kalinowski, M., Felizardo, K. R., & Mendes, E. (2022). Successful combination of database search and snowballing for identification of primary studies in systematic literature studies. Information and Software Technology, 147, 106908. https://doi.org/10.1016/j.infsof.2022.106908
- MLA 9
Wohlin, Claes, et al. "Successful combination of database search and snowballing for identification of primary studies in systematic literature studies." Information and Software Technology, vol. 147, 2022, pp. 106908, https://doi.org/10.1016/j.infsof.2022.106908.
- Chicago
Wohlin, Claes, Marcos Kalinowski, Katia Romero Felizardo, and Emília Mendes. "Successful combination of database search and snowballing for identification of primary studies in systematic literature studies." Information and Software Technology 147 (2022): 106908. https://doi.org/10.1016/j.infsof.2022.106908.
- GOST
Wohlin C., Kalinowski M., Felizardo K. R. [и др.] Successful combination of database search and snowballing for identification of primary studies in systematic literature studies // Information and Software Technology. — 2022. — Vol. 147. — P. 106908. — URL: https://doi.org/10.1016/j.infsof.2022.106908
- BibTeX
@article{wohlin2022successful, title = {{Successful combination of database search and snowballing for identification of primary studies in systematic literature studies}}, author = {Claes Wohlin and Marcos Kalinowski and Katia Romero Felizardo and Emília Mendes}, journal = {Information and Software Technology}, year = {2022}, volume = {147}, pages = {106908}, doi = {10.1016/j.infsof.2022.106908}, url = {https://doi.org/10.1016/j.infsof.2022.106908} }- RIS
TY - JOUR AU - Wohlin, Claes AU - Kalinowski, Marcos AU - Felizardo, Katia Romero AU - Mendes, Emília TI - Successful combination of database search and snowballing for identification of primary studies in systematic literature studies JO - Information and Software Technology VL - 147 SP - 106908 PY - 2022 DA - 2022/03/28 DO - 10.1016/j.infsof.2022.106908 UR - https://doi.org/10.1016/j.infsof.2022.106908 ER -
Ask Claude about this paper
Add Find Research to Claude or ChatGPT and ask in plain language. The assistant reads this record, finds the papers around it and cites only what it actually found:
- “Summarize doi:10.1016/j.infsof.2022.106908 and list its main limitations.”
- “Find newer studies that test the same question, with free PDFs.”
- “Cite this and five related papers in APA for my literature review.”
Setup takes about a minute: add the connector, then start the free trial.
Record from OpenAlex; open-access location from Unpaywall and the indexes. Find Research links only to legal copies.