Abstract:In this study, we propose a structured methodology that utilizes large language models (LLMs) in a cost-efficient and parsimonious manner, integrating the strengths of scholars and machines while offsetting their respective weaknesses. Our methodology, facilitated through a chain of thought and few-shot learning prompting from computer science, extends best practices for co-author teams in qualitative research to human-machine teams in quantitative research. This allows humans to utilize abductive reasoning and natural language to interrogate not just what the machine has done but also what the human has done. Our method highlights how scholars can manage inherent weaknesses OF LLMs using careful, low-cost techniques. We demons…
Abstract:In this study, we propose a structured methodology that utilizes large language models (LLMs) in a cost-efficient and parsimonious manner, integrating the strengths of scholars and machines while offsetting their respective weaknesses. Our methodology, facilitated through a chain of thought and few-shot learning prompting from computer science, extends best practices for co-author teams in qualitative research to human-machine teams in quantitative research. This allows humans to utilize abductive reasoning and natural language to interrogate not just what the machine has done but also what the human has done. Our method highlights how scholars can manage inherent weaknesses OF LLMs using careful, low-cost techniques. We demonstrate how to use the methodology to interrogate human-machine rating discrepancies for a sample of 1,934 press releases announcing pharmaceutical alliances (1990-2017).
| Comments: | 67 pages |
| Subjects: | Computation and Language (cs.CL); Artificial Intelligence (cs.AI) |
| MSC classes: | 68T50 |
| ACM classes: | H.3.3; I.2.7 |
| Cite as: | arXiv:2512.07583 [cs.CL] |
| (or arXiv:2512.07583v1 [cs.CL] for this version) | |
| https://doi.org/10.48550/arXiv.2512.07583 arXiv-issued DOI via DataCite (pending registration) | |
| Related DOI: | https://doi.org/10.2139/ssrn.5577090 DOI(s) linking to related resources |
Submission history
From: Navid Asgari [view email] [v1] Mon, 8 Dec 2025 14:26:31 UTC (1,082 KB)