Stylometric comparisons of human versus AI-generated creative writing

Simple item page
dc.contributor.authorO'Sullivan, Jamesen
dc.date.accessioned2025-01-23T12:59:42Z
dc.date.available2025-01-23T12:59:42Z
dc.date.issued2025en
dc.description.abstractThis study employs stylometry to compare the creative writing styles of humans and large language models (LLMs) such as GPT-3.5, GPT-4, and Llama 70b. Using a dataset of short stories generated in response to predefined narrative prompts, the analysis focuses on stylistic differences, measured through Burrows’ Delta, a widely used metric in computational literary studies. Clustering techniques reveals clear distinctions between human and AI-generated texts, findings which suggest that LLMs, while increasingly sophisticated in mimicking human creativity, remain distinguishable as machine-generated texts.en
dc.description.statusPeer revieweden
dc.format.mimetypeapplication/pdfen
dc.identifier.articleid1708
dc.identifier.citationO’Sullivan, J. (2025) ‘Stylometric comparisons of human versus AI-generated creative writing’, Humanities and Social Sciences Communications, 12(1), 1708. https://doi.org/10.1057/s41599-025-05986-3en
dc.identifier.doi10.1057/s41599-025-05986-3
dc.identifier.endpage7en
dc.identifier.issued1
dc.identifier.journaltitleHumanities and Social Sciences Communications
dc.identifier.startpage1en
dc.identifier.urihttps://hdl.handle.net/10468/16884
dc.identifier.volume12
dc.language.isoenen
dc.rights© 2025, the Author. This is an Open Access article distributed under the terms of the Creative Commons Attribution-NonCommercial-NoDerivatives License (http://creativecommons.org/licenses/by-nc-nd/4.0/), which permits non-commercial re-use, distribution, and reproduction in any medium, provided the original work is properly cited, and is not altered, transformed, or built upon in any way.en
dc.rights.urihttps://creativecommons.org/licenses/by-nc-nd/4.0/
dc.subjectStylometryen
dc.subjectCreative writing stylesen
dc.subjectLarge language models (LLMs)en
dc.subjectGPT-3.5en
dc.subjectGPT-4en
dc.subjectLlama 70ben
dc.subjectStylistic differencesen
dc.subjectBurrows’ Deltaen
dc.titleStylometric comparisons of human versus AI-generated creative writingen
dc.typeArticle (peer-reviewed)en
Files
Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
osullivan-humans-versus-LLMs-creative-writing.pdf
Size:
1.53 MB
Format:
Adobe Portable Document Format
Description:
Published Version
Download
License bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
license.txt
Size:
2.71 KB
Format:
Item-specific license agreed upon to submission
Description:
Download
Collections
Digital Arts and Humanities - Journal Articles