Reddit to LLM.txt
dev.to·14h·
Discuss: DEV
🏛Digital humanities
Preview
Report Post

You found it. The perfect Reddit thread. 300+ comments of exactly the conversation you need for your AI project.

You start copy-pasting. Five minutes in you realize you missed half the nested replies. You go back. You’re trying to figure out which comment was responding to which. An hour later you have a document full of text with no structure and no idea who said what or when.

this is the problem nobody talks about.

Reddit is the best training data on the internet. Real conversations with actual nuance. But every way to extract it is broken. Manual copy-paste doesn’t scale. Scrapers require a CS degree to configure. The API means writing code and dealing with rate limits. And even when you get the text out, it’s just a wall of words. No hierarchy. Your model can’t lea…

Similar Posts

Loading similar posts...

Keyboard Shortcuts

Navigation
Next / previous item
j/k
Open post
oorEnter
Preview post
v
Post Actions
Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Recommendations
Add interest / feed
Enter
Not interested
x
Go to
Home
gh
Interests
gi
Feeds
gf
Likes
gl
History
gy
Changelog
gc
Settings
gs
Browse
gb
Search
/
General
Show this help
?
Submit feedback
!
Close modal / unfocus
Esc

Press ? anytime to show this help