Back to article
shash42.substack.com

What does your eval measure? (opens in new tab)

Covers 4 stories See all stories this covers including karpathy/autoresearch: AI agents running research on single-GPU nanochat training automaticallyDiscussed on Substack

Covers 4 related stories

GitHub·

karpathy/autoresearch: AI agents running research on single-GPU nanochat training automatically

Discussed on Hacker News, Lobsters, and DEV
Feeds
Import AI (Jack Clark)·

Import AI 455: Automating AI Research

Discussed on Substack
Feeds
dspy.ai·

DSPy – open-source framework for programming not prompting LMs

Discussed on Hacker News and Hacker News
Feeds
arXiv·

"GPQA: A Graduate-Level Google-Proof Q&A Benchmark", Rein et al 2023 (ultra-difficult LLM benchmarks)

Discussed on r/mlscaling
Feeds

Keyboard Shortcuts

Navigation

Next / previous post
j/k
Open post
oorEnter
Preview post
v

Post Actions

Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s

Recommendations

Add interest / feed
Enter
Not interested
x

Go to

Home
gh
Interests
gi
Feeds
gf
Likes
gl
History
gy
Changelog
gc
Settings
gs
Discover
gb
Search
/

General

Show this help
?
Submit feedback
!
Close modal / unfocus
Esc

Press ? anytime to show this help