Back to article
pathtostaff.com

Self-Attention Solved the Sequential Bottleneck (opens in new tab)

Covers 10 stories See all stories this covers including Attention is all you need (2017)Covered by tldr.techDiscussed on Hacker News

Covers 10 related stories

arXiv·

Attention is all you need (2017)

Discussed on Hacker News, Hacker News, and DEV
Feeds
arXiv·

DeepSeek-V3 Technical Report

Discussed on Hacker News and Hacker News
Feeds
arXiv·

Language models are few-shot learners (2020)

Discussed on Hacker News
Feeds
arXiv·

Current LLMs are the future? No ways man! Look at Mamba: Selective State Spaces

Discussed on r/LLM
Feeds
arXiv·

Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer

Discussed on Hacker News
Feeds
transformer-circuits.pub·

In-context Learning and Induction Heads

Feeds
arXiv·

YaRN: Efficient Context Window Extension of Large Language Models

Feeds
arXiv·

[2401.04088] Mixtral of Experts

Feeds
arXiv·

[1409.0473] neural machine translation by jointly learning to align and translate

Feeds
youtube.com·

Let's build GPT: from scratch, in code, spelled out.

Feeds

Covered in 1 article

tldr.tech·

GLM 5.2 comparisons ⚔️, use AI for code review 👀, Deno Desktop 🖥

Feeds

Keyboard Shortcuts

Navigation

Next / previous post
j/k
Open post
oorEnter
Preview post
v

Post Actions

Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s

Recommendations

Add interest / feed
Enter
Not interested
x

Go to

Home
gh
Interests
gi
Feeds
gf
Likes
gl
History
gy
Changelog
gc
Settings
gs
Discover
gb
Search
/

General

Show this help
?
Submit feedback
!
Close modal / unfocus
Esc

Press ? anytime to show this help