4 hours ago -
I wanted to understand transformers at a level where nothing is magic, so I'm building a ChatGPT-style model from first principles in TypeScript. Why not Python? I've found that reimplementing concepts in a different language forces me to grasp the nuance of the implementation. Chapters cover dataloaders, embeddings, and the attention mechanism so far. Feedback welcome if anything's unclear. Comments URL: https://news.ycombinator.com/item?id=50085332 Points: 7 # Comments: 0
News Source
Hacker News RSS
CPI-U rises 7.2% annualized in September (3.7% YoY)
44 minutes ago
1 hour ago
Smart people don't think others are stupid
2 hours ago
Comment