Introducing SpacesDiscover community-curated learning paths and structured roadmaps for any topic you want to master.
Explore Spaces
YTCourseYTCourse
TechnologyTopic

Explore Language Model Engineering

Curated learning resources and paths covering Language Model Engineering.

3

Sub-Topics

1

Course

0

Learners

Explore Sub-Topics

View All Sub-Topics
SUB-TOPIC

Tokenization

Hover to explore

Curated learning resources and paths covering Tokenization.

SUB-TOPIC

Transformer Architecture

Hover to explore

Curated learning resources and paths covering Transformer Architecture.

SUB-TOPIC

Context Windows

Hover to explore

Curated learning resources and paths covering Context Windows.

All Language Model Engineering Courses

Browse all courses in Language Model Engineering.

Architecting Large Language Models from Scratch: From Perceptrons to Post-Training
14h 23m
Advanced
—/ 5.002

Architecting Large Language Models from Scratch: From Perceptrons to Post-Training

Master the inner workings of LLMs by building a GPT-2-style transformer from scratch. Learn neural network fundamentals, GPU optimization, attention mechanisms, pre-training pipelines, instruction tuning, and policy optimization using PyTorch.

Justin Angel@justinangelai

Didn't find what you were looking for?

Explore other topics or browse all courses to find exactly what you're looking for.

Explore Topics Browse All Courses