CS336: Language Modeling from Scratch
3 hours ago
- #CS336
- #AI education
- #language models
- This course provides a comprehensive overview of language models, guiding students through building their own language models from data collection to deployment.
- Prerequisites include proficiency in Python, deep learning experience, and knowledge of calculus, linear algebra, probability, statistics, and machine learning.
- Coursework involves five assignments focusing on basics, systems, scaling, data processing, and alignment/reinforcement learning.
- GPU compute options for self-study include Modal, Lambda Labs, RunPod, Nebius, and Together, with recommendations for debugging on CPU first.
- Honor code policies allow study group collaboration, limited AI tool use for conceptual questions, and prohibit copying existing code.
- Course logistics include lectures on Monday/Wednesday, office hours, and using Slack for questions and announcements.