[Work in progress]

Reading List

Creating an updated page based on an old ML reference page:

Advanced Natural Language Processing / Spring 2025
https://cmu-l3.github.io/anlp-spring2025/

nanoGPT – a small implementation of a transformer model
https://github.com/karpathy/nanoGPT
https://www.youtube.com/watch?v=kCc8FmEb1nY

Mixture of Experts Explained
https://huggingface.co/blog/moe

 

NeurIPS 2024 LLM Inference Tutorial (Reading List)
https://cmu-l3.github.io/neurips2024-inference-tutorial/

 

Code

https://github.com/OpenRLHF/OpenRLHF