Nano GPT
2 devlogs
1h 14m
Created by
Maadhav Bhatt
Nano GPT, as built by Andrej Kaparthy in his 2023 video
Followers
No followers yet
Ship Your Project
Get ready!
Once you ship this you can't edit the description of the project, but you'll be able to add more devlogs and re-ship it as you add new features!
Timeline
feat: implement data processing and create BigramLanguageModel class
chore: add formatting related settings
Attempted to understand and implement the loss part, but I need a review on Transformers first.
Download datasets, understand tokenization, implement character level tokenization.
