jenk/build-your-own-x
1
1
Fork 0
mirror of https://github.com/codecrafters-io/build-your-own-x synced 2026-07-02 16:59:25 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
618 commits 1 branch 0 tags 10 MiB
Commit graph

2 commits

Author SHA1 Message Date
Claude
1ef5253c93
Add .gitignore for llm/, remove compiled/checkpoint files 
https://claude.ai/code/session_01SWXLQb3nFTiygbp74dpjVa
 2026-03-22 22:51:54 +00:00
Claude
1d3ce8cff7
Add basic LLM implementation from scratch 
Implements a character-level GPT-style Transformer:
- model.py: CausalSelfAttention, FeedForward, TransformerBlock, LLM
- tokenizer.py: CharTokenizer (char -> int mapping)
- train.py: training loop with AdamW, gradient clipping, checkpointing, sampling
- generate.py: load checkpoint and generate text from a prompt

Verified working on a built-in Shakespeare excerpt (805k param model).

https://claude.ai/code/session_01SWXLQb3nFTiygbp74dpjVa
 2026-03-22 22:51:49 +00:00