microgpt is a single-file Python implementation that enables training and inference of GPT-type language models using only the standard library, without relying on external libraries like PyTorch. The ...
💪 FP8 compatibility ! 🚀 Speed Up all Process 🚀 less VRAM consumption (Stay high, batch_size=1 for RTX4090 max, I'm trying to fix that) 🛠️ Better benchmark coming soon ...
💪 FP8 compatibility ! 🚀 Speed Up all Process 🚀 less VRAM consumption (Stay high, batch_size=1 for RTX4090 max, I'm trying to fix that) 🛠️ Better benchmark coming soon ...
I'm a software engineer passionate about everything shaping our future.
Some results have been hidden because they may be inaccessible to you
Show inaccessible results