DEV Community

Sho Tanaka (tsho)
Sho Tanaka (tsho)

Posted on Originally published at implicit-none.com on

Turning Qwen2.5-0.5B into a JSON API with SFT — 23% 100% on a Free T4

I Tried Post-Training and All I Got Was "systemsystem"

I followed the TRL tutorial to fine-tune a small model with SFT (supervised fine-tuning). Training ran to completion. But no matter what I asked the trained model, the answer was: