Train 1T parameter LLM with 8 GPUs?

See this project https://github.com/Sphere-AI-Lab/orbit.

3 points | by kendy1992 1 day ago

1 comments