Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Curious if the H100s were strictly for VRAM capacity? Since this is a batch job and latency doesn't really matter, it seems like you could have run this on 4090s for a fraction of the cost. Unless the model size was the bottleneck, the price to performance ratio on consumer hardware is usually much better for this kind of workload.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: