I made a site to compare GPUs
When you look at GPU compute at any site, there is not much help to understand what kind of powerful you are actually renting. I think the worst thing is that some providers has "cheap" gpus, but they are so old that using them is directly counterproductive since it does not support any of the new features that makes GPUs fast.
Google will show a Nvidia T4 in Colab and also Google Cloud, but it is actually from 2018 and does not support BF16 or FP8. You are essentially renting outdated hardware. They will also rent you a L4, but it only has 300 GB/S memory which is really slow compared to newer GPUs, so all in all you are underselling your own time by renting one of those cards, even though it looks like a great getting started cards. And don't get me started on the P4 which they are selling at $438 a month.
Read full post
