• wewbull@feddit.uk
      link
      fedilink
      English
      arrow-up
      2
      ·
      1 month ago

      It’s when the coffers of Microsoft, Amazon, Meta and investment banks dry up. All of them are losing billions every month but it’s all driven by fewer than 10 companies. Nvidia is lapping up the money of course, but once the AI companies stop buying GPUs on crazy numbers it’s going to be a rocky ride down.

      • astanix@lemmy.world
        link
        fedilink
        English
        arrow-up
        0
        ·
        1 month ago

        Is it like crypto where cpus were good and then gpus and then FPGAs then ASICs? Or is this different?

        • wewbull@feddit.uk
          link
          fedilink
          English
          arrow-up
          1
          ·
          1 month ago

          I think it’s different. The fundamental operation of all these models is multiplying big matrices of numbers together. GPUs are already optimised for this. Crypto was trying to make the algorithm fit the GPU rather than it being a natural fit.

          With FPGAs you take a 10x loss in clock speed but can have precisely the algorithm you want. ASICs then give you the clock speed back.

          GPUs are already ASICS that implement the ideal operation for ML/AI, so FPGAs would be a backwards step.