• wewbull@feddit.uk
    link
    fedilink
    English
    arrow-up
    2
    ·
    1 month ago

    It’s when the coffers of Microsoft, Amazon, Meta and investment banks dry up. All of them are losing billions every month but it’s all driven by fewer than 10 companies. Nvidia is lapping up the money of course, but once the AI companies stop buying GPUs on crazy numbers it’s going to be a rocky ride down.

    • astanix@lemmy.world
      link
      fedilink
      English
      arrow-up
      0
      ·
      1 month ago

      Is it like crypto where cpus were good and then gpus and then FPGAs then ASICs? Or is this different?

      • wewbull@feddit.uk
        link
        fedilink
        English
        arrow-up
        1
        ·
        1 month ago

        I think it’s different. The fundamental operation of all these models is multiplying big matrices of numbers together. GPUs are already optimised for this. Crypto was trying to make the algorithm fit the GPU rather than it being a natural fit.

        With FPGAs you take a 10x loss in clock speed but can have precisely the algorithm you want. ASICs then give you the clock speed back.

        GPUs are already ASICS that implement the ideal operation for ML/AI, so FPGAs would be a backwards step.