With the advent of LLMs, multimodality and “general purpose” AIs which seat on unimaginable amounts money, computing power and data. I’m graduating and want to start a PHD, but feel quite disheartened given the huge results obtained simply by “brute-forcing” and by the ever-growing hype in machine learning that could result in a bubble of data scientists, ML researchers and so on.

  • TenshiS@alien.topB
    link
    fedilink
    English
    arrow-up
    1
    ·
    10 months ago

    Interesting take, but 180 degrees from what I believe. Seeing how amazing transformers are and for the first time carving a path to AGI, I think we’ll have the ability to replace the average office worker within 5 years. Any excel and PowerPoint task, phone call, contracting and negociation with clients, controlling and finance, coding task and analytic task can be automated. Its easier than you make it out to be. Most people do disappointingly simple stuff on a daily basis and spend most time with politics and dicking around. A migration project where you move data from a legacy system to a new system sometimes takes 20 people half a year. It’s like reinventing wheels every single time, simply because the systems are different and unique, not because the work itself is particularly difficult. That’s something that could be done in an hour.

    I hope you’re right, but I’m betting on a different horse. I think many people will be blindsided. And I think politics will have a hard time handling the transition to a UBI or whatever solution they come up with fast enough.

    • damhack@alien.topB
      link
      fedilink
      English
      arrow-up
      1
      ·
      10 months ago

      Transformers are not a path to AGI. They’re too dumb and static. Active Inference is where it’s at.