• henrikx@lemmy.dbzer0.com
    link
    fedilink
    English
    arrow-up
    7
    arrow-down
    6
    ·
    edit-2
    5 months ago

    You should all see the story about the invention blue LEDs. No one believed that it could work except some japanese guy (Shuji Nakamura) who kept working on it despite his company telling him to stop. No one believed it could ever be solved despite being so close. He solved it and the rewards were astronomical.

    This could very well be another case of being so close to a breakthrough. Two years since GPT-3 came out is nothing. If you were paying any sort of attention you would see there are promising papers coming out almost every week. It’s clear there is a lot we don’t know about training neural nets effectively. Our own brains are the proof of that.

    • cley_faye@lemmy.world
      link
      fedilink
      English
      arrow-up
      16
      arrow-down
      1
      ·
      5 months ago

      No one believed that it could work except some japanese guy

      There is a difference in not knowing how to do a thing and someone coming out doing the thing, and knowing how something works, knowing it’s by design limitations, and still hoping it may work out.

    • zbyte64@awful.systems
      link
      fedilink
      English
      arrow-up
      11
      arrow-down
      1
      ·
      5 months ago

      I mean if you ignore all the papers that point out how dubious the gen AI benchmarks are, then it is very impressive.

    • raspberriesareyummy@lemmy.world
      link
      fedilink
      English
      arrow-up
      4
      ·
      5 months ago

      mwahahah. The people who are working on LLMs right now are the dumbasses and MBAs of the industry. If we ever get anything like an artificial general AI, it will come from a team of serious researchers / engineers who don’t give a shit about marketing.