we_are_mammals@alien.topB to Machine Learning@academy.gardenEnglish · 10 months agoBill Gates told a German newspaper that GPT5 wouldn't be much better than GPT4: "there are reasons to believe that we have reached a plateau" [N]www.handelsblatt.comexternal-linkmessage-square131fedilinkarrow-up11arrow-down10cross-posted to: machinelearning@lemmit.online
arrow-up11arrow-down1external-linkBill Gates told a German newspaper that GPT5 wouldn't be much better than GPT4: "there are reasons to believe that we have reached a plateau" [N]www.handelsblatt.comwe_are_mammals@alien.topB to Machine Learning@academy.gardenEnglish · 10 months agomessage-square131fedilinkcross-posted to: machinelearning@lemmit.online
minus-squarevisarga@alien.topBlinkfedilinkEnglisharrow-up1·10 months ago no ML technique has been shown to do anything more than just mimic statistical aspects of the training set That’s ok when the agent creates its own training set, like AlphaZero. It is learning from feedback as opposed to learning from next token prediction.
That’s ok when the agent creates its own training set, like AlphaZero. It is learning from feedback as opposed to learning from next token prediction.