PierroZ-PLKG@alien.topB to Machine Learning@academy.gardenEnglish · 10 months ago[D] Is grokking present in LLMs?message-squaremessage-square3fedilinkarrow-up11arrow-down10file-text
arrow-up11arrow-down1message-square[D] Is grokking present in LLMs?PierroZ-PLKG@alien.topB to Machine Learning@academy.gardenEnglish · 10 months agomessage-square3fedilinkfile-text
As said in the title I’m curious if grokking has been proven to happen with llm, could it be the case with gpt-4?
minus-squareAlt-Depixelator-777@alien.topBlinkfedilinkarrow-up1·10 months ago“…grass groks being walked on…” llms do not grok, nor do they grok grokking, but mainly, they do not grok “not grokking”
“…grass groks being walked on…” llms do not grok, nor do they grok grokking, but mainly, they do not grok “not grokking”