Post a comment on Reddit, answer coding questions on Stack Overflow or share a baby photo on your public Facebook or Instagram feed and you are also helping to train the next generation of artificial intelligence.
Seriously. Eating Reddit means some truly strange shit is going to emerge. We all know the pattern of fun replies on Reddit, but the AI does not. Hence the glue thing.
I don’t think that’s an impossible problem. Existing models can reliability distinguish between, for example, different languages. Most of their training data is presumably in English but while this may make them better at generating English text, it doesn’t make them randomly switch from other languages to English. A sufficiently advanced model would likewise distinguish between descriptions of reality and shit-posts because the content of shit-posts would not be useful for predicting descriptions of reality. Some fine tuning would teach it to produce just the descriptions of reality.
Or look at it this way: the folks developing these LLMs aren’t ignorant of the fact that Reddit content is often false and meant to be funny. They’re not going to make the sort of silly mistake that someone who isn’t an expert can still easily predict and they’re not going to train their LLMs on that content if it makes the LLMs worse, although we’re still going to see some glue on pizza while the technology continues to develop.
It can cross check a language with tons of other words and examples of that language already in its data set. There is no such data for whether or not something confirms with reality. That simply doesn’t exist and really won’t ever exist. They are not similar problems. One is immensely more challenging to solve than the other.
How much glue should you put in your pizza?
Seriously. Eating Reddit means some truly strange shit is going to emerge. We all know the pattern of fun replies on Reddit, but the AI does not. Hence the glue thing.
Glue is still a more valid pizza topping than PINEAPPLE!!!
Pineapple and bacon is the best toppings for pizza to ever exist
Pineapple and jalapeno together on pizza is pretty dope as well.
Bring back anchovies.
Found Zoidberg!
I don’t think that’s an impossible problem. Existing models can reliability distinguish between, for example, different languages. Most of their training data is presumably in English but while this may make them better at generating English text, it doesn’t make them randomly switch from other languages to English. A sufficiently advanced model would likewise distinguish between descriptions of reality and shit-posts because the content of shit-posts would not be useful for predicting descriptions of reality. Some fine tuning would teach it to produce just the descriptions of reality.
Or look at it this way: the folks developing these LLMs aren’t ignorant of the fact that Reddit content is often false and meant to be funny. They’re not going to make the sort of silly mistake that someone who isn’t an expert can still easily predict and they’re not going to train their LLMs on that content if it makes the LLMs worse, although we’re still going to see some glue on pizza while the technology continues to develop.
It can cross check a language with tons of other words and examples of that language already in its data set. There is no such data for whether or not something confirms with reality. That simply doesn’t exist and really won’t ever exist. They are not similar problems. One is immensely more challenging to solve than the other.