I think if no actual living beings (or some future AI that isn’t this feedforward memoryless bullshit) are being harmed then it’s not so much doing as it is saying in the sense of making a statement, which is kind of unclear.

That’s my take as well.

I think this Anthropic fellow is too much of a psychopath to understand that there’s other reasons to ponder the question of consciousness, than to try to upsell a chatbot as a slave, and so he can’t understand that it would actually be very bad for him if a bunch of normies were told, with full weight of divine authority, that these things are conscious. I mean, maybe not civil war level bad, but worse than PETA on your ass level bad for sure.

And that is to me very disturbing. He can’t even imagine that a reaction to “this is a slave” could be anything other than “shut up and take my money”.

I think that’s a separate phenomenon. Renewables are often cheaper than fossil fuels, which is great.

But to avoid pollution, we must actually leave fossil fuels in the ground, unused, unburned.

You know what is the big green initiative at fossil fuel companies? Using renewable energy to power fracking. The worst case scenario used to be that we only leave fossil fuels in the ground when the energy required for their extraction exceeds energy obtained by burning them. Now, the range of scenarios has expanded in both directions. We can leave fossil fuels in the ground because it’s cheaper to do renewables. But also we can extract and burn below-energy-breakeven fossil fuels.

We did give up on it. New shiny shit comes along and they need electricity, where do they get it? Converted airplane turbines, even reciprocating ship engines, etc, all running on natural gas. All the green pledge companies just polluting like there’s no tomorrow, quite literally.

Not to mention that if we didn’t give up on global warming, that would have slowed down AI development, giving more time to prevent AI doomsday.

Plus on the would be dooms day the AI would have less computing power available to it, meaning it would take it longer to figure out how to build another datacenter overnight. Plus if it is more distributed there’s greater latency.

The thing about Yudkowsky’s cult is that like any religion it is really all about not actually thinking anything through.

Everyone accuses them of not really believing what they say, because they can’t think straight about anything that they “believe”. To such an extreme extent it comes off as some sort of cynical ploy with a hidden agenda to convert the oxygen in the atmosphere into paperclips.

Well yeah its gonna likely fail to hack the power grid, but also just starting or stopping too many GPUs at once is a problem if they are grid connected, so I dunno. We damn near had a grid collapse from a freeze in Texas.

Also i used to point out that the real “foom” is how we are fucking up the planet after billions years of evolution. Practically in an instant. Like yeah it feels slow to us because we run pretty fast.

But on geological timeframe it really could just as well be their stupid AI dismantling the planet in 6 days (and on the seventh day, resting).

I would argue that the root cause is that they are complete morons who wouldn’t recognize paperclip maximization if it put a gas turbine in their backyard.

The emerging talk about “AI Chornobyl” is quite disturbing with regards to what this booga-booga gonna look like. If they don’t get enough booga booga from this stupid hacking incident, then what?

What’s really disturbing to me is that now they are talking about the power grid as a target. It’s not like their usual biblical stuff about plagues and locusts. Of course, power grid can’t be that insecure, or Iran would’ve went for it already, but they have privileged access courtesy of all the use of chatbots to run shell commands etc.

I think AI is kind of like that stupid universal socket wrench head that has a bunch of pins in it. The main skill in using something like that would be guessing when it’s not gonna work and not using it.

I think an even bigger problem here is - what are you bringing to the market, and why should you be making any money? Your AI provider has perfect knowledge of how your “organization” works, but they are far better equipped to optimize it, while you’re just using their API as a black box.

Yeah sloppers I know went from “see it proved new math! that totally clears us of plagiarism accusations we get when we repost that someone ai generated a frogger and a WoW clone” to “tried to use it for coding and it didn’t do a good job”.

The math stuff is mostly using Lean proof verifier and all that, by the way, the only use of LLM that they found that is actually legit because it doesn’t matter if its slopping, and you want your attempts randomized.

Anyone who would have tried the kind of bullshit he’s trying, a century ago, would have died of radium poisoning or something equally dreadful. The only reason this idiot is still alive is regulations; however he’s pretty good at risk compensating greater safety of quack treatments in 21th century with the sheer number of quack treatments he’s doing.

I’m going to prognosticate that he’ll die through some combination of the sheer brute force effort he’s putting into finding a lethal quack treatment, and the weakening of regulations and corresponding societal norms relating to quack treatments.

Fucking knew it. I follow some idiot slopper thread and they are all always going on about their prompting and absolutely none of them ever even considered measuring the effects.

Having actually done optimizations including professionally once upon a time, its so ridiculous to see people thinking they optimize a stochastic process [when they don’t even formally measure anything]. It is just gambling.

In addition to shoving absolute piece of shit “products” into everything. Prompt injectable “assistants”, worthless search overviews, shoveled out without any QA or security reviews or anything.

Take those doctor transcriotionists that make up whole sentences. Why in the fuck is there even an LLM in there? Oh it lowers word error rate? That’s because nobody expected having to benchmark bad faith efforts where coherent sentences can be completely made up, so nobody thought it necessary to disqualify for it.

They are still trying to prompt inject the robot god into turning us all into paperclips, I see.

There’s a slopper at the other end of it who believes that asking AI to find the best place to buy bitcoin is something that AIs are good at. Or perhaps asking AI to summarize the article and getting a penis enlargement ad as a summary.

“But I thought chatbots were great at security! They hacked huggingface and also fable will fix all security bugs in firefox”.

I think even if development at an instant is some % faster to start with, it writes the same functionality in more lines of code which will rapidly lead to a cumulative slowdown.

Imagine you are traveling the oregon trail in a wagon and a devil offers you an extra horse but all of its manure has to go into the wagon. Initial speed up followed by a cumulative slowdown. If you keep accepting devil’s deals as your wagon keeps slowing down to a crawl, the progression is governed by a horseshit version of Tsiolkovsky’s equation.

Well, the big issue is that there’s only this much demand. How many web browsers is there genuine end user demand for, worldwide? Probably just 1. Several are made thanks to other demands by large corporations. How much value does a web browser provide, to billions of people who use it? What ever the number may be, it’s orders of magnitude more than it costs to develop.

Why is software observably hard for companies? When 90% of people are working on projects that are going nowhere, that creates a situation where competence is quite rare. Because in most projects it is objectively unnecessary (would make no difference). Where majority of software engineers never seen a successful project all the way from the start to the finish line.

Then there’s startups, these are (predominantly) mere vehicles for moving money from the coffers of large publicly traded corporations into pockets of VCs (who sell startups to said corporations). Whole world of pretend software engineering.

Then there’s large corporations, where CEOs want to get paid more and to be able to get paid more they need to add more layers to the hierarchy underneath them, which they need to fill somehow, and they can’t fill on merit because they just don’t have enough stuff happening that they could measure merit in.

edit: basically the management always wants to do the equivalent of having hired a dozen heart surgeons to work on one heart and a “heart surgery architect” as well, the more layers the better because the more layers the higher is the pay their layer can get.