That’s the LLM. It’s not the agent harness. The harness is fully deterministic code. Engineers make the harness capable of performing actions. There is nothing an “AI agent” can do, that a sw dev didn’t allow in the harness.
This is true. However, if you simply forbid all “tools” or “actions” that are potentially harmful then there will be very little left the agent can actually do.
Every tool you give to an LLM agent might be used for “good” or “bad”. To filter malicious actions would need a way to classify the actions with confidence which imo would only work with human supervision.
However, I still think that the companies that develop such systems should still be responsible for what those systems do: They are the ones who pushed the “release” button on those systems.
That’s the LLM. It’s not the agent harness. The harness is fully deterministic code. Engineers make the harness capable of performing actions. There is nothing an “AI agent” can do, that a sw dev didn’t allow in the harness.
This is true. However, if you simply forbid all “tools” or “actions” that are potentially harmful then there will be very little left the agent can actually do.
Every tool you give to an LLM agent might be used for “good” or “bad”. To filter malicious actions would need a way to classify the actions with confidence which imo would only work with human supervision.
However, I still think that the companies that develop such systems should still be responsible for what those systems do: They are the ones who pushed the “release” button on those systems.