So we are going to assume rest api consumers use the api responsibly as opposed to making a ton of additional calls for no reason that an LLM will have to interpret rather than my existing Redis cache? I’m sure an LLM will be far more efficient.
I mean, it will be vastly more efficient for certain tasks. Like night and day.
Previously, a DOS attack could hope to exhaust the service’s bandwidth out maybe overwhelm its load balancer. And that needed a large botnet for most services. Now you can run a small-scale attack and exhaust the business’s token budget or (if they don’t have token limits) their operational budget. That’s incomparably more efficient!
And all of that without needing to wait for exploits; it’s an aspect of normal operation.
So we are going to assume rest api consumers use the api responsibly as opposed to making a ton of additional calls for no reason that an LLM will have to interpret rather than my existing Redis cache? I’m sure an LLM will be far more efficient.
I mean, it will be vastly more efficient for certain tasks. Like night and day.
Previously, a DOS attack could hope to exhaust the service’s bandwidth out maybe overwhelm its load balancer. And that needed a large botnet for most services. Now you can run a small-scale attack and exhaust the business’s token budget or (if they don’t have token limits) their operational budget. That’s incomparably more efficient!
And all of that without needing to wait for exploits; it’s an aspect of normal operation.
The future is now, old-timer.