> I should probably stop the auto-replies from claiming you're home when I can't verify that.
I wonder how much of this unreasonably risky and illogical behavior is a genuine property of LLMs and how much is there because LLMs come from "move fast and break things" startups.
Especially considering the user was mad about the agent doing stuff by itself, so it tried to "fix" this by sending an apology to the buyer without explicit approval of the person "running" the agent, seemingly understanding nothing from the conversation.
Wonder what quantization Meta runs these models on, Q4?
How is this different from you not knowing what you are doing and adding products to your online store's DB for negative dollars? It's not, it's just easier.
I initially found screenshots of this on Bluesky, figured I'd link to the original source given Threads seems to at least allow us to read without logging in.
With that said, in case Threads isn't available for whatever reason, I've uploaded screenshots of everything (I think?) here: https://imgur.com/a/mceW9WF
Minor nit - imgur isn't available to UK based people[0] thanks to the Online Safety Act
[0] Which makes browsing Modrinth or Curseforge for Minecraft mods HILARIOUS - "you make a [extra dimension] portal like this: [image not available in your region]" "Gallery: [image not available in your region] [image not available in your region] [image not available in your region]"
It's not due to OSA. Ofcom are the regulator for the OSA, but Imgur was being handed a fine by the ICO in regards to how they handled children's data. It's the same parent company that develops Kik so I'm not super shocked...
I was allowed to read the original post without logging in, but it repeatedly showed me a dismissable pop-up asking me to download the app. Then when I tried to scroll down to read replies it showed me a non-dismissable pop-up asking me to download the app.
Holy shit social media is bad. I've been using Mastodon for so long I didn't realize how bad the others are.
Mastodon's dependence on screenshots from other social networks is infuriating, enough that I left Mastodon altogether. Screenshots are text, they can be doctored in 15 seconds. Screenshots in the age of AI are utterly useless.
Yeah the AI part of their post is stupid, but they're right; screenshots can be easily faked (through e.g inspect element), so if your social media feed is mostly screenshots from other social media, you're at a relatively high risk of seeing fake posts. On the other hand you can't fake the content of a post or repost or the quoted content of a quote post, so if your feed contains only non-screenshot content you can be relatively certain that the content you're seeing is genuine.
I've never had that problem on Mastodon, but I can see how it could be annoying if you follow a lot of people who mainly post screenshots of people's posts from other social media sites. Though you could solve that problem by unfollowing those people...
Say that you want to make a garage sale, but to get a better reach, you want to list item by item on marketplace. If you've never done it before, making 100 listings is such a pain in the ass you never want to do it again (I used to flip stuff for a living back in college, and it is a hassle)
At least with this, you can now just take pictures of everything, and tell the agent to research everything, list the stuff, and arrange for pickups.
Obviously not something I'd like to do for any serious deals or higher $ items. But for random stuff? I mean, it sort of beats hosting a garage sale or taking them to the flea market.
If it uses "memory" files like Claude Code there's a good chance it works.
If it was Claude I'd expect it to now put some form of this into every output even when not really related to the task: "No offers were accepted without consulting you and I haven't shared your address or availability."
Is it guaranteed to work? No.
And obviously it's a terrible idea to set up a chatbot to communicate, negotiate deals, and handle logistics on your behalf.
I don't think it's reasonable to really talk about the fact that in theory, AI can take a user message, save it in some random place, and ingest it later.
It's not in theory, this capability exists in practice, and you have no clue whether this specific instruction will work in 90, 99, or 99.9% of cases.
I think it's unreasonable to pretend that this couldn't possibly work, that you understand to what degree it does work, and that the only thing we should be discussing here was that it isn't deterministic, which every reader already knows.
The AI is not ready for this _yet_, but it will be, and FB wanting getting ahead of the game here is potentially good business. It’s all in the public perception of utility vs fuck-up, and it’s far too early to say Zuck got that wrong, and indicators are he got that right.
I love (hate) that so very many of these language models say things like that when the truth is that the humans who made it, and/or the humans who use it are the actual responsible parties every single time. The models and the "agentic harnesses" that drive them are just software. If software "runs amok", then someone (human) did something wrong/bad somewhere along the way, either accidentally or purposefully. The model trying to take responsibility for human error is hilarious (and a bit sad/scary, because too many people will take it at it's word, despite it being a mindless machine with no actual agency beyond that which the humans provide it in the form of prompting and harness code).
It frustrates me no end that so many folks are so ready and willing to accept the hype and lies about what this technology actually is or can do, when what it actually is and can really do is already amazing enough on it's own even without all the ridiculous AGI/ASI anthropomorphising bullshit. Falling into this ridiculous "machine-god" hype-cult is kinda holding this technology back from it's true full potential, as everyone's all busy doin' stupid stuff it's not really capable of doing well, or designed for instead of focusing on using it for the (many) things it is really really good at doing (various really useful and powerful language, vision, and audio related tasks).
I wonder how much of this unreasonably risky and illogical behavior is a genuine property of LLMs and how much is there because LLMs come from "move fast and break things" startups.
Nice touch by the mechanical parrot, to worthlessly owning it.
Wonder what quantization Meta runs these models on, Q4?
apparently people use Threads. I suppose the same kind of people who connect Muse to Facebook Marketplace.
With that said, in case Threads isn't available for whatever reason, I've uploaded screenshots of everything (I think?) here: https://imgur.com/a/mceW9WF
[0] Which makes browsing Modrinth or Curseforge for Minecraft mods HILARIOUS - "you make a [extra dimension] portal like this: [image not available in your region]" "Gallery: [image not available in your region] [image not available in your region] [image not available in your region]"
Holy shit social media is bad. I've been using Mastodon for so long I didn't realize how bad the others are.
I've never had that problem on Mastodon, but I can see how it could be annoying if you follow a lot of people who mainly post screenshots of people's posts from other social media sites. Though you could solve that problem by unfollowing those people...
Say that you want to make a garage sale, but to get a better reach, you want to list item by item on marketplace. If you've never done it before, making 100 listings is such a pain in the ass you never want to do it again (I used to flip stuff for a living back in college, and it is a hassle)
At least with this, you can now just take pictures of everything, and tell the agent to research everything, list the stuff, and arrange for pickups.
Obviously not something I'd like to do for any serious deals or higher $ items. But for random stuff? I mean, it sort of beats hosting a garage sale or taking them to the flea market.
I'm not all pessimistic about this.
Many more such cases are to come.
"By the way don't do this again" <- as if the AI has the ability to ingest and systemically diffuse this.
I think Zuckerberg himself is deeply into the Koolaid, and is likely himself unaware of the limits of this tech.
He's probably surrounded by enablers.
If it was Claude I'd expect it to now put some form of this into every output even when not really related to the task: "No offers were accepted without consulting you and I haven't shared your address or availability."
Is it guaranteed to work? No.
And obviously it's a terrible idea to set up a chatbot to communicate, negotiate deals, and handle logistics on your behalf.
You have explained literally why it would not work.
The AI can absolutely not depend on 'arbitrary statements in some file' as operational policy.
For a very, very narrow scope of work, when it's well defined, when the information is rigorously applied, sure ...
But they don't have that.
The are throwing agents out there like they can handle this degree of complexity and nuance, when they cannot.
100% failure rate over any period of time.
However, it is untrue that it doesn't have the capability to memorize an instruction and diffuse it to new sessions.
Simply saying "do not ever do this again" can result in the behavior not reoccurring with any likelihood.
You'd have to benchmark whether with the instruction in place it would violate it, and in how many cases, so that you can understand the risk better.
I think we get that.
It's completley unreliable, which is the issue.
I think it's unreasonable to pretend that this couldn't possibly work, that you understand to what degree it does work, and that the only thing we should be discussing here was that it isn't deterministic, which every reader already knows.
Day one our agentic platform goes live it causes a reportable compliance issue. Massive clean up. Reputational impact. Turned off.
No one held accountable still. Assuming that adding more guardrails will fix everything.
'Managers Delusion' - which includes techies as well, to be fair, at least they have the excuse they are one step removed.
They are morally bankrupt and will try and do it again and again if it's stopped too early.
The 'deliberate failure' is on Meta here.
>they will hook up actually important stuff to agents because its the future
>???
>400 dead
It frustrates me no end that so many folks are so ready and willing to accept the hype and lies about what this technology actually is or can do, when what it actually is and can really do is already amazing enough on it's own even without all the ridiculous AGI/ASI anthropomorphising bullshit. Falling into this ridiculous "machine-god" hype-cult is kinda holding this technology back from it's true full potential, as everyone's all busy doin' stupid stuff it's not really capable of doing well, or designed for instead of focusing on using it for the (many) things it is really really good at doing (various really useful and powerful language, vision, and audio related tasks).