Meta's AI didn't break account security. Its architects did
The Meta "AI" is not responsible for letting hackers reset the emails of Instagram accounts, the childishly optimistic architects who thought a security workflow should be handled by LLM token karaoke are.
Do not let Gen AI anthropomorphism let irresponsible system designers off the hook. "Don't change user emails based on someone asking nicely" is not a new threat vector that just appeared.
And I'll remind everyone again, Meta can weather an "oopsie" like that, most of us can't. Make sure the people working AI into your processes have qualifications beyond sales and writing prompts.
Insert obligatory "get in touch" here.
Jessie Grenfell
Jessie has spent 20+ years architecting and delivering software for organizations where complexity is the norm — financial services, insurance, nonprofits, and regulated industries where getting it wrong isn't an option. She specializes in the hard problems: unique operational workflows, cross-system integrations, and the kind of compliance requirements (HIPAA, CCPA, SOC 2) that most developers treat as someone else's job.
At Codality, she leads every principal engagement from discovery through delivery — because she's seen what happens when that thread gets cut.