How Automation Affects Institutional Trust

More than half of internet traffic today is no longer human. That's not a dystopian prediction. It's from Stanford University's 2026 AI Index report. MIT Sloan Management Review - Middle East has an article by Tasmia Ansari this week that takes that data point seriously and follows it to its organizational implications — and it's one of the more rigorous pieces on what AI actually does to institutional trust over time. The core argument is structured around a verification–velocity matrix. Most organizations are currently operating in the high-velocity, low-verification quadrant: scaling AI-generated content fast, with limited traceability or oversight. That position feels competitive in the short term. The problem is that it quietly erodes the one asset that's hardest to rebuild — user trust. The Google AI Overviews example is instructive. What looked like a product improvement, collapsing multiple sources into a single synthesized answer, turned out to remove the incentive for users to engage with original, verifiable content at all. The downstream effect: the raw material that feeds AI systems begins to thin out. Speed ate the source. What is most significant here is the organizational framing. This isn't a technology problem with a technology fix. It requires C-suite decisions about where the company sits on the verification spectrum, product teams designing for traceability, and boards asking what proportion of outputs are actually verifiable. Wikipedia's model — 20 years of insisting every claim link to a checkable source looks less like a quaint editorial policy and more like a durable competitive architecture right now. In a world where AI generates everything, the organizations that maintain rigorous human judgment in the loop won't just be more credible. They'll be increasingly rare. Full story on MIT Sloan Management Review Middle East — link in comments.

Princeton University did not end a 133-year honor code tradition because students suddenly changed. It ended because the conditions that made that system work changed. A trust-based model depends on people being able to observe behavior well enough to regulate it. Once that visibility starts to disappear, the structure underneath the trust starts to weaken too. That is what makes this story worth paying attention to. For generations, Princeton believed a shared commitment to honesty could hold without proctors in the room. That belief was not naive. It worked for more than a century. What changed was not the existence of cheating, but the ability to detect it. When a student can use new tools on a small device and still look like they are simply thinking, peer accountability breaks down because the misconduct no longer has an obvious external signal. That same pattern is showing up in other places. CNBC reported Goldman Sachs COO John Waldron describing parts of the workforce as a “human assembly line,” with digital agents becoming the robots. Financial Times reported that Amazon employees were gaming internal leaderboards by burning fake tokens. Princeton University is changing how exams are administered because the old trust architecture no longer has the visibility it relied on. These are very different stories, but they point to the same pressure: once it becomes harder to tell what is genuine, what is automated, and what is being manipulated, the way accountability works has to change. This is why the conversation matters beyond schools. Organizations also run on trust-based systems. They set rules, explain values, hire people they believe will act responsibly, and assume managers and peers can observe behavior well enough for self-governance to hold. When that observability starts to erode, the response is rarely neutral. Companies move toward tighter controls, more monitoring, and more effort to recreate visibility through systems and surveillance. That is the leadership challenge underneath all of this. The real issue is not simply whether new tools make work faster. It is whether institutions can preserve trust when they can no longer see clearly how the work is being done. The answer to that question will shape how organizations manage performance, integrity, and accountability in the years ahead.

AI killed trust in 37% of companies last year. Not because the technology failed. Because leaders did. I watched a $4B healthcare company deploy AI that made perfect business sense. Saved $12M annually. Improved efficiency 3x. Six months later, some of their best people had quit. The AI worked flawlessly. The trust? Gone. Here's what actually happened: Monday morning all-hands: "We're implementing AI to augment our workforce." What employees heard: "We're replacing you." No context. No conversation. No consideration for the humans who'd built the company. Leadership promised "full transparency" about AI's role. Then held closed-door meetings about "workforce optimization." Then wondered why rumors spread faster than facts. What Trust Actually Looks Like in the AI Era: 1. Start With (The Human) Why → Not "AI will save us money." → But "AI will handle repetitive tasks so you can do work that matters." → Show people their future, not their replacement. 2. Co-Create The Change The companies succeeding with AI? They involved employees from day one. → Engineers helped design AI workflows → Customer service shaped AI responses   → Sales teams defined AI boundaries 3. Address The Fear Directly → "Will AI take my job?"  → Stop dodging. Answer honestly: "AI will change your job. Here's exactly how. Here's what we're doing to ensure you thrive in that change." 4. Invest in Humans First → One client spent $3M on AI, $3M on employee development. → Result: 94% adoption rate, zero key talent loss. → The math is simple: Trust is cheaper than turnover. Trust Multipliers That Work: Radical Transparency → Share AI decision criteria → Show which tasks AI handles → Publish success AND failure metrics Skills Guarantee → "We'll invest in your growth" → Paid learning time → Clear career pathways with AI Human-First Policies → No AI decisions about people without human review → Employees can challenge AI recommendations → Ethics committee with actual employee representation The Trust Killers to Avoid: → Surprise AI deployments → "Trust us" without evidence → Talking efficiency while planning layoffs → Treating AI resistance as ignorance The Counter-Intuitive Truth: Companies that prioritize trust over technology are winning with AI. Here's what I've learned from watching multiple AI transformations: Trust isn't the soft stuff. It's the hard requirement. You can have perfect AI with zero trust = failure. You can have basic AI with high trust = transformation. AI without trust isn't transformation. It's just expensive automation that your best people will leave behind. The choice is yours: Build trust first, or rebuild your team later. What's your biggest AI trust challenge? Share below 👇 ♻️ Repost if your someone in your network needs this message (thank you!) Follow Carolyn Healey for more AI transformation insights.

#AI didn’t just change how work gets done. It changed who we trust. For decades, trust was earned through people. Credentials. Experience. Reputation. Now trust is quietly shifting to systems. If the dashboard says it’s fine, we relax. If the model recommends it, we comply. If the workflow moves forward, we assume someone checked. Medicine has lived through this transition. Clinical judgment slowly gave way to protocol. Protocol gave way to automation. And automation changed behavior long before outcomes were measured. AI accelerates that shift. The most dangerous moment is not when AI is wrong. It’s when AI becomes the default authority. Because authority without accountability feels efficient. And efficiency is seductive. Leaders need to ask a hard question. Who does my organization trust more, humans or models? If the answer is unclear, the system is already deciding for you. Best practices for preserving human authority in AI systems: Make recommendations explainable, not just accurate Force deliberate pauses before irreversible actions Design interfaces that invite questioning, not compliance Train people to challenge AI, not defer to it Tie accountability to humans, not tools AI should inform judgment, not replace it. Trust should be earned, not automated. The future belongs to organizations that understand this early. #AI #ArtificialIntelligence #AIGovernance #ResponsibleAI #Leadership #TrustInAI #HumanCenteredAI #DigitalTransformation #RiskManagement #DrGPT

🛎️ NEW RESEARCH 🛎️ AI in health is here – but public trust, organizational governance, and policy isn’t keeping pace. Last year, I published a commentary (https://lnkd.in/ezYebyEz) on how states were converging and diverging on Health AI requirements. Building on that work, I’ve been lucky to lead new research, funded by the California Health Care Foundation, delivered by NORC at the University of Chicago to 1500 patients across the US, and supported by our Policy Workgroup, and prior workshops of 150+ clinicians, patients, and vendors. Our findings reveal a stark gap between AI adoption and confidence: 💊 75% of people are using AI, yet only 13% feel very comfortable with it 💊 51% say AI makes them trust healthcare less; only 12% say it increases trust 💊 93% report at least one concern about AI in healthcare 💊 80%+ say trust would increase with clear accountability measures Some surprising themes emerged: 💻 Concerns focus less on AI itself, more on governance, accountability, and patient protection. 💻 Use, comfort, and trust are only modestly linked and highly context-dependent. 💻 Data commercialization concerns outweigh concerns about algorithmic bias. Notably 12% report never having considered AI bias at all.  💻 Patients fear ‘humans-out-the-loop’ scenarios– critical in the current Agentic AI debate 💻 Disclosure that AI is involved in care is crucial, but does not alone build trust; in some cases, it reduces trust. 💻 No single institution is seen as a trusted overseer. Instead, people favor multi-layered governance across independent non-profits, health systems, and federal regulators. As states race to regulate health AI and health systems scale adoption, this research offers a foundation for evidence-based governance grounded in real public behaviour and preferences. Huge thanks to our partners and participants for making this work possible.  We hope these findings inform industry leaders, including policymakers, deployers of health AI, those responsible for AI adoption and governance, and more. Coalition for Health AI (CHAI) is committed to gathering consensus and developing tools for patients and providers that set a gold standard for transparency. (And as ever, thank you to Ann Li who made this look so beautiful) David Blumenthal Karandeep Singh Suchi Saria Ramin Bastani Syed Mohiuddin Brian Anderson, MD Randall Rutta Grace Cordovano, PhD, BCPA Lily Liu Daniel Yang, MD Lauren Kahre, MPH Amy Zolotow

AI deployment velocity is outrunning the foundations designed to support it. Amazon’s recent pattern of incidents shows what that trade-off looks like when it lands in production. To be clear, Amazon clarified last week that recent outages on its retail site were not caused by AI-written code. Only one incident involved AI tooling - and the cause was an engineer following advice that an agent inferred from an outdated internal wiki. That clarification matters. The headline story was wrong. The operational pattern underneath it is not. ▪️An agent drew on stale institutional knowledge. ▪️It gave confident advice. ▪️An engineer followed it. A six-hour outage resulted. The outage had nothing to do with code quality. It had everything to do with whether the knowledge the agent was operating on was current, auditable, and trustworthy. This is the trade-off every enterprise is navigating right now. The question is not whether AI agents make mistakes. The question is: What is the agent drawing on when it acts, and how much should a human trust it? ▪️Agents don’t signal uncertainty the way humans do. ▪️They give confident outputs regardless of whether the underlying knowledge is six months old or six years old. ▪️The human in the loop becomes the last line of defence - but only if they know to question it. For enterprises deploying agents today: auditing the relevance of institutional knowledge those agents operate on is key. Permissions, documentation, process guides, internal wikis - accumulated over years, rarely updated, never designed to be the foundation an autonomous agent draws from at speed. The key question to answer: if the agent acts on the knowledge available to it today, would you trust the outcome?

𝐓𝐡𝐞 𝐫𝐞𝐚𝐥 𝐀𝐈 𝐥𝐞𝐚𝐩 𝐢𝐬𝐧’𝐭 𝐚𝐛𝐨𝐮𝐭 𝐦𝐚𝐜𝐡𝐢𝐧𝐞𝐬 — 𝐢𝐭’𝐬 𝐚𝐛𝐨𝐮𝐭 𝐭𝐫𝐮𝐬𝐭. This week, the headlines were loud. AI created hundreds of billions in market value. Governments doubled down on AI-led industrial revival. Investors chased the next wave of automation. And yet, in boardrooms across the world, I hear a quieter concern. “𝑾𝒆 𝒉𝒂𝒗𝒆 𝒕𝒉𝒆 𝒕𝒆𝒄𝒉𝒏𝒐𝒍𝒐𝒈𝒚. 𝑩𝒖𝒕 𝒅𝒐 𝒑𝒆𝒐𝒑𝒍𝒆 𝒕𝒓𝒖𝒔𝒕 𝒊𝒕??” Here’s the uncomfortable truth:  𝑨𝑰 𝒂𝒅𝒐𝒑𝒕𝒊𝒐𝒏 𝒉𝒂𝒔 𝒔𝒕𝒐𝒑𝒑𝒆𝒅 𝒃𝒆𝒊𝒏𝒈 𝒂 𝒕𝒆𝒄𝒉𝒏𝒐𝒍𝒐𝒈𝒚 𝒑𝒓𝒐𝒃𝒍𝒆𝒎. 𝑰𝒕’𝒔 𝒏𝒐𝒘 𝒂 𝒕𝒓𝒖𝒔𝒕 𝒑𝒓𝒐𝒃𝒍𝒆𝒎. Banks aren’t prioritizing AI for speed anymore — 𝘁𝗵𝗲𝘆’𝗿𝗲 𝘂𝘀𝗶𝗻𝗴 𝗶𝘁 𝗳𝗼𝗿 𝗳𝗿𝗮𝘂𝗱 𝗽𝗿𝗲𝘃𝗲𝗻𝘁𝗶𝗼𝗻 𝗮𝗻𝗱 𝗿𝗶𝘀𝗸 𝗰𝗼𝗻𝘁𝗮𝗶𝗻𝗺𝗲𝗻𝘁. Enterprises aren’t chasing pure automation — 𝘁𝗵𝗲𝘆’𝗿𝗲 𝗶𝗻𝘃𝗲𝘀𝘁𝗶𝗻𝗴 𝗶𝗻 𝗔𝗜 𝗮𝘀𝘀𝗶𝘀𝘁𝗶𝗻𝗴 𝗵𝘂𝗺𝗮𝗻 𝗰𝗼𝗹𝗹𝗮𝗯𝗼𝗿𝗮𝘁𝗶𝗼𝗻. Even investors are backing models that augment human judgment, not replace it. The misconception many leaders still hold is this: Build better AI, and adoption will follow. In reality, 𝒂𝒅𝒐𝒑𝒕𝒊𝒐𝒏 𝒇𝒐𝒍𝒍𝒐𝒘𝒔 𝒄𝒐𝒏𝒇𝒊𝒅𝒆𝒏𝒄𝒆 — confidence in ethics, explainability, accountability, and human oversight. The organizations that will win in 2026 won’t be the ones with the most advanced models. They’ll be the ones with the 𝗺𝗼𝘀𝘁 𝘁𝗿𝘂𝘀𝘁𝗲𝗱 𝗔𝗜 𝗲𝗰𝗼𝘀𝘆𝘀𝘁𝗲𝗺𝘀. So here’s the leadership question worth asking as we close the year: Are we investing more in AI capability… or in the trust required to use it well? Because technology scales fast.  𝙏𝙧𝙪𝙨𝙩 𝙘𝙤𝙢𝙥𝙤𝙪𝙣𝙙𝙨.