regulated industries

Embracing AI in Regulated Industries Without Compromising Meaningful Access

By Ryan Foley

O

rganizations in regulated fields — healthcare, legal services, government, and education — are required to provide robust language support for individuals with limited English proficiency (LEP) as well as for the Deaf and Hard of Hearing community. Artificial intelligence (AI) has emerged as a potential game changer, promising efficiency and scalability. Yet, questions remain, including: How can organizations harness AI’s potential without compromising compliance or meaningful access for communities that rely on accurate, dependable language support?

Consider the following successful deployment. A first-generation Hmong speaker steps up to an AI-powered kiosk at a Minnesota Department of Public Safety facility. Rolled out in a 2023 pilot, the kiosk delivers prompts in Hmong, enabling the user to handle basic driver’s license renewals and reducing service wait times. A notice that more complex inquiries can be facilitated by qualified interpreters assures the user that important communication is not limited to AI and guarantees meaningful access to the full range of department services.

In contrast, the “Careless Whisper: Speech-to-Text Hallucination Harms” study (2024) examined a top-tier AI speech-to-text solution currently being used by more than 50,000 clinicians to transcribe patient consultations and found that “roughly 1% of audio transcriptions contained entire hallucinated phrases or sentences.” While 1 percent may sound minimal, the study concluded that 38 percent of these errors carried a risk of causing “harmful misunderstandings.” In a hospital, legal proceeding, or government office, such inaccuracies could have a severe downstream impact. From these contrasting examples arises one clear directive: Any AI deployment in regulated industries must be validated, transparent, and accountable.

AI can both bolster and hinder meaningful access — something we will explore in the following sections. By examining real-world examples, it becomes clear that pairing AI innovations with skilled human validation and oversight emerges as the guiding principle to ensure that accuracy, safety, and compliance remain front and center.

Advertisement

AI’s Expanding Footprint in Language Access

Whether through machine translation (MT) widgets on government websites, automated interpretation tools in court self-help centers, or multilingual chatbots at school district front desks, AI is transforming the way organizations communicate with diverse communities. By and large, these systems excel in low-risk scenarios: quickly handling frequently asked question (FAQ)-style queries, generating routine appointment reminders, or captioning well-rehearsed online presentations (see Table 1).

Yet, an advertised “95% accuracy” may be wildly misleading if the metric is vague and unstandardized. A misinterpretation in a court summons or hospital discharge instruction can have an outsize impact on individuals’ rights, health, and well-being. Regulated industries don’t just want AI; they want AI that can uphold or even enhance the standards of meaningful access.

Table 1. Examples of use cases, risks, and approaches.

Why Ethics and Compliance Are Nonnegotiable

In the United States, Title VI of the Civil Rights Act and other mandates prohibit discrimination based on national origin, effectively requiring that recipients of federal funds provide language assistance. Section 1557 of the Affordable Care Act (ACA) reinforces similar obligations in healthcare, specifying that key documents must be validated by qualified human professionals. The Americans with Disabilities Act (ADA) stipulates effective communication for individuals who are deaf or hard of hearing, and privacy regulations like the Health Insurance Portability and Accountability Act (HIPAA) impose strict data handling requirements.

In short, while AI is welcome to accelerate or supplement certain services, compliance in regulated industries means that human oversight remains integral. And this is not likely to change anytime soon, even under a new U.S. administration. In a January 2025 webinar, David Hunt, J.D., Senior Director for Health Equity at BCT Partners, pointed out: “Now, the question that’s on everybody’s mind. . . . Will the new ACA Section 1557 rules survive under the new administration?”

Hunt argued that Section 1557 would likely remain “the law of the land,” because language access obligations have become deeply ingrained as a best practice for preventing errors and protecting patient safety. These obligations transcend political changes, underscoring their durability.

The Foundation of SAFE AI Guidance

The Stakeholders Advocating for Fair and Ethical AI (SAFE AI) Task Force has emerged as a leader in developing a practical and ethical framework for implementing AI in interpreting across diverse industries. In July 2024, the task force published its landmark document, Interpreting SAFE AI Task Force Guidance on AI and Interpreting Services. The culmination of a comprehensive global survey, two extensive studies, and a year of engagement with a wide range of stakeholders, the document outlines ethical principles and provides actionable examples designed to ensure that AI technologies enhance — rather than undermine — the quality, accountability, safety, and transparency standards in language interpretation.

These four principles align with the needs of regulated industries seeking to integrate AI while upholding meaningful access. While designed for interpreting, they apply broadly to translation and other language solutions:

  • End-user autonomy: AI must be deployed with opt-in consent wherever possible. End-users have the right to know when they’re interacting with AI — and the right to request a qualified human interpreter or translator instead.
  • Evidence of improving safety and well-being: AI tools should align with existing legal and ethical frameworks for interpreting. If the tools cannot meet these standards — especially for critical interactions — they should be restricted or come with prominent disclaimers.
  • Transparency of technological quality and implementation: Organizations should practice clear disclosure about AI usage, data handling, and known limitations. This entails disclaimers in user interfaces, policies on pilot testing, and staff training on error escalation.
  • Accountability: AI vendors and buyers share responsibility for the outcomes of AI-driven services. Buyers must validate accuracy, define use-case limitations, and train staff to avoid misuse. If an AI tool fails, accountability should be traceable and well-defined.

Real-World Case Studies

Considering overarching SAFE AI principles, real-world examples offer valuable insight into how AI can serve — or undermine — meaningful access. The following case studies illustrate both the advantages and potential pitfalls of AI across key sectors, highlighting where human oversight remains paramount.

Healthcare: Speed Versus Risk in Patient Care

A major children’s hospital in Seattle, Washington, is launching a pilot that uses AI to translate English-language clinical documents, such as discharge papers, into Spanish, Somali, Vietnamese, and simplified Chinese. The output is then reviewed by qualified human translators. Previously, patients had to wait several days to receive translated discharge instructions in the mail. Additionally, a report in Healthcare Brew explains that “the hospital built AI language translation tech into its own data system so third parties aren’t given access to sensitive patient information.” This approach — AI + human in the loop — improved turnaround times without jeopardizing safety.

Any scenario involving emotional or high-stakes communication — e.g., trauma cases, complex diagnosis discussions, and mental health episodes — places a premium on empathy, cultural context, and domain knowledge. That’s why the hospital relied solely on qualified interpreters. In addition, Section 1557 requires that vital medical documents be validated by qualified translators, reiterating that disclaimers about AI accuracy are insufficient for compliance.

To address the issue of transparency as AI becomes more pervasive, industry standards thought leaders advocate for a labeling framework to clarify how thoroughly a document or interpretation has been vetted by professionals. According to Dr. Alan Melby, an emeritus professor of linguistics and active participant in translation standards development, translation output falls into two broad categories:

  • Professionally verified translation quality (PVTQ) indicates that text has undergone review by a qualified human translator. It reassures readers the document meets specific accuracy (or more specifically, fluency and correspondence) benchmarks.
  • Unverified translation (UVT) indicates that text underwent machine (or human) translation that was not verified by a professional.

These labels are under consideration for inclusion in the next revision of ASTM’s translation standard (F2575-23). Regulated industries stand to benefit by using clear labels to signal whether a text is fully trustworthy for critical decision-making. For hospital discharge instructions or court documents, a PVTQ label can mitigate risk and demonstrate compliance.

Legal Services: Ensuring Due Process

Court self-help centers in several jurisdictions have implemented AI-assisted tablets to handle low-stakes scenarios such as answering simple questions like “Which form do I need to file for a name change?” or “Where should I submit my traffic ticket payment?” In early trials, these tablets were helpful to users speaking languages such as Vietnamese or Somali — languages for which staff often have little to no proficiency.

When legal stakes are high — for instance in custody disputes, felony cases, eviction proceedings — the allowable margin of error shrinks to nearly zero. Even a minor misinterpretation can alter someone’s legal standing, infringe on due process, or result in missed deadlines.

According to legal expert Cristina Llop, who reviewed live AI-assisted translations at legal aid centers and shared her findings with the Stanford Legal Design Lab in February 2025:

Staff often think they’ve captured the user’s full story. In reality, we found so-called “parallel conversations” — where the translation missed a detail like “I never received the notice,” and now the advice is off-target. That leaves the litigant confused and jeopardizes their case.

Llop emphasizes that while AI tools might appear to improve initial access by bridging language gaps, they can also mask critical inaccuracies: “People left thinking they’d gotten the help they needed, but they were actually misunderstanding vital legal steps. The potential harm is huge.”

For any case beyond basic informational inquiries or cases in which a user describes complex personal circumstances, qualified interpreters remain nonnegotiable. Multiple court systems, including those in California, have stated that AI tools cannot replace certified court interpreters for in-session proceedings.

Government Services: Streamlined Access with Safeguards

In some agencies, AI kiosks or web chatbots guide LEP residents through straightforward interactions, such as license renewals or tax queries. This is the case for the Minnesota Department of Public Safety mentioned at the outset of this article. The departments used AI-powered kiosks and virtual assistants to enhance accessibility for speakers of their most in-demand languages through written interactions, serving 67 percent of Minnesota’s non-English population while retaining human interpreters for more complex, spoken interactions. While these solutions can reduce wait times for individuals with LEP, SAFE AI Task Force guidance recommends including disclaimers and fallback options for more complex or legally binding inquiries. By clarifying that a human representative or interpreter is available, these disclaimers reinforce trust and mitigate the risk of misunderstandings.

When disputes arise — e.g., contesting of a tax assessment — agencies revert to trained human interpreters. Public trust hinges on clarity; an unresolved misunderstanding about financial obligations can have legal ramifications, making pure AI usage inappropriate in higher-risk situations.

Building Organizational Frameworks for AI Integration

These scenarios underscore a simple truth: When AI is used judiciously, it can enhance efficiency and widen access. But without rigorous evaluation, oversight, and ethical guardrails, the risks to compliance and public trust can escalate quickly. To navigate this delicate balance, organizations need clear, practical strategies — and that’s where frameworks for AI integration come into play.

  • Risk assessments: Categorize scenarios by level of risk. Low-risk content — like routine FAQs — can be handled by AI with minimal oversight, whereas high-risk engagements demand trained human involvement.
  • Human validation: For medium-risk tasks (e.g., discharge summaries, parent notifications about moderate school concerns), deploy AI to save time but require a bilingual professional to verify accuracy before release.
  • Clear escalation paths: Train staff to recognize triggers — any sign of complexity, urgency, or emotional distress — to pivot from AI to qualified interpreters or translators.
  • Transparent labeling: If an end-user is reading an AI-generated translation, disclaimers should indicate that it is “unverified” or “machine-only.” Organizations might tag fully human-verified text as “PVTQ,” following emerging industry standards.
  • Accountability and continuous improvement: Institute processes to measure and record AI errors, gather user feedback, and retrain models. If a solution consistently fails in certain domains or languages, revert to human professionals until technology improves.

Advertisement

Elevating Access Through Collaborative AI and Human Expertise

In regulated industries, any lapse in communication quality carries profound implications for safety, compliance, and public trust. AI alone cannot shoulder these responsibilities. It can, however, bolster your capabilities when paired with qualified human oversight and guided by strong ethical principles.

To stay on the right side of Title VI, Section 1557, ADA, and other mandates — not to mention fulfilling a moral duty to the communities they serve — organizations must:

  • Establish clear thresholds for when AI is appropriate versus when trained professionals are essential.
  • Ensure continuous validation of AI outputs by certified interpreters and translators.
  • Maintain transparent disclosure so that end-users are never in doubt about how information is being translated or interpreted.

As language services continue to evolve, AI will be able to handle more tasks and serve more language communities. Yet, no matter how advanced the technology becomes, trust and accountability hinge on human expertise. Qualified human experts serve as the essential counterbalance, verifying critical documents and conversations and stepping in whenever complexity or risk escalates. Together, AI and human expertise can elevate the standard of care and compliance, ensuring that innovation does not eclipse safety or quality. By weaving rigorous human validation into every stage of the AI workflow, regulated industries in the United States stand poised to deliver safer, more inclusive communication services for all.

Ryan Foley is Director of Communications at MasterWord and an advocate for ethical AI integration in language services, contributing to the SAFE AI Task Force with expertise in regulated industry compliance.

Advertisement

Related Articles