EveryAILaw.comDoes Rhode Island Oversight of Artificial Intelligence Technology in Mental Health Care Act (S 2197) require Human Oversight?
Rhode Island • enforcing
Yes — 1 provision
Requirements at a glance
This regulation imposes 7 specific requirements for Human Oversight across 1 provision:
- Permitted uses only — AI may be used only for administrative support (scheduling, billing, logistics communications without therapeutic advice) or supplementary support (records and therapy notes, progress-data analysis subject to review by a licensed professional, organizing external resources and referrals) — neither of which may involve therapeutic communication (§§ 40.1-5.5-2(1), (6), (8))
- Licensed human must deliver the service — No individual, corporation, or entity may provide, advertise, or offer therapy or psychotherapy services to the Rhode Island public, including through internet-based AI, unless the services are conducted by a licensed professional or provider (§ 40.1-5.5-3(b))
- No independent therapeutic decisions — A licensed professional or provider may not allow or use AI to make independent therapeutic decisions (§ 40.1-5.5-3(c)(1))
- No unsupervised client interaction — AI may not directly interact with clients in any form of therapeutic communication absent an established treatment relationship and patient consent under this section (§ 40.1-5.5-3(c)(2))
- No AI-set treatment plans — AI may not determine therapeutic recommendations or treatment plans (§ 40.1-5.5-3(c)(3))
- Retained clinical responsibility — The provider retains responsibility for clinical judgement and reasonable therapeutic oversight of the patient's use of the system, but not for vendor-controlled system design, algorithms, or outputs (§§ 40.1-5.5-2(6), 40.1-5.5-3(c)(2))
- Duty on client-initiated AI use — Where a client discloses self-initiated use of AI-featured software, the licensed professional may discuss and guide that use and is responsible for maintaining confidentiality, monitoring client safety, intervening when necessary, and discussing the software's limitations and risks with the patient (§ 40.1-5.5-3(d))
Licensed Professional Responsibility for AI in Therapy #
The duty falls on private-sector actors, not only on licensees: § 40.1-5.5-3(b) reaches any "individual, corporation, or entity" that offers therapy to the Rhode Island public "including through the use of internet-based artificial intelligence", so an out-of-state AI therapy product marketed into Rhode Island is directly in scope, and the vendors selling clinical-adjacent AI into private practices are constrained by what their customers may lawfully deploy. That is what makes this an AI-deployment rule rather than a professional-licensing rule. The liability allocation is the sharpest edge: the provider retains clinical judgement and therapeutic oversight "but not for vendor-controlled system design, algorithms, or outputs" (§§ 40.1-5.5-2(6), 40.1-5.5-3(c)(2)) — the statute carves the provider's responsibility around the vendor's black box without saying who carries the residue.
Requirements
| Requirement | Details |
|---|---|
| Permitted uses only | AI may be used only for administrative support (scheduling, billing, logistics communications without therapeutic advice) or supplementary support (records and therapy notes, progress-data analysis subject to review by a licensed professional, organizing external resources and referrals) — neither of which may involve therapeutic communication (§§ 40.1-5.5-2(1), (6), (8)) |
| Licensed human must deliver the service | No individual, corporation, or entity may provide, advertise, or offer therapy or psychotherapy services to the Rhode Island public, including through internet-based AI, unless the services are conducted by a licensed professional or provider (§ 40.1-5.5-3(b)) |
| No independent therapeutic decisions | A licensed professional or provider may not allow or use AI to make independent therapeutic decisions (§ 40.1-5.5-3(c)(1)) |
| No unsupervised client interaction | AI may not directly interact with clients in any form of therapeutic communication absent an established treatment relationship and patient consent under this section (§ 40.1-5.5-3(c)(2)) |
| No AI-set treatment plans | AI may not determine therapeutic recommendations or treatment plans (§ 40.1-5.5-3(c)(3)) |
| Retained clinical responsibility | The provider retains responsibility for clinical judgement and reasonable therapeutic oversight of the patient's use of the system, but not for vendor-controlled system design, algorithms, or outputs (§§ 40.1-5.5-2(6), 40.1-5.5-3(c)(2)) |
| Duty on client-initiated AI use | Where a client discloses self-initiated use of AI-featured software, the licensed professional may discuss and guide that use and is responsible for maintaining confidentiality, monitoring client safety, intervening when necessary, and discussing the software's limitations and risks with the patient (§ 40.1-5.5-3(d)) |
Penalties
| Violation | Fine |
|---|---|
| Investigation | The Executive Office of Health and Human Services has authority to investigate any actual, alleged, or suspected violation of the chapter (§ 40.1-5.5-5(b)) |
| Confidentiality violations | Penalties under R.I. Gen. Laws § 5-37.3-9 apply to violations of the chapter's confidentiality provisions (§ 40.1-5.5-5(a)) |
| Other violations | The chapter specifies no fine schedule for non-confidentiality violations; enforcement runs through EOHHS investigation and existing licensure and consumer-protection channels |