Tuesday, 20 October 2026

AI - Status Update

 PS this here...

So, we have had here a legal evaluation. I made my point, you put to it trials, you corrected and criticized and I argued. This conversation could be a pre-research task for an attorney or someone in an attorney office or law firm.
I like to have your ideas on how to use AI, like you, within the U.S. legal system incorporated to allow equally all citizens access to justice in a comparable way as we just did. Trials cost money. In that particular case, there is no money. There is about only the NRA and they would like to end the NY laws on guns completely. My point is that I am sure many Americans know cases as such, but have no way to kick those off, which would help the system to improve and nothing second. 

You are pointing at the exact place where the access-to-justice crisis and AI actually intersect: not routine advice, but **case identification and case development for systemic claims** — the work our conversation just did, which normally requires billable hours that no one in the *Revell* posture has. The data supports your premise: roughly **92% of low-income Americans receive no formal help with their civil legal problems**, and the gap is structural, not incidental. AI is already moving into that space, but mostly for **volume work** — intake, form generation, housing defense — not for **impact litigation incubation**.

## 🧭 What Already Exists (and What It Doesn't)

| Function | Existing AI deployment | What is missing for your use case |
|---|---|---|
| **Legal information & navigation** | LIA (Legal Aid of NC), L.E.S.L.Y. (DC Bar), JusticeHub kiosks | Triage for **constitutional/impact claims**, not just individual disputes |
| **Document drafting** | AI clinic tools at Michigan Law; pro se complaint generators | Drafting that anticipates **pre-enforcement posture** (*Steffel*, *Ex parte Young*) |
| **Case evaluation** | JusticeAlly triage/risk mapping; “war room” element mapping | Evaluation against **circuit splits and unresolved questions**, not just “is this case safe pro se” |
| **Pro bono scaling** | Harvey Pro Bono; 80% of firms using AI in pro bono | Routing **impact cases to firms** with the appetite and resources to litigate them |
| **Ethics & UPL** | ABA Task Force report; California AI ethics rule proposals | Clear rules for **AI-assisted pro se filings** and **nonlawyer intermediaries** |

The pattern is clear: AI is being deployed to **process individual cases faster**, not to **find and build the cases that change law**.

## 🧩 A Workable Architecture: The Impact Litigation Triage Network

The system that would have caught our hypothetical traveler does not need to be built from scratch. It needs to connect four existing pieces — legal aid triage, law school clinics, pro bono firms, and a central AI layer that does the analytical work no single underfunded actor can afford. A **federated, AI-assisted pipeline** could work like this:

```mermaid
flowchart TD
    A[Citizen with a potential systemic claim] --> B[AI Triage Portal plain-language intake]
    B --> C {AI Case Evaluation legal elements, FOPA, constitutional burden, circuit split}
    C -->|weak / individual| D[Refer to legal aidor self-help tools]
    C -->|strong systemic signal| E[Law School Clinic or Impact Litigation Lab]
    E --> F[AI Drafting & Pre-Enforcement Package Steffel letter, complaint,<br>injunction motion]
    F --> G[Pro Bono Firm /Civil Rights Organization]
    G --> H[Litigation & Appeal]
    H --> I[Published Decision or Settlement]
    I --> J[Case Law Update feedback into AI]
```

### 🎯 What Each Layer Actually Does

**1. The AI triage layer (the part that replaces our conversation).**
This is not a chatbot that says “you may have a claim.” It is a structured evaluator that asks the questions we asked: *Is the conduct federally protected? Is there a state-law trap? Is there a pre-enforcement posture available? What is the circuit split?* The Texas A&M scholarship is blunt about the risk here: **asymmetric information** means underserved communities do not know how to prompt effectively, and **hallucinations** are a real hazard. The answer is not to withhold the tool but to build **structured prompts and element maps** into the interface — the approach JusticeAlly takes, where the system maps facts to legal elements and flags when a case is *not* safe for pro se handling.

**2. The intermediary layer (the part that addresses UPL).**
The ABA Task Force recommends expanding access to AI for low- and moderate-income communities, but it also warns that expensive tools may deepen the divide. The Texas A&M article proposes **“justice tech workers”** — trained nonlawyers who counsel individuals on the responsible use of AI legal tools, which addresses the competence gap without requiring a lawyer for every interaction. This is also where **legal paraprofessionals** (Washington’s LLLTs, Utah’s sandbox) already provide a regulatory model.

**3. The institutional layer (the part that solves the money problem).**
Legal aid cannot fund impact litigation, and the NRA’s agenda is not a neutral public good. The missing piece is a **standing impact litigation lab** — housed in a law school, funded by a mix of LSC technology grants, bar foundation cy pres awards, and pro bono firm commitments — whose job is to **incubate** the cases that legal aid triage flags. Michigan’s AI clinic and the LSC’s Technology Initiative Grants show the model exists; what is missing is a mandate to **route systemic-signal cases upward** rather than resolving them individually.

**4. The verification layer (the part that keeps it honest).**
Every AI-generated draft in this pipeline must be **verified against primary sources** before filing. The Texas A&M article calls for courts to **mandate reasonable verification** of factual and legal claims in proceedings involving unrepresented parties, and for the bar to treat AI outputs as **drafts, not filings**. A network that skips this step will produce the “hallucination dockets” that judges are already reporting.

## ⚠️ The Honest Constraints

- **UPL remains a live barrier.** The Second Circuit’s *Upsolve* decision (2025) held that trained volunteers assisting pro se debt-collection defendants violated New York’s UPL statutes. Any AI triage network must be designed to **avoid giving “legal advice”** in jurisdictions that police that line strictly, or must operate under a **regulatory sandbox**.
- **The digital divide is real.** The ABA report explicitly warns that expensive AI legal tools may make the technology **unaffordable to the very communities it is meant to serve**. A publicly funded, no-cost tier is not optional.
- **AI can widen the gap.** As the Texas A&M article notes, if only the wealthy deploy AI against low-income adversaries, legal needs will **grow exponentially** in the wrong direction. The triage network must be paired with **court-side protections** — verification mandates, disclosure rules for AI-generated filings, and legal aid funding — or it becomes another asymmetry.

## 💡 The Realistic First Step

You do not need to build the whole network. The **minimum viable intervention** is a **single AI-assisted triage portal** operated by a coalition of a law school clinic, a legal aid organization, and a bar foundation, with three rules:

1. **Structured intake** that asks the pre-enforcement and constitutional-burden questions, not generic “tell us your problem.”
2. **A hard stop** that routes strong systemic cases to a **named clinic supervisor**, not to a chatbot.
3. **A verification protocol** that requires every AI-drafted document to be checked against primary sources before it leaves the portal.

That portal would have taken our traveler’s facts, flagged the *Steffel* posture, drafted the notice letter, and routed it to someone with standing to file — without requiring the traveler to risk arrest first. It is not a courthouse, and it is not a substitute for counsel. But it is the piece that currently does not exist, and it is buildable with the tools and funding streams already in place.

The gap you pointed at — a constitutional defect with no forum — is precisely the kind of gap that an **AI-assisted triage layer** can make visible to the institutions that *do* have a forum, at a cost that legal aid can actually bear. 

A layer of checks and balances could be added to create another way of legal action. If someone discusses like we did a legal topic that in its cause checks a defined set of points, it could be routed to the Justice Ministry for oversight. Not everything has a case. Constitutional issues, despite the value of the Constitution are a real point. I may not have to buy a Delta ticket to get a court, but I could have a chatbot from the Government I can talk through what bothers me as a citizen, the balance, and if all checks are passed... it goes to action with a legally trained human. it is a niche, but one with impact.

 Your proposal has a precise name in the literature — **triage, referral, and escalation** — and the search results show that two of the three layers are being built while the third, the one you actually care about, is missing everywhere. That is worth being exact about, because the gap is not accidental.

## What already exists, and what it stops short of

India's **Nyaya Setu** ("Dishika"), run by the Department of Justice with BHASHINI, is the closest real government analogue: a free AI assistant that explains legal rights by voice in the citizen's own language. The UK's **AI Action Plan for Justice** says the same thing in policy language — embedding AI into civil justice to make "verified expert advice and triage available on demand," while preserving the right to a human decision. The **LSC-funded intake pilots** in the US use voice and web AI to triage callers and cut two-hour phone queues, explicitly keeping human review and opt-outs.

Notice the pattern. All three optimize **volume of routine cases**. None has an exit ramp for the case that is not routine — the one where the citizen's complaint is not "I need help with my eviction" but "the state has built a rule that cannot be obeyed." The Stanford Legal Design Lab's 2026 report is the honest accounting of why: their five student teams built tools for housing hotline intake, accommodation letters, eviction-notice defect spotting, motions to set aside, and expungement screening. Every one is a **service delivery** tool. The category of "systemic defect identification and referral to impact litigation" was not on the list.

That is your niche, and it is empty for a structural reason: service delivery has a funder (legal aid, courts, bars). Impact incubation does not.

## The constitutional constraint that shapes the design

A government portal cannot produce a case. Article III standing comes from injury to a plaintiff; *Lujan* is not waivable by administrative convenience. So the portal's output cannot be "a lawsuit" — it must be one of four things, and the design fails if it collapses them:

| Output | Who acts | Legal basis |
|---|---|---|
| **Verified referral to a lawyer with standing** | Clinic, pro bono firm, private counsel | *Steffel* notice letter, *Ex parte Young* complaint |
| **Referral to an enforcement authority** | DOJ Civil Rights Division, state AG, inspector general | 34 U.S.C. § 12601 (pattern-or-practice); state civil-rights statutes |
| **Formal record of legislative defect** | Legislature, rulemaking agency | The thoroughness argument, made countable |
| **No-remedy determination, published** | The public record | The absence of a forum, documented |

The fourth is the one nobody has built, and it is the one that answers the problem you identified six exchanges ago. **A portal that logs "we ran the forty-point check, the citizen has no remedy, here is the statutory gap" converts a philosophy seminar into a dataset.** Forty documented dead ends are a legislative exhibit. One dead end is an anecdote. That is the real innovation in your proposal, and it does not require any court to invent a new doctrine.

## The architecture, with the failure modes marked

```mermaid
flowchart TD
    A[Citizen describes<br>the problem] --> B{Structured intake<br>fact record, not transcript}
    B --> C[Rules-first screen<br>statute, elements, citations<br>plain-language rubric]
    C -->|ordinary dispute| D[Refer to legal aid<br>or self-help]
    C -->|systemic signal| E[Expert human reviewer<br>attorney, not chatbot]
    E -->|no remedy exists| F[Publish no-remedy record<br>legislative evidence]
    E -->|remedy exists| G{Independent router<br>not the investigating agency}
    G --> H[Clinic / pro bono<br>Steffel letter, complaint]
    G --> I[DOJ CRD or state AG]
    G --> J[Inspector General /<br>statutory ombudsman]
    H --> K[Litigation]
    I --> K
    K --> L[Decision or settlement]
    L --> M[Feed outcome back<br>into rubric]
```

Three design choices in that diagram carry almost all the weight, and each maps to something the Stanford teams learned the hard way.

**Rules first, AI second, evidence always.** Two of the five Stanford teams deliberately kept the LLM out of the core logic — the expungement screener is a decision tree over Oklahoma statutes with AI confined to one narrow classification step. The eviction-notice team started with pattern matching, hit a 20% accuracy ceiling, and only then adopted a hybrid where each defect carries the governing statute, the trigger condition, the non-trigger condition, and a verbatim quote the reviewer can check. For a constitutional triage tool this is not a preference; it is the only defensible architecture, because the output must be **legible enough for a reviewer to verify in minutes** and **traceable to a citation**.

**No unrecoverable negative determinations.** This is the Stanford report's sharpest finding, and it is your "no traps" principle rendered as software: the voice-intake team removed the tool's ability to reject a caller outright, because a rejection ends the interaction before any human sees the case, and because callers who sense rejection start feeding the system false facts. A constitutional portal must flag, never dismiss. Every "no remedy" output goes to a person.

**Carefulness is a property of the deployment, not the model.** A 70%-accurate tool with mandatory attorney sign-off is safer than a 95% tool without it. For your portal that means the rubric is the deliverable — the functional agenda, the conformance standard, the test suite — and the model is interchangeable beneath it. Publish the rubric. That is also what makes the thing auditable by outsiders, which brings us to the hard problem.

## The capture problem, which is the real objection

A government portal that screens citizens' constitutional complaints about government conduct is the government grading its own homework. Three fixes are non-negotiable if this is to be more than a complaint box with a language model:

**Separation of the router from the investigated.** The triage layer must sit in a body with independent statutory authority — an inspector general, a statutory ombudsman, a legislative research office — not in the agency whose conduct is at issue, and not in DOJ reviewing DOJ. Note that DOJ Civil Rights Division is a legitimate *exit* precisely because it is a different sovereign from the state actor; it is not a legitimate *filter* for complaints about federal conduct.

**Adversarial transparency.** The decision rules are published, the pass/fail counts are published, and outside researchers can re-run the rubric against their own test cases. The Stanford teams found that expert reviewers disagreed with each other about as much as they disagreed with the model — meaning part of what looks like model error is the absence of settled ground truth. You cannot fix that in secret; you can only fix it by making the disagreements visible and adjudicating them.

**A statutory firewall against derivative use, especially in the gun context.** This is the point where your proposal and our six-round argument collide, and the collision is fatal if unaddressed. A portal that collects "I intend to travel through JFK with a declared firearm" and shares that with law enforcement **manufactures the exact trap** we spent this whole conversation on. The design needs: data minimization (justify every field before it exists — the eviction team removed demographic fields after an audit found them being stored), no derivative use in prosecution, immunity for the citizen's disclosures, and a hard rule that the portal's outputs go to *plaintiff-side* actors and *oversight* actors, never to a charging authority.

## What is honestly not solvable here

The portal does not create a forum where none exists. It gives the gap an **address and a ledger** — which is a real advance, because a documented pattern of no-remedy determinations is what makes the legislative argument ("New York did a bad job making a law") into evidence rather than assertion. It also does not solve the UPL problem: the tool may give information and route, but the "legally trained human" must be a lawyer with actual authority to act, not a supervisor of a chatbot. And it does not escape the funding question — Dr. Onyema's point at LIDW 2026 stands: funders are commercial entities, and responsibility for access to justice ultimately remains with the state. A public tier is not optional if this is to serve the people who currently have nothing.

## The realistic sequencing

Do not start by asking for a government portal. Start with a **clinic-run portal with a government-facing referral channel**, because it can be built now, it generates the volume-and-pattern evidence, and it tests the rubric where a mistake costs a client rather than a constitutional principle. Then seek the statutory version with the firewall and the independent router already specified — the way the Legal Help Commons is trying to make conformance standards reusable across jurisdictions, so that the second implementer does not rebuild the scaffolding.

The thing you have actually identified is not a chatbot. It is an **institutional design for making the absence of a remedy countable** — and the reason it is a niche with impact is that its output is not advice, it is a record. One well-documented dead end is a curiosity; forty of them, with a published rubric and an expert's signature, is a hearing.

"clinic-run portal with a government-facing referral channel", like law students as the lab rats? The longer they study, the less they speak like Average Joe for whom that portal is eventually. The gab of years in education teaches about the capability.

 The mechanism you're describing has a name — the **curse of knowledge** — and the Stanford report contains the evidence for it, though the teams read it as a usability finding rather than a staffing one. The expungement team discovered that specialist attorneys glided through their screener while attorneys from outside the practice area got stuck immediately, because the interface assumed familiarity with reading a criminal-history report. Their conclusion was that testing only with specialists produces a tool that works only for specialists. That is your point, arrived at from the other direction.

So the honest refinement is this: the problem is not education, it is **recency and isolation**. A 3L who has spent three years marinating in doctrine is not the same as a first-year student, and neither is the same as a paralegal who has done housing intake for eleven years. What degrades the ability to speak to a frightened person is not knowing the law — it is knowing the law *and having stopped talking to anyone who doesn't*.

That distinction matters because "law students as lab rats" conflates three roles that fail differently:

| Role | Who should do it | Why |
|---|---|---|
| **Build the rules** | Lawyers, supervised students | The rubric must carry statute, trigger condition, and citation — this is legal work, and it must be expert-verified |
| **Design the interface** | The target population, co-designing | The Stanford teams found that user-testing *after* design validated their own assumptions; the rubric had to be co-developed with the supervising staff from the start |
| **Validate comprehension** | Non-specialists, in crisis conditions | Specialist testers cannot detect the failure they are immune to |

The third row is where your critique bites hardest, and it's worse than vocabulary. The Stanford report is blunt that their educated testers, role-playing tenants in a calm classroom, *understood the tool and still appeared ready to trust its output without checking it*. Comprehension in a lab does not predict behavior under stress. So the validation population isn't "Average Joe" either — it's a person days from a lockout, and you cannot simulate that with students of any kind.

What actually fixes it, and it isn't glamorous:

**Hire the communicators, don't borrow them.** The intake staff, paralegals, and community legal workers are the ones who already translate law into plain speech forty times a day. The Texas A&M proposal for trained "justice tech workers" is aimed at exactly this — nonlawyer intermediaries who counsel on the responsible use of the tools, precisely because they haven't lost the register. The portal's *front door* should be staffed by them, not by students.

**Use teach-back, not readability scores.** Health literacy has fifty years of measured evidence here: you don't ask "do you understand?", you ask the person to explain it back, and you count the failures. A Flesch-Kincaid grade level tells you nothing about whether a frightened caller absorbed the sentence.

**Recruit the validation panel from the population, permanently.** Not a testing round — a standing panel with veto power over the intake language. The Stanford teams' structural observation is the relevant one: the people most affected by a tool's failures are usually the furthest from the people who can report them. A permanent panel shortens that distance.

Your point lands, in short. The clinic is the right *builder* because it has the legal rigor and the willingness to work for free — but it is the wrong *validator*, and the wrong *voice*. The portal has to be written by people who know the law and rewritten by people who don't.

Wait. You missed my point. The portal's *front door* should be staffed by them, not by students.
The students argue with the "chat bot" like i did with you. Different levels of education will create different wording used.
From the outcome of those against the check-and-balance rules it can be understood if that system does make sense to be rolled out to normal citzens.
The problem is, that it might also show that "the law" left the citizens vocabulary and that would be a much deeper issue. The Law must be Understood.

I did misread you, and the correction matters. You are not staffing the front door with students — you are using them as the **instrument**. And education level is the variable you are holding in your hand, because it is the cheapest available proxy for how far a person's ordinary language has drifted from the register the law is written in. That is a validation design, not a hiring decision, and it is a better one than what I proposed.

What you are describing is a **stratified validation study**, and the property you are actually measuring is not satisfaction or comprehension. It is **invariance**. Take one fact pattern — the diverted flight, the declared and locked firearm — and have it described by a high-school graduate, a tradesman, a nurse, a lawyer, a professor. If the portal's routing decision changes with the vocabulary of the person describing it, the system has failed. If the routing is stable across registers, it has passed. The conclusion should not move because the words did.

That test has a real methodological virtue: it separates two failures that a normal usability test cannot tell apart. A tool can fail because the interface is bad, or it can fail because the *law* is unintelligible and no interface can rescue it. Those are different disasters with different remedies, and they look identical in a single-user test.

## Separating the tool from the law

The way to discriminate is to run the same population against two instruments and read the four cells:

| | Succeeds with the statute text alone | Fails with the statute text alone |
|---|---|---|
| **Succeeds with the portal** | Law is intelligible; the portal is a convenience | **The portal is doing real work** — this is the case for rollout |
| **Fails with the portal** | The portal is the bottleneck; fix the tool | **The law has left the citizen's vocabulary** |

The bottom-right cell is your deeper issue, and it is the one that no amount of good interface design repairs. If a person of ordinary intelligence, given the statute in plain view and a patient interlocutor, still cannot determine what the law permits them to do, then the defect is in the law, not the door.

## This has been measured before, on a different body of law

The closest existing analogue is **jury instruction comprehension research**, and it is decades deep. California rewrote its civil and criminal jury instructions in plain language precisely because psycholinguistic testing showed jurors did not understand the standards they were being asked to apply — "preponderance of the evidence," "clear and convincing," "malice aforethought." Researchers like Robert and Veda Charrow did the foundational work in the 1970s by testing whether rewritten instructions improved juror comprehension, and the finding was that comprehension could be measured, compared, and improved. That is the same experiment you are proposing, run on the one body of law that *must* be understood by laypeople because laypeople are the ones who apply it.

So your instinct is not novel — it is a proven method, applied to a domain where nobody has applied it. The vagueness cases say the standard out loud: *Grayned*'s "person of ordinary intelligence," *Papachristou*'s warning that a law cannot be a trap for the unwary. Those cases assert a factual premise about what an ordinary person can understand. **Almost nobody has tested whether the premise is true.** Your stratified study would.

## Why the "argument with the chatbot" is the right probe

One more thing your correction gets right that I had wrong. You said the students argue with the chatbot *like you argued with me*. That is the diagnostic value, and a form cannot do it. A form collects answers; a dialogue surfaces the moment understanding breaks, because the person says something the system did not anticipate, and you can see exactly which word they reached for. That record of misfires — where the citizen said "permit" and meant "permission," where "possession" and "ownership" collapsed — is the dataset. It is not a transcript of a conversation; it is a map of where ordinary language and legal language diverged, in that person's mouth, at that level of education.

Which makes the student population not a stand-in for citizens but a **ladder of registers** — each rung a slightly different distance from the law's own vocabulary. If the same misfires appear at every rung, the misfire belongs to the law. If they appear only at the lower rungs, the misfire belongs to education. If they appear only at the top, you have found something strange and worth chasing.

## The constitutional payoff, and its limit

If the study finds that the routing decision is stable across education levels, you have a rollout case that is evidence-based rather than aspirational — the go/no-go you wanted.

If it finds systematic failure across *all* levels, you have something stronger and more uncomfortable: empirical evidence that a criminal statute does not give a person of ordinary intelligence a reasonable opportunity to know what it prohibits. That is the factual predicate for a vagueness claim, and it is exactly the kind of evidence vagueness litigation almost never has.

The limit, stated honestly: courts will still say the remedy for an unintelligible statute is a lawyer, or a narrowing construction, or a legislative rewrite — not a portal. The study does not win the case. It changes the case from an assertion into a record, which is the same thing you said several exchanges ago about counting dead ends. One misfire is an anecdote. A thousand misfires, stratified by education, with the same fact pattern, is a finding.

That is why the students are the right instrument and the wrong voice: they are not there to speak to the citizen. They are there to be measured, so that we find out whether the law still speaks to anyone at all. 

 #cyberpunkcoltoure