3D Studio and clinical HUD

Executive summary

The 3D Studio is a patient-bound planning space — restorative, implant, bridge and arch views — rendered with three.js; the clinical HUD surfaces chairside suggestions while the clinician works. Studio plans are staged proposals on the client; nothing in the studio writes to the record without passing through Treatment Planning. Clearance and topology rules are deterministic shared code, not model output.

Overview

PilotSee · 3D Studio and clinical HUD
Let the clinician see and stage a plan in three dimensions, with geometric rules enforced in code.

Pipeline

The studio loads the patient’s chart, twin state and any accepted plan.
Clinicians stage restorative, implant and bridge proposals; bridge topology and implant clearance thresholds are checked by shared deterministic rules.
Staged proposals hand off to Treatment Planning, which owns persistence.
In parallel, the HUD processes Scribe context into chairside suggestions shown as drafts.

Data owned

Clinical scene
Holds
Per-turn scene state for Copilot and the studio
Staged proposals (client)
Holds
Unpersisted plan proposals pending Treatment Planning

Store	Holds
Clinical scene	Per-turn scene state for Copilot and the studio
Staged proposals (client)	Unpersisted plan proposals pending Treatment Planning

Models and engines

HUD extraction
Model or engine
Gemini 3 Flash-Lite (flash tier)
Notes
Mechanical extraction from transcript context
HUD suggestions, chairside processing
Model or engine
Gemini 3 Flash (pro tier)
Notes
Drafts shown as suggestions

Step	Model or engine	Notes
HUD extraction	Gemini 3 Flash-Lite (flash tier)	Mechanical extraction from transcript context
HUD suggestions, chairside processing	Gemini 3 Flash (pro tier)	Drafts shown as suggestions

Guardrails

Geometry and clearance checks are deterministic (shared/clinical/bridgeTopology.ts, implant clearance thresholds).
Studio output is a staged proposal, never a persisted plan.
Renderer and direct manipulation have kill switches.

Rollout and status

Pilot3D renderer and direct manipulation
Behind kill-switch flags
ProductionClinical HUD suggestions
Inside Scribe
PlannedPlan tray
Flag defaults off
PlannedPatient geometry, CAD engines, CBCT volumetrics
Specified in the 3D Studio plan; not built

Interfaces

Consumes
What
Chart, twin and plan state
Consumes
What
Scribe context (HUD)
Emits
What
Staged proposals to Treatment Planning
Emits
What
Chairside suggestions

Direction	What
Consumes	Chart, twin and plan state
Consumes	Scribe context (HUD)
Emits	Staged proposals to Treatment Planning
Emits	Chairside suggestions

SOURCE OF TRUTH

src/components/copilot/odontogram3d/
src/components/copilot/hud/
shared/clinical/bridgeTopology.ts
docs/3d-studio-workspace-tier1-implementation-plan.md