AssemblyAI Voice Agent API + Realtime STT (medical-v1)

Bedside voice triage that documents only what was said.

A voice agent runs patient intake. An ambient scribe records the consult. Every SOAP line links to the turn it came from, and nothing is final until a clinician signs.

Open Console
  1. 01 / VOICE INTAKE
    Agent asks, calls tools, flags risk
  2. 02 / AMBIENT SCRIBE
    Doctor and patient, diarized live
  3. 03 / SOURCE-LINKED SOAP
    Every line cites a transcript turn
  4. 04 / CLINICIAN SIGN-OFF
    Draft until a human signs
Department Triage Roster & Queue ManagementSHIFT ROSTER
BAY 1[MRN-48201]
ESI-4
Patient Intake #1
Awaiting bedside voice triage intake
0 TURNSPending Note
ACTIVE ENCOUNTERBAY 1 • MRN-48201IN TRIAGE
Patient Intake #1(Demographics Pending)
CHAPTER 01 / OPERATIONAL COCKPIT

Bedside Clinical Console: Patient Intake #1

Autonomous Spoken Intake ProtocolPCM 24,000 HZ

Interactive conversational intake for Patient Intake #1. Transcripts, vitals, and tool logs remain isolated to this patient.

Audio DSP Telemetry
24,000 HZPCM16 MONODISCONNECTED
-48 dB-36 dB-24 dB-12 dB-6 dB0 dB CLIP
CARRIER:OFFLINE
MIC:IDLE
BARGE-IN:ARMED
RESPONSE LATENCY:Speak to measure

Dialogue channel ready for Patient Intake #1.

Click "Initialize Voice Triage" to begin live bedside microphone intake. Transcripts, clinical flags, and SOAP documentation attach cleanly to MRN-48201.

Patient Intake #1 • 0 speech turns recorded
Clinical Event Audit Ledger • Patient Intake #1
0 DISPATCHED
Audited tool invocations for Patient Intake #1 (check_drug_interaction, flag_critical_vital) will render here in real time.
Triage Stratification
ESI-4 Less Urgent
Pain Intensity
-- / 10
Chief Clinical Complaint
Awaiting bedside voice triage intake
Physiological Telemetry
Blood Pressure
--/--
Heart Rate
-- bpm
SpO2
--%
Respiratory Rate
--/min
Temperature
--°F
Active Chart DossierPatient Intake #1
Reconciled Home Medications
No home medications recorded yet.
RECORD IDENTIFIER:MRN-48201
UNIT / LOCATION:BAY 1 • TRAUMA TELEMETRY
ENCOUNTER TIME:12:00:00
CHAPTER 02 / CLINICAL OUTPUT

Source-Linked SOAP Note: Patient Intake #1

Every line links to the transcript turn it came from. Items without a source are flagged. Nothing is final until a clinician signs. Exports as an HL7 FHIR R4 bundle for MRN-48201.

No Clinical Note Compiled

Record a bedside intake or ambient consultation. MediScribe drafts a SOAP note from what was actually said, links every line to its source turn, and waits for clinician sign-off.

SHIFT RECORDS • AUDIT ARCHIVE

Patient Encounter Archive & Shift Ledger

Comprehensive patient record ledger tracking triage acuity, clinical flags, dialogue history, and FHIR progress documentation across the clinical shift.

Total Encounters: 1|Completed: 0
MRN / IDPATIENT & DEMOGRAPHICSBEDTRIAGE SEVERITYSTATUSFLAGS & CONFLICTSDOCUMENTATIONACTION
MRN-48201
enc-101
Patient Intake #1
Awaiting bedside voice triage intake
BAY 1ESI-4 Less UrgentIn TriageNonePending
CHAPTER 03 / SYSTEM ARCHITECTURE

Engineered for High-Acuity Triage

Streaming voice and transcription, with clinical rules and a medical-tuned speech model.

Full Duplex Barge-In Engine

Instant Audio Interruption Handling

When a clinician or patient speaks mid-sentence, MediScribe detects the barge-in signal via WebSocket reply.done.status === "interrupted" and instantly flushes the Web Audio API buffer at 24kHz.

BUFFER FLUSH
ON BARGE-IN
SAMPLE FORMAT
24kHz PCM16
VAD SENSITIVITY
0.5 THRESHOLD
Clinical Stratification

5-Tier ESI Stratification

Autonomous algorithm calculates Emergency Severity Index (ESI 1 through 5) evaluating vital stability and projected resource utilization.

ESI-1 RESUSCITATIONImmediate
ESI-2 EMERGENTHigh Risk / Pain >= 8
ESI-3 URGENT2+ Resources
Clinical Pharmacology Engine

Drug Interaction Inspector

The same curated rule set the Voice Agent calls during intake. Demo coverage only: 10 high-risk drug pairs.

PRESET PAIRS:
Acoustic Architecture

medical-v1 Domain Diarization

Universal-3.5 Pro handles complex pharmaceutical nomenclature, anatomical terminology, and clinician vs patient speaker attribution natively.

SPEAKER LABELS:Doctor • Patient
TERMINOLOGY:medical-v1 domain
LATENCY:Measured live in cockpit