liveavatar-debug
Troubleshoot and debug LiveAvatar integration issues. Use when the user's LiveAvatar integration isn't working, the avatar is silent, audio is garbled, sessions fail to start, events aren't received, or they're getting API errors.
What this skill does
# LiveAvatar Debugging Guide
Symptom-based troubleshooting for LiveAvatar integrations. Find your symptom below and follow the fix.
## Avatar is silent / not responding to speech
**Most likely: Missing `context_id` in FULL Mode.**
Without a `context_id`, the avatar enters restricted mode — streams video but ignores user input. No error thrown.
**Fix:** Create a context via `POST /v1/contexts` with at least a `prompt` field. Include the returned `context_id` in your session token's `avatar_persona`.
**Other causes:**
- Browser mic permissions blocked (check `allow="microphone"` on iframe)
- Push-to-Talk enabled but PTT events not being sent
- OS-level mic mute
## Audio is garbled or distorted (LITE Mode)
**Most likely: Wrong audio format.**
Required: PCM 16-bit signed, 24KHz, base64. No error returned for wrong format.
**Checklist:**
- [ ] Sample rate is exactly 24,000 Hz
- [ ] Raw PCM (no WAV/MP3/OGG headers)
- [ ] 16-bit signed, not 8-bit or 32-bit float
- [ ] Base64 encoded
- [ ] Chunks under 1MB
**Quick test:** Send a known-good 440Hz test tone. If it works but your TTS doesn't, resample your TTS output.
## 401 error / session fails to start
**Most likely: Wrong auth header.**
| Endpoint | Correct auth |
|----------|-------------|
| `POST /v1/sessions/token` | `X-API-KEY: <api_key>` |
| `POST /v1/sessions/start` | `Authorization: Bearer <session_token>` |
Common mistakes: using API key on `/start`, using Bearer token on `/token`, putting API key in Bearer format.
## Events not received (FULL Mode)
- Subscribed to correct topics? Send to `agent-control`, receive from `agent-response`
- LiveKit room connected? Check connection state
- Parsing JSON correctly? Events have `event_type`, `event_id`, `session_id`
## WebSocket events silently dropped (LITE Mode)
**Most likely: Sending before `connected`.**
Wait for `{"type": "session.state_updated", "state": "connected"}` before sending any commands.
Also check:
- Using correct event names? LITE uses `agent.*`, not `avatar.*` (that's FULL)
- WebSocket still open? 5-min inactivity timeout
## Session times out
5 minutes of inactivity kills the session.
- **FULL:** `POST /v1/sessions/keep-alive` with `Bearer <session_token>`
- **LITE:** `{"type": "session.keep_alive", "event_id": "..."}` via WebSocket
Send every 2-3 minutes.
## Sandbox won't start
- [ ] `is_sandbox: true` set in session token
- [ ] Avatar ID is `dd73ea75-1218-4ef3-92ce-606d5f7fbc0a` (sessions) or `65f9e3c9-d48b-4118-b73a-4ae2e3cbb8f0` (embeds)
- [ ] Not using a different avatar with sandbox mode
~1 minute auto-termination is expected behavior.
## Image avatar fails / no audio
Image avatars have no auto-generated voice. Specify `voice_id` in `avatar_persona`. Browse voices at `GET /v1/voices`.
## Custom LLM / TTS not working
**LLM checklist:**
- [ ] Secret: `secret_type: "LLM_API_KEY"`
- [ ] Config: correct `model`, `secret_id`, `base_url`
- [ ] `llm_configuration_id` in session token
- [ ] Endpoint supports OpenAI `/chat/completions` protocol
**TTS checklist:**
- [ ] Secret: `secret_type: "ELEVENLABS_API_KEY"`
- [ ] Voice imported via `POST /v1/voices/third_party`
- [ ] Using the **returned LiveAvatar voice_id** (not the ElevenLabs ID)
## CORS / network errors
- API calls should come from backend, not browser
- Allow outbound `wss://` for LiveKit and WebSocket
- Allow `*.livekit.cloud`, `api.liveavatar.com`, `embed.liveavatar.com`
## General approach
1. Start with sandbox mode to eliminate billing issues
2. Check session state: `GET /v1/sessions/{id}`
3. Check transcript: `GET /v1/sessions/{id}/transcript`
4. Check credits: `GET /v1/users/credits`
5. Verify you're not mixing FULL and LITE event systems
Related in Image & Video
watch
IncludedWatch a video (URL or local path). Downloads with yt-dlp, extracts auto-scaled frames with ffmpeg, pulls the transcript from captions (or Whisper API fallback), and hands the result to Claude so it can answer questions about what's in the video.
physical-ai-defect-image-generation
IncludedUse when the user wants to orchestrate defect image generation, run associated setup, or handle outputs on OSMO. The Day 0 path handles cold-start with USD-to-ROI, image-edit augmentation, and AnomalyGen to create initial PCBA datasets. The Day 1 path performs inference and labeling on real images. This skill helps with first-time asset setup, creation of finetuning checkpoints, and configuring deployment. Trigger keywords: defect image generation, dig workflow, dig pipeline, defect image detection workflow, aoi pipeline, aoi anomalygen, usd2roi anomalygen, day 0 pcba, day 1 pcba, day 1 real-photo alignment, day 1 manual roi, metal surface anomaly, glass defect, anomalygen finetune, setup_pcb, setup_metal, setup_glass, setup_pretrained, dig setup, dig datasets, dig pretrained checkpoint, dig image-edit endpoint.
accelint-react-best-practices
IncludedReact performance optimization and best practices. ALWAYS use this skill when working with any React code - writing components, hooks, JSX; refactoring; optimizing re-renders, memoization, state management; reviewing for performance; fixing hydration mismatches; debugging infinite re-renders, stale closures, input focus loss, animations restarting; preventing remounting; implementing transitions, lazy initialization, effect dependencies. Even simple React tasks benefit from these patterns. Covers React 19+ (useEffectEvent, Activity, ref props). Triggers - useEffect, useState, useMemo, useCallback, memo, inline components, nested components, components inside components, re-render, performance, hydration, SSR, Next.js, useDeferredValue, combined hooks.
elevenlabs-agents
IncludedBuild conversational AI voice agents with ElevenLabs Platform using React, JavaScript, React Native, or Swift SDKs. Configure agents, tools (client/server/MCP), RAG knowledge bases, multi-voice, and Scribe real-time STT. Use when: building voice chat interfaces, implementing AI phone agents with Twilio, configuring agent workflows or tools, adding RAG knowledge bases, testing with CLI "agents as code", or troubleshooting deprecated @11labs packages, Android audio cutoff, CSP violations, dynamic variables, or WebRTC config. Keywords: ElevenLabs Agents, ElevenLabs voice agents, AI voice agents, conversational AI, @elevenlabs/react, @elevenlabs/client, @elevenlabs/react-native, @elevenlabs/elevenlabs-js, @elevenlabs/agents-cli, elevenlabs SDK, voice AI, TTS, text-to-speech, ASR, speech recognition, turn-taking model, WebRTC voice, WebSocket voice, ElevenLabs conversation, agent system prompt, agent tools, agent knowledge base, RAG voice agents, multi-voice agents, pronunciation dictionary, voice speed control, elevenlabs scribe, @11labs deprecated, Android audio cutoff, CSP violation elevenlabs, dynamic variables elevenlabs, case-sensitive tool names, webhook authentication
humanizer
IncludedHumanize AI-generated text by detecting and removing patterns typical of LLM output. Rewrites text to sound natural, specific, and human. Uses 28 pattern detectors, 560+ AI vocabulary terms across 3 tiers, and statistical analysis (burstiness, type-token ratio, readability) for comprehensive detection. Use when asked to humanize text, de-AI writing, make content sound more natural/human, review writing for AI patterns, score text for AI detection, or improve AI-generated drafts. Covers content, language, style, communication, and filler categories.
generating-mermaid-diagrams
IncludedSalesforce architecture diagrams using Mermaid with ASCII fallback. Use this skill when generating text-based diagrams for Salesforce architecture, OAuth flows, ERDs, integration sequences, or Agentforce structure. TRIGGER when: user says "diagram", "visualize", "ERD", or asks for sequence diagrams, flowcharts, class diagrams, or architecture visualizations in Mermaid. DO NOT TRIGGER when: user wants PNG/SVG image output (use generating-visual-diagrams), or asks about non-Salesforce systems.