ai-music

What this skill does

# AI Music

Generate AI music on RunComfy through one CLI — vocal songs, instrumentals, jingles, game loops, multilingual covers. This skill picks the right model from the RunComfy catalog based on the user's actual intent and ships the documented prompting patterns + the exact `runcomfy run` invoke for each.

[runcomfy.com](https://www.runcomfy.com/?utm_source=skills.sh&utm_medium=skill&utm_campaign=ai-music) · [Audio models](https://www.runcomfy.com/models?utm_source=skills.sh&utm_medium=skill&utm_campaign=ai-music) · [CLI docs](https://docs.runcomfy.com/cli/introduction?utm_source=skills.sh&utm_medium=skill&utm_campaign=ai-music)

## Install this skill

```bash
npx skills add agentspace-so/runcomfy-agent-skills --skill ai-music -g
```

## Powered by the RunComfy CLI

**Step 1 — install** (one of, see the `runcomfy-cli` skill for details):

```bash
npm i -g @runcomfy/cli         # global install
npx -y @runcomfy/cli --version # zero-install
```

**Step 2 — sign in** (or set `RUNCOMFY_TOKEN` env var in CI / containers):

```bash
runcomfy login
```

**Step 3 — generate music**:

```bash
runcomfy run <vendor>/<model>/<endpoint> \
  --input '{"prompt": "...", ...}' \
  --output-dir ./out
```

CLI deep dive: [`runcomfy-cli`](https://www.skills.sh/agentspace-so/runcomfy-agent-skills/runcomfy-cli) skill.

---

## Pick the right model for the user's intent

### Text-to-music (generate from scratch) — newest first

**ACE Step 1.5** — `acestep-ai/ace-step-1.5/text-to-audio`
> Latest ACE Step generation. **50+ language vocal support**, refined structured-lyric handling, $0.0003/s. Open-weights (Apache 2.0).
> Pick for: multilingual launches, vocal songs in non-English, hero-quality ACE output.
> Avoid for: maximally polished commercial vocal hooks (try ElevenLabs Music) or cost-sensitive batches (try base ACE Step).

**ElevenLabs AI Music Generation** — `elevenlabs/elevenlabs/music-generation`
> Premium 44.1 kHz stereo, 5 s–5 min, section-level control (Intro/Verse/Chorus/Bridge), multilingual vocals, commercial-friendly. $0.0083/s (~27× ACE Step).
> Pick for: hero brand campaigns, polished vocal hooks, premium commercial cuts, ad music.
> Avoid for: high-volume drafts / background music libraries — cost dominates.

**ACE Step (base)** — `acestep-ai/ace-step/text-to-audio` *(default for cost-sensitive work)*
> Original ACE Step. Tag-driven composition, optional lyrics, 5–240 s stereo. **$0.0002/s** — cheapest CLI-reachable music model on RunComfy.
> Pick for: background music libraries, jingles, game loops, drafts, cost-sensitive iteration.
> Avoid for: premium vocal hooks — use **ElevenLabs Music** or **ACE Step 1.5**.

### Edit existing audio — ACE Step only (ElevenLabs has no edit endpoints)

**ACE Step audio-inpaint** — `acestep-ai/ace-step/audio-inpaint`
> Regenerate a **time range** (start_time / end_time, anchorable to track start or end) inside an existing track.
> Pick for: fix a bad chorus, swap the bridge, replace a 20 s section without re-rendering.
> Avoid for: edits not bounded by time (use the source-model text-to-music instead).

**ACE Step audio-outpaint** — `acestep-ai/ace-step/audio-outpaint`
> Extend an existing track **bidirectionally** — add intro before, outro after, or both (`extend_before_duration` / `extend_after_duration`).
> Pick for: lengthen a 30 s hook into a 2 min cut, add a fade-out, build longer arrangement around an existing hook.
> Avoid for: extending past 4 min total — chain calls instead.

The agent reads these tables, classifies user intent (premium vs cost-sensitive · multilingual · vocal vs instrumental · generate vs edit), and picks the matching subsection below.

---

## Route 1: ElevenLabs AI Music Generation — premium

**Model**: `elevenlabs/elevenlabs/music-generation`
**Full schema + tips**: see the dedicated [`elevenlabs-music-generation`](https://www.skills.sh/agentspace-so/runcomfy-agent-skills/elevenlabs-music-generation) skill.

### Quick invoke

```bash
runcomfy run elevenlabs/elevenlabs/music-generation \
  --input '{
    "prompt": "Upbeat indie-pop anthem, bright electric guitars, driving drums, 120 BPM, female lead vocal. [Intro 8 bars] instrumental build. [Verse] Chalk on the palms, laces double-knotted. [Chorus] We rise, we strike, we never fade out. [Outro] full band, fade.",
    "music_length_ms": 60000
  }' \
  --output-dir ./out
```

ElevenLabs Music reads **one `prompt`** carrying both style brief and lyrics with section markers. `force_instrumental: true` for no vocals. $0.0083/s — draft short, finalize long.

---

## Route 2: ACE Step / ACE Step 1.5 — cheap, open-weights

**Model**: `acestep-ai/ace-step/text-to-audio` (base) or `acestep-ai/ace-step-1.5/text-to-audio` (1.5)
**Full schema + tips**: see the dedicated [`ace-step`](https://www.skills.sh/agentspace-so/runcomfy-agent-skills/ace-step) skill.

### Quick invoke

```bash
runcomfy run acestep-ai/ace-step-1.5/text-to-audio \
  --input '{
    "tags": "indie pop, anthemic, electric guitar, driving drums, female vocal, 120 BPM",
    "lyrics": "[Verse]\nChalk on the palms\nMorning on the ridge\n[Chorus]\nWe rise, we strike, we never fade out",
    "duration": 60
  }' \
  --output-dir ./out
```

ACE Step splits **style into `tags`** and **vocal content into `lyrics`** (with `[Verse]/[Chorus]/[Bridge]` markers, or `[inst]` for instrumental). 1.5 variant adds 50+ language vocal support.

---

## Route 3: ACE Step audio-inpaint — repair a section

```bash
runcomfy run acestep-ai/ace-step/audio-inpaint \
  --input '{
    "audio": "https://your-cdn.example/song.mp3",
    "tags": "indie pop, breakdown, piano only, soft, no drums",
    "start_time": 20,
    "end_time": 40,
    "lyrics": "[inst]"
  }' \
  --output-dir ./out
```

`start_time_relative_to` and `end_time_relative_to` default to `start`; set to `end` to anchor against the track's end (e.g. rewrite the last 15 s without computing exact timestamps). Full schema: [`ace-step`](https://www.skills.sh/agentspace-so/runcomfy-agent-skills/ace-step) skill.

---

## Route 4: ACE Step audio-outpaint — extend a track

```bash
runcomfy run acestep-ai/ace-step/audio-outpaint \
  --input '{
    "audio": "https://your-cdn.example/hook-30s.mp3",
    "tags": "indie pop, build-up before chorus, fade outro",
    "extend_before_duration": 30,
    "extend_after_duration": 60,
    "lyrics": "[inst]"
  }' \
  --output-dir ./out
```

Bidirectional in one call — set both `extend_before_duration` and `extend_after_duration` to add intro + outro at once. Cap is 4 min total.

---

## Common patterns

### Premium brand campaign jingle (5–15 s)
- **Route 1 (ElevenLabs Music)** — hero quality, polished mix. $0.05–0.12 per take.

### Background music library at scale (50+ tracks)
- **Route 2 (ACE Step base)** with varied tag combos. $0.012 / 60 s × 50 = $0.60 for 50 drafts.

### Multilingual launch (same song, 8 languages)
- **Route 2 (ACE Step 1.5)** — identical tags, swap `lyrics` per language. Or **Route 1 (ElevenLabs Music)** if premium quality matters more than cost.

### Game loop bed
- **Route 2 (ACE Step base)** with "seamless loop, consistent groove" in tags, 60–120 s.

### Theme song for a video
- **Route 1 (ElevenLabs Music)** with full brief + lyrics + section markers, `music_length_ms` matched to the video length.

### "I generated a 30 s hook but I need a 2 min track"
- **Route 4 (ACE Step audio-outpaint)** with the hook as `audio`, add 30 s intro + 60 s outro in one call.

### "My second chorus came out wrong"
- **Route 3 (ACE Step audio-inpaint)** with `start_time` / `end_time` around the bad chorus, tags matching the original song style.

### Cheap draft → premium polish
- Iterate tags on **Route 2 (ACE Step base)** for $0.01–0.02 per attempt → lock vibe → final render on **Route 1 (ElevenLabs Music)** for the polished commercial cut.

### Inpaint a section that doesn't fit ACE's time-range schema
- The CLI today doesn't expose a mask-based audio inpaint endpoint. Either reformulate as a time-range edit,