cx-observability-setup

What this skill does

# Observability Setup Skill

Use this skill when setting up or configuring the observability stack - saved views, webhook integrations, notification channels, and external integrations. This is the "day 1 setup" skill for onboarding a new service or reconfiguring notification pipelines.

---

## CLI Commands

### Views

| Command | Purpose |
|---|---|
| `cx views list` | List all saved views |
| `cx views get <id>` | Get a view definition |
| `cx views create --from-file` | Create a saved view |
| `cx views update <id> --from-file` | Update a saved view |
| `cx views delete <id>` | Delete a saved view |
| `cx views folders list` | List view folders |
| `cx views folders get <id>` | Get a folder |
| `cx views folders create --from-file` | Create a folder |
| `cx views folders update <id> --from-file` | Update a folder |
| `cx views folders delete <id>` | Delete a folder |

### Webhooks

| Command | Purpose |
|---|---|
| `cx webhooks list` | List all outgoing webhooks |
| `cx webhooks get <id>` | Get webhook details |
| `cx webhooks create --from-file` | Create a webhook |
| `cx webhooks update <id> --from-file` | Update a webhook |
| `cx webhooks delete <id>` | Delete a webhook |
| `cx webhooks test <id>` | Test a webhook |
| `cx webhooks types` | List available webhook types |
| `cx webhooks actions list` | List automation actions |
| `cx webhooks actions get <id>` | Get action details |
| `cx webhooks actions create --from-file` | Create an action |
| `cx webhooks actions update --from-file` | Update an action |
| `cx webhooks actions delete <id>` | Delete an action |
| `cx webhooks actions batch --from-file` | Batch execute actions |
| `cx webhooks actions reorder --from-file` | Reorder actions |

### Notifications

| Command | Purpose |
|---|---|
| `cx notifications connectors list` | List notification connectors |
| `cx notifications connectors get <id>` | Get connector details |
| `cx notifications connectors create --from-file` | Create a connector |
| `cx notifications connectors update --from-file` | Update a connector |
| `cx notifications connectors delete <id>` | Delete a connector |
| `cx notifications connectors types` | List connector types |
| `cx notifications connectors entity-types` | List entity types |
| `cx notifications connectors entity-subtypes --type <type>` | List entity subtypes |
| `cx notifications routers list` | List notification routers |
| `cx notifications routers get <id>` | Get router details |
| `cx notifications routers create --from-file` | Create a router |
| `cx notifications routers update --from-file` | Update a router |
| `cx notifications routers delete <id>` | Delete a router |
| `cx notifications routers validate-matcher --from-file` | Test entity label matcher |
| `cx notifications presets list` | List notification presets |
| `cx notifications presets get <id>` | Get preset details |
| `cx notifications presets create --from-file` | Create a custom preset |
| `cx notifications presets update --from-file` | Update a custom preset |
| `cx notifications presets delete <id>` | Delete a custom preset |
| `cx notifications presets set-default <id>` | Set default preset |
| `cx notifications test connector --from-file` | Test connector config |
| `cx notifications test destination --from-file` | Test destination |
| `cx notifications test preset --from-file` | Test preset config |
| `cx notifications test routing-condition --from-file` | Test routing condition |
| `cx notifications test template-render --from-file` | Test template rendering |

### Integrations

| Command | Purpose |
|---|---|
| `cx integrations list` | List all integrations |
| `cx integrations get <id>` | Get integration details |
| `cx integrations create --from-file` | Create an integration |
| `cx integrations update <id> --from-file` | Update an integration |
| `cx integrations delete <id>` | Delete an integration |
| `cx integrations test --from-file` | Test integration config |
| `cx integrations template` | Get integration template |
| `cx integrations definition <id>` | Get integration definition |
| `cx integrations deployed <id>` | Get deployed integration |
| `cx integrations extensions list` | List available extensions |
| `cx integrations extensions get <id>` | Get extension details |
| `cx integrations extensions deployed` | List deployed extensions |
| `cx integrations extensions deploy --from-file` | Deploy an extension |
| `cx integrations extensions update --from-file` | Update deployed extension |
| `cx integrations extensions undeploy --from-file` | Undeploy an extension |
| `cx integrations contextual-data list` | List contextual data integrations |
| `cx integrations contextual-data get <id>` | Get contextual data details |
| `cx integrations contextual-data create --from-file` | Create contextual data integration |
| `cx integrations contextual-data update <id> --from-file` | Update contextual data integration |
| `cx integrations contextual-data delete <id>` | Delete contextual data integration |
| `cx integrations contextual-data definition <id>` | Get contextual data definition |
| `cx integrations contextual-data test <id>` | Test contextual data integration |

All commands support `-o json` for structured output and `-p <profile>` for profile selection.

---

## New Service Setup Workflow

When onboarding a new service, follow this checklist:

### 1. Create Saved Views

Set up views for the service's key log queries:

```bash
cx views folders create --from-file folder.json
cx views create --from-file view.json
```

### 2. Set Up Notification Connectors

Configure channels (Slack, PagerDuty, email):

```bash
cx notifications connectors types -o json
cx notifications connectors create --from-file slack-connector.json
```

### 3. Configure Notification Routing

Route alerts to the right channels:

```bash
cx notifications routers create --from-file router.json
```

### 4. Set Up Webhooks

Configure outgoing webhooks for external integrations:

```bash
cx webhooks types -o json
cx webhooks create --from-file webhook.json
cx webhooks test <webhook-id>
```

### 5. Install Integrations

Deploy relevant integrations and extensions:

```bash
cx integrations list -o json
cx integrations create --from-file integration.json
cx integrations extensions deploy --from-file extension.json
```

### 6. Create Dashboard

Use the `cx-dashboards` skill for the full dashboard creation workflow.

### 7. Create SLOs

Use the `cx-incident-management` skill for SLO creation and monitoring.

---

## Notification Setup Workflow

Detailed notification channel configuration:

### 1. List Available Connector Types

```bash
cx notifications connectors types -o json
```

### 2. Create a Connector

```bash
cx notifications connectors create --from-file connector.json
```

### 3. Create a Router

```bash
cx notifications routers create --from-file router.json
```

### 4. Assign or Create a Preset

```bash
cx notifications presets list -o json
cx notifications presets create --from-file preset.json
cx notifications presets set-default <preset-id>
```

### 5. Test End-to-End

```bash
cx notifications test connector --from-file test-connector.json
cx notifications test destination --from-file test-destination.json
cx notifications test routing-condition --from-file test-condition.json
```

---

## Webhook Setup

### 1. List Webhook Types

```bash
cx webhooks types -o json
```

### 2. Create Webhook

Template from an existing webhook if possible:

```bash
cx webhooks get <existing-id> -o json > webhook-template.json
cx webhooks create --from-file webhook.json
```

### 3. Test Webhook

```bash
cx webhooks test <webhook-id>
```

### 4. Create Automation Actions (Optional)

```bash
cx webhooks actions create --from-file action.json
cx webhooks actions reorder --from-file order.json
```

---

## Key Principles

- **Always test after setup** - use `cx notifications test`, `cx webhooks test`, `cx integrations test`
- **Use `--from-file`** for complex JSON