self-improving-agent

What this skill does

# Self-Improving Agent

Captures learnings, errors, and corrections to enable continuous improvement across sessions.

## Activation Triggers

This skill automatically activates when:

| Trigger | What Gets Logged | Location |
|---------|------------------|----------|
| **Command fails** | Error type, context, recovery suggestion | `logs/failures_detailed.jsonl` |
| **User corrects** | "No, that's wrong...", "Actually..." | `logs/corrections.jsonl` |
| **Missing capability** | "Can you X?" where X isn't available | `logs/missing_capabilities.jsonl` |
| **API/tool fails** | Failure pattern, suggested fix | `logs/failures_detailed.jsonl` |
| **Better approach found** | Optimization learned | `logs/learnings.jsonl` |

## How It Works

### 1. Automatic Logging (via hooks)
```
PostToolUse → enhanced-failure-logger.js → logs failures with context
UserMessage → correction-detector.js → detects "wrong/actually/try again"
Response → capability-tracker.js → detects unfulfilled requests
```

### 2. Learning Aggregation
All learnings flow to `logs/learnings.jsonl`:
```json
{
  "timestamp": "2026-01-26T12:00:00Z",
  "type": "user_correction|tool_failure|missing_capability",
  "category": "factual_error|command_failed|web_browsing",
  "description": "what was learned",
  "source": "which detector"
}
```

### 3. Session Start Review
On each session start, recent learnings are shown:
```
=== Learning Review ===
[Learnings] 47 total entries
[Recent]
  • [tool_failure] Bash failed: timeout - WebFetch to external API...
  • [user_correction] User corrected: "No, use the other file..."
[Corrections] 12 user corrections logged
[Capability Gaps] Top requested:
  • send emails (5x)
  • browse web (3x)
```

### 4. QAVR Integration
Successful learnings boost Q-values for related memories, improving future retrieval.

## Manual Commands

### Review Learnings
```bash
# Show all learnings
cat ~/.claude/logs/learnings.jsonl | tail -20

# Show corrections only
cat ~/.claude/logs/corrections.jsonl | jq -s 'group_by(.correction_type) | map({type: .[0].correction_type, count: length})'

# Show capability gaps report
node ~/.claude/scripts/hooks/capability-tracker.js --report
```

### Test Detection
```bash
# Test correction detector
node ~/.claude/scripts/hooks/correction-detector.js

# Test failure logger
node ~/.claude/scripts/hooks/enhanced-failure-logger.js

# Test capability tracker
node ~/.claude/scripts/hooks/capability-tracker.js
```

## Learning Categories

### Correction Types
- `factual_error` - Wrong information provided
- `retry_request` - User asked to try again
- `misunderstanding` - Misinterpreted the request
- `failed_solution` - Solution didn't work

### Failure Types
- `permission_error` - Access denied
- `not_found` - File/resource missing
- `timeout` - Operation timed out
- `network_error` - Connection issues
- `syntax_error` - Invalid syntax
- `api_error` - External API failed
- `command_failed` - Shell command failed
- `agent_failed` - Subagent failed

### Capability Categories
- `web_browsing` - Internet access requests
- `image_processing` - Image/photo handling
- `communication` - Email/messaging
- `database_access` - SQL/database queries
- `external_api` - Third-party services
- `memory_persistence` - Long-term memory

## Configuration

In `settings.json`, these hooks enable self-improvement:

```json
{
  "hooks": {
    "SessionStart": [...],  // Reviews learnings
    "PostToolUse": [
      {"matcher": "Bash", "hooks": [{"command": "enhanced-failure-logger.js"}]},
      {"matcher": "Task", "hooks": [{"command": "enhanced-failure-logger.js"}]}
    ]
  }
}
```

## Benefits

1. **Learn from mistakes** - Don't repeat the same errors
2. **Understand user preferences** - Track what corrections mean
3. **Identify skill gaps** - Know what features to build
4. **Improve over time** - QAVR ranking gets better with feedback
5. **Context persistence** - Learnings survive session restarts

## Integration with Other Skills

| Skill | Integration |
|-------|-------------|
| **QAVR** | Successful learnings boost memory Q-values |
| **Memory Consolidation** | Periodic cleanup of old learnings |
| **Confidence Check** | Review learnings before major tasks |
| **IR-v2** | Use learnings to inform pattern selection |

## Files

```
~/.claude/
├── logs/
│   ├── learnings.jsonl           # All learnings
│   ├── corrections.jsonl         # User corrections
│   ├── failures_detailed.jsonl   # Enhanced failure logs
│   ├── missing_capabilities.jsonl # Capability requests
│   └── capability_gaps.json      # Aggregated gaps
└── scripts/hooks/
    ├── correction-detector.js
    ├── enhanced-failure-logger.js
    ├── capability-tracker.js
    └── session-start.js (reviews learnings)
```