interview-system-designer

What this skill does

# Interview System Designer

Comprehensive interview system design, competency assessment, and hiring process optimization.

## Table of Contents

- [Quick Start](#quick-start)
- [Tools Overview](#tools-overview)
  - [Interview Loop Designer](#1-interview-loop-designer)
  - [Question Bank Generator](#2-question-bank-generator)
  - [Hiring Calibrator](#3-hiring-calibrator)
- [Interview System Workflows](#interview-system-workflows)
  - [Role-Specific Loop Design](#role-specific-loop-design)
  - [Competency Matrix Development](#competency-matrix-development)
  - [Question Bank Creation](#question-bank-creation)
  - [Bias Mitigation Framework](#bias-mitigation-framework)
  - [Hiring Bar Calibration](#hiring-bar-calibration)
- [Competency Frameworks](#competency-frameworks)
- [Scoring & Calibration](#scoring--calibration)
- [Reference Documentation](#reference-documentation)
- [Industry Standards](#industry-standards)

---

## Quick Start

```bash
# Design a complete interview loop for a senior software engineer role
python loop_designer.py --role "Senior Software Engineer" --level senior --team platform --output loops/

# Generate a comprehensive question bank for a product manager position
python question_bank_generator.py --role "Product Manager" --level senior --competencies leadership,strategy,analytics --output questions/

# Analyze interview calibration across multiple candidates and interviewers
python hiring_calibrator.py --input interview_data.json --output calibration_report.json --analysis-type full
```

---

## Tools Overview

### 1. Interview Loop Designer

Generates calibrated interview loops tailored to specific roles, levels, and teams.

**Input:** Role definition (title, level, team, competency requirements)
**Output:** Complete interview loop with rounds, focus areas, time allocation, scorecard templates

**Key Features:**
- Role-specific competency mapping
- Level-appropriate question difficulty
- Interviewer skill requirements
- Time-optimized scheduling
- Standardized scorecards

**Usage:**
```bash
# Design loop for a specific role
python loop_designer.py --role "Staff Data Scientist" --level staff --team ml-platform

# Generate loop with specific focus areas
python loop_designer.py --role "Engineering Manager" --level senior --competencies leadership,technical,strategy

# Create loop for multiple levels
python loop_designer.py --role "Backend Engineer" --levels junior,mid,senior --output loops/backend/
```

### 2. Question Bank Generator

Creates comprehensive, competency-based interview questions with detailed scoring criteria.

**Input:** Role requirements, competency areas, experience level
**Output:** Structured question bank with scoring rubrics, follow-up probes, and calibration examples

**Key Features:**
- Competency-based question organization
- Level-appropriate difficulty progression
- Behavioral and technical question types
- Anti-bias question design
- Calibration examples (poor/good/great answers)

**Usage:**
```bash
# Generate questions for technical competencies
python question_bank_generator.py --role "Frontend Engineer" --competencies react,typescript,system-design

# Create behavioral question bank
python question_bank_generator.py --role "Product Manager" --question-types behavioral,leadership --output pm_questions/

# Generate questions for all levels
python question_bank_generator.py --role "DevOps Engineer" --levels junior,mid,senior,staff
```

### 3. Hiring Calibrator

Analyzes interview scores to detect bias, calibration issues, and recommends improvements.

**Input:** Interview results data (candidate scores, interviewer feedback, demographics)
**Output:** Calibration analysis, bias detection report, interviewer coaching recommendations

**Key Features:**
- Statistical bias detection
- Interviewer calibration analysis
- Score distribution analysis
- Recommendation engine
- Trend tracking over time

**Usage:**
```bash
# Analyze calibration across all interviews
python hiring_calibrator.py --input interview_results.json --analysis-type comprehensive

# Focus on specific competency areas
python hiring_calibrator.py --input data.json --competencies technical,leadership --output bias_report.json

# Track calibration trends over time
python hiring_calibrator.py --input historical_data.json --trend-analysis --period quarterly
```

---

## Interview System Workflows

### Role-Specific Loop Design

#### Software Engineering Roles

**Junior/Mid Software Engineer (2-4 years)**
- **Duration:** 3-4 hours across 3-4 rounds
- **Focus Areas:** Coding fundamentals, debugging, system understanding, growth mindset
- **Rounds:**
  1. Technical Phone Screen (45min) - Coding fundamentals, algorithms
  2. Coding Deep Dive (60min) - Problem-solving, code quality, testing
  3. System Design Basics (45min) - Component interaction, basic scalability
  4. Behavioral & Values (30min) - Team collaboration, learning agility

**Senior Software Engineer (5-8 years)**
- **Duration:** 4-5 hours across 4-5 rounds
- **Focus Areas:** System design, technical leadership, mentoring capability, domain expertise
- **Rounds:**
  1. Technical Phone Screen (45min) - Advanced algorithms, optimization
  2. System Design (60min) - Scalability, trade-offs, architectural decisions
  3. Coding Excellence (60min) - Code quality, testing strategies, refactoring
  4. Technical Leadership (45min) - Mentoring, technical decisions, cross-team collaboration
  5. Behavioral & Culture (30min) - Leadership examples, conflict resolution

**Staff+ Engineer (8+ years)**
- **Duration:** 5-6 hours across 5-6 rounds
- **Focus Areas:** Architectural vision, organizational impact, technical strategy, cross-functional leadership
- **Rounds:**
  1. Technical Phone Screen (45min) - System architecture, complex problem-solving
  2. Architecture Design (90min) - Large-scale systems, technology choices, evolution patterns
  3. Technical Strategy (60min) - Technical roadmaps, technology adoption, risk assessment
  4. Leadership & Influence (60min) - Cross-team impact, technical vision, stakeholder management
  5. Coding & Best Practices (45min) - Code quality standards, development processes
  6. Cultural & Strategic Fit (30min) - Company values, strategic thinking

#### Product Management Roles

**Product Manager (3-6 years)**
- **Duration:** 3-4 hours across 4 rounds
- **Focus Areas:** Product sense, analytical thinking, stakeholder management, execution
- **Rounds:**
  1. Product Sense (60min) - Feature prioritization, user empathy, market understanding
  2. Analytical Thinking (45min) - Data interpretation, metrics design, experimentation
  3. Execution & Process (45min) - Project management, cross-functional collaboration
  4. Behavioral & Leadership (30min) - Stakeholder management, conflict resolution

**Senior Product Manager (6-10 years)**
- **Duration:** 4-5 hours across 4-5 rounds
- **Focus Areas:** Product strategy, team leadership, business impact, market analysis
- **Rounds:**
  1. Product Strategy (75min) - Market analysis, competitive positioning, roadmap planning
  2. Leadership & Influence (60min) - Team building, stakeholder management, decision-making
  3. Data & Analytics (45min) - Advanced metrics, experimentation design, business intelligence
  4. Technical Collaboration (45min) - Technical trade-offs, engineering partnership
  5. Case Study Presentation (45min) - Past impact, lessons learned, strategic thinking

#### Design Roles

**UX Designer (2-5 years)**
- **Duration:** 3-4 hours across 3-4 rounds
- **Focus Areas:** Design process, user research, visual design, collaboration
- **Rounds:**
  1. Portfolio Review (60min) - Design process, problem-solving approach, visual skills
  2. Design Challenge (90min) - User-centered design, wireframing, iteration
  3. Collaboration & Process (45min) - Cross-functional work, feedback incorporation
  4. Behavioral & Values (30min) - User advocacy, creative problem-solving

**Senior UX Designer (5+ years)**
- **Dura