research-synthesis

What this skill does

## Core Analytical Methods

### Thematic Coding

A systematic approach to extracting meaning from qualitative data:

1. **Immersion** — Read the full dataset end-to-end without annotating. Build an intuitive sense of the landscape before imposing structure.
2. **Open coding** — Walk through every data point, attaching descriptive labels. Over-code rather than under-code; collapsing is easier than retroactive splitting.
3. **Pattern grouping** — Cluster related codes into candidate themes. Each theme should represent a meaningful pattern relevant to your research questions.
4. **Validation pass** — Revisit the raw data to stress-test each theme. Confirm sufficient supporting evidence exists, themes do not overlap excessively, and together they form a coherent narrative.
5. **Sharpening** — Give each theme a precise name and a one-to-two sentence definition capturing its essence.
6. **Reporting** — Write up themes as findings, each backed by concrete evidence from the data.

### Bottom-Up Clustering (Affinity Approach)

A technique for letting structure emerge organically from observations:

1. **Atomize** — Record every discrete observation, quote, or data point as an individual unit
2. **Group by similarity** — Arrange units into clusters without predefined categories; let the data dictate the groupings
3. **Name each cluster** — Assign a label that captures the shared thread binding the items together
4. **Build hierarchy** — If natural super-groups appear across clusters, organize them into higher-level categories
5. **Read the map** — The cluster structure and inter-cluster relationships reveal your key themes

**Practical guidance:**
- Keep each unit to a single observation — do not bundle multiple insights together
- Rearrange freely; initial placements are provisional
- Oversized clusters typically contain multiple themes and should be subdivided
- Isolated observations that resist grouping are worth examining — outliers often carry signal
- The clustering process itself generates understanding, not just the final arrangement

### Cross-Validation Through Triangulation

Strengthen any finding by confirming it through independent lines of evidence:

- **Method triangulation**: Probe the same question via different techniques (e.g., interviews, surveys, and analytics)
- **Participant triangulation**: Examine the same question across different user segments or cohorts
- **Temporal triangulation**: Look for the same pattern at multiple points in time

Findings backed by several independent sources carry far more weight. When sources diverge, treat the disagreement as informative — it may point to distinct user segments or context-dependent behavior.

## Working with Interview Data

### Extracting Signal from Individual Sessions

For every interview, pull out four categories of information:

**Observed behaviors and expressed attitudes**
- Separate what participants describe doing from what they feel or believe
- Record situational context: frequency, setting, collaborators involved
- Pay special attention to workarounds — each one represents an unmet need

**Illustrative quotations**
- Select quotes that are specific and vivid, not generic platitudes
- Attribute by participant profile rather than name: "Mid-market ops lead, 50-person team" rather than "Participant 7"
- Remember: a quote is evidence supporting a finding, not a finding in itself

**Gaps between stated preferences and actual behavior**
- What people claim to want frequently diverges from what they actually do
- Observable behavior is stronger evidence than self-reported preference
- When a participant requests a feature but their workflow shows no use of analogous existing features, note the discrepancy

**Intensity signals**
- Emotional markers: frustration, enthusiasm, resignation
- Frequency of encounter: daily pain versus rare annoyance
- Effort invested in workarounds
- Downstream consequences when the problem occurs

### Patterns Across Multiple Sessions

After coding individual interviews:
- Identify which observations recur across participants and count their frequency
- Segment by user type — different roles or contexts often yield different patterns
- Surface contradictions between participants; these frequently indicate meaningful audience segments
- Highlight anything that defied your initial expectations

## Interpreting Survey Data

### Quantitative Response Analysis

- **Sample quality**: Evaluate response rate and potential non-response bias before drawing conclusions
- **Look at distributions, not just means**: A bimodal spread (concentrated at extremes) tells a fundamentally different story than a bell curve, even if the averages match
- **Slice by segment**: Aggregate numbers can conceal critical differences between user groups
- **Respect sample size**: Small samples make minor numerical differences unreliable
- **Contextualize with benchmarks**: Compare against previous periods or industry baselines

### Free-Text Response Analysis
- Apply the same thematic coding process used for interview data
- Tally theme frequency across responses
- Extract representative quotes per theme
- Watch for themes that appear in open text but were absent from the structured questions — these reveal blind spots in your survey design

### Frequent Pitfalls in Survey Analysis
- Reporting means without showing distributions — identical averages can mask radically different response shapes
- Overlooking non-response bias — those who skipped the survey may differ systematically from those who completed it
- Treating small score fluctuations as meaningful — a fraction-of-a-point shift is usually noise
- Assuming equal intervals on Likert scales — the psychological distance between "Strongly Agree" and "Agree" is not necessarily the same as between "Agree" and "Neutral"
- Drawing causal conclusions from cross-tabulated correlations

## Bridging Qualitative and Quantitative Evidence

### The Iterative Loop

- **Start qualitative**: Interviews and observation uncover the what and the why. They generate hypotheses about user behavior.
- **Quantify**: Surveys and analytics measure how widespread and how frequent. They validate or challenge hypotheses at scale.
- **Return to qualitative**: Dive back in to explain surprising quantitative results.

### Combining Evidence Effectively
- Weight qualitative findings by their quantitative reach — a theme from interviews matters more if analytics show it touches a large user base
- Use qualitative data to decode quantitative anomalies — a retention dip is a number; interviews reveal the onboarding redesign confused new users
- Present integrated evidence: "42% of respondents flagged difficulty with X (survey data). Interviews trace the root cause to Y (qualitative finding)."

### When Data Sources Conflict
- Conflicting evidence across methods is a feature, not a flaw — it demands investigation
- Check whether the divergence stems from different populations being measured
- Consider whether self-reported preferences (survey) diverge from actual behavior (analytics)
- Verify whether the survey question truly captured the intended construct
- Report the conflict transparently and pursue follow-up rather than arbitrarily choosing one source

## Building Personas from Data

### From Behavioral Clusters to Profiles

Personas must be grounded in observed patterns, not assumptions:

1. **Detect behavioral clusters**: Identify groups of participants who share similar goals, behaviors, and contexts
2. **Isolate differentiating dimensions**: Determine what separates one cluster from another — usage intensity, company size, technical sophistication, primary job-to-be-done, etc.
3. **Draft persona profiles** for each cluster:
   - Descriptive label and summary
   - Characteristic behaviors and objectives
   - Core frustrations and unaddressed needs
   - Contextual details (role, organization type, adjacent tools)
   - Supporting quotes from research
4. **Ground-