outscraper

What this skill does

# Outscraper

Outscraper provides data scraping APIs for search engines, social media, and e-commerce websites. Developers and data scientists use it to extract large-scale public data for market research, lead generation, and competitive analysis. It helps automate data collection from the web.

Official docs: https://outscraper.com/documentation

## Outscraper Overview

- **Google Search Results**
  - **SERP Data**
- **Google Maps Results**
  - **Place Details**
  - **Reviews**
- **Google Play Results**
  - **App Details**
  - **Reviews**
- **App Store Results**
  - **App Details**
  - **Reviews**
- **Amazon Product Results**
  - **Product Details**
  - **Reviews**
- **Amazon Best Sellers Results**
- **Amazon Search Suggestions**
- **YouTube Results**
  - **Video Details**
  - **Comments**
- **Twitter Results**
  - **Tweet Details**
- **LinkedIn Results**
  - **Profile Details**
- **Instagram Results**
  - **Profile Details**
- **TikTok Results**
  - **Video Details**
- **Walmart Results**
  - **Product Details**
- **Whois Results**
- **Proxy**
- **Realtime Location**
- **Email Verification**
- **Phone Number Verification**
- **Scrape Website Data**
- **Scrape Text Data**
- **Parse Website Data**
- **Parse Text Data**
- **Summarize Text**
- **Translate Text**
- **Extract Contact Details**
- **Extract Emails From URL**
- **Extract Phone Numbers From URL**
- **Extract Social Media From URL**
- **Extract Locations From URL**
- **Extract Data From PDF**
- **Convert HTML to Markdown**
- **Check Website Status**
- **Find Similar Websites**
- **Find Alternative Websites**
- **Find Websites Using Technology**
- **Find Websites Using Keywords**
- **Find People By Skills**
- **Find People By Email**
- **Find People By Name**
- **Find Company By Name**
- **Find Company By Domain**
- **Find Company By LinkedIn URL**
- **Find Company By Facebook URL**
- **Find Company By Twitter URL**
- **Find Company By Instagram URL**
- **Find Company By Crunchbase URL**
- **Find Company By Location**
- **Find Company By Industry**
- **Find Company By Keywords**
- **Find Company By Funding**
- **Find Company Employee Count**
- **Find Company Revenue**
- **Find Company Founded Year**
- **Find Company Headquarters**
- **Find Company Description**
- **Find Company Website**
- **Find Company Email Address**
- **Find Company Phone Number**
- **Find Company Social Media Links**
- **Find Company Similar Companies**
- **Find Company Alternative Companies**
- **Find Company Technologies Used**
- **Find Company Job Openings**
- **Find Company News**
- **Find Company Events**
- **Find Company Blog**
- **Find Company Leadership**
- **Find Company Investors**
- **Find Company Acquisitions**
- **Find Company Exits**
- **Find Company Patents**
- **Find Company Trademarks**
- **Find Company Awards**
- **Find Company Associations**
- **Find Company Memberships**
- **Find Company Customers**
- **Find Company Suppliers**
- **Find Company Partners**
- **Find Company Competitors**
- **Find Company Financials**
- **Find Company Filings**
- **Find Company Legal Disputes**
- **Find Company Compliance**
- **Find Company Risk Assessment**
- **Find Company Sustainability**
- **Find Company Diversity**
- **Find Company Ethics**
- **Find Company Social Responsibility**
- **Find Company Governance**
- **Find Company Innovation**
- **Find Company Research and Development**
- **Find Company Product Development**
- **Find Company Marketing**
- **Find Company Sales**
- **Find Company Customer Service**
- **Find Company Operations**
- **Find Company Human Resources**
- **Find Company Information Technology**
- **Find Company Finance**
- **Find Company Legal**
- **Find Company Real Estate**
- **Find Company Supply Chain**
- **Find Company Manufacturing**
- **Find Company Distribution**
- **Find Company Logistics**
- **Find Company Quality Control**
- **Find Company Security**
- **Find Company Health and Safety**
- **Find Company Environmental Management**
- **Find Company Crisis Management**
- **Find Company Business Continuity**
- **Find Company Disaster Recovery**
- **Find Company Data Protection**
- **Find Company Privacy**
- **Find Company Intellectual Property**
- **Find Company Licensing**
- **Find Company Franchising**
- **Find Company Mergers and Acquisitions**
- **Find Company Joint Ventures**
- **Find Company Strategic Alliances**
- **Find Company Partnerships**
- **Find Company Investments**
- **Find Company Divestitures**
- **Find Company Restructuring**
- **Find Company Bankruptcy**
- **Find Company Liquidation**
- **Find Company Dissolution**

Use action names and parameters as needed.

## Working with Outscraper

This skill uses the Membrane CLI to interact with Outscraper. Membrane handles authentication and credentials refresh automatically — so you can focus on the integration logic rather than auth plumbing.

### Install the CLI

Install the Membrane CLI so you can run `membrane` from the terminal:

```bash
npm install -g @membranehq/cli@latest
```

### Authentication

```bash
membrane login --tenant --clientName=<agentType>
```

This will either open a browser for authentication or print an authorization URL to the console, depending on whether interactive mode is available.

**Headless environments:** The command will print an authorization URL. Ask the user to open it in a browser. When they see a code after completing login, finish with:

```bash
membrane login complete <code>
```

Add `--json` to any command for machine-readable JSON output.

**Agent Types** : claude, openclaw, codex, warp, windsurf, etc. Those will be used to adjust tooling to be used best with your harness

### Connecting to Outscraper

Use `membrane connection ensure` to find or create a connection by app URL or domain:

```bash
membrane connection ensure "https://outscraper.com/" --json
```
The user completes authentication in the browser. The output contains the new connection id.

This is the fastest way to get a connection. The URL is normalized to a domain and matched against known apps. If no app is found, one is created and a connector is built automatically.

If the returned connection has `state: "READY"`, skip to **Step 2**.

#### 1b. Wait for the connection to be ready

If the connection is in `BUILDING` state, poll until it's ready:

```bash
npx @membranehq/cli connection get <id> --wait --json
```

The `--wait` flag long-polls (up to `--timeout` seconds, default 30) until the state changes. Keep polling until `state` is no longer `BUILDING`.

The resulting state tells you what to do next:

- **`READY`** — connection is fully set up. Skip to **Step 2**.
- **`CLIENT_ACTION_REQUIRED`** — the user or agent needs to do something. The `clientAction` object describes the required action:
  - `clientAction.type` — the kind of action needed:
    - `"connect"` — user needs to authenticate (OAuth, API key, etc.). This covers initial authentication and re-authentication for disconnected connections.
    - `"provide-input"` — more information is needed (e.g. which app to connect to).
  - `clientAction.description` — human-readable explanation of what's needed.
  - `clientAction.uiUrl` (optional) — URL to a pre-built UI where the user can complete the action. Show this to the user when present.
  - `clientAction.agentInstructions` (optional) — instructions for the AI agent on how to proceed programmatically.

  After the user completes the action (e.g. authenticates in the browser), poll again with `membrane connection get <id> --json` to check if the state moved to `READY`.

- **`CONFIGURATION_ERROR`** or **`SETUP_FAILED`** — something went wrong. Check the `error` field for details.

### Searching for actions

Search using a natural language description of what you want to do:

```bash
membrane action list --connectionId=CONNECTION_ID --intent "QUERY" --limit 10 --json
```

You should always search for actions in the context of a specific connection.

Each result includes `id`, `name`, `description`, `inputSchema`