Social Intel

People Research

Scrape LinkedIn profiles, company pages, and posts for prospect research.

linkedinsocialscrapingcompany-research

Overview

Social Intel scrapes LinkedIn to extract detailed profile information, company data, and recent posts. Unlike simple profile finders, it returns rich structured data — work history, education, skills, company size, industry, and post engagement metrics. It uses a headless browser with your LinkedIn session to access the same data you would see while browsing LinkedIn, and structures it for use in sales workflows like prospect research, account mapping, and engagement tracking.

Currently macOS only. Windows and Linux support coming soon.

Use Cases

Research a Decision-Maker Before Outreach

You are about to send a cold email to the VP of Sales at a target account. Before writing the email, you use Social Intel to scrape their LinkedIn profile. The tool returns their full work history, showing they joined the company 8 months ago from a competitor, their headline emphasizes "scaling outbound," and they recently posted about hiring SDRs.

Expected outcome: A structured profile with work history, headline, and recent activity — enabling your rep to write a personalized email referencing their transition from the competitor and their current focus on scaling the outbound team.

Map Key Stakeholders at a Target Account

You have identified a target account and need to understand the organizational structure. You use Social Intel to scrape the company page for overview data, then scrape individual profiles of the leadership team. The tool returns titles, reporting lines (inferred from seniority), and tenure at the company.

Expected outcome: A stakeholder map showing the CRO, VP Sales, VP Marketing, and Head of Revenue Operations — with tenure, background, and current focus areas for each. Your AE can plan a multi-threaded outreach strategy.

Track Competitor Activity Through LinkedIn Posts

You want to monitor what a competitor is talking about on LinkedIn to stay ahead of their messaging. You scrape their company posts and analyze engagement metrics. Posts about a new product launch have 10x the usual engagement, signaling market interest.

Expected outcome: A feed of recent LinkedIn posts with engagement data (reactions, comments, reposts), allowing your marketing team to identify trending topics and adjust competitive positioning.

Capabilities

●Scrapes individual LinkedIn profiles with full work history, education, and skills
●Extracts company page data including industry, size, headquarters, and specialties
●Retrieves recent company posts with engagement metrics (reactions, comments, reposts)
●Uses a headless browser to render JavaScript-heavy LinkedIn pages accurately
●Returns structured JSON output ready for CRM enrichment or research workflows
●Handles LinkedIn's dynamic content loading and infinite scroll patterns
●No third-party API key required — uses your own LinkedIn session

Data Sources

Source	What’s Extracted
LinkedIn Profiles	Professional profiles with work history, education, and skills
LinkedIn Company Pages	Company information, size, industry, and overview
LinkedIn Posts	Recent company posts with engagement metrics

Tools

Scrapes a LinkedIn profile and returns structured data including name, headline, current and past positions, education, skills, and location.

Parameters

Name	Type	Required	Description
`linkedin_url`	string	Yes	Full LinkedIn profile URL (e.g., https://linkedin.com/in/username)

Response Fields

name
headline
location
about
experience (title, company, duration)
education
skills

Dependencies

●macOS (Windows and Linux support coming soon)
●Python 3.10+
●Chromium browser (installed automatically)
●Active LinkedIn account for session authentication
●No API keys required

Works With

After researching a company with Website Intel and Techstack Intel, use Social Intel to deep-dive into key contacts and company activity on LinkedIn. Chain with Review Intel to understand how their customers feel before reaching out.

Quick Setup

git clone https://github.com/ekas-io/open-sales-stack.git
cd open-sales-stack
./scripts/setup.sh

./scripts/add-to-claude.sh --social-intel

See full setup instructions on GitHub →

Frequently Asked Questions

Does Social Intel require a LinkedIn API key or Sales Navigator subscription?▾

No. Social Intel uses a headless browser with your regular LinkedIn session credentials. It accesses the same data you would see while browsing LinkedIn in your browser. No LinkedIn API key, Sales Navigator, or premium subscription is required.

Is scraping LinkedIn against their terms of service?▾

LinkedIn's terms of service restrict automated access. Social Intel is designed for individual research use, similar to manually browsing profiles. Users should be aware of LinkedIn's policies and use the tool responsibly. We recommend rate-limiting your requests and avoiding bulk scraping of large numbers of profiles in short timeframes.

How does Social Intel handle LinkedIn authentication?▾

During setup, you provide your LinkedIn session cookie. The headless browser uses this cookie to access LinkedIn as your authenticated session. The cookie is stored locally and never transmitted to any external service.

Can I scrape private profiles or profiles outside my network?▾

Social Intel can only access profiles and data that your LinkedIn account can see. If a profile is restricted or outside your network, the tool will return whatever data LinkedIn shows to your account — which may be limited depending on your connection level and LinkedIn plan.

What data is returned from a company page scrape?▾

A company page scrape returns the company name, description, industry, company size range, headquarters location, founding year, specialties, website URL, and follower count. It provides the same overview data visible on the LinkedIn company page.