Overview
Social Analyzer supports advanced network configuration including proxy servers, custom HTTP headers, user-agent strings, and request timeouts. These settings are essential for avoiding rate limits, bypassing restrictions, and integrating with existing security infrastructure.Proxy Configuration
Setting Up a Proxy (Node.js)
In Node.js, the proxy is configured inmodules/helper.js:
Proxy Support (Python)
Python version uses therequests library with session-based connections. To configure a proxy, you’ll need to modify the session configuration:
HTTPS Proxy Agent
The Node.js implementation useshttps-proxy-agent for secure proxy connections:
User Agent Configuration
Default User Agents
Node.js:Custom User Agent (Python CLI)
Custom HTTP headers including User-Agent.
Custom User Agent (Node.js API)
Request Timeout Configuration
Timeout Settings (Python)
Delay in seconds between each request to avoid rate limiting.Default:
0 (no delay)Setting a timeout helps avoid rate limits and reduces the chance of being blocked by websites.
Connection Timeout (Node.js)
Node.js uses dynamic timeouts based on site configuration:Timeout in Slow Mode
For browser-based slow scanning, timeouts are configured per site:Custom Headers
Python Implementation
Custom HTTP headers as a JSON dictionary.
Node.js Implementation
Headers are configured inhelper.js and can be modified programmatically:
Logging Configuration
Enable detailed logging for debugging and analysis.
Custom directory for log files.
Disable output to screen (useful for automation).
SSL/TLS Configuration
Certificate Verification
Python implementation disables SSL verification by default for compatibility:Custom Certificate (Node.js)
The Node.js implementation supports custom certificate files:Complete Examples
Python with Proxy and Custom Headers
Node.js Web API Configuration
Avoiding Rate Limits
FAQ
Why do I need a proxy?
Why do I need a proxy?
Proxies are useful for:
- Avoiding IP bans: Distribute requests across multiple IP addresses
- Bypassing geo-restrictions: Access region-locked websites
- Corporate networks: Route traffic through required proxy servers
- Privacy: Hide your real IP address
What timeout value should I use?
What timeout value should I use?
Recommended timeout values:
- Fast searches: 1-2 seconds
- Avoiding rate limits: 2-3 seconds
- Conservative approach: 5+ seconds
Can I use SOCKS5 proxies?
Can I use SOCKS5 proxies?
Node.js implementation supports HTTPS proxies via
https-proxy-agent. For SOCKS5 support, you may need to use a SOCKS-to-HTTP proxy converter or modify the proxy agent configuration.How do I rotate user agents?
How do I rotate user agents?
For user agent rotation, you’ll need to:
- Create a script that runs Social Analyzer multiple times
- Change the
--headersparameter for each run - Use different user agent strings from a list
Are requests logged?
Are requests logged?
When
--logs is enabled, Social Analyzer creates detailed logs in the logs directory. Use --silent to suppress console output while still logging to files.See Also
- CLI Options - All available command-line options
- Website Selection - Filter websites by country, type, or popularity
- Integration Guide - Integrate Social Analyzer with other tools