Getting Started
An overview of Scrappey.com, an authorized browser-workflow proxy that returns rendered HTML and cookies through managed browser sessions.
Scrappey.com is an authorized browser-workflow proxy. It runs requests through managed browser sessions and returns rendered HTML and cookies, so you can work with the pages your application needs β including dynamic websites that require JavaScript rendering.
What is Scrappey
Scrappey.com makes it straightforward to collect web data through managed browser sessions. It acts as a proxy server: you send a request, and it returns the rendered HTML and the cookies set during the session. Those cookies can be reused with other HTTP clients to maintain session continuity with the same site. You can also script multi-step browser interactions through the browserActions API. It's well suited to workflows that demand high reliability and repeatability β QA, uptime and content monitoring, indexing your own content, ad verification, SEO analytics, and internal automation. Use it only where permitted and in compliance with each site's terms and applicable laws.
Features
Scrappey is a browser-automation engine that provides complete, consistent browser environments, helping you reliably access sites that require a real browser to render. Here's how it works:
Scrappey runs a full browser environment with realistic, configurable settings:
- It manages browser configuration β device type, browser, language, time zone, screen size, and related properties β so pages render as they would in a standard desktop or mobile browser.
- It supports realistic interaction primitives such as mouse movement, scrolling, and typing, so interactive pages and dynamically loaded content render and behave correctly.
Scrappey provides a standards-compliant browser environment:
- It runs your automation as a standard browser session, executing JavaScript and loading assets like a normal browser.
- It gives you control over browser configuration and privacy-related settings (WebGL, WebRTC, canvas, fonts, and more).
- It keeps browser settings internally consistent, which improves rendering consistency across sites.
Scrappey aligns the browser environment with your selected proxy region:
- It sets a consistent language, locale, and time zone to match the proxy.
- It matches browser settings to your configured proxy region, so regional testing and localized content render correctly.
Additional capabilities:
- Generate consistent, unique device profiles that persist across requests (see Profiles)
- Run full browser environments on headless servers
- Control WebGL, image loading, WebRTC, and other browser-level settings
In short, Scrappey helps you collect data, run QA and monitoring against your own or authorized sites, and automate browser tasks β with sessions that behave like an ordinary browser environment. Use it only where permitted and in line with applicable terms and laws.
Setup and Installation
- Sign up at Scrappey.
- Obtain your unique API key from your Scrappey dashboard.
- Integrate Scrappey into your projects via simple HTTP requests or SDKs provided.
Sending Requests
Sending requests through Scrappey.com is a straightforward process. You simply need to send a request to an endpoint, providing the URL, headers (optional), cookies (optional), and proxy (optional). Once you initiate the request, Scrappey handles browser execution, session state, proxy routing, and response collection.
To authenticate your requests, you'll need an API key, which you can obtain by visiting the Dashboard. This API key ensures that your requests are properly authorized and processed.
Not sure what to do? Check out our Request Builder.
Example Request
Example CURL