Tips and tricks
Scraping options
Javascript rendering
If you need to scrape a page that requires you to render the javascript to load the data you need,
then we can fetch these pages using a headless browser.
To enable rendering, simply use render=true
API parameter.
Custom headers and cookies
Sometimes you might need to send custom headers or cookies to the website you want to scrape.
That might help you to keep a certain session, or increase the scraping success rate.
You can do so easily by using request_headers
and request_cookies
parameters.
API default settings
Coming soon!
Proxy geolocation
To ensure your requests come from a specific country, you can use the country
parameter.
We currently support these countries:
- United States (
country=us
) - Anywhere in the world - (
country=random
)
Country code must be specified in alpha2 format.