Shifter Documentation
  • Getting Started
  • PROXIES
    • Rotating Residential Proxies
    • Static Residential Proxies
  • SCRAPING API
    • Web Scraping API
      • API Request
      • Basic Request
      • Rendering JavaScript
      • Custom Headers
      • Custom Cookies
      • Proxies
      • Geolocation
      • Sessions
      • Forcing Timeouts
      • Binary Files
      • Waiting for CSS
      • Screenshot
      • Extraction Rules
      • JSON Auto Parser
      • Javascript Instructions
      • Disable Stealth
      • POST Requests
      • PUT Requests
      • Conclusion
      • API Errors
  • Google SERP API
    • Search APIs
      • Google Search API
      • Google Product API
      • Google Scholar Cite API
      • Google Scholar Author API
      • Google Scholar Profiles API
      • Google Scholar API
      • Google Autocomplete API
      • Google Maps Photos API
      • Google Maps Reviews API
      • Google Reverse Image API
      • Google Events API
      • Google Finance API
      • Google Play API
      • Google Jobs API
      • Google Local Services API
      • Google Jobs Listing API
      • Google Maps API
      • Google Trends API
        • Google Trends Categories List
        • Geo Parameter Options List
    • API Response
  • Bing SERP API
    • Search API
    • API Parameters
    • Basic API Requests
  • Yandex SERP API
    • Search API
    • Basic API Requests
    • API Parameters
  • Amazon API
    • Getting Started
      • API Parameters
      • Access the API
      • Supported Domains
    • Amazon Search
    • Amazon Seller Products
    • Amazon Seller Profile
    • Amazon Seller Feedback
    • Amazon Product
    • Amazon Category
    • Amazon Bestsellers
    • Amazon Deals
  • Useful Links
    • Github
    • Shifter Homepage
    • Knowledge Base
Powered by GitBook
On this page
  • Getting Started
  • Proxies
  • A quick intro to residential proxies
  • Scraping APIs
  • Web Scraping API
  • SERP API

Was this helpful?

Getting Started

NextRotating Residential Proxies

Last updated 1 year ago

Was this helpful?

Getting Started

Shifter is the ultimate data toolkit for data collection, we support innovative companies, startups, and entrepreneurs with groundbreaking technology that enables them to collect, structure, and use data flawlessly.

Let’s dig into our product suite and see how each product fits into your data collection process

Proxies

A proxy server acts as a gateway between you and the internet. It’s an intermediary server separating end users from the websites they browse. Proxy servers provide varying levels of functionality, security, and privacy depending on your use case, needs, or company policy.

A quick intro to residential proxies

A residential proxy is an intermediary that uses an IP address provided by an Internet Service Provider (ISP), unlike data center proxies that are assigned to a fixed location with the internet provider classified as a data center and can be easily detected.

Residential proxies are assigned by default a physical address and belong to real devices (mobile, desktop, tablet) enabling you to mimic real user behavior when scraping data, thus achieving the highest success rates.

Rotating Residential Proxies

A rotating residential proxy is a type of proxy server that assigns a new residential IP address every IP rotation time, it can be on every connection attempt or at a predetermined rotation time, for example, every 5 minutes.

Rotating residential proxies is ideal for running large-scale scraping operations by concurrently distributing your requests through millions of IP addresses for the best results.

Our rotating residential proxies can be configured from the client or via API, you can read the full documentation .

Static Residential Proxies

Static residential proxies are by nature data center IPs but with a catch, they are assigned to an Internet Service Provider (ISP) - making them share the same profile and details as residential proxies.

In essence, they are a hybrid, offering the anonymity and specifications of residential proxies together with the speed and stability of data center proxies.

Also, one important factor to take into account is the fact that static residential proxies maintain the same IP address 24/7 and can be accessed at any time (without IP rotation).

Scraping APIs

Web Scraping API

Web Scraping API is a REST API that uses the Shifter residential proxy infrastructure together with advanced anti-bot detection measures to extract HTML from any web page.

Shifter's Web Scraping API handles by default proxy rotation, geotargeting, headless browsers, JavaScript rendering, and automatic CAPTCHA solving to provide a seamless flow to extract HTML data.

SERP API

Shifter's SERP API is a best-in-class REST API for extracting real-time data from search engines in structured formats including JSON, HTML, and CSV.

The API handles by default proxy rotation, geotargeting, headless browsers, JavaScript rendering, CAPTCHA solving, and automatic retries.

  • desktop

  • tablet

  • mobile

SERP API Google

Extract formatted search engine results pages from all Google services including:

  • Google Search

  • Google Maps

  • Google Jobs

  • Google Trends

  • Google Autocomplete

  • Google Related Questions

  • Google Scholar

  • Google Play Store

  • Google Product

  • Google Recipes

  • Google Reverse Image

  • Google Events

  • Google Local Services

  • Google News

  • Google Sports

Our API comes with multiple features to accommodate the most complex use cases, we highly recommend reading our full documentation:

Extract formatted search engine results pages from the Bing search engine.

Extract formatted search engine results pages from the Yandex search engine.

Our static residential proxies can be configured from the client or via API, you can read the full documentation .

Our API comes with multiple features to accommodate the most complex use cases, we highly recommend reading our full documentation .

Our SERP API is capable of handling millions of requests per minute due to the distributed architecture hosted on the and also can extract data rendered using multiple devices:

For the most accurate results with geolocation, we have created the , an API that you can call to get the full list of locations you use in your queries.

⬇️
dashboard
here
dashboard
here
here
Shifter Cloud
SERP Google API
SERP Bing API
SERP Yandex API
SERP Locations API
SERP API Bing
SERP API Yandex