Connect Web Scrapper to Redshift
Send Web Scrapper users, sitemap lists, scraping jobs and 2 more data types to Redshift on a schedule. Refresh as often as every 15 minutes.
web_scrapper
userssitemap_listsscraping_jobsscraping_job_data_qualitiessitemap_details
How to connect Web Scrapper and Redshift
4 steps. You can preview the Web Scrapper data in Coupler.io before anything reaches Redshift.
Step 1 of 4
Connect Web Scrapper
Enter your Web Scrapper API token. You only do this once per account.
Step 2 of 4
Choose what to export
Pick the Web Scrapper data you want in Redshift.
Step 3 of 4
Connect Redshift
Enter your Redshift connection details, then the schema and table for the Web Scrapper data.
Show 3 more fields Show fewer fields
Step 4 of 4
Choose a write mode and schedule
Every run either replaces or appends the data in Redshift. Run it as often as every 15 minutes.
Each run drops and recreates users with fresh Web Scrapper data.
Coupler.io made it easy to create dashboards and reports from different data sources. The sync is reliable and the user experience is amazing.
Take your data analytics to the next level
Sign Up with Google
Sign Up with MICROSOFT
SIGN UP WITH EMAIL
By signing up to Coupler.io, you agree to our Privacy Policy and Terms of Use.
Build your Web Scrapper integrations with these destinations
Get the most of Web Scrapper to Redshift integration
Gather data
Understand data
Automate data
Act on data
5 data types, including Users, Sitemap lists, Scraping jobs, Scraping job data qualities and Sitemap details.
With your Web Scrapper API token, entered once when you add the connection.
Yes, if the database user has CREATE privileges. Coupler.io creates the web_scrapper schema and the users table on the first run.
With Replace, Coupler.io recreates users, so new Web Scrapper columns appear automatically. With Append, the table keeps its schema, so add the column yourself or switch to Replace.
On a schedule you choose, from monthly down to every 15 minutes, depending on your Coupler.io plan.
Yes. Add more sources to the same data flow, for example 100ms or Amazon Seller Central, and join or append them before the data reaches Redshift.