HasData

Python toolkit for web scraping product prices from e-commerce sites. Features locale-aware normalization, currency detection, anti-bot techniques, price drop alerts, and LLM extraction for complex layouts.

This repository provides minimal working examples for bypassing Cloudflare 1020 errors using Playwright in both Python and Node.js. The focus is on showing basic setups to load pages that are often protected by anti-bot measures, with step-by-step improvements like stealth plugins, proxy rotation, and human-like behaviors.

This repository provides practical examples of handling authentication in web scraping using both Python and Node.js. It covers multiple login techniques - from simple form submissions to handling cookies, sessions and CSRF tokens.

PHP script that checks where a domain ranks in Google for a keyword in a chosen location through the HasData Google SERP API. Each run appends the position with its date and a link to the saved SERP page to a CSV file, so a daily cron job builds a ranking history.

Collection of Python and Node.js scripts for scraping TikTok data, including profiles, videos, comments, and search results. Fully structured JSON outputs for further analysis or downloads.

Streamlit app that searches Google News through HasData's Google SERP API. Filter by time, language and region, page through the results in the browser and export them as JSON or CSV.

Streamlit app that turns a keyword and its filters (site, time range, excluded words, exact phrase, language and region) into a Google News RSS feed URL. It parses the feed into a table with title, link, date, source and description, and exports it to CSV, JSON or XLSX.

Streamlit app for the HasData Google News API. Pick one of nine Google News topics or paste your own topic, section, publication or story token, add a keyword query, set country, language and sort order, preview the results in a table and export them as JSON or CSV.

PHP web scraping examples, one runnable script per task. The scripts handle logins with a cookie jar, parse pages with XPath in Symfony DomCrawler, fetch in parallel with Guzzle Pool (10 URLs in 1.25s against 4.1s one by one), rotate proxies and headers, and save results to PostgreSQL, CSV or JSON.

Homebrew tap for the HasData CLI, a single binary that calls any HasData API from the terminal, including Google SERP, web scraping, Amazon, Zillow and Google Maps. Install it with brew tap HasData/hasdata, then brew install hasdata.