1
0 Comments

Use Proxy Server for Web Scraping

https://www.octoparse.com/blog/proxy-server-for-web-scraping/?indie=
Web scraping has become a popular way for collecting web data. However, some website owners are fighting back web scraping through limiting the access rate of any single IP. To reduce the chances of getting blocked, we should try to avoid scraping a website with a single IP address. In this article, we will introduce what is a proxy server and some popular web scrapers that have IP proxy features.

posted to
Webscraping
on April 1, 2022
Trending on Indie Hackers
I've built a 2300$ a month SaaS out of a simple problem. 19 comments 🔥 Roast My Landing Page 12 comments Where can I buy newsletter ad promos? 8 comments Key takeaways growing MRR from $6.5k to $20k for my design studio 6 comments How would you monetize my project colorsandfonts? 5 comments YouTube? How to start 5 comments