5
3 Comments

Anyone used Puppeteer for Web Scraping? Whats your coolest project?

by Bryce Davies

I've recently started using Puppeteer and Node.js for web scraping and am finding the power and flexibility you get with it amazing. Of course you need to write a bit of code but its very simple and the browser emulation you get with it is great for javascript heavy websites. I'm currently using it on some more difficult to scrape sites like social media etc.

Interested to hear if anyone else has experience and what you've used it for

posted to
Webscraping
 on September 9, 2021
Say something nice to brycedavies…
Post Comment
  1. 1

    I have never used Puppeteer, I always use Cheerio for web scraping, I will try it!

    GuillermoGoni
    ·
    2 years ago
    ·
    Reply
  2. 1

    I tried using Puppeteer for HTML to pdf conversion and but the thing was I had to use Nodejs with it so switched to Playwright which I can use with Python.

    sagunsh
    ·
    3 years ago
    ·
    Reply
  3. 1

    At @supermonitoring we use Puppeteer for page speed and transaction monitoring.

    konradcaban
    ·
    3 years ago
    ·
    Reply
Trending on Indie Hackers
Passed $7k 💵 in a month with my boring directory of job boards 39 comments Reaching $100k MRR Organically in 12 months 32 comments 87.7% of entrepreneurs struggle with at least one mental health issue 14 comments How to Secure #1 on Product Hunt: DO’s and DON'Ts / Experience from PitchBob – AI Pitch Deck Generator & Founders Co-Pilot 11 comments Competing with a substitute? 📌 Here are 4 ad examples you can use [from TOP to BOTTOM of funnel] 10 comments Are you wondering how to gain subscribers to a founder's X account from scratch? 9 comments