Forem

# webscraping

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Building a Lightning-Fast NSE Stock Data Scraper: From API Calls to Full-Stack Web App

Building a Lightning-Fast NSE Stock Data Scraper: From API Calls to Full-Stack Web App

Comments
6 min read
Automated Web Scraping: Building Smarter Data Pipelines Without Manual Effort
Cover image for Automated Web Scraping: Building Smarter Data Pipelines Without Manual Effort

Automated Web Scraping: Building Smarter Data Pipelines Without Manual Effort

Comments
4 min read
Scraping JavaScript-Rendered Web Pages with Python

Scraping JavaScript-Rendered Web Pages with Python

Comments
5 min read
One Workflow to Scrape ANY Job Board or Career Page of any company

n8n and Bright Challenge: Unstoppable Workflow

One Workflow to Scrape ANY Job Board or Career Page of any company

6
Comments 2
2 min read
Simple Auto Login Bot
Cover image for Simple Auto Login Bot

Simple Auto Login Bot

11
Comments 2
2 min read
Crafting a Monster Hunter Wilds AI Assistant: Scrapy, Vector Search & Prompt Engineering
Cover image for Crafting a Monster Hunter Wilds AI Assistant: Scrapy, Vector Search & Prompt Engineering

Crafting a Monster Hunter Wilds AI Assistant: Scrapy, Vector Search & Prompt Engineering

Comments
8 min read
Aura – Like robots.txt, but for AI actions
Cover image for Aura – Like robots.txt, but for AI actions

Aura – Like robots.txt, but for AI actions

1
Comments
9 min read
Scrape YouTube videos in Python
Cover image for Scrape YouTube videos in Python

Scrape YouTube videos in Python

Comments
2 min read
Best SERP APIs for Developers in 2025

Best SERP APIs for Developers in 2025

1
Comments
3 min read
5 Things You Should Know About SafeLine WAF

5 Things You Should Know About SafeLine WAF

5
Comments
2 min read
Building a Discord Controlled Web Scraper with Scrapy & Zyte API
Cover image for Building a Discord Controlled Web Scraper with Scrapy & Zyte API

Building a Discord Controlled Web Scraper with Scrapy & Zyte API

Comments 1
12 min read
How to Vibe Code a Web Scraper for Non-Coders
Cover image for How to Vibe Code a Web Scraper for Non-Coders

How to Vibe Code a Web Scraper for Non-Coders

1
Comments
3 min read
How to Extract YouTube Video Details Using Puppeteer

How to Extract YouTube Video Details Using Puppeteer

Comments
7 min read
How to Extract YouTube Shorts Video Details Using Puppeteer

How to Extract YouTube Shorts Video Details Using Puppeteer

Comments
7 min read
What if every time your content made an AI smarter—or more profitable—you got paid?
Cover image for What if every time your content made an AI smarter—or more profitable—you got paid?

What if every time your content made an AI smarter—or more profitable—you got paid?

Comments
1 min read
Automating my University's STS Course & Lecturer Evaluation Process with Python + Selenium
Cover image for Automating my University's STS Course & Lecturer Evaluation Process with Python + Selenium

Automating my University's STS Course & Lecturer Evaluation Process with Python + Selenium

Comments 3
1 min read
Robots are not that bad
Cover image for Robots are not that bad

Robots are not that bad

1
Comments
2 min read
Benchmarking LLM Search APIs: Tavily vs Web Search Plus vs OpenAI Web Search
Cover image for Benchmarking LLM Search APIs: Tavily vs Web Search Plus vs OpenAI Web Search

Benchmarking LLM Search APIs: Tavily vs Web Search Plus vs OpenAI Web Search

Comments
4 min read
Transformando Trabalho em Conteúdo: Gerando Pautas para Lives com Python, RSS e Reddit
Cover image for Transformando Trabalho em Conteúdo: Gerando Pautas para Lives com Python, RSS e Reddit

Transformando Trabalho em Conteúdo: Gerando Pautas para Lives com Python, RSS e Reddit

Comments
4 min read
HasData vs Oxylabs vs ScrapingBee: Cost, Reliability & Output Quality

HasData vs Oxylabs vs ScrapingBee: Cost, Reliability & Output Quality

1
Comments
2 min read
🕵️‍♂️ Social Media First Post Finder
Cover image for 🕵️‍♂️ Social Media First Post Finder

🕵️‍♂️ Social Media First Post Finder

Comments
1 min read
🔎 CloakDetect: Revealing the Hidden Side of the Web
Cover image for 🔎 CloakDetect: Revealing the Hidden Side of the Web

🔎 CloakDetect: Revealing the Hidden Side of the Web

1
Comments
1 min read
Building a Production-Ready Apple Store Reviews Scraper with Python & Scrapy
Cover image for Building a Production-Ready Apple Store Reviews Scraper with Python & Scrapy

Building a Production-Ready Apple Store Reviews Scraper with Python & Scrapy

Comments
7 min read
Scylla: A Proxy Pool Solution for Web Scraping

Scylla: A Proxy Pool Solution for Web Scraping

Comments
1 min read
G2.com Scraping: Handling Anti-Bot Measures with Scrapy
Cover image for G2.com Scraping: Handling Anti-Bot Measures with Scrapy

G2.com Scraping: Handling Anti-Bot Measures with Scrapy

Comments
4 min read
loading...