crawlee-python
Visit crawlee-pythoncrawlee-python is a Python library for web scraping and browser automation, designed to build reliable crawlers. It facilitates extracting data for AI, LLMs,...
Boost your confidence score by at least 15%
SHYPD CONFIDENCE SCORE
PRICING
Explore more AI tools for Web Scraping & Automation→
Scrapling
Scrapling is an adaptive web scraping framework designed to handle web scraping tasks, from single requests to full-scale crawls. Its parser learns from websites, adapting to changes. It offers features like proxy rotation and a command-line interface.
parsera
parsera is a lightweight Python library for scraping websites using LLMs. It simplifies the process of extracting data from websites by leveraging the power of large language models. The library is designed to be simple and lightweight for easy integration.
scrapeghost
scrapeghost was an experimental library for scraping websites using OpenAI's GPT API. The project is no longer maintained or recommended by the author. It was designed to facilitate web scraping and data extraction using large language models.
crawlee
crawlee is a Node.js library for web scraping and browser automation. It helps build reliable crawlers to extract data for AI, LLMs, and GPTs. The tool supports downloading various file types and works with Puppeteer, Playwright, and Cheerio. Crawlee includes proxy rotation and both headful and headless modes.
autoscraper
Autoscraper is an automatic web scraping tool for Python. It can extract data such as text, URLs, and HTML tag values from web pages. The tool learns scraping rules from sample data provided by the user and then retrieves similar elements from the web page.
crawl4ai
crawl4ai is an open-source web crawler and scraper designed to be LLM-friendly. It allows users to extract data from websites for various AI applications. The tool is available on GitHub and encourages community contributions.
scrapecraft
Scrapecraft is an AI-powered web scraping editor that allows users to build, test, and deploy web scrapers using natural language. It features a visual workflow builder and is powered by ScrapeGraphAI and LangGraph. The tool is designed to simplify the process of creating web scraping pipelines with AI assistance.
pic-gather
pic-gather is an open-source image collector compatible with Windows and MacOS. It supports custom acquisition sources for gathering images. The tool is designed for developers and researchers needing automated image collection. It is available on GitHub.
Scrapegraph-ai
Scrapegraph-ai is a Python-based AI web scraper. It allows users to extract data from websites using AI. The tool is open-source and available on GitHub.
Explore more Coding & Development tools→
Build and Ship
Build and Ship is a deployment platform that allows users to deploy applications with a single command. It supports over 15 frameworks and offers zero-downtime blue-green deployments. The platform integrates with CI/CD and deploys applications to the user's own hardware. It aims to provide a Vercel-like experience without the associated costs.
GrammarPeace - The $0 Grammarly Killer
GrammarPeace is a free, open-source AI grammar checker and translator. It is a Chrome extension that checks grammar, rewrites tone, and translates over 15 languages. Users can bring their own API key for models like Claude, GPT, and Groq. GrammarPeace does not collect data, ensuring user privacy.
Kagura AI
Kagura AI is an AI-powered testing tool designed for modern development teams. It generates, executes, and evolves QA tests automatically from a URL and a description of what to test. Kagura AI adapts to UI changes, allowing users to pause mid-test to interact, eliminating scripting and maintenance.
HookWatch
HookWatch is a unified monitoring platform for webhooks, cron jobs, and AI agent tools. It provides real-time dashboards, smart alerts, and automatic retries. The service monitors webhook endpoints 24/7 and alerts users instantly when issues arise. HookWatch aims to provide reliable monitoring without enterprise complexity.
ScrollGuard for iOS
ScrollGuard for iOS is an app designed to limit endless scrolling on social media platforms. It helps users block distractions from Instagram Reels, YouTube Shorts, and TikTok. ScrollGuard aims to help users maintain social connections while reducing time spent on algorithm-driven content. It is free to download with core blocking features available without payment.
Screen Url
ScreenURL is a screenshot API for developers to capture website screenshots with a single API call. It provides pixel-perfect screenshots in milliseconds. It is suitable for social media previews, automated testing, website monitoring, and content aggregation. A free tier is available.