> ## Documentation Index
> Fetch the complete documentation index at: https://docs.crewai.com/llms.txt
> Use this file to discover all available pages before exploring further.

# Overview

> Extract data from websites and automate browser interactions with powerful scraping tools

These tools enable your agents to interact with the web, extract data from websites, and automate browser-based tasks. From simple web scraping to complex browser automation, these tools cover all your web interaction needs.

## **Available Tools**

> **[Scrape Website Tool](https://docs.crewai.com/en/tools/web-scraping/scrapewebsitetool.md)**
>
> General-purpose web scraping tool for extracting content from any website.

> **[Scrape Element Tool](https://docs.crewai.com/en/tools/web-scraping/scrapeelementfromwebsitetool.md)**
>
> Target specific elements on web pages with precision scraping capabilities.

> **[Firecrawl Crawl Tool](https://docs.crewai.com/en/tools/web-scraping/firecrawlcrawlwebsitetool.md)**
>
> Crawl entire websites systematically with Firecrawl's powerful engine.

> **[Firecrawl Scrape Tool](https://docs.crewai.com/en/tools/web-scraping/firecrawlscrapewebsitetool.md)**
>
> High-performance web scraping with Firecrawl's advanced capabilities.

> **[Firecrawl Search Tool](https://docs.crewai.com/en/tools/web-scraping/firecrawlsearchtool)**
>
> Search and extract specific content using Firecrawl's search features.

> **[Selenium Scraping Tool](https://docs.crewai.com/en/tools/web-scraping/seleniumscrapingtool.md)**
>
> Browser automation and scraping with Selenium WebDriver capabilities.

> **[ScrapFly Tool](https://docs.crewai.com/en/tools/web-scraping/scrapflyscrapetool.md)**
>
> Professional web scraping with ScrapFly's premium scraping service.

> **[ScrapGraph Tool](https://docs.crewai.com/en/tools/web-scraping/scrapegraphscrapetool.md)**
>
> Graph-based web scraping for complex data relationships.

> **[Spider Tool](https://docs.crewai.com/en/tools/web-scraping/spidertool.md)**
>
> Comprehensive web crawling and data extraction capabilities.

> **[BrowserBase Tool](https://docs.crewai.com/en/tools/web-scraping/browserbaseloadtool.md)**
>
> Cloud-based browser automation with BrowserBase infrastructure.

> **[HyperBrowser Tool](https://docs.crewai.com/en/tools/web-scraping/hyperbrowserloadtool.md)**
>
> Fast browser interactions with HyperBrowser's optimized engine.

> **[Stagehand Tool](https://docs.crewai.com/en/tools/web-scraping/stagehandtool.md)**
>
> Intelligent browser automation with natural language commands.

> **[Oxylabs Scraper Tool](https://docs.crewai.com/en/tools/web-scraping/oxylabsscraperstool.md)**
>
> Access web data at scale with Oxylabs.

> **[Bright Data Tools](https://docs.crewai.com/en/tools/web-scraping/brightdata-tools.md)**
>
> SERP search, Web Unlocker, and Dataset API integrations.

## **Common Use Cases**

* **Data Extraction**: Scrape product information, prices, and reviews
* **Content Monitoring**: Track changes on websites and news sources
* **Lead Generation**: Extract contact information and business data
* **Market Research**: Gather competitive intelligence and market data
* **Testing & QA**: Automate browser testing and validation workflows
* **Social Media**: Extract posts, comments, and social media analytics

## **Quick Start Example**

```python theme={null}
from crewai_tools import ScrapeWebsiteTool, FirecrawlScrapeWebsiteTool, SeleniumScrapingTool

# Create scraping tools
simple_scraper = ScrapeWebsiteTool()
advanced_scraper = FirecrawlScrapeWebsiteTool()
browser_automation = SeleniumScrapingTool()

# Add to your agent
agent = Agent(
    role="Web Research Specialist",
    tools=[simple_scraper, advanced_scraper, browser_automation],
    goal="Extract and analyze web data efficiently"
)
```

## **Scraping Best Practices**

* **Respect robots.txt**: Always check and follow website scraping policies
* **Rate Limiting**: Implement delays between requests to avoid overwhelming servers
* **User Agents**: Use appropriate user agent strings to identify your bot
* **Legal Compliance**: Ensure your scraping activities comply with terms of service
* **Error Handling**: Implement robust error handling for network issues and blocked requests
* **Data Quality**: Validate and clean extracted data before processing

## **Tool Selection Guide**

* **Simple Tasks**: Use `ScrapeWebsiteTool` for basic content extraction
* **JavaScript-Heavy Sites**: Use `SeleniumScrapingTool` for dynamic content
* **Scale & Performance**: Use `FirecrawlScrapeWebsiteTool` for high-volume scraping
* **Cloud Infrastructure**: Use `BrowserBaseLoadTool` for scalable browser automation
* **Complex Workflows**: Use `StagehandTool` for intelligent browser interactions


This documentation is built and hosted on [Mintlify](https://mintlify.com), a developer documentation platform.