Skip to main content

​
Bright Data Tools

This set of tools integrates Bright Data services for web extraction.

​
Installation

uv add crewai-tools requests aiohttp

​
Environment Variables

  • BRIGHT_DATA_API_KEY (required)
  • BRIGHT_DATA_ZONE (for SERP/Web Unlocker)
Create credentials at https://brightdata.com/ (sign up, then create an API token and zone). See their docs: https://developers.brightdata.com/

​
Included Tools

  • BrightDataSearchTool: SERP search (Google/Bing/Yandex) with geo/language/device options.
  • BrightDataWebUnlockerTool: Scrape pages with anti-bot bypass and rendering.
  • BrightDataDatasetTool: Run Dataset API jobs and fetch results.

​
Examples

Code
from crewai_tools import BrightDataSearchTool

tool = BrightDataSearchTool(
    query="CrewAI",
    country="us",
)

print(tool.run())

​
Web Unlocker

Code
from crewai_tools import BrightDataWebUnlockerTool

tool = BrightDataWebUnlockerTool(
    url="https://example.com",
    format="markdown",
)

print(tool.run(url="https://example.com"))

​
Dataset API

Code
from crewai_tools import BrightDataDatasetTool

tool = BrightDataDatasetTool(
    dataset_type="ecommerce",
    url="https://example.com/product",
)

print(tool.run())

​
Troubleshooting

  • 401/403: verify BRIGHT_DATA_API_KEY and BRIGHT_DATA_ZONE.
  • Empty/blocked content: enable rendering or try a different zone.

​
Example

Code
from crewai import Agent, Task, Crew
from crewai_tools import BrightDataSearchTool

tool = BrightDataSearchTool(
    query="CrewAI",
    country="us",
)

agent = Agent(
    role="Web Researcher",
    goal="Search with Bright Data",
    backstory="Finds reliable results",
    tools=[tool],
    verbose=True,
)

task = Task(
    description="Search for CrewAI and summarize top results",
    expected_output="Short summary with links",
    agent=agent,
)

crew = Crew(
    agents=[agent],
    tasks=[task],
    verbose=True,
)

result = crew.kickoff()