Bright Data
Search, Crawl and Scrape any site, at scale, without getting blocked
1.0.2Bright Data is a web data infrastructure provider. This toolkit enables Arcade agents to search, scrape, and extract structured data from any website at scale without encountering blocks.
Capabilities
- Web scraping: Fetch any public webpage and return its content as clean Markdown, suitable for LLM consumption or downstream processing.
- Search engine queries: Run searches against Google, Bing, or Yandex with control over result count, search type (web, images, etc.), and country targeting.
- Structured data extraction: Pull normalized, schema'd data from major platforms — Amazon (products, reviews), LinkedIn (people, companies), Instagram (profiles, posts, reels, comments), Facebook (posts, marketplace, reviews), X (posts), YouTube (videos), Zillow (listings), Booking.com (hotels), and ZoomInfo (companies) — via named feed types.
Secrets
This toolkit requires no OAuth flow; access is controlled entirely through Bright Data credentials configured as Arcade secrets.
BRIGHTDATA_API_KEY
Your Bright Data API key, used to authenticate all requests to Bright Data's services. To obtain it:
- Log in to the Bright Data control panel.
- Navigate to Account Settings → API Token.
- Generate or copy your existing API token.
This key must have permissions to access the proxy zones and datasets your agent will use. If your account uses role-based access, ensure the token is scoped to the relevant products (Scraping Browser, SERP API, Web Scraper API).
BRIGHTDATA_ZONE
A Bright Data zone name (also called a proxy zone), which identifies the specific proxy or scraping product configuration to route requests through. Zones are created and managed in the Bright Data control panel. Each zone can represent a datacenter proxy, residential proxy, SERP API endpoint, or Scraping Browser instance. Use the zone name exactly as it appears in your dashboard (e.g., serp_api, residential, or a custom name you defined).
For instructions on configuring secrets in Arcade, see the Arcade secrets guide. You can also manage secrets directly at https://api.arcade.dev/dashboard/auth/secrets.
Available tools(3)
| Tool name | Description | Secrets | |
|---|---|---|---|
Scrape a webpage and return content in Markdown format using Bright Data.
Examples:
scrape_as_markdown("https://example.com") -> "# Example Page
Content..."
scrape_as_markdown("https://news.ycombinator.com") -> "# Hacker News
..."
| 2 | ||
Search using Google, Bing, or Yandex with advanced parameters using Bright Data.
Examples:
search_engine("climate change") -> "# Search Results
## Climate Change - Wikipedia
..."
search_engine("Python tutorials", engine="bing", num_results=5) -> "# Bing Results
..."
search_engine("cats", search_type="images", country_code="us") -> "# Image Results
..."
| 2 | ||
Extract structured data from various websites like LinkedIn, Amazon, Instagram, etc.
NEVER MAKE UP LINKS. IF LINKS ARE NEEDED, FIND THEM WITH A WEB SEARCH FIRST.
Supported source types:
- amazon_product, amazon_product_reviews
- linkedin_person_profile, linkedin_company_profile
- zoominfo_company_profile
- instagram_profiles, instagram_posts, instagram_reels, instagram_comments
- facebook_posts, facebook_marketplace_listings, facebook_company_reviews
- x_posts
- zillow_properties_listing
- booking_hotel_listings
- youtube_videos
Examples:
web_data_feed("amazon_product", "https://amazon.com/dp/B08N5WRWNW")
-> "{"title": "Product Name", ...}"
web_data_feed("linkedin_person_profile", "https://linkedin.com/in/johndoe")
-> "{"name": "John Doe", ...}"
web_data_feed(
"facebook_company_reviews", "https://facebook.com/company", num_of_reviews=50
) -> "[{"review": "...", ...}]" | 1 |