UseScraper

UseScraper - Web Crawler & Scraper API is a fast, scalable toolset designed to extract and crawl web content. It can fetch single pages or crawl entire websites, render JavaScript content, and export results as HTML, plain text, or Markdown for AI consumption. It supports multi-site crawling, URL-based filtering, webhook notifications, data storage, and auto-expiring data. The service emphasizes speed, reliability, and ease of integration via API or dashboard UI. First 1,000 pages are free, with tiered pricing for larger workloads.

---

How to Use UseScraper

1. Sign up and create a crawl job. Choose the target URL or multiple sites and configure options.
2. Configure output format. Select HTML, plain text, or Markdown as the export format.
3. Set crawl preferences. Use options like multi-site crawling, page exclusions, and CSS-based element exclusions to tailor results.
4. Run the crawl. Start the job and monitor status via webhook or dashboard.
5. Retrieve results. Access crawled data from the data store via API or export it directly.

---

Output Formats

• Markdown
• Plain text
• HTML

---

Features and Capabilities

• Fast page-level scraping and site-wide crawling
• JavaScript rendering with a real Chrome browser
• Output as Markdown, plain text, or HTML
• Automatic proxies to prevent rate limiting (Coming Soon)
• Multi-site crawling in a single job
• Page exclusion with glob patterns
• CSS selector-based exclusion of repetitive content
• Webhook updates for crawl status and completion
• Data store for crawl results with API access
• Auto-expire data for saved results
• Pay-as-you-go pricing, with first 1,000 pages free

---

Plans and Pricing (Key Points)

• Free tier: first 1,000 pages per month
• Pro: $1 per 1,000 pages, unlimited concurrent jobs, advanced proxies, crawl unlimited pages, priority support (Coming Soon)
• Flexible data storage and API access

---

Safety and Best Practices

• Ensure you have permission to crawl and extract data from target sites
• Respect robots.txt and rate limits to avoid disruption
• Properly handle any sensitive or copyrighted content

---

Core Features

• Fast single-page and site-wide crawling
• JavaScript rendering via real Chrome browser
• Output formats: Markdown, plain text, HTML
• Multi-site crawl capability
• Exclude pages and site elements with glob patterns and CSS selectors
• Webhook notifications for crawl status and completion
• Data store access via API
• Auto-expiration for stored crawl data
• Pay-as-you-go pricing with free initial credits