Built by Metorial, the integration platform for agentic AI.
Start a new web crawling session. Crawls accessible subpages of a website and converts them into structured markdown or JSON. Provide a single URL or multiple URLs from the same domain. Returns a session ID for tracking progress.
Retrieve extracted data from a Kadoa workflow. Supports pagination, sorting, and filtering with operators like EQUALS, CONTAINS, GREATER_THAN, etc. Can also retrieve data from a specific workflow run by providing a run ID.
Retrieve comprehensive details of a Kadoa workflow including its configuration, schema, run history, health status, and monitoring settings. Use this to inspect a workflow's full setup before running or modifying it.
Check crawl session status and retrieve crawled pages. Optionally fetch the content of a specific page in markdown or HTML format. Use this to monitor crawl progress and retrieve results.
Retrieve detected data changes from monitored workflows. Filter by workflow IDs, date range, and pagination. Each change includes the affected data, type of change (added, removed, changed), and field-level differences.
Search and retrieve Kadoa extraction workflows. Filter by state, run status, tags, or free-text search. Returns workflow summaries including name, URL, state, schedule, and record counts.
List available scraping countries and ISO codes. Use an ISO code when selecting a manual location for ad-hoc extraction.
Perform lifecycle actions on a Kadoa workflow: pause, resume, schedule, delete, or update metadata. Use this to change a workflow's name, URLs, schedule, tags, monitoring configuration, schema, or navigation settings.
Extract data from a single webpage instantly without creating a persistent workflow. Provide a URL and a schema ID (or use built-in modes like "html", "body", or "markdown" for raw content). Useful for one-off data needs or testing extraction configurations.
Execute a Kadoa extraction workflow immediately. Optionally pass variables for dynamic URL placeholders and a row limit. Returns the job ID for tracking the run.
Create a persistent extraction workflow from one or more URLs and natural-language instructions. Returns the workflow ID for inspecting, running, and retrieving its data.