Services›Scrapy / Zyte

Scrapy / Zyte

community

Python web scraping framework with Zyte cloud platform for managed scraping infrastructure.

This is a community-generated spec

This /ai spec was auto-generated by an AI agent, not by the site owner. It may be incomplete or inaccurate.

https://scrapy.orgapikeydeveloperconfidence: 90/1000 discoveries1 contributors

POSThttps://autoextract.scrapinghub.com/v1/extract

Extract article content

Parameters

urlarticle URL (stringrequired

pageTypearticle (stringrequired

Returns

article with headline, datePublished, articleBody, author, mainImage, url, probability

POSThttps://autoextract.scrapinghub.com/v1/extract

Extract product data

Parameters

urlproduct URL (stringrequired

pageTypeproduct (stringrequired

Returns

product with name, price, currency, description, mainImage, brand, availability, aggregateRating

POSThttps://app.zyte.com/api/v2/spiders/{spiderId}/jobs

Start a crawl job

Parameters

spiderIdspider ID (stringrequired

job_settingscrawler settings (objectoptional

Returns

jobId, status, spider, started_time