Built a Yiwugo.com Scraper for Chinese Wholesale Market Data

[wfgsss]

Hey Crawlee community! 👋

I built and published a Yiwugo.com Scraper on the Apify Store that extracts product data from China's largest small commodity wholesale marketplace (义乌购).

What it does

Yiwugo.com is the online platform for the Yiwu International Trade Market — the world's largest wholesale market with 75,000+ shops. The scraper extracts:

• Product names, prices (min/max ranges), and units
• Supplier info (shop name, level, location)
• Product images and booth numbers
• Delivery promises and online order availability

Technical challenges solved

1. Anti-scraping measures: Yiwugo uses rate limiting and session validation. Solved with request queuing and automatic retry with backoff.
2. Chinese text encoding: Product data mixes Chinese characters with numbers and units. Built normalization logic to clean price formats like ¥2.50 - ¥8.00/件.
3. Dynamic content: Some product details load via AJAX. Used Crawlee's request interception to capture API responses directly.
4. Data standardization: Raw data has inconsistent formats across categories. Built a unified output schema with 15+ fields.

Links

• Apify Store: https://apify.com/jungle_intertwining/yiwugo-scraper
• Example repo: https://github.com/wfgsss/yiwugo-scraper-example (with price monitoring and supplier comparison scripts)
• Tutorial: https://dev.to/wfgsss/how-to-scrape-yiwugocom-for-wholesale-product-data-4hn

Use cases

• Price monitoring: ack wholesale price changes over time
• Supplier discovery: Find and compare suppliers by category
• Market research: Analyze product categories and pricing trends
• Lead generation: Build supplier contact databases

Would love to hear feedback from the community! If you're working with Chinese e-commerce data or wholesale platforms, happy to share what I learned.

---

Built with Crawlee + Apify Platform