Özgür Işık Damar
Web & Desktop

Product Price & Stock Crawler Platform

A distributed crawler infrastructure pulling product, price and stock data from multiple suppliers and marketplaces around the clock. Worker fleet, central endpoint manager, live heartbeat — 7.8M products and ~5M transactions tracked through one panel.

Stack

Distributed crawlersWorker fleetEndpoint ManagerHeartbeat monitoringReal-time statsNormalizationMulti-source

Every crawler worker on one panel — IP, current task, heartbeat and uptime live; a slow or crashed worker is restarted with one click.

1 / 1

Up next