ShelfWatch US

Availability status changes far more frequently than price, so ShelfWatch US's scraping cadence and storage model needed to capture both current state and historical trend without the dataset becoming unmanageably large or stale. It aggregates product listings from major US retail stores, tracking pricing and availability in a single, continuously refreshed dataset, with resilient per-store scraper logic since major retailers differ enough in site structure that a one-size-fits-all scraper broke often.

Provided a reliable, regularly refreshed dataset of pricing and availability across multiple major US retailers for downstream analysis.