Scraper Admin Panel

Trigger full, uncapped scrapes that snapshot data into the database as static records. Scrapes run in small steps driven by this page, so keep this tab open until a run says DONE. If you close it, press Run again and it resumes where it stopped.

DA Commodity Prices (30 days)

Backfill the last 30 days of DA Daily Price Index PDFs and store every commodity row per day. Runs one day per request, repeated automatically.

Panlasang Pinoy Recipes (ALL)

Crawl every recipe index page and store every recipe — ingredients and step-by-step instructions included. Runs one index page per request, repeated automatically until the site is exhausted.

Panlasang Pinoy Structured Data (backfill)

Re-read every stored recipe's page for what the first crawl didn't keep: course, cuisine, yield, Panlasang Pinoy's own nutrition estimate and ingredient group headings (marinade, breading). Only reads recipes not read yet, about 40 seconds per request, repeated automatically.

PSA Monthly Retail Prices (NCR)

Import the Philippine Statistics Authority's monthly palengke prices for Metro Manila (OpenSTAT): seafood, offal and vegetables DA doesn't list. One request, about 20 seconds; also runs weekly on its own.

FNRI Nutrition Data (ALL)

Crawl the full FNRI Food Composition Table, following every pagination link. Runs one listing page per request, repeated automatically until done.

SM Markets Prices (ALL)

Crawl the full SM Markets (smmarkets.ph) catalog via its Magento GraphQL API and snapshot today's price for every product. Runs one category page per request, repeated automatically until done.