9 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Jan NovakandClaude Opus 4.6	a1212c6312	Tag Docker images with both git tag and latest ... Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> 0.01	2026-02-15 21:05:51 +01:00
Jan NovakandClaude Opus 4.6	0b95c847c4	Add first_seen/last_updated timestamps to track property freshness ... Each property record now carries two date fields: - first_seen: date the listing first appeared (preserved across runs) - last_updated: date of the most recent scrape that included it All 6 scrapers (Sreality, Realingo, Bezrealitky, iDNES, PSN, CityHome) set these fields during scraping. Cached results preserve first_seen and refresh last_updated. PSN and CityHome gain a load_previous() helper to track first_seen across runs (they lacked caching before). The merge script keeps the earliest first_seen and latest last_updated when deduplicating listings across sources. The HTML map now shows dates in popups ("Přidáno: DD.MM.YYYY"), displays a green "NOVÉ" badge on newly discovered listings, and adds a "Přidáno" dropdown filter (24h / 3 days / 7 days / 14 days) for spotting new ones. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>	2026-02-15 21:03:08 +01:00
3 people	c6089f0da9	Add Gitea Actions CI pipeline for Docker image builds ... Triggers on tag push or manual dispatch. Builds the image using build/Dockerfile and pushes to the Gitea container registry. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>	2026-02-14 22:40:23 +00:00
3 people	327688d9d2	Add comprehensive project documentation ... Cover the full pipeline (scrapers, merge, map generation), all 6 data sources with their parsing methods, filter criteria, CLI arguments, Docker setup, caching, rate limiting, and project structure. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>	2026-02-14 22:40:23 +00:00
3 people	09a853aa05	Add validation mode, structured logging, and CLI args to all scrapers ... - Replace print() with Python logging module across all 6 scrapers for configurable log levels (DEBUG/INFO/WARNING/ERROR) - Add --max-pages, --max-properties, and --log-level CLI arguments to each scraper via argparse for limiting scrape scope - Add validation Make targets (validation, validation-local, validation-local-debug) for quick test runs with limited data - Update run_all.sh to parse and forward CLI args to all scrapers - Update mapa_bytu.html with latest scrape results Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>	2026-02-14 22:40:23 +00:00
Jan Novakandkacerr	5207c48890	add docker build, makefile, and some more shit before we move forward	2026-02-14 22:40:23 +00:00
littlemeat	215b51aadb	Initial commit from Mac	2026-02-14 17:50:42 +01:00
littlemeat	846d0bd9f2	Upload files to "/" ... v1 scrapery	2026-02-13 16:11:28 +00:00
littlemeat	82d1f94104	v1	2026-02-13 16:10:14 +00:00