Reliability improvements and cleanup #5

Merged
kacerr merged 2 commits from improve/reliability-and-fixes into main 2026-02-27 10:26:04 +00:00
Owner

Summary

  • Retry logic, validation, and ratings sync improvements
  • Remove regen_map.py references from Dockerfile and README (file was intentionally deleted)

Test plan

  • Docker image builds without errors
  • Scrapers run with retry logic on failure
  • Ratings sync correctly
## Summary - Retry logic, validation, and ratings sync improvements - Remove `regen_map.py` references from Dockerfile and README (file was intentionally deleted) ## Test plan - [ ] Docker image builds without errors - [ ] Scrapers run with retry logic on failure - [ ] Ratings sync correctly
kacerr added 2 commits 2026-02-27 10:25:33 +00:00
Reliability improvements: retry logic, validation, ratings sync
Some checks failed
Build and Push / build (push) Failing after 4s
27a7834eb6
- Add 3-attempt retry with exponential backoff to Sreality, Realingo,
  Bezrealitky, and PSN scrapers (CityHome and iDNES already had it)
- Add shared validate_listing() in scraper_stats.py; all 6 scrapers now
  validate GPS bounds, price, area, and required fields before output
- Wire ratings to server /api/ratings on page load (merge with
  localStorage) and save (async POST); ratings now persist across
  browsers and devices
- Namespace JS hash IDs as {source}_{id} to prevent rating collisions
  between listings from different portals with the same numeric ID
- Replace manual Czech diacritic table with unicodedata.normalize()
  in merge_and_map.py for correct deduplication of all edge cases
- Correct README schedule docs: every 4 hours, not twice daily

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
Remove regen_map.py references from Dockerfile and README
All checks were successful
Build and Push / build (push) Successful in 6s
fd3991f8d6
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
kacerr merged commit 39e4b9ce2a into main 2026-02-27 10:26:04 +00:00
Sign in to join this conversation.
No Reviewers
No Label
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: littlemeat/maru-hleda-byt#5