littlemeat/maru-hleda-byt
1
1
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Reliability improvements and cleanup #5

Merged
kacerr merged 2 commits from improve/reliability-and-fixes into main 2026-02-27 11:26:04 +01:00
Conversation 0 Commits 2 Files Changed 10
+213 -120
kacerr commented 2026-02-27 11:25:33 +01:00
Owner
Copy Link
Copy Source

Summary

  • Retry logic, validation, and ratings sync improvements
  • Remove regen_map.py references from Dockerfile and README (file was intentionally deleted)

Test plan

  • Docker image builds without errors
  • Scrapers run with retry logic on failure
  • Ratings sync correctly
## Summary - Retry logic, validation, and ratings sync improvements - Remove `regen_map.py` references from Dockerfile and README (file was intentionally deleted) ## Test plan - [ ] Docker image builds without errors - [ ] Scrapers run with retry logic on failure - [ ] Ratings sync correctly
kacerr added 2 commits 2026-02-27 11:25:33 +01:00
Reliability improvements: retry logic, validation, ratings sync
Build and Push / build (push) Failing after 4s
Details
27a7834eb6 
- Add 3-attempt retry with exponential backoff to Sreality, Realingo,
  Bezrealitky, and PSN scrapers (CityHome and iDNES already had it)
- Add shared validate_listing() in scraper_stats.py; all 6 scrapers now
  validate GPS bounds, price, area, and required fields before output
- Wire ratings to server /api/ratings on page load (merge with
  localStorage) and save (async POST); ratings now persist across
  browsers and devices
- Namespace JS hash IDs as {source}_{id} to prevent rating collisions
  between listings from different portals with the same numeric ID
- Replace manual Czech diacritic table with unicodedata.normalize()
  in merge_and_map.py for correct deduplication of all edge cases
- Correct README schedule docs: every 4 hours, not twice daily

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
Remove regen_map.py references from Dockerfile and README
Build and Push / build (push) Successful in 6s
Details
fd3991f8d6 
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
kacerr merged commit 39e4b9ce2a into main 2026-02-27 11:26:04 +01:00
Sign in to join this conversation.
Reviewers
No Reviewers
Labels
No items
No labels
Milestone
No items
No Milestone
Projects
Clear projects
No projects
Assignees
Clear assignees
kacerr littlemeat
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: littlemeat/maru-hleda-byt#5