Add Gitea Actions CI pipeline for Docker image builds

Triggers on tag push or manual dispatch. Builds the image using build/Dockerfile and pushes to the Gitea container registry. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Add comprehensive project documentation
2026-02-14 22:40:23 +00:00 · 2026-02-14 22:40:23 +00:00 · 2026-02-14 22:40:23 +00:00 · 2026-02-14 22:40:23 +00:00 · 2026-02-14 17:50:42 +01:00
9 changed files with 31060 additions and 0 deletions
--- a/.DS_Store
+++ b/.DS_Store
--- a/.claude/settings.local.json
+++ b/.claude/settings.local.json
@@ -0,0 +1,31 @@
+{
+  "permissions": {
+    "allow": [
+      "WebFetch(domain:github.com)",
+      "WebFetch(domain:www.sreality.cz)",
+      "WebFetch(domain:webscraping.pro)",
+      "WebFetch(domain:raw.githubusercontent.com)",
+      "Bash(python3:*)",
+      "Bash(open:*)",
+      "WebFetch(domain:www.realingo.cz)",
+      "WebFetch(domain:api.realingo.cz)",
+      "Bash(curl:*)",
+      "Bash(grep:*)",
+      "WebFetch(domain:www.realitni-pes.cz)",
+      "WebFetch(domain:www.bezrealitky.cz)",
+      "WebFetch(domain:apify.com)",
+      "WebFetch(domain:www.bezrealitky.com)",
+      "WebFetch(domain:reality.idnes.cz)",
+      "Bash(# Final checks: robots.txt and response time for rate limiting clues curl -s -L -H \"\"User-Agent: Mozilla/5.0 \\(Windows NT 10.0; Win64; x64\\) AppleWebKit/537.36 \\(KHTML, like Gecko\\) Chrome/120.0.0.0 Safari/537.36\"\" \"\"https://reality.idnes.cz/robots.txt\"\")",
+      "WebFetch(domain:www.cityhome.cz)",
+      "WebFetch(domain:www.psn.cz)",
+      "WebFetch(domain:www.city-home.cz)",
+      "WebFetch(domain:psn.cz)",
+      "WebFetch(domain:api.psn.cz)",
+      "Bash(done)",
+      "Bash(# Final summary: count total units across all projects\n# Get the total count from the unitsCountData we already extracted\necho \"\"From unitsCountData on /prodej page:\"\"\necho \"\"  type_id 0 \\(Prodej bytů a ateliérů\\): 146\"\"\necho \"\"  type_id 1 \\(Prodej komerčních nemovitostí\\): 14\"\"\necho \"\"  type_id 2 \\(Pronájem bytů\\): 3\"\"\necho \"\"  type_id 3 \\(Pronájem komerčních nemovitostí\\): 48\"\"\necho \"\"\"\"\necho \"\"Total for-sale projects: 19\"\"\necho \"\"\"\"\necho \"\"Disposition counts from the data:\"\"\npython3 << 'PYEOF'\n# Extract disposition counts from prodej page\nimport re\n\nwith open\\('/tmp/psn_prodej_p1.html', 'r', encoding='utf-8'\\) as f:\n    html = f.read\\(\\)\n\n# Find disposition data\nidx = html.find\\('\\\\\\\\\"disposition\\\\\\\\\":['\\)\nif idx >= 0:\n    chunk = html[idx:idx+2000].replace\\('\\\\\\\\\"', '\"'\\)\n    # Extract name and count pairs\n    import re\n    pairs = re.findall\\(r'\"name\":\"\\([^\"]+\\)\",\"count\":\\(\\\\d+\\)', chunk\\)\n    for name, count in pairs:\n        print\\(f\"  {name}: {count}\"\\)\nPYEOF)",
+      "Bash(ls:*)",
+      "Bash(chmod:*)"
+    ]
+  }
+}
--- a/byty_bezrealitky.json
+++ b/byty_bezrealitky.json
@@ -0,0 +1,427 @@
+[
+  {
+    "hash_id": 990183,
+    "name": "Prodej bytu 3+kk 86 m²",
+    "price": 10385000,
+    "price_formatted": "10 385 000 Kč",
+    "locality": "Ke Tvrzi, Praha - Královice",
+    "lat": 50.0390519,
+    "lon": 14.63862,
+    "disposition": "3+kk",
+    "floor": 2,
+    "area": 86,
+    "building_type": "Cihlová",
+    "ownership": "Osobní",
+    "url": "https://www.bezrealitky.cz/nemovitosti-byty-domy/990183-nabidka-prodej-bytu-ke-tvrzi-praha",
+    "source": "bezrealitky",
+    "image": ""
+  },
+  {
+    "hash_id": 989862,
+    "name": "Prodej bytu 3+kk 73 m²",
+    "price": 12790000,
+    "price_formatted": "12 790 000 Kč",
+    "locality": "Vrázova, Praha - Smíchov",
+    "lat": 50.0711312,
+    "lon": 14.4076652,
+    "disposition": "3+kk",
+    "floor": 3,
+    "area": 73,
+    "building_type": "Cihlová",
+    "ownership": "Osobní",
+    "url": "https://www.bezrealitky.cz/nemovitosti-byty-domy/989862-nabidka-prodej-bytu-vrazova-praha",
+    "source": "bezrealitky",
+    "image": ""
+  },
+  {
+    "hash_id": 981278,
+    "name": "Prodej bytu 3+kk 70 m²",
+    "price": 11890000,
+    "price_formatted": "11 890 000 Kč",
+    "locality": "Argentinská, Praha - Holešovice",
+    "lat": 50.1026043,
+    "lon": 14.4435365,
+    "disposition": "3+kk",
+    "floor": 3,
+    "area": 70,
+    "building_type": "Cihlová",
+    "ownership": "Osobní",
+    "url": "https://www.bezrealitky.cz/nemovitosti-byty-domy/981278-nabidka-prodej-bytu-argentinska-praha",
+    "source": "bezrealitky",
+    "image": ""
+  },
+  {
+    "hash_id": 989817,
+    "name": "Prodej bytu 3+kk 88 m²",
+    "price": 13490000,
+    "price_formatted": "13 490 000 Kč",
+    "locality": "Miroslava Hajna, Praha - Letňany",
+    "lat": 50.1406487,
+    "lon": 14.5207541,
+    "disposition": "3+kk",
+    "floor": 2,
+    "area": 88,
+    "building_type": "Cihlová",
+    "ownership": "Osobní",
+    "url": "https://www.bezrealitky.cz/nemovitosti-byty-domy/989817-nabidka-prodej-bytu-miroslava-hajna-praha",
+    "source": "bezrealitky",
+    "image": ""
+  },
+  {
+    "hash_id": 970257,
+    "name": "Prodej bytu 3+1 106 m²",
+    "price": 12950000,
+    "price_formatted": "12 950 000 Kč",
+    "locality": "Novákových, Praha - Libeň",
+    "lat": 50.1034771,
+    "lon": 14.4758735,
+    "disposition": "3+1",
+    "floor": 5,
+    "area": 106,
+    "building_type": "Cihlová",
+    "ownership": "Osobní",
+    "url": "https://www.bezrealitky.cz/nemovitosti-byty-domy/970257-nabidka-prodej-bytu-novakovych-praha",
+    "source": "bezrealitky",
+    "image": ""
+  },
+  {
+    "hash_id": 972406,
+    "name": "Prodej bytu 3+kk 83 m²",
+    "price": 10490000,
+    "price_formatted": "10 490 000 Kč",
+    "locality": "Na Výrovně, Praha - Stodůlky",
+    "lat": 50.0396067,
+    "lon": 14.3167022,
+    "disposition": "3+kk",
+    "floor": 2,
+    "area": 83,
+    "building_type": "Cihlová",
+    "ownership": "Osobní",
+    "url": "https://www.bezrealitky.cz/nemovitosti-byty-domy/972406-nabidka-prodej-bytu-na-vyrovne",
+    "source": "bezrealitky",
+    "image": ""
+  },
+  {
+    "hash_id": 967142,
+    "name": "Prodej bytu 3+kk 78 m²",
+    "price": 11648000,
+    "price_formatted": "11 648 000 Kč",
+    "locality": "Na Míčánkách, Praha - Vršovice",
+    "lat": 50.0713284,
+    "lon": 14.4638722,
+    "disposition": "3+kk",
+    "floor": 6,
+    "area": 78,
+    "building_type": "Cihlová",
+    "ownership": "Osobní",
+    "url": "https://www.bezrealitky.cz/nemovitosti-byty-domy/967142-nabidka-prodej-bytu-na-micankach",
+    "source": "bezrealitky",
+    "image": ""
+  },
+  {
+    "hash_id": 955977,
+    "name": "Prodej bytu 4+kk 75 m²",
+    "price": 10363000,
+    "price_formatted": "10 363 000 Kč",
+    "locality": "Karla Guta, Praha - Uhříněves",
+    "lat": 50.03017,
+    "lon": 14.5940072,
+    "disposition": "4+kk",
+    "floor": 4,
+    "area": 75,
+    "building_type": "Cihlová",
+    "ownership": "Osobní",
+    "url": "https://www.bezrealitky.cz/nemovitosti-byty-domy/955977-nabidka-prodej-bytu-karla-guta",
+    "source": "bezrealitky",
+    "image": ""
+  },
+  {
+    "hash_id": 974557,
+    "name": "Prodej bytu 4+kk 94 m²",
+    "price": 13499900,
+    "price_formatted": "13 499 900 Kč",
+    "locality": "V Dolině, Praha - Michle",
+    "lat": 50.0579963,
+    "lon": 14.4682887,
+    "disposition": "4+kk",
+    "floor": 8,
+    "area": 94,
+    "building_type": "Cihlová",
+    "ownership": "Osobní",
+    "url": "https://www.bezrealitky.cz/nemovitosti-byty-domy/974557-nabidka-prodej-bytu-v-doline-praha",
+    "source": "bezrealitky",
+    "image": ""
+  },
+  {
+    "hash_id": 988498,
+    "name": "Prodej bytu 3+1 75 m²",
+    "price": 11400000,
+    "price_formatted": "11 400 000 Kč",
+    "locality": "5. května, Praha - Nusle",
+    "lat": 50.0604096,
+    "lon": 14.4326302,
+    "disposition": "3+1",
+    "floor": 4,
+    "area": 75,
+    "building_type": "Cihlová",
+    "ownership": "Osobní",
+    "url": "https://www.bezrealitky.cz/nemovitosti-byty-domy/988498-nabidka-prodej-bytu-5-kvetna-praha",
+    "source": "bezrealitky",
+    "image": ""
+  },
+  {
+    "hash_id": 985285,
+    "name": "Prodej bytu 3+kk 70 m²",
+    "price": 12200000,
+    "price_formatted": "12 200 000 Kč",
+    "locality": "Klausova, Praha - Stodůlky",
+    "lat": 50.0370204,
+    "lon": 14.3432643,
+    "disposition": "3+kk",
+    "floor": 5,
+    "area": 70,
+    "building_type": "Cihlová",
+    "ownership": "Osobní",
+    "url": "https://www.bezrealitky.cz/nemovitosti-byty-domy/985285-nabidka-prodej-bytu-klausova-praha",
+    "source": "bezrealitky",
+    "image": ""
+  },
+  {
+    "hash_id": 965526,
+    "name": "Prodej bytu 3+kk 77 m²",
+    "price": 11890000,
+    "price_formatted": "11 890 000 Kč",
+    "locality": "Vinohradská, Praha - Strašnice",
+    "lat": 50.0776726,
+    "lon": 14.4870072,
+    "disposition": "3+kk",
+    "floor": 16,
+    "area": 77,
+    "building_type": "Smíšená",
+    "ownership": "Osobní",
+    "url": "https://www.bezrealitky.cz/nemovitosti-byty-domy/965526-nabidka-prodej-bytu-vinohradska-praha",
+    "source": "bezrealitky",
+    "image": ""
+  },
+  {
+    "hash_id": 924811,
+    "name": "Prodej bytu 3+kk 75 m²",
+    "price": 13390000,
+    "price_formatted": "13 390 000 Kč",
+    "locality": "Waltariho, Praha - Hloubětín",
+    "lat": 50.1076717,
+    "lon": 14.5248559,
+    "disposition": "3+kk",
+    "floor": 4,
+    "area": 75,
+    "building_type": "Smíšená",
+    "ownership": "Osobní",
+    "url": "https://www.bezrealitky.cz/nemovitosti-byty-domy/924811-nabidka-prodej-bytu-waltariho-praha",
+    "source": "bezrealitky",
+    "image": ""
+  },
+  {
+    "hash_id": 985859,
+    "name": "Prodej bytu 3+1 80 m²",
+    "price": 9000000,
+    "price_formatted": "9 000 000 Kč",
+    "locality": "Staňkova, Praha - Háje",
+    "lat": 50.0377128,
+    "lon": 14.5311557,
+    "disposition": "3+1",
+    "floor": 2,
+    "area": 80,
+    "building_type": "Cihlová",
+    "ownership": "Osobní",
+    "url": "https://www.bezrealitky.cz/nemovitosti-byty-domy/985859-nabidka-prodej-bytu-stankova-praha",
+    "source": "bezrealitky",
+    "image": ""
+  },
+  {
+    "hash_id": 985583,
+    "name": "Prodej bytu 3+kk 76 m²",
+    "price": 10850000,
+    "price_formatted": "10 850 000 Kč",
+    "locality": "Boloňská, Praha - Horní Měcholupy",
+    "lat": 50.047328,
+    "lon": 14.5565277,
+    "disposition": "3+kk",
+    "floor": 4,
+    "area": 76,
+    "building_type": "Cihlová",
+    "ownership": "Osobní",
+    "url": "https://www.bezrealitky.cz/nemovitosti-byty-domy/985583-nabidka-prodej-bytu-bolonska-praha",
+    "source": "bezrealitky",
+    "image": ""
+  },
+  {
+    "hash_id": 981178,
+    "name": "Prodej bytu 4+kk 86 m²",
+    "price": 11990000,
+    "price_formatted": "11 990 000 Kč",
+    "locality": "Sušilova, Praha - Uhříněves",
+    "lat": 50.032081,
+    "lon": 14.5885148,
+    "disposition": "4+kk",
+    "floor": 2,
+    "area": 86,
+    "building_type": "SKELET",
+    "ownership": "Osobní",
+    "url": "https://www.bezrealitky.cz/nemovitosti-byty-domy/981178-nabidka-prodej-bytu-susilova-praha",
+    "source": "bezrealitky",
+    "image": ""
+  },
+  {
+    "hash_id": 973216,
+    "name": "Prodej bytu 4+1 82 m²",
+    "price": 11357000,
+    "price_formatted": "11 357 000 Kč",
+    "locality": "Nad Kapličkou, Praha - Strašnice",
+    "lat": 50.0839509,
+    "lon": 14.4904493,
+    "disposition": "4+1",
+    "floor": 2,
+    "area": 82,
+    "building_type": "Cihlová",
+    "ownership": "Osobní",
+    "url": "https://www.bezrealitky.cz/nemovitosti-byty-domy/973216-nabidka-prodej-bytu-nad-kaplickou-praha",
+    "source": "bezrealitky",
+    "image": ""
+  },
+  {
+    "hash_id": 868801,
+    "name": "Prodej bytu 3+kk 109 m²",
+    "price": 7299000,
+    "price_formatted": "7 299 000 Kč",
+    "locality": "Pod Karlovem, Praha - Vinohrady",
+    "lat": 50.0676313,
+    "lon": 14.432498,
+    "disposition": "3+kk",
+    "floor": 5,
+    "area": 109,
+    "building_type": "Cihlová",
+    "ownership": "Družstevní",
+    "url": "https://www.bezrealitky.cz/nemovitosti-byty-domy/868801-nabidka-prodej-bytu-pod-karlovem-praha",
+    "source": "bezrealitky",
+    "image": ""
+  },
+  {
+    "hash_id": 868795,
+    "name": "Prodej bytu 3+kk 106 m²",
+    "price": 6299000,
+    "price_formatted": "6 299 000 Kč",
+    "locality": "Pod Karlovem, Praha - Vinohrady",
+    "lat": 50.0676313,
+    "lon": 14.432498,
+    "disposition": "3+kk",
+    "floor": 2,
+    "area": 106,
+    "building_type": "Cihlová",
+    "ownership": "Družstevní",
+    "url": "https://www.bezrealitky.cz/nemovitosti-byty-domy/868795-nabidka-prodej-bytu-pod-karlovem-praha",
+    "source": "bezrealitky",
+    "image": ""
+  },
+  {
+    "hash_id": 981890,
+    "name": "Prodej bytu 3+1 84 m²",
+    "price": 12980000,
+    "price_formatted": "12 980 000 Kč",
+    "locality": "Novákových, Praha - Libeň",
+    "lat": 50.103273,
+    "lon": 14.4746894,
+    "disposition": "3+1",
+    "floor": 2,
+    "area": 84,
+    "building_type": "Cihlová",
+    "ownership": "Osobní",
+    "url": "https://www.bezrealitky.cz/nemovitosti-byty-domy/981890-nabidka-prodej-bytu-novakovych-praha",
+    "source": "bezrealitky",
+    "image": ""
+  },
+  {
+    "hash_id": 976276,
+    "name": "Prodej bytu 3+kk 75 m²",
+    "price": 13490000,
+    "price_formatted": "13 490 000 Kč",
+    "locality": "Svornosti, Praha - Smíchov",
+    "lat": 50.0673284,
+    "lon": 14.4095087,
+    "disposition": "3+kk",
+    "floor": 2,
+    "area": 75,
+    "building_type": "Cihlová",
+    "ownership": "Osobní",
+    "url": "https://www.bezrealitky.cz/nemovitosti-byty-domy/976276-nabidka-prodej-bytu-svornosti-praha",
+    "source": "bezrealitky",
+    "image": ""
+  },
+  {
+    "hash_id": 950787,
+    "name": "Prodej bytu 3+kk 70 m²",
+    "price": 9999000,
+    "price_formatted": "9 999 000 Kč",
+    "locality": "Sečská, Praha - Strašnice",
+    "lat": 50.071191,
+    "lon": 14.5035501,
+    "disposition": "3+kk",
+    "floor": 3,
+    "area": 70,
+    "building_type": "Smíšená",
+    "ownership": "Osobní",
+    "url": "https://www.bezrealitky.cz/nemovitosti-byty-domy/950787-nabidka-prodej-bytu-secska-praha",
+    "source": "bezrealitky",
+    "image": ""
+  },
+  {
+    "hash_id": 978045,
+    "name": "Prodej bytu 3+kk 76 m²",
+    "price": 11133000,
+    "price_formatted": "11 133 000 Kč",
+    "locality": "K Vinoři, Praha - Kbely",
+    "lat": 50.1329656,
+    "lon": 14.5618499,
+    "disposition": "3+kk",
+    "floor": 2,
+    "area": 76,
+    "building_type": "Smíšená",
+    "ownership": "Osobní",
+    "url": "https://www.bezrealitky.cz/nemovitosti-byty-domy/978045-nabidka-prodej-bytu-k-vinori",
+    "source": "bezrealitky",
+    "image": ""
+  },
+  {
+    "hash_id": 974552,
+    "name": "Prodej bytu 3+1 75 m²",
+    "price": 11000000,
+    "price_formatted": "11 000 000 Kč",
+    "locality": "Vejražkova, Praha - Košíře",
+    "lat": 50.0637808,
+    "lon": 14.3612275,
+    "disposition": "3+1",
+    "floor": 2,
+    "area": 75,
+    "building_type": "Cihlová",
+    "ownership": "Osobní",
+    "url": "https://www.bezrealitky.cz/nemovitosti-byty-domy/974552-nabidka-prodej-bytu-vejrazkova-praha",
+    "source": "bezrealitky",
+    "image": ""
+  },
+  {
+    "hash_id": 955010,
+    "name": "Prodej bytu 3+kk 70 m²",
+    "price": 12290000,
+    "price_formatted": "12 290 000 Kč",
+    "locality": "Břeclavská, Praha - Kyje",
+    "lat": 50.0951045,
+    "lon": 14.5454237,
+    "disposition": "3+kk",
+    "floor": 2,
+    "area": 70,
+    "building_type": "Cihlová",
+    "ownership": "Osobní",
+    "url": "https://www.bezrealitky.cz/nemovitosti-byty-domy/955010-nabidka-prodej-bytu-breclavska-hlavni-mesto-praha",
+    "source": "bezrealitky",
+    "image": ""
+  }
+]
--- a/byty_cityhome.json
+++ b/byty_cityhome.json
@@ -0,0 +1 @@
+[]
--- a/byty_idnes.json
+++ b/byty_idnes.json
--- a/byty_merged.json
+++ b/byty_merged.json
--- a/byty_psn.json
+++ b/byty_psn.json
@@ -0,0 +1 @@
+[]
--- a/byty_realingo.json
+++ b/byty_realingo.json
--- a/byty_sreality.json
+++ b/byty_sreality.json
Author	SHA1	Message	Date
Jan Novak	c6089f0da9	Add Gitea Actions CI pipeline for Docker image builds Triggers on tag push or manual dispatch. Builds the image using build/Dockerfile and pushes to the Gitea container registry. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>	2026-02-14 22:40:23 +00:00
Jan Novak	327688d9d2	Add comprehensive project documentation Cover the full pipeline (scrapers, merge, map generation), all 6 data sources with their parsing methods, filter criteria, CLI arguments, Docker setup, caching, rate limiting, and project structure. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>	2026-02-14 22:40:23 +00:00
Jan Novak	09a853aa05	Add validation mode, structured logging, and CLI args to all scrapers - Replace print() with Python logging module across all 6 scrapers for configurable log levels (DEBUG/INFO/WARNING/ERROR) - Add --max-pages, --max-properties, and --log-level CLI arguments to each scraper via argparse for limiting scrape scope - Add validation Make targets (validation, validation-local, validation-local-debug) for quick test runs with limited data - Update run_all.sh to parse and forward CLI args to all scrapers - Update mapa_bytu.html with latest scrape results Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>	2026-02-14 22:40:23 +00:00
Jan Novak	5207c48890	add docker build, makefile, and some more shit before we move forward	2026-02-14 22:40:23 +00:00
Marie Michalova	215b51aadb	Initial commit from Mac	2026-02-14 17:50:42 +01:00