fix: RID collector keeps late readings instead of losing every evening

RID's hourly report often lags 1-2 h in the evening. The cycle discarded the
whole report unless it already held the current hour, the web-API loop then
slept a full hour, and after 01:00 only today's report was fetched. Result:
the 19:00-24:00 readings were dropped most nights (P.1 lost 00:00 on 23 of
the last 60 days, 13 evening hours this week), the feed went stale from
~21:00 until morning and ntfy ping-status sent a stale/recovered pair daily.

- run_scraping_cycle() upserts every reading the report has; "current hour
  present" now only decides the retry cadence (returned as before).
- Yesterday's report is re-fetched while the store has holes in it (hours
  22-24 are only reachable through that day's report).
- Leader loop polls at :05 (RID_POLL_OFFSET_MINUTES) and retries every
  RID_RETRY_MINUTES (10) while RID is behind; HII/dams/rain once per clock
  hour; forecast precompute + ntfy when newer readings arrive or hourly.
- Startup re-fetches holes from the last GAP_FILL_DAYS_ON_START (14) days.
- /scraping/status: the leader shares its stats via a JSON file, so any
  worker reports them (was always 0 runs); adds feed_current,
  latest_reading, readings_saved.

src/config.py

@@ -134,6 +134,16 @@ class Config:
 
     # Scheduler settings
     SCRAPING_INTERVAL_HOURS = int(os.getenv("SCRAPING_INTERVAL_HOURS", "1"))
+    # RID is polled this many minutes past each hour; while the current hour is
+    # not published yet (the evening report often lags 1-2 h) it is retried
+    # every RID_RETRY_MINUTES. Late readings are stored either way.
+    RID_POLL_OFFSET_MINUTES = int(os.getenv("RID_POLL_OFFSET_MINUTES", "5"))
+    RID_RETRY_MINUTES = int(os.getenv("RID_RETRY_MINUTES", "10"))
+    # On startup the collection leader re-fetches RID reports with holes from
+    # the last N days (0 = off). Older history: `run.py --fill-gaps all`.
+    GAP_FILL_DAYS_ON_START = int(os.getenv("GAP_FILL_DAYS_ON_START", "14"))
+    # Leader -> other workers hand-off for /scraping/status (default: temp dir)
+    SCRAPING_STATUS_FILE = os.getenv("SCRAPING_STATUS_FILE", "")
 
     # Logging settings
     LOG_LEVEL = os.getenv("LOG_LEVEL", "INFO")
@@ -209,6 +219,12 @@ class Config:
         if cls.SCRAPING_INTERVAL_HOURS <= 0:
             errors.append("SCRAPING_INTERVAL_HOURS must be positive")
 
+        if not 0 <= cls.RID_POLL_OFFSET_MINUTES < 60:
+            errors.append("RID_POLL_OFFSET_MINUTES must be between 0 and 59")
+
+        if cls.RID_RETRY_MINUTES <= 0:
+            errors.append("RID_RETRY_MINUTES must be positive")
+
         if cls.DATA_RETENTION_DAYS <= 0:
             errors.append("DATA_RETENTION_DAYS must be positive")
 
@@ -274,6 +290,9 @@ class Config:
             "API_URL": cls.API_URL,
             "REQUEST_TIMEOUT": cls.REQUEST_TIMEOUT,
             "SCRAPING_INTERVAL_HOURS": cls.SCRAPING_INTERVAL_HOURS,
+            "RID_POLL_OFFSET_MINUTES": cls.RID_POLL_OFFSET_MINUTES,
+            "RID_RETRY_MINUTES": cls.RID_RETRY_MINUTES,
+            "GAP_FILL_DAYS_ON_START": cls.GAP_FILL_DAYS_ON_START,
             "LOG_LEVEL": cls.LOG_LEVEL,
             "LOG_FILE": cls.LOG_FILE,
             "DATA_RETENTION_DAYS": cls.DATA_RETENTION_DAYS,