grabowski
1845ef7203
CI/CD Pipeline - Northern Thailand Ping River Monitor / Test Suite (3.11) (push) Failing after 37s
CI/CD Pipeline - Northern Thailand Ping River Monitor / Build Docker Image (push) Skipped
CI/CD Pipeline - Northern Thailand Ping River Monitor / Integration Test with Services (push) Skipped
CI/CD Pipeline - Northern Thailand Ping River Monitor / Deploy to Staging (push) Skipped
CI/CD Pipeline - Northern Thailand Ping River Monitor / Deploy to Production (push) Skipped
CI/CD Pipeline - Northern Thailand Ping River Monitor / Performance Test (push) Skipped
CI/CD Pipeline - Northern Thailand Ping River Monitor / Code Quality (push) Successful in 16s
Documentation / Validate Documentation (push) Failing after 9s
Documentation / Generate API Documentation (push) Successful in 10s
Documentation / Build Sphinx Documentation (push) Successful in 15s
CI/CD Pipeline - Northern Thailand Ping River Monitor / Cleanup (push) Successful in 0s
Documentation / Documentation Summary (push) Successful in 2s
Poll the open api-v3.thaiwater.net public endpoints (rain_24h, waterlevel_load), filter to the Ping basin, and persist to new hii_rain_stations/hii_rainfall and hii_wl_stations/hii_waterlevel tables (auto-created; sqlite/postgresql/mysql). Water levels stay in their own tables since HII reports m MSL from a different station set; rid_code maps mirrors like ridhydro_P.1 to P.1 and offset_msl converts MSL to gauge datum. Runs every scraping cycle in web-api and continuous modes (hourly cadence even during 1-minute RID retry), one-shot via --collect-hii; docs/DATA_SOURCES.md catalogs all probed endpoints.
194 lines
7.5 KiB
Markdown
194 lines
7.5 KiB
Markdown
# Notable Documents and References
|
|
|
|
This document contains important references and external resources related to the Thailand Water Level Monitoring System.
|
|
|
|
## 🌊 **Official Thai Government Water Resources**
|
|
|
|
### **Royal Irrigation Department (RID) Resources**
|
|
|
|
#### **1. Water Level Monitoring Diagram**
|
|
- **URL**: https://water.rid.go.th/hyd/Diagram/graphic_ping.pdf
|
|
- **Description**: Official diagram showing the water level monitoring network structure
|
|
- **Content**: Technical diagrams and network topology for Thailand's water monitoring system
|
|
- **Language**: Thai
|
|
- **Format**: PDF
|
|
- **Usage**: Understanding the official monitoring infrastructure and station relationships
|
|
|
|
#### **2. Hourly Water Level Data Portal**
|
|
- **URL**: https://hyd-app-db.rid.go.th/hydro1h.html
|
|
- **Description**: Real-time hourly water level data web interface
|
|
- **Content**: Live data from all 16 monitoring stations across Thailand
|
|
- **Language**: Thai
|
|
- **Format**: Web Application
|
|
- **Usage**: Primary data source for the monitoring system
|
|
- **API Endpoint**: Used by our scraper to fetch real-time data
|
|
- **Update Frequency**: Hourly updates
|
|
- **Data Points**: ~240-384 measurements per hour across all stations
|
|
|
|
#### **3. Individual Station Data - P.76 Example**
|
|
- **URL**: https://www.hydro-1.net/Data/STATION/P.76.html
|
|
- **Description**: Detailed individual station data page for station P.76
|
|
- **Content**: Historical data, station details, and specific measurements
|
|
- **Language**: Thai/English
|
|
- **Format**: Web Page
|
|
- **Usage**: Reference for individual station characteristics and historical data patterns
|
|
- **Station**: P.76 - บ้านแม่อีไฮ (Banb Mae I Hai)
|
|
|
|
### **ThaiWater / HII (Hydro-Informatics Institute) Resources**
|
|
|
|
#### **4. ThaiWater Portal**
|
|
- **URL**: https://twa.thaiwater.net
|
|
- **Description**: National water situation portal (rainfall, water level, dams, warnings)
|
|
- **Language**: Thai/English
|
|
- **Usage**: Backed by open and auth-gated APIs — full endpoint catalog in [DATA_SOURCES.md](../DATA_SOURCES.md)
|
|
|
|
#### **5. ThaiWater Data Standard**
|
|
- **URL**: https://standard.thaiwater.net
|
|
- **Description**: Official water-data standard for exchange and warning — canonical station/basin/province code registries, data formats, warning-level definitions
|
|
- **Language**: Thai
|
|
- **Usage**: Reference for station metadata and warning-level semantics
|
|
|
|
## 📊 **Data Sources and APIs**
|
|
|
|
### **Primary Data Source**
|
|
- **API Endpoint**: `https://hyd-app-db.rid.go.th/webservice/getGroupHourlyWaterLevelReportAllHL.ashx`
|
|
- **Method**: POST
|
|
- **Data Format**: JSON
|
|
- **Update Schedule**: Hourly (top of each hour)
|
|
- **Coverage**: All 16 monitoring stations
|
|
- **Metrics**: Water level (m), Discharge (cms), Discharge percentage (%)
|
|
|
|
### **Station Coverage**
|
|
The system monitors 16 stations across Thailand:
|
|
- P.1 - สะพานนวรัฐ (Nawarat Bridge)
|
|
- P.5 - สะพานท่านาง (Tha Nang Bridge)
|
|
- P.20 - บ้านเชียงดาว (Ban Chiang Dao)
|
|
- P.21 - บ้านริมใต้ (Ban Rim Tai)
|
|
- P.4A - บ้านแม่แตง (Ban Mae Taeng)
|
|
- P.67 - บ้านแม่แต (Ban Tae)
|
|
- P.75 - บ้านช่อแล (Ban Chai Lat)
|
|
- P.76 - บ้านแม่อีไฮ (Banb Mae I Hai)
|
|
- P.77 - บ้านสบแม่สะป๊วด (Baan Sop Mae Sapuord)
|
|
- P.81 - บ้านโป่ง (Ban Pong)
|
|
- P.82 - บ้านสบวิน (Ban Sob win)
|
|
- P.84 - บ้านพันตน (Ban Panton)
|
|
- P.85 - บ้านหล่ายแก้ว (Baan Lai Kaew)
|
|
- P.87 - บ้านป่าซาง (Ban Pa Sang)
|
|
- P.92 - บ้านเมืองกึ๊ด (Ban Muang Aut)
|
|
- P.103 - สะพานวงแหวนรอบ 3 (Ring Bridge 3)
|
|
|
|
## 🔗 **Related Resources**
|
|
|
|
### **Technical Documentation**
|
|
- **Thai Water Resources**: https://water.rid.go.th/
|
|
- **Hydro Information Network**: https://www.hydro-1.net/
|
|
- **Royal Irrigation Department**: https://www.rid.go.th/
|
|
|
|
### **Data Standards**
|
|
- **Time Format**: Thai Buddhist calendar (BE) + 24-hour format
|
|
- **Coordinate System**: WGS84 decimal degrees
|
|
- **Water Level Units**: Meters (m)
|
|
- **Discharge Units**: Cubic meters per second (cms)
|
|
- **Update Frequency**: Hourly at :00 minutes
|
|
|
|
### **API Parameters**
|
|
```javascript
|
|
{
|
|
'DW[UtokID]': '1',
|
|
'DW[BasinID]': '6',
|
|
'DW[TimeCurrent]': 'DD/MM/YYYY', // Thai Buddhist calendar
|
|
'_search': 'false',
|
|
'nd': timestamp_milliseconds,
|
|
'rows': '100',
|
|
'page': '1',
|
|
'sidx': 'indexhourly',
|
|
'sord': 'asc'
|
|
}
|
|
```
|
|
|
|
## 📋 **Data Structure Reference**
|
|
|
|
### **JSON Response Format**
|
|
```json
|
|
{
|
|
"rows": [
|
|
{
|
|
"hourlytime": "1.00", // Hour (1-24, where 24 = midnight next day)
|
|
"wlvalues1": "2.45", // Water level for station 1 (meters)
|
|
"qvalues1": "125.3", // Discharge for station 1 (cms)
|
|
"QPercent1": "45.2", // Discharge percentage for station 1
|
|
"wlvalues2": "1.89", // Station 2 data...
|
|
// ... continues for all 16 stations
|
|
}
|
|
]
|
|
}
|
|
```
|
|
|
|
### **Station ID Mapping**
|
|
- Station 1 → P.20 (Ban Chiang Dao)
|
|
- Station 2 → P.75 (Ban Chai Lat)
|
|
- Station 3 → P.92 (Ban Muang Aut)
|
|
- Station 4 → P.4A (Ban Mae Taeng)
|
|
- Station 5 → P.67 (Ban Tae)
|
|
- Station 6 → P.21 (Ban Rim Tai)
|
|
- Station 7 → P.103 (Ring Bridge 3)
|
|
- Station 8 → P.1 (Nawarat Bridge)
|
|
- Station 9 → P.82 (Ban Sob win)
|
|
- Station 10 → P.84 (Ban Panton)
|
|
- Station 11 → P.81 (Ban Pong)
|
|
- Station 12 → P.5 (Tha Nang Bridge)
|
|
- Station 13 → P.77 (Baan Sop Mae Sapuord)
|
|
- Station 14 → P.87 (Ban Pa Sang)
|
|
- Station 15 → P.76 (Banb Mae I Hai)
|
|
- Station 16 → P.85 (Baan Lai Kaew)
|
|
|
|
## 🌐 **Geolocation Reference**
|
|
|
|
### **Sample Coordinates (P.1 - Nawarat Bridge)**
|
|
- **Latitude**: 15.6944°N
|
|
- **Longitude**: 100.2028°E
|
|
- **Geohash**: w5q6uuhvfcfp25
|
|
- **Location**: Nakhon Sawan Province, Thailand
|
|
|
|
### **Coordinate System**
|
|
- **Datum**: WGS84
|
|
- **Format**: Decimal degrees
|
|
- **Precision**: 4 decimal places (~11m accuracy)
|
|
- **Usage**: Grafana geomap visualization
|
|
|
|
## 📝 **Usage Notes**
|
|
|
|
### **Data Collection**
|
|
- **Frequency**: Every 15 minutes (full check at :00, quick checks at :15, :30, :45)
|
|
- **Retention**: 2+ years of historical data
|
|
- **Gap Filling**: Automatic detection and filling of missing data
|
|
- **Data Updates**: Checks for changed values in recent data
|
|
|
|
### **Time Handling**
|
|
- **Thai Time**: UTC+7 (Asia/Bangkok)
|
|
- **Buddhist Calendar**: Thai year = Gregorian year + 543
|
|
- **Hour 24**: Represents midnight (00:00) of the next day
|
|
- **API Format**: DD/MM/YYYY (Buddhist calendar)
|
|
|
|
### **Data Quality**
|
|
- **Validation**: Automatic data validation and error detection
|
|
- **Retry Logic**: 15-minute retry intervals when data is unavailable
|
|
- **Error Handling**: Comprehensive error logging and recovery
|
|
- **Monitoring**: Health checks and alert conditions
|
|
|
|
## 🔍 **Research and Development**
|
|
|
|
### **Future Enhancements**
|
|
- **Additional Stations**: Potential expansion to more monitoring points
|
|
- **Real-time Alerts**: Threshold-based notification system
|
|
- **Predictive Analytics**: Water level forecasting capabilities
|
|
- **Mobile Integration**: Field data collection and verification
|
|
|
|
### **Technical Improvements**
|
|
- **API Optimization**: Enhanced data fetching efficiency
|
|
- **Database Performance**: Query optimization and indexing
|
|
- **Visualization**: Advanced Grafana dashboard features
|
|
- **Integration**: Connection with other water management systems
|
|
|
|
This document serves as a comprehensive reference for understanding the data sources, technical specifications, and official resources that support the Thailand Water Level Monitoring System.
|