We are failing to properly import all bandwidth files it seems
While checking our data and making sense of it it occurs to us that we miss a lot of bandwidth data from different authorities. Take for example 06C397676A6407BDE1C8836FC49CD42F38B8082E where we get:
FROM bw_line
WHERE fingerprint = '06C397676A6407BDE1C8836FC49CD42F38B8082E'
AND published BETWEEN '2024-08-22' AND '2024-08-24'
AND scanner_country IN ('DE', 'AT', 'SE', 'US') order by published,scanner_country;
published | weight_bytes | stream_bw | consensus_bandwidth | desc_bw_obs_last | advertised_bw
---------------------+--------------+-----------+---------------------+------------------+---------------
2024-08-22 01:37:14 | AT | 5965473 | 180000000 | 107330826 | 107330826
2024-08-22 04:37:10 | AT | 5965473 | 180000000 | 107330826 | 107330826
2024-08-22 04:39:20 | DE | 6115994 | 180000000 | 107330826 | 107330826
2024-08-22 05:38:36 | US | 1778034 | 180000000 | 107330826 | 107330826
2024-08-22 06:39:21 | DE | 6106589 | 180000000 | 107330826 | 107330826
2024-08-22 07:35:37 | US | 1899656 | 180000000 | 107330826 | 107330826
2024-08-22 07:36:25 | US | 1312513 | 190000000 | 107330826 | 107330826
2024-08-22 07:45:19 | SE | 1917322 | 190000000 | 107330826 | 107330826
2024-08-22 12:38:55 | US | 1778034 | 180000000 | 107162850 | 107162850
2024-08-22 12:45:14 | SE | 1696680 | 190000000 | 107330826 | 107330826
2024-08-22 13:37:00 | US | 1274325 | 180000000 | 107162850 | 107162850
2024-08-22 14:45:33 | SE | 1618404 | 180000000 | 107162850 | 107162850
2024-08-22 16:38:34 | US | 1778034 | 170000000 | 107162850 | 107162850
2024-08-22 16:45:38 | SE | 1618404 | 180000000 | 107162850 | 107162850
2024-08-22 18:38:41 | US | 1778034 | 170000000 | 107162850 | 107162850
2024-08-22 18:45:48 | SE | 1618404 | 180000000 | 107162850 | 107162850
2024-08-22 19:35:58 | US | 1878257 | 180000000 | 107330826 | 107330826
2024-08-22 20:36:23 | AT | 5965473 | 180000000 | 107330826 | 107330826
2024-08-22 22:37:13 | AT | 5965473 | 180000000 | 107330826 | 107330826
2024-08-23 03:39:13 | US | 1769753 | 170000000 | 107162850 | 107162850
2024-08-23 04:45:40 | SE | 1618404 | 180000000 | 107162850 | 107162850
2024-08-23 06:37:22 | AT | 6083043 | 180000000 | 107330826 | 107330826
2024-08-23 07:39:14 | DE | 6106589 | 180000000 | 107330826 | 107330826
2024-08-23 09:36:58 | AT | 6083043 | 180000000 | 107330826 | 107330826
2024-08-23 09:38:33 | US | 1769753 | 170000000 | 107162850 | 107162850
2024-08-23 12:39:24 | DE | 6106589 | 180000000 | 107330826 | 107330826
2024-08-23 15:38:22 | US | 1728158 | 170000000 | 108720212 | 108720212
2024-08-23 18:38:43 | DE | 6106589 | 180000000 | 107330826 | 107330826
2024-08-23 21:36:12 | AT | 6083043 | 180000000 | 107330826 | 107330826
2024-08-23 21:36:54 | US | 1338257 | 180000000 | 107162850 | 107162850
2024-08-23 23:35:29 | AT | 5956534 | 170000000 | 108720212 | 108720212However, that relay has been constantly running on 2024-08-23 at least and for DE alone we should have hourly bw file entries (that is 24 entries alone) as we have 24 such entries in our collector files. @juga, @hiro