mirror of
https://github.com/BigBodyCobain/Shadowbroker.git
synced 2026-04-24 19:46:09 +02:00
362a6e2ceb
Former-commit-id: 8ed321f2ba
2719 lines
278 KiB
Plaintext
2719 lines
278 KiB
Plaintext
|
|
> frontend@0.1.0 dev
|
|
> concurrently --names "NEXT,API" --prefix-colors "cyan,yellow" "next dev" "..\backend\venv\Scripts\python.exe ../backend/main.py"
|
|
|
|
[NEXT] Γû▓ Next.js 16.1.6 (Turbopack)
|
|
[NEXT] - Local: http://localhost:3000
|
|
[NEXT] - Network: http://10.0.0.234:3000
|
|
[NEXT]
|
|
[NEXT] Γ£ô Starting...
|
|
[API] INFO: Will watch for changes in these directories: ['F:\\Codebase\\Oracle\\live-risk-dashboard\\frontend']
|
|
[API] INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit)
|
|
[API] INFO: Started reloader process [20656] using StatReload
|
|
[NEXT] Γ£ô Ready in 2.7s
|
|
[API] INFO: Started server process [15128]
|
|
[API] INFO: Waiting for application startup.
|
|
[API] INFO:services.ais_stream:AIS cache loaded: 26595 vessels from disk
|
|
[API] INFO:services.ais_stream:Starting Node.js AIS Stream Proxy...
|
|
[API] INFO:services.ais_stream:AIS Stream background thread started
|
|
[API] INFO:apscheduler.scheduler:Adding job tentatively -- it will be properly scheduled when the scheduler starts
|
|
[API] INFO:apscheduler.scheduler:Adding job tentatively -- it will be properly scheduled when the scheduler starts
|
|
[API] INFO:apscheduler.scheduler:Adding job tentatively -- it will be properly scheduled when the scheduler starts
|
|
[API] INFO:apscheduler.scheduler:Adding job tentatively -- it will be properly scheduled when the scheduler starts
|
|
[API] INFO:apscheduler.scheduler:Adding job tentatively -- it will be properly scheduled when the scheduler starts
|
|
[API] INFO:apscheduler.scheduler:Adding job tentatively -- it will be properly scheduled when the scheduler starts
|
|
[API] INFO:apscheduler.scheduler:Adding job tentatively -- it will be properly scheduled when the scheduler starts
|
|
[API] INFO:apscheduler.scheduler:Adding job tentatively -- it will be properly scheduled when the scheduler starts
|
|
[API] INFO:apscheduler.scheduler:Adding job tentatively -- it will be properly scheduled when the scheduler starts
|
|
[API] INFO:apscheduler.scheduler:Adding job tentatively -- it will be properly scheduled when the scheduler starts
|
|
[API] INFO:apscheduler.scheduler:Added job "update_all_data" to job store "default"
|
|
[API] INFO:apscheduler.scheduler:Added job "update_all_data" to job store "default"
|
|
[API] INFO:apscheduler.scheduler:Added job "start_scheduler.<locals>.update_cctvs" to job store "default"
|
|
[API] INFO:apscheduler.scheduler:Added job "fetch_flights" to job store "default"
|
|
[API] INFO:apscheduler.scheduler:Added job "fetch_ships" to job store "default"
|
|
[API] INFO:apscheduler.scheduler:Added job "fetch_geopolitics" to job store "default"
|
|
[API] INFO:apscheduler.scheduler:Added job "start_scheduler.<locals>.update_cctvs" to job store "default"
|
|
[API] INFO:apscheduler.scheduler:Added job "fetch_flights" to job store "default"
|
|
[API] INFO:apscheduler.scheduler:Added job "fetch_ships" to job store "default"
|
|
[API] INFO:apscheduler.scheduler:Added job "fetch_geopolitics" to job store "default"
|
|
[API] INFO:apscheduler.scheduler:Scheduler started
|
|
[API] INFO: Application startup complete.
|
|
[API] INFO:apscheduler.executors.default:Running job "update_all_data (trigger: date[2026-02-28 01:27:34 MST], next run at: 2026-02-28 01:27:34 MST)" (scheduled at 2026-02-28 01:27:34.479195-07:00)
|
|
[API] INFO:apscheduler.scheduler:Removed job fc1e5373c3c848aca8a21f73ae71b853
|
|
[API] INFO:services.data_fetcher:Fetching new data concurrently...
|
|
[API] INFO:services.data_fetcher:Downloading global airports database from ourairports.com...
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: date[2026-02-28 01:27:34 MST], next run at: 2026-02-28 01:27:34 MST)" (scheduled at 2026-02-28 01:27:34.483189-07:00)
|
|
[API] INFO:apscheduler.scheduler:Removed job 0055c6fe5db542db8e3c775bc914547b
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: date[2026-02-28 01:27:34 MST], next run at: 2026-02-28 01:27:34 MST)" (scheduled at 2026-02-28 01:27:34.483189-07:00)
|
|
[API] INFO:apscheduler.scheduler:Removed job 5af206250cf04a8b98d97edbc4d5c3d9
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_geopolitics (trigger: date[2026-02-28 01:27:34 MST], next run at: 2026-02-28 01:27:34 MST)" (scheduled at 2026-02-28 01:27:34.483189-07:00)
|
|
[API] INFO:apscheduler.scheduler:Removed job 8ae3e4373fd9490db20ecb05bd8f3462
|
|
[API] INFO:services.ais_stream:AIS Stream proxy started � receiving vessel data
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21822 AIS vessels
|
|
[API] INFO:services.data_fetcher:Fetching Geopolitics data...
|
|
[API] INFO:services.geopolitics:Fetching DeepStateMap from GitHub mirror...
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: date[2026-02-28 01:27:34 MST], next run at: 2026-02-28 01:27:34 MST)" executed successfully
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_flights (trigger: date[2026-02-28 01:27:34 MST], next run at: 2026-02-28 01:27:34 MST)" (scheduled at 2026-02-28 01:27:34.483189-07:00)
|
|
[API] INFO:apscheduler.scheduler:Removed job d08d93b1b8ec4e49915d64ba25f30a09
|
|
[API] INFO:services.geopolitics:Downloading latest DeepStateMap: https://raw.githubusercontent.com/cyterat/deepstate-map-data/main/data/deepstatemap_data_20260228.geojson
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.geopolitics:Fetching GDELT Global Military Incidents...
|
|
[API] INFO:services.data_fetcher:Loaded 1184 large airports into cache.
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 88 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21818 AIS vessels
|
|
[API] INFO:services.data_fetcher:Fetching Geopolitics data...
|
|
[API] INFO:services.geopolitics:Fetching GDELT Global Military Incidents...
|
|
[API] INFO:services.data_fetcher:Tracked flights: 0 total (0 from military)
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: date[2026-02-28 01:27:34 MST], next run at: 2026-02-28 01:27:34 MST)" executed successfully
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_geopolitics (trigger: date[2026-02-28 01:27:34 MST], next run at: 2026-02-28 01:27:34 MST)" executed successfully
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] ERROR:services.network_utils:curl fallback failed with exit code 0
|
|
[API] WARNING:services.data_fetcher:Routeset batch returned HTTP 500
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] Exception in thread Thread-8 (_readerthread):
|
|
[API] Traceback (most recent call last):
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\threading.py", line 1016, in _bootstrap_inner
|
|
[API] self.run()
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\threading.py", line 953, in run
|
|
[API] self._target(*self._args, **self._kwargs)
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\subprocess.py", line 1515, in _readerthread
|
|
[API] buffer.append(fh.read())
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\encodings\cp1252.py", line 23, in decode
|
|
[API] return codecs.charmap_decode(input,self.errors,decoding_table)[0]
|
|
[API] UnicodeDecodeError: 'charmap' codec can't decode byte 0x81 in position 58628: character maps to <undefined>
|
|
[API] ERROR:services.network_utils:curl fallback exception: 'NoneType' object has no attribute 'strip'
|
|
[API] WARNING:services.data_fetcher:Routeset batch returned HTTP 500
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] Exception in thread Thread-10 (_readerthread):
|
|
[API] Traceback (most recent call last):
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\threading.py", line 1016, in _bootstrap_inner
|
|
[API] self.run()
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\threading.py", line 953, in run
|
|
[API] self._target(*self._args, **self._kwargs)
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\subprocess.py", line 1515, in _readerthread
|
|
[API] buffer.append(fh.read())
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\encodings\cp1252.py", line 23, in decode
|
|
[API] return codecs.charmap_decode(input,self.errors,decoding_table)[0]
|
|
[API] UnicodeDecodeError: 'charmap' codec can't decode byte 0x8d in position 19763: character maps to <undefined>
|
|
[API] ERROR:services.network_utils:curl fallback exception: 'NoneType' object has no attribute 'strip'
|
|
[API] WARNING:services.data_fetcher:Routeset batch returned HTTP 500
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] Exception in thread Thread-12 (_readerthread):
|
|
[API] Traceback (most recent call last):
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\threading.py", line 1016, in _bootstrap_inner
|
|
[API] self.run()
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\threading.py", line 953, in run
|
|
[API] self._target(*self._args, **self._kwargs)
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\subprocess.py", line 1515, in _readerthread
|
|
[API] buffer.append(fh.read())
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\encodings\cp1252.py", line 23, in decode
|
|
[API] return codecs.charmap_decode(input,self.errors,decoding_table)[0]
|
|
[API] UnicodeDecodeError: 'charmap' codec can't decode byte 0x8d in position 63851: character maps to <undefined>
|
|
[API] ERROR:services.network_utils:curl fallback exception: 'NoneType' object has no attribute 'strip'
|
|
[API] WARNING:services.data_fetcher:Routeset batch returned HTTP 500
|
|
[API] INFO:services.data_fetcher:Resolved routes for 3552 / 4725 flights
|
|
[API] INFO:services.data_fetcher:Tracked flights: 9 total (9 from civilian)
|
|
[API] INFO:services.data_fetcher:Trail accumulation: 1253 active trails, 0 pruned
|
|
[API] INFO:services.data_fetcher:Data update complete.
|
|
[API] INFO:apscheduler.executors.default:Job "update_all_data (trigger: date[2026-02-28 01:27:34 MST], next run at: 2026-02-28 01:27:34 MST)" executed successfully
|
|
[API] INFO:services.data_fetcher:Resolved routes for 3468 / 4726 flights
|
|
[API] INFO:services.data_fetcher:Tracked flights: 9 total (9 from civilian)
|
|
[API] INFO:services.data_fetcher:Trail accumulation: 1334 active trails, 0 pruned
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_flights (trigger: date[2026-02-28 01:27:34 MST], next run at: 2026-02-28 01:27:34 MST)" executed successfully
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 5000 messages, tracking 26507 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26507 vessels
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 01:29:34 MST)" (scheduled at 2026-02-28 01:28:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 01:29:34 MST)" (scheduled at 2026-02-28 01:28:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21734 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 01:29:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 01:29:34 MST)" executed successfully
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 10000 messages, tracking 26414 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26414 vessels
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 15000 messages, tracking 26471 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26471 vessels
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 20000 messages, tracking 26528 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26528 vessels
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 01:30:34 MST)" (scheduled at 2026-02-28 01:29:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 01:30:34 MST)" (scheduled at 2026-02-28 01:29:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21754 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 01:30:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 01:30:34 MST)" executed successfully
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 25000 messages, tracking 26426 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26426 vessels
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 30000 messages, tracking 26469 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26469 vessels
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[NEXT] Γ¿» ./src/components/MapboxViewer.tsx:4:1
|
|
[NEXT] Module not found: Can't resolve 'react-map-gl'
|
|
[NEXT] [0m [90m 2 |[39m
|
|
[NEXT] [90m 3 |[39m [36mimport[39m [33mReact[39m[33m,[39m { useRef[33m,[39m useEffect[33m,[39m useState[33m,[39m useMemo } [36mfrom[39m [32m"react"[39m[33m;[39m
|
|
[NEXT] [31m[1m>[22m[39m[90m 4 |[39m [36mimport[39m [33mMap[39m[33m,[39m { [33mSource[39m[33m,[39m [33mLayer[39m[33m,[39m [33mFog[39m[33m,[39m [33mSky[39m[33m,[39m useMap[33m,[39m [33mMapRef[39m } [36mfrom[39m [32m"react-map-gl"[39m[33m;[39m
|
|
[NEXT] [90m |[39m [31m[1m^[22m[39m[31m[1m^[22m[39m[31m[1m^[22m[39m[31m[1m^[22m[39m[31m[1m^[22m[39m[31m[1m^[22m[39m[31m[1m^[22m[39m[31m[1m^[22m[39m[31m[1m^[22m[39m[31m[1m^[22m[39m[31m[1m^[22m[39m[31m[1m^[22m[39m[31m[1m^[22m[39m[31m[1m^[22m[39m[31m[1m^[22m[39m[31m[1m^[22m[39m[31m[1m^[22m[39m[31m[1m^[22m[39m[31m[1m^[22m[39m[31m[1m^[22m[39m[31m[1m^[22m[39m[31m[1m^[22m[39m[31m[1m^[22m[39m[31m[1m^[22m[39m[31m[1m^[22m[39m[31m[1m^[22m[39m[31m[1m^[22m[39m[31m[1m^[22m[39m[31m[1m^[22m[39m[31m[1m^[22m[39m[31m[1m^[22m[39m[31m[1m^[22m[39m[31m[1m^[22m[39m[31m[1m^[22m[39m[31m[1m^[22m[39m[31m[1m^[22m[39m[31m[1m^[22m[39m[31m[1m^[22m[39m[31m[1m^[22m[39m[31m[1m^[22m[39m[31m[1m^[22m[39m[31m[1m^[22m[39m[31m[1m^[22m[39m[31m[1m^[22m[39m[31m[1m^[22m[39m[31m[1m^[22m[39m[31m[1m^[22m[39m[31m[1m^[22m[39m[31m[1m^[22m[39m[31m[1m^[22m[39m[31m[1m^[22m[39m[31m[1m^[22m[39m[31m[1m^[22m[39m[31m[1m^[22m[39m[31m[1m^[22m[39m[31m[1m^[22m[39m[31m[1m^[22m[39m[31m[1m^[22m[39m[31m[1m^[22m[39m[31m[1m^[22m[39m[31m[1m^[22m[39m[31m[1m^[22m[39m[31m[1m^[22m[39m[31m[1m^[22m[39m[31m[1m^[22m[39m[31m[1m^[22m[39m[31m[1m^[22m[39m[31m[1m^[22m[39m[31m[1m^[22m[39m[31m[1m^[22m[39m[31m[1m^[22m[39m[31m[1m^[22m[39m[31m[1m^[22m[39m[31m[1m^[22m[39m[31m[1m^[22m[39m[31m[1m^[22m[39m
|
|
[NEXT] [90m 5 |[39m [36mimport[39m type { [33mLayerProps[39m } [36mfrom[39m [32m"react-map-gl"[39m[33m;[39m
|
|
[NEXT] [90m 6 |[39m [36mimport[39m [32m"mapbox-gl/dist/mapbox-gl.css"[39m[33m;[39m
|
|
[NEXT] [90m 7 |[39m [36mimport[39m [33m*[39m [36mas[39m satellite [36mfrom[39m [32m"satellite.js"[39m[33m;[39m[0m
|
|
[NEXT]
|
|
[NEXT]
|
|
[NEXT]
|
|
[NEXT] Import trace:
|
|
[NEXT] Client Component Browser:
|
|
[NEXT] ./src/components/MapboxViewer.tsx [Client Component Browser]
|
|
[NEXT] ./src/app/page.tsx [Client Component Browser]
|
|
[NEXT] ./src/app/page.tsx [Server Component]
|
|
[NEXT]
|
|
[NEXT] https://nextjs.org/docs/messages/module-not-found
|
|
[NEXT]
|
|
[NEXT]
|
|
[NEXT] GET / 500 in 1745ms (compile: 1538ms, render: 207ms)
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 35000 messages, tracking 26505 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26505 vessels
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_flights (trigger: interval[0:03:00], next run at: 2026-02-28 01:33:34 MST)" (scheduled at 2026-02-28 01:30:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 01:31:34 MST)" (scheduled at 2026-02-28 01:30:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 01:31:34 MST)" (scheduled at 2026-02-28 01:30:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21759 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 01:31:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 01:31:34 MST)" executed successfully
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 40000 messages, tracking 26441 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26441 vessels
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 45000 messages, tracking 26489 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26489 vessels
|
|
[API] INFO:services.data_fetcher:Resolved routes for 3635 / 4687 flights
|
|
[API] INFO:services.data_fetcher:Tracked flights: 10 total (9 from civilian)
|
|
[API] INFO:services.data_fetcher:Trail accumulation: 1107 active trails, 0 pruned
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_flights (trigger: interval[0:03:00], next run at: 2026-02-28 01:33:34 MST)" executed successfully
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 50000 messages, tracking 26521 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26521 vessels
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 01:32:34 MST)" (scheduled at 2026-02-28 01:31:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 01:32:34 MST)" (scheduled at 2026-02-28 01:31:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21739 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 01:32:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 01:32:34 MST)" executed successfully
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 55000 messages, tracking 26439 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26439 vessels
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 60000 messages, tracking 26497 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26497 vessels
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 01:33:34 MST)" (scheduled at 2026-02-28 01:32:34.484200-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_geopolitics (trigger: interval[0:05:00], next run at: 2026-02-28 01:37:34 MST)" (scheduled at 2026-02-28 01:32:34.484716-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 01:33:34 MST)" (scheduled at 2026-02-28 01:32:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Fetching Geopolitics data...
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_geopolitics (trigger: interval[0:05:00], next run at: 2026-02-28 01:37:34 MST)" executed successfully
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21750 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 01:33:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 01:33:34 MST)" executed successfully
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 65000 messages, tracking 26426 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26426 vessels
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 70000 messages, tracking 26465 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26465 vessels
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 75000 messages, tracking 26524 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26524 vessels
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_flights (trigger: interval[0:03:00], next run at: 2026-02-28 01:36:34 MST)" (scheduled at 2026-02-28 01:33:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 01:34:34 MST)" (scheduled at 2026-02-28 01:33:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 01:34:34 MST)" (scheduled at 2026-02-28 01:33:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21759 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 01:34:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 01:34:34 MST)" executed successfully
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 80000 messages, tracking 26444 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26444 vessels
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 85000 messages, tracking 26503 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26503 vessels
|
|
[API] INFO:services.data_fetcher:Resolved routes for 3619 / 4699 flights
|
|
[API] INFO:services.data_fetcher:Tracked flights: 10 total (10 from civilian)
|
|
[API] INFO:services.data_fetcher:Trail accumulation: 1144 active trails, 0 pruned
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_flights (trigger: interval[0:03:00], next run at: 2026-02-28 01:36:34 MST)" executed successfully
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 90000 messages, tracking 26548 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26548 vessels
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 01:35:34 MST)" (scheduled at 2026-02-28 01:34:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 01:35:34 MST)" (scheduled at 2026-02-28 01:34:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21799 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 01:35:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 01:35:34 MST)" executed successfully
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 01:36:34 MST)" (scheduled at 2026-02-28 01:35:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 01:36:34 MST)" (scheduled at 2026-02-28 01:35:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21702 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 01:36:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 01:36:34 MST)" executed successfully
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 95000 messages, tracking 26375 vessels
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_flights (trigger: interval[0:03:00], next run at: 2026-02-28 01:39:34 MST)" (scheduled at 2026-02-28 01:36:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 01:37:34 MST)" (scheduled at 2026-02-28 01:36:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 01:37:34 MST)" (scheduled at 2026-02-28 01:36:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21544 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 01:37:34 MST)" executed successfully
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26375 vessels
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 01:37:34 MST)" executed successfully
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 100000 messages, tracking 26234 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26234 vessels
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 105000 messages, tracking 26278 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26278 vessels
|
|
[API] INFO:services.data_fetcher:Resolved routes for 3614 / 4704 flights
|
|
[API] INFO:services.data_fetcher:Tracked flights: 10 total (8 from civilian)
|
|
[API] INFO:services.data_fetcher:Trail accumulation: 1166 active trails, 0 pruned
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_flights (trigger: interval[0:03:00], next run at: 2026-02-28 01:39:34 MST)" executed successfully
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 110000 messages, tracking 26327 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26327 vessels
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 01:38:34 MST)" (scheduled at 2026-02-28 01:37:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 01:38:34 MST)" (scheduled at 2026-02-28 01:37:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_geopolitics (trigger: interval[0:05:00], next run at: 2026-02-28 01:42:34 MST)" (scheduled at 2026-02-28 01:37:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Fetching Geopolitics data...
|
|
[API] INFO:services.geopolitics:Fetching GDELT Global Military Incidents...
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21566 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 01:38:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 01:38:34 MST)" executed successfully
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_geopolitics (trigger: interval[0:05:00], next run at: 2026-02-28 01:42:34 MST)" executed successfully
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 115000 messages, tracking 26264 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26264 vessels
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 120000 messages, tracking 26320 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26320 vessels
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 01:39:34 MST)" (scheduled at 2026-02-28 01:38:34.484200-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 01:39:34 MST)" (scheduled at 2026-02-28 01:38:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21561 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 01:39:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 125000 messages, tracking 26214 vessels
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 01:39:34 MST)" executed successfully
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26214 vessels
|
|
[API] Traceback (most recent call last):
|
|
[API] File "F:\Codebase\Oracle\live-risk-dashboard\backend\main.py", line 110, in <module>
|
|
[API] uvicorn.run("main:app", host="0.0.0.0", port=8000, reload=True)
|
|
[API] File "F:\Codebase\Oracle\live-risk-dashboard\backend\venv\lib\site-packages\uvicorn\main.py", line 582, in run
|
|
[API] ChangeReload(config, target=server.run, sockets=[sock]).run()
|
|
[API] File "F:\Codebase\Oracle\live-risk-dashboard\backend\venv\lib\site-packages\uvicorn\supervisors\basereload.py", line 50, in run
|
|
[API] for changes in self:
|
|
[API] File "F:\Codebase\Oracle\live-risk-dashboard\backend\venv\lib\site-packages\uvicorn\supervisors\basereload.py", line 69, in __next__
|
|
[API] return self.should_restart()
|
|
[API] File "F:\Codebase\Oracle\live-risk-dashboard\backend\venv\lib\site-packages\uvicorn\supervisors\statreload.py", line 32, in should_restart
|
|
[API] for file in self.iter_py_files():
|
|
[API] File "F:\Codebase\Oracle\live-risk-dashboard\backend\venv\lib\site-packages\uvicorn\supervisors\statreload.py", line 52, in iter_py_files
|
|
[API] for path in list(reload_dir.rglob("*.py")):
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\pathlib.py", line 1047, in rglob
|
|
[API] for p in selector.select_from(self):
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\pathlib.py", line 493, in _select_from
|
|
[API] for p in successor_select(starting_point, is_dir, exists, scandir):
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\pathlib.py", line 440, in _select_from
|
|
[API] with scandir(parent_path) as scandir_it:
|
|
[API] FileNotFoundError: [WinError 3] The system cannot find the path specified: 'F:\\Codebase\\Oracle\\live-risk-dashboard\\frontend\\.next\\diagnostics'
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 130000 messages, tracking 26259 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26259 vessels
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 135000 messages, tracking 26309 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26309 vessels
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_flights (trigger: interval[0:03:00], next run at: 2026-02-28 01:42:34 MST)" (scheduled at 2026-02-28 01:39:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 01:40:34 MST)" (scheduled at 2026-02-28 01:39:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 01:40:34 MST)" (scheduled at 2026-02-28 01:39:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21545 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 01:40:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 140000 messages, tracking 26200 vessels
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26200 vessels
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 01:40:34 MST)" executed successfully
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 145000 messages, tracking 26253 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26253 vessels
|
|
[API] INFO:services.data_fetcher:Resolved routes for 3659 / 4759 flights
|
|
[API] INFO:services.data_fetcher:Tracked flights: 11 total (7 from civilian)
|
|
[API] INFO:services.data_fetcher:Trail accumulation: 1154 active trails, 0 pruned
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_flights (trigger: interval[0:03:00], next run at: 2026-02-28 01:42:34 MST)" executed successfully
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 150000 messages, tracking 26299 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26299 vessels
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 01:41:34 MST)" (scheduled at 2026-02-28 01:40:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 01:41:34 MST)" (scheduled at 2026-02-28 01:40:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21532 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 01:41:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 01:41:34 MST)" executed successfully
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 155000 messages, tracking 26191 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26191 vessels
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 160000 messages, tracking 26249 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26249 vessels
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 165000 messages, tracking 26305 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26305 vessels
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 01:42:34 MST)" (scheduled at 2026-02-28 01:41:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 01:42:34 MST)" (scheduled at 2026-02-28 01:41:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21527 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 01:42:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 01:42:34 MST)" executed successfully
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 170000 messages, tracking 26225 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26225 vessels
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 175000 messages, tracking 26272 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26272 vessels
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 180000 messages, tracking 26348 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26348 vessels
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_flights (trigger: interval[0:03:00], next run at: 2026-02-28 01:45:34 MST)" (scheduled at 2026-02-28 01:42:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 01:43:34 MST)" (scheduled at 2026-02-28 01:42:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 01:43:34 MST)" (scheduled at 2026-02-28 01:42:34.484716-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_geopolitics (trigger: interval[0:05:00], next run at: 2026-02-28 01:47:34 MST)" (scheduled at 2026-02-28 01:42:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:services.data_fetcher:Fetching Geopolitics data...
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_geopolitics (trigger: interval[0:05:00], next run at: 2026-02-28 01:47:34 MST)" executed successfully
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21603 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 01:43:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 01:43:34 MST)" executed successfully
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 185000 messages, tracking 26276 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26276 vessels
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] INFO:services.data_fetcher:Resolved routes for 3678 / 4776 flights
|
|
[API] INFO:services.data_fetcher:Tracked flights: 12 total (7 from civilian)
|
|
[API] INFO:services.data_fetcher:Trail accumulation: 1163 active trails, 0 pruned
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_flights (trigger: interval[0:03:00], next run at: 2026-02-28 01:45:34 MST)" executed successfully
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 01:44:34 MST)" (scheduled at 2026-02-28 01:43:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 01:44:34 MST)" (scheduled at 2026-02-28 01:43:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21565 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 01:44:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 01:44:34 MST)" executed successfully
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Error: Unexpected server response: 503
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 01:45:34 MST)" (scheduled at 2026-02-28 01:44:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 01:45:34 MST)" (scheduled at 2026-02-28 01:44:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21303 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 01:45:34 MST)" executed successfully
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 01:45:34 MST)" executed successfully
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 190000 messages, tracking 26003 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26003 vessels
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 195000 messages, tracking 26069 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26069 vessels
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_flights (trigger: interval[0:03:00], next run at: 2026-02-28 01:48:34 MST)" (scheduled at 2026-02-28 01:45:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 01:46:34 MST)" (scheduled at 2026-02-28 01:45:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 01:46:34 MST)" (scheduled at 2026-02-28 01:45:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21348 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 01:46:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 01:46:34 MST)" executed successfully
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 200000 messages, tracking 26002 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26002 vessels
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 205000 messages, tracking 26061 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26061 vessels
|
|
[API] INFO:services.data_fetcher:Resolved routes for 3695 / 4831 flights
|
|
[API] INFO:services.data_fetcher:Tracked flights: 12 total (6 from civilian)
|
|
[API] INFO:services.data_fetcher:Trail accumulation: 1184 active trails, 0 pruned
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_flights (trigger: interval[0:03:00], next run at: 2026-02-28 01:48:34 MST)" executed successfully
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 210000 messages, tracking 26123 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26123 vessels
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 01:47:34 MST)" (scheduled at 2026-02-28 01:46:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 01:47:34 MST)" (scheduled at 2026-02-28 01:46:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21361 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 01:47:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 215000 messages, tracking 25997 vessels
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 01:47:34 MST)" executed successfully
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25997 vessels
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Error: Unexpected server response: 503
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Error: Unexpected server response: 503
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 01:48:34 MST)" (scheduled at 2026-02-28 01:47:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 01:48:34 MST)" (scheduled at 2026-02-28 01:47:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_geopolitics (trigger: interval[0:05:00], next run at: 2026-02-28 01:52:34 MST)" (scheduled at 2026-02-28 01:47:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Fetching Geopolitics data...
|
|
[API] INFO:services.geopolitics:Fetching GDELT Global Military Incidents...
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21162 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 01:48:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 01:48:34 MST)" executed successfully
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_geopolitics (trigger: interval[0:05:00], next run at: 2026-02-28 01:52:34 MST)" executed successfully
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_flights (trigger: interval[0:03:00], next run at: 2026-02-28 01:51:34 MST)" (scheduled at 2026-02-28 01:48:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 01:49:34 MST)" (scheduled at 2026-02-28 01:48:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 01:49:34 MST)" (scheduled at 2026-02-28 01:48:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 20957 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 01:49:34 MST)" executed successfully
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 01:49:34 MST)" executed successfully
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 220000 messages, tracking 25616 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25616 vessels
|
|
[API] INFO:services.data_fetcher:Resolved routes for 3678 / 4784 flights
|
|
[API] INFO:services.data_fetcher:Tracked flights: 14 total (8 from civilian)
|
|
[API] INFO:services.data_fetcher:Trail accumulation: 1181 active trails, 0 pruned
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_flights (trigger: interval[0:03:00], next run at: 2026-02-28 01:51:34 MST)" executed successfully
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 225000 messages, tracking 25683 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25683 vessels
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 01:50:34 MST)" (scheduled at 2026-02-28 01:49:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 01:50:34 MST)" (scheduled at 2026-02-28 01:49:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 20921 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 01:50:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 01:50:34 MST)" executed successfully
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 230000 messages, tracking 25559 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25559 vessels
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 235000 messages, tracking 25678 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25678 vessels
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 240000 messages, tracking 25777 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25777 vessels
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 01:51:34 MST)" (scheduled at 2026-02-28 01:50:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 01:51:34 MST)" (scheduled at 2026-02-28 01:50:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21264 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 01:51:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 01:51:34 MST)" executed successfully
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 245000 messages, tracking 25900 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25900 vessels
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 250000 messages, tracking 25967 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25967 vessels
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 255000 messages, tracking 26032 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26032 vessels
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_flights (trigger: interval[0:03:00], next run at: 2026-02-28 01:54:34 MST)" (scheduled at 2026-02-28 01:51:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 01:52:34 MST)" (scheduled at 2026-02-28 01:51:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 01:52:34 MST)" (scheduled at 2026-02-28 01:51:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21391 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 01:52:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 01:52:34 MST)" executed successfully
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 260000 messages, tracking 26052 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26052 vessels
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 265000 messages, tracking 26114 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26114 vessels
|
|
[API] INFO:services.data_fetcher:Resolved routes for 3697 / 4853 flights
|
|
[API] INFO:services.data_fetcher:Tracked flights: 14 total (8 from civilian)
|
|
[API] INFO:services.data_fetcher:Trail accumulation: 1225 active trails, 0 pruned
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_flights (trigger: interval[0:03:00], next run at: 2026-02-28 01:54:34 MST)" executed successfully
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 270000 messages, tracking 26159 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26159 vessels
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 01:53:34 MST)" (scheduled at 2026-02-28 01:52:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 01:53:34 MST)" (scheduled at 2026-02-28 01:52:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_geopolitics (trigger: interval[0:05:00], next run at: 2026-02-28 01:57:34 MST)" (scheduled at 2026-02-28 01:52:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Fetching Geopolitics data...
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_geopolitics (trigger: interval[0:05:00], next run at: 2026-02-28 01:57:34 MST)" executed successfully
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21369 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 01:53:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 01:53:34 MST)" executed successfully
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 275000 messages, tracking 26068 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26068 vessels
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 280000 messages, tracking 26141 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26141 vessels
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 01:54:34 MST)" (scheduled at 2026-02-28 01:53:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 01:54:34 MST)" (scheduled at 2026-02-28 01:53:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21303 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 01:54:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 01:54:34 MST)" executed successfully
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 285000 messages, tracking 25974 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25974 vessels
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 290000 messages, tracking 26026 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26026 vessels
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 295000 messages, tracking 26073 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26073 vessels
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_flights (trigger: interval[0:03:00], next run at: 2026-02-28 01:57:34 MST)" (scheduled at 2026-02-28 01:54:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 01:55:34 MST)" (scheduled at 2026-02-28 01:54:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 01:55:34 MST)" (scheduled at 2026-02-28 01:54:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21377 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 01:55:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 01:55:34 MST)" executed successfully
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 300000 messages, tracking 26024 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26024 vessels
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 305000 messages, tracking 26114 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26114 vessels
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 310000 messages, tracking 26165 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26165 vessels
|
|
[API] INFO:services.data_fetcher:Resolved routes for 3646 / 4782 flights
|
|
[API] INFO:services.data_fetcher:Tracked flights: 14 total (8 from civilian)
|
|
[API] INFO:services.data_fetcher:Trail accumulation: 1203 active trails, 0 pruned
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_flights (trigger: interval[0:03:00], next run at: 2026-02-28 01:57:34 MST)" executed successfully
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 01:56:34 MST)" (scheduled at 2026-02-28 01:55:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 01:56:34 MST)" (scheduled at 2026-02-28 01:55:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21413 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 01:56:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 01:56:34 MST)" executed successfully
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 01:57:34 MST)" (scheduled at 2026-02-28 01:56:34.484200-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 01:57:34 MST)" (scheduled at 2026-02-28 01:56:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21054 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 01:57:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 01:57:34 MST)" executed successfully
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 315000 messages, tracking 25673 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25673 vessels
|
|
[API] INFO:apscheduler.executors.default:Running job "update_all_data (trigger: interval[0:30:00], next run at: 2026-02-28 02:27:34 MST)" (scheduled at 2026-02-28 01:57:34.482190-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_flights (trigger: interval[0:03:00], next run at: 2026-02-28 02:00:34 MST)" (scheduled at 2026-02-28 01:57:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 01:58:34 MST)" (scheduled at 2026-02-28 01:57:34.484716-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 01:58:34 MST)" (scheduled at 2026-02-28 01:57:34.484200-07:00)
|
|
[API] INFO:services.data_fetcher:Fetching new data concurrently...
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_geopolitics (trigger: interval[0:05:00], next run at: 2026-02-28 02:02:34 MST)" (scheduled at 2026-02-28 01:57:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:services.data_fetcher:Fetching Geopolitics data...
|
|
[API] INFO:services.geopolitics:Fetching GDELT Global Military Incidents...
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 20895 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 01:58:34 MST)" executed successfully
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 20895 AIS vessels
|
|
[API] INFO:services.data_fetcher:Fetching Geopolitics data...
|
|
[API] INFO:services.geopolitics:Fetching GDELT Global Military Incidents...
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.data_fetcher:Tracked flights: 14 total (0 from military)
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 01:58:34 MST)" executed successfully
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_geopolitics (trigger: interval[0:05:00], next run at: 2026-02-28 02:02:34 MST)" executed successfully
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 320000 messages, tracking 25498 vessels
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25498 vessels
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] ERROR:services.network_utils:curl fallback failed with exit code 0
|
|
[API] WARNING:services.data_fetcher:Routeset batch returned HTTP 500
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (502 Server Error: Bad Gateway for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] ERROR:services.network_utils:curl fallback failed with exit code 0
|
|
[API] WARNING:services.data_fetcher:Routeset batch returned HTTP 500
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 325000 messages, tracking 25573 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25573 vessels
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] Exception in thread Thread-26 (_readerthread):
|
|
[API] Traceback (most recent call last):
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\threading.py", line 1016, in _bootstrap_inner
|
|
[API] self.run()
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\threading.py", line 953, in run
|
|
[API] self._target(*self._args, **self._kwargs)
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\subprocess.py", line 1515, in _readerthread
|
|
[API] buffer.append(fh.read())
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\encodings\cp1252.py", line 23, in decode
|
|
[API] return codecs.charmap_decode(input,self.errors,decoding_table)[0]
|
|
[API] UnicodeDecodeError: 'charmap' codec can't decode byte 0x8d in position 17679: character maps to <undefined>
|
|
[API] ERROR:services.network_utils:curl fallback exception: 'NoneType' object has no attribute 'strip'
|
|
[API] WARNING:services.data_fetcher:Routeset batch returned HTTP 500
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] Exception in thread Thread-28 (_readerthread):
|
|
[API] Traceback (most recent call last):
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\threading.py", line 1016, in _bootstrap_inner
|
|
[API] self.run()
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\threading.py", line 953, in run
|
|
[API] self._target(*self._args, **self._kwargs)
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\subprocess.py", line 1515, in _readerthread
|
|
[API] buffer.append(fh.read())
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\encodings\cp1252.py", line 23, in decode
|
|
[API] return codecs.charmap_decode(input,self.errors,decoding_table)[0]
|
|
[API] UnicodeDecodeError: 'charmap' codec can't decode byte 0x81 in position 4282: character maps to <undefined>
|
|
[API] ERROR:services.network_utils:curl fallback exception: 'NoneType' object has no attribute 'strip'
|
|
[API] WARNING:services.data_fetcher:Routeset batch returned HTTP 500
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 330000 messages, tracking 25627 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25627 vessels
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] Exception in thread Thread-34 (_readerthread):
|
|
[API] Traceback (most recent call last):
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\threading.py", line 1016, in _bootstrap_inner
|
|
[API] self.run()
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\threading.py", line 953, in run
|
|
[API] self._target(*self._args, **self._kwargs)
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\subprocess.py", line 1515, in _readerthread
|
|
[API] buffer.append(fh.read())
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\encodings\cp1252.py", line 23, in decode
|
|
[API] return codecs.charmap_decode(input,self.errors,decoding_table)[0]
|
|
[API] UnicodeDecodeError: 'charmap' codec can't decode byte 0x8d in position 70312: character maps to <undefined>
|
|
[API] ERROR:services.network_utils:curl fallback exception: 'NoneType' object has no attribute 'strip'
|
|
[API] WARNING:services.data_fetcher:Routeset batch returned HTTP 500
|
|
[API] INFO:services.data_fetcher:Resolved routes for 3485 / 4853 flights
|
|
[API] INFO:services.data_fetcher:Tracked flights: 15 total (9 from civilian)
|
|
[API] INFO:services.data_fetcher:Trail accumulation: 1421 active trails, 374 pruned
|
|
[API] INFO:services.data_fetcher:Data update complete.
|
|
[API] INFO:apscheduler.executors.default:Job "update_all_data (trigger: interval[0:30:00], next run at: 2026-02-28 02:27:34 MST)" executed successfully
|
|
[API] INFO:services.data_fetcher:Resolved routes for 3555 / 4852 flights
|
|
[API] INFO:services.data_fetcher:Tracked flights: 15 total (9 from civilian)
|
|
[API] INFO:services.data_fetcher:Trail accumulation: 1350 active trails, 0 pruned
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_flights (trigger: interval[0:03:00], next run at: 2026-02-28 02:00:34 MST)" executed successfully
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 01:59:34 MST)" (scheduled at 2026-02-28 01:58:34.484200-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 01:59:34 MST)" (scheduled at 2026-02-28 01:58:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21072 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 01:59:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 335000 messages, tracking 25674 vessels
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 01:59:34 MST)" executed successfully
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25674 vessels
|
|
[NEXT] Persisting failed: Unable to write SST file 00013700.sst
|
|
[NEXT]
|
|
[NEXT] Caused by:
|
|
[NEXT] The system cannot find the path specified. (os error 3)
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 340000 messages, tracking 25784 vessels
|
|
[NEXT] Persisting failed: Another write batch or compaction is already active (Only a single write operations is allowed at a time)
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25784 vessels
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[NEXT] Persisting failed: Another write batch or compaction is already active (Only a single write operations is allowed at a time)
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:00:34 MST)" (scheduled at 2026-02-28 01:59:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:00:34 MST)" (scheduled at 2026-02-28 01:59:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21272 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:00:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:00:34 MST)" executed successfully
|
|
[NEXT] Persisting failed: Another write batch or compaction is already active (Only a single write operations is allowed at a time)
|
|
[NEXT] Persisting failed: Another write batch or compaction is already active (Only a single write operations is allowed at a time)
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 345000 messages, tracking 25927 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25927 vessels
|
|
[NEXT] Persisting failed: Another write batch or compaction is already active (Only a single write operations is allowed at a time)
|
|
[NEXT] Persisting failed: Another write batch or compaction is already active (Only a single write operations is allowed at a time)
|
|
[NEXT] Persisting failed: Another write batch or compaction is already active (Only a single write operations is allowed at a time)
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 350000 messages, tracking 26004 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26004 vessels
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 355000 messages, tracking 26058 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26058 vessels
|
|
[NEXT] Persisting failed: Another write batch or compaction is already active (Only a single write operations is allowed at a time)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_flights (trigger: interval[0:03:00], next run at: 2026-02-28 02:03:34 MST)" (scheduled at 2026-02-28 02:00:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:01:34 MST)" (scheduled at 2026-02-28 02:00:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:01:34 MST)" (scheduled at 2026-02-28 02:00:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21283 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:01:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:01:34 MST)" executed successfully
|
|
[NEXT] Persisting failed: Another write batch or compaction is already active (Only a single write operations is allowed at a time)
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 360000 messages, tracking 25910 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25910 vessels
|
|
[NEXT] Persisting failed: Another write batch or compaction is already active (Only a single write operations is allowed at a time)
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 365000 messages, tracking 25959 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25959 vessels
|
|
[API] INFO:services.data_fetcher:Resolved routes for 3705 / 4837 flights
|
|
[API] INFO:services.data_fetcher:Tracked flights: 15 total (11 from civilian)
|
|
[API] INFO:services.data_fetcher:Trail accumulation: 1200 active trails, 0 pruned
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_flights (trigger: interval[0:03:00], next run at: 2026-02-28 02:03:34 MST)" executed successfully
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 370000 messages, tracking 26006 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26006 vessels
|
|
[NEXT] Persisting failed: Another write batch or compaction is already active (Only a single write operations is allowed at a time)
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:02:34 MST)" (scheduled at 2026-02-28 02:01:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:02:34 MST)" (scheduled at 2026-02-28 02:01:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21301 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:02:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:02:34 MST)" executed successfully
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[NEXT] Persisting failed: Another write batch or compaction is already active (Only a single write operations is allowed at a time)
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[NEXT] Persisting failed: Another write batch or compaction is already active (Only a single write operations is allowed at a time)
|
|
[NEXT]
|
|
[NEXT] thread 'tokio-runtime-worker' (13712) panicked at C:\actions-runner\_work\next.js\next.js\turbopack\crates\turbo-tasks-backend\src\backend\operation\mod.rs:156:17:
|
|
[NEXT] Failed to restore task data (corrupted database or bug): Meta for get_type (TaskId 94695))
|
|
[NEXT]
|
|
[NEXT] Caused by:
|
|
[NEXT] 0: Looking up data for TaskId 94695 from database failed
|
|
[NEXT] 1: Unable to open static sorted file referenced from 00013673.meta
|
|
[NEXT] 2: Unable to open static sorted file 00013672.sst
|
|
[NEXT] 3: The system cannot find the path specified. (os error 3)
|
|
[NEXT] note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
|
|
[NEXT]
|
|
[NEXT] thread 'tokio-runtime-worker' (13712) panicked at C:\actions-runner\_work\next.js\next.js\turbopack\crates\turbo-tasks-backend\src\backend\operation\mod.rs:156:17:
|
|
[NEXT] Failed to restore task data (corrupted database or bug): Meta for get_type (TaskId 94687))
|
|
[NEXT]
|
|
[NEXT] Caused by:
|
|
[NEXT] 0: Looking up data for TaskId 94687 from database failed
|
|
[NEXT] 1: Unable to open static sorted file referenced from 00013673.meta
|
|
[NEXT] 2: Unable to open static sorted file 00013672.sst
|
|
[NEXT] 3: The system cannot find the path specified. (os error 3)
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[NEXT]
|
|
[NEXT] thread 'tokio-runtime-worker' (27016) panicked at C:\actions-runner\_work\next.js\next.js\turbopack\crates\turbo-tasks-backend\src\backend\operation\mod.rs:156:17:
|
|
[NEXT] Failed to restore task data (corrupted database or bug): Meta for FileContent::parse_json (TaskId 81))
|
|
[NEXT]
|
|
[NEXT] Caused by:
|
|
[NEXT] 0: Looking up data for TaskId 81 from database failed
|
|
[NEXT] 1: Unable to open static sorted file referenced from 00013673.meta
|
|
[NEXT] 2: Unable to open static sorted file 00013672.sst
|
|
[NEXT] 3: The system cannot find the path specified. (os error 3)
|
|
[NEXT]
|
|
[NEXT] thread 'tokio-runtime-worker' (27016) panicked at C:\actions-runner\_work\next.js\next.js\turbopack\crates\turbo-tasks-backend\src\backend\operation\mod.rs:156:17:
|
|
[NEXT] Failed to restore task data (corrupted database or bug): Meta for determine_module_type_for_directory (TaskId 96455))
|
|
[NEXT]
|
|
[NEXT] Caused by:
|
|
[NEXT] 0: Looking up data for TaskId 96455 from database failed
|
|
[NEXT] 1: Unable to open static sorted file referenced from 00013673.meta
|
|
[NEXT] 2: Unable to open static sorted file 00013672.sst
|
|
[NEXT] 3: The system cannot find the path specified. (os error 3)
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[NEXT] ΓÜá Found a change in next.config.ts. Restarting the server to apply the changes...
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:03:34 MST)" (scheduled at 2026-02-28 02:02:34.484200-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:03:34 MST)" (scheduled at 2026-02-28 02:02:34.484716-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_geopolitics (trigger: interval[0:05:00], next run at: 2026-02-28 02:07:34 MST)" (scheduled at 2026-02-28 02:02:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Fetching Geopolitics data...
|
|
[API] INFO:services.geopolitics:Fetching DeepStateMap from GitHub mirror...
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21298 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:03:34 MST)" executed successfully
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.geopolitics:Downloading latest DeepStateMap: https://raw.githubusercontent.com/cyterat/deepstate-map-data/main/data/deepstatemap_data_20260228.geojson
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_geopolitics (trigger: interval[0:05:00], next run at: 2026-02-28 02:07:34 MST)" executed successfully
|
|
[NEXT] Γû▓ Next.js 16.1.6 (Turbopack)
|
|
[NEXT] - Local: http://localhost:3000
|
|
[NEXT] - Network: http://10.0.0.234:3000
|
|
[NEXT]
|
|
[NEXT] Γ£ô Starting...
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[NEXT] Γ£ô Ready in 2.4s
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:03:34 MST)" executed successfully
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[NEXT] Persisting failed: Unable to write SST file 00000011.sst
|
|
[NEXT]
|
|
[NEXT] Caused by:
|
|
[NEXT] The system cannot find the path specified. (os error 3)
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[NEXT] Persisting failed: Another write batch or compaction is already active (Only a single write operations is allowed at a time)
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[NEXT] Persisting failed: Another write batch or compaction is already active (Only a single write operations is allowed at a time)
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 375000 messages, tracking 25882 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25882 vessels
|
|
[NEXT] Persisting failed: Another write batch or compaction is already active (Only a single write operations is allowed at a time)
|
|
[NEXT] Persisting failed: Another write batch or compaction is already active (Only a single write operations is allowed at a time)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_flights (trigger: interval[0:03:00], next run at: 2026-02-28 02:06:34 MST)" (scheduled at 2026-02-28 02:03:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:04:34 MST)" (scheduled at 2026-02-28 02:03:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:04:34 MST)" (scheduled at 2026-02-28 02:03:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21343 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:04:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:04:34 MST)" executed successfully
|
|
[NEXT] Persisting failed: Another write batch or compaction is already active (Only a single write operations is allowed at a time)
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 380000 messages, tracking 25941 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25941 vessels
|
|
[NEXT] Persisting failed: Another write batch or compaction is already active (Only a single write operations is allowed at a time)
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 385000 messages, tracking 26018 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26018 vessels
|
|
[NEXT] Persisting failed: Another write batch or compaction is already active (Only a single write operations is allowed at a time)
|
|
[NEXT] Persisting failed: Another write batch or compaction is already active (Only a single write operations is allowed at a time)
|
|
[API] INFO:services.data_fetcher:Resolved routes for 3723 / 4874 flights
|
|
[API] INFO:services.data_fetcher:Tracked flights: 15 total (11 from civilian)
|
|
[API] INFO:services.data_fetcher:Trail accumulation: 1212 active trails, 185 pruned
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_flights (trigger: interval[0:03:00], next run at: 2026-02-28 02:06:34 MST)" executed successfully
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 390000 messages, tracking 26056 vessels
|
|
[NEXT] Persisting failed: Another write batch or compaction is already active (Only a single write operations is allowed at a time)
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26056 vessels
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:05:34 MST)" (scheduled at 2026-02-28 02:04:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:05:34 MST)" (scheduled at 2026-02-28 02:04:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21413 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:05:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:05:34 MST)" executed successfully
|
|
[NEXT] Persisting failed: Another write batch or compaction is already active (Only a single write operations is allowed at a time)
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 395000 messages, tracking 26008 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26008 vessels
|
|
[NEXT] Persisting failed: Another write batch or compaction is already active (Only a single write operations is allowed at a time)
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 400000 messages, tracking 26094 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26094 vessels
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[NEXT] Persisting failed: Another write batch or compaction is already active (Only a single write operations is allowed at a time)
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 405000 messages, tracking 26248 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26248 vessels
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:06:34 MST)" (scheduled at 2026-02-28 02:05:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:06:34 MST)" (scheduled at 2026-02-28 02:05:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21156 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:06:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:06:34 MST)" executed successfully
|
|
[NEXT] Persisting failed: Another write batch or compaction is already active (Only a single write operations is allowed at a time)
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 410000 messages, tracking 25766 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25766 vessels
|
|
[NEXT] Persisting failed: Another write batch or compaction is already active (Only a single write operations is allowed at a time)
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 415000 messages, tracking 25852 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25852 vessels
|
|
[NEXT] Persisting failed: Another write batch or compaction is already active (Only a single write operations is allowed at a time)
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 420000 messages, tracking 25887 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25887 vessels
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_flights (trigger: interval[0:03:00], next run at: 2026-02-28 02:09:34 MST)" (scheduled at 2026-02-28 02:06:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:07:34 MST)" (scheduled at 2026-02-28 02:06:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:07:34 MST)" (scheduled at 2026-02-28 02:06:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21161 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:07:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:07:34 MST)" executed successfully
|
|
[NEXT] Persisting failed: Another write batch or compaction is already active (Only a single write operations is allowed at a time)
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 425000 messages, tracking 25721 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25721 vessels
|
|
[NEXT] Persisting failed: Another write batch or compaction is already active (Only a single write operations is allowed at a time)
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 430000 messages, tracking 25775 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25775 vessels
|
|
[API] INFO:services.data_fetcher:Resolved routes for 3676 / 4798 flights
|
|
[API] INFO:services.data_fetcher:Tracked flights: 15 total (11 from civilian)
|
|
[API] INFO:services.data_fetcher:Trail accumulation: 1194 active trails, 0 pruned
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_flights (trigger: interval[0:03:00], next run at: 2026-02-28 02:09:34 MST)" executed successfully
|
|
[NEXT] Persisting failed: Another write batch or compaction is already active (Only a single write operations is allowed at a time)
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:08:34 MST)" (scheduled at 2026-02-28 02:07:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:08:34 MST)" (scheduled at 2026-02-28 02:07:34.484716-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_geopolitics (trigger: interval[0:05:00], next run at: 2026-02-28 02:12:34 MST)" (scheduled at 2026-02-28 02:07:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:services.data_fetcher:Fetching Geopolitics data...
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21131 AIS vessels
|
|
[API] INFO:services.geopolitics:Fetching GDELT Global Military Incidents...
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:08:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:08:34 MST)" executed successfully
|
|
[NEXT] Persisting failed: Another write batch or compaction is already active (Only a single write operations is allowed at a time)
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_geopolitics (trigger: interval[0:05:00], next run at: 2026-02-28 02:12:34 MST)" executed successfully
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 435000 messages, tracking 25655 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25655 vessels
|
|
[NEXT] Persisting failed: Another write batch or compaction is already active (Only a single write operations is allowed at a time)
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 440000 messages, tracking 25861 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25861 vessels
|
|
[NEXT] Persisting failed: Another write batch or compaction is already active (Only a single write operations is allowed at a time)
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:09:34 MST)" (scheduled at 2026-02-28 02:08:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:09:34 MST)" (scheduled at 2026-02-28 02:08:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21388 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:09:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 445000 messages, tracking 25924 vessels
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25924 vessels
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:09:34 MST)" executed successfully
|
|
[NEXT] Persisting failed: Another write batch or compaction is already active (Only a single write operations is allowed at a time)
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 450000 messages, tracking 26053 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26053 vessels
|
|
[NEXT] Persisting failed: Another write batch or compaction is already active (Only a single write operations is allowed at a time)
|
|
[NEXT] Persisting failed: Another write batch or compaction is already active (Only a single write operations is allowed at a time)
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 455000 messages, tracking 26139 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26139 vessels
|
|
[NEXT] Persisting failed: Another write batch or compaction is already active (Only a single write operations is allowed at a time)
|
|
[NEXT] Persisting failed: Another write batch or compaction is already active (Only a single write operations is allowed at a time)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_flights (trigger: interval[0:03:00], next run at: 2026-02-28 02:12:34 MST)" (scheduled at 2026-02-28 02:09:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:10:34 MST)" (scheduled at 2026-02-28 02:09:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:10:34 MST)" (scheduled at 2026-02-28 02:09:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21450 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:10:34 MST)" executed successfully
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 460000 messages, tracking 25966 vessels
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25966 vessels
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:10:34 MST)" executed successfully
|
|
[NEXT] Persisting failed: Another write batch or compaction is already active (Only a single write operations is allowed at a time)
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 465000 messages, tracking 26019 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26019 vessels
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[NEXT] Persisting failed: Another write batch or compaction is already active (Only a single write operations is allowed at a time)
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[NEXT] Persisting failed: Another write batch or compaction is already active (Only a single write operations is allowed at a time)
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] INFO:services.data_fetcher:Resolved routes for 3697 / 4868 flights
|
|
[API] INFO:services.data_fetcher:Tracked flights: 15 total (9 from civilian)
|
|
[API] INFO:services.data_fetcher:Trail accumulation: 1241 active trails, 202 pruned
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_flights (trigger: interval[0:03:00], next run at: 2026-02-28 02:12:34 MST)" executed successfully
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[NEXT] Persisting failed: Another write batch or compaction is already active (Only a single write operations is allowed at a time)
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:11:34 MST)" (scheduled at 2026-02-28 02:10:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:11:34 MST)" (scheduled at 2026-02-28 02:10:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21363 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:11:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:11:34 MST)" executed successfully
|
|
[NEXT] Persisting failed: Another write batch or compaction is already active (Only a single write operations is allowed at a time)
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[NEXT] Persisting failed: Another write batch or compaction is already active (Only a single write operations is allowed at a time)
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[NEXT] Persisting failed: Another write batch or compaction is already active (Only a single write operations is allowed at a time)
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:12:34 MST)" (scheduled at 2026-02-28 02:11:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:12:34 MST)" (scheduled at 2026-02-28 02:11:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21381 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:12:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:12:34 MST)" executed successfully
|
|
[NEXT] Persisting failed: Another write batch or compaction is already active (Only a single write operations is allowed at a time)
|
|
[NEXT] Persisting failed: Another write batch or compaction is already active (Only a single write operations is allowed at a time)
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 470000 messages, tracking 25931 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25931 vessels
|
|
[NEXT] Persisting failed: Another write batch or compaction is already active (Only a single write operations is allowed at a time)
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 475000 messages, tracking 26027 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26027 vessels
|
|
[NEXT] Persisting failed: Another write batch or compaction is already active (Only a single write operations is allowed at a time)
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 480000 messages, tracking 26081 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26081 vessels
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_flights (trigger: interval[0:03:00], next run at: 2026-02-28 02:15:34 MST)" (scheduled at 2026-02-28 02:12:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:13:34 MST)" (scheduled at 2026-02-28 02:12:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:13:34 MST)" (scheduled at 2026-02-28 02:12:34.484716-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_geopolitics (trigger: interval[0:05:00], next run at: 2026-02-28 02:17:34 MST)" (scheduled at 2026-02-28 02:12:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:services.data_fetcher:Fetching Geopolitics data...
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21540 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_geopolitics (trigger: interval[0:05:00], next run at: 2026-02-28 02:17:34 MST)" executed successfully
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:13:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:13:34 MST)" executed successfully
|
|
[NEXT] Persisting failed: Another write batch or compaction is already active (Only a single write operations is allowed at a time)
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 485000 messages, tracking 26081 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26081 vessels
|
|
[NEXT] Persisting failed: Another write batch or compaction is already active (Only a single write operations is allowed at a time)
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 490000 messages, tracking 26145 vessels
|
|
[NEXT] Persisting failed: Another write batch or compaction is already active (Only a single write operations is allowed at a time)
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26145 vessels
|
|
[API] INFO:services.data_fetcher:Resolved routes for 3720 / 4839 flights
|
|
[API] INFO:services.data_fetcher:Tracked flights: 15 total (8 from civilian)
|
|
[API] INFO:services.data_fetcher:Trail accumulation: 1200 active trails, 0 pruned
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_flights (trigger: interval[0:03:00], next run at: 2026-02-28 02:15:34 MST)" executed successfully
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 495000 messages, tracking 26204 vessels
|
|
[NEXT] Persisting failed: Another write batch or compaction is already active (Only a single write operations is allowed at a time)
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26204 vessels
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:14:34 MST)" (scheduled at 2026-02-28 02:13:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:14:34 MST)" (scheduled at 2026-02-28 02:13:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21519 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:14:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:14:34 MST)" executed successfully
|
|
[NEXT] Persisting failed: Another write batch or compaction is already active (Only a single write operations is allowed at a time)
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[NEXT] Persisting failed: Another write batch or compaction is already active (Only a single write operations is allowed at a time)
|
|
[NEXT] Γùï Compiling / ...
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 500000 messages, tracking 26081 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26081 vessels
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:15:34 MST)" (scheduled at 2026-02-28 02:14:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:15:34 MST)" (scheduled at 2026-02-28 02:14:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21431 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:15:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 505000 messages, tracking 25946 vessels
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:15:34 MST)" executed successfully
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25946 vessels
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 510000 messages, tracking 26013 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26013 vessels
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 515000 messages, tracking 26081 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26081 vessels
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_flights (trigger: interval[0:03:00], next run at: 2026-02-28 02:18:34 MST)" (scheduled at 2026-02-28 02:15:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:16:34 MST)" (scheduled at 2026-02-28 02:15:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:16:34 MST)" (scheduled at 2026-02-28 02:15:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21458 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:16:34 MST)" executed successfully
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 520000 messages, tracking 25972 vessels
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25972 vessels
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:16:34 MST)" executed successfully
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 525000 messages, tracking 26026 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26026 vessels
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] Exception in thread Thread-40 (_readerthread):
|
|
[API] Traceback (most recent call last):
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\threading.py", line 1016, in _bootstrap_inner
|
|
[API] self.run()
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\threading.py", line 953, in run
|
|
[API] self._target(*self._args, **self._kwargs)
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\subprocess.py", line 1515, in _readerthread
|
|
[API] buffer.append(fh.read())
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\encodings\cp1252.py", line 23, in decode
|
|
[API] return codecs.charmap_decode(input,self.errors,decoding_table)[0]
|
|
[API] UnicodeDecodeError: 'charmap' codec can't decode byte 0x8d in position 21383: character maps to <undefined>
|
|
[API] ERROR:services.network_utils:curl fallback exception: 'NoneType' object has no attribute 'strip'
|
|
[API] WARNING:services.data_fetcher:Routeset batch returned HTTP 500
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] INFO:services.data_fetcher:Resolved routes for 3635 / 4867 flights
|
|
[API] INFO:services.data_fetcher:Tracked flights: 15 total (8 from civilian)
|
|
[API] INFO:services.data_fetcher:Trail accumulation: 1282 active trails, 197 pruned
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_flights (trigger: interval[0:03:00], next run at: 2026-02-28 02:18:34 MST)" executed successfully
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:17:34 MST)" (scheduled at 2026-02-28 02:16:34.484200-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:17:34 MST)" (scheduled at 2026-02-28 02:16:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21331 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:17:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:17:34 MST)" executed successfully
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:18:34 MST)" (scheduled at 2026-02-28 02:17:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:18:34 MST)" (scheduled at 2026-02-28 02:17:34.484716-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_geopolitics (trigger: interval[0:05:00], next run at: 2026-02-28 02:22:34 MST)" (scheduled at 2026-02-28 02:17:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:services.data_fetcher:Fetching Geopolitics data...
|
|
[API] INFO:services.geopolitics:Fetching GDELT Global Military Incidents...
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21308 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:18:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_geopolitics (trigger: interval[0:05:00], next run at: 2026-02-28 02:22:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:18:34 MST)" executed successfully
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 530000 messages, tracking 25834 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25834 vessels
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 535000 messages, tracking 25896 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25896 vessels
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 540000 messages, tracking 25944 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25944 vessels
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_flights (trigger: interval[0:03:00], next run at: 2026-02-28 02:21:34 MST)" (scheduled at 2026-02-28 02:18:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:19:34 MST)" (scheduled at 2026-02-28 02:18:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:19:34 MST)" (scheduled at 2026-02-28 02:18:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21412 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:19:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:19:34 MST)" executed successfully
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 545000 messages, tracking 25962 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25962 vessels
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 550000 messages, tracking 26010 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26010 vessels
|
|
[API] INFO:services.data_fetcher:Resolved routes for 3756 / 4950 flights
|
|
[API] INFO:services.data_fetcher:Tracked flights: 15 total (7 from civilian)
|
|
[API] INFO:services.data_fetcher:Trail accumulation: 1258 active trails, 85 pruned
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_flights (trigger: interval[0:03:00], next run at: 2026-02-28 02:21:34 MST)" executed successfully
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 555000 messages, tracking 26082 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26082 vessels
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:20:34 MST)" (scheduled at 2026-02-28 02:19:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:20:34 MST)" (scheduled at 2026-02-28 02:19:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21334 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:20:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:20:34 MST)" executed successfully
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 560000 messages, tracking 25931 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25931 vessels
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:21:34 MST)" (scheduled at 2026-02-28 02:20:34.484200-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:21:34 MST)" (scheduled at 2026-02-28 02:20:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 20308 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:21:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:21:34 MST)" executed successfully
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 565000 messages, tracking 24773 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 24773 vessels
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 570000 messages, tracking 24839 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 24839 vessels
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 575000 messages, tracking 24881 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 24881 vessels
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_flights (trigger: interval[0:03:00], next run at: 2026-02-28 02:24:34 MST)" (scheduled at 2026-02-28 02:21:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:22:34 MST)" (scheduled at 2026-02-28 02:21:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:22:34 MST)" (scheduled at 2026-02-28 02:21:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 20278 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:22:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 580000 messages, tracking 24736 vessels
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:22:34 MST)" executed successfully
|
|
[API] INFO:services.ais_stream:AIS cache saved: 24736 vessels
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 585000 messages, tracking 24799 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 24799 vessels
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] Exception in thread Thread-44 (_readerthread):
|
|
[API] Traceback (most recent call last):
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\threading.py", line 1016, in _bootstrap_inner
|
|
[API] self.run()
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\threading.py", line 953, in run
|
|
[API] self._target(*self._args, **self._kwargs)
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\subprocess.py", line 1515, in _readerthread
|
|
[API] buffer.append(fh.read())
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\encodings\cp1252.py", line 23, in decode
|
|
[API] return codecs.charmap_decode(input,self.errors,decoding_table)[0]
|
|
[API] UnicodeDecodeError: 'charmap' codec can't decode byte 0x8d in position 28044: character maps to <undefined>
|
|
[API] ERROR:services.network_utils:curl fallback exception: 'NoneType' object has no attribute 'strip'
|
|
[API] WARNING:services.data_fetcher:Routeset batch returned HTTP 500
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] Exception in thread Thread-46 (_readerthread):
|
|
[API] Traceback (most recent call last):
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\threading.py", line 1016, in _bootstrap_inner
|
|
[API] self.run()
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\threading.py", line 953, in run
|
|
[API] self._target(*self._args, **self._kwargs)
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\subprocess.py", line 1515, in _readerthread
|
|
[API] buffer.append(fh.read())
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\encodings\cp1252.py", line 23, in decode
|
|
[API] return codecs.charmap_decode(input,self.errors,decoding_table)[0]
|
|
[API] UnicodeDecodeError: 'charmap' codec can't decode byte 0x81 in position 17231: character maps to <undefined>
|
|
[API] ERROR:services.network_utils:curl fallback exception: 'NoneType' object has no attribute 'strip'
|
|
[API] WARNING:services.data_fetcher:Routeset batch returned HTTP 500
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] Exception in thread Thread-48 (_readerthread):
|
|
[API] Traceback (most recent call last):
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\threading.py", line 1016, in _bootstrap_inner
|
|
[API] self.run()
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\threading.py", line 953, in run
|
|
[API] self._target(*self._args, **self._kwargs)
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\subprocess.py", line 1515, in _readerthread
|
|
[API] buffer.append(fh.read())
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\encodings\cp1252.py", line 23, in decode
|
|
[API] return codecs.charmap_decode(input,self.errors,decoding_table)[0]
|
|
[API] UnicodeDecodeError: 'charmap' codec can't decode byte 0x8d in position 11710: character maps to <undefined>
|
|
[API] ERROR:services.network_utils:curl fallback exception: 'NoneType' object has no attribute 'strip'
|
|
[API] WARNING:services.data_fetcher:Routeset batch returned HTTP 500
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:23:34 MST)" (scheduled at 2026-02-28 02:22:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:23:34 MST)" (scheduled at 2026-02-28 02:22:34.484716-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_geopolitics (trigger: interval[0:05:00], next run at: 2026-02-28 02:27:34 MST)" (scheduled at 2026-02-28 02:22:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] INFO:services.data_fetcher:Fetching Geopolitics data...
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_geopolitics (trigger: interval[0:05:00], next run at: 2026-02-28 02:27:34 MST)" executed successfully
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 20281 AIS vessels
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:23:34 MST)" executed successfully
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] Exception in thread Thread-52 (_readerthread):
|
|
[API] Traceback (most recent call last):
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\threading.py", line 1016, in _bootstrap_inner
|
|
[API] self.run()
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\threading.py", line 953, in run
|
|
[API] self._target(*self._args, **self._kwargs)
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\subprocess.py", line 1515, in _readerthread
|
|
[API] buffer.append(fh.read())
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\encodings\cp1252.py", line 23, in decode
|
|
[API] return codecs.charmap_decode(input,self.errors,decoding_table)[0]
|
|
[API] UnicodeDecodeError: 'charmap' codec can't decode byte 0x8d in position 2806: character maps to <undefined>
|
|
[API] ERROR:services.network_utils:curl fallback exception: 'NoneType' object has no attribute 'strip'
|
|
[API] WARNING:services.data_fetcher:Routeset batch returned HTTP 500
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:23:34 MST)" executed successfully
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] INFO:services.data_fetcher:Resolved routes for 3460 / 4945 flights
|
|
[API] INFO:services.data_fetcher:Tracked flights: 16 total (8 from civilian)
|
|
[API] INFO:services.data_fetcher:Trail accumulation: 1548 active trails, 109 pruned
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_flights (trigger: interval[0:03:00], next run at: 2026-02-28 02:24:34 MST)" executed successfully
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:24:34 MST)" (scheduled at 2026-02-28 02:23:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:24:34 MST)" (scheduled at 2026-02-28 02:23:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 19789 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:24:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:24:34 MST)" executed successfully
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 590000 messages, tracking 24217 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 24217 vessels
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 595000 messages, tracking 24291 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 24291 vessels
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 600000 messages, tracking 24350 vessels
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_flights (trigger: interval[0:03:00], next run at: 2026-02-28 02:27:34 MST)" (scheduled at 2026-02-28 02:24:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:25:34 MST)" (scheduled at 2026-02-28 02:24:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:25:34 MST)" (scheduled at 2026-02-28 02:24:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 19761 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:25:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.ais_stream:AIS cache saved: 24350 vessels
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:25:34 MST)" executed successfully
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 605000 messages, tracking 24241 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 24241 vessels
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 610000 messages, tracking 24323 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 24323 vessels
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] ERROR:services.network_utils:curl fallback failed with exit code 0
|
|
[API] WARNING:services.data_fetcher:Routeset batch returned HTTP 500
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 615000 messages, tracking 24408 vessels
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:26:34 MST)" (scheduled at 2026-02-28 02:25:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:26:34 MST)" (scheduled at 2026-02-28 02:25:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 19883 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:26:34 MST)" executed successfully
|
|
[API] INFO:services.ais_stream:AIS cache saved: 24408 vessels
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.data_fetcher:Resolved routes for 3692 / 5002 flights
|
|
[API] INFO:services.data_fetcher:Tracked flights: 16 total (8 from civilian)
|
|
[API] INFO:services.data_fetcher:Trail accumulation: 1383 active trails, 115 pruned
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_flights (trigger: interval[0:03:00], next run at: 2026-02-28 02:27:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:26:34 MST)" executed successfully
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:27:34 MST)" (scheduled at 2026-02-28 02:26:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:27:34 MST)" (scheduled at 2026-02-28 02:26:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 20444 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:27:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:27:34 MST)" executed successfully
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] INFO:apscheduler.executors.default:Running job "update_all_data (trigger: interval[0:30:00], next run at: 2026-02-28 02:57:34 MST)" (scheduled at 2026-02-28 02:27:34.482190-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_flights (trigger: interval[0:03:00], next run at: 2026-02-28 02:30:34 MST)" (scheduled at 2026-02-28 02:27:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:28:34 MST)" (scheduled at 2026-02-28 02:27:34.484200-07:00)
|
|
[API] INFO:services.data_fetcher:Fetching new data concurrently...
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:28:34 MST)" (scheduled at 2026-02-28 02:27:34.484716-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_geopolitics (trigger: interval[0:05:00], next run at: 2026-02-28 02:32:34 MST)" (scheduled at 2026-02-28 02:27:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:services.data_fetcher:Fetching Geopolitics data...
|
|
[API] INFO:services.geopolitics:Fetching GDELT Global Military Incidents...
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 20237 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:28:34 MST)" executed successfully
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 20236 AIS vessels
|
|
[API] INFO:services.data_fetcher:Fetching Geopolitics data...
|
|
[API] INFO:services.geopolitics:Fetching GDELT Global Military Incidents...
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.data_fetcher:Tracked flights: 16 total (0 from military)
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:28:34 MST)" executed successfully
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_geopolitics (trigger: interval[0:05:00], next run at: 2026-02-28 02:32:34 MST)" executed successfully
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 620000 messages, tracking 24658 vessels
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] INFO:services.ais_stream:AIS cache saved: 24658 vessels
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] Exception in thread Thread-70 (_readerthread):
|
|
[API] Traceback (most recent call last):
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\threading.py", line 1016, in _bootstrap_inner
|
|
[API] self.run()
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\threading.py", line 953, in run
|
|
[API] self._target(*self._args, **self._kwargs)
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\subprocess.py", line 1515, in _readerthread
|
|
[API] buffer.append(fh.read())
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\encodings\cp1252.py", line 23, in decode
|
|
[API] return codecs.charmap_decode(input,self.errors,decoding_table)[0]
|
|
[API] UnicodeDecodeError: 'charmap' codec can't decode byte 0x8d in position 6556: character maps to <undefined>
|
|
[API] ERROR:services.network_utils:curl fallback exception: 'NoneType' object has no attribute 'strip'
|
|
[API] WARNING:services.data_fetcher:Routeset batch returned HTTP 500
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 625000 messages, tracking 24733 vessels
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] ERROR:services.network_utils:curl fallback failed with exit code 0
|
|
[API] WARNING:services.data_fetcher:Routeset batch returned HTTP 500
|
|
[API] INFO:services.ais_stream:AIS cache saved: 24733 vessels
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] INFO:services.data_fetcher:Resolved routes for 3698 / 4962 flights
|
|
[API] INFO:services.data_fetcher:Tracked flights: 16 total (7 from civilian)
|
|
[API] INFO:services.data_fetcher:Trail accumulation: 1337 active trails, 0 pruned
|
|
[API] INFO:services.data_fetcher:Data update complete.
|
|
[API] INFO:apscheduler.executors.default:Job "update_all_data (trigger: interval[0:30:00], next run at: 2026-02-28 02:57:34 MST)" executed successfully
|
|
[API] INFO:services.data_fetcher:Resolved routes for 3670 / 4962 flights
|
|
[API] INFO:services.data_fetcher:Tracked flights: 16 total (7 from civilian)
|
|
[API] INFO:services.data_fetcher:Trail accumulation: 1364 active trails, 0 pruned
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_flights (trigger: interval[0:03:00], next run at: 2026-02-28 02:30:34 MST)" executed successfully
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 630000 messages, tracking 24887 vessels
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:29:34 MST)" (scheduled at 2026-02-28 02:28:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:29:34 MST)" (scheduled at 2026-02-28 02:28:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 20237 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:29:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.ais_stream:AIS cache saved: 24887 vessels
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:29:34 MST)" executed successfully
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 635000 messages, tracking 25021 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25021 vessels
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 640000 messages, tracking 25712 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25712 vessels
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 645000 messages, tracking 25882 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25882 vessels
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:30:34 MST)" (scheduled at 2026-02-28 02:29:34.484200-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:30:34 MST)" (scheduled at 2026-02-28 02:29:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21243 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:30:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:30:34 MST)" executed successfully
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 650000 messages, tracking 25801 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25801 vessels
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_flights (trigger: interval[0:03:00], next run at: 2026-02-28 02:33:34 MST)" (scheduled at 2026-02-28 02:30:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:31:34 MST)" (scheduled at 2026-02-28 02:30:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:31:34 MST)" (scheduled at 2026-02-28 02:30:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21108 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:31:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:31:34 MST)" executed successfully
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] Exception in thread Thread-82 (_readerthread):
|
|
[API] Traceback (most recent call last):
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\threading.py", line 1016, in _bootstrap_inner
|
|
[API] self.run()
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\threading.py", line 953, in run
|
|
[API] self._target(*self._args, **self._kwargs)
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\subprocess.py", line 1515, in _readerthread
|
|
[API] buffer.append(fh.read())
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\encodings\cp1252.py", line 23, in decode
|
|
[API] return codecs.charmap_decode(input,self.errors,decoding_table)[0]
|
|
[API] UnicodeDecodeError: 'charmap' codec can't decode byte 0x8d in position 50112: character maps to <undefined>
|
|
[API] ERROR:services.network_utils:curl fallback exception: 'NoneType' object has no attribute 'strip'
|
|
[API] WARNING:services.data_fetcher:Routeset batch returned HTTP 500
|
|
[API] INFO:services.data_fetcher:Resolved routes for 3658 / 4953 flights
|
|
[API] INFO:services.data_fetcher:Tracked flights: 18 total (9 from civilian)
|
|
[API] INFO:services.data_fetcher:Trail accumulation: 1381 active trails, 510 pruned
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_flights (trigger: interval[0:03:00], next run at: 2026-02-28 02:33:34 MST)" executed successfully
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 655000 messages, tracking 25606 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25606 vessels
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:32:34 MST)" (scheduled at 2026-02-28 02:31:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:32:34 MST)" (scheduled at 2026-02-28 02:31:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21062 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:32:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:32:34 MST)" executed successfully
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 660000 messages, tracking 25582 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25582 vessels
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 665000 messages, tracking 25810 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25810 vessels
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 670000 messages, tracking 25944 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25944 vessels
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:33:34 MST)" (scheduled at 2026-02-28 02:32:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:33:34 MST)" (scheduled at 2026-02-28 02:32:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_geopolitics (trigger: interval[0:05:00], next run at: 2026-02-28 02:37:34 MST)" (scheduled at 2026-02-28 02:32:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Fetching Geopolitics data...
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_geopolitics (trigger: interval[0:05:00], next run at: 2026-02-28 02:37:34 MST)" executed successfully
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21510 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:33:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:33:34 MST)" executed successfully
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 675000 messages, tracking 26034 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26034 vessels
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 680000 messages, tracking 26103 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26103 vessels
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_flights (trigger: interval[0:03:00], next run at: 2026-02-28 02:36:34 MST)" (scheduled at 2026-02-28 02:33:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:34:34 MST)" (scheduled at 2026-02-28 02:33:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:34:34 MST)" (scheduled at 2026-02-28 02:33:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21472 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:34:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:34:34 MST)" executed successfully
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] INFO:services.data_fetcher:Resolved routes for 3812 / 5059 flights
|
|
[API] INFO:services.data_fetcher:Tracked flights: 20 total (11 from civilian)
|
|
[API] INFO:services.data_fetcher:Trail accumulation: 1325 active trails, 109 pruned
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_flights (trigger: interval[0:03:00], next run at: 2026-02-28 02:36:34 MST)" executed successfully
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:35:34 MST)" (scheduled at 2026-02-28 02:34:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:35:34 MST)" (scheduled at 2026-02-28 02:34:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21269 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:35:34 MST)" executed successfully
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:35:34 MST)" executed successfully
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 685000 messages, tracking 25758 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25758 vessels
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:36:34 MST)" (scheduled at 2026-02-28 02:35:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:36:34 MST)" (scheduled at 2026-02-28 02:35:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21225 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:36:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:36:34 MST)" executed successfully
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 690000 messages, tracking 25724 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25724 vessels
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 695000 messages, tracking 25796 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25796 vessels
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 700000 messages, tracking 25894 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25894 vessels
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_flights (trigger: interval[0:03:00], next run at: 2026-02-28 02:39:34 MST)" (scheduled at 2026-02-28 02:36:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:37:34 MST)" (scheduled at 2026-02-28 02:36:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:37:34 MST)" (scheduled at 2026-02-28 02:36:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21191 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:37:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:37:34 MST)" executed successfully
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 705000 messages, tracking 25712 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25712 vessels
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 710000 messages, tracking 25790 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25790 vessels
|
|
[API] INFO:services.data_fetcher:Resolved routes for 3763 / 5014 flights
|
|
[API] INFO:services.data_fetcher:Tracked flights: 21 total (12 from civilian)
|
|
[API] INFO:services.data_fetcher:Trail accumulation: 1352 active trails, 114 pruned
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_flights (trigger: interval[0:03:00], next run at: 2026-02-28 02:39:34 MST)" executed successfully
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:38:34 MST)" (scheduled at 2026-02-28 02:37:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:38:34 MST)" (scheduled at 2026-02-28 02:37:34.484716-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_geopolitics (trigger: interval[0:05:00], next run at: 2026-02-28 02:42:34 MST)" (scheduled at 2026-02-28 02:37:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:services.data_fetcher:Fetching Geopolitics data...
|
|
[API] INFO:services.geopolitics:Fetching DeepStateMap from GitHub mirror...
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21200 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:38:34 MST)" executed successfully
|
|
[API] INFO:services.geopolitics:Downloading latest DeepStateMap: https://raw.githubusercontent.com/cyterat/deepstate-map-data/main/data/deepstatemap_data_20260228.geojson
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.geopolitics:Fetching GDELT Global Military Incidents...
|
|
[API] WARNING:services.geopolitics:GDELT returned 1 error features. Throttling active.
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_geopolitics (trigger: interval[0:05:00], next run at: 2026-02-28 02:42:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:38:34 MST)" executed successfully
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 715000 messages, tracking 25645 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25645 vessels
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 720000 messages, tracking 25743 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25743 vessels
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:39:34 MST)" (scheduled at 2026-02-28 02:38:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:39:34 MST)" (scheduled at 2026-02-28 02:38:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21329 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:39:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:39:34 MST)" executed successfully
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 725000 messages, tracking 25832 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25832 vessels
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 730000 messages, tracking 25901 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25901 vessels
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 735000 messages, tracking 26006 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26006 vessels
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_flights (trigger: interval[0:03:00], next run at: 2026-02-28 02:42:34 MST)" (scheduled at 2026-02-28 02:39:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:40:34 MST)" (scheduled at 2026-02-28 02:39:34.484200-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:40:34 MST)" (scheduled at 2026-02-28 02:39:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21413 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:40:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:40:34 MST)" executed successfully
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 740000 messages, tracking 25965 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25965 vessels
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] INFO:services.data_fetcher:Resolved routes for 3797 / 5064 flights
|
|
[API] INFO:services.data_fetcher:Tracked flights: 21 total (11 from civilian)
|
|
[API] INFO:services.data_fetcher:Trail accumulation: 1377 active trails, 124 pruned
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_flights (trigger: interval[0:03:00], next run at: 2026-02-28 02:42:34 MST)" executed successfully
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 745000 messages, tracking 26057 vessels
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:41:34 MST)" (scheduled at 2026-02-28 02:40:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:41:34 MST)" (scheduled at 2026-02-28 02:40:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21330 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:41:34 MST)" executed successfully
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26057 vessels
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:41:34 MST)" executed successfully
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 750000 messages, tracking 25864 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25864 vessels
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 755000 messages, tracking 25971 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25971 vessels
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 760000 messages, tracking 26061 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26061 vessels
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:42:34 MST)" (scheduled at 2026-02-28 02:41:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:42:34 MST)" (scheduled at 2026-02-28 02:41:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21560 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:42:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:42:34 MST)" executed successfully
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 765000 messages, tracking 26066 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26066 vessels
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 770000 messages, tracking 26135 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26135 vessels
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 775000 messages, tracking 26221 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26221 vessels
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_flights (trigger: interval[0:03:00], next run at: 2026-02-28 02:45:34 MST)" (scheduled at 2026-02-28 02:42:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:43:34 MST)" (scheduled at 2026-02-28 02:42:34.484200-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:43:34 MST)" (scheduled at 2026-02-28 02:42:34.484716-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_geopolitics (trigger: interval[0:05:00], next run at: 2026-02-28 02:47:34 MST)" (scheduled at 2026-02-28 02:42:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Fetching Geopolitics data...
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_geopolitics (trigger: interval[0:05:00], next run at: 2026-02-28 02:47:34 MST)" executed successfully
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21769 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:43:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:43:34 MST)" executed successfully
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] ERROR:services.network_utils:curl fallback failed with exit code 0
|
|
[API] WARNING:services.data_fetcher:Routeset batch returned HTTP 500
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] ERROR:services.network_utils:curl fallback failed with exit code 0
|
|
[API] WARNING:services.data_fetcher:Routeset batch returned HTTP 500
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] Exception in thread Thread-102 (_readerthread):
|
|
[API] Traceback (most recent call last):
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\threading.py", line 1016, in _bootstrap_inner
|
|
[API] self.run()
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\threading.py", line 953, in run
|
|
[API] self._target(*self._args, **self._kwargs)
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\subprocess.py", line 1515, in _readerthread
|
|
[API] buffer.append(fh.read())
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\encodings\cp1252.py", line 23, in decode
|
|
[API] return codecs.charmap_decode(input,self.errors,decoding_table)[0]
|
|
[API] UnicodeDecodeError: 'charmap' codec can't decode byte 0x8d in position 23851: character maps to <undefined>
|
|
[API] ERROR:services.network_utils:curl fallback exception: 'NoneType' object has no attribute 'strip'
|
|
[API] WARNING:services.data_fetcher:Routeset batch returned HTTP 500
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] ERROR:services.network_utils:curl fallback failed with exit code 0
|
|
[API] WARNING:services.data_fetcher:Routeset batch returned HTTP 500
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] ERROR:services.network_utils:curl fallback failed with exit code 0
|
|
[API] WARNING:services.data_fetcher:Routeset batch returned HTTP 500
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] Exception in thread Thread-110 (_readerthread):
|
|
[API] Traceback (most recent call last):
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\threading.py", line 1016, in _bootstrap_inner
|
|
[API] self.run()
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\threading.py", line 953, in run
|
|
[API] self._target(*self._args, **self._kwargs)
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\subprocess.py", line 1515, in _readerthread
|
|
[API] buffer.append(fh.read())
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\encodings\cp1252.py", line 23, in decode
|
|
[API] return codecs.charmap_decode(input,self.errors,decoding_table)[0]
|
|
[API] UnicodeDecodeError: 'charmap' codec can't decode byte 0x8d in position 39989: character maps to <undefined>
|
|
[API] ERROR:services.network_utils:curl fallback exception: 'NoneType' object has no attribute 'strip'
|
|
[API] WARNING:services.data_fetcher:Routeset batch returned HTTP 500
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] INFO:services.data_fetcher:Resolved routes for 3264 / 4991 flights
|
|
[API] INFO:services.data_fetcher:Tracked flights: 22 total (12 from civilian)
|
|
[API] INFO:services.data_fetcher:Trail accumulation: 1829 active trails, 108 pruned
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_flights (trigger: interval[0:03:00], next run at: 2026-02-28 02:45:34 MST)" executed successfully
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:44:34 MST)" (scheduled at 2026-02-28 02:43:34.484200-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:44:34 MST)" (scheduled at 2026-02-28 02:43:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21516 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:44:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:44:34 MST)" executed successfully
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:45:34 MST)" (scheduled at 2026-02-28 02:44:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:45:34 MST)" (scheduled at 2026-02-28 02:44:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21227 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:45:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:45:34 MST)" executed successfully
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 780000 messages, tracking 25730 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25730 vessels
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 785000 messages, tracking 25791 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25791 vessels
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 790000 messages, tracking 25886 vessels
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_flights (trigger: interval[0:03:00], next run at: 2026-02-28 02:48:34 MST)" (scheduled at 2026-02-28 02:45:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:46:34 MST)" (scheduled at 2026-02-28 02:45:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:46:34 MST)" (scheduled at 2026-02-28 02:45:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21390 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:46:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25886 vessels
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:46:34 MST)" executed successfully
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 795000 messages, tracking 25932 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25932 vessels
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 800000 messages, tracking 26078 vessels
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26078 vessels
|
|
[API] INFO:services.data_fetcher:Resolved routes for 3832 / 5090 flights
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 805000 messages, tracking 26209 vessels
|
|
[API] INFO:services.data_fetcher:Tracked flights: 22 total (13 from civilian)
|
|
[API] INFO:services.data_fetcher:Trail accumulation: 1344 active trails, 132 pruned
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_flights (trigger: interval[0:03:00], next run at: 2026-02-28 02:48:34 MST)" executed successfully
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:47:34 MST)" (scheduled at 2026-02-28 02:46:34.484200-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:47:34 MST)" (scheduled at 2026-02-28 02:46:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21610 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:47:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:47:34 MST)" executed successfully
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26209 vessels
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:48:34 MST)" (scheduled at 2026-02-28 02:47:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:48:34 MST)" (scheduled at 2026-02-28 02:47:34.484716-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_geopolitics (trigger: interval[0:05:00], next run at: 2026-02-28 02:52:34 MST)" (scheduled at 2026-02-28 02:47:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:services.data_fetcher:Fetching Geopolitics data...
|
|
[API] INFO:services.geopolitics:Fetching GDELT Global Military Incidents...
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21237 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:48:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_geopolitics (trigger: interval[0:05:00], next run at: 2026-02-28 02:52:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:48:34 MST)" executed successfully
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_flights (trigger: interval[0:03:00], next run at: 2026-02-28 02:51:34 MST)" (scheduled at 2026-02-28 02:48:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:49:34 MST)" (scheduled at 2026-02-28 02:48:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:49:34 MST)" (scheduled at 2026-02-28 02:48:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21104 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:49:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 88 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:49:34 MST)" executed successfully
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 810000 messages, tracking 25577 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25577 vessels
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] Exception in thread Thread-118 (_readerthread):
|
|
[API] Traceback (most recent call last):
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\threading.py", line 1016, in _bootstrap_inner
|
|
[API] self.run()
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\threading.py", line 953, in run
|
|
[API] self._target(*self._args, **self._kwargs)
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\subprocess.py", line 1515, in _readerthread
|
|
[API] buffer.append(fh.read())
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\encodings\cp1252.py", line 23, in decode
|
|
[API] return codecs.charmap_decode(input,self.errors,decoding_table)[0]
|
|
[API] UnicodeDecodeError: 'charmap' codec can't decode byte 0x8d in position 11886: character maps to <undefined>
|
|
[API] ERROR:services.network_utils:curl fallback exception: 'NoneType' object has no attribute 'strip'
|
|
[API] WARNING:services.data_fetcher:Routeset batch returned HTTP 500
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 815000 messages, tracking 25680 vessels
|
|
[API] INFO:services.data_fetcher:Resolved routes for 3732 / 5043 flights
|
|
[API] INFO:services.data_fetcher:Tracked flights: 22 total (12 from civilian)
|
|
[API] INFO:services.data_fetcher:Trail accumulation: 1421 active trails, 0 pruned
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_flights (trigger: interval[0:03:00], next run at: 2026-02-28 02:51:34 MST)" executed successfully
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25680 vessels
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:50:34 MST)" (scheduled at 2026-02-28 02:49:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:50:34 MST)" (scheduled at 2026-02-28 02:49:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21389 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:50:34 MST)" executed successfully
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 820000 messages, tracking 25813 vessels
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 88 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:50:34 MST)" executed successfully
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25813 vessels
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 825000 messages, tracking 26011 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26011 vessels
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 830000 messages, tracking 26142 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26142 vessels
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 835000 messages, tracking 26234 vessels
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:51:34 MST)" (scheduled at 2026-02-28 02:50:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:51:34 MST)" (scheduled at 2026-02-28 02:50:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21739 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:51:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26234 vessels
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 88 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:51:34 MST)" executed successfully
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_flights (trigger: interval[0:03:00], next run at: 2026-02-28 02:54:34 MST)" (scheduled at 2026-02-28 02:51:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:52:34 MST)" (scheduled at 2026-02-28 02:51:34.484200-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:52:34 MST)" (scheduled at 2026-02-28 02:51:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21536 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:52:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 88 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:52:34 MST)" executed successfully
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] ERROR:services.network_utils:curl fallback failed with exit code 0
|
|
[API] WARNING:services.data_fetcher:Routeset batch returned HTTP 500
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] Exception in thread Thread-126 (_readerthread):
|
|
[API] Traceback (most recent call last):
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\threading.py", line 1016, in _bootstrap_inner
|
|
[API] self.run()
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\threading.py", line 953, in run
|
|
[API] self._target(*self._args, **self._kwargs)
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\subprocess.py", line 1515, in _readerthread
|
|
[API] buffer.append(fh.read())
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\encodings\cp1252.py", line 23, in decode
|
|
[API] return codecs.charmap_decode(input,self.errors,decoding_table)[0]
|
|
[API] UnicodeDecodeError: 'charmap' codec can't decode byte 0x81 in position 49655: character maps to <undefined>
|
|
[API] ERROR:services.network_utils:curl fallback exception: 'NoneType' object has no attribute 'strip'
|
|
[API] WARNING:services.data_fetcher:Routeset batch returned HTTP 500
|
|
[API] INFO:services.data_fetcher:Resolved routes for 3797 / 5078 flights
|
|
[API] INFO:services.data_fetcher:Tracked flights: 22 total (12 from civilian)
|
|
[API] INFO:services.data_fetcher:Trail accumulation: 1356 active trails, 101 pruned
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_flights (trigger: interval[0:03:00], next run at: 2026-02-28 02:54:34 MST)" executed successfully
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:53:34 MST)" (scheduled at 2026-02-28 02:52:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:53:34 MST)" (scheduled at 2026-02-28 02:52:34.484716-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_geopolitics (trigger: interval[0:05:00], next run at: 2026-02-28 02:57:34 MST)" (scheduled at 2026-02-28 02:52:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Fetching Geopolitics data...
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_geopolitics (trigger: interval[0:05:00], next run at: 2026-02-28 02:57:34 MST)" executed successfully
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21321 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:53:34 MST)" executed successfully
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 88 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:53:34 MST)" executed successfully
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 840000 messages, tracking 25778 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25778 vessels
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 845000 messages, tracking 25859 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25859 vessels
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:54:34 MST)" (scheduled at 2026-02-28 02:53:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:54:34 MST)" (scheduled at 2026-02-28 02:53:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21378 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:54:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:54:34 MST)" executed successfully
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 850000 messages, tracking 25813 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25813 vessels
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 855000 messages, tracking 25911 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25911 vessels
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 860000 messages, tracking 25984 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25984 vessels
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_flights (trigger: interval[0:03:00], next run at: 2026-02-28 02:57:34 MST)" (scheduled at 2026-02-28 02:54:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:55:34 MST)" (scheduled at 2026-02-28 02:54:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:55:34 MST)" (scheduled at 2026-02-28 02:54:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21420 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:55:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 865000 messages, tracking 25848 vessels
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:55:34 MST)" executed successfully
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25848 vessels
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] INFO:services.data_fetcher:Resolved routes for 3900 / 5124 flights
|
|
[API] INFO:services.data_fetcher:Tracked flights: 22 total (11 from civilian)
|
|
[API] INFO:services.data_fetcher:Trail accumulation: 1278 active trails, 239 pruned
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_flights (trigger: interval[0:03:00], next run at: 2026-02-28 02:57:34 MST)" executed successfully
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:56:34 MST)" (scheduled at 2026-02-28 02:55:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:56:34 MST)" (scheduled at 2026-02-28 02:55:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21360 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:56:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:56:34 MST)" executed successfully
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 870000 messages, tracking 25793 vessels
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:57:34 MST)" (scheduled at 2026-02-28 02:56:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:57:34 MST)" (scheduled at 2026-02-28 02:56:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 20957 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:57:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25793 vessels
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:57:34 MST)" executed successfully
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 875000 messages, tracking 25433 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25433 vessels
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 880000 messages, tracking 25515 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25515 vessels
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 885000 messages, tracking 25597 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25597 vessels
|
|
[API] INFO:apscheduler.executors.default:Running job "update_all_data (trigger: interval[0:30:00], next run at: 2026-02-28 03:27:34 MST)" (scheduled at 2026-02-28 02:57:34.482190-07:00)
|
|
[API] INFO:services.data_fetcher:Fetching new data concurrently...
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_flights (trigger: interval[0:03:00], next run at: 2026-02-28 03:00:34 MST)" (scheduled at 2026-02-28 02:57:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:58:34 MST)" (scheduled at 2026-02-28 02:57:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:58:34 MST)" (scheduled at 2026-02-28 02:57:34.484716-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_geopolitics (trigger: interval[0:05:00], next run at: 2026-02-28 03:02:34 MST)" (scheduled at 2026-02-28 02:57:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Fetching Geopolitics data...
|
|
[API] INFO:services.geopolitics:Fetching GDELT Global Military Incidents...
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 20975 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:58:34 MST)" executed successfully
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 20975 AIS vessels
|
|
[API] INFO:services.data_fetcher:Fetching Geopolitics data...
|
|
[API] INFO:services.geopolitics:Fetching GDELT Global Military Incidents...
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.data_fetcher:Tracked flights: 22 total (0 from military)
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:58:34 MST)" executed successfully
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] ERROR:services.network_utils:curl fallback failed with exit code 0
|
|
[API] WARNING:services.data_fetcher:Routeset batch returned HTTP 500
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_geopolitics (trigger: interval[0:05:00], next run at: 2026-02-28 03:02:34 MST)" executed successfully
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 890000 messages, tracking 25438 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25438 vessels
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 895000 messages, tracking 25528 vessels
|
|
[API] Exception in thread Thread-146 (_readerthread):
|
|
[API] Traceback (most recent call last):
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\threading.py", line 1016, in _bootstrap_inner
|
|
[API] self.run()
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\threading.py", line 953, in run
|
|
[API] self._target(*self._args, **self._kwargs)
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\subprocess.py", line 1515, in _readerthread
|
|
[API] buffer.append(fh.read())
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\encodings\cp1252.py", line 23, in decode
|
|
[API] return codecs.charmap_decode(input,self.errors,decoding_table)[0]
|
|
[API] UnicodeDecodeError: 'charmap' codec can't decode byte 0x8d in position 50519: character maps to <undefined>
|
|
[API] ERROR:services.network_utils:curl fallback exception: 'NoneType' object has no attribute 'strip'
|
|
[API] WARNING:services.data_fetcher:Routeset batch returned HTTP 500
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25528 vessels
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] Exception in thread Thread-152 (_readerthread):
|
|
[API] Traceback (most recent call last):
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\threading.py", line 1016, in _bootstrap_inner
|
|
[API] self.run()
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\threading.py", line 953, in run
|
|
[API] self._target(*self._args, **self._kwargs)
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\subprocess.py", line 1515, in _readerthread
|
|
[API] buffer.append(fh.read())
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\encodings\cp1252.py", line 23, in decode
|
|
[API] return codecs.charmap_decode(input,self.errors,decoding_table)[0]
|
|
[API] UnicodeDecodeError: 'charmap' codec can't decode byte 0x8d in position 6918: character maps to <undefined>
|
|
[API] ERROR:services.network_utils:curl fallback exception: 'NoneType' object has no attribute 'strip'
|
|
[API] WARNING:services.data_fetcher:Routeset batch returned HTTP 500
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] Exception in thread Thread-154 (_readerthread):
|
|
[API] Traceback (most recent call last):
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\threading.py", line 1016, in _bootstrap_inner
|
|
[API] self.run()
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\threading.py", line 953, in run
|
|
[API] self._target(*self._args, **self._kwargs)
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\subprocess.py", line 1515, in _readerthread
|
|
[API] buffer.append(fh.read())
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\encodings\cp1252.py", line 23, in decode
|
|
[API] return codecs.charmap_decode(input,self.errors,decoding_table)[0]
|
|
[API] UnicodeDecodeError: 'charmap' codec can't decode byte 0x81 in position 2622: character maps to <undefined>
|
|
[API] ERROR:services.network_utils:curl fallback exception: 'NoneType' object has no attribute 'strip'
|
|
[API] WARNING:services.data_fetcher:Routeset batch returned HTTP 500
|
|
[API] INFO:services.data_fetcher:Resolved routes for 3786 / 5100 flights
|
|
[API] INFO:services.data_fetcher:Tracked flights: 22 total (9 from civilian)
|
|
[API] INFO:services.data_fetcher:Trail accumulation: 1394 active trails, 399 pruned
|
|
[API] INFO:services.data_fetcher:Data update complete.
|
|
[API] INFO:apscheduler.executors.default:Job "update_all_data (trigger: interval[0:30:00], next run at: 2026-02-28 03:27:34 MST)" executed successfully
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] INFO:services.data_fetcher:Resolved routes for 3707 / 5102 flights
|
|
[API] INFO:services.data_fetcher:Tracked flights: 22 total (9 from civilian)
|
|
[API] INFO:services.data_fetcher:Trail accumulation: 1475 active trails, 0 pruned
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_flights (trigger: interval[0:03:00], next run at: 2026-02-28 03:00:34 MST)" executed successfully
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:59:34 MST)" (scheduled at 2026-02-28 02:58:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:59:34 MST)" (scheduled at 2026-02-28 02:58:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21202 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 02:59:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 02:59:34 MST)" executed successfully
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 900000 messages, tracking 25630 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25630 vessels
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 905000 messages, tracking 25720 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25720 vessels
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 910000 messages, tracking 25813 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25813 vessels
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 03:00:34 MST)" (scheduled at 2026-02-28 02:59:34.484200-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 03:00:34 MST)" (scheduled at 2026-02-28 02:59:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21416 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 03:00:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 03:00:34 MST)" executed successfully
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 915000 messages, tracking 25884 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25884 vessels
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 920000 messages, tracking 25957 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25957 vessels
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 925000 messages, tracking 26020 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 26020 vessels
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_flights (trigger: interval[0:03:00], next run at: 2026-02-28 03:03:34 MST)" (scheduled at 2026-02-28 03:00:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 03:01:34 MST)" (scheduled at 2026-02-28 03:00:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 03:01:34 MST)" (scheduled at 2026-02-28 03:00:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21381 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 03:01:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 03:01:34 MST)" executed successfully
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (502 Server Error: Bad Gateway for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] ERROR:services.network_utils:curl fallback failed with exit code 0
|
|
[API] WARNING:services.data_fetcher:Routeset batch returned HTTP 500
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 930000 messages, tracking 25842 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25842 vessels
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] Exception in thread Thread-162 (_readerthread):
|
|
[API] Traceback (most recent call last):
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\threading.py", line 1016, in _bootstrap_inner
|
|
[API] self.run()
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\threading.py", line 953, in run
|
|
[API] self._target(*self._args, **self._kwargs)
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\subprocess.py", line 1515, in _readerthread
|
|
[API] buffer.append(fh.read())
|
|
[API] File "C:\Users\admin\AppData\Local\Programs\Python\Python310\lib\encodings\cp1252.py", line 23, in decode
|
|
[API] return codecs.charmap_decode(input,self.errors,decoding_table)[0]
|
|
[API] UnicodeDecodeError: 'charmap' codec can't decode byte 0x8d in position 32062: character maps to <undefined>
|
|
[API] ERROR:services.network_utils:curl fallback exception: 'NoneType' object has no attribute 'strip'
|
|
[API] WARNING:services.data_fetcher:Routeset batch returned HTTP 500
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.network_utils:Python HTTP blocked for https://api.adsb.lol/api/0/routeset (420 Client Error: for url: https://api.adsb.lol/api/0/routeset), falling back to curl.exe...
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] INFO:services.data_fetcher:Resolved routes for 3697 / 5053 flights
|
|
[API] INFO:services.data_fetcher:Tracked flights: 23 total (10 from civilian)
|
|
[API] INFO:services.data_fetcher:Trail accumulation: 1432 active trails, 151 pruned
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_flights (trigger: interval[0:03:00], next run at: 2026-02-28 03:03:34 MST)" executed successfully
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 03:02:34 MST)" (scheduled at 2026-02-28 03:01:34.484200-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 03:02:34 MST)" (scheduled at 2026-02-28 03:01:34.484716-07:00)
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21140 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 03:02:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 03:02:34 MST)" executed successfully
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] INFO:apscheduler.executors.default:Running job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 03:03:34 MST)" (scheduled at 2026-02-28 03:02:34.484200-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 03:03:34 MST)" (scheduled at 2026-02-28 03:02:34.484716-07:00)
|
|
[API] INFO:apscheduler.executors.default:Running job "fetch_geopolitics (trigger: interval[0:05:00], next run at: 2026-02-28 03:07:34 MST)" (scheduled at 2026-02-28 03:02:34.484716-07:00)
|
|
[API] INFO:services.data_fetcher:Running CCTV Pipeline Ingestion...
|
|
[API] INFO:services.data_fetcher:Fetching Geopolitics data...
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_geopolitics (trigger: interval[0:05:00], next run at: 2026-02-28 03:07:34 MST)" executed successfully
|
|
[API] INFO:services.data_fetcher:Ships: 5 carriers + 21086 AIS vessels
|
|
[API] INFO:apscheduler.executors.default:Job "fetch_ships (trigger: interval[0:01:00], next run at: 2026-02-28 03:03:34 MST)" executed successfully
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 884 cameras from TFLJamCamIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 90 cameras from LTASingaporeIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 978 cameras from AustinTXIngestor
|
|
[API] INFO:services.cctv_pipeline:Successfully ingested 1032 cameras from NYCDOTIngestor
|
|
[API] INFO:apscheduler.executors.default:Job "start_scheduler.<locals>.update_cctvs (trigger: interval[0:01:00], next run at: 2026-02-28 03:03:34 MST)" executed successfully
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] ERROR:services.ais_stream:AIS Stream error: concurrent connections per user exceeded
|
|
[API] WARNING:services.ais_stream:AIS proxy stderr: WebSocket Proxy Closed. Reconnecting in 5s...
|
|
[API] INFO:services.ais_stream:AIS Stream: processed 935000 messages, tracking 25559 vessels
|
|
[API] INFO:services.ais_stream:AIS cache saved: 25559 vessels
|