035748fc61
skip using base release in run_local.py
2026-02-16 18:26:53 -05:00
13432068e6
src/adsb/run_local.py works
2026-02-16 17:45:31 -05:00
2bc45ff6a4
increase retry_delay to 5 minutes.
2026-02-16 15:35:02 -05:00
5883b459ac
fix bug with no dupliacte icaos across days
2026-02-15 21:08:17 -05:00
f8ba66375b
preserve time
2026-02-15 21:08:03 -05:00
7a62faecef
sort by time in end
2026-02-15 20:33:06 -05:00
9964ce576b
slight update for compress by day
2026-02-15 20:32:33 -05:00
be33fd2eaf
compress by day
2026-02-15 19:59:50 -05:00
2b2095700f
use chunks in run_local
2026-02-15 19:53:09 -05:00
3f38263a0c
stop depue that destroys previous days
2026-02-15 17:55:16 -05:00
1a553d5f44
use date of file instead of min timestamp
2026-02-15 16:44:09 -05:00
405855c566
deal with whole schema
2026-02-15 16:43:00 -05:00
4e81dde201
fix date parsing
2026-02-15 14:55:32 -05:00
fde8ef029c
update csv writing to handle empty data. Save space with higher gzip compression
2026-02-15 14:14:54 -05:00
18ab51bd60
update naming
2026-02-15 13:45:03 -05:00
83b9d2a76d
write gzip
2026-02-15 13:41:09 -05:00
8874619ab0
write gzip
2026-02-15 13:41:02 -05:00
823f291728
fix errors in daily release due to new .gz file
2026-02-15 13:21:51 -05:00
982011b36f
end of year check
2026-02-14 22:42:32 -05:00
1b15e43669
use .csv.gz
2026-02-14 22:22:14 -05:00
f17adc4574
remvoe aws worker, reducer
2026-02-14 22:21:14 -05:00
6a250a63fb
fix None value comparision
2026-02-14 20:21:32 -05:00
8ce04f1f83
Revert "update for historical run"
...
This reverts commit ccf55b2308
2026-02-14 18:44:21 -05:00
9441761ac9
use temp release too.
2026-02-14 18:43:25 -05:00
ccf55b2308
update for historical run
2026-02-14 15:57:16 -05:00
76eaf118ef
add run_local.py
2026-02-14 15:54:36 -05:00
0fcbad0fbc
let mictronics retry
2026-02-14 15:07:08 -05:00
0c7484e7bf
create_daily_microtonics release
2026-02-13 22:19:02 -05:00
8c60ac611d
create daily adsbexchange database snapshot release
2026-02-13 22:19:02 -05:00
4015a5fcf1
OpenAirframes 1.0
2026-02-13 11:37:31 -05:00
b349c01d31
FIX: trigger for planequery-aircraft daily release workflow. Update contributions issue template.
2026-02-12 10:26:05 -05:00
722bcdf791
FEATURE: Add contributions framework. Fix and improve daily adsb release using Github actions for map reduce.
2026-02-11 23:22:46 -05:00
27da93801e
FEATURE: add historical adsb aircraft data and update daily adsb aircraft data derivation.
...
add clickhouse_connect
use 32GB
update to no longer do df.copy()
Add planequery_adsb_read.ipynb
INCREASE: update Fargate task definition to 16 vCPU and 64 GB memory for improved performance on large datasets
update notebook
remove print(df)
Ensure empty strings are preserved in DataFrame columns
check if day has data for adsb
update notebook
2026-02-11 13:58:56 -05:00
16a0a5fec8
Create derived csv daily. Get historical FAA data
2026-02-02 20:48:35 -05:00
2e60c64f61
add src/get_historical_faa.py
2026-02-01 13:05:29 -05:00
ccefbf437c
Initial commit
2026-01-31 21:10:15 -05:00
ggman12