343a391a3f
change default chunk_days from 7 to 3
2026-02-16 16:35:05 -05:00
2bc45ff6a4
increase retry_delay to 5 minutes.
2026-02-16 15:35:02 -05:00
03291d93a8
add scripts/run_historical_adsb_action.py
2026-02-16 14:54:25 -05:00
5883b459ac
fix bug with no dupliacte icaos across days
2026-02-15 21:08:17 -05:00
f8ba66375b
preserve time
2026-02-15 21:08:03 -05:00
7a62faecef
sort by time in end
2026-02-15 20:33:06 -05:00
9964ce576b
slight update for compress by day
2026-02-15 20:32:33 -05:00
be33fd2eaf
compress by day
2026-02-15 19:59:50 -05:00
2b2095700f
use chunks in run_local
2026-02-15 19:53:09 -05:00
a8b2b66952
fix .csv to .csv.gz transition
2026-02-15 19:08:51 -05:00
3f38263a0c
stop depue that destroys previous days
2026-02-15 17:55:16 -05:00
1a553d5f44
use date of file instead of min timestamp
2026-02-15 16:44:09 -05:00
405855c566
deal with whole schema
2026-02-15 16:43:00 -05:00
4e81dde201
fix date parsing
2026-02-15 14:55:32 -05:00
fde8ef029c
update csv writing to handle empty data. Save space with higher gzip compression
2026-02-15 14:14:54 -05:00
18ab51bd60
update naming
2026-02-15 13:45:03 -05:00
83b9d2a76d
write gzip
2026-02-15 13:41:09 -05:00
8874619ab0
write gzip
2026-02-15 13:41:02 -05:00
823f291728
fix errors in daily release due to new .gz file
2026-02-15 13:21:51 -05:00
982011b36f
end of year check
2026-02-14 22:42:32 -05:00
1b15e43669
use .csv.gz
2026-02-14 22:22:14 -05:00
f17adc4574
remvoe aws worker, reducer
2026-02-14 22:21:14 -05:00
6a250a63fb
fix None value comparision
2026-02-14 20:21:32 -05:00
9e24fcbc63
update integrity checker. Hopefully solve issue.
2026-02-14 19:56:25 -05:00
8ce04f1f83
Revert "update for historical run"
...
This reverts commit ccf55b2308
2026-02-14 18:44:21 -05:00
9441761ac9
use temp release too.
2026-02-14 18:43:25 -05:00
ccf55b2308
update for historical run
2026-02-14 15:57:16 -05:00
76eaf118ef
add run_local.py
2026-02-14 15:54:36 -05:00
0fcbad0fbc
let mictronics retry
2026-02-14 15:07:08 -05:00
0c7484e7bf
create_daily_microtonics release
2026-02-13 22:19:02 -05:00
8c60ac611d
create daily adsbexchange database snapshot release
2026-02-13 22:19:02 -05:00
145f1006be
update template
2026-02-13 12:12:24 -05:00
f5465f0552
update .github/workflows/update-community-prs.yaml
2026-02-13 12:00:10 -05:00
17098ae39a
fix update-community-prs.yaml
2026-02-13 11:52:53 -05:00
6f6b65780a
update community_submission.yaml. update Readme.md
2026-02-13 11:49:18 -05:00
4015a5fcf1
OpenAirframes 1.0
2026-02-13 11:37:31 -05:00
f9e04337ae
Merge pull request #5 from PlaneQuery/develop
...
FIX: trigger for planequery-aircraft daily release workflow. Update contributions issue template.
2026-02-12 10:42:47 -05:00
1348e1f3a0
Merge branch 'main' into develop
2026-02-12 10:41:26 -05:00
b349c01d31
FIX: trigger for planequery-aircraft daily release workflow. Update contributions issue template.
2026-02-12 10:26:05 -05:00
a98175bc6c
Merge pull request #3 from PlaneQuery/develop
...
Develop to main new historical adsb workflow. Community Submission updates.
2026-02-11 23:42:40 -05:00
953a3647df
remove process historical-faa github workflow
2026-02-11 23:41:42 -05:00
e5c99b611c
make a histoircla runner for adsb
2026-02-11 23:41:42 -05:00
4e803dbb45
remove confirmations
2026-02-11 23:41:42 -05:00
59c2aab5c7
Merge pull request #2 from PlaneQuery/develop
...
develop to main FEATURE: Add contributions framework. Fix and improve daily adsb release
2026-02-11 23:24:01 -05:00
722bcdf791
FEATURE: Add contributions framework. Fix and improve daily adsb release using Github actions for map reduce.
2026-02-11 23:22:46 -05:00
27da93801e
FEATURE: add historical adsb aircraft data and update daily adsb aircraft data derivation.
...
add clickhouse_connect
use 32GB
update to no longer do df.copy()
Add planequery_adsb_read.ipynb
INCREASE: update Fargate task definition to 16 vCPU and 64 GB memory for improved performance on large datasets
update notebook
remove print(df)
Ensure empty strings are preserved in DataFrame columns
check if day has data for adsb
update notebook
2026-02-11 13:58:56 -05:00
b94bfdc575
Merge pull request #1 from PlaneQuery/import/af-klm-fleet
...
af-klm-fleet from iclems
2026-02-04 17:51:46 -05:00
c90bdada76
delete air-france folder
2026-02-04 17:49:25 -05:00
921cbefb6e
Add 'af-klm-fleet/' from commit 'b1dd01c27eccc8ba620994b6ae0df78a37075f3a'
...
git-subtree-dir: af-klm-fleet
git-subtree-mainline: 85a3db4dd0b1dd01c27e
2026-02-04 17:47:47 -05:00
b1dd01c27e
Fix API rate limit risk
2026-02-04 23:27:15 +01:00
ggman12