Commit Graph

42 Commits

Author SHA1 Message Date
ggman12 efb4cbb953 update example 2026-02-12 13:22:43 -05:00
ggman12 5578133a99 update schema to be uppercase only 2026-02-12 12:36:50 -05:00
ggman12 eace7d5a63 update folder 2026-02-12 12:34:27 -05:00
ggman12 82f47b662c make blank username work 2026-02-12 12:32:41 -05:00
ggman12 787796c3ab update approve_submission 2026-02-12 12:26:54 -05:00
ggman12 61aae586ee fix approve 2026-02-12 12:18:28 -05:00
ggman12 5abfa6b226 update submission validation 2026-02-12 12:15:04 -05:00
ggman12 a743b74ae5 Merge branch 'develop' 2026-02-12 12:10:24 -05:00
ggman12 53a020ab73 add jsonschema to requirements.txt 2026-02-12 12:09:03 -05:00
ggman12 2de41c9883 update historical. To check tar and fail fast if any maps fail 2026-02-12 12:01:13 -05:00
ggman12 bccc634158 remove existing release 2026-02-12 11:50:45 -05:00
ggman12 43b07942b0 add needed permissions 2026-02-12 11:42:49 -05:00
ggman12 2c9e994a12 add debug for FAA 2026-02-12 11:06:38 -05:00
ggman12 99b680476a delete parquet chunck after load to not use so much space for big historical run 2026-02-12 10:52:42 -05:00
JG f9e04337ae Merge pull request #5 from PlaneQuery/develop
FIX: trigger for planequery-aircraft daily release workflow. Update contributions issue template.
planequery-aircraft-2026-02-12-main
2026-02-12 10:42:47 -05:00
ggman12 1348e1f3a0 Merge branch 'main' into develop 2026-02-12 10:41:26 -05:00
ggman12 b349c01d31 FIX: trigger for planequery-aircraft daily release workflow. Update contributions issue template. 2026-02-12 10:26:05 -05:00
JG a98175bc6c Merge pull request #3 from PlaneQuery/develop
Develop to main new historical adsb workflow. Community Submission updates.
2026-02-11 23:42:40 -05:00
ggman12 953a3647df remove process historical-faa github workflow 2026-02-11 23:41:42 -05:00
ggman12 e5c99b611c make a histoircla runner for adsb 2026-02-11 23:41:42 -05:00
ggman12 4e803dbb45 remove confirmations 2026-02-11 23:41:42 -05:00
JG 59c2aab5c7 Merge pull request #2 from PlaneQuery/develop
develop to main FEATURE: Add contributions framework. Fix and improve daily adsb release
2026-02-11 23:24:01 -05:00
ggman12 722bcdf791 FEATURE: Add contributions framework. Fix and improve daily adsb release using Github actions for map reduce. 2026-02-11 23:22:46 -05:00
ggman12 27da93801e FEATURE: add historical adsb aircraft data and update daily adsb aircraft data derivation.
add clickhouse_connect

use 32GB

update to no longer do df.copy()

Add planequery_adsb_read.ipynb

INCREASE: update Fargate task definition to 16 vCPU and 64 GB memory for improved performance on large datasets

update notebook

remove print(df)

Ensure empty strings are preserved in DataFrame columns

check if day has data for adsb

update notebook
2026-02-11 13:58:56 -05:00
JG b94bfdc575 Merge pull request #1 from PlaneQuery/import/af-klm-fleet
af-klm-fleet from iclems
planequery-aircraft-2026-02-09 planequery-aircraft-2026-02-05 planequery-aircraft-2026-02-06 planequery-aircraft-2026-02-07 planequery-aircraft-2026-02-08 planequery-aircraft-2026-02-10 planequery-aircraft-2026-02-11 planequery-aircraft-2026-02-12-develop
2026-02-04 17:51:46 -05:00
ggman12 c90bdada76 delete air-france folder 2026-02-04 17:49:25 -05:00
ggman12 921cbefb6e Add 'af-klm-fleet/' from commit 'b1dd01c27eccc8ba620994b6ae0df78a37075f3a'
git-subtree-dir: af-klm-fleet
git-subtree-mainline: 85a3db4dd0
git-subtree-split: b1dd01c27e
2026-02-04 17:47:47 -05:00
Clément Wehrung b1dd01c27e Fix API rate limit risk 2026-02-04 23:27:15 +01:00
Clément Wehrung 2282e1197f Auto-update fleet data - 2026-02-04 2026-02-04 23:25:27 +01:00
Clément Wehrung ea9c095f91 Fix generate README / License 2026-02-04 23:25:18 +01:00
Clément Wehrung 4eb2b9ce0b Auto-update fleet data - 2026-02-04 2026-02-04 23:21:27 +01:00
Clément Wehrung 23ef72100f Merge branch 'main' of github.com:iclems/af-klm-fleet 2026-02-04 23:20:04 +01:00
Clément Wehrung bfb22670ba Added cron update 2026-02-04 23:19:02 +01:00
Clem c7a3d9e056 Update README.md 2026-02-04 23:07:47 +01:00
Clément Wehrung 0d683d3510 Initial fleet data: Air France (220) + KLM (117) aircraft 2026-02-04 23:03:47 +01:00
Clem 8f11a1d05a Initial commit 2026-02-04 23:00:48 +01:00
ggman12 85a3db4dd0 add air-france folder planequery-aircraft-2026-02-04 2026-02-03 17:28:47 -05:00
ggman12 42f95208c6 update name 2026-02-02 20:50:37 -05:00
ggman12 16a0a5fec8 Create derived csv daily. Get historical FAA data 2026-02-02 20:48:35 -05:00
ggman12 2e60c64f61 add src/get_historical_faa.py 2026-02-01 13:05:29 -05:00
ggman12 72a949ee21 update name of assets 2026-02-01 12:20:17 -05:00
ggman12 ccefbf437c Initial commit 2026-01-31 21:10:15 -05:00