OpenAirframes

CalvinBackup/OpenAirframes

Fork 0

mirror of https://github.com/PlaneQuery/OpenAirframes.git synced 2026-04-23 19:46:09 +02:00

Commit Graph

Select branches

Hide Pull Requests

community-submission-12

community-submission-14

community-submission-20

community-submission-23

community-submission-27

community-submission-29

community-submission-7

community-submission-9

copilot/fix-ads-b-reduce-failure

develop

import/af-klm-fleet

jonah/fix-historical-proper

main

#1

#10

#11

#13

#15

#16

#17

#18

#19

#2

#21

#22

#24

#24

#25

#28

#3

#30

#30

#31

#32

#33

#34

#35

#4

#5

#8

openairframes-2026-02-12-develop

openairframes-2026-02-13-develop

openairframes-2026-02-13-main

openairframes-2026-02-14-develop

openairframes-2026-02-15-develop

openairframes-2026-02-15-main

openairframes-2026-02-16-develop

openairframes-2026-02-16-main

openairframes-2026-02-17-develop

openairframes-2026-02-17-main

openairframes-2026-02-19-main

openairframes-2026-02-20-develop

openairframes-2026-02-20-main

openairframes-2026-02-21-develop

openairframes-2026-02-21-main

openairframes-2026-02-22-develop

openairframes-2026-02-22-main

openairframes-2026-02-23-develop

openairframes-2026-02-23-main

openairframes-2026-02-24-develop

openairframes-2026-02-24-main

openairframes-2026-02-25-develop

openairframes-2026-02-25-main

openairframes-2026-02-26-develop

openairframes-2026-02-26-main

openairframes-2026-02-27-develop

openairframes-2026-02-27-main

openairframes-2026-02-28-develop

openairframes-2026-02-28-main

openairframes-2026-03-01-develop

openairframes-2026-03-01-main

openairframes-2026-03-02-develop

openairframes-2026-03-02-main

openairframes-2026-03-03-develop

openairframes-2026-03-03-main

openairframes-2026-03-04-develop

openairframes-2026-03-04-main

openairframes-2026-03-05-develop

openairframes-2026-03-05-main

openairframes-2026-03-06-develop

openairframes-2026-03-06-main

openairframes-2026-03-07-develop

openairframes-2026-03-07-main

openairframes-2026-03-08-develop

openairframes-2026-03-08-main

openairframes-2026-03-09-develop

openairframes-2026-03-09-main

openairframes-2026-03-10-develop

openairframes-2026-03-10-main

openairframes-2026-03-11-main

openairframes-2026-03-12-develop

openairframes-2026-03-12-main

openairframes-2026-03-13-develop

openairframes-2026-03-13-main

openairframes-2026-03-14-develop

openairframes-2026-03-14-main

openairframes-2026-03-15-develop

openairframes-2026-03-15-main

openairframes-2026-03-16-develop

openairframes-2026-03-16-main

openairframes-2026-03-17-develop

openairframes-2026-03-17-main

openairframes-2026-03-18-develop

openairframes-2026-03-18-main

openairframes-2026-03-19-develop

openairframes-2026-03-19-main

openairframes-2026-03-20-develop

openairframes-2026-03-20-main

openairframes-2026-03-21-develop

openairframes-2026-03-21-main

openairframes-2026-03-22-develop

openairframes-2026-03-22-main

openairframes-2026-03-23-develop

openairframes-2026-03-23-main

openairframes-2026-03-24-develop

openairframes-2026-03-24-main

openairframes-2026-03-25-develop

openairframes-2026-03-25-main

openairframes-2026-03-26-develop

openairframes-2026-03-26-main

openairframes-2026-03-27-develop

openairframes-2026-03-27-main

openairframes-2026-03-28-develop

openairframes-2026-03-28-main

openairframes-2026-03-29-develop

openairframes-2026-03-29-main

openairframes-2026-03-30-develop

openairframes-2026-03-30-main

openairframes-2026-03-31-develop

openairframes-2026-03-31-main

openairframes-2026-04-01-develop

openairframes-2026-04-01-main

openairframes-2026-04-02-develop

openairframes-2026-04-02-main

openairframes-2026-04-03-develop

openairframes-2026-04-03-main

openairframes-2026-04-04-develop

openairframes-2026-04-04-main

openairframes-2026-04-05-develop

openairframes-2026-04-05-main

openairframes-2026-04-06-develop

openairframes-2026-04-06-main

openairframes-2026-04-07-develop

openairframes-2026-04-07-main

openairframes-2026-04-08-develop

openairframes-2026-04-08-main

openairframes-2026-04-09-develop

openairframes-2026-04-09-main

openairframes-2026-04-10-develop

openairframes-2026-04-10-main

openairframes-2026-04-11-develop

openairframes-2026-04-11-main

openairframes-2026-04-12-develop

openairframes-2026-04-12-main

openairframes-2026-04-13-develop

openairframes-2026-04-13-main

openairframes-2026-04-14-develop

openairframes-2026-04-14-main

openairframes-2026-04-15-develop

openairframes-2026-04-15-main

openairframes-2026-04-16-develop

openairframes-2026-04-16-main

openairframes-2026-04-17-develop

openairframes-2026-04-17-main

openairframes-2026-04-18-develop

openairframes-2026-04-18-main

openairframes-2026-04-19-develop

openairframes-2026-04-19-main

openairframes-2026-04-20-develop

openairframes-2026-04-20-main

openairframes-2026-04-21-develop

openairframes-2026-04-21-main

openairframes-2026-04-22-develop

openairframes-2026-04-22-main

openairframes-2026-04-23-develop

openairframes-2026-04-23-main

planequery-aircraft-2026-02-03

planequery-aircraft-2026-02-04

planequery-aircraft-2026-02-05

planequery-aircraft-2026-02-06

planequery-aircraft-2026-02-07

planequery-aircraft-2026-02-08

planequery-aircraft-2026-02-09

planequery-aircraft-2026-02-10

planequery-aircraft-2026-02-11

planequery-aircraft-2026-02-12-develop

planequery-aircraft-2026-02-12-main

2829e5fb6e Merge pull request #35 from PlaneQuery/develop main openairframes-2026-04-23-main openairframes-2026-04-23-develop openairframes-2026-04-22-main openairframes-2026-04-22-develop openairframes-2026-04-21-main openairframes-2026-04-21-develop openairframes-2026-04-20-main openairframes-2026-04-20-develop openairframes-2026-04-19-main openairframes-2026-04-19-develop openairframes-2026-04-18-main openairframes-2026-04-18-develop openairframes-2026-04-17-main openairframes-2026-04-17-develop openairframes-2026-04-16-main openairframes-2026-04-16-develop openairframes-2026-04-15-main openairframes-2026-04-15-develop openairframes-2026-04-14-main openairframes-2026-04-14-develop openairframes-2026-04-13-main openairframes-2026-04-13-develop openairframes-2026-04-12-main openairframes-2026-04-12-develop openairframes-2026-04-11-main openairframes-2026-04-11-develop openairframes-2026-04-10-main openairframes-2026-04-10-develop openairframes-2026-04-09-main openairframes-2026-04-09-develop openairframes-2026-04-08-main openairframes-2026-04-08-develop openairframes-2026-04-07-main openairframes-2026-04-07-develop openairframes-2026-04-06-main openairframes-2026-04-06-develop openairframes-2026-04-05-main openairframes-2026-04-05-develop openairframes-2026-04-04-main openairframes-2026-04-04-develop openairframes-2026-04-03-main openairframes-2026-04-03-develop openairframes-2026-04-02-main openairframes-2026-04-02-develop openairframes-2026-04-01-main openairframes-2026-04-01-develop openairframes-2026-03-31-main openairframes-2026-03-31-develop openairframes-2026-03-30-main openairframes-2026-03-30-develop openairframes-2026-03-29-main openairframes-2026-03-29-develop openairframes-2026-03-28-main openairframes-2026-03-28-develop openairframes-2026-03-27-main openairframes-2026-03-27-develop openairframes-2026-03-26-main openairframes-2026-03-26-develop openairframes-2026-03-25-main openairframes-2026-03-25-develop openairframes-2026-03-24-main openairframes-2026-03-24-develop openairframes-2026-03-23-main openairframes-2026-03-23-develop openairframes-2026-03-22-main openairframes-2026-03-22-develop openairframes-2026-03-21-main openairframes-2026-03-21-develop openairframes-2026-03-20-main openairframes-2026-03-20-develop openairframes-2026-03-19-main openairframes-2026-03-19-develop JG 2026-03-18 14:31:29 -04:00
9c744b0baf update readme.md develop ggman12 2026-03-18 14:29:13 -04:00
ebda04767f Merge pull request #34 from PlaneQuery/develop openairframes-2026-03-18-main openairframes-2026-03-18-develop openairframes-2026-03-17-main openairframes-2026-03-17-develop openairframes-2026-03-16-main openairframes-2026-03-16-develop openairframes-2026-03-15-main openairframes-2026-03-15-develop openairframes-2026-03-14-main openairframes-2026-03-14-develop openairframes-2026-03-13-main openairframes-2026-03-13-develop openairframes-2026-03-12-main openairframes-2026-03-12-develop openairframes-2026-03-11-main JG 2026-03-10 05:12:11 -04:00
3fdf443894 add russia_ukraine ggman12 2026-02-18 23:10:45 -05:00
24313603c5 works ggman12 2026-02-18 23:03:02 -05:00
2bb0a5eac3 Merge pull request #33 from PlaneQuery/develop openairframes-2026-03-10-main openairframes-2026-03-10-develop openairframes-2026-03-09-main openairframes-2026-03-09-develop openairframes-2026-03-08-main openairframes-2026-03-08-develop openairframes-2026-03-07-main openairframes-2026-03-07-develop openairframes-2026-03-06-main openairframes-2026-03-06-develop openairframes-2026-03-05-main openairframes-2026-03-05-develop openairframes-2026-03-04-main openairframes-2026-03-04-develop openairframes-2026-03-03-main openairframes-2026-03-03-develop openairframes-2026-03-02-main openairframes-2026-03-02-develop openairframes-2026-03-01-main openairframes-2026-03-01-develop openairframes-2026-02-28-main openairframes-2026-02-28-develop openairframes-2026-02-27-main openairframes-2026-02-27-develop openairframes-2026-02-26-main JG 2026-02-26 15:32:59 -05:00
b54f33aa56 Handle ADSB when ADSB.lol has not released any data for day. Just rerelease latest adsb ggman12 2026-02-26 14:43:11 -05:00
2dda3d341c Merge pull request #32 from PlaneQuery/develop openairframes-2026-02-26-develop openairframes-2026-02-25-main openairframes-2026-02-25-develop JG 2026-02-24 15:37:54 -05:00
b0526f0a95 Fix Community Submission export. Fix CSV concatenation logic to prevent duplicates when there is no new ADSB.lol data. ggman12 2026-02-24 03:18:53 -05:00
4b6a043a9d Merge pull request #31 from PlaneQuery/develop JG 2026-02-24 02:17:08 -05:00
55c464aad7 Fix adsb asset retrival to be more fault tolerant. Fix download issue for 2024-07-03 ggman12 2026-02-24 02:12:55 -05:00
aa509e8560 attempt to fix download issue for 2024-07-03 ggman12 2026-02-19 17:51:49 -05:00
82d11d8d24 try less strict tar extract for 2025-10-15 and other days that fail openairframes-2026-02-24-main openairframes-2026-02-24-develop openairframes-2026-02-23-main openairframes-2026-02-23-develop openairframes-2026-02-22-main openairframes-2026-02-22-develop openairframes-2026-02-21-main openairframes-2026-02-21-develop openairframes-2026-02-20-main openairframes-2026-02-20-develop openairframes-2026-02-19-main ggman12 2026-02-19 00:20:03 -05:00
f93816977f Update schema with new tags: owner, owner_category_0, owner_category_1, category community-submission-29 github-actions[bot] 2026-02-19 04:20:28 +00:00
a37bd43c09 Add community submission from @ggman12 (closes #29) github-actions[bot] 2026-02-19 04:20:26 +00:00
76a217ad14 src/contributions/approve_submission.py handle big json files ggman12 2026-02-18 23:11:12 -05:00
ec2d1a1291 update download.sh ggman12 2026-02-18 21:08:07 -05:00
97284c69a9 verify downlaod asssets ggman12 2026-02-18 20:52:54 -05:00
a2880904e5 Community submission (rebased on main) community-submission-23 github-actions[bot] 2026-02-18 22:19:18 +00:00
892ffa78af Merge pull request #28 from PlaneQuery/community-submission-27 JG 2026-02-18 17:18:49 -05:00
f77a91db2c Update schema with new tags: manufacturer_icao, manufacturer_name, model, type_code, serial_number, icao_aircraft_type, operator, operator_callsign, operator_icao, citation_0 community-submission-27 github-actions[bot] 2026-02-18 22:18:12 +00:00
b3bd654998 Add community submission from @ggman12 (closes #27) github-actions[bot] 2026-02-18 22:18:12 +00:00
302be8b8dc update checker for arrays issue ggman12 2026-02-18 17:11:14 -05:00
b61dc0f5e5 provide more error ggman12 2026-02-18 17:08:43 -05:00
1ff17cc6a8 allow adsb to fail for when adsb.lol hasen't uploaded file yet. ggman12 2026-02-18 16:49:02 -05:00
d216ea9329 Daily ADSB and Histoircal updates. Update readme.md ggman12 2026-02-13 11:49:18 -05:00
4703383648 add hisotircal-adsb-run.yaml jonah/fix-historical-proper ggman12 2026-02-17 17:55:49 -05:00
53633bc09f use v6 for python ggman12 2026-02-17 17:39:54 -05:00
f6897c1b72 updates to .github/workflows/historical-adsb.yaml ggman12 2026-02-17 17:36:47 -05:00
19f3c5b63c Add main pipeline for processing ADS-B data with date argument ggman12 2026-02-17 17:27:44 -05:00
b2f6a751fa Refactor concat_parquet_to_final.py to accept date as an argument and streamline file handling ggman12 2026-02-17 17:27:41 -05:00
88b00c1cf6 add .snapshots to .gitignore ggman12 2026-02-17 17:27:28 -05:00
b6bf915cec Filter rows by date in compress_parquet_part function ggman12 2026-02-17 16:59:09 -05:00
6306aade16 Make global NUMBER_PARTS. remove print. ggman12 2026-02-17 16:42:59 -05:00
9c54d9f1e4 remove print ggman12 2026-02-17 16:40:25 -05:00
e8707ab853 get rid of unused code ggman12 2026-02-17 16:18:26 -05:00
ca5cb23a4d use date folder ggman12 2026-02-17 16:16:46 -05:00
121dccf26c concat file ggman12 2026-02-17 16:16:41 -05:00
db98b3021a change to use path ggman12 2026-02-17 16:16:35 -05:00
94cf50ac3a make return consistant ggman12 2026-02-17 16:09:09 -05:00
ac177e8025 output .csv too ggman12 2026-02-17 16:09:01 -05:00
6b7068bc84 works ggman12 2026-02-17 15:51:20 -05:00
70ec797535 works ggman12 2026-02-17 15:46:07 -05:00
1afe2bed4e remvoe code from src/adsb/process_icao_chunk.py ggman12 2026-02-17 15:42:45 -05:00
d3c52266e5 fix tar corrruption ggman12 2026-02-17 15:42:35 -05:00
c0dca14b83 remove unused code ggman12 2026-02-17 14:57:29 -05:00
1fc4a94743 do only a single day instead of multiple ggman12 2026-02-17 14:23:30 -05:00
f29abad52a output to parted tar.gz ggman12 2026-02-17 14:10:01 -05:00
6eb84a894b add notebooks/whatever.ipynb to .gitignore ggman12 2026-02-17 12:48:59 -05:00
0c81490513 make it single day ggman12 2026-02-17 12:48:28 -05:00
11ed7e597d delete unused code ggman12 2026-02-17 12:48:01 -05:00
24c0fc970c use exclusive end_date ggman12 2026-02-17 12:47:44 -05:00
c12e855b5a change from 7 days to 1 ggman12 2026-02-16 20:36:20 -05:00
b55690638c feat: implement download and concatenate script for workflow artifacts ggman12 2026-02-16 20:34:22 -05:00
dcee136f09 refactor: update historical-adsb script to use 15-day chunks and improve argument handling ggman12 2026-02-16 20:14:04 -05:00
035748fc61 skip using base release in run_local.py ggman12 2026-02-16 18:26:53 -05:00
13432068e6 src/adsb/run_local.py works ggman12 2026-02-16 17:45:31 -05:00
9cb4c5045b remove compression from github action ggman12 2026-02-16 17:41:15 -05:00
343a391a3f change default chunk_days from 7 to 3 ggman12 2026-02-16 16:35:05 -05:00
2bc45ff6a4 increase retry_delay to 5 minutes. ggman12 2026-02-16 15:35:02 -05:00
03291d93a8 add scripts/run_historical_adsb_action.py ggman12 2026-02-16 14:54:25 -05:00
2b720f3d88 Remove step-level timeouts to allow artifact downloads to complete copilot/fix-ads-b-reduce-failure copilot-swe-agent[bot] 2026-02-16 19:38:27 +00:00
e65da2cd95 Fix YAML property ordering for timeout-minutes copilot-swe-agent[bot] 2026-02-16 17:50:18 +00:00
7ea815732c Add timeout and retry logic to adsb-reduce artifact download step copilot-swe-agent[bot] 2026-02-16 17:49:41 +00:00
7fd5df8777 Initial plan copilot-swe-agent[bot] 2026-02-16 17:44:39 +00:00
5883b459ac fix bug with no dupliacte icaos across days ggman12 2026-02-15 21:08:17 -05:00
f8ba66375b preserve time ggman12 2026-02-15 21:08:03 -05:00
7a62faecef sort by time in end ggman12 2026-02-15 20:33:06 -05:00
9964ce576b slight update for compress by day ggman12 2026-02-15 20:32:33 -05:00
be33fd2eaf compress by day ggman12 2026-02-15 19:59:50 -05:00
2b2095700f use chunks in run_local ggman12 2026-02-15 19:53:09 -05:00
a8b2b66952 fix .csv to .csv.gz transition openairframes-2026-02-17-main openairframes-2026-02-17-develop openairframes-2026-02-16-main openairframes-2026-02-16-develop ggman12 2026-02-15 19:08:51 -05:00
3f38263a0c stop depue that destroys previous days ggman12 2026-02-15 17:55:16 -05:00
1a553d5f44 use date of file instead of min timestamp ggman12 2026-02-15 16:44:09 -05:00
405855c566 deal with whole schema ggman12 2026-02-15 16:43:00 -05:00
4e81dde201 fix date parsing ggman12 2026-02-15 14:55:32 -05:00
fde8ef029c update csv writing to handle empty data. Save space with higher gzip compression ggman12 2026-02-15 14:14:54 -05:00
18ab51bd60 update naming ggman12 2026-02-15 13:45:03 -05:00
83b9d2a76d write gzip ggman12 2026-02-15 13:41:09 -05:00
8874619ab0 write gzip ggman12 2026-02-15 13:41:02 -05:00
823f291728 fix errors in daily release due to new .gz file ggman12 2026-02-15 13:21:51 -05:00
982011b36f end of year check ggman12 2026-02-14 22:42:32 -05:00
1b15e43669 use .csv.gz ggman12 2026-02-14 22:22:14 -05:00
f17adc4574 remvoe aws worker, reducer ggman12 2026-02-14 22:21:14 -05:00
6a250a63fb fix None value comparision openairframes-2026-02-15-main openairframes-2026-02-15-develop ggman12 2026-02-14 20:21:32 -05:00
9e24fcbc63 update integrity checker. Hopefully solve issue. ggman12 2026-02-14 19:56:25 -05:00
8ce04f1f83 Revert "update for historical run" ggman12 2026-02-14 18:44:21 -05:00
9441761ac9 use temp release too. ggman12 2026-02-14 18:43:25 -05:00
ccf55b2308 update for historical run ggman12 2026-02-14 15:57:16 -05:00
76eaf118ef add run_local.py ggman12 2026-02-14 15:54:36 -05:00
0fcbad0fbc let mictronics retry ggman12 2026-02-14 15:07:08 -05:00
0c7484e7bf create_daily_microtonics release openairframes-2026-02-14-develop ggman12 2026-02-13 18:25:22 -05:00
8c60ac611d create daily adsbexchange database snapshot release ggman12 2026-02-13 15:26:31 -05:00
145f1006be update template openairframes-2026-02-13-develop ggman12 2026-02-13 12:12:24 -05:00
f5465f0552 update .github/workflows/update-community-prs.yaml ggman12 2026-02-13 12:00:10 -05:00
17098ae39a fix update-community-prs.yaml ggman12 2026-02-13 11:52:53 -05:00
6f6b65780a update community_submission.yaml. update Readme.md ggman12 2026-02-13 11:49:18 -05:00
4015a5fcf1 OpenAirframes 1.0 ggman12 2026-02-12 10:52:42 -05:00
8999a943a9 update histoircal openairframes-2026-02-13-main ggman12 2026-02-13 00:12:18 -05:00
74625b9bc9 split large file into chuncks ggman12 2026-02-12 20:22:36 -05:00

1 2 3