Commit Graph

174 Commits

Author SHA1 Message Date
Shadowbroker c2f2f99cf4 Merge pull request #98 from johan-martensson/feat/satellite-data-quality
fix: correct COSMO-SkyMed key and add missing satellite classifications
2026-03-22 01:49:19 -06:00
Shadowbroker ed70f88c04 Merge pull request #96 from johan-martensson/fix/financial-batch-fetch
fix: replace concurrent yfinance fetches with single batch download
2026-03-22 01:48:14 -06:00
Johan Martensson 7a02bf6178 fix: correct COSMO-SKYMED key and add missing satellite classifications (COSMOS, WGS, AEHF, MUOS, SENTINEL, CSS) 2026-03-22 05:31:28 +00:00
Johan Martensson 98a9293166 fix: replace concurrent yfinance fetches with single batch download to avoid rate limiting 2026-03-22 05:31:28 +00:00
Shadowbroker 803a296133 Merge pull request #93 from singularfailure/main
feat: add Spanish CCTV feeds and fix image loading
2026-03-21 12:49:19 -06:00
Singular Failure 3a2d8ddd75 feat: add Spanish CCTV feeds and fix image loading
- Add 5 native ingestors to cctv_pipeline.py: DGT (~1,917 cameras),
  Madrid (~357), Málaga (~134), Vigo (~59), Vitoria-Gasteiz (~17)
- Fix DGT DATEX2 parser to match actual XML schema (device elements,
  not CctvCameraRecord)
- Wire all new ingestors into the scheduler via data_fetcher.py
- Remove standalone spain_cctv.py by Alborz Nazari, replaced by native
  pipeline ingestors that integrate with the existing scheduler pattern
- Fix CCTV image loading for servers with Referer-based hotlink
  protection (referrerPolicy="no-referrer")
- Replace external via.placeholder.com fallbacks with inline SVG data
  URIs to avoid dependency on unreachable third-party service
- Surface source_agency attribution in CCTV panel UI for open data
  license compliance (CC BY / Spain Ley 37/2007)

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-21 15:10:43 +01:00
Shadowbroker 42a800a683 Merge pull request #92 from wa1id/fix/cctv-layer-population
fix: restore CCTV layer ingestion and map rendering
2026-03-20 18:05:23 -06:00
Wa1iD 231f0afc4e fix: restore CCTV layer ingestion and map rendering 2026-03-20 22:05:05 +01:00
Shadowbroker f0b6f9a8d1 Merge pull request #91 from AlborzNazari/feature/spain-cctv-stix
feat: add Spain DGT/Madrid CCTV sources and STIX 2.1 export endpoint
2026-03-20 12:38:02 -06:00
Alborz Nazari 335b1f78f6 feat: add Spain DGT/Madrid CCTV sources and STIX 2.1 export endpoint 2026-03-20 17:27:13 +01:00
Shadowbroker 2a5b8134a4 Merge pull request #87 from adust09/feat/power-plants-layer
feat: add power plants layer (WRI Global Power Plant Database)
2026-03-18 09:43:11 -06:00
adust09 b40f9d1fd0 feat: add power plants layer with WRI Global Power Plant Database
Map ~35,000 power generation facilities from 164 countries using the
WRI Global Power Plant Database (CC BY 4.0). Follows the existing
datacenter layer pattern with clustered icon symbols, amber color
scheme, and click popups showing fuel type, capacity, and operator.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-18 16:56:24 +09:00
Shadowbroker 2812d43f49 Merge pull request #78 from Xpirix/change_style_only_on_style_div
style: update LocateBar component to improve style interaction
2026-03-16 12:17:29 -06:00
Xpirix ebcc101168 style: update bottom bar component to improve style interaction 2026-03-16 20:16:00 +03:00
Shadowbroker fbec6fe323 Merge pull request #77 from adust09/feat/jsdf-bases-layer
feat: add 18 JSDF bases to military bases layer
2026-03-16 10:53:40 -06:00
adust09 44147da205 fix: resolve merge conflicts between JSDF bases and East Asia adversary bases
Merge both feature sets: keep JSDF bases (gsdf/msdf/asdf branches) from
PR #77 and East Asia adversary bases (missile/nuclear branches) from main.
Union all branch types in tests and MaplibreViewer labels.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-17 01:10:19 +09:00
Shadowbroker 144fca4e75 Merge pull request #76 from adust09/feat/east-asia-enhancement
feat: East Asia intelligence coverage enhancement
2026-03-15 23:46:30 -06:00
adust09 457f00ca42 feat: add 18 JSDF bases to military bases layer
Add ASDF (8), MSDF (6), and GSDF (4) bases to military_bases.json.
Colocated bases (Misawa, Yokosuka, Sasebo) have offset coordinates
to avoid overlap with existing US entries. Add branchLabel entries
for GSDF/MSDF/ASDF in MaplibreViewer popup.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-16 14:44:32 +09:00
adust09 27506bbaa9 test: add JSDF bases tests (RED phase)
- Add gsdf/msdf/asdf to known_branches in test_branch_values_are_known
- Add test_includes_jsdf_bases for Yonaguni, Naha, Kure
- Add test_colocated_bases_have_separate_entries for Misawa
- Add buildMilitaryBasesGeoJSON tests with ASDF branch validation

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-16 14:43:01 +09:00
adust09 910d1fd633 feat: enhance East Asia coverage with adversary bases, news sources, ICAO ranges, and PLAN vessel DB
- Add 68 military bases (PLA, Russia, DPRK, ROC, Philippines, Australia)
  with data-driven color coding (red/blue/green) on the map
- Add 6 news RSS feeds (Yonhap, Nikkei Asia, Taipei Times, Asia Times,
  Defense News, Japan Times) and 15 geocoding keywords for islands,
  straits, and disputed areas
- Extend ICAO country ranges for Russia, Australia, Philippines,
  Singapore, DPRK and add Russian aircraft classification (fighters,
  bombers, cargo, recon)
- Create PLAN/CCG vessel enrichment module (90+ ships) following
  yacht_alert pattern for automatic MMSI-based identification
- Update frontend types and popup styling for adversary/allied/ROC
  color distinction

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-16 12:46:40 +09:00
Shadowbroker 95da3015d9 Create LICENSE
Freedom for the people
2026-03-15 18:43:26 -06:00
Shadowbroker 1ac05bad0b Merge pull request #72 from adust09/feat/military-bases-layer
feat: East Asia military tracking — ICAO enrichment, model classification, force display
2026-03-15 10:31:54 -06:00
adust09 4b9765791f feat: enrich military aircraft with ICAO country/force and East Asia model classification
Infer country and military force (PLA, JSDF, ROK, ROC) from ICAO hex
address blocks when the flag field is Unknown. Extract and extend aircraft
model classification to cover East Asian fighters, cargo, recon, and
tanker types with hyphen-normalized matching.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-16 01:05:44 +09:00
adust09 05de14af9d feat: add military bases map layer for Western Pacific
Add 18 US military bases (Japan, Guam, South Korea, Hawaii, Diego Garcia)
as a toggleable map layer. Follows the existing data center layer pattern:
static JSON → backend fetcher → slow-tier API → frontend GeoJSON layer.

Includes red circle markers with labels, click popups showing operator
and branch info, and a toggle in the left panel.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-16 00:33:35 +09:00
adust09 130287bb49 feat: add East Asia news sources and improve geocoding for Taiwan contingency
Add 5 East Asia-focused RSS feeds (FocusTaiwan, Kyodo, SCMP, The Diplomat,
Stars and Stripes) and 22 geographic keywords (Taiwan Strait, South/East
China Sea, Okinawa, Guam, military bases, etc.) to improve coverage of
Taiwan contingency scenarios.

Refactor keyword matching into a pure _resolve_coords() function with
longest-match-first sorting so specific locations like "Taiwan Strait"
are not absorbed by generic "Taiwan".

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-15 23:19:55 +09:00
anoracleofra-code 4a33424924 fix: correct Helm chart path in README
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-15 01:10:23 -06:00
anoracleofra-code acf1267681 fix: correct Helm chart image repos and apiVersion
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-15 01:07:20 -06:00
Shadowbroker b5f49fe882 Update README.md
Former-commit-id: 85110e82cc09ab746d323f8625b8ecb5b1c03500
2026-03-14 19:26:50 -06:00
Shadowbroker 42d301f6eb Merge pull request #66 from chr0n1x/helm-chart
feat: helm chart!
Former-commit-id: a5d440d990e1565d248d8f9ba6b7f5626dc46da0
2026-03-14 19:21:56 -06:00
Shadowbroker 71c00a6c57 Delete frontend/errors.txt
Former-commit-id: 257159ead999c4805217b3bcefb24101b34281b9
2026-03-14 19:16:22 -06:00
Shadowbroker a0c2ff68c0 Delete frontend/build_error.txt
Former-commit-id: b984825c75bb468d9b80c72e62b8f5ba897af9c7
2026-03-14 19:16:07 -06:00
Shadowbroker 3e41cc4999 Delete frontend/build_logs2.txt
Former-commit-id: c60db226c818c30ba78012b4906d3aaf763a7100
2026-03-14 19:15:48 -06:00
Shadowbroker 79ade6d92f Delete frontend/build_logs.txt
Former-commit-id: 2c6e44b2882a9d3646ebcbdc8c632f4f9e8a98a1
2026-03-14 19:15:26 -06:00
Shadowbroker 50a07fb419 Delete frontend/build_logs3.txt
Former-commit-id: 18910fb5ded0c99f9c4a9e6febfe3c8f464f754a
2026-03-14 19:15:13 -06:00
Shadowbroker 850a532d2b Delete frontend/build_logs4.txt
Former-commit-id: 873cf8224397f822e076d8c5a92796b9e2ceb2ad
2026-03-14 19:15:02 -06:00
Shadowbroker 2f6a3d56b0 Delete frontend/build_logs5.txt
Former-commit-id: 9e6f1567e68d3d55c285f4e5235b5ad6220ebd49
2026-03-14 19:12:13 -06:00
Shadowbroker e83d71bb1f Delete frontend/build_output.txt
Former-commit-id: 564ddfcb3f135243d3017c5eb8aff5bfed521601
2026-03-14 19:11:59 -06:00
Kevin R 078eac12d8 feat: helm chart!
Former-commit-id: 27a7d19a73f4360424d2654a078b6cc26c53d231
2026-03-14 19:39:55 -04:00
Shadowbroker 21668a4d66 Update README.md
Former-commit-id: 28a314c7a4162c303bf4b7d71aec69b8441c197f
2026-03-14 16:19:33 -06:00
Shadowbroker 54993c3f89 Update README.md
Former-commit-id: 2a80e7ff67e5a3fd13df59bf547d1455ed563b20
2026-03-14 15:41:15 -06:00
anoracleofra-code b37bfc0162 fix: add path traversal guard to updater extraction
Validates that every destination path stays within project_root
before writing. Prevents a malicious zip from writing outside
the project directory via ../traversal entries.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

Former-commit-id: 3140416e80b1b56e4e6cccc930d11c2d5f9b1611
2026-03-14 14:48:47 -06:00
anoracleofra-code 95474c3ac5 fix: updater resolves project_root to / in Docker containers
In Docker, main.py lives at /app/main.py so Path.parent.parent
resolves to filesystem root /, causing PermissionError on .github
and other dirs. Now detects this case and falls back to cwd.
Also grants backenduser write access to /app for auto-update.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

Former-commit-id: 12c8bb5816a70161d5ab5d79f9240e7eab6e6e15
2026-03-14 14:34:11 -06:00
anoracleofra-code b99a5e5d66 fix: updater crashes on os.makedirs PermissionError + prune protected dirs
os.makedirs was outside try/except so permission-denied on .github
directory creation crashed the entire update. Now both makedirs and
copy are caught. Also prunes protected dirs from os.walk so the
updater never even enters .github, .git, .claude, etc.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

Former-commit-id: d4bdef4604095a82860a4bc91bec3435a878f899
2026-03-14 14:29:37 -06:00
anoracleofra-code 3cdd2c851e fix: updater permission denied on .github — add to protected dirs
The auto-updater tried to extract .github/ from the release zip,
causing Permission denied errors. Added .github and .claude to the
protected directories list so they are skipped during extraction.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

Former-commit-id: 8916fa08e005820ddbfc3b195c387dbf6187587e
2026-03-14 14:23:03 -06:00
anoracleofra-code 8ff4516a7a fix: auto-updater proxy drop + protect internal docs from git
Auto-update POST goes through Next.js proxy which dies when extracted
files trigger hot-reload. Network drops now transition to restart polling
instead of showing failure. Also adds admin key header and FastAPI error
field fallback. Gitignore updated to protect internal docs.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

Former-commit-id: 03162f8a4b7ad8a0f2983f81361df7dba42a8689
2026-03-14 14:18:30 -06:00
anoracleofra-code 90c2e90e2c v0.9.5: The Voltron Update — modular architecture, stable IDs, parallelized boot
- Parallelized startup (60s → 15s) via ThreadPoolExecutor
- Adaptive polling engine with ETag caching (no more bbox interrupts)
- useCallback optimization for interpolation functions
- Sliding LAYERS/INTEL edge panels replace bulky Record Panel
- Modular fetcher architecture (flights, geo, infrastructure, financial, earth_observation)
- Stable entity IDs for GDELT & News popups (PR #63, credit @csysp)
- Admin auth (X-Admin-Key), rate limiting (slowapi), auto-updater
- Docker Swarm secrets support, env_check.py validation
- 85+ vitest tests, CI pipeline, geoJSON builder extraction
- Server-side viewport bbox filtering reduces payloads 80%+

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

Former-commit-id: f2883150b5bc78ebc139d89cc966a76f7d7c0408
v0.9.5
2026-03-14 14:01:54 -06:00
anoracleofra-code 60c90661d4 feat: wire TypeScript interfaces into all component props, fix 12 lint errors
Former-commit-id: 04b30a9e7af32b644140c45333f55c20afec45f2
2026-03-14 13:39:20 -06:00
anoracleofra-code 17c41d7ddf feat: add ADMIN_KEY auth guard to sensitive settings and system endpoints
Former-commit-id: 0eaa7813a16f13e123e9c131fcf90fcb8bf420fd
2026-03-14 13:39:20 -06:00
Shadowbroker 9ad35fb5d8 Merge pull request #63 from csysp/fix/c3-entity-id-index
fix/replace array-index entity IDs with stable keys for GDELT + popups

Former-commit-id: 3a965fb50893cd0fe9101d56fa80c09fafe75248
2026-03-14 11:47:07 -06:00
csysp ff61366543 fix: replace array-index entity IDs with stable keys for GDELT and news popups
selectedEntity.id was stored as a numeric array index into data.gdelt[]
and data.news[]. After any data refresh those arrays rebuild, so the
stored index pointed to a different item — showing wrong popup content.

GDELT features now use g.properties?.name || String(g.geometry.coordinates)
as a stable id; popups resolve via find(). News popups resolve via find()
matching alertKey. ThreatMarkers emits alertKey string instead of originalIdx.
ThreatMarkerProps updated: id: number → id: string | number.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

Former-commit-id: c2bfd0897a9ebd27e7c905ea3ac848a89883f140
2026-03-14 10:16:04 -06:00