Commit Graph

57 Commits

Author SHA1 Message Date
tdurieux aae6eae6eb handle rate limit 2026-05-06 17:50:01 +03:00
tdurieux 75b67448ef fix 2026-05-06 11:24:48 +03:00
dependabot[bot] e34f45522f chore(deps): bump uuid and bullmq (#691)
* chore(deps): bump uuid and bullmq

Removes [uuid](https://github.com/uuidjs/uuid). It's no longer used after updating ancestor dependency [bullmq](https://github.com/taskforcesh/bullmq). These dependencies need to be updated together.


Removes `uuid`

Updates `bullmq` from 2.4.0 to 5.76.5
- [Release notes](https://github.com/taskforcesh/bullmq/releases)
- [Commits](https://github.com/taskforcesh/bullmq/compare/v2.4.0...v5.76.5)

---
updated-dependencies:
- dependency-name: bullmq
  dependency-version: 5.76.5
  dependency-type: direct:production
- dependency-name: uuid
  dependency-version: 
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>

* fix(bullmq): adapt isRunning + getJobs typing for v5 API

Worker.isRunning became a method (was a property in v2), and
Queue.getJobs now requires a mutable JobType[] (was string[]).

* clean up

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: tdurieux <durieuxthomas@hotmail.com>
Co-authored-by: Thomas Durieux <5577568+tdurieux@users.noreply.github.com>
2026-05-06 08:40:12 +02:00
tdurieux 2528f42b59 add tests 2026-05-06 08:23:22 +03:00
tdurieux 79f555769d improve binary file detection: content sniffing + jsonl support
Files like .jsonl that mime-types doesn't know fell through to
application/octet-stream and rendered as "Unsupported binary file" in
the viewer. Replace istextorbinary with isbinaryfile for content-based
detection, and use mime-types for name-based classification with a
textual application/* allowlist.

The streaming transformer now defers classification when the name is
inconclusive and sniffs the first chunk before emitting "transform",
so route.ts and AnonymizedFile.ts get a content-aware Content-Type.
Whitelists .jsonl and .ndjson to short-circuit dataset files.

Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
2026-05-06 07:52:48 +03:00
tdurieux f8c91ca0af multiple fixes 2026-05-05 10:32:31 +03:00
tdurieux 1968e3341a 2.3.0 2026-04-24 16:14:29 +02:00
tdurieux 88f826aab4 update design 2026-04-24 14:55:18 +02:00
Thomas Durieux 8198a4b44a Standardize error responses with consistent format and human-readable messages (#667) 2026-04-15 09:27:08 +02:00
Thomas Durieux 95324fd09f Replace isomorphic-dompurify with sanitize-html for Node 21 compat (#663) 2026-04-15 04:57:21 +02:00
Thomas Durieux 655ae92c4c Remove OpenTelemetry tracing infrastructure (#662) 2026-04-15 04:39:08 +02:00
Thomas Durieux f3641c8ce3 Set up CI with ESLint linter and Mocha test runner (#661) 2026-04-15 04:34:03 +02:00
Thomas Durieux 812f8b6314 Sanitize markdown HTML output with DOMPurify to prevent XSS (#658) 2026-04-15 04:22:38 +02:00
tdurieux 80101f83aa fix: fix dns lookup for dnsrr 2024-04-05 14:48:40 +01:00
tdurieux 22a28a913d perf: improve page loading time 2024-04-05 01:02:41 +01:00
tdurieux f5d45394bf feat: add sha to file path to avoid caching 2024-04-04 15:56:38 +01:00
tdurieux 4d12641c7e feat: introduce streamers that handle the stream and anonymization from github 2024-04-03 11:13:01 +01:00
tdurieux 35f4b4ce52 refactor: improve file streaming 2024-04-01 15:17:26 +01:00
tdurieux bee5c5834c fix: add missing package 2024-03-31 14:33:22 +01:00
tdurieux 829720b131 chore: update dependencies 2024-03-27 11:45:41 +00:00
tdurieux 0caf786c9c feat: adds opentelemetry support 2024-03-27 11:18:13 +00:00
tdurieux 696a465d5c 2.2.0 2023-08-28 14:46:54 +02:00
tdurieux ecfd69bd37 fix: fix zip extract 2023-08-28 14:36:04 +02:00
tdurieux d8de3f189a Release 2.1.5 2023-08-28 12:12:16 +02:00
tdurieux f72a662750 chore: update dependencies 2023-08-28 12:12:13 +02:00
tdurieux 68d96ad82e chore: update dependencies 2023-06-26 18:24:28 +02:00
tdurieux e24d1b4630 update dependencies & remove google analytics 2023-06-20 09:58:25 +02:00
tdurieux 6c4363182b chore: update decompress-stream-to-s3 2023-05-08 13:57:16 +02:00
tdurieux ee82d3c12a chore: update dependencies and update AWS S3 lib to v3 2023-05-01 14:53:27 +02:00
tdurieux ec6098b3a1 chore: use strict compilation mode 2023-02-13 13:38:57 +01:00
tdurieux 5c72f54db5 perf: improve the perf of Anonymous GitHub 2023-02-08 15:34:50 +01:00
tdurieux c84df5c8e9 2.1.1 2023-02-07 09:04:10 +01:00
tdurieux dcf7f36917 feat: add cli to anonymize repositories locally 2023-02-06 15:55:43 +01:00
tdurieux 2751d300e2 chore: update dependencies 2022-10-24 14:54:58 +02:00
tdurieux 231b2fe0c8 feat(#137): adds support for md rendering in webview 2022-10-24 08:34:53 +02:00
tdurieux 04b85599a6 feat: slow down request after 50 requests 2022-10-19 11:04:52 +02:00
tdurieux f22c1ef4f0 chore: update dep 2022-09-07 10:33:40 +02:00
tdurieux 9d9a6879ab fix: add metadata about the source of the files in S3 2022-08-10 13:58:37 +02:00
tdurieux 7c326143f5 chore: update mongoose dep 2022-07-22 13:18:40 +02:00
tdurieux ac52999841 chore: replace bull by bullmq 2022-07-22 13:06:22 +02:00
tdurieux fa8a513d93 chore: update dependencies 2022-07-22 09:52:31 +02:00
dependabot[bot] a8160e18c5 chore(deps): bump got from 11.8.2 to 11.8.5 (#115)
Bumps [got](https://github.com/sindresorhus/got) from 11.8.2 to 11.8.5.
- [Release notes](https://github.com/sindresorhus/got/releases)
- [Commits](https://github.com/sindresorhus/got/compare/v11.8.2...v11.8.5)

---
updated-dependencies:
- dependency-name: got
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-06-23 11:18:04 +02:00
tdurieux 2f73a3309c chore: update packages 2021-09-12 00:58:14 +02:00
tdurieux 486ad634ca feat: download zip instead of tar 2021-09-12 00:06:17 +02:00
tdurieux 9838891567 feat: handle repository download and remove using a job queue 2021-09-08 15:00:15 +02:00
tdurieux 074d1f93a6 feat: use pm2 to log errors 2021-09-07 09:18:21 +02:00
tdurieux eaa9656815 feat: improve error message 2021-09-06 22:34:58 +02:00
Thomas Durieux 49da267d5f feat: Add conference manager (#71) 2021-09-06 09:34:39 +02:00
tdurieux d21bb5097b fix license in package.json 2021-08-13 12:17:40 +02:00
tdurieux b460965c4b update dependencies 2021-08-13 08:26:27 +02:00