tdurieux 79f555769d improve binary file detection: content sniffing + jsonl support ...

Files like .jsonl that mime-types doesn't know fell through to
application/octet-stream and rendered as "Unsupported binary file" in
the viewer. Replace istextorbinary with isbinaryfile for content-based
detection, and use mime-types for name-based classification with a
textual application/* allowlist.

The streaming transformer now defers classification when the name is
inconclusive and sniffs the first chunk before emitting "transform",
so route.ts and AnonymizedFile.ts get a content-aware Content-Type.
Whitelists .jsonl and .ndjson to short-circuit dataset files.

Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>

2026-05-06 07:52:48 +03:00

..

anonymize-byte-safety.test.js

feat: preserve raw bytes when anonymization is a no-op

2026-05-04 11:52:03 +02:00

anonymize-utils.test.js

improve binary file detection: content sniffing + jsonl support

2026-05-06 07:52:48 +03:00

anonymized-file.test.js

Fix 9 bugs and add 103 tests for core anonymization, config, and routing (#669)

2026-04-15 09:41:00 +02:00

anonymous-error.test.js

Fix 9 bugs and add 103 tests for core anonymization, config, and routing (#669)

2026-04-15 09:41:00 +02:00

conference-pricing.test.js

Fix 9 bugs and add 103 tests for core anonymization, config, and routing (#669)

2026-04-15 09:41:00 +02:00

conference.test.js

Fix 9 bugs and add 103 tests for core anonymization, config, and routing (#669)

2026-04-15 09:41:00 +02:00

config.test.js

Fix 9 bugs and add 103 tests for core anonymization, config, and routing (#669)

2026-04-15 09:41:00 +02:00

database-storage.test.js

Fix 9 bugs and add 103 tests for core anonymization, config, and routing (#669)

2026-04-15 09:41:00 +02:00

error-codes.test.js

Standardize error responses with consistent format and human-readable messages (#667)

2026-04-15 09:27:08 +02:00

file-etag.test.js

fix: include file path in cache ETag

2026-05-03 21:19:39 +02:00

humanFileSize.test.js

Fix 9 bugs and add 103 tests for core anonymization, config, and routing (#669)

2026-04-15 09:41:00 +02:00

is-text-file.test.js

improve binary file detection: content sniffing + jsonl support

2026-05-06 07:52:48 +03:00

lfs-detect.test.js

feat: resolve Git LFS pointers via the raw URL endpoint

2026-05-04 12:18:55 +02:00

markdown-sanitization.test.js

Replace isomorphic-dompurify with sanitize-html for Node 21 compat (#663)

2026-04-15 04:57:21 +02:00

pull-request-content.test.js

Fix 9 bugs and add 103 tests for core anonymization, config, and routing (#669)

2026-04-15 09:41:00 +02:00

route-utils.test.js

Fix 9 bugs and add 103 tests for core anonymization, config, and routing (#669)

2026-04-15 09:41:00 +02:00

validation.test.js

Fix 9 bugs and add 103 tests for core anonymization, config, and routing (#669)

2026-04-15 09:41:00 +02:00