Commit Graph

14 Commits

Author SHA1 Message Date
tdurieux ef78e8ff3c feat: preserve raw bytes when anonymization is a no-op
When the anonymizer doesn't change a slice's text, the streamer used
to push Buffer.from(out, "utf8") — which loses any invalid-UTF-8 bytes
in the input (replaced by U+FFFD via StringDecoder). Files
mistakenly classified as text (binary blobs without a known extension,
text with stray non-UTF-8 bytes, BOMs) came out corrupted even though
nothing in the term list matched.

Track the raw chunk bytes alongside the decoded `pending`. On flush —
where we have every byte buffered — emit the original buffer directly
when the output equals the input, so a pure passthrough is bit-exact.
In the streaming OVERLAP path, do the same when the decode for that
slice round-trips losslessly; fall back to encoded output otherwise
(unchanged from before for that case).

Also add the "missing_content" locale entry for the
/api/anonymize-preview route.
2026-05-04 11:52:03 +02:00
tdurieux a5f66d6844 multiple fixes 2026-05-03 15:30:54 +02:00
Thomas Durieux 8198a4b44a Standardize error responses with consistent format and human-readable messages (#667) 2026-04-15 09:27:08 +02:00
Thomas Durieux b2d77faa6c try to fix repo access 2025-04-01 22:27:41 +02:00
tdurieux 3bf6864472 feat: improve error management in front end 2023-04-26 00:27:52 +02:00
tdurieux c9acb7b899 feat: improve response content type header 2023-04-25 17:42:50 +02:00
tdurieux 0c87428fdf fix: add error message translation for folder_not_supported 2021-09-07 00:00:47 +02:00
tdurieux 6c668e4f86 fix: improve error handling when a commit is not accessible 2021-09-06 23:06:10 +02:00
Thomas Durieux 20e8d533f4 feat: measure and display user quota (#72) 2021-09-06 14:53:42 +02:00
Thomas Durieux 49da267d5f feat: Add conference manager (#71) 2021-09-06 09:34:39 +02:00
tdurieux 5d2da5a93a merge index and explorer views 2021-04-21 18:15:29 +02:00
tdurieux cf17e1c456 fix typos 2021-04-06 17:45:36 +02:00
tdurieux 22465d455c add repository status page 2021-04-06 10:01:53 +02:00
tdurieux 72715dfcd9 Display error messages 2021-03-19 13:26:29 +01:00