Commit Graph

44 Commits

Author SHA1 Message Date
jeanpaul a34b30acc7 feat(n8n Evaluation Node): Add pre-defined metrics to the "Set Metrics" operation (#17127) 2025-07-11 13:58:26 +02:00
Iván Ovejero f3ef0a713c refactor(core): Lintfix cli package (#17125) 2025-07-08 19:32:02 +02:00
Benjamin Schroth 57b914dcd9 fix(core): Improve handling of disabled Set Metrics node (#17085) 2025-07-08 19:16:08 +02:00
jeanpaul e982d9144b feat: Make the 'set output' node optional if you inserted a 'set metrics' node (no-changelog) (#16955) 2025-07-04 14:55:23 +02:00
Iván Ovejero 7c33292483 refactor(core): Move integration test utils for insights (#16693) 2025-06-25 17:32:54 +02:00
Iván Ovejero b5828e5b56 refactor(core): Rename @n8n/integration-test-utils to @n8n/backend-test-utils (#16444) 2025-06-17 18:09:44 +02:00
Iván Ovejero ac032418cb refactor(core): Prepare insights for move to standalone module (#16426) 2025-06-17 14:51:30 +02:00
Mutasem Aldmour aa273745ec fix: Run evaluations successfully when offload manual executions is true with queue mode (#16307)
Co-authored-by: cubic-dev-ai[bot] <191113872+cubic-dev-ai[bot]@users.noreply.github.com>
2025-06-13 15:33:48 +02:00
Eugene eff0571f42 feat(core): Add number of tokens and latency automatically as metrics in evaluation (#16243) 2025-06-13 09:24:12 +02:00
Eugene 739ad853cd fix(core): Always save evaluation executions (#16285) 2025-06-12 15:50:37 +02:00
Mutasem Aldmour e36345824f fix: Run evaluations as full manual executions in queue mode (#16230) 2025-06-12 11:25:21 +02:00
Iván Ovejero c229e915ea refactor(core): Move Logger to @n8n/backend-common (#15721) 2025-05-30 12:57:47 +02:00
Eugene eb3dd199ab feat(core): Add telemetry for Evaluation feature (no-changelog) (#15562)
Co-authored-by: Yiorgis Gozadinos <yiorgis@n8n.io>
2025-05-26 13:09:03 +02:00
Eugene ca8f087a47 feat(editor): Evaluations frontend (no-changelog) (#15550)
Co-authored-by: Yiorgis Gozadinos <yiorgis@n8n.io>
Co-authored-by: JP van Oosten <jp@n8n.io>
Co-authored-by: Giulio Andreini <g.andreini@gmail.com>
Co-authored-by: Michael Kret <michael.k@radency.com>
2025-05-26 12:26:28 +02:00
Eugene fa620f2d5b feat(core): Evaluations backend (no-changelog) (#15542)
Co-authored-by: Yiorgis Gozadinos <yiorgis@n8n.io>
Co-authored-by: Mutasem Aldmour <4711238+mutdmour@users.noreply.github.com>
2025-05-23 09:05:13 +02:00
Eugene 8152f8c6a7 feat(core): Update data model for Evaluations (no-changelog) (#15520)
Co-authored-by: Yiorgis Gozadinos <yiorgis@n8n.io>
Co-authored-by: JP van Oosten <jp@n8n.io>
2025-05-22 12:55:31 +02:00
Iván Ovejero 52f27a76ac refactor(core): Move workflow repository to @n8n/db (#15260)
Co-authored-by: Ricardo Espinoza <ricardo@n8n.io>
2025-05-13 14:21:59 +02:00
कारतोफ्फेलस्क्रिप्ट™ 8591c2e0d1 refactor(core): Migrate DB setup to use DI (#15324) 2025-05-13 13:28:41 +02:00
Eugene a0a4476175 chore: Rename Test workflow -> Execute workflow (#15112) 2025-05-13 09:35:41 +02:00
Iván Ovejero f2ee990a57 refactor(core): Move third batch of repositories to @n8n/db (#15166) 2025-05-09 09:57:54 +02:00
Iván Ovejero ade546fb48 refactor(core): Move first batch of repositories to @n8n/db (#15130) 2025-05-06 11:22:43 +02:00
Iván Ovejero bd258be052 refactor(core): Move final batch of entities to @n8n/db (#15061) 2025-05-02 17:46:05 +02:00
Iván Ovejero 20834abb56 refactor(core): Move interrelated entities to @n8n/db (#15050) 2025-05-02 12:19:32 +02:00
Iván Ovejero 442cd094ee refactor(core): Separate list query entities from request types (#15015) 2025-04-30 13:34:50 +02:00
Iván Ovejero 20115a8fa1 refactor(core): Move initial files to @n8n/db (#14953) 2025-04-29 18:14:52 +02:00
Iván Ovejero e6381e09e3 refactor(core): Introduce @n8n/decorators package (#14784) 2025-04-23 16:39:49 +02:00
oleg 53e11b19ad feat(core): Automatically extract evaluation metrics (no-changelog) (#14051) 2025-03-25 15:43:19 +01:00
Alex Grozav 8215e0b59f refactor: Migrate NodeConnectionType to const object type (no-changelog) (#14078)
Co-authored-by: कारतोफ्फेलस्क्रिप्ट™ <aditya@netroy.in>
2025-03-21 14:01:26 +02:00
Eugene a1fee65713 fix(core): Fix test runner in queue mode (no-changelog) (#13479)
Co-authored-by: Danny Martini <danny@n8n.io>
2025-02-27 13:13:07 +01:00
Iván Ovejero 3ca99194c6 refactor(core): Migrate all errors in cli package to new hierarchy (#13478)
Co-authored-by: Tomi Turtiainen <10324676+tomi@users.noreply.github.com>
2025-02-27 09:30:55 +02:00
Eugene c9c0716a69 feat(core): Add telemetry for workflow evaluation feature (no-changelog) (#13367) 2025-02-20 15:00:13 +01:00
Eugene 0a2e29839c feat(core): Change evaluation workflow input data format (no-changelog) (#13109) 2025-02-13 12:08:10 +01:00
Tomi Turtiainen f001edb2a2 refactor(core): Use IWorkflowBase over WorkflowEntity in most places (#13225) 2025-02-13 10:54:11 +02:00
Eugene 02573b46e0 feat(core): Add error reporting for workflow evaluation (no-changelog) (#12838)
Co-authored-by: oleg <me@olegivaniv.com>
2025-02-11 16:03:41 +01:00
Danny Martini a15504329b fix: Sync partial execution version of FE and BE, also allow enforcing a specific version (#12840)
Co-authored-by: Iván Ovejero <ivov.src@gmail.com>
2025-02-03 14:17:31 +01:00
Eugene 1ca6a9799a feat(core): Keep track of test case executions during test run (no-changelog) (#12787) 2025-01-31 12:27:35 +01:00
Eugene 0f345681d9 chore: Add basic telemetry events to workflow evaluation (no-changelog) (#12890)
Co-authored-by: Oleg Ivaniv <me@olegivaniv.com>
2025-01-29 16:00:22 +01:00
Eugene be520b4f60 feat: Add API endpoint to cancel a test run (no-changelog) (#12115) 2025-01-14 12:12:31 +01:00
Eugene dcd7feb973 fix(core): Node mocking for evaluation executions (no-changelog) (#12541) 2025-01-13 10:45:29 +01:00
Eugene cc008f9239 feat: Save the number of successful, failed and total executions for Test Run (no-changelog) (#12131) 2025-01-07 16:03:16 +01:00
oleg 3d990eb555 feat(editor): Add workflow evaluation run views (no-changelog) (#12258) 2025-01-07 12:52:44 +01:00
Eugene 04c1182a1e feat(core): Use node IDs instead of names for data mocking during test runs (no-changelog) (#12348) 2025-01-07 10:00:06 +01:00
कारतोफ्फेलस्क्रिप्ट™ 39d5e0ff87 refactor(core): Replace typedi with our custom DI system (no-changelog) (#12389)
Co-authored-by: Iván Ovejero <ivov.src@gmail.com>
2025-01-06 10:21:24 +01:00
Iván Ovejero f754b22a3f refactor(core): Mark all backend Enterprise Edition files and dirs (#12350) 2024-12-24 13:02:05 +01:00