[Nightly]: 2026.17 perfomance by pmPaulis · Pull Request #9107 · ProcessMaker/processmaker

pmPaulis · 2026-10-19T15:07:36Z

Issue & Reproduction Steps

In this branch already merge all the changes related to the perfomance staff

Related Tickets & Packages

Code Review Checklist

I have pulled this code locally and tested it on my instance, along with any associated packages.
This code adheres to ProcessMaker Coding Guidelines.
This code includes a unit test or an E2E test that tests its functionality, or is covered by an existing test.
This solution fixes the bug reported in the original ticket.
This solution does not alter the expected output of a component in a way that would break existing Processes.
This solution does not implement any breaking changes that would invalidate documentation or cause existing Processes to fail.
This solution has been tested with enterprise packages that rely on its functionality and does not introduce bugs in those packages.
This code does not duplicate functionality that already exists in the framework or in ProcessMaker.
This ticket conforms to the PRD associated with this part of ProcessMaker.

PR Packages

ProcessMaker/screen-builder#1917
ProcessMaker/vue-form-elements#475
https://github.com/ProcessMaker/package-savedsearch/pull/706

…ed caching

…er is present

… behavior

…ration

…nse handling

…detailed documentation

… chain

Introduce PUT /api/1.1/tasks/{id} for COMPLETED status, gated by TASK_UPDATE_V1_1_ENABLED, with optional raw token persistence behind TOKEN_PERSISTENCE_RAW_ENABLED. https://processmaker.atlassian.net/browse/FOUR-32800

…is executed.

https://processmaker.atlassian.net/browse/FOUR-32800

Batch-load listing relations after pagination to avoid per-row queries for process version alternative, active tasks, process categories, and project assets while preserving the existing API response shape. - Add ProcessRequestListingRawRepository to hydrate activeTasks (raw SQL) and process data (Eloquent + batched projects/categories) - Use withAggregate for process_version_alternative and read it without lazy-loading ProcessVersion - Add activeTasks relation and use preloaded data in ProcessRequests - Preload projects JSON and reuse loaded categories in Process accessors - Apply hydration in index and getRequestsByCase - Add bounded query-count feature test https://processmaker.atlassian.net/browse/FOUR-32947

feat(FOUR-32801): improve Jobs execution when the PUT tasks endpoint is executed

feat(FOUR-32800): add v1.1 task completion endpoint with raw SQL path

FOUR-32800: test compares legacy and optimized

…ng and optimizing pagination

…retrieval

…nd response structure validation

…mps are null Prevent task completion failures when recording the Prometheus activity_execution_time_seconds histogram in BpmnSubscriber. Fall back to created_at and completed_at when created_at_ms or completed_at_ms are unavailable, and skip the metric observation when either timestamp is still missing. https://processmaker.atlassian.net/browse/FOUR-33645

FOUR-32144: Improve the api PUT /api/1.0/tasks/{task-id}

FOUR-32946 Improve the API /api/1.0/processes

perf(FOUR-32947): reduce N+1 queries on requests listing (FOUR-32947)

fix(FOUR-33645): guard activity execution time metric when ms timesta…

FOUR-32126: Inbox >> First loading is to slow

cursor · 2026-10-19T15:07:48Z

PR Summary

Medium Risk
Large behavioral surface area (process list pagination and removed start-event filtering, optional raw SQL for tokens/task completion) with most risky paths gated by config, but optimized tasks default on.

Overview
This PR bundles performance work across API listings, BPMN persistence, the Tasks UI, and the browser.

Listings and hydration: Process index now paginates, qualifies orderBy columns, drops heavy bpmn/svg payloads, and stops loading events for in-loop start-event filtering (that logic is removed from the controller). Process request index skips eager process includes and batch-hydrates process and activeTasks via ProcessRequestListingRawRepository after paginated queries. When OPTIMIZED_TASKS_ENABLED is on (default true), task index delegates to V1_1 indexOptimized with slimmer selects, column-to-field mapping, and an EXISTS-based nonSystem scope for tokens.

Optional raw SQL execution (env flags): TOKEN_PERSISTENCE_RAW_ENABLED routes token/instance updates through TokenPersistenceRawRepository; TASK_UPDATE_V1_1_ENABLED adds PUT /api/1.1/tasks/{id} completion via TaskCompletionRawService and an in-memory engine bridge.

Tasks page caching: /tasks uses tasks-page-etag middleware to return 304 when stable shell context is unchanged; BrowserCache no longer forces no-store when responses already carry an ETag.

Frontend: Axios gets a short-TTL GET cache and in-flight deduplication (apiClientCache.js); process list stops requesting with=events; task edit lazy-loads the Data tab Monaco editor and preloads edit bundles; login prefetches inbox assets.

Smaller fixes: recommendation job deduplication (ShouldBeUnique), safer activity execution metrics, search-index hooks to skip redundant remove jobs, and task edit authorization/view tweaks (canUpdateTask, deferred “viewed” tracking).

^{Reviewed by Cursor Bugbot for commit 2bcece4. Bugbot is set up for automated code reviews on this repo. Configure here.}

cursor

Stale Bugbot comment from a previous run.

Use npm branch builds for modeler, screen-builder, and vue-form-elements, and Packagist dev-epic/FOUR-32144 for package-savedsearch. Co-authored-by: Cursor <[email protected]>

…timized index

fix(FOUR-34193): resolve V1.1 TaskController from the container on optimized index

decisions-sonarqube · 2026-11-03T17:42:41Z

Quality Gate passed

Issues
0 New issues
0 Fixed issues
0 Accepted issues

Measures
0 Security Hotspots
No data about Coverage
0.0% Duplication on New Code

See analysis details on SonarQube

cursor

Cursor Bugbot has reviewed your changes using high effort and found 2 potential issues.

^{❌ Bugbot Autofix is OFF. To automatically fix reported issues with cloud agents, enable autofix in the Cursor dashboard.}

Want fixes drafted automatically? Bugbot Autofix can create code changes for findings. A team admin can enable Autofix in the Cursor dashboard.

^{Reviewed by Cursor Bugbot for commit 2bcece4. Configure here.}

cursor · 2026-11-03T17:49:16Z

+        }
+
+        $handledIncludes = ['data', 'processRequest', 'process', 'user', 'draft', 'processRequest.process'];
+        $additionalIncludes = array_values(array_diff($includes, $handledIncludes));


Dropped processRequest.process include

Medium Severity

processRequest.process is treated as already handled in the optimized task query, but no constrained with() is registered for it. Clients that send that include no longer eager-load the nested process and either miss the relation or lazy-load the full process per row.

^{Reviewed by Cursor Bugbot for commit 2bcece4. Configure here.}

cursor · 2026-11-03T17:49:16Z

+            'closed' => $repository->saveClosedToken($token),
+            default => $repository->saveActivatedToken($token),
+        };
+    }


Raw token saves skip Scout

Medium Severity

When TOKEN_PERSISTENCE_RAW_ENABLED is on, token and request updates run as raw UPDATEs and never call Eloquent save(). Scout indexing and other model observers do not run, so searchable task/request documents go stale after complete/activate even though this PR added wasSearchable* hooks.

Additional Locations (2)

ProcessMaker/Repositories/TokenPersistenceRawRepository.php#L71-L105

ProcessMaker/Repositories/ExecutionInstanceRepository.php#L239-L248

^{Triggered by learned rule: Scout wasSearchable must match shouldBeSearchable}

^{Reviewed by Cursor Bugbot for commit 2bcece4. Configure here.}

rodriquelca and others added 30 commits July 28, 2026 11:03

FOUR-32126: INBOX >> First loading is to slow

21054c6

feat: implement ETag middleware for Tasks page caching

b607dd8

feat: update inbox and tasks routes to use ETag middleware for improv…

5ecf0f4

…ed caching

feat: enhance BrowserCache middleware to return response if ETag head…

8677dab

…er is present

test: add ETag handling tests for Tasks page to ensure proper caching…

89c0183

… behavior

feat: optimize TasksPageEtag for permission handling and user configu…

34bb989

…ration

fix: update inbox route to use no-cache middleware for improved respo…

c4f7e1f

…nse handling

docs: add Tasks Page ETag Sequence documentation

fd5cebc

feat: add api client caching functionality

9cf4563

feat: add debug logging to api client cache for improved diagnostics

7b3f11f

feat(FOUR-31831): review Improve Task page loading

dfc6091

fix: code style

40fc24a

feat: enhance api client cache with additional utility functions and …

e01a75f

…detailed documentation

feat: return original request in api client cache to maintain promise…

93f4e68

… chain

test: add comprehensive tests for api client cache functionality

4489b89

Adding indexOptimized method to taskController api-1.1

cb592e8

Adding optimization parameter to nonSystem

4ee7901

Adding taskOptimized route to api.php v1.1

a5ce0c5

Adding indexOptimizedBaseQuery method

e4a1759

Adding config value from env, to activate the optimized endpoint on 1.1

8a510a9

feat(FOUR-32801): improve Jobs execution when the PUT tasks endpoint …

6795511

…is executed.

style(FOUR-32800): reorder imports in task completion raw service files

3fc16e0

https://processmaker.atlassian.net/browse/FOUR-32800

Merge branch 'develop' into feature/FOUR-32800

b55a89c

FOUR-32800: test compares legacy and optimized

a5f315b

Merge pull request #9021 from ProcessMaker/bugfix/FOUR-32801

da5e64f

feat(FOUR-32801): improve Jobs execution when the PUT tasks endpoint is executed

Merge pull request #9020 from ProcessMaker/feature/FOUR-32800

5e7ca61

feat(FOUR-32800): add v1.1 task completion endpoint with raw SQL path

feat(FOUR-32800): solving observation about starts

c2ea6f6

Merge pull request #9046 from ProcessMaker/feature/FOUR-32800

daafb12

FOUR-32800: test compares legacy and optimized

devmiguelangel and others added 14 commits September 10, 2026 12:43

feat: enhance process retrieval logic by refining relationship handli…

b36b825

…ng and optimizing pagination

feat: correct query parameters in ProcessMixin to ensure proper data …

a550247

…retrieval

test: add tests for process listing, including pagination, sorting, a…

fdd28de

…nd response structure validation

Merge branch 'develop' into task/FOUR-32144

009273c

Merge remote-tracking branch 'origin/develop' into FOUR-32946

c527057

Merge pull request #9045 from ProcessMaker/task/FOUR-32144

e314c13

FOUR-32144: Improve the api PUT /api/1.0/tasks/{task-id}

Merge pull request #9056 from ProcessMaker/FOUR-32946

2d97d70

FOUR-32946 Improve the API /api/1.0/processes

Merge pull request #9036 from ProcessMaker/feature/FOUR-32947

c1e2d66

perf(FOUR-32947): reduce N+1 queries on requests listing (FOUR-32947)

Merge pull request #9090 from ProcessMaker/bugfix/FOUR-33645

8ab48d6

fix(FOUR-33645): guard activity execution time metric when ms timesta…

Merge pull request #8942 from ProcessMaker/feature/FOUR-32126

a7216fd

FOUR-32126: Inbox >> First loading is to slow

FOUR-30918: phase 1 perfomance

462794b

FOUR-32144: Phase 3: Platform Performance

3031089

Bumped version

d80baef

pmPaulis added the performance label Oct 19, 2026

cursor Bot reviewed Oct 19, 2026

View reviewed changes

Comment thread ProcessMaker/Http/Controllers/Api/TaskController.php Resolved

Comment thread ProcessMaker/Repositories/TokenPersistenceRawRepository.php Resolved

Comment thread ProcessMaker/Traits/TaskControllerIndexMethods.php Resolved

nolanpro and others added 4 commits October 20, 2026 08:00

Pin FOUR-30918 JS branch prereleases and savedsearch dev branch.

522c353

Use npm branch builds for modeler, screen-builder, and vue-form-elements, and Packagist dev-epic/FOUR-32144 for package-savedsearch. Co-authored-by: Cursor <[email protected]>

Version 2026.17.1-perf1

5b71be6

fixing version name

de8d3e1

updating with develop

4b6f9ce

This comment was marked as resolved.

Sign in to view

rodriquelca and others added 4 commits October 28, 2026 09:40

fix(FOUR-34193): resolve V1.1 TaskController from the container on op…

a4e5b13

…timized index

updating with 2026.16.4 and solving conflicts

767a5d8

updating the version

02ba967

Merge pull request #9115 from ProcessMaker/bugfix/FOUR-34193

89cad74

fix(FOUR-34193): resolve V1.1 TaskController from the container on optimized index

pmPaulis added the 2026.17 label Oct 30, 2026

updating with develop and conflicts

2bcece4

cursor Bot reviewed Nov 3, 2026

View reviewed changes

Navigation Menu

Repository navigation

[Nightly]: 2026.17 perfomance - #9107

[Nightly]: 2026.17 perfomance#9107
pmPaulis wants to merge 54 commits into
developfrom
nightly/2026.17-perfomance

pmPaulis commented Oct 19, 2026

Uh oh!

cursor Bot commented Oct 19, 2026 •

edited

Loading

Uh oh!

cursor Bot left a comment •

edited

Loading

Uh oh!

Uh oh!

Uh oh!

Uh oh!

This comment was marked as resolved.

Uh oh!

decisions-sonarqube Bot commented Nov 3, 2026

Uh oh!

cursor Bot left a comment

Uh oh!

cursor Bot Nov 3, 2026

Uh oh!

cursor Bot Nov 3, 2026

Uh oh!

Reviewers

Uh oh!

Assignees

Labels

Projects

Milestone

Development

Uh oh!

6 participants

Conversation

pmPaulis commented Oct 19, 2026

Issue & Reproduction Steps

Related Tickets & Packages

Code Review Checklist

PR Packages

Uh oh!

cursor Bot commented Oct 19, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

PR Summary

Uh oh!

cursor Bot left a comment • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

This comment was marked as resolved.

Uh oh!

decisions-sonarqube Bot commented Nov 3, 2026

Quality Gate passed

Uh oh!

cursor Bot left a comment

Choose a reason for hiding this comment

Uh oh!

cursor Bot Nov 3, 2026

Choose a reason for hiding this comment

Dropped processRequest.process include

Uh oh!

cursor Bot Nov 3, 2026

Choose a reason for hiding this comment

Raw token saves skip Scout

Uh oh!

Reviewers

Uh oh!

Assignees

Labels

Projects

Milestone

Development

Uh oh!

6 participants

cursor Bot commented Oct 19, 2026 •

edited

Loading

cursor Bot left a comment •

edited

Loading