Introduce ProcessingResponse

[Zelldon]

Description

blocked by #10191 ✅
blocked by #10188 ✅

Introduce the ProcessingResponse, which encapsulates the information of the Record which should be send as response on a user command and the request- and streamId which identifies the request.

The ProcessingResponse usage replaces the usage of the CommandResponseWriter, and deletes several now unused code.

Related issues

closes #10001

Definition of Done

Not all items need to be done depending on the issue and the pull request.

Code changes:

• The changes are backwards compatibility with previous versions
• If it fixes a bug then PRs are created to backport the fix to the last two minor versions. You can trigger a backport by assigning labels (e.g. backport stable/1.3) to the PR, in case that fails you need to create backports manually.

Testing:

• There are unit/integration tests that verify all acceptance criterias of the issue
• New tests are written to ensure backwards compatibility with further versions
• The behavior is tested manually
• The change has been verified by a QA run
• The impact of the changes is verified by a benchmark

Documentation:

• The documentation is updated (e.g. BPMN reference, configuration, examples, get-started guides, etc.)
• New content is added to the release announcement
• If the PR changes how BPMN processes are validated (e.g. support new BPMN element) then the Camunda modeling team should be informed to adjust the BPMN linting.

Please refer to our review guidelines.

[github-actions]

Test Results

   852 files  ±  0     852 suites  ±0   1h 47m 28s ⏱️ + 7m 58s
6 365 tests  - 50  6 354 ✔️  - 50  11 💤 ±0  0 ❌ ±0 
6 549 runs   - 50  6 538 ✔️  - 50  11 💤 ±0  0 ❌ ±0 

Results for commit 0697540. ± Comparison against base commit 8bc7e82.

♻️ This comment has been updated with latest results.

[deepthidevaki]

Looks good to me. But I think you should also add a test using the new StreamingPlatformExtension to test that after processing response is sent.

[Zelldon]

Thanks @deepthidevaki for your review 🙇 Actually we have already some see here https://github.com/camunda/zeebe/blob/main/engine/src/test/java/io/camunda/zeebe/engine/processing/streamprocessor/StreamProcessorTest.java#L454 I had to fix them in this PR, since they made some order assumptions.

I will migrate them soon to the extension, which is why I didn't wrote a new one right now. Hope that is fine for you.

[Zelldon]

bors r+

[zeebe-bors-camunda]

Build succeeded:

• Test summary
• Go linting
• Java checks