Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ProcessingScheduleService allows to schedule a task which returns a Result #9999

Closed
8 tasks done
Zelldon opened this issue Aug 4, 2022 · 1 comment · Fixed by #10112
Closed
8 tasks done

ProcessingScheduleService allows to schedule a task which returns a Result #9999

Zelldon opened this issue Aug 4, 2022 · 1 comment · Fixed by #10112
Assignees
Labels
kind/toil Categorizes an issue or PR as general maintenance, i.e. cleanup, refactoring, etc.

Comments

@Zelldon
Copy link
Member

Zelldon commented Aug 4, 2022

Description

We started to introduce the new ProcessingScheduleService still the consumers of this service use the LogStreamWriter, which they get from the Engine/StreamProcessorContext.

Ideally the consumers of the Service can just schedule a Task, which returns an Result. The result should be written to the Log (internally in the streamProcessor). The consumer of the service doesn't care how this is done, and doesn't need to know about LogStreamWriters.

What we need:

  • Introduce a ProcessingScheduleResult
    • potentially backed by similar implementation (parts) of the other ProcessingResult
  • New methods to schedule a Task which returns an result
  • Implementation of that
  • Backened in the StreamProcessor, like writing the result to the logstream
  • We need to make sure that the scheduling is guaranteed to happen only during processing not in between and after a committed transaction
  • During pause no execution should happen
  • We need tests

related to #9730

@Zelldon Zelldon added the kind/toil Categorizes an issue or PR as general maintenance, i.e. cleanup, refactoring, etc. label Aug 4, 2022
@Zelldon
Copy link
Member Author

Zelldon commented Aug 18, 2022

Partly done via #10076 rest is via #10012

@Zelldon Zelldon self-assigned this Aug 18, 2022
@Zelldon Zelldon mentioned this issue Sep 22, 2022
71 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
kind/toil Categorizes an issue or PR as general maintenance, i.e. cleanup, refactoring, etc.
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant