Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

We need to model a process for using a task queue to make cloud ingest processing more scalable #296

Open
randytpierce opened this issue Jan 10, 2024 · 1 comment
Open

We need to model a process for using a task queue to make cloud ingest processing more scalable #296

randytpierce opened this issue Jan 10, 2024 · 1 comment
Assignees
@randytpierce
Labels
couchbase task Tasks break a project down into discrete steps VXingest issues related to the VXingest project

Comments

@randytpierce
Copy link
Contributor

Describe what We need to model a process for using a task queue to make cloud ingest processing more scalable. Currently the ingest processes are designed for a cron driven set of tasks. This will not scale in a cloud environment. We need to evaluate and model a different process for queing up ingest templates or possibly even subdividing certain ingest templates into succinct tasks that can be performed in a container.
@randytpierce randytpierce added couchbase VXingest issues related to the VXingest project task Tasks break a project down into discrete steps labels Jan 10, 2024
@randytpierce randytpierce self-assigned this Jan 10, 2024
@randytpierce
Copy link
Contributor Author

still needed, not stale

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@randytpierce randytpierce

Labels
couchbase task Tasks break a project down into discrete steps VXingest issues related to the VXingest project
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@randytpierce