Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug] Not enough memory to create materialized view #34342

Open
2 of 3 tasks
Jrebel-i opened this issue Apr 30, 2024 · 0 comments
Open
2 of 3 tasks

[Bug] Not enough memory to create materialized view #34342

Jrebel-i opened this issue Apr 30, 2024 · 0 comments

Comments

@Jrebel-i
Copy link

Jrebel-i commented Apr 30, 2024

Search before asking

  • I had searched in the issues and found no similar issues.

Version

2.0.7

What's Wrong?

When I create the materialized view, I get the following error:

Msg: errCode = 2, detailMessage = rollup tasks failed on same tablet reach threshold [[ALTER], signature: 1116543, backendId: 10642, tablet id: 1116543], reason=task type: ALTER, status_code: MEM_ALLOC_FAILED, status_message: [(10.150.31.199)[MEM_ALLOC_FAILED][E11] Allocator mem tracker check failed, [MEM_LIMIT_EXCEEDED]failed alloc size 8.00 KB, memory tracker limit exceeded, tracker label:EngineAlterTabletTask#baseTabletId=829115:newTabletId=1116543, type:schema_change, limit 2.00 GB, peak used 2.00 GB, current used 2.00 GB. backend 10.150.31.199 process memory used 7.63 GB. can modify `memory_limitation_per_thread_for_schema_change_bytes` in be.conf to change limit, details see be.INFO

Then I increase the memory_limitation_per_thread_for_schema_change_bytes=51539607552 for all be nodes and report the following error again:

Msg: errCode = 2, detailMessage = rollup tasks failed on same tablet reach threshold [[ALTER], signature: 1255382, backendId: 10642, tablet id: 1255382], reason=task type: ALTER, status_code: MEM_LIMIT_EXCEEDED, status_message: [(10.150.31.199)[MEM_LIMIT_EXCEEDED]PreCatch error code:11, [E11] Allocator sys memory check failed: Cannot alloc:262144, consuming tracker:<EngineAlterTabletTask#baseTabletId=860575:newTabletId=1255382>, peak used 17571329400, current used 17571329400, exec node:<>, process memory used 49.28 GB exceed limit 49.43 GB or sys available memory 1.41 GB less than low water mark 1.60 GB.
The maximum memory of the server is 64 GB.

What You Expected?

Create the materialized view correctly

How to Reproduce?

No response

Anything Else?

No response

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant