[Bug]: The GPU memory usage is much larger than the actual vector data

[longyxiang]

Is there an existing issue for this?

• I have searched the existing issues

Environment

- Milvus version:2.3.12
- Deployment mode(standalone or cluster):standalone 
- MQ type(rocksmq, pulsar or kafka):    
- SDK version(e.g. pymilvus v2.0.0rc2):Go
- OS(Ubuntu or CentOS): CentOS
- CPU/Memory: 
- GPU: A10
- Others:

Current Behavior

The GPU memory usage is much larger than the actual vector data，512-dimensional vector data

Expected Behavior

No response

Steps To Reproduce

No response

Milvus Log

No response

Anything else?

No response

[xiaofan-luan]

/assign @Presburger @liliu-z

[liliu-z]

Talked offline. This memory is occupied by GPU mem pool. We are working on adding a mem pool usage metrics to help monitor it.

[liliu-z]

Another issue to track this : zilliztech/knowhere#507

[stale]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.
Rotten issues close after 30d of inactivity. Reopen the issue with /reopen.