Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[wip]Add eBPF support for optimizer #506

Open
wants to merge 9 commits into
base: main
Choose a base branch
from

Conversation

sctb512
Copy link
Member

@sctb512 sctb512 commented Jul 10, 2023

  1. Add pkg/optimizer package.
  2. Remove events configuration entry which is no need for users.
  3. Add eBPF support for optimizer.

Here is a example output for eBPF optimizer:

> cat pytorch:1.12.1.csv
timestamp,command,path,position,size
1688978328332,python,/root/miniconda3/lib/python3.10/lib-dynload/cmath.cpython-310-x86_64-linux-gnu.so,118784,4096
1688978328375,python,/root/miniconda3/lib/python3.10/lib-dynload/_socket.cpython-310-x86_64-linux-gnu.so,184320,4096
1688978328377,python,/root/miniconda3/lib/python3.10/lib-dynload/array.cpython-310-x86_64-linux-gnu.so,126976,4096
1688978328379,python,/root/miniconda3/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so,28672,4096
1688978328416,python,/root/miniconda3/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so,348160,4096
1688978328416,python,/root/miniconda3/lib/libssl.so.1.1,1122304,4096
1688978328424,python,/root/miniconda3/lib/python3.10/lib-dynload/unicodedata.cpython-310-x86_64-linux-gnu.so,2224128,4096
1688978328429,python,/root/miniconda3/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so,114688,4096

@sctb512 sctb512 force-pushed the ebpf-server branch 24 times, most recently from d40a436 to 81db814 Compare July 14, 2023 08:31
@sctb512 sctb512 changed the title Add eBPF support for optimizer [wip]Add eBPF support for optimizer Jul 14, 2023
@sctb512
Copy link
Member Author

sctb512 commented Jul 14, 2023

The runtime environment for this patch is harsh and the project gobpf is unmaintained for a while. I would like to consider a more suitable library to implement this feature.

@sctb512 sctb512 force-pushed the ebpf-server branch 4 times, most recently from 649a7cb to 0532c9b Compare August 24, 2023 08:09
This package is used to abstract the optimizer.

Signed-off-by: Bin Tang <tangbin.bin@bytedance.com>
Signed-off-by: Bin Tang <tangbin.bin@bytedance.com>
Signed-off-by: Bin Tang <tangbin.bin@bytedance.com>
Remove the 'events' configuration, which does not need to
be configured, and add the 'server_type' for optimizer.

Signed-off-by: Bin Tang <tangbin.bin@bytedance.com>
Signed-off-by: Bin Tang <tangbin.bin@bytedance.com>
Signed-off-by: Bin Tang <tangbin.bin@bytedance.com>
Signed-off-by: Bin Tang <tangbin.bin@bytedance.com>
Signed-off-by: Bin Tang <tangbin.bin@bytedance.com>
Signed-off-by: Bin Tang <tangbin.bin@bytedance.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants