Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug]: Wrong port used to access Pulsar in test files #32272

Closed
1 task done
Ald392 opened this issue Apr 15, 2024 · 8 comments
Closed
1 task done

[Bug]: Wrong port used to access Pulsar in test files #32272

Ald392 opened this issue Apr 15, 2024 · 8 comments
Assignees
Labels
kind/bug Issues or changes related a bug stale indicates no udpates for 30 days triage/accepted Indicates an issue or PR is ready to be actively worked on.

Comments

@Ald392
Copy link
Contributor

Ald392 commented Apr 15, 2024

Is there an existing issue for this?

  • I have searched the existing issues

Environment

No response

Current Behavior

When go tests are conducted inside milvus/pkg/mq/msgstream/mqwrapper/pulsar, following errors are occurring:
Screenshot 2024-04-15 at 3 12 29 PM
Screenshot 2024-04-15 at 3 59 07 PM

Expected Behavior

No response

Steps To Reproduce

1. Run the go test following steps inside DEVELOPMENT.md

Milvus Log

No response

Anything else?

No response

@Ald392 Ald392 added kind/bug Issues or changes related a bug needs-triage Indicates an issue or PR lacks a `triage/foo` label and requires one. labels Apr 15, 2024
@Ald392
Copy link
Contributor Author

Ald392 commented Apr 15, 2024

Reason: Inside


Pulsar containers port 8080 is mapped to localhosts port 18080. But in :

  1. webServiceURL = "http://" + pulsarURL.Hostname() + ":" + "8080"
  2. webServiceURL = "http://" + pulsarURL.Hostname() + ":" + "8080"

the new pulsar admin client is giving requests to port 8080 of localhost.

Solution:
Changing port number to 18080 in both can solve the issue

@xiaofan-luan
Copy link
Contributor

that is based on your deployment right?
By default it is 8080 but it's kind like based on your deployment.

The tricky part here is for pulsarctl, they have two ports 80 and 8080 by default, based on whether you have a proxy deployed

@xiaofan-luan
Copy link
Contributor

but 18080 is definitely your internal definition I guess

@yanliang567
Copy link
Contributor

/assign @Ald392
please help to check as comments above.

/unassign

@sre-ci-robot sre-ci-robot assigned Ald392 and unassigned yanliang567 Apr 16, 2024
@yanliang567 yanliang567 added triage/accepted Indicates an issue or PR is ready to be actively worked on. and removed needs-triage Indicates an issue or PR lacks a `triage/foo` label and requires one. labels Apr 16, 2024
@Ald392
Copy link
Contributor Author

Ald392 commented Apr 16, 2024

but 18080 is definitely your internal definition I guess

Port 8080 of pulsar container is forwarded to localhosts port 18080 in the milvus/deployments/docker/dev/docker-compose.yml
Which is the recommended deployment for UT according to https://github.com/milvus-io/milvus/blob/e19d17076f21183883fc8acd648e1a112f8c42fb/DEVELOPMENT.md

So either we have to change the port used to access pulsar in go test files or we have to forward pulsar's 8080 to localhosts 8080 which when i tested was causing some new test failures. Because some other go tests are running on assumption that localhosts 8080 is free. I believe that is the reason for forwarding pulsar to localhosts 18080 in the first place.
So the preferred solution according to me would be to change port used for accessing pulsar in test files to 18080.

@xiaofan-luan
Copy link
Contributor

Port 8080 of pulsar container is forwarded to localhosts port 18080 in the milvus/deployments/docker/dev/docker-compose.yml Which is the recommended deployment for UT according to https://github.com/milvus-io/milvus/blob/e19d17076f21183883fc8acd648e1a112f8c42fb/DEVELOPMENT.md

So either we have to change the port used to access pulsar in go test files or we have to forward pulsar's 8080 to localhosts 8080 which when i tested was causing some new test failures. Because some other go tests are running on assumption that localhosts 8080 is free. I believe that is the reason for forwarding pulsar to localhosts 18080 in the first place. So the preferred solution according to me would be to change port used for accessing pulsar in test files to 18080.

But I thought not all the user are running with the pod forward? Should it just be changed based on users requirment?

@Ald392
Copy link
Contributor Author

Ald392 commented Apr 17, 2024

Port 8080 of pulsar container is forwarded to localhosts port 18080 in the milvus/deployments/docker/dev/docker-compose.yml Which is the recommended deployment for UT according to https://github.com/milvus-io/milvus/blob/e19d17076f21183883fc8acd648e1a112f8c42fb/DEVELOPMENT.md
So either we have to change the port used to access pulsar in go test files or we have to forward pulsar's 8080 to localhosts 8080 which when i tested was causing some new test failures. Because some other go tests are running on assumption that localhosts 8080 is free. I believe that is the reason for forwarding pulsar to localhosts 18080 in the first place. So the preferred solution according to me would be to change port used for accessing pulsar in test files to 18080.

But I thought not all the user are running with the pod forward? Should it just be changed based on users requirment?

Ok, that would be enough. But the scenario should be informed to the user right?
Also another thing to add is that i have observed these tests are passing in the GO ut pipeline. Are we using a different docker-compose file there, if so is there any link to that?

Copy link

stale bot commented May 18, 2024

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.
Rotten issues close after 30d of inactivity. Reopen the issue with /reopen.

@stale stale bot added the stale indicates no udpates for 30 days label May 18, 2024
@Ald392 Ald392 closed this as completed Jun 9, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
kind/bug Issues or changes related a bug stale indicates no udpates for 30 days triage/accepted Indicates an issue or PR is ready to be actively worked on.
Projects
None yet
Development

No branches or pull requests

3 participants