New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Proxy silently ignored without http:
#1282
Comments
Thanks @gurgeous option 2 sounds good to me, but I have to admit I'm no expert on proxies... are we sure there's no use case where one might want to omit the protocol? We pass the string as is to |
I am not an expert either... as far as I know the only use cases are http(s) and socks? Not sure if socks is even supported yet. I'll put together a simple PR and we can see if anyone complains. |
Sounds good, thanks! |
@iMacTia Reading that work, made me realize that "assume it's an HTTP proxy" is a pretty good assumption. |
Basic Info
Issue description
Proxy silently ignored without
http:
. For example, if you set proxy tosomething:1234
it will be silently ignored. The correct proxy setting would behttp://something:1234
. This is an important issue because it's undocumented, difficult to debug, and can have serious consequences for crawling projects.I propose either:
or
http://
for strings that lack a scheme.Let me know if you agree with one of these options and I'l put together a PR. Thanks!
Steps to reproduce
The text was updated successfully, but these errors were encountered: