Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Should not try to resolve address when connecting through HTTP proxy #8733

Closed
cyberduck opened this issue Apr 8, 2015 · 18 comments
Closed
Assignees
Labels
bug fixed high priority s3 AWS S3 Protocol Implementation
Milestone

Comments

@cyberduck
Copy link
Collaborator

de76d1c created the issue

We are trying to use Cyberduck to connect to an S3 compatible provider via our Proxy solution. We set the settings to use system proxy and put in all the information for the connection. We use our proxy to do DNS resolution for external URL's and not our internal DNS servers. When we try and connect to the S3 bucket we get a DNS resolution error that is cannot resolve the DNS name for the Storage URL on the internet. I think what is happening is Cyberduck is trying to get DNS from the internal DNS servers configured in the OS and not allowing the Proxy to provide the lookup. Can you provide some support on this?


Attachments

@cyberduck
Copy link
Collaborator Author

@dkocher commented

A HTTP proxy server does not provide DNS resolution. Provide a DNS server IP address in TCP/IP system settings that can resolve the DNS name.

@cyberduck
Copy link
Collaborator Author

de76d1c commented

:) Actually in our case it does. We don't allow our internal DNS servers to resolve external addresses for security reasons and all external resolution is done by our Zscaler Proxies. So the issue we are running into with Cyberduck is that Cyberduck is trying to resolve using the DNS servers set on OS and not resolution coming from Proxy. We have tested another tool called Cloudberry Explorer and that works with our proxy but does not offer a Linux version which is an issue for us. Would come one be willing to work with us to try and resolve?

@cyberduck
Copy link
Collaborator Author

@dkocher commented

Please post the system configuration proxy settings.

@cyberduck
Copy link
Collaborator Author

@dkocher commented

We are connecting to an S3 compatible storage bucket on Verizon. We are reaching to the internet through our Proxy and our Proxy does the DNS resolution  on traffic going out. I think what is happening is that Cyberduck is doing DNS lookups via the DNS servers set on the system (Internal) and not allowing the Proxy to provide the lookup. So when Cyberduck does the DNS request for storage-iad3a.cloud.verizon.com and uses the internal servers, it is not able to resolve. We don’t allow internal DNS servers to resolve external addresses. What we need is Cyberduck to get the DNS lookup form the Proxy on Port 80.

When connecting through the HTTP proxy the target hostname storage-iad3a.cloud.verizon.com should just be passed in the CONNECT header and not be resolved. The hostname will be resolved by the proxy and Cyberduck does no DNS lookup for the target server at all but only for the proxy.

@cyberduck
Copy link
Collaborator Author

de76d1c commented

Can we chat on the phone to discuss?

@cyberduck
Copy link
Collaborator Author

@dkocher commented

In cbe5337. Please update to the latest snapshot build available.

@cyberduck
Copy link
Collaborator Author

de76d1c commented

Is that a Linux update version as well?

@cyberduck
Copy link
Collaborator Author

@dkocher commented

Replying to [comment:8 brian.w.walker@…]:

Is that a Linux update version as well?

Snapshot builds for Cyberduck CLI for Linux will be available within a few minutes.

@cyberduck
Copy link
Collaborator Author

@dkocher commented

Replying to [comment:6 brian.w.walker@…]:

Can we chat on the phone to discuss?

We prefer to keep the conversation documented in this thread for future reference.

@cyberduck
Copy link
Collaborator Author

de76d1c commented

ok, I am running Ubuntu 14.04. I am not an ubuntu expert. Can you give me the exact commands to run to grab th new package and install?

@cyberduck
Copy link
Collaborator Author

@dkocher commented

Replying to [comment:11 brian.w.walker@…]:

ok, I am running Ubuntu 14.04. I am not an ubuntu expert. Can you give me the exact commands to run to grab th new package and install?

Please follow our instructions to use the DEB Package Repository with the nightly source added.

@cyberduck
Copy link
Collaborator Author

de76d1c commented

We grabbed the new version. Can you help with Command Line for connecting to Verizon using our access and private key?

@cyberduck
Copy link
Collaborator Author

de76d1c commented

Will the Linux version use the proxy settings on execution, or do we need to configure the linux CLI to use the proxy?

@cyberduck
Copy link
Collaborator Author

@dkocher commented

Replying to [comment:14 brian.w.walker@…]:

Will the Linux version use the proxy settings on execution, or do we need to configure the linux CLI to use the proxy?
Good point. Added default proxy finder implementation that should work on Linux in 09121bc.

@cyberduck
Copy link
Collaborator Author

@dkocher commented

Replying to [comment:13 brian.w.walker@…]:

We grabbed the new version. Can you help with Command Line for connecting to Verizon using our access and private key?

Added help text to install connection profile for CLI version in e587298. Run duck --help. You can install the Verizon connection profiles in ~/.duck/profiles/.

@cyberduck
Copy link
Collaborator Author

@dkocher commented

An updated snapshot build (ebbc11e) is now available.

@cyberduck
Copy link
Collaborator Author

de76d1c commented

Can you provide details on how to install profiles? The documentation is a little vague

@cyberduck
Copy link
Collaborator Author

@dkocher commented

Replying to [comment:18 brian.w.walker@…]:

Can you provide details on how to install profiles? The documentation is a little vague

Is comment [comment:16] not clear?

@iterate-ch iterate-ch locked as resolved and limited conversation to collaborators Nov 26, 2021
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
bug fixed high priority s3 AWS S3 Protocol Implementation
Projects
None yet
Development

No branches or pull requests

2 participants