In the former posts, we have shared the methods to download files from the web using the requests or wget module. As we know, they are external modules which we need to install them before using. Therefore, we are going to present you an alternative method to download remote resources using a built-in module called urllib2 in Python 2 or urllib in Python 3.
Much of the Python ecosystem already uses urllib3 and you should too. The urllib module is the replacement of urllib2 as long as migrating from Python 2 to Python 3. The urllib module in Python 3 is a collection of modules that you can use for working with URLs. If you are coming from a Python 2 background you will note that in Python 2 you had urllib and urllib2. These are now a part of the urllib package in Python 3.
The current version of urllib is made up of the following modules:. We will be covering each part individually except for urllib. Apr 16, Jan 21, Sep 24, Sep 20, Sep 19, May 23, Apr 29, Apr 24, Apr 22, May 2, Apr 17, Nov 2, Oct 16, Jun 5, Jul 20, Apr 25, Jan 19, Nov 16, Nov 3, Oct 27, Sep 26, Sep 6, Jun 11, Apr 11, Apr 6, Dec 29, Dec 18, Dec 14, Jul 21, May 3, Apr 21, Feb 25, Feb 11, Sep 13, Jul 7, Jun 24, Apr 18, Mar 6, Sep 25, Aug 14, Aug 2, Jun 16, Mar 25, Feb 6, Feb 5, Jan 29, Jan 7, Nov 4, Oct 11, Oct 9, Jul 18, Mar 30, Jul 13, Dec 11, Nov 24, Download the file for your platform.
If you're not sure which to choose, learn more about installing packages. Warning Some features may not work without JavaScript. Please try enabling it if you encounter problems. Search PyPI Search.
Latest version Released: Sep 22, Navigation Project description Release history Download files. Project links Homepage Issue tracker Code Documentation. Maintainers SethMichaelLarson shazow urllib3.
Connection pooling. File uploads with multipart encoding. Helpers for retrying requests and dealing with HTTP redirects. Support for gzip, deflate, and brotli encoding. Documentation urllib3 has usage and reference documentation at urllib3. Contributing urllib3 happily accepts contributions. Security Disclosures To report a security vulnerability, please use the Tidelift security contact.
Maintainers sethmlarson Seth M. Sponsorship If your company benefits from this library, please consider sponsoring its development. For Enterprise Professional support for urllib3 is available as part of the Tidelift Subscription. Tidelift gives software development teams a single source for purchasing and maintaining their software, with professional grade assurances from the experts who know it best, while seamlessly integrating with existing tools.
Issue The exception classes are exported from the urllib. Sometimes the status code indicates that the server is unable to fulfil the request. Because the default handlers handle redirects codes in the range , and codes in the — range indicate success, you will usually only see error codes in the — range. The dictionary is reproduced here for convenience. When an error is raised the server responds by returning an HTTP error code and an error page. This means that as well as the code attribute, it also has read, geturl, and info, methods as returned by the urllib.
I prefer the second approach. The response returned by urlopen or the HTTPError instance has two useful methods info and geturl and is defined in the module urllib. This is useful because urlopen or the opener object used may have followed a redirect. It is currently an http. HTTPMessage instance. When you fetch a URL you use an opener an instance of the perhaps confusingly-named urllib.
Normally we have been using the default opener - via urlopen - but you can create custom openers. Openers use handlers. You will want to create openers if you want to fetch URLs with specific handlers installed, for example to get an opener that handles cookies, or to get an opener that does not handle redirections.
To create an opener, instantiate an OpenerDirector , and then call. Other sorts of handlers you might want to can handle proxies, authentication, and other common but slightly specialised situations.
This means that calls to urlopen will use the opener you have installed. For a more detailed discussion of this subject — including an explanation of how Basic Authentication works - see the Basic Authentication Tutorial. When authentication is required, the server sends a header as well as the error code requesting authentication. The client should then retry the request with the appropriate name and password for the realm included as a header in the request.
Active 4 years, 3 months ago. Viewed 17k times. Improve this question. Community Bot 1 1 1 silver badge. Nathan Nathan 2, 8 8 gold badges 26 26 silver badges 48 48 bronze badges. Add a comment. Active Oldest Votes. Improve this answer. Sheng Sheng 3, 1 1 gold badge 16 16 silver badges 21 21 bronze badges. An easier way I think also you can do it in two lines is to use: import urllib.
Xantium Xantium 9, 9 9 gold badges 55 55 silver badges 80 80 bronze badges. The PEP20 would have you use Request from urllib. Information about PEP20 for Request.
0コメント