MarcoBuster/yt-dlp
1
0
Fork 0
mirror of https://github.com/yt-dlp/yt-dlp.git synced 2024-11-09 06:27:06 +01:00
Code Issues Projects Releases Wiki Activity
22,518 Commits 3 Branches 99 Tags 168 MiB
5078692aa2
Commit Graph

49 Commits

Author SHA1 Message Date
coletdjnz
b4e0d5ac16
Disable apply_mask C implementation 2024-05-18 14:38:44 +12:00
coletdjnz
c01179b581
cleanup 2024-05-18 13:54:01 +12:00
coletdjnz
101d9f53b4
always use WebSocketsSSLTransport if available 
this ensures it is used for both sockets in TLS-in-TLS
 2024-05-18 13:46:55 +12:00
coletdjnz
018acbb93c
does this resolve unclosed socket? 2024-05-18 12:48:50 +12:00
coletdjnz
3350bdeb87
refactoring and add http erro test 2024-05-18 12:23:22 +12:00
coletdjnz
0efd83b31a
patch SSLTransport to return b'' instead of 0 as EOF 
Websockets only treats b'' as EOF
 2024-05-18 11:41:36 +12:00
coletdjnz
51e99b0759
Merge remote-tracking branch 'upstream/master' into networking/websockets-http-proxy 
# Conflicts:
#	test/test_http_proxy.py
#	test/test_networking.py
 2024-05-11 11:09:44 +12:00
coletdjnz
3c7a287e28
[test] Add HTTP proxy tests (#9578) 
Also fixes HTTPS proxies for curl_cffi

Authored by: coletdjnz
 2024-05-11 10:06:58 +12:00
bashonly
bec9a59e8e
[networking] Add extensions attribute to Response (#9756) 
CurlCFFIRH now provides an `impersonate` field in its responses' extensions

Authored by: bashonly
 2024-05-04 22:19:42 +00:00
coletdjnz
0d520bc008
misc fixes 2024-05-03 17:09:26 +12:00
coletdjnz
8ea52ec344
Update yt_dlp/networking/_websockets.py 2024-05-03 17:04:33 +12:00
bashonly
216f6a3cb5
[cleanup] Misc (#9426) 
Authored by: bashonly, pukkandan
 2024-04-09 16:12:26 +00:00
luiso1979
79a451e576
[networking] Respect SSLKEYLOGFILE environment variable (#9543) 
Authored by: luiso1979
 2024-04-08 21:53:30 +02:00
coletdjnz
833862cfbc
misc cleanup 2024-04-06 15:50:48 +13:00
coletdjnz
01fe8e8fa6
Handle urllib3 not being available 2024-04-06 15:40:29 +13:00
coletdjnz
3999a510f7
Working websockets HTTP/S proxy 2024-04-06 15:14:59 +13:00
coletdjnz
39a45d48f9
somewhat working implementation 2024-03-31 22:04:21 +13:00
coletdjnz
e565e45a6f
[rh:curl_cffi] Fix HTTPS proxy support 2024-03-31 14:50:52 +13:00
bashonly
50c2935231
[ie] Add extractor impersonate API (#9474) 
Authored by: bashonly, Grub4K, pukkandan
 2024-03-30 23:18:07 +00:00
coletdjnz
e5d4f11104
[rh:websockets] Workaround race condition causing issues on PyPy (#9514) 
Authored by: coletdjnz
 2024-03-23 11:27:10 +13:00
coletdjnz
52f5be1f1e
[rh:curlcffi] Add support for curl_cffi 
Authored by: coletdjnz, Grub4K, pukkandan, bashonly

Co-authored-by: Simon Sawicki <contact@grub4k.xyz>
Co-authored-by: pukkandan <pukkandan.ytdlp@gmail.com>
Co-authored-by: bashonly <bashonly@protonmail.com>
 2024-03-16 23:15:11 -05:00
coletdjnz
0b81d4d252
Add new options --impersonate and --list-impersonate-targets 
Authored by: coletdjnz, Grub4K, pukkandan, bashonly

Co-authored-by: Simon Sawicki <contact@grub4k.xyz>
Co-authored-by: pukkandan <pukkandan.ytdlp@gmail.com>
Co-authored-by: bashonly <bashonly@protonmail.com>
 2024-03-16 23:14:13 -05:00
pukkandan
93240fc184
[cleanup] Fix misc bugs (#8968) 
Closes #8816

Authored by: bashonly, seproDev, pukkandan, Grub4k
 2024-03-11 00:51:26 +05:30
pukkandan
47ab66db0f
[docs] Misc Cleanup (#8977) 
Closes #8355, #8944

Authored by: bashonly, Grub4k, Arthurszzz, seproDev, pukkandan

Co-authored-by: sepro <4618135+seproDev@users.noreply.github.com>
Co-authored-by: bashonly <bashonly@protonmail.com>
Co-authored-by: Arthurszzz <minecraftgamerarthur@gmail.com>
Co-authored-by: Simon Sawicki <accounts@grub4k.xyz>
Co-authored-by: bashonly <88596187+bashonly@users.noreply.github.com>
 2024-03-11 00:48:47 +05:30
Simon Sawicki
dbd8b1bff9
Improve 069b2aedae 
Authored by: Grub4k
 2024-03-10 20:44:53 +05:30
pukkandan
069b2aedae
Create ydl._request_director when needed 2024-02-25 06:06:42 +05:30
coletdjnz
0085e2bab8
[rh] Remove additional logging handlers on close (#9032) 
Fixes https://github.com/yt-dlp/yt-dlp/issues/8922

Authored by: coletdjnz
 2024-02-18 11:32:34 +13:00
coletdjnz
35f4f764a7
[rh:requests] Apply remove_dot_segments to absolute redirect locations 
Fixes https://github.com/yt-dlp/yt-dlp/issues/9020

Authored by: coletdjnz
 2024-01-21 10:03:33 +13:00
coletdjnz
811d298b23
[networking] Remove _CompatHTTPError (#8871) 
Use `yt_dlp.networking.exceptions.HTTPError`.
`_CompatHTTPError` was to help with transition to the networking framework.

Authored by: coletdjnz
 2024-01-20 15:26:50 +13:00
Simon Sawicki
f9fb3ce86e
[cleanup] Misc (#8598) 
Authored by: bashonly, pukkandan, seproDev, Grub4K

Co-authored-by: bashonly <bashonly@protonmail.com>
Co-authored-by: pukkandan <pukkandan.ytdlp@gmail.com>
Co-authored-by: sepro <4618135+seproDev@users.noreply.github.com>
 2023-12-30 22:27:36 +01:00
coletdjnz
ccfd70f4c2
[rh:websockets] Migrate websockets to networking framework (#7720) 
* Adds a basic WebSocket framework
* Introduces new minimum `websockets` version of 12.0
* Deprecates `WebSocketsWrapper`

Fixes https://github.com/yt-dlp/yt-dlp/issues/8439

Authored by: coletdjnz
 2023-11-20 08:04:04 +00:00
Simon Sawicki
b012271d01
[cleanup] Misc (#8510) 
Authored by: bashonly, coletdjnz, dirkf, gamer191, seproDev, Grub4K
 2023-11-14 22:40:38 +01:00
Simon Sawicki
4e38e2ae9d
[rh:requests] Handle both bytes and int for IncompleteRead.partial (Fix 8a8b54523a) (#8348) 
Authored by: bashonly, coletdjnz, Grub4K
 2023-10-15 10:54:38 +02:00
coletdjnz
8a8b54523a
[rh:requests] Add handler for requests HTTP library (#3668) 
Adds support for HTTPS proxies and persistent connections (keep-alive)

Closes https://github.com/yt-dlp/yt-dlp/issues/1890
Resolves https://github.com/yt-dlp/yt-dlp/issues/4070
Resolves https://github.com/ytdl-org/youtube-dl/issues/32549
Resolves https://github.com/ytdl-org/youtube-dl/issues/14523
Resolves https://github.com/ytdl-org/youtube-dl/issues/13734

Authored by: coletdjnz, Grub4K, bashonly
 2023-10-13 23:33:00 +00:00
bashonly
5ca095cbcd
[cleanup] Misc (#8182) 
Closes #7796, Closes #8028
Authored by: barsnick, sqrtNOT, gamer191, coletdjnz, Grub4K, bashonly
 2023-09-23 20:00:31 +00:00
coletdjnz
20fbbd9249
[networking] Fix various socks proxy bugs (#8065) 
- Fixed support for IPv6 socks proxies
- Fixed support for IPv6 over socks5
- Fixed --source-address not being obeyed for socks4 and socks5
- Fixed socks4a when the destination address is an IPv4 address

Closes https://github.com/yt-dlp/yt-dlp/issues/7959
Fixes https://github.com/ytdl-org/youtube-dl/issues/15368

Authored by: coletdjnz
Co-authored-by: Simon Sawicki <accounts@grub4k.xyz>
Co-authored-by: bashonly <bashonly@bashonly.com>
 2023-09-18 07:33:26 +00:00
Simon Sawicki
836e06d246
[core] Fix support for upcoming Python 3.12 (#8130) 
This also adds the following test runners:
- `3.12-dev` on `ubuntu-latest`
- `3.12-dev` on `windows-latest`
- `pypy-3.10` on `ubuntu-latest`

Authored by: Grub4K
 2023-09-17 12:56:50 +02:00
Simon Sawicki
77bff23ee9
Bugfix for 59e92b1f18 
Closes #8012

Authored by: Grub4K
 2023-09-02 15:18:04 +02:00
Simon Sawicki
59e92b1f18
[rh/urllib] Simplify gzip decoding (#7611) 
Authored by: Grub4K
 2023-08-27 00:13:30 +02:00
coletdjnz
db7b054a61
[networking] Add request handler preference framework (#7603) 
Preference functions that take a request and a request handler instance can be registered to prioritize different request handlers per request.

Authored by: coletdjnz
Co-authored-by: pukkandan <pukkandan.ytdlp@gmail.com>
 2023-08-04 22:17:48 +00:00
pukkandan
6148833f5c
[cleanup] Misc 2023-07-30 04:06:18 +05:30
coletdjnz
4bf912282a
[networking] Remove dot segments during URL normalization (#7662) 
This implements RFC3986 5.2.4 remove_dot_segments during the URL normalization process.

Closes #3355, #6526

Authored by: coletdjnz
 2023-07-28 22:40:20 +00:00
coletdjnz
bbeacff7fc
[networking] Ignore invalid proxies in env (#7704) 
Authored by: coletdjnz
 2023-07-27 20:26:02 +05:30
coletdjnz
86aea0d3a2
[networking] Add strict Request extension checking (#7604) 
Authored by: coletdjnz
Co-authored-by: pukkandan <pukkandan.ytdlp@gmail.com>
 2023-07-23 05:17:15 +00:00
pukkandan
62b5c94cad
[cleanup] Misc fixes 
Closes #7528
 2023-07-22 09:09:52 +05:30
bashonly
71baa490eb
[networking] Fix POST requests with zero-length payloads (#7648) 
Bugfix for 227bf1a33b

Authored by: bashonly
 2023-07-20 13:23:30 +00:00
coletdjnz
3d2623a898
[compat, networking] Deprecate old functions (#2861) 
Authored by: coletdjnz, pukkandan
 2023-07-15 16:18:35 +05:30
coletdjnz
227bf1a33b
[networking] Rewrite architecture (#2861) 
New networking interface consists of a `RequestDirector` that directs
each `Request` to appropriate `RequestHandler` and returns the
`Response` or raises `RequestError`. The handlers define adapters to
transform its internal Request/Response/Errors to our interfaces.

User-facing changes:
- Fix issues with per request proxies on redirects for urllib
- Support for `ALL_PROXY` environment variable for proxy setting
- Support for `socks5h` proxy
   - Closes https://github.com/yt-dlp/yt-dlp/issues/6325, https://github.com/ytdl-org/youtube-dl/issues/22618, https://github.com/ytdl-org/youtube-dl/pull/28093
- Raise error when using `https` proxy instead of silently converting it to `http`

Authored by: coletdjnz
 2023-07-15 16:18:35 +05:30
pukkandan
c365dba843
[networking] Add module (#2861) 
No actual changes - code is only moved around
 2023-07-15 16:18:34 +05:30