Sergey M․
a3c3a1e128
[http] Rework HTTP downloader
...
* Simplify code and split into separate routines to facilitate maintaining
* Make retry mechanism work on errors during actual download not only during connection establishment phase
* Retry on ECONNRESET and ETIMEDOUT during reading data from network
* Retry on content too short and various timeout errors
* Show error description on retry
* Closes #506 , closes #809 , closes #2849 , closes #4240 , closes #6023 , closes #8625 , closes #9483
2017-08-27 02:22:30 +07:00
Sergey M․
1433734c35
[downloader/common] Use utils.shell_quote for debug command line
2017-06-17 23:50:21 +07:00
Remita Amine
ea0c2f219c
[downloader/fragment] use a general file to store fragment download context
2017-04-19 18:53:15 +01:00
Remita Amine
75a2485407
[fragment,hls,f4m,dash,ism] improve fragment downloading
...
- resume immediately
- no need to concatenate segments and decrypt them on every resume
- no need to save temp files for segments
and for hls downloader:
- no need to download keys for segments that already downloaded
2017-04-19 11:46:07 +01:00
Pratyush Singh
d374d943f3
[downloader/common] Limit displaying 2 digits after decimal point in sleep interval message
2017-02-25 20:59:04 +07:00
Sergey M․
bcd6276520
[downloader/common] Remove debug output
2016-10-12 21:22:33 +07:00
Sergey M․
1ad6b891b2
Add more checks for --min/max-sleep-interval arguments and use more idiomatic naming
2016-08-09 03:47:56 +07:00
singh-pratyush96
065bc35489
Add --max-sleep-interval ( Closes #9930 )
2016-08-09 03:32:42 +07:00
Sergey M․
617e58d850
[downloader/{common,fragment}] Fix total retries reporting on python 2.6
2016-03-19 20:51:30 +06:00
Yen Chi Hsuan
e9c0cdd389
[jython] Introduce compat_os_name
...
os.name is always 'java' on Jython
2016-03-03 19:24:24 +08:00
Sergey M․
d800609c62
[refactor] Do not specify redundant None as second argument in dict.get()
2016-02-14 14:25:04 +06:00
Jaime Marquínez Ferrándiz
7d106a65ca
Add --hls-use-mpegts option
...
When using the mpegts container hls vidoes can be played while being downloaded (useful if you are recording a live stream).
VLC and mpv play them file, but QuickTime doesn't.
2016-01-30 12:26:40 +01:00
Jaime Marquínez Ferrándiz
32d77eeb04
[downloader/common] report_retry: Don't crash when retries is infinite ( fixes #8299 )
2016-01-22 14:49:17 +01:00
Sergey M․
9b9c5355e4
Rename error_to_str to error_to_compat_str
2015-12-20 07:00:39 +06:00
Sergey M․
7f8b271465
Properly convert errors to strings
2015-12-20 05:27:38 +06:00
ashutosh-mishra
17cc153435
Typo fix, found while going through the code.
2015-11-20 22:51:46 +05:30
Sergey M․
964e7b2dd0
[downloader/common] Always skip "already downloaded" check when outputting to stdout
2015-10-12 00:43:54 +06:00
Sergey M․
cd8a07a764
[downloader/common] Use decodeArgument
2015-04-26 04:30:45 +06:00
Philipp Hagemeister
c59e701e35
Default to continuedl=True
...
We already do this in the CLI interface, so it should be just fine.
2015-03-28 08:11:39 +01:00
Jaime Marquínez Ferrándiz
70a1165b32
Don't use bare 'except:'
...
They catch any exception, including KeyboardInterrupt, we don't want to catch it.
2015-03-27 13:02:20 +01:00
Philipp Hagemeister
c75f0b361a
[downloader/external] Add support for custom options ( Fixes #4885 , closes #5098 )
2015-03-02 18:21:31 +01:00
Philipp Hagemeister
8fb3ac3649
PEP8: W503
2015-02-21 14:55:13 +01:00
Philipp Hagemeister
5cda4eda72
[YoutubeDL] Use a progress hook for progress reporting
...
Instead of every downloader calling two helper functions, let our progress report be an ordinary progress hook like everyone else's.
Closes #4875 .
2015-02-17 21:40:35 +01:00
Philipp Hagemeister
881e6a1f5c
Add --xattr-set-filesize option ( Fixes #1348 )
2015-01-25 04:49:44 +01:00
Philipp Hagemeister
222516d97d
[downloader] Lay groundwork for external downloaders.
...
This comes with a very simply implementation for wget; the real work is in setting up the infrastructure.
2015-01-24 01:38:48 +01:00
Philipp Hagemeister
5f0d813d93
Merge remote-tracking branch 'rupertbaxter2/master'
...
Conflicts:
youtube_dl/__init__.py
youtube_dl/downloader/common.py
2015-01-23 12:05:01 +01:00
Pierre
4340decad2
check for overwriting files in the downloader ( fixes #3916 , closes #3829 )
2015-01-11 12:02:27 +01:00
Philipp Hagemeister
fdc8000810
[downloader] Handle a file ./- ( Fixes #4498 )
2014-12-17 11:39:06 +01:00
Philipp Hagemeister
71b640cc5b
[YoutubeDL] Add declarative version of progress hooks
2014-12-15 01:26:20 +01:00
Philipp Hagemeister
1cc79574fc
Fix imports and general cleanup
...
· Import from compat what comes from compat. Yes, some names are available in utils too, but that's an implementation detail.
· Use _match_id consistently whenever possible
· Fix some outdated tests
· Use consistent valid URL (always match the whole protocol, no ^ at start required)
· Use modern test definitions
2014-12-13 12:35:45 +01:00
Philipp Hagemeister
cc8c9281e6
[downloader/common] Do not use classic int division
2014-12-12 17:17:09 +01:00
Philipp Hagemeister
cf372f0778
Merge remote-tracking branch 'SyxbEaEQ2/rate-limit'
2014-12-12 17:16:13 +01:00
Jouke Waleson
5f6a1245ff
PEP8 applied
2014-11-23 20:41:03 +01:00
Philipp Hagemeister
b6b70730bf
[downloader/common] Modernize
2014-11-16 15:06:59 +01:00
Philipp Hagemeister
b686fc18da
[hlsnative] Support test parameter
2014-09-24 14:38:40 +02:00
rupertbaxter2
a42c921598
Removed sleep and sleep output when interval is zero
2014-08-13 04:38:40 -07:00
rupertbaxter2
f96252b913
Merge remote-tracking branch 'upstream/master'
2014-08-13 04:22:45 -07:00
Sergey M․
c767dc74b8
[downloader/common] Fix typo
2014-08-10 01:41:01 +07:00
SyxbEaEQ2
00cf122d7a
[downloader/common] Fix possible negative sleep time in slow_down()
2014-08-06 20:53:04 +02:00
rupertbaxter2
03359e9864
Added --sleep-interval option
2014-08-03 07:34:04 -07:00
SyxbEaEQ2
c7667c2d7f
[downloader/(common/http)] Changes calculation of the rate-limit. ( Fix #2297 , fix #2140 , fix #595 , fix #2370 )
2014-07-31 03:08:24 +02:00
Jaime Marquínez Ferrándiz
e3ced9ed61
[downloader/common] Use compat_str with the error in try_rename (appeared in #2389 )
...
Otherwise on python 2.x we get `UnicodeDecodeError` because it may contain non ascii characters.
2014-04-04 14:59:11 +02:00
Jaime Marquínez Ferrándiz
f89197d73e
Some pep8 style fixes
2014-01-25 15:33:23 +01:00
Philipp Hagemeister
dabc127362
Remove dead code
2013-12-23 16:03:06 +01:00
Jaime Marquínez Ferrándiz
3bc2ddccc8
Move FileDownloader to its own module and create a new class for each download process
...
A suitable downloader can be found using the 'get_suitable_downloader' function.
Each subclass implements 'real_download', for downloading an info dict you call the 'download' method, which first checks if the video has already been downloaded
2013-12-11 16:18:48 +01:00
