Sergey M․
95d8f7ea12
[fragment] Generalize fragmented media file downloader
2015-07-29 02:26:16 +06:00
Jaime Marquínez Ferrándiz
59db9f8018
[downloader/dash] Improve 'combine_url' ( fixes #6341 )
...
In some videos the base_url already ends with '/'.
2015-07-23 12:09:30 +02:00
Jaime Marquínez Ferrándiz
2ee8f5d80f
Merge remote-tracking branch 'yan12125/download-dash-segments' ( #5886 )
2015-07-20 19:34:24 +02:00
Sergey M․
6c4d20cd6f
[downloader/external] Fix externals downloaders specified with extension on Windows
2015-06-28 00:08:52 +06:00
Jaime Marquínez Ferrándiz
906e2f0eac
[downloader/external] Add downloader for httpie ( closes #6079 )
2015-06-25 15:48:04 +02:00
Yen Chi Hsuan
5bf3276e8d
[downloader/dash] Add testing facility
2015-06-10 14:45:54 +08:00
Yen Chi Hsuan
93dfcb9357
[downloader/dash] Do not pollute ``self``
2015-06-10 13:44:54 +08:00
Yen Chi Hsuan
423d2be5f8
[downloader/dash] Rename the protocol
...
'http_dash_segments' looks more like a protocol name than
'dash_segments'
2015-06-04 22:27:29 +08:00
Yen Chi Hsuan
453a1617aa
[downloader/dash] Reorder imports
2015-06-04 22:12:05 +08:00
Yen Chi Hsuan
b9258c6178
[YoutubeDL] Change how DashSegmentsFD is selected
2015-06-04 22:05:33 +08:00
Yen Chi Hsuan
6800d3372f
[YoutubeDL] Support DASH manifest downloading
2015-06-03 23:10:18 +08:00
Yen Chi Hsuan
156fc83a55
[downloader/rtmp] Fix a typo
2015-05-08 03:11:24 +08:00
Antti Ajanki
233c1c0e76
[downloader/f4m] Fragment filenames must be sanitized
...
because the fragment was written to a file with a sanitized name by
http_dl.download()
2015-05-03 11:31:42 +03:00
Jaime Marquínez Ferrándiz
2ddcd88129
Remove code that was only used by the Grooveshark extractor
2015-05-02 17:29:56 +02:00
Sergey M․
74f8654a53
[downloader/external] Use encodeArgument
2015-04-26 04:33:43 +06:00
Sergey M․
9e105a858c
[downloader/rtmp] Fix arguments encoding and simplify retry logic ( Closes #5528 )
2015-04-26 04:32:54 +06:00
Sergey M․
cd8a07a764
[downloader/common] Use decodeArgument
2015-04-26 04:30:45 +06:00
Sergey M․
a5ebf77d87
[mplayer] Rename to RTSP
2015-04-26 00:25:51 +06:00
Sergey M․
b874495b1f
[mplayer] Simplify
2015-04-26 00:23:16 +06:00
Sergey M․
b860f5dfd4
[mplayer] Clarify error message
2015-04-26 00:22:13 +06:00
mrkrossxdx
db37e0c273
Added support for mpv if mplayer is not available
2015-04-24 20:50:34 +02:00
Yen Chi Hsuan
c6391cd587
[Senate] Add new extractor ( #5302 )
2015-04-21 02:29:56 +08:00
Philipp Hagemeister
c59e701e35
Default to continuedl=True
...
We already do this in the CLI interface, so it should be just fine.
2015-03-28 08:11:39 +01:00
Jaime Marquínez Ferrándiz
70a1165b32
Don't use bare 'except:'
...
They catch any exception, including KeyboardInterrupt, we don't want to catch it.
2015-03-27 13:02:20 +01:00
Jaime Marquínez Ferrándiz
43d6280d0a
[downloader/f4m] Fix use of base64 in python 3.2 ( fixes #5132 )
...
b64decode needs a byte string, but on 3.4 it also accepts strings.
2015-03-08 18:25:11 +01:00
Jaime Marquínez Ferrándiz
f28fe66970
[downloader/http] Add missing fields for _hook_progress call
...
It would fail if you run 'youtube-dl --no-part URL' a second time when the file has already been downloaded.
(Reported in Fedora: https://bugzilla.redhat.com/show_bug.cgi?id=1195779 )
2015-03-04 12:14:38 +01:00
Jaime Marquínez Ferrándiz
123397317c
[downloader/http] Remove wrong '_hook_progress' call ( fixes #5117 )
2015-03-03 18:45:56 +01:00
Philipp Hagemeister
c75f0b361a
[downloader/external] Add support for custom options ( Fixes #4885 , closes #5098 )
2015-03-02 18:21:31 +01:00
Philipp Hagemeister
2a15a98a6a
[rmtp] Encode filename before invoking subprocess
...
This fixes #5066 .
Reproducible with
LC_ALL=C youtube-dl "http://www.prosieben.de/tv/germanys-next-topmodel/video/playlist/ganze-folge-episode-2-das-casting-in-muenchen "
2015-02-26 01:44:20 +01:00
Antti Ajanki
5eaaeb7c31
[f4m] Tolerate missed fragments on live streams
2015-02-24 21:22:59 +02:00
Antti Ajanki
c4f8c453ae
[f4m] Refresh fragment list periodically on live streams
2015-02-24 21:22:59 +02:00
Philipp Hagemeister
8fb3ac3649
PEP8: W503
2015-02-21 14:55:13 +01:00
Philipp Hagemeister
09ab40b7d1
Merge branch 'progress-as-hook2'
2015-02-17 23:41:48 +01:00
Philipp Hagemeister
a91a2c1a83
[downloader] Remove various unneeded assignments and imports
2015-02-17 21:44:41 +01:00
Philipp Hagemeister
16e7711e22
[downloader/http] Remove gruesome import
2015-02-17 21:42:31 +01:00
Philipp Hagemeister
5cda4eda72
[YoutubeDL] Use a progress hook for progress reporting
...
Instead of every downloader calling two helper functions, let our progress report be an ordinary progress hook like everyone else's.
Closes #4875 .
2015-02-17 21:40:35 +01:00
Philipp Hagemeister
8ac27a68e6
[hls] Switch to available as a property
2015-02-17 17:35:03 +01:00
Jaime Marquínez Ferrándiz
fbc503d696
[downloader/hls] Fix detection of ffmpeg/avconv (reported in #4966 )
2015-02-17 16:40:42 +01:00
Jaime Marquínez Ferrándiz
163d966707
[downloader/external] curl: Add the '--location' flag
...
curl doesn't follow redirections by default
2015-02-17 16:21:02 +01:00
Philipp Hagemeister
85729c51af
[downloader] Add --hls-prefer-native to use the native HLS downloader ( #4966 )
2015-02-17 12:09:12 +01:00
Philipp Hagemeister
73fac4e911
[ffmpeg] Add --ffmpeg-location
2015-02-16 04:05:53 +01:00
Philipp Hagemeister
cc9ca3ba6e
[downloader/external] Simplify source_address
...
'' might actually be passed in, so check for None.
2015-02-02 20:33:25 +01:00
Sergey M․
ae7773942e
[downloader/external] Simplify
2015-02-02 21:51:38 +06:00
Sergey M․
469a64cebf
[downloader/external] Simplify
2015-02-02 21:40:52 +06:00
vijayanand nandam
6a66904f8e
passing source address option to external downloaders
2015-02-02 20:51:40 +05:30
Philipp Hagemeister
1283204917
[http] PEP8 ( #4831 )
2015-02-02 12:05:39 +01:00
Philipp Hagemeister
6789defea9
Merge pull request #4831 from light94/master
...
Handling Connection Reset by Peer Error
2015-02-02 12:03:28 +01:00
Sergey M․
4a3da4ebdb
[hls] Simplify
2015-02-01 23:54:38 +06:00
Sergey M․
027008b14e
[hls] Fix encode issues on python2 @ Windows
2015-02-01 23:49:23 +06:00
light94
e77d2975af
Handling Connection Reset by Peer Error
2015-02-01 00:10:58 +05:30
Jaime Marquínez Ferrándiz
e41b1f7385
Fix flake8 errors
2015-01-31 10:51:39 +01:00
Philipp Hagemeister
d543bdc351
[downloader/f4m] Clarify that we should eventually just implement the DRM scheme ( #3000 )
2015-01-30 16:06:55 +01:00
Philipp Hagemeister
c7ff0c6422
Merge remote-tracking branch 'rzhxeo/f4m-drm'
2015-01-30 16:00:47 +01:00
Paul Hartmann
7bb3ceb4c7
[dctp] prefix real_time parameter with rtmp_
2015-01-30 00:47:43 +01:00
Paul Hartmann
0865f397ae
added extractor for dctp.tv
2015-01-28 08:21:04 +01:00
rzhxeo
6ca85be6f8
Filter DRM protected media in f4m downloader
2015-01-26 20:44:48 +01:00
Philipp Hagemeister
3dee7826e7
[rtl2] PEP8, simplify, make rtmp tests run ( #470 )
2015-01-25 18:09:48 +01:00
Philipp Hagemeister
d4f64cabf4
Merge remote-tracking branch 'David-Development/rtl2.py'
2015-01-25 17:55:31 +01:00
Philipp Hagemeister
881e6a1f5c
Add --xattr-set-filesize option ( Fixes #1348 )
2015-01-25 04:49:44 +01:00
David-Development
7906d199a1
[rtl2] Add new extractor
2015-01-25 00:07:15 +01:00
Jaime Marquínez Ferrándiz
e5660ee6ae
[YoutubeDL] Fill the info dict 'http_headers' field with all the headers available
...
Useful for external tools using the json output.
The methods '_calc_headers' and '_calc_cookies' have been copied from the downloader/external, now they just use "info_dict['http_headers']".
2015-01-24 18:56:04 +01:00
Jaime Marquínez Ferrándiz
587a9c2749
[downloader/external] Use the 'http_headers' field
2015-01-24 18:25:09 +01:00
Jaime Marquínez Ferrándiz
e1554a407d
[extractors] Use http_headers for setting the User-Agent and the Referer
2015-01-24 18:23:53 +01:00
Jaime Marquínez Ferrándiz
3fcfb8e9fa
[utils] YoutubeDLHandler: don't use 'Youtubedl-user-agent' for overriding the default user agent
...
Setting the 'User-Agent' header is enough
2015-01-24 18:07:21 +01:00
Philipp Hagemeister
384b62028a
[downloader/external] Add curl and aria2c ( Closes #182 )
2015-01-24 13:33:45 +01:00
Philipp Hagemeister
222516d97d
[downloader] Lay groundwork for external downloaders.
...
This comes with a very simply implementation for wget; the real work is in setting up the infrastructure.
2015-01-24 01:38:48 +01:00
Philipp Hagemeister
a055469faf
[downloader] Improve downloader selection
2015-01-23 23:50:31 +01:00
Jaime Marquínez Ferrándiz
bf7fa94ec7
[downloader/f4m] build_fragments_list: Support videos with more than 1 segment
2015-01-23 16:31:52 +01:00
Philipp Hagemeister
5f0d813d93
Merge remote-tracking branch 'rupertbaxter2/master'
...
Conflicts:
youtube_dl/__init__.py
youtube_dl/downloader/common.py
2015-01-23 12:05:01 +01:00
Pierre
4340decad2
check for overwriting files in the downloader ( fixes #3916 , closes #3829 )
2015-01-11 12:02:27 +01:00
Antti Ajanki
f14f2a6d79
[downloader/f4m] Minor cleanup
2015-01-05 21:12:33 +02:00
Antti Ajanki
2c322cc5d6
[downloader/f4m] The last value in a tag is the tag length
2015-01-05 21:07:15 +02:00
Antti Ajanki
3b8f3a1504
[downloader/f4m] <metadata> is optional according to the F4M specs
2015-01-05 21:07:13 +02:00
Jaime Marquínez Ferrándiz
63948fc62c
[downloader/hls] Respect the 'prefer_ffmpeg' option
2015-01-04 13:41:49 +01:00
Philipp Hagemeister
95ceeec722
Remove unused import
2015-01-04 02:05:35 +01:00
Jaime Marquínez Ferrándiz
d26b1317ed
[downloader/mplayer] Use check_executable
2015-01-03 00:33:36 +01:00
Philipp Hagemeister
fdc8000810
[downloader] Handle a file ./- ( Fixes #4498 )
2014-12-17 11:39:06 +01:00
Philipp Hagemeister
7af808a5ef
Improve code style
2014-12-17 00:06:41 +01:00
Philipp Hagemeister
71b640cc5b
[YoutubeDL] Add declarative version of progress hooks
2014-12-15 01:26:20 +01:00
Philipp Hagemeister
da4d4191a9
Merge branch 'master' of github.com:rg3/youtube-dl
2014-12-13 23:05:22 +01:00
Philipp Hagemeister
1cc79574fc
Fix imports and general cleanup
...
· Import from compat what comes from compat. Yes, some names are available in utils too, but that's an implementation detail.
· Use _match_id consistently whenever possible
· Fix some outdated tests
· Use consistent valid URL (always match the whole protocol, no ^ at start required)
· Use modern test definitions
2014-12-13 12:35:45 +01:00
Philipp Hagemeister
cc8c9281e6
[downloader/common] Do not use classic int division
2014-12-12 17:17:09 +01:00
Philipp Hagemeister
cf372f0778
Merge remote-tracking branch 'SyxbEaEQ2/rate-limit'
2014-12-12 17:16:13 +01:00
Philipp Hagemeister
5f9b83944d
[ffmpeg] Improve version check and call it from hls ( Fixes #4377 )
2014-12-06 12:14:26 +01:00
Philipp Hagemeister
80310134e0
[mplayer] Modernize
2014-11-26 12:34:52 +01:00
Philipp Hagemeister
4d2d638df4
[http] Modernize
2014-11-26 12:27:36 +01:00
Philipp Hagemeister
0e44f90e18
[hls] Remove useless u porefixes
2014-11-26 12:26:21 +01:00
Philipp Hagemeister
14d4e90eb1
[downloader/__init__] Define proper __all__
2014-11-23 22:25:12 +01:00
Jouke Waleson
9e1a5b8455
PEP8: applied even more rules
2014-11-23 21:39:15 +01:00
Jouke Waleson
2514d2635e
PEP8: E225,E227
2014-11-23 21:23:05 +01:00
Jouke Waleson
8bcc875676
PEP8: more applied
2014-11-23 21:20:46 +01:00
Jouke Waleson
5f6a1245ff
PEP8 applied
2014-11-23 20:41:03 +01:00
Philipp Hagemeister
b6b70730bf
[downloader/common] Modernize
2014-11-16 15:06:59 +01:00
Philipp Hagemeister
4c83c96795
[YoutubeDL] Include rtmpdump in exe versions -v output
2014-11-02 10:55:36 +01:00
Philipp Hagemeister
ee966928af
[f4m] Support bootstrap URLs
2014-10-28 17:27:41 +01:00
Philipp Hagemeister
fec02bcc90
[hlsnative] Correct handling when remaining_bytes is None
2014-09-25 09:21:45 +02:00
Philipp Hagemeister
b686fc18da
[hlsnative] Support test parameter
2014-09-24 14:38:40 +02:00
Philipp Hagemeister
f0b5d6af74
[vevo] Support 1080p videos ( Fixes #3656 )
2014-09-24 14:16:56 +02:00
Jaime Marquínez Ferrándiz
b509a4b176
[downloader/f4m] If <pv-2.0> is in the manifest, add it to the fragments urls query ( fixes #3176 )
...
It's used in some akamai videos (for example for theplatform.com).
2014-09-21 15:43:09 +02:00
Sergey M․
88a23aef5a
[http] Avoid closing stdout ( Fixes #3686 )
2014-09-05 22:05:36 +07:00
Jaime Marquínez Ferrándiz
7798fad535
[downloader/rtmp] Use check_exectuble
2014-08-27 15:56:27 +02:00
Jaime Marquínez Ferrándiz
baf2907501
[downloader/hls] Return False if ffmpeg or avconv couldn't be found
2014-08-27 15:50:47 +02:00
Jaime Marquínez Ferrándiz
3c765c68c4
[downloader/hls] Use check_executable
2014-08-27 15:49:07 +02:00
Jaime Marquínez Ferrándiz
29153f49b3
[downloader/hls] Use the correct program when reporting an error
2014-08-27 15:40:02 +02:00
Philipp Hagemeister
d769be6c96
[grooveshark,http] Make HTTP POST downloads work
2014-08-24 01:31:35 +02:00
rupertbaxter2
a42c921598
Removed sleep and sleep output when interval is zero
2014-08-13 04:38:40 -07:00
rupertbaxter2
f96252b913
Merge remote-tracking branch 'upstream/master'
2014-08-13 04:22:45 -07:00
Sergey M․
c767dc74b8
[downloader/common] Fix typo
2014-08-10 01:41:01 +07:00
SyxbEaEQ2
00cf122d7a
[downloader/common] Fix possible negative sleep time in slow_down()
2014-08-06 20:53:04 +02:00
rupertbaxter2
03359e9864
Added --sleep-interval option
2014-08-03 07:34:04 -07:00
SyxbEaEQ2
c7667c2d7f
[downloader/(common/http)] Changes calculation of the rate-limit. ( Fix #2297 , fix #2140 , fix #595 , fix #2370 )
2014-07-31 03:08:24 +02:00
Jaime Marquínez Ferrándiz
31bb8d3f51
[bloomberg] Extract the available formats ( closes #2776 )
...
It uses a helper method in the InfoExtractor class.
The downloader will pick the requested formats using the bitrate in the info dict.
2014-07-28 15:32:38 +02:00
Jaime Marquínez Ferrándiz
23566e0d78
rtmp and hls downloaders: Clarify error message when the external tools are not installed
...
Ask to install them, as we do in the postprocessor.
We get some reports with it, like #3061 or #3048 .
2014-06-09 20:23:20 +02:00
Jaime Marquínez Ferrándiz
087ca2cb07
[naver] Add rtmp formats ( fixes #3054 )
2014-06-06 14:55:19 +02:00
Sergey M․
eb45133451
[rtmp] Add support for multiple AFM data entries
2014-05-01 21:14:21 +07:00
Sergey M․
32fd27ec98
[http] Fix string/None comparison with int while in test
2014-04-30 20:02:17 +07:00
Sergey M․
df297c8794
[http] Improve download mechanism when Range HTTP header is ignored
2014-04-27 09:32:01 +07:00
Jaime Marquínez Ferrándiz
e3ced9ed61
[downloader/common] Use compat_str with the error in try_rename (appeared in #2389 )
...
Otherwise on python 2.x we get `UnicodeDecodeError` because it may contain non ascii characters.
2014-04-04 14:59:11 +02:00
Jaime Marquínez Ferrándiz
b900e7cba4
[downloader/f4m] Close the final video
2014-04-03 13:35:07 +02:00
Sergey M․
a59e40a1ea
Replace 'referer' with 'http_referer'
2014-03-25 21:53:26 +07:00
Sergey M․
1d0e49e1c7
Use explicitly set Referer header for downloading
2014-03-25 21:22:27 +07:00
Philipp Hagemeister
75f2e25ba9
[downloader/hls] Encode filename ( Fixes #2609 )
2014-03-24 21:23:05 +01:00
Jaime Marquínez Ferrándiz
22ff5d2105
[http] Use the YoutubeDL.urlopen method
2014-03-07 16:41:42 +01:00
Sergey M․
9d6105c9f0
Do not resume live streams
...
No resuming or seeking in live streams is possible (c) man rtmpdump
2014-03-05 22:46:20 +07:00
Sergey M․
8dec03ecba
Use unicode literals
2014-03-05 22:24:07 +07:00
Sergey M․
826547870b
Report no connect as error
2014-03-05 22:21:19 +07:00
Sergey M․
52d6a9a61d
Handle rtmpdump's no connection return value
2014-03-05 22:19:27 +07:00
Sergey M․
ad242b5fbc
Remove superfluous whitespace
2014-03-05 22:16:50 +07:00
Sergey M․
3524175625
Use meaningful return value constants for rtmpdump
2014-03-05 22:12:02 +07:00
rzhxeo
60daf7f0bb
Set resume_len to 0 if download is restarted
2014-02-26 02:47:27 +01:00
Philipp Hagemeister
1df96e59ce
[f4m] Clean up
2014-02-22 23:03:00 +01:00
Jaime Marquínez Ferrándiz
1824b48169
[f4m] Download only the first fragment with the --test option
2014-02-15 17:53:23 +01:00
Philipp Hagemeister
b53466e168
Fix f4m downloading on Python 2.6
2014-02-15 16:24:43 +01:00
Jaime Marquínez Ferrándiz
cf1eb45153
Add a downloader for f4m manifests
2014-02-09 12:24:54 +01:00
Sergey M.
082c6c867a
[bbc.co.uk] Add support for bbc.co.uk radio programmes ( Closes #2184 )
2014-02-08 21:55:28 +07:00
Philipp Hagemeister
db1f388878
[huffpost] Add support
2014-01-27 05:47:38 +01:00
Jaime Marquínez Ferrándiz
f89197d73e
Some pep8 style fixes
2014-01-25 15:33:23 +01:00
Jaime Marquínez Ferrándiz
70af3439e9
[hls] Fix the program name when reporting the file size
2014-01-08 16:15:20 +01:00
Jaime Marquínez Ferrándiz
7976fcac55
[http] Fix ‘err’ variable not being assigned in an except block ( #2045 )
2013-12-31 13:44:57 +01:00
Philipp Hagemeister
dabc127362
Remove dead code
2013-12-23 16:03:06 +01:00
Philipp Hagemeister
c25c991809
[mplayer] Fix error introduced by downloader separation
2013-12-23 16:00:48 +01:00
Philipp Hagemeister
1538eff6d8
[bliptv] Remove support for direct downloads
...
This is now handled by the generic IE
2013-12-23 15:49:21 +01:00
Jaime Marquínez Ferrándiz
3bc2ddccc8
Move FileDownloader to its own module and create a new class for each download process
...
A suitable downloader can be found using the 'get_suitable_downloader' function.
Each subclass implements 'real_download', for downloading an info dict you call the 'download' method, which first checks if the video has already been downloaded
2013-12-11 16:18:48 +01:00
