Jaime Marquínez Ferrándiz
231516b6c9
Merge pull request #1705 from iemejia/master
...
[ted] support for subtitles
2013-11-10 11:54:18 +01:00
Jaime Marquínez Ferrándiz
4f045eef8f
[youtube:channel] Fix the extraction
...
The page don't include the 'load more' button anymore, now we directly get the 'c4_browse_ajax' pages.
2013-11-06 21:42:33 +01:00
Philipp Hagemeister
08fb86c49b
[youtube] Add description for YoutubeSearchDateIE ( #1710 )
2013-11-03 15:59:10 +01:00
Philipp Hagemeister
3633d77c0f
Merge remote-tracking branch 'CBGoodBuddy/ytsearchtime'
2013-11-03 15:56:55 +01:00
Jaime Marquínez Ferrándiz
9103bbc5cd
Add the 'webpage_url' field to info_dict
...
The url for the video page, it must allow to reproduce the result.
It's automatically set by YoutubeDL if it's missing.
2013-11-03 12:11:13 +01:00
Craig Markwardt
a3dd924871
Add YoutubeSearchDateIE extractor to youtube.py & __init__.py, which searches by publication date.
2013-11-02 22:40:48 -04:00
Jaime Marquínez Ferrándiz
cf51923545
[youtube] Remove vevo test
...
The video is no longer available and it seems that vevo video don't use encrypted signatures anymore.
2013-11-02 20:46:26 +01:00
Ismaël Mejía
38db46794f
Merge branch 'ted_subtitles'
2013-11-02 19:50:45 +01:00
Ismaël Mejía
1f343eaabb
[subtitles] refactor to support websites with subtitle information the
...
webpage.
I added the parameter webpage, so now it's similar to the way automatic
captions are handled. This is an improvement needed for websites like
TED.
2013-11-02 19:29:25 +01:00
Philipp Hagemeister
8eddf3e91d
[youtube] Encode subtitle track name in request ( Fixes #1700 )
2013-11-02 11:21:05 +01:00
Philipp Hagemeister
795f28f871
[youtube] Fix login ( Fixes #1681 )
2013-10-29 06:45:54 +01:00
Jaime Marquínez Ferrándiz
600cc1a4f0
[youtube] Set the format_id field to the itag of the format ( closes #1624 )
2013-10-25 17:17:46 +02:00
Jaime Marquínez Ferrándiz
ea32fbacc8
Fix the extensions of two tests with youtube videos
...
The best quality is now a mp4 video.
2013-10-25 16:55:37 +02:00
Jaime Marquínez Ferrándiz
00fe14fc75
[youtube] Also use the 'adaptative_fmts' field from the /get_video_info page ( fixes #1649 )
...
The 'adaptative_fmts' field from the video page is not added to the 'url_encoded_fmt_stream_map'
2013-10-25 16:52:58 +02:00
Philipp Hagemeister
6803655ced
Merge pull request #1622 from rbrito/fix-extension
...
extractor: youtube: Set extension of AAC audio formats to m4a.
2013-10-22 15:16:26 -07:00
Jaime Marquínez Ferrándiz
f6a54188c2
[youtube] Use 'node is None' when checking if the video has automatic captions
...
It had stopped working and it reports a FutureWarning
2013-10-21 16:28:55 +02:00
Rogério Brito
d5a9bb4ea9
extractor: youtube: Swap video dimensions to match standard practice.
...
While working on this, I thought about simplifying things like changing
480x854 to 480p, and that seemed like a good option, until I realized that
people (me included) usually link the concept of some number followed by a p
with the video being 16:9.
So, we would be losing some information and, as we all know,
[explicit is better than implicit][*].
[*]: http://www.python.org/dev/peps/pep-0020/
This closes #1446 .
Signed-off-by: Rogério Brito <rbrito@ime.usp.br>
2013-10-19 14:04:44 -03:00
Rogério Brito
f6f1fc9286
extractor: youtube: Fix extension of dash formats.
...
While we are at it, separate the audio formats from the video formats.
Signed-off-by: Rogério Brito <rbrito@ime.usp.br>
2013-10-18 18:53:00 -03:00
Rogério Brito
16f36a6fc9
extractor: youtube: Set extension of AAC audio formats to m4a.
...
This, in particular, eases downloading both audio and videos in DASH formats
before muxing them, which alleviates the problem that I exposed on issue
Furthermore, one may argue that this is, indeed, the case for correctness's
sake.
Signed-off-by: Rogério Brito <rbrito@ime.usp.br>
2013-10-18 17:50:55 -03:00
Philipp Hagemeister
a733eb6c53
[youtube] Do not crash if caption info is missing altogether ( Fixes #1610 )
2013-10-17 02:19:19 +02:00
Jai Grimshaw
1fb07d10a3
[youtube] Adds #1312 Download annotations
...
Adds #1321 Download annotations from youtube
Annotations are downloaded and written to a .annotations.xml file using the https://www.youtube.com/annotations_invideo?features=1&legacy=1&video_id=$VIDEOID API.
Added unit test for annotations.
2013-10-14 16:22:27 +11:00
Philipp Hagemeister
57da92b7df
[youtube] Do not recognize attribution link as user ( Fixes #1573 )
2013-10-09 23:50:38 +02:00
Jaime Marquínez Ferrándiz
a34c2faae4
[youtube] set the 'name' parameter in the subtitles url ( fixes #1577 )
2013-10-09 16:41:36 +02:00
Philipp Hagemeister
15870e90b0
Restore warning when user forgets to quote URL ( #1396 )
2013-10-07 12:21:24 +02:00
Philipp Hagemeister
cfadd183c4
Call extracted property age_limit everywhere
2013-10-06 16:23:06 +02:00
Philipp Hagemeister
8dbe9899a9
Allow users to specify an age limit ( fixes #1545 )
...
With these changes, users can now restrict what videos are downloaded by the intented audience, by specifying their age with --age-limit YEARS .
Add rudimentary support in youtube, pornotube, and youporn.
2013-10-06 06:08:56 +02:00
Philipp Hagemeister
7f8ae73a5d
Include length in player cache ID
...
Some videos use the same player with IDs of multiple lengths.
See https://travis-ci.org/rg3/youtube-dl/jobs/12126506#L319 for an example.
2013-10-04 11:36:06 +02:00
Philipp Hagemeister
c21315f273
[youtube] new static 82 signature
2013-10-04 00:43:01 +02:00
Philipp Hagemeister
c38b1e776d
[youtube] Simplify cache_dir code ( #1529 )
2013-10-02 08:41:14 +02:00
Philipp Hagemeister
4f8bf17f23
Merge remote-tracking branch 'holomorph/master'
2013-10-02 08:23:53 +02:00
Philipp Hagemeister
ca40186c75
[youtube] Fix static 82 signature ( Closes #1539 )
2013-10-02 08:20:00 +02:00
Philipp Hagemeister
a8c6b24155
[youtube] Support videos without a title ( Fixes #1391 , Closes #1542 )
2013-10-02 07:25:35 +02:00
Filippo Valsorda
bd8e5c7ca2
Merge pull request #1531 from rg3/no-playlist
...
[youtube] implement --no-playlist to only download current video
2013-10-01 10:08:20 -07:00
Filippo Valsorda
7c61bd36bb
[youtube] correct --no-playlist for python3
2013-10-01 11:58:13 -04:00
Philipp Hagemeister
44d466559e
Properly handle stream meap not being present
2013-10-01 14:44:09 +02:00
Philipp Hagemeister
f10503db67
Handle videos without url_encoded_fmt_stream_map ( Fixes #1535 )
2013-10-01 11:39:11 +02:00
Mark Oteiza
fa55675593
Support XDG base directory specification
2013-09-30 18:22:38 -04:00
Filippo Valsorda
47192f92d8
implement --no-playlist to only download current video - closes #755
2013-09-30 16:26:25 -04:00
Jaime Marquínez Ferrándiz
9abb32045a
[youtube] Add hlsvp to the error message if it can't be found and remove the live stream test
...
It's no longer available, other olympics streams have the same problem.
2013-09-27 15:06:27 +02:00
Jaime Marquínez Ferrándiz
f490e77e77
[youtube] Set the thumbnail to None if it can't be extracted
2013-09-27 14:22:36 +02:00
Jaime Marquínez Ferrándiz
2dc592991a
[youtube] update description of test
2013-09-27 14:20:52 +02:00
Philipp Hagemeister
920de7a27d
[youtube] Fix 83 signature ( Closes #1511 )
2013-09-27 06:15:21 +02:00
Philipp Hagemeister
695dc094ab
Merge branch 'automatic-signatures'
2013-09-24 21:40:08 +02:00
Philipp Hagemeister
f2c327fd39
Fix 86 signature ( #1494 )
2013-09-24 21:20:42 +02:00
Philipp Hagemeister
e35e4ddc9a
Fix output of --youtube-print-sig-code when counting down to 0
2013-09-24 21:18:03 +02:00
Philipp Hagemeister
c3c88a2664
Allow opts.cachedir == None to disable cache
2013-09-24 21:04:43 +02:00
Jaime Marquínez Ferrándiz
bb0eee71e7
[youtube] Update one of the test's description
2013-09-24 21:04:13 +02:00
Jaime Marquínez Ferrándiz
6f56389b88
[youtube] update algos for length 86 and 84 ( fixes #1494 )
2013-09-24 21:02:00 +02:00
Philipp Hagemeister
c705320f48
Correct test strings
2013-09-22 12:18:16 +02:00
Philipp Hagemeister
d2d8f89531
Do not warn if fallback is without alternatives (because we did not get the flash player URL)
2013-09-22 12:18:10 +02:00
Philipp Hagemeister
bdde940e90
[youtube] Improve flash player URL handling
2013-09-22 12:17:42 +02:00
Philipp Hagemeister
13dc64ce74
[youtube] Remove _decrypt_signature_age_gate
2013-09-22 11:17:21 +02:00
Philipp Hagemeister
f8061589e6
[youtube] Actually pass in cachedir option
2013-09-22 10:51:33 +02:00
Philipp Hagemeister
0ca96d48c7
[youtube] Improve source code quality
2013-09-22 10:37:23 +02:00
Philipp Hagemeister
4ba146f35d
Update static signatures
2013-09-22 10:31:25 +02:00
Philipp Hagemeister
edf3e38ebd
[youtube] Improve cache and add an option to print the extracted signatures
2013-09-22 10:30:02 +02:00
Philipp Hagemeister
c4417ddb61
[youtube] Add filesystem signature cache
2013-09-22 00:35:03 +02:00
Philipp Hagemeister
2f2ffea9ca
Clarify a couple of calls
2013-09-21 15:34:29 +02:00
Philipp Hagemeister
ba552f542f
Use reader instead of indexing
2013-09-21 15:32:37 +02:00
Philipp Hagemeister
8379969834
Prepare signature function caching
2013-09-21 15:19:48 +02:00
Philipp Hagemeister
95dbd2f990
Change test target (Verified with node.js)
2013-09-21 15:10:38 +02:00
Philipp Hagemeister
a7177865b1
Implement more opcodes
2013-09-21 14:48:12 +02:00
Philipp Hagemeister
e0df6211cc
Restore accidentally deleted commits
...
That's what happens if you let Windows machines write :(
2013-09-21 14:40:35 +02:00
Jaime Marquínez Ferrándiz
38d025b3f0
[youtube] add algo for length 91
2013-09-20 14:43:16 +02:00
patrickslin
bc4b900898
Unable to decrypt signature length 93 ( fixes #1461 )
2013-09-19 21:49:06 -07:00
Jaime Marquínez Ferrándiz
71c82637e7
[youtube] apply the fix for lists with number of videos multiple of _MAX_RESULTS to user extraction
...
Copied from the playlist extractor.
2013-09-18 23:00:32 +02:00
Jaime Marquínez Ferrándiz
4a67aafb7e
[youtube] Don't search the flash player version for videos with age gate activated
2013-09-17 20:59:55 +02:00
Philipp Hagemeister
6ae8ee3f54
Update 85 signature ( Fixes #1449 )
...
This is the first signature algorithm to have been parsed automatically, although that only works for HTML5 players for now, and is not yet integrated into master.
2013-09-17 16:59:13 +02:00
Jaime Marquínez Ferrándiz
e69ae5b9e7
[youtube] support youtube.googleapis.com/v/* urls ( fixes #1425 )
2013-09-15 12:14:59 +02:00
Jaime Marquínez Ferrándiz
ce85f022d2
[youtube] update algo for length 82 ( fixes #1416 )
2013-09-12 22:04:09 +02:00
Jaime Marquínez Ferrándiz
e3dc22ca3a
[youtube] Fix detection of videos with automatic captions
2013-09-11 19:24:56 +02:00
Jaime Marquínez Ferrándiz
d665f8d3cb
[subtitles] Also list the available automatic captions languages with '--list-sub'
2013-09-11 19:17:30 +02:00
Jaime Marquínez Ferrándiz
055e6f3657
[youtube] Support automatic captions with original language different from English ( fixes #1225 ) and download in multiple languages.
2013-09-11 19:08:43 +02:00
Jaime Marquínez Ferrándiz
7fad1c6328
[subtitles] Use self._download_webpage for extracting the subtitles
...
It raises ExtractorError for the same exceptions we have to catch.
2013-09-11 16:24:47 +02:00
Jaime Marquínez Ferrándiz
d82134c339
[subtitles] Simplify the extraction of subtitles in subclasses and remove NoAutoSubtitlesInfoExtractor
...
Subclasses just need to call the method extract_subtitles, which will call _extract_subtitles and _request_automatic_caption
Now the default implementation of _request_automatic_caption returns {}.
2013-09-11 16:05:49 +02:00
Jaime Marquínez Ferrándiz
54d39d8b2f
[subtitles] rename SubitlesIE to SubtitlesInfoExtractor
...
Otherwise it can be automatically detected as a IE ready for use.
2013-09-11 15:51:04 +02:00
Jaime Marquínez Ferrándiz
de7f3446e0
[youtube] move subtitles methods from the base extractor to YoutubeIE
2013-09-11 15:48:23 +02:00
Ismael Mejia
f8e52269c1
[subtitles] made inheritance hierarchy flat as requested
2013-09-11 15:21:09 +02:00
Ismael Mejia
cf1dd0c59e
Merge branch 'master' into subtitles_rework
2013-09-11 14:26:48 +02:00
Jaime Marquínez Ferrándiz
aa8f2641da
[youtube] update algo for length 85 ( fixes #1408 and fixes #1406 )
2013-09-11 11:24:58 +02:00
Jaime Marquínez Ferrándiz
8963d9c266
[youtube] Modify the regex to match ids of length 11 ( fixes #1396 )
...
In urls like http://www.youtube.com/watch?v=BaW_jenozKcsharePLED17F32AD9753930 you can't split the query string and ids always have that length.
2013-09-09 10:33:12 +02:00
Jaime Marquínez Ferrándiz
890f62e868
Revert "[youtube] Fix detection of tags from HLS videos."
...
They have undo the change
This reverts commit 0638ad9999
.
2013-09-08 18:50:07 +02:00
Ismael Mejia
72836fcee4
Merge branch 'master' into subtitles_rework
2013-09-06 23:24:41 +02:00
Ismael Mejia
d6e203b3dc
[subtitles] fixed multiple subtitles language separated by comma after merge
...
As mentioned in the pull request, I forgot to include this changes.
aa6a10c44a
2013-09-06 16:30:13 +02:00
Jaime Marquínez Ferrándiz
e3ea479087
[youtube] Fix some issues with the detection of playlist/channel urls (reported in #1374 )
...
They were being caught by YoutubeUserIE, now it only extracts a url if the rest of extractors aren't suitable.
Now the url tests check that the urls can only be extracted with an specific extractor.
2013-09-06 16:24:24 +02:00
Jaime Marquínez Ferrándiz
faab1d3836
[youtube] Fix detection of feeds urls ( fixes #1294 )
...
Urls like https://www.youtube.com/feed/watch_later were being as users (before the last changes to YoutubeUserIE, as videos)
2013-09-06 14:45:49 +02:00
Jaime Marquínez Ferrándiz
fd9cf73836
[youtube] Users: download from the api in json to simplify extraction ( fixes #1358 )
...
There could be duplicate videos or other videos if the description have links.
2013-09-06 10:43:02 +02:00
Jaime Marquínez Ferrándiz
0638ad9999
[youtube] Fix detection of tags from HLS videos.
2013-09-06 10:25:31 +02:00
patrickslin
1cf911bc82
Vevo sig changed again, please update for us! Thanks very much! ( fixes #1375 )
2013-09-05 17:38:03 -07:00
Jaime Marquínez Ferrándiz
f4b052321b
[youtube] Urls like youtube.com/NASA are now interpreted as users ( fixes #1069 )
...
Video urls like http://youtube.com/BaW_jenozKc are not valid, but http://youtu.be/BaW_jenozKc is correct.
2013-09-05 22:39:15 +02:00
Jaime Marquínez Ferrándiz
c215217e39
[youtube] Playlists: extract the videos id from ['media$group']['yt$videoid'] ( fixes #1374 )
...
'media$player' is not defined for private videos.
2013-09-05 21:40:04 +02:00
Allan Zhou
96fb5605b2
AHLS -> Apple HTTP Live Streaming
2013-09-03 18:49:35 -07:00
Allan Zhou
85f03346eb
Merge remote-tracking branch 'upstream/master'
2013-08-30 17:51:59 -07:00
Allan Zhou
bdc6b3fc64
add support for "-f mp4" for YouTube
2013-08-30 17:51:50 -07:00
Jaime Marquínez Ferrándiz
2e756879f1
[youtube] update algo for length 86
2013-08-30 20:49:51 +02:00
Jaime Marquínez Ferrándiz
c7a7750d3b
[youtube] Fix typo in the _VALID_URL for YoutubeFavouritesIE, it was intended to also match :ytfavourites
2013-08-30 20:13:05 +02:00
Jaime Marquínez Ferrándiz
23b00bc0e4
[youtube] update algo for length 84
...
Only appears sometimes, nearly identical to length 86.
2013-08-29 22:44:29 +02:00
Jaime Marquínez Ferrándiz
52e1eea18b
[youtube] update algo for length 86 ( fixes #1349 )
2013-08-29 22:33:58 +02:00
Jaime Marquínez Ferrándiz
c7bf7366bc
Update descriptions checksum for some test for Unistra and Youtube
2013-08-29 13:41:59 +02:00
Jaime Marquínez Ferrándiz
3e223834d9
[youtube] update algo for length 88, thanks to @Ramhack ( fixes #1328 )
2013-08-28 10:26:44 +02:00