lkho
bf7392922f
[duboku] fix list results, minor error checking
2020-08-30 15:53:07 +08:00
David Bauer
c70a9f2ace
[hrfernsehen] add extractor
...
Add an extractor for videos provided by HR Fernsehen, a regional TV
channel in Germany.
Signed-off-by: David Bauer <mail@david-bauer.net>
2020-08-29 20:21:49 +02:00
lkho
7cc9d5b321
[duboku] replace import *, fix tests
2020-08-29 16:25:42 +08:00
lkho
a8f88d2fec
[duboku] fix test_no_duplicates
2020-08-29 15:44:56 +08:00
lkho
d82b6697c2
[duboku] add tests
2020-08-29 15:33:57 +08:00
lkho
de4144a4ae
[duboku] add playlist extractor
2020-08-29 15:33:57 +08:00
lkho
503406d4bc
[duboku] Add new extractor www.duboku.co
2020-08-29 15:33:57 +08:00
Hugo Alves De Azevedo
377be41755
- fixing suitable
2020-08-28 15:21:52 -03:00
Hugo Alves De Azevedo
c2baf165e4
- formatting
2020-08-28 14:40:03 -03:00
Hugo Alves De Azevedo
39672cdc79
- formatting
2020-08-28 14:25:37 -03:00
tfvlrue
ba39289d79
Resolve audio/x-wav to "wav" extension, rather than "x-wav" (which ffmpeg does not recognize)
...
This was causing ffmpeg errors when trying to downloading certain audio files from Soundcloud with the --add-metadata option set.
2020-08-28 12:00:30 -04:00
Hugo Alves De Azevedo
2adf91f94f
- removing unused method
2020-08-28 10:03:13 -03:00
Hugo Alves De Azevedo
4d75c363a7
- adding alura support
2020-08-28 10:02:31 -03:00
Leonardo Taccari
8067a2b8b4
[la7] Fix extraction ( closes #23323 )
...
Parsing `videoParams' or `videoLa7' JavaScript snippets as JSON is getting too
hard for js_to_json. Just extract the `vid' from there and use _search_og_*
for all other data.
Remove the 2nd test: unfortunately the page are removed after a couple of
days/weeks.
Thanks to Elia Geretto for spotting and suggesting several problems with the
tests!
Closes #23323 .
2020-08-28 12:09:29 +02:00
Leonardo Taccari
abea91456e
[rai] Fix extraction for recent raiplay.it updates
...
- Introduce _BASE_URL in RaiBaseIE class so it could be reused as base for the
several subextractors.
- Remove first test of RaiPlayIE, it is no longer available
- Adjust RaiPlayIE to recent raiplay.it updates, make it extension agnostic
(passing possible `.json' URLs is now supported too) and update test
info_dict.
- Adjust RaiPlayLiveIE to recent raiplay.it updates. Passing it as
`url_transparent' is no longer supported (there is no longer an accessible
ContentItem)
- Adjust RaiPlayPlaylistIE to recent raiplay.it updates and instruct it about
ContentSet-s.
- Update a RaiIE test and remove two tests that are no longer availables
This fix issue #22923 , #22906 and supersedes #23006 .
2020-08-28 12:07:31 +02:00
George Schizas
9f13f9d18a
Merge branch 'master' of https://github.com/ytdl-org/youtube-dl into bugfix/youtube/chapters-fix-extractor
2020-08-28 11:31:29 +03:00
Remita Amine
f5863a3ea0
[biqle] improve video_ext extraction
2020-08-27 19:20:41 +01:00
Aakash Gajjar
19a107f21c
Revert "pull changes from remote master ( #190 )" ( #193 )
...
This reverts commit b827ee921f
2020-08-26 20:22:32 +05:30
Aakash Gajjar
7f7edf837c
Revert "pull changes from remote master ( #191 )" ( #192 )
...
This reverts commit 63cdbe6ae8
2020-08-26 20:21:29 +05:30
Hugo Alves De Azevedo
74dc105210
- adding alura support
2020-08-25 22:39:20 -03:00
Aakash Gajjar
63cdbe6ae8
pull changes from remote master ( #191 )
...
* [scrippsnetworks] Add new extractor(closes #19857 )(closes #22981 )
* [teachable] Improve locked lessons detection (#23528 )
* [teachable] Fail with error message if no video URL found
* [extractors] add missing import for ScrippsNetworksIE
* [brightcove] cache brightcove player policy keys
* [prosiebensat1] improve geo restriction handling(closes #23571 )
* [soundcloud] automatically update client id on failing requests
* [spankbang] Fix extraction (closes #23307 , closes #23423 , closes #23444 )
* [spankbang] Improve removed video detection (#23423 )
* [brightcove] update policy key on failing requests
* [pornhub] Fix extraction and add support for m3u8 formats (closes #22749 , closes #23082 )
* [pornhub] Improve locked videos detection (closes #22449 , closes #22780 )
* [brightcove] invalidate policy key cache on failing requests
* [soundcloud] fix client id extraction for non fatal requests
* [ChangeLog] Actualize
[ci skip]
* [devscripts/create-github-release] Switch to using PAT for authentication
Basic authentication will be deprecated soon
* release 2020.01.01
* [redtube] Detect private videos (#23518 )
* [vice] improve extraction(closes #23631 )
* [devscripts/create-github-release] Remove unused import
* [wistia] improve format extraction and extract subtitles(closes #22590 )
* [nrktv:seriebase] Fix extraction (closes #23625 ) (#23537 )
* [discovery] fix anonymous token extraction(closes #23650 )
* [scrippsnetworks] add support for www.discovery.com videos
* [scrippsnetworks] correct test case URL
* [dctp] fix format extraction(closes #23656 )
* [pandatv] Remove extractor (#23630 )
* [naver] improve extraction
- improve geo-restriction handling
- extract automatic captions
- extract uploader metadata
- extract VLive HLS formats
* [naver] improve metadata extraction
* [cloudflarestream] improve extraction
- add support for bytehighway.net domain
- add support for signed URLs
- extract thumbnail
* [cloudflarestream] import embed URL extraction
* [lego] fix extraction and extract subtitle(closes #23687 )
* [safari] Fix kaltura session extraction (closes #23679 ) (#23670 )
* [orf:fm4] Fix extraction (#23599 )
* [orf:radio] Clean description and improve extraction
* [twitter] add support for promo_video_website cards(closes #23711 )
* [vodplatform] add support for embed.kwikmotion.com domain
* [ndr:base:embed] Improve thumbnails extraction (closes #23731 )
* [canvas] Add support for new API endpoint and update tests (closes #17680 , closes #18629 )
* [travis] Add flake8 job (#23720 )
* [yourporn] Fix extraction (closes #21645 , closes #22255 , closes #23459 )
* [ChangeLog] Actualize
[ci skip]
* release 2020.01.15
* [soundcloud] Restore previews extraction (closes #23739 )
* [orf:tvthek] Improve geo restricted videos detection (closes #23741 )
* [zype] improve extraction
- extract subtitles(closes #21258 )
- support URLs with alternative keys/tokens(#21258 )
- extract more metadata
* [americastestkitchen] fix extraction
* [nbc] add support for nbc multi network URLs(closes #23049 )
* [ard] improve extraction(closes #23761 )
- simplify extraction
- extract age limit and series
- bypass geo-restriction
* [ivi:compilation] Fix entries extraction (closes #23770 )
* [24video] Add support for 24video.vip (closes #23753 )
* [businessinsider] Fix jwplatform id extraction (closes #22929 ) (#22954 )
* [ard] add a missing condition
* [azmedien] fix extraction(closes #23783 )
* [voicerepublic] fix extraction
* [stretchinternet] fix extraction(closes #4319 )
* [youtube] Fix sigfunc name extraction (closes #23819 )
* [ChangeLog] Actualize
[ci skip]
* release 2020.01.24
* [soundcloud] imporve private playlist/set tracks extraction
https://github.com/ytdl-org/youtube-dl/issues/3707#issuecomment-577873539
* [svt] fix article extraction(closes #22897 )(closes #22919 )
* [svt] fix series extraction(closes #22297 )
* [viewlift] improve extraction
- fix extraction(closes #23851 )
- add add support for authentication
- add support for more domains
* [vimeo] fix album extraction(closes #23864 )
* [tva] Relax _VALID_URL (closes #23903 )
* [tv5mondeplus] Fix extraction (closes #23907 , closes #23911 )
* [twitch:stream] Lowercase channel id for stream request (closes #23917 )
* [sportdeutschland] Update to new sportdeutschland API
They switched to SSL, but under a different host AND path...
Remove the old test cases because these videos have become unavailable.
* [popcorntimes] Add extractor (closes #23949 )
* [thisoldhouse] fix extraction(closes #23951 )
* [toggle] Add support for mewatch.sg (closes #23895 ) (#23930 )
* [compat] Introduce compat_realpath (refs #23991 )
* [update] Fix updating via symlinks (closes #23991 )
* [nytimes] improve format sorting(closes #24010 )
* [abc:iview] Support 720p (#22907 ) (#22921 )
* [nova:embed] Fix extraction (closes #23672 )
* [nova:embed] Improve (closes #23690 )
* [nova] Improve extraction (refs #23690 )
* [jpopsuki] Remove extractor (closes #23858 )
* [YoutubeDL] Fix playlist entry indexing with --playlist-items (closes #10591 , closes #10622 )
* [test_YoutubeDL] Fix get_ids
* [test_YoutubeDL] Add tests for #10591 (closes #23873 )
* [24video] Add support for porn.24video.net (closes #23779 , closes #23784 )
* [npr] Add support for streams (closes #24042 )
* [ChangeLog] Actualize
[ci skip]
* release 2020.02.16
* [tv2dk:bornholm:play] Fix extraction (#24076 )
* [imdb] Fix extraction (closes #23443 )
* [wistia] Add support for multiple generic embeds (closes #8347 , closes #11385 )
* [teachable] Add support for multiple videos per lecture (closes #24101 )
* [pornhd] Fix extraction (closes #24128 )
* [options] Remove duplicate short option -v for --version (#24162 )
* [extractor/common] Convert ISM manifest to unicode before processing on python 2 (#24152 )
* [YoutubeDL] Force redirect URL to unicode on python 2
* Remove no longer needed compat_str around geturl
* [youjizz] Fix extraction (closes #24181 )
* [test_subtitles] Remove obsolete test
* [zdf:channel] Fix tests
* [zapiks] Fix test
* [xtube] Fix metadata extraction (closes #21073 , closes #22455 )
* [xtube:user] Fix test
* [telecinco] Fix extraction (refs #24195 )
* [telecinco] Add support for article opening videos
* [franceculture] Fix extraction (closes #24204 )
* [xhamster] Fix extraction (closes #24205 )
* [ChangeLog] Actualize
[ci skip]
* release 2020.03.01
* [vimeo] Fix subtitles URLs (#24209 )
* [servus] Add support for new URL schema (closes #23475 , closes #23583 , closes #24142 )
* [youtube:playlist] Fix tests (closes #23872 ) (#23885 )
* [peertube] Improve extraction
* [peertube] Fix issues and improve extraction (closes #23657 )
* [pornhub] Improve title extraction (closes #24184 )
* [vimeo] fix showcase password protected video extraction(closes #24224 )
* [youtube] Fix age-gated videos support without login (closes #24248 )
* [youtube] Fix tests
* [ChangeLog] Actualize
[ci skip]
* release 2020.03.06
* [nhk] update API version(closes #24270 )
* [youtube] Improve extraction in 429 error conditions (closes #24283 )
* [youtube] Improve age-gated videos extraction in 429 error conditions (refs #24283 )
* [youtube] Remove outdated code
Additional get_video_info requests don't seem to provide any extra itags any longer
* [README.md] Clarify 429 error
* [pornhub] Add support for pornhubpremium.com (#24288 )
* [utils] Add support for cookies with spaces used instead of tabs
* [ChangeLog] Actualize
[ci skip]
* release 2020.03.08
* Revert "[utils] Add support for cookies with spaces used instead of tabs"
According to [1] TABs must be used as separators between fields.
Files produces by some tools with spaces as separators are considered
malformed.
1. https://curl.haxx.se/docs/http-cookies.html
This reverts commit cff99c91d1closes #24224 )"
This reverts commit 12ee431676#24329 )
* [nhk] Remove obsolete rtmp formats (closes #24329 )
* [nhk] Update m3u8 URL and use native hls (#24329 )
* [ndr] Fix extraction (closes #24326 )
* [xtube] Fix formats extraction (closes #24348 )
* [xtube] Fix typo
* [hellporno] Fix extraction (closes #24399 )
* [cbc:watch] Add support for authentication
* [cbc:watch] Fix authenticated device token caching (closes #19160 )
* [soundcloud] fix download url extraction(closes #24394 )
* [limelight] remove disabled API requests(closes #24255 )
* [bilibili] Add support for new URL schema with BV ids (closes #24439 , closes #24442 )
* [bilibili] Add support for player.bilibili.com (closes #24402 )
* [teachable] Extract chapter metadata (closes #24421 )
* [generic] Look for teachable embeds before wistia
* [teachable] Update upskillcourses domain
New version does not use teachable platform any longer
* [teachable] Update gns3 domain
* [teachable] Update test
* [ChangeLog] Actualize
[ci skip]
* [ChangeLog] Actualize
[ci skip]
* release 2020.03.24
* [spankwire] Fix extraction (closes #18924 , closes #20648 )
* [spankwire] Add support for generic embeds (refs #24633 )
* [youporn] Add support form generic embeds
* [mofosex] Add support for generic embeds (closes #24633 )
* [tele5] Fix extraction (closes #24553 )
* [extractor/common] Skip malformed ISM manifest XMLs while extracting ISM formats (#24667 )
* [tv4] Fix ISM formats extraction (closes #24667 )
* [twitch:clips] Extend _VALID_URL (closes #24290 ) (#24642 )
* [motherless] Fix extraction (closes #24699 )
* [nova:embed] Fix extraction (closes #24700 )
* [youtube] Skip broken multifeed videos (closes #24711 )
* [soundcloud] Extract AAC format
* [soundcloud] Improve AAC format extraction (closes #19173 , closes #24708 )
* [thisoldhouse] Fix video id extraction (closes #24548 )
Added support for:
with of without "www."
and either ".chorus.build" or ".com"
It now validated correctly on older URL's
```
<iframe src="https://thisoldhouse.chorus.build/videos/zype/5e33baec27d2e50001d5f52f
```
and newer ones
```
<iframe src="https://www.thisoldhouse.com/videos/zype/5e2b70e95216cc0001615120
```
* [thisoldhouse] Improve video id extraction (closes #24549 )
* [youtube] Fix DRM videos detection (refs #24736 )
* [options] Clarify doc on --exec command (closes #19087 ) (#24883 )
* [prosiebensat1] Improve extraction and remove 7tv.de support (#24948 )
* [prosiebensat1] Extract series metadata
* [tenplay] Relax _VALID_URL (closes #25001 )
* [tvplay] fix Viafree extraction(closes #15189 )(closes #24473 )(closes #24789 )
* [yahoo] fix GYAO Player extraction and relax title URL regex(closes #24178 )(closes #24778 )
* [youtube] Use redirected video id if any (closes #25063 )
* [youtube] Improve player id extraction and add tests
* [extractor/common] Extract multiple JSON-LD entries
* [crunchyroll] Fix and improve extraction (closes #25096 , closes #25060 )
* [ChangeLog] Actualize
[ci skip]
* release 2020.05.03
* [puhutv] Remove no longer available HTTP formats (closes #25124 )
* [utils] Improve cookie files support
+ Add support for UTF-8 in cookie files
* Skip malformed cookie file entries instead of crashing (invalid entry len, invalid expires at)
* [dailymotion] Fix typo
* [compat] Introduce compat_cookiejar_Cookie
* [extractor/common] Use compat_cookiejar_Cookie for _set_cookie (closes #23256 , closes #24776 )
To always ensure cookie name and value are bytestrings on python 2.
* [orf] Add support for more radio stations (closes #24938 ) (#24968 )
* [uol] fix extraction(closes #22007 )
* [downloader/http] Finish downloading once received data length matches expected
Always do this if possible, i.e. if Content-Length or expected length is known, not only in test.
This will save unnecessary last extra loop trying to read 0 bytes.
* [downloader/http] Request last data block of exact remaining size
Always request last data block of exact size remaining to download if possible not the current block size.
* [iprima] Improve extraction (closes #25138 )
* [youtube] Improve signature cipher extraction (closes #25188 )
* [ChangeLog] Actualize
[ci skip]
* release 2020.05.08
* [spike] fix Bellator mgid extraction(closes #25195 )
* [bbccouk] PEP8
* [mailru] Fix extraction (closes #24530 ) (#25239 )
* [README.md] flake8 HTTPS URL (#25230 )
* [youtube] Add support for yewtu.be (#25226 )
* [soundcloud] reduce API playlist page limit(closes #25274 )
* [vimeo] improve format extraction and sorting(closes #25285 )
* [redtube] Improve title extraction (#25208 )
* [indavideo] Switch to HTTPS for API request (#25191 )
* [utils] Fix file permissions in write_json_file (closes #12471 ) (#25122 )
* [redtube] Improve formats extraction and extract m3u8 formats (closes #25311 , closes #25321 )
* [ard] Improve _VALID_URL (closes #25134 ) (#25198 )
* [giantbomb] Extend _VALID_URL (#25222 )
* [postprocessor/ffmpeg] Embed series metadata with --add-metadata
* [youtube] Add support for more invidious instances (#25417 )
* [ard:beta] Extend _VALID_URL (closes #25405 )
* [ChangeLog] Actualize
[ci skip]
* release 2020.05.29
* [jwplatform] Improve embeds extraction (closes #25467 )
* [periscope] Fix untitled broadcasts (#25482 )
* [twitter:broadcast] Add untitled periscope broadcast test
* [malltv] Add support for sk.mall.tv (#25445 )
* [brightcove] Fix subtitles extraction (closes #25540 )
* [brightcove] Sort imports
* [twitch] Pass v5 accept header and fix thumbnails extraction (closes #25531 )
* [twitch:stream] Fix extraction (closes #25528 )
* [twitch:stream] Expect 400 and 410 HTTP errors from API
* [tele5] Prefer jwplatform over nexx (closes #25533 )
* [jwplatform] Add support for bypass geo restriction
* [tele5] Bypass geo restriction
* [ChangeLog] Actualize
[ci skip]
* release 2020.06.06
* [kaltura] Add support for multiple embeds on a webpage (closes #25523 )
* [youtube] Extract chapters from JSON (closes #24819 )
* [facebook] Support single-video ID links
I stumbled upon this at https://www.facebook.com/bwfbadminton/posts/10157127020046316 . No idea how prevalent it is yet.
* [youtube] Fix playlist and feed extraction (closes #25675 )
* [youtube] Fix thumbnails extraction and remove uploader id extraction warning (closes #25676 )
* [youtube] Fix upload date extraction
* [youtube] Improve view count extraction
* [youtube] Fix uploader id and uploader URL extraction
* [ChangeLog] Actualize
[ci skip]
* release 2020.06.16
* [youtube] Fix categories and improve tags extraction
* [youtube] Force old layout (closes #25682 , closes #25683 , closes #25680 , closes #25686 )
* [ChangeLog] Actualize
[ci skip]
* release 2020.06.16.1
* [brightcove] Improve embed detection (closes #25674 )
* [bellmedia] add support for cp24.com clip URLs(closes #25764 )
* [youtube:playlists] Extend _VALID_URL (closes #25810 )
* [youtube] Prevent excess HTTP 301 (#25786 )
* [wistia] Restrict embed regex (closes #25969 )
* [youtube] Improve description extraction (closes #25937 ) (#25980 )
* [youtube] Fix sigfunc name extraction (closes #26134 , closes #26135 , closes #26136 , closes #26137 )
* [ChangeLog] Actualize
[ci skip]
* release 2020.07.28
* [xhamster] Extend _VALID_URL (closes #25789 ) (#25804 )
* [xhamster] Fix extraction (closes #26157 ) (#26254 )
* [xhamster] Extend _VALID_URL (closes #25927 )
Co-authored-by: Remita Amine <remitamine@gmail.com>
Co-authored-by: Sergey M․ <dstftw@gmail.com>
Co-authored-by: nmeum <soeren+github@soeren-tempel.net>
Co-authored-by: Roxedus <me@roxedus.dev>
Co-authored-by: Singwai Chan <c.singwai@gmail.com>
Co-authored-by: cdarlint <cdarlint@users.noreply.github.com>
Co-authored-by: Johannes N <31795504+jonolt@users.noreply.github.com>
Co-authored-by: jnozsc <jnozsc@gmail.com>
Co-authored-by: Moritz Patelscheck <moritz.patelscheck@campus.tu-berlin.de>
Co-authored-by: PB <3854688+uno20001@users.noreply.github.com>
Co-authored-by: Philipp Hagemeister <phihag@phihag.de>
Co-authored-by: Xaver Hellauer <software@hellauer.bayern>
Co-authored-by: d2au <d2au.dev@gmail.com>
Co-authored-by: Jan 'Yenda' Trmal <jtrmal@gmail.com>
Co-authored-by: jxu <7989982+jxu@users.noreply.github.com>
Co-authored-by: Martin Ström <name@my-domain.se>
Co-authored-by: The Hatsune Daishi <nao20010128@gmail.com>
Co-authored-by: tsia <github@tsia.de>
Co-authored-by: 3risian <59593325+3risian@users.noreply.github.com>
Co-authored-by: Tristan Waddington <tristan.waddington@gmail.com>
Co-authored-by: Devon Meunier <devon.meunier@gmail.com>
Co-authored-by: Felix Stupp <felix.stupp@outlook.com>
Co-authored-by: tom <tomster954@gmail.com>
Co-authored-by: AndrewMBL <62922222+AndrewMBL@users.noreply.github.com>
Co-authored-by: willbeaufoy <will@willbeaufoy.net>
Co-authored-by: Philipp Stehle <anderschwiedu@googlemail.com>
Co-authored-by: hh0rva1h <61889859+hh0rva1h@users.noreply.github.com>
Co-authored-by: comsomisha <shmelev1996@mail.ru>
Co-authored-by: TotalCaesar659 <14265316+TotalCaesar659@users.noreply.github.com>
Co-authored-by: Juan Francisco Cantero Hurtado <iam@juanfra.info>
Co-authored-by: Dave Loyall <dave@the-good-guys.net>
Co-authored-by: tlsssl <63866177+tlsssl@users.noreply.github.com>
Co-authored-by: Rob <ankenyr@gmail.com>
Co-authored-by: Michael Klein <github@a98shuttle.de>
Co-authored-by: JordanWeatherby <47519158+JordanWeatherby@users.noreply.github.com>
Co-authored-by: striker.sh <19488257+strikersh@users.noreply.github.com>
Co-authored-by: Matej Dujava <mdujava@gmail.com>
Co-authored-by: Glenn Slayden <5589855+glenn-slayden@users.noreply.github.com>
Co-authored-by: MRWITEK <mrvvitek@gmail.com>
Co-authored-by: JChris246 <43832407+JChris246@users.noreply.github.com>
Co-authored-by: TheRealDude2 <the.real.dude@gmx.de>
2020-08-25 20:27:15 +05:30
Aakash Gajjar
b827ee921f
pull changes from remote master ( #190 )
...
* [scrippsnetworks] Add new extractor(closes #19857 )(closes #22981 )
* [teachable] Improve locked lessons detection (#23528 )
* [teachable] Fail with error message if no video URL found
* [extractors] add missing import for ScrippsNetworksIE
* [brightcove] cache brightcove player policy keys
* [prosiebensat1] improve geo restriction handling(closes #23571 )
* [soundcloud] automatically update client id on failing requests
* [spankbang] Fix extraction (closes #23307 , closes #23423 , closes #23444 )
* [spankbang] Improve removed video detection (#23423 )
* [brightcove] update policy key on failing requests
* [pornhub] Fix extraction and add support for m3u8 formats (closes #22749 , closes #23082 )
* [pornhub] Improve locked videos detection (closes #22449 , closes #22780 )
* [brightcove] invalidate policy key cache on failing requests
* [soundcloud] fix client id extraction for non fatal requests
* [ChangeLog] Actualize
[ci skip]
* [devscripts/create-github-release] Switch to using PAT for authentication
Basic authentication will be deprecated soon
* release 2020.01.01
* [redtube] Detect private videos (#23518 )
* [vice] improve extraction(closes #23631 )
* [devscripts/create-github-release] Remove unused import
* [wistia] improve format extraction and extract subtitles(closes #22590 )
* [nrktv:seriebase] Fix extraction (closes #23625 ) (#23537 )
* [discovery] fix anonymous token extraction(closes #23650 )
* [scrippsnetworks] add support for www.discovery.com videos
* [scrippsnetworks] correct test case URL
* [dctp] fix format extraction(closes #23656 )
* [pandatv] Remove extractor (#23630 )
* [naver] improve extraction
- improve geo-restriction handling
- extract automatic captions
- extract uploader metadata
- extract VLive HLS formats
* [naver] improve metadata extraction
* [cloudflarestream] improve extraction
- add support for bytehighway.net domain
- add support for signed URLs
- extract thumbnail
* [cloudflarestream] import embed URL extraction
* [lego] fix extraction and extract subtitle(closes #23687 )
* [safari] Fix kaltura session extraction (closes #23679 ) (#23670 )
* [orf:fm4] Fix extraction (#23599 )
* [orf:radio] Clean description and improve extraction
* [twitter] add support for promo_video_website cards(closes #23711 )
* [vodplatform] add support for embed.kwikmotion.com domain
* [ndr:base:embed] Improve thumbnails extraction (closes #23731 )
* [canvas] Add support for new API endpoint and update tests (closes #17680 , closes #18629 )
* [travis] Add flake8 job (#23720 )
* [yourporn] Fix extraction (closes #21645 , closes #22255 , closes #23459 )
* [ChangeLog] Actualize
[ci skip]
* release 2020.01.15
* [soundcloud] Restore previews extraction (closes #23739 )
* [orf:tvthek] Improve geo restricted videos detection (closes #23741 )
* [zype] improve extraction
- extract subtitles(closes #21258 )
- support URLs with alternative keys/tokens(#21258 )
- extract more metadata
* [americastestkitchen] fix extraction
* [nbc] add support for nbc multi network URLs(closes #23049 )
* [ard] improve extraction(closes #23761 )
- simplify extraction
- extract age limit and series
- bypass geo-restriction
* [ivi:compilation] Fix entries extraction (closes #23770 )
* [24video] Add support for 24video.vip (closes #23753 )
* [businessinsider] Fix jwplatform id extraction (closes #22929 ) (#22954 )
* [ard] add a missing condition
* [azmedien] fix extraction(closes #23783 )
* [voicerepublic] fix extraction
* [stretchinternet] fix extraction(closes #4319 )
* [youtube] Fix sigfunc name extraction (closes #23819 )
* [ChangeLog] Actualize
[ci skip]
* release 2020.01.24
* [soundcloud] imporve private playlist/set tracks extraction
https://github.com/ytdl-org/youtube-dl/issues/3707#issuecomment-577873539
* [svt] fix article extraction(closes #22897 )(closes #22919 )
* [svt] fix series extraction(closes #22297 )
* [viewlift] improve extraction
- fix extraction(closes #23851 )
- add add support for authentication
- add support for more domains
* [vimeo] fix album extraction(closes #23864 )
* [tva] Relax _VALID_URL (closes #23903 )
* [tv5mondeplus] Fix extraction (closes #23907 , closes #23911 )
* [twitch:stream] Lowercase channel id for stream request (closes #23917 )
* [sportdeutschland] Update to new sportdeutschland API
They switched to SSL, but under a different host AND path...
Remove the old test cases because these videos have become unavailable.
* [popcorntimes] Add extractor (closes #23949 )
* [thisoldhouse] fix extraction(closes #23951 )
* [toggle] Add support for mewatch.sg (closes #23895 ) (#23930 )
* [compat] Introduce compat_realpath (refs #23991 )
* [update] Fix updating via symlinks (closes #23991 )
* [nytimes] improve format sorting(closes #24010 )
* [abc:iview] Support 720p (#22907 ) (#22921 )
* [nova:embed] Fix extraction (closes #23672 )
* [nova:embed] Improve (closes #23690 )
* [nova] Improve extraction (refs #23690 )
* [jpopsuki] Remove extractor (closes #23858 )
* [YoutubeDL] Fix playlist entry indexing with --playlist-items (closes #10591 , closes #10622 )
* [test_YoutubeDL] Fix get_ids
* [test_YoutubeDL] Add tests for #10591 (closes #23873 )
* [24video] Add support for porn.24video.net (closes #23779 , closes #23784 )
* [npr] Add support for streams (closes #24042 )
* [ChangeLog] Actualize
[ci skip]
* release 2020.02.16
* [tv2dk:bornholm:play] Fix extraction (#24076 )
* [imdb] Fix extraction (closes #23443 )
* [wistia] Add support for multiple generic embeds (closes #8347 , closes #11385 )
* [teachable] Add support for multiple videos per lecture (closes #24101 )
* [pornhd] Fix extraction (closes #24128 )
* [options] Remove duplicate short option -v for --version (#24162 )
* [extractor/common] Convert ISM manifest to unicode before processing on python 2 (#24152 )
* [YoutubeDL] Force redirect URL to unicode on python 2
* Remove no longer needed compat_str around geturl
* [youjizz] Fix extraction (closes #24181 )
* [test_subtitles] Remove obsolete test
* [zdf:channel] Fix tests
* [zapiks] Fix test
* [xtube] Fix metadata extraction (closes #21073 , closes #22455 )
* [xtube:user] Fix test
* [telecinco] Fix extraction (refs #24195 )
* [telecinco] Add support for article opening videos
* [franceculture] Fix extraction (closes #24204 )
* [xhamster] Fix extraction (closes #24205 )
* [ChangeLog] Actualize
[ci skip]
* release 2020.03.01
* [vimeo] Fix subtitles URLs (#24209 )
* [servus] Add support for new URL schema (closes #23475 , closes #23583 , closes #24142 )
* [youtube:playlist] Fix tests (closes #23872 ) (#23885 )
* [peertube] Improve extraction
* [peertube] Fix issues and improve extraction (closes #23657 )
* [pornhub] Improve title extraction (closes #24184 )
* [vimeo] fix showcase password protected video extraction(closes #24224 )
* [youtube] Fix age-gated videos support without login (closes #24248 )
* [youtube] Fix tests
* [ChangeLog] Actualize
[ci skip]
* release 2020.03.06
* [nhk] update API version(closes #24270 )
* [youtube] Improve extraction in 429 error conditions (closes #24283 )
* [youtube] Improve age-gated videos extraction in 429 error conditions (refs #24283 )
* [youtube] Remove outdated code
Additional get_video_info requests don't seem to provide any extra itags any longer
* [README.md] Clarify 429 error
* [pornhub] Add support for pornhubpremium.com (#24288 )
* [utils] Add support for cookies with spaces used instead of tabs
* [ChangeLog] Actualize
[ci skip]
* release 2020.03.08
* Revert "[utils] Add support for cookies with spaces used instead of tabs"
According to [1] TABs must be used as separators between fields.
Files produces by some tools with spaces as separators are considered
malformed.
1. https://curl.haxx.se/docs/http-cookies.html
This reverts commit cff99c91d1closes #24224 )"
This reverts commit 12ee431676#24329 )
* [nhk] Remove obsolete rtmp formats (closes #24329 )
* [nhk] Update m3u8 URL and use native hls (#24329 )
* [ndr] Fix extraction (closes #24326 )
* [xtube] Fix formats extraction (closes #24348 )
* [xtube] Fix typo
* [hellporno] Fix extraction (closes #24399 )
* [cbc:watch] Add support for authentication
* [cbc:watch] Fix authenticated device token caching (closes #19160 )
* [soundcloud] fix download url extraction(closes #24394 )
* [limelight] remove disabled API requests(closes #24255 )
* [bilibili] Add support for new URL schema with BV ids (closes #24439 , closes #24442 )
* [bilibili] Add support for player.bilibili.com (closes #24402 )
* [teachable] Extract chapter metadata (closes #24421 )
* [generic] Look for teachable embeds before wistia
* [teachable] Update upskillcourses domain
New version does not use teachable platform any longer
* [teachable] Update gns3 domain
* [teachable] Update test
* [ChangeLog] Actualize
[ci skip]
* [ChangeLog] Actualize
[ci skip]
* release 2020.03.24
* [spankwire] Fix extraction (closes #18924 , closes #20648 )
* [spankwire] Add support for generic embeds (refs #24633 )
* [youporn] Add support form generic embeds
* [mofosex] Add support for generic embeds (closes #24633 )
* [tele5] Fix extraction (closes #24553 )
* [extractor/common] Skip malformed ISM manifest XMLs while extracting ISM formats (#24667 )
* [tv4] Fix ISM formats extraction (closes #24667 )
* [twitch:clips] Extend _VALID_URL (closes #24290 ) (#24642 )
* [motherless] Fix extraction (closes #24699 )
* [nova:embed] Fix extraction (closes #24700 )
* [youtube] Skip broken multifeed videos (closes #24711 )
* [soundcloud] Extract AAC format
* [soundcloud] Improve AAC format extraction (closes #19173 , closes #24708 )
* [thisoldhouse] Fix video id extraction (closes #24548 )
Added support for:
with of without "www."
and either ".chorus.build" or ".com"
It now validated correctly on older URL's
```
<iframe src="https://thisoldhouse.chorus.build/videos/zype/5e33baec27d2e50001d5f52f
```
and newer ones
```
<iframe src="https://www.thisoldhouse.com/videos/zype/5e2b70e95216cc0001615120
```
* [thisoldhouse] Improve video id extraction (closes #24549 )
* [youtube] Fix DRM videos detection (refs #24736 )
* [options] Clarify doc on --exec command (closes #19087 ) (#24883 )
* [prosiebensat1] Improve extraction and remove 7tv.de support (#24948 )
* [prosiebensat1] Extract series metadata
* [tenplay] Relax _VALID_URL (closes #25001 )
* [tvplay] fix Viafree extraction(closes #15189 )(closes #24473 )(closes #24789 )
* [yahoo] fix GYAO Player extraction and relax title URL regex(closes #24178 )(closes #24778 )
* [youtube] Use redirected video id if any (closes #25063 )
* [youtube] Improve player id extraction and add tests
* [extractor/common] Extract multiple JSON-LD entries
* [crunchyroll] Fix and improve extraction (closes #25096 , closes #25060 )
* [ChangeLog] Actualize
[ci skip]
* release 2020.05.03
* [puhutv] Remove no longer available HTTP formats (closes #25124 )
* [utils] Improve cookie files support
+ Add support for UTF-8 in cookie files
* Skip malformed cookie file entries instead of crashing (invalid entry len, invalid expires at)
* [dailymotion] Fix typo
* [compat] Introduce compat_cookiejar_Cookie
* [extractor/common] Use compat_cookiejar_Cookie for _set_cookie (closes #23256 , closes #24776 )
To always ensure cookie name and value are bytestrings on python 2.
* [orf] Add support for more radio stations (closes #24938 ) (#24968 )
* [uol] fix extraction(closes #22007 )
* [downloader/http] Finish downloading once received data length matches expected
Always do this if possible, i.e. if Content-Length or expected length is known, not only in test.
This will save unnecessary last extra loop trying to read 0 bytes.
* [downloader/http] Request last data block of exact remaining size
Always request last data block of exact size remaining to download if possible not the current block size.
* [iprima] Improve extraction (closes #25138 )
* [youtube] Improve signature cipher extraction (closes #25188 )
* [ChangeLog] Actualize
[ci skip]
* release 2020.05.08
* [spike] fix Bellator mgid extraction(closes #25195 )
* [bbccouk] PEP8
* [mailru] Fix extraction (closes #24530 ) (#25239 )
* [README.md] flake8 HTTPS URL (#25230 )
* [youtube] Add support for yewtu.be (#25226 )
* [soundcloud] reduce API playlist page limit(closes #25274 )
* [vimeo] improve format extraction and sorting(closes #25285 )
* [redtube] Improve title extraction (#25208 )
* [indavideo] Switch to HTTPS for API request (#25191 )
* [utils] Fix file permissions in write_json_file (closes #12471 ) (#25122 )
* [redtube] Improve formats extraction and extract m3u8 formats (closes #25311 , closes #25321 )
* [ard] Improve _VALID_URL (closes #25134 ) (#25198 )
* [giantbomb] Extend _VALID_URL (#25222 )
* [postprocessor/ffmpeg] Embed series metadata with --add-metadata
* [youtube] Add support for more invidious instances (#25417 )
* [ard:beta] Extend _VALID_URL (closes #25405 )
* [ChangeLog] Actualize
[ci skip]
* release 2020.05.29
* [jwplatform] Improve embeds extraction (closes #25467 )
* [periscope] Fix untitled broadcasts (#25482 )
* [twitter:broadcast] Add untitled periscope broadcast test
* [malltv] Add support for sk.mall.tv (#25445 )
* [brightcove] Fix subtitles extraction (closes #25540 )
* [brightcove] Sort imports
* [twitch] Pass v5 accept header and fix thumbnails extraction (closes #25531 )
* [twitch:stream] Fix extraction (closes #25528 )
* [twitch:stream] Expect 400 and 410 HTTP errors from API
* [tele5] Prefer jwplatform over nexx (closes #25533 )
* [jwplatform] Add support for bypass geo restriction
* [tele5] Bypass geo restriction
* [ChangeLog] Actualize
[ci skip]
* release 2020.06.06
* [kaltura] Add support for multiple embeds on a webpage (closes #25523 )
* [youtube] Extract chapters from JSON (closes #24819 )
* [facebook] Support single-video ID links
I stumbled upon this at https://www.facebook.com/bwfbadminton/posts/10157127020046316 . No idea how prevalent it is yet.
* [youtube] Fix playlist and feed extraction (closes #25675 )
* [youtube] Fix thumbnails extraction and remove uploader id extraction warning (closes #25676 )
* [youtube] Fix upload date extraction
* [youtube] Improve view count extraction
* [youtube] Fix uploader id and uploader URL extraction
* [ChangeLog] Actualize
[ci skip]
* release 2020.06.16
* [youtube] Fix categories and improve tags extraction
* [youtube] Force old layout (closes #25682 , closes #25683 , closes #25680 , closes #25686 )
* [ChangeLog] Actualize
[ci skip]
* release 2020.06.16.1
* [brightcove] Improve embed detection (closes #25674 )
* [bellmedia] add support for cp24.com clip URLs(closes #25764 )
* [youtube:playlists] Extend _VALID_URL (closes #25810 )
* [youtube] Prevent excess HTTP 301 (#25786 )
* [wistia] Restrict embed regex (closes #25969 )
* [youtube] Improve description extraction (closes #25937 ) (#25980 )
* [youtube] Fix sigfunc name extraction (closes #26134 , closes #26135 , closes #26136 , closes #26137 )
* [ChangeLog] Actualize
[ci skip]
* release 2020.07.28
* [xhamster] Extend _VALID_URL (closes #25789 ) (#25804 )
* [xhamster] Fix extraction (closes #26157 ) (#26254 )
* [xhamster] Extend _VALID_URL (closes #25927 )
Co-authored-by: Remita Amine <remitamine@gmail.com>
Co-authored-by: Sergey M․ <dstftw@gmail.com>
Co-authored-by: nmeum <soeren+github@soeren-tempel.net>
Co-authored-by: Roxedus <me@roxedus.dev>
Co-authored-by: Singwai Chan <c.singwai@gmail.com>
Co-authored-by: cdarlint <cdarlint@users.noreply.github.com>
Co-authored-by: Johannes N <31795504+jonolt@users.noreply.github.com>
Co-authored-by: jnozsc <jnozsc@gmail.com>
Co-authored-by: Moritz Patelscheck <moritz.patelscheck@campus.tu-berlin.de>
Co-authored-by: PB <3854688+uno20001@users.noreply.github.com>
Co-authored-by: Philipp Hagemeister <phihag@phihag.de>
Co-authored-by: Xaver Hellauer <software@hellauer.bayern>
Co-authored-by: d2au <d2au.dev@gmail.com>
Co-authored-by: Jan 'Yenda' Trmal <jtrmal@gmail.com>
Co-authored-by: jxu <7989982+jxu@users.noreply.github.com>
Co-authored-by: Martin Ström <name@my-domain.se>
Co-authored-by: The Hatsune Daishi <nao20010128@gmail.com>
Co-authored-by: tsia <github@tsia.de>
Co-authored-by: 3risian <59593325+3risian@users.noreply.github.com>
Co-authored-by: Tristan Waddington <tristan.waddington@gmail.com>
Co-authored-by: Devon Meunier <devon.meunier@gmail.com>
Co-authored-by: Felix Stupp <felix.stupp@outlook.com>
Co-authored-by: tom <tomster954@gmail.com>
Co-authored-by: AndrewMBL <62922222+AndrewMBL@users.noreply.github.com>
Co-authored-by: willbeaufoy <will@willbeaufoy.net>
Co-authored-by: Philipp Stehle <anderschwiedu@googlemail.com>
Co-authored-by: hh0rva1h <61889859+hh0rva1h@users.noreply.github.com>
Co-authored-by: comsomisha <shmelev1996@mail.ru>
Co-authored-by: TotalCaesar659 <14265316+TotalCaesar659@users.noreply.github.com>
Co-authored-by: Juan Francisco Cantero Hurtado <iam@juanfra.info>
Co-authored-by: Dave Loyall <dave@the-good-guys.net>
Co-authored-by: tlsssl <63866177+tlsssl@users.noreply.github.com>
Co-authored-by: Rob <ankenyr@gmail.com>
Co-authored-by: Michael Klein <github@a98shuttle.de>
Co-authored-by: JordanWeatherby <47519158+JordanWeatherby@users.noreply.github.com>
Co-authored-by: striker.sh <19488257+strikersh@users.noreply.github.com>
Co-authored-by: Matej Dujava <mdujava@gmail.com>
Co-authored-by: Glenn Slayden <5589855+glenn-slayden@users.noreply.github.com>
Co-authored-by: MRWITEK <mrvvitek@gmail.com>
Co-authored-by: JChris246 <43832407+JChris246@users.noreply.github.com>
Co-authored-by: TheRealDude2 <the.real.dude@gmx.de>
2020-08-25 20:23:34 +05:30
xarantolus
94255fa0b1
[youtube] More general title extraction
...
Seems like this attribute is moved every few weeks, so we just extract both and use the one that is present.
2020-08-24 14:30:08 +02:00
xarantolus
7d743516b5
[youtube] Make ytcfg.set config extraction non-fatal
...
If the markup of the page changes in the future, it might be possible that _FEED_DATA still works, but the other regex does not. SInce it is not necessary for the first page of videos, we make sure the program doesn't exit before extracting them.
TL;DR: Extract the first video page even if there are problems
2020-08-24 14:29:16 +02:00
Unknown
e7ff46dc8b
flake8
2020-08-19 03:05:38 +02:00
Unknown
0bfc3b7e7b
fix and cheap workaround for unix 404 error.
2020-08-19 03:01:47 +02:00
sxvghd
92d25998f9
[doodstream] flake8 compliance
2020-08-18 00:12:14 +02:00
sxvghd
c00c1575b6
Styling changes
2020-08-17 17:07:22 +02:00
Stephen Stair
8d6df01f04
[StoryFire] Add new extractor
2020-08-16 18:19:44 -07:00
sxvghd
b50f352f59
[doodstream] new extractor
2020-08-16 15:40:59 +02:00
Adrian Heine
5630d79794
[ABC] Support abc.net.au/btn ( closes #21254 )
2020-08-16 01:32:05 +02:00
Adrian Heine
76b01870f8
[ABC] Fix extraction
2020-08-16 01:32:05 +02:00
Adrian Heine
5c23e3af61
[rutv] Fix JSON URL ( closes #26333 )
2020-08-15 23:11:00 +02:00
Surkal
13c30d1d52
[francetv] fix extractor
2020-08-14 13:11:20 +02:00
Sergey M․
10709fc7c6
[xhamster] Extend _VALID_URL ( closes #25927 )
2020-08-12 21:51:50 +07:00
TheRealDude2
a7e348556a
[xhamster] Fix extraction ( closes #26157 ) ( #26254 )
2020-08-12 21:42:17 +07:00
JChris246
6cb30ea5ed
[xhamster] Extend _VALID_URL ( closes #25789 ) ( #25804 )
2020-08-12 21:37:22 +07:00
Adrian Heine
34675f9de9
[videa] Adapt to updates
...
Closes #26288 , closes #25973 , closes #25650 .
2020-08-12 13:36:47 +02:00
George Schizas
edd83104b4
Use initial data from JS instead to get chapters
...
There are probably a lot more useful data in there.
2020-08-11 12:20:47 +03:00
Aakash Gajjar
89cee32ce9
fix(tiktok): update title getter
...
Signed-off-by: Aakash Gajjar <skyqutip@gmail.com>
2020-08-11 12:02:23 +05:30
siikamiika
15eae44d74
harden regex with lookbehind
2020-08-11 00:13:43 +03:00
siikamiika
eaedbfd97e
fix ytInitialData parsing
2020-08-11 00:05:32 +03:00
Alfonso Solbes
92b6dc13f3
[MyVideoGe] add new extractor
2020-08-10 17:58:10 +02:00
Unknown
1a57b3c03f
flake8 fix.
2020-08-07 01:50:00 +02:00
Unknown
c68a4ae679
auth fix.
2020-08-07 01:28:23 +02:00
Unknown
a58f3e7777
flake8
2020-08-06 23:58:43 +02:00
Unknown
fb4126a18c
working login. aac hq is working if available
2020-08-06 23:31:12 +02:00
Unknown
2ab47fa3a8
updated test. sign in sc.py
2020-08-06 15:41:41 +02:00
Adrian Heine
3d85256855
[magentamusik360] Add new extractor
2020-08-06 14:01:23 +02:00
Unknown
09cace68c2
hard web auth.
2020-08-06 00:47:37 +02:00
