[youtube-dl] Download files from youtube.com or other video platforms

Did you actually install the qtube package or the youtube-dl package? You should install the former really if you want it in the WebIf, and it'll then install the latter as a dependency. The latter is command line only.
 
Upgraded to 2021.06.06c, rebooted Humax (twice) but am still getting this :-
Code: 
Humax HDR-Fox T2 (Humax1) 1.03.12/3.13

Humax1# youtube-dl --version
2021.03.03
Humax1#

opkg list-installed
. . . .
webif-charts - 1.3
webshell - 1.0.4
wget - 1.20.3
wireless-tools - 29-1
youtube-dl - 2021.06.06c
zip - 3.0-1
Humax1#
 
Last edited:
Uninstall / re-Install did the job, I'm guessing it was 2021.06.06c but was displaying 2021.03.03 in error - Thanks
 
prpr said:
A link might be helpful, if you discover something needs doing. It doesn't happen by osmosis.
Click to expand...
Yes it would. But - I’m not sure that the way I’m updating a Windows version is the same way you are updating Humaxes with CF. I know I have to play follow the links to find what I’m looking for. I don’t understand github! As an excuse (cough) I didn’t want to give a misleading link.
 
/df said:
Where? In my proof of concept version. Not that I was being deliberately obtuse but the BBC extractor needs some modifications to access a different Mediator and it's not obvious how to implement those without breaking normal operation. In fact even the normal operation is controversial as to whether multiple Mediator requests are acceptable to produce a wider range of formats.

For a proof of concept, this should do:
Code: 
--- /home/df/Documents/src/youtube-dl/youtube_dl/extractor/bbc.py
+++ /home/df/Documents/src/youtube-dl/youtube_dl/extractor/bbc.py.hak
@@ -57,13 +57,10 @@
     _LOGIN_URL = 'https://account.bbc.com/signin'
     _NETRC_MACHINE = 'bbc'
 
-    _MEDIA_SELECTOR_URL_TEMPL = 'https://open.live.bbc.co.uk/mediaselector/6/select/version/2.0/mediaset/%s/vpid/%s'
+    _MEDIA_SELECTOR_URL_TEMPL = 'https://securegate.iplayer.bbc.co.uk/mediaselector/6/select/version/2.0/mediaset/%s/vpid/%s'
     _MEDIA_SETS = [
-        # Provides HQ HLS streams with even better quality that pc mediaset but fails
-        # with geolocation in some cases when it's even not geo restricted at all (e.g.
-        # http://www.bbc.co.uk/programmes/b06bp7lf). Also may fail with selectionunavailable.
-        'iptv-all',
-        'pc',
+        'legacy-iptv-all',
+        'iptv-uhd',
     ]
 
     _EMP_PLAYLIST_NS = 'http://bbc.co.uk/2008/emp/playlist'
However this won't produce anything without the certificate.

To be integrated properly, the extraction should fall back to the normal Mediator if no certificate is given or extraction using the certificate fails.
Click to expand...
I am trying to get this to work on PC using youtube-dl PR youtube-dl/pull/29590
I have hdrfoxt2_20201202.pem from iplfix ipk iplfix_1.0_mipsel.opk
openssl pkcs12 -in hdrfoxt2_20201202.p12 -out hdrfoxt2_20201202.pem -nodes
Click to expand...
I am only able to see 960x540 from ''legacy-iptv-all'. iptv-uhd alone provides no results
ERROR: bbc.co.uk returned error: selectionunavailable
Click to expand...
enabling 'iptv-all' gives me 720p5500k which is regular web iplayer quality
The certificate code is working because if I don't supply that argument I get:
sslv3 alert handshake failure
Click to expand...
 
magnets said:
I am trying to get this to work on PC
Click to expand...
It strikes me you're fishing in the wrong pool. I realise the configuration files might be applicable on another platform, but surely the youtube-dl-on-PC brigade will be further ahead with this?
 
In this case it makes no difference as I'd be answering either way (the PR is mine).

Taking as an example Blue Planet II s01e01 which has id p04thmv7 and vpid p06mqywx, we get (rates in kbit/s):
Code: 
Availability for VPID: p06mqywx

iptv-all    8490
legacy-iptv-all    576    1732    3000    8490
iptv-uhd    23803008
For this to work you need both PR 29590 and the modified BBC extractor with securegate and the appropriate media selector; also if more than one media selector is mentioned, depending on the order, you may need a patch that carries on extracting formats after one media selector has provided formats.

What show are you testing with? (probably better to carry this on in a separate thread ...)
 
Having problems with ITV hub again. It was working on Sunday evening but since Monday it has been failing. I am using the the latest available version (2021.06.06e) with the modification for ITV hub as suggested by @/df using 'fakehttp' to allow subtitles to be downloaded. It starts to download the first webpage but does not succeed. I have also tried with an unmodified installation to no avail.
Edit.
Output from the QTube log is pasted below (the download fails however the download is submitted, QTube or Telnet). The original run looks like the failure is due to the download file not being available. Later runs don't proceed past the initial attempt to open the webpage.

Code: 
First attempt:
4970    17/01/2022 06:05:10 - -code 1 -level 0 -errorinfo {lambda.finalizer /mod/webif/plugin/qtube/queue.hook 29} -errorcode {CHILDSTATUS 18725 1}
4969    17/01/2022 06:05:10 - Caught error: ERROR: Unable to download webpage: HTTP Error 404: Not Found (caused by HTTPError()); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see  https://yt-dl.org/update  on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
4968    17/01/2022 06:05:07 - [ITV] 1a7314a00015: Downloading webpage
4967    17/01/2022 06:04:35 - Starting queued download URL https://www.itv.com/hub/vera/1a7314a00015 Options  QID 3551
4966    17/01/2022 06:04:35 - ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

Later attempt:
4988    17/01/2022 16:58:33 - [ITV] 1a7314a00015: Downloading webpage
4987    17/01/2022 16:58:03 - Starting queued download URL https://www.itv.com/hub/vera/1a7314a00015 Options  QID 3551
4986    17/01/2022 16:58:03 - +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
 
Last edited:
Meanwhile, an ITV extractor bug was found and fixed in the pending PR where a duration h:mm:ss:nnn was interpreted as d:hh:mm:sss and thus caused the file size for the 2Mbit/s version of the above episode to be estimated as 50GiB vs 1.8GiB.
 
/df said:
Are you hoping to get Vera S04E01 https://www.itv.com/hub/vera/1a7314a0015, which can be fetched with the patched extractor? The page with URL https://www.itv.com/hub/vera/1a7314a00015 reports "404 Episode not available", and that's what yt-dl sees when it looks.

Otherwise please paste output from youtube-dl -F -v whateverURL.
Click to expand...
I've tried a few different files to no avail, the download fails when it tries to extract information from the requested webpage. I you do this in a regular browser (e.g. Chrome or Opera for Android) you are asked to log in and then you can play the file on that device. I tried adding user credentials to the youtube-dl command line (--username --password) but to no avail.
/df said:
Meanwhile, an ITV extractor bug was found and fixed in the pending PR where a duration h:mm:ss:nnn was interpreted as d:hh:mm:sss and thus caused the file size for the 2Mbit/s version of the above episode to be estimated as 50GiB vs 1.8GiB.
Click to expand...
I don't know if this is the cause, but it began to happen in the early hours of Monday morning: I left a few files in the QTube download queue overnight. The first few worked and then the downloads started to fail in the early morning.
 
You must log in or register to reply here.
Back
Top