Specific Qtube Request Won't Appear on the Process Queue

Black Hole

Black Hole

May contain traces of nut
What's going on here?

I tried to set a Radio 4 programme to download in the background, but it didn't appear in the queue. I tried refreshing the queue display, nothing. I set a couple of YouTube videos to download, and they appeared in the queue. Then I tried the R4 prog again - nothing.

Then I ran it immediate with the -F option, and first it failed to download a manifest (with some error message about running the latest yt-dl or reporting the error) but succeeded when I retried.

Tried to queue it again, nothing. The process options string is the same as I have always used for audio downloads.

Am I correct in thinking there is no pre-processing before submitting the job to the queue, and if there are any errors they will only show up once the queue gets around to running it?

4162664F-D3FF-46E6-9F8C-8B3E401D4CE6.jpeg

E708381C-BD3A-4655-87BA-A688B574CC97.jpeg
 
Wait a minute. Why do the queue task IDs skip 8352? That's where the original submission should have been. Why does the submission in the screen shot say ID 7911?
 
Oh for Pete's sake.

:oops:

It isn't being queued because there is a matching entry already in the queue:

1A70E8B3-0910-413E-B0EC-6AF62E74AB4C.jpeg

I thought I had forgotten to download the programme, because it hasn't been downloaded. But for some reason it is actually still pending (no idea why). I'll try the "resubmit" button.
 
Resubmit sorted it.

Looking through qtube.log, I see the programme was indeed downloaded in its entirety on 22nd August, and was converted to MP3, but for some reason the queue status didn't change to complete:

Code: 
22/08/2022 17:15:09 - ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
22/08/2022 17:15:09 - Starting queued download URL https://www.bbc.co.uk/programmes/m0013jdn Options -x --audio-format mp3 QID 7911
22/08/2022 17:15:37 - [bbc.co.uk] m0013jdn: Downloading video page
22/08/2022 17:15:53 - [bbc.co.uk] m0013jdn: Downloading playlist JSON
22/08/2022 17:15:53 - [bbc.co.uk] m0013jdm: Downloading media selection JSON
22/08/2022 17:15:54 - [bbc.co.uk] m0013jdm: Downloading MPD manifest
22/08/2022 17:15:55 - [bbc.co.uk] m0013jdm: Downloading MPD manifest
22/08/2022 17:15:55 - [bbc.co.uk] m0013jdm: Downloading m3u8 information
22/08/2022 17:15:55 - [bbc.co.uk] m0013jdm: Downloading m3u8 information
22/08/2022 17:15:56 - [bbc.co.uk] m0013jdm: Downloading MPD manifest
22/08/2022 17:15:56 - [bbc.co.uk] m0013jdm: Downloading MPD manifest
22/08/2022 17:15:56 - [bbc.co.uk] m0013jdm: Downloading m3u8 information
22/08/2022 17:15:57 - [bbc.co.uk] m0013jdm: Downloading m3u8 information
22/08/2022 17:16:04 - [dashsegments] Total fragments: 132
22/08/2022 17:16:04 - [download] Destination: /mnt/hd2/My Video/NatureBang_Cockatoos_and_the_Power_of_the_Beat.m4a
22/08/2022 17:16:04 - [download]   0.8% of ~82.11KiB at 126.36KiB/s ETA 01:14
22/08/2022 17:16:04 - [download]   0.8% of ~82.11KiB at 126.36KiB/s ETA 01:14
22/08/2022 17:16:05 - [download]   0.0% of ~16.12MiB at 100.37KiB/s ETA 03:23:59
.
.
.
22/08/2022 17:18:21 - [download]  99.2% of ~31.88MiB at 491.96KiB/s ETA 00:01
22/08/2022 17:18:21 - [download]  99.2% of ~31.88MiB at 491.96KiB/s ETA 00:01
22/08/2022 17:18:22 - [download] 100.0% of ~31.64MiB at 392.32KiB/s ETA 00:00
22/08/2022 17:18:22 - [download] 100.0% of ~31.64MiB at 428.51KiB/s ETA 00:00
22/08/2022 17:18:22 - [download] 100.0% of ~31.64MiB at 208.36KiB/s ETA 00:00
22/08/2022 17:18:22 - [download] 100.0% of ~31.64MiB at 208.36KiB/s ETA 00:00
22/08/2022 17:18:22 - [download] 100% of 31.64MiB in 02:18
22/08/2022 17:18:23 - [ffmpeg] Correcting container in "/mnt/hd2/My Video/NatureBang_Cockatoos_and_the_Power_of_the_Beat.m4a"
22/08/2022 17:18:35 - [ffmpeg] Destination: /mnt/hd2/My Video/NatureBang_Cockatoos_and_the_Power_of_the_Beat.mp3
22/08/2022 17:53:08 - Deleting original file /mnt/hd2/My Video/NatureBang_Cockatoos_and_the_Power_of_the_Beat.m4a (pass -k to keep)
22/08/2022 17:53:09 - Completed queued download of https://www.bbc.co.uk/programmes/m0013jdn Options -x --audio-format mp3

Here's where I did a manual -F, with the first attempt failing. The error report might be of use to somebody(is the "Gateway Timeout" anything like has been reported in another thread about iPlayer download problems?):

Code: 
09:17:32 - --------------------------------------------------------------
09:17:32 - Starting immediate download of https://www.bbc.co.uk/programmes/m0013jdn Options -F
09:18:05 - [bbc.co.uk] m0013jdn: Downloading video page
09:18:06 - [bbc.co.uk] m0013jdn: Downloading playlist JSON
09:19:07 - Caught error: ERROR: Unable to download JSON metadata: HTTP Error 504: Gateway Time-out (caused by HTTPError()); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see  https://yt-dl.org/update  on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
09:20:35 - --------------------------------------------------------------
09:20:35 - Starting immediate download of https://www.bbc.co.uk/programmes/m0013jdn Options -F
09:21:08 - [bbc.co.uk] m0013jdn: Downloading video page
09:21:10 - [bbc.co.uk] m0013jdn: Downloading playlist JSON
09:21:11 - [bbc.co.uk] m0013jdm: Downloading media selection JSON
09:21:11 - [bbc.co.uk] m0013jdm: Downloading MPD manifest
09:21:13 - [bbc.co.uk] m0013jdm: Downloading MPD manifest
09:21:13 - [bbc.co.uk] m0013jdm: Downloading m3u8 information
09:21:13 - [bbc.co.uk] m0013jdm: Downloading m3u8 information
09:21:14 - [bbc.co.uk] m0013jdm: Downloading MPD manifest
09:21:14 - [bbc.co.uk] m0013jdm: Downloading MPD manifest
09:21:15 - [bbc.co.uk] m0013jdm: Downloading m3u8 information
09:21:15 - [bbc.co.uk] m0013jdm: Downloading m3u8 information
09:21:16 - [info] Available formats for m0013jdm:
09:21:16 - format code                                extension  resolution note
09:21:16 - mf_akamai_nonbidi-audio_eng_1=48000-0      m4a        audio only [en] DASH audio   48k , m4a_dash container, mp4a.40.5 (48000Hz)
09:21:16 - mf_akamai_nonbidi-audio_eng_1=48000-1      m4a        audio only [en] DASH audio   48k , m4a_dash container, mp4a.40.5 (48000Hz)
09:21:16 - mf_cloudfront_nonbidi-audio_eng_1=48000-0  m4a        audio only [en] DASH audio   48k , m4a_dash container, mp4a.40.5 (48000Hz)
09:21:16 - mf_cloudfront_nonbidi-audio_eng_1=48000-1  m4a        audio only [en] DASH audio   48k , m4a_dash container, mp4a.40.5 (48000Hz)
09:21:16 - mf_akamai_nonbidi-audio_eng_1=96000-0      m4a        audio only [en] DASH audio   96k , m4a_dash container, mp4a.40.5 (48000Hz)
09:21:16 - mf_akamai_nonbidi-audio_eng_1=96000-1      m4a        audio only [en] DASH audio   96k , m4a_dash container, mp4a.40.5 (48000Hz)
09:21:16 - mf_cloudfront_nonbidi-audio_eng_1=96000-0  m4a        audio only [en] DASH audio   96k , m4a_dash container, mp4a.40.5 (48000Hz)
09:21:16 - mf_cloudfront_nonbidi-audio_eng_1=96000-1  m4a        audio only [en] DASH audio   96k , m4a_dash container, mp4a.40.5 (48000Hz)
09:21:16 - mf_akamai_nonbidi-audio_eng=128000-0       m4a        audio only [en] DASH audio  128k , m4a_dash container, mp4a.40.2 (48000Hz)
09:21:16 - mf_akamai_nonbidi-audio_eng=128000-1       m4a        audio only [en] DASH audio  128k , m4a_dash container, mp4a.40.2 (48000Hz)
09:21:16 - mf_cloudfront_nonbidi-audio_eng=128000-0   m4a        audio only [en] DASH audio  128k , m4a_dash container, mp4a.40.2 (48000Hz)
09:21:16 - mf_cloudfront_nonbidi-audio_eng=128000-1   m4a        audio only [en] DASH audio  128k , m4a_dash container, mp4a.40.2 (48000Hz)
09:21:16 - mf_akamai_nonbidi-136-0                    mp4        audio only  136k , mp4a.40.2@128k
09:21:16 - mf_akamai_nonbidi-136-1                    mp4        audio only  136k , mp4a.40.2@128k
09:21:16 - mf_cloudfront_nonbidi-136-0                mp4        audio only  136k , mp4a.40.2@128k
09:21:16 - mf_cloudfront_nonbidi-136-1                mp4        audio only  136k , mp4a.40.2@128k
09:21:16 - mf_akamai_nonbidi-audio_eng=320000-0       m4a        audio only [en] DASH audio  320k , m4a_dash container, mp4a.40.2 (48000Hz)
09:21:16 - mf_akamai_nonbidi-audio_eng=320000-1       m4a        audio only [en] DASH audio  320k , m4a_dash container, mp4a.40.2 (48000Hz)
09:21:16 - mf_cloudfront_nonbidi-audio_eng=320000-0   m4a        audio only [en] DASH audio  320k , m4a_dash container, mp4a.40.2 (48000Hz)
09:21:16 - mf_cloudfront_nonbidi-audio_eng=320000-1   m4a        audio only [en] DASH audio  320k , m4a_dash container, mp4a.40.2 (48000Hz) (best)
09:21:16 - Completed immediate download of https://www.bbc.co.uk/programmes/m0013jdn Options -F

...and then after the resubmit, it does it all over again:

Code: 
26/08/2022 13:02:40 - ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
26/08/2022 13:02:40 - Starting queued download URL https://www.bbc.co.uk/programmes/m0013jdn Options -x --audio-format mp3 QID 7911
26/08/2022 13:03:10 - [bbc.co.uk] m0013jdn: Downloading video page
26/08/2022 13:03:11 - [bbc.co.uk] m0013jdn: Downloading playlist JSON
26/08/2022 13:03:12 - [bbc.co.uk] m0013jdm: Downloading media selection JSON
26/08/2022 13:03:12 - [bbc.co.uk] m0013jdm: Downloading MPD manifest
26/08/2022 13:03:13 - [bbc.co.uk] m0013jdm: Downloading MPD manifest
26/08/2022 13:03:14 - [bbc.co.uk] m0013jdm: Downloading m3u8 information
26/08/2022 13:03:14 - [bbc.co.uk] m0013jdm: Downloading m3u8 information
26/08/2022 13:03:14 - [bbc.co.uk] m0013jdm: Downloading MPD manifest
26/08/2022 13:03:15 - [bbc.co.uk] m0013jdm: Downloading MPD manifest
26/08/2022 13:03:15 - [bbc.co.uk] m0013jdm: Downloading m3u8 information
26/08/2022 13:03:15 - [bbc.co.uk] m0013jdm: Downloading m3u8 information
26/08/2022 13:03:22 - [dashsegments] Total fragments: 132
26/08/2022 13:03:22 - [download] Destination: /mnt/hd2/My Video/NatureBang_Cockatoos_and_the_Power_of_the_Beat.m4a
26/08/2022 13:03:23 - [download]   0.8% of ~82.11KiB at 44.29KiB/s ETA 01:14
26/08/2022 13:03:23 - [download]   0.8% of ~82.11KiB at 44.29KiB/s ETA 01:14
26/08/2022 13:03:23 - [download]   0.0% of ~16.12MiB at 42.26KiB/s ETA 02:39:55
.
.
.
26/08/2022 13:05:24 - [download] 100.0% of ~31.64MiB at 500.04KiB/s ETA 00:00
26/08/2022 13:05:24 - [download] 100.0% of ~31.64MiB at 300.00KiB/s ETA 00:00
26/08/2022 13:05:24 - [download] 100.0% of ~31.64MiB at 183.70KiB/s ETA 00:00
26/08/2022 13:05:24 - [download] 100.0% of ~31.64MiB at 183.70KiB/s ETA 00:00
26/08/2022 13:05:24 - [download] 100% of 31.64MiB in 02:02
26/08/2022 13:05:25 - [ffmpeg] Correcting container in "/mnt/hd2/My Video/NatureBang_Cockatoos_and_the_Power_of_the_Beat.m4a"
26/08/2022 13:05:38 - [ffmpeg] Destination: /mnt/hd2/My Video/NatureBang_Cockatoos_and_the_Power_of_the_Beat.mp3
26/08/2022 13:40:20 - Deleting original file /mnt/hd2/My Video/NatureBang_Cockatoos_and_the_Power_of_the_Beat.m4a (pass -k to keep)
26/08/2022 13:40:21 - Completed queued download of https://www.bbc.co.uk/programmes/m0013jdn Options -x --audio-format mp3

Presuming the MP3 file existed (I was relying on the queue to tell me the job had been done), should ffmpeg have been able to over-write it without a warning or renaming the output?
 
Code: 
22/08/2022 17:53:09 - Completed queued download of https://www.bbc.co.uk/programmes/m0013jdn Options -x --audio-format mp3
Issuing that log message is the last thing that qtube does before returning OK so it is difficult to see how it could fail to mark the entry Complete.

Are there any messages in auto.log for that time period (it should have a copy of the completed message) - perhaps a database access error for queue.db
 
Last edited:
Code: 
22/08/2022 17:15:09 - De-queuing 7911 - qtube - https://www.bbc.co.uk/programmes/m0013jdn
22/08/2022 17:15:09 - qtube:Starting queued download URL https://www.bbc.co.uk/programmes/m0013jdn Options -x --audio-format mp3 QID 7911
22/08/2022 17:15:09 - qtube:See /mod/tmp/qtube.log for details
22/08/2022 17:53:09 - qtube:Completed queued download of https://www.bbc.co.uk/programmes/m0013jdn Options -x --audio-format mp3
22/08/2022 17:53:09 -     OK - Check qtube.log -

It looks normal. "Just one of those things", I guess.
 
You must log in or register to reply here.
Back
Top