I've been using detectads with chaseget for a while now, and it's been great. However, last night I was recording the whole series of the IT Crowd as they were broadcasting it back to back and today discovered that one of the episodes is missing. I checked the activity.log and chaseget.log, and they seem normal for every episode. Is there anywhere I could see where/when/what caused the program to be deleted? I have now installed undelete to hopefully stop the same thing from happening again in the future
Programme 'deleted' by DetectAds?
- Thread starter adamskrz
- Start date
MymsMan
Ad detector
Have you checked detectads.log for any clues?
Have you checked [Deleted Items]/detectads for any sign of the original recording
Detectads should only move the original to the bin when it is about to rename the cropped file.
Bad idea,
The dustbin is your only hope of retrieving an incorrectly deleted recording, without it they go straight to the bit bucket
Black Hole
May contain traces of nut
You mean it was a bad idea not to have installed it before.
MymsMan
Ad detector
Yes,
For some reason I had read it as uninstalled undelete which would be a bad idea
I've been trying to make sense of the log. At the end of the process, it seems to remove each video file - surely it should be replacing it with ad-detected version; from reading the wiki, it's clear that there's at least the input file and the decrypted file in existence when chaserun processing, are these just not logged? At first I thought that that was what happened (it's the 2338 that went missing), but then I saw that it does that to every program. Can anyone help explain the process?
| 971 | Removed /media/My Video/The IT Crowd/The IT Crowd_20200606_0009.hmt<br> |
| 970 | Removed /media/My Video/The IT Crowd/The IT Crowd_20200606_0009.nts<br> |
| 969 | Removed /media/My Video/The IT Crowd/The IT Crowd_20200606_0009.ts<br> |
| 968 | Removed /mod/tmp/The IT Crowd_20200606_0009-inp.hmt<br> |
| 967 | Removed /mod/tmp/The IT Crowd_20200606_0009-inp.nts<br> |
| 966 | Removed /mod/tmp/The IT Crowd_20200606_0009-inp.ts<br> |
| 965 | 06/06/2020 00:38:38 DA(6034)- done...processed /media/My Video/The IT Crowd/The IT Crowd_20200606_0009.ts in 1581.653s 00:26:22 - 3 ad breaks detected |
| 964 | 06/06/2020 00:38:36 DA(6034)- /media/My Video/The IT Crowd/The IT Crowd_20200606_0009.ts deleted |
| 963 | 06/06/2020 00:38:35 DA(6034)- Final bookmarks: 7 619 855 1715 1741 |
| 962 | 06/06/2020 00:38:35 DA(6034)- ad break found 28:35-29:01 (1715 - 1741) Frames: 42863 - 43515 |
| 961 | 06/06/2020 00:38:29 DA(7277)- ==DETECTADS Chase Run: /media/My Video/The IT Crowd/The IT Crowd_20200606_0038.ts |
| 960 | 06/06/2020 00:38:29 RM(7271)- DETECTADS: Started /media/My Video/The IT Crowd/The IT Crowd_20200606_0038.ts for chaserun advert detection |
| 959 | 06/06/2020 00:38:28 RM(7271)- DETECTADS: Checking /media/My Video/The IT Crowd/The IT Crowd_20200606_0038.ts (Channel 4 HD) for channel exclusion |
| 958 | 06/06/2020 00:24:54 DA(6034)- ad break found 10:19-14:15 (619 - 855) Frames: 15480 - 21373 |
| 957 | 06/06/2020 00:13:12 DA(6034)- ad break found 0:00-0:07 (0 - 7) Frames: 1 - 171 |
| 956 | Removed /media/My Video/The IT Crowd/The IT Crowd_20200605_2338.hmt<br> |
| 955 | Removed /media/My Video/The IT Crowd/The IT Crowd_20200605_2338.nts<br> |
| 954 | Removed /media/My Video/The IT Crowd/The IT Crowd_20200605_2338.ts<br> |
| 953 | Removed /mod/tmp/The IT Crowd_20200605_2338-inp.hmt<br> |
| 952 | Removed /mod/tmp/The IT Crowd_20200605_2338-inp.nts<br> |
| 951 | Removed /mod/tmp/The IT Crowd_20200605_2338-inp.ts<br> |
| 950 | 06/06/2020 00:09:25 DA(4720)- done...processed /media/My Video/The IT Crowd/The IT Crowd_20200605_2338.ts in 1657.451s 00:27:37 - 3 ad breaks detected |
| 949 | 06/06/2020 00:09:20 DA(4720)- /media/My Video/The IT Crowd/The IT Crowd_20200605_2338.ts deleted |
| 948 | 06/06/2020 00:09:20 DA(6034)- ==DETECTADS Chase Run: /media/My Video/The IT Crowd/The IT Crowd_20200606_0009.ts |
| 947 | 06/06/2020 00:09:19 RM(6021)- DETECTADS: Started /media/My Video/The IT Crowd/The IT Crowd_20200606_0009.ts for chaserun advert detection |
| 946 | 06/06/2020 00:09:19 DA(4720)- Final bookmarks: 19 772 1007 1710 1821 |
| 945 | 06/06/2020 00:09:19 DA(4720)- ad break found 28:30-30:21 (1710 - 1821) Frames: 42746 - 45523 |
| 944 | 06/06/2020 00:09:19 RM(6021)- DETECTADS: Checking /media/My Video/The IT Crowd/The IT Crowd_20200606_0009.ts (Channel 4 HD) for channel exclusion |
| 943 | 05/06/2020 23:57:31 DA(4720)- ad break found 12:52-16:47 (772 - 1007) Frames: 19311 - 25177 |
| 942 | 05/06/2020 23:43:57 DA(4720)- ad break found 0:00-0:19 (0 - 19) Frames: 1 - 467 |
| 941 | Removed /media/My Video/The IT Crowd/The IT Crowd_20200605_2309.hmt<br> |
| 940 | Removed /media/My Video/The IT Crowd/The IT Crowd_20200605_2309.nts<br> |
| 939 | Removed /media/My Video/The IT Crowd/The IT Crowd_20200605_2309.ts<br> |
| 938 | Removed /mod/tmp/The IT Crowd_20200605_2309-inp.hmt<br> |
| 937 | Removed /mod/tmp/The IT Crowd_20200605_2309-inp.nts<br> |
| 936 | Removed /mod/tmp/The IT Crowd_20200605_2309-inp.ts<br> |
| 935 | 05/06/2020 23:38:57 DA(3589)- done...processed /media/My Video/The IT Crowd/The IT Crowd_20200605_2309.ts in 1575.295s 00:26:15 - 3 ad breaks detected |
| 934 | 05/06/2020 23:38:55 DA(3589)- /media/My Video/The IT Crowd/The IT Crowd_20200605_2309.ts deleted |
| 933 | 05/06/2020 23:38:55 DA(3589)- Final bookmarks: 15 744 979 1605 1742 |
| 932 | 05/06/2020 23:38:55 DA(3589)- ad break found 26:45-29:02 (1605 - 1742) Frames: 40131 - 43550 |
| 931 | 05/06/2020 23:38:49 DA(4720)- ==DETECTADS Chase Run: /media/My Video/The IT Crowd/The IT Crowd_20200605_2338.ts |
| 930 | 05/06/2020 23:38:49 RM(4713)- DETECTADS: Started /media/My Video/The IT Crowd/The IT Crowd_20200605_2338.ts for chaserun advert detection |
| 929 | 05/06/2020 23:38:48 RM(4713)- DETECTADS: Checking /media/My Video/The IT Crowd/The IT Crowd_20200605_2338.ts (Channel 4 HD) for channel exclusion |
| 928 | 05/06/2020 23:27:30 DA(3589)- ad break found 12:24-16:19 (744 - 979) Frames: 18602 - 24470 |
| 927 | 05/06/2020 23:13:44 DA(3589)- ad break found 0:00-0:15 (0 - 15) Frames: 1 - 370 |
| 926 | 05/06/2020 23:09:43 DA(3589)- ==DETECTADS Chase Run: /media/My Video/The IT Crowd/The IT Crowd_20200605_2309.ts |
| 925 | 05/06/2020 23:09:43 RM(3580)- DETECTADS: Started /media/My Video/The IT Crowd/The IT Crowd_20200605_2309.ts for chaserun advert detection |
| 924 | 05/06/2020 23:09:42 RM(3580)- DETECTADS: Checking /media/My Video/The IT Crowd/The IT Crowd_20200605_2309.ts (Channel 4 HD) for channel exclusion |
MymsMan
Ad detector
There is nothing obviously wrong
No log record is generated for the rename of the -dec (-crop if cropping) file to the original file name which occurs between the
messages.
If something had gone wrong I would have expected a bunch of error messages and no 'done' message, I would also have expected the next run of detectads attempting to clean up an orphaned -dec file.
I think something else has deleted the recording after detectads has completed but I have no idea what, when or why.
To search for clues try searching all of the logs for references to the recording, from a webshell or telnet command window try:
No log record is generated for the rename of the -dec (-crop if cropping) file to the original file name which occurs between the
Code:
950 06/06/2020 00:09:25 DA(4720)- done...processed /media/My Video/The IT Crowd/The IT Crowd_20200605_2338.ts in 1657.451s 00:27:37 - 3 ad breaks detected
949 06/06/2020 00:09:20 DA(4720)- /media/My Video/The IT Crowd/The IT Crowd_20200605_2338.ts deletedIf something had gone wrong I would have expected a bunch of error messages and no 'done' message, I would also have expected the next run of detectads attempting to clean up an orphaned -dec file.
I think something else has deleted the recording after detectads has completed but I have no idea what, when or why.
To search for clues try searching all of the logs for references to the recording, from a webshell or telnet command window try:
Code:
grep 20200605_2338 /mod/tmp/*.log
ls /mod/tmp/*20200605_2338*
ls "/media/My Video/The IT Crowd/"*20200605_2338*
bottletop
Active Member
I had a similar issue to this last week with the recordings for Plebs ITV2 Weds 22:00 & 22:30 (two episodes showing on consecutive time slots).
The difference is that I have undelete installed, so I had to retrieve the first of the two episodes from the dustbin, the second of the two was fine.
Note, I have
undelete installed and set to 10 days
detectads package with settings: 'chaserun'; Delete (move to bin) original recording after processing - Y; Write output recording to folder - Same as input; Limit cpu usage to 75%
The settings seems to work fine except on some occasions.
If I cant see the recording the first thing I do is to check my [Deleted Items] folder, it is sometimes there, otherwise it may be that there was a conflict in the recording schedule (eg overrun or overlaps when 2 recordings at same time period).
I don't have last weeks logs available, but thought I'd mention it for anyone wishing to test the issue out.
I noticed this has oddity has affected previous weeks recordings for Plebs, but it doesn't happen every week - just on some weeks.
I thought it may be either detectads Delete (move to bin) original recording after processing - Y;
or Auto-Processings Settings - Create backup files in dustbin for decrypt and shrink? -No
but that is simply a guess and I have not changed it as it seems to work fine for me most of the time
The difference is that I have undelete installed, so I had to retrieve the first of the two episodes from the dustbin, the second of the two was fine.
Note, I have
undelete installed and set to 10 days
detectads package with settings: 'chaserun'; Delete (move to bin) original recording after processing - Y; Write output recording to folder - Same as input; Limit cpu usage to 75%
The settings seems to work fine except on some occasions.
If I cant see the recording the first thing I do is to check my [Deleted Items] folder, it is sometimes there, otherwise it may be that there was a conflict in the recording schedule (eg overrun or overlaps when 2 recordings at same time period).
I don't have last weeks logs available, but thought I'd mention it for anyone wishing to test the issue out.
I noticed this has oddity has affected previous weeks recordings for Plebs, but it doesn't happen every week - just on some weeks.
I thought it may be either detectads Delete (move to bin) original recording after processing - Y;
or Auto-Processings Settings - Create backup files in dustbin for decrypt and shrink? -No
but that is simply a guess and I have not changed it as it seems to work fine for me most of the time
Last edited:
MymsMan
Ad detector
I think I have found a potential timing window with back to back recordings where the orphaned file clean up could run before the previous recording has completely finished.
Now that I have released schedchk I should have more time to work on detectads but I do have quite a long list of changes to make so it won't be a quick fix.
In the meantime make sure you have undelete active in case of problems.
Now that I have released schedchk I should have more time to work on detectads but I do have quite a long list of changes to make so it won't be a quick fix.
In the meantime make sure you have undelete active in case of problems.
bottletop
Active Member
That sounds like the culprit, because on each occasion I dug the first of the two recordings from the deleted items directory