Sweeper not running [SOLVED]

Black Hole

May contain traces of nut
The sweeper package is installed, and rules are set. I thought it wasn't running because the folder in question has the "[" prefix, but I changed that to a "-" and it still isn't running. A sweeper sweep would show up in auto.log, right? Nothing, not even to say sweeper ran and found nothing to do.

"Test config" works, and so does "Run now".

What could cause sweeper not to trigger on each 10-minute auto cycle?


Update:

Solution

Have you got a /mod/etc/sweeper.conf file? Not having it will stop it registering.

Because I don't have any sweeper rules set up for My Video, there is no "master" rule set and no rule set file /mod/etc/sweeper.conf. Creating a dummy file touch /mod/etc/sweeper.conf solved the problem. Or you could just add a rule to My Video which does nothing.
 
Last edited:
No mention of sweeper at all, even with full debug logging. Things I could try:
  1. fix-flash-packages, even though I have the "don't disable" flag set;

  2. Uninstall and reinstall sweeper.
What else? I can't think of anything else.
 
With normal logging levels Sweeper is virtually silent
Code:
5000    12/04/2022 22:31:06 - Active flags: decryptR decrypt expire detectads sweeper nodetectads dedup shrink
but with full debug it is very verbose!
for a single run I have:
Code:
4035    12/04/2022 09:53:49 - <********* ::sweeper::run (33.648 seconds)
.
.  1600+ lines omitted
.
2502    12/04/2022 09:53:17 - + Sweeper processing /media/My Video/Innocent/Innocent_20210518_2101.ts
2479    12/04/2022 09:53:17 - + Sweeper processing /media/My Video/Innocent/Innocent_20210520_2059.ts
2456    12/04/2022 09:53:16 - + Sweeper processing /media/My Video/Innocent/Innocent_20210519_2100.ts
2433    12/04/2022 09:53:16 - + Sweeper processing /media/My Video/Innocent/Innocent_20210517_2100.ts
2407    12/04/2022 09:53:16 - + Sweeper processing /media/My Video/Red Bull Soapbox Race/Red Bull Soapbox Race_20220226_1455.ts
2388    12/04/2022 09:53:16 - *********> ::sweeper::run (Priority 700)
I suspect that the sweeper auto.hook file has gone AWOL.

Reinstalling Sweeeper should fix that if it is the problem, fix-flash-packages wont help since it is not a flash resident package.
 
Uninstall, reinstall, reboot (no idea whether that was necessary, but it never hurts)... still not getting sweeper mentioned in the Active Flags line:
Code:
13/04/2022 07:36:02 - Active flags: decryptR decrypt mpg mp3

Where do the flags get registered? The sweeper rules in question are applied to a folder rather than My Video, how does the auto system find them? Where do I look for the auto.hook file?
 
I tried inserting a reboot after the uninstall, clutching at straws. This seems to be the nub of the matter:
Code:
4835    13/04/2022 12:44:03 - Active flags: decryptR decrypt mpg mp3
4834    13/04/2022 12:44:03 - Scan completed (0.486 seconds)
4833    13/04/2022 12:44:02 - Scanning media for flags...
4832    13/04/2022 12:44:02 - Registered disableota with priority 1000 (::disableota::run)
4831    13/04/2022 12:44:02 - Registered disabledso with priority 1000 (::disabledso::run)
4830    13/04/2022 12:44:02 - Registered skip with priority 990 (::skip::run)
4829    13/04/2022 12:44:02 - Registered shrink with priority 400 (::shrink::run)
4828    13/04/2022 12:44:02 - Registered mpg with priority 300 (::mpg::run)
4827    13/04/2022 12:44:02 - Registered mp3 with priority 300 (::mp3::run)
4826    13/04/2022 12:44:02 - Auto de-queue processed 0 items in 0.102 seconds.
4825    13/04/2022 12:44:02 - Registered expire with priority 900 (::expire::run)
4824    13/04/2022 12:44:02 - Registered dedup with priority 800 (::dedup::run)
4823    13/04/2022 12:44:02 - Registered decrypt with priority 600 (::decrypt::run)
4822    13/04/2022 12:44:02 - Registered qtube with priority 200
4821    13/04/2022 12:44:02 - Registered shrink with priority 400
4820    13/04/2022 12:44:02 - Registered mpg with priority 300
4819    13/04/2022 12:44:02 - Registered mp3 with priority 300
4818    13/04/2022 12:44:02 - Registered decrypt with priority 900
4817    13/04/2022 12:44:02 - Auto processing starting
Sweeper isn't being registered! I presume it should show up in that "Registered" list?
 
Have you got a /mod/etc/sweeper.conf file? Not having it will stop it registering.

There's probably a more elegant way to display this, but this'll do. Assuming you've changed directory to /mod/webif then issue these commands to show the things eligible for registration in auto/queue categories:
Code:
for p in 'lib/auto/plugin plugin'; do find $p -name '*.hook';done|grep auto\.hook
for p in 'lib/auto/plugin plugin'; do find $p -name '*.hook';done|grep queue\.hook
You should see plugin/sweeper/auto.hook as one of the lines.
 
Assuming you've changed directory to /mod/webif then issue these commands to show the things eligible for registration in auto/queue categories:
Code:
for p in 'lib/auto/plugin plugin'; do find $p -name '*.hook';done|grep auto\.hook
for p in 'lib/auto/plugin plugin'; do find $p -name '*.hook';done|grep queue\.hook
You should see plugin/sweeper/auto.hook as one of the lines.

Code:
HDRFOX4# cd mod/webif                                                                                                                                                     
HDRFOX4# for p in 'lib/auto/plugin plugin'; do find $p -name '*.hook';done|grep auto\.hook                                                                                 
lib/auto/plugin/decrypt/auto.hook                                                                                                                                         
lib/auto/plugin/mp3/auto.hook                                                                                                                                             
lib/auto/plugin/expire/auto.hook                                                                                                                                           
lib/auto/plugin/mpg/auto.hook                                                                                                                                             
lib/auto/plugin/shrink/auto.hook                                                                                                                                           
lib/auto/plugin/dedup/auto.hook                                                                                                                                           
lib/auto/plugin/skip/auto.hook                                                                                                                                             
plugin/disable-dso/auto.hook                                                                                                                                               
plugin/sweeper/auto.hook          <----------                                                                                                                                                  
plugin/disable-ota/auto.hook                                                                                                                                               
HDRFOX4# for p in 'lib/auto/plugin plugin'; do find $p -name '*.hook';done|grep queue\.hook                                                                               
lib/auto/plugin/decrypt/queue.hook                                                                                                                                         
lib/auto/plugin/mp3/queue.hook                                                                                                                                             
lib/auto/plugin/mpg/queue.hook                                                                                                                                             
lib/auto/plugin/shrink/queue.hook                                                                                                                                         
plugin/qtube/queue.hook                                                                                                                                                   
HDRFOX4#

Have you got a /mod/etc/sweeper.conf file? Not having it will stop it registering.
Aha! Would that be the case if there are no top-level rules?
Code:
HDRFOX4# ls /mod/etc                                                                                                                                                       
anacrontab  lighttpd   mdev         modservice.d  profile   recmon.d     secrets.tdb-opkg  smb.conf   ssmtp     webif.db  youtube-dl.conf                                 
init.d      magic.mgc  mke2fs.conf  passdb.tdb    queue.db  secrets.tdb  smb-hotplug.conf  smbpasswd  termtype  wgetrc                                                     
HDRFOX4#

I'll try adding a dummy file.
 
Would that be the case if there are no top-level rules?
I guess so. I think I've been caught out by this before. It seems a bit of an unnecessary restriction, if just providing an empty file makes everything work. You wonder why the check is there in the first place.
 
You wonder why the check is there in the first place.
I think this is a case of the use exceeding the intention. Originally, sweeper sorted and filed recordings dumped into My Video, either as one-off recordings or as a result of flatten. I expect the ability to apply local rules to sub-folders came later, and it was never considered somebody (ie me!) might try to apply local rules with no top level rules existing.
 
I would guess you're right. Looks like the check needs to bit the dust though as it's now annoyingly unintuitive, and forces the user to have to resort to command line antics to make stuff work, which is not particularly nice.
 
Sweeper 2.2.5 is now in the Beta repository. If you would care to upgrade, then delete your dummy file and check it all still works, that would be appreciated.
 
forces the user to have to resort to command line antics to make stuff work
Just opening the sweeper GUI, clicking "Add rule", and then "Save changes" is enough.

Sweeper 2.2.5 is now in the Beta repository. If you would care to upgrade, then delete your dummy file and check it all still works, that would be appreciated.
Roger wilco
 
If tinkering with sweeper it would would be nice to change the start and and end of run log entries to level 0 so that there was some evidence of it running without the huge volume of logging at level 2
 
Yep, 2.2.5 is working as expected. It throws up debug:
Code:
13/04/2022 19:42:04 - Error opening sweeper ruleset (/mod/etc/sweeper.conf), /mod/etc/sweeper.conf: No such file or directory
... but goes on to find other rule sets:
Code:
4818    13/04/2022 19:42:04 - --- SWEEP(0) STARTING FOR /media/My Video/-MP3 ---
4817    13/04/2022 19:42:04 -
4816    13/04/2022 19:42:04 - SWEEPER: [/media/My Video/-MP3]
 
Back
Top