Auto decrypt/shrink events not processing

lashers · 2025-12-12T01:20:24+0000

A few days ago I found that programs were not being decrypted or shrunk. The items were being added to the queue but not processed, the auto log showing:

Code:

/bin/sh: /mod/webif/lib/auto/deq: Permission denied

A trial manual decrypt and shrink did however complete successfully. A search on the forum and the wiki has not produced any useful information; an internet search provided some general suggestions, one of which was to check permissions. This produced the following result:

Code:

Humax1TB# ls -l /mod/webif/lib/auto/deq                                                                                                           
-rwx------    1 root     root          1061 Mar 25  2022 /mod/webif/lib/auto/deq

I assume this looks OK; the next suggestion was to reinstall "the web interface or the specific module that is causing the issue" but I don't know which module is involved and am not sufficiently confident to proceed. Can anyone provide any advice or instructions on how to resolve this? Two things which may or may not be relevant: I noticed that I was still running customised firmware 3.13 so upgraded but the problem remains; also, after the upgrade I had a disk warning that offline sectors had increased from 8 to 24 and the most recent Self-test logs showed:

Code:

1     Extended offline     Completed: read failure     10%     41409     -
2     Short offline     Completed without error     00%     41402     -

Thanks in advance for any assistance.

Black Hole · 2025-12-12T07:37:32+0000

lashers said:
an internet search provided some general suggestions, one of which was to check permissions...

reinstall "the web interface or the specific module that is causing the issue"

The general internet knows nothing about the CF, I have never known there to be issues with permissions. This is the only place to ask and any fiddling in the dark is likely to make matters worse.

lashers said:
am not sufficiently confident to proceed

Good.

lashers said:
still running customised firmware 3.13

No harm in that.

lashers said:
after the upgrade I had a disk warning that offline sectors had increased from 8 to 24

That is not necessarily alarming, but it would be worth running a fixdisk (as would be advantageous from time to time).

From what you've said, it sounds like the queue is not processing. Does the queue* show any tasks completing recently? Rather than duplicate information, THIS THREAD appears to be an exact match to your problem..

* WebIF >> Queue, assuming WebIF >> Settings >> Auto-Processing Settings >> Show queue icon in menu/toolbar? = YES.

prpr · 2025-12-12T10:38:42+0000

lashers said:
I assume this looks OK;

You (of course) didn't state your WebIf version, but I can tell you're not on the latest version. That file size looks pretty suspicious too.

I had a disk warning that offline sectors had increased from 8 to 24 and the most recent Self-test logs showed:
1 Extended offline Completed: read failure 10% 41409

You need to run through the fixdisk procedure in Maintenance Mode first, until you have no offline sectors. Then upgrade all your packages to the latest releases.

Black Hole said:
I have never known there to be issues with permissions.

There have been several over the years. There was one I fixed just recently in 1.5.4-1.

prpr · 2025-12-12T11:54:05+0000

Black Hole said:
Rather than duplicate information, THIS THREAD appears to be an exact match to your problem..

But it isn't, as post #1 shows.

lashers · 2025-12-12T14:06:07+0000

prpr said:
You (of course) didn't state your WebIf version, but I can tell you're not on the latest version. That file size looks pretty suspicious too.

I am, as I have auto-update installed:

Code:

Web Interface Version: 1.5.4-3
Custom Firmware Version: 3.14 (build 1757805000)
Humax Version: 1.03.12 (kernel HDR_CFW_3.14)
Loader Version: a7.34

prpr said:
You need to run through the fixdisk procedure in Maintenance Mode first, until you have no offline sectors. Then upgrade all your packages to the latest releases.

I will run it overnight. It will take quite a while as I have a 4TB drive. Is there anything else I can try beforehand?

Thanks again for your assistance.

Black Hole · 2025-12-12T14:36:38+0000

prpr said:
But it isn't, as post #1 shows.

It isn't? Does it? Only if you have more in-depth knowledge I suppose.

prpr · 2025-12-12T15:12:43+0000

lashers said:
I am, as I have auto-update installed

So something else is amiss as the file you quoted should be:
-rwx------ 1 root root 5898 Sun 12 May 2024 12:41:43 /mod/webif/lib/auto/deq
and yours looks like it's dated from an earlier version of WebIf, but it's also the wrong size.
Can you do a cat /mod/webif/lib/auto/deq and see how it's corrupted?
Then you need to reinstall the WebIf - there's an option for it on the Administration (Telnet) Menu.

It would be useful to see your disk SMART stats. - if you update to tmenu 1.29 (updated earlier today) then there's a new "smart" option which will work from the menu, as well as the usual WebIf Diagnostics page.
Install the fix-disk package too, as it fixes a display bug in the 3.14 firmware version.

To speed up the overall process, you can set the long SMART test going while still using the box in normal mode, again on the Admin menu, and monitor periodically for when it finds the error. Then you can go to MM and the fixdisk stage, and use the options: -s -y -r
and just leave it and hopefully come back to find it fixed tomorrow.

prpr · 2025-12-12T15:16:26+0000

Black Hole said:
It isn't? Does it?

The thread you referred to seemed to imply a problem with the queue database. This is not the problem here (stuff is getting on to the queue), which appears to be a script corruption one, possibly caused or compounded by physical disk problems.

lashers · 2025-12-12T16:14:28+0000

prpr said:
Can you do a cat /mod/webif/lib/auto/deq and see how it's corrupted?

Code:

Humax1TB# cat /mod/webif/lib/auto/deq                                                                                                             
#!/mod/bin/jimsh                                                                                                                                 
                                                                                                                                                  
source /mod/webif/lib/setup                                                                                                                       
require queue.class system.class                                                                                                                 
                                                                                                                                                  
proc fixflags {dir} {                                                                                                                             
        foreach entry [readdir -nocomplain $dir] {                                                                                               
                if {[file isdirectory "$dir/$entry"]} {                                                                                           
                        fixflags "$dir/$entry"                                                                                                   
                        continue                                                                                                                 
                }                                                                                                                                 
                if {[string match {.auto*r} $entry]} {                                                                                           
                        puts "Updating flag $dir/$entry"                                                                                         
                        file rename "$dir/$entry" \                                                                                               
                            "$dir/[string range $entry 0 end-1]R"                                                                                 
                }                                                                                                                                 
        }                                                                                                                                         
}                                                                                                                                                 
                                                                                                                                                  
set queries {                                                                                                                                     
        2 { {alter table queue add column last integer default 0} }                                                                               
}                                                                                                                                                 
                                                                                                                                                  
set latest 3                                                                                                                                     
set cur [queue version]                                                                                                                           
                                                                                                                                                  
if {$cur == $latest} {                                                                                                                           
        puts "Queue database is up-to-date."                                                                                                     
        exit                                                                                                                                     
}                                                                                                                                                 
                                                                                                                                                  
if {$cur < 3} {                                                                                                                                   
        puts "Upgrading directory flags..."                                                                                                       
        fixflags [system mediaroot]                                                                                                               
}                                                                                                                                                 
                                                                                                                                                  
if {$cur < 2} {                                                                                                                                   
        puts "Clearing queue due to version change..."                                                                                           
        queue dbhandle -close                                                                                                                     
        file delete /mod/etc/queue.db                                                                                                             
        queue dbhandle                                                                                                                           
        set cur $latest                                                                                                                           
}                                                                                                                                                 
                                                                                                                                                  
set db [queue dbhandle]                                                                                                                           
loop i $cur $latest {                                                                                                                             
        puts "Upgrading queue database to version $($i + 1)"                                                                                     
        foreach q $queries($i) {                                                                                                                 
                catch { $db query $q }                                                                                                           
                $db query {                                                                                                                       
                        update config                                                                                                             
                        set val = %s                                                                                                             
                        where var = 'version'                                                                                                     
                } $($i + 1)                                                                                                                       
        }                                                                                                                                         
}

prpr said:
Then you need to reinstall the WebIf - there's an option for it on the Administration (Telnet) Menu.

Done. This has updated deq and restarted queue processing.

prpr said:
It would be useful to see your disk SMART stats. - if you update to tmenu 1.29 (updated earlier today) then there's a new "smart" option which will work from the menu, as well as the usual WebIf Diagnostics page.

Code:

smartctl 6.4 2015-06-04 r4109 [7405b0-smp-linux-2.6.18-7.1] (local build)                                                                         
Copyright (C) 2002-15, Bruce Allen, Christian Franke, www.smartmontools.org                                                                       
                                                                                                                                                  
=== START OF INFORMATION SECTION ===                                                                                                             
Model Family:     Seagate Video 3.5 HDD                                                                                                           
Device Model:     ST4000VM000-2AF166                                                                                                             
Serial Number:    ZGY0MLA9                                                                                                                       
LU WWN Device Id: 5 000c50 0a436c55a                                                                                                             
Firmware Version: SC11                                                                                                                           
User Capacity:    4,000,787,030,016 bytes [4.00 TB]                                                                                               
Sector Sizes:     512 bytes logical, 4096 bytes physical                                                                                         
Rotation Rate:    5980 rpm                                                                                                                       
Form Factor:      3.5 inches                                                                                                                     
Device is:        In smartctl database [for details use: -P show]                                                                                 
ATA Version is:   ACS-3 T13/2161-D revision 5                                                                                                     
SATA Version is:  SATA 3.1, 6.0 Gb/s (current: 3.0 Gb/s)                                                                                         
Local Time is:    Fri Dec 12 15:52:44 2025 GMT                                                                                                   
SMART support is: Available - device has SMART capability.                                                                                       
SMART support is: Enabled                                                                                                                         
                                                                                                                                                  
=== START OF READ SMART DATA SECTION ===                                                                                                         
SMART overall-health self-assessment test result: PASSED                                                                                         
See vendor-specific Attribute list for marginal Attributes.                                                                                       
                                                                                                                                                  
General SMART Values:                                                                                                                             
Offline data collection status:  (0x00) Offline data collection activity                                                                         
                                        was never started.                                                                                       
                                        Auto Offline Data Collection: Disabled.                                                                   
Self-test execution status:      (   0) The previous self-test routine completed                                                                 
                                        without error or no self-test has ever                                                                   
                                        been run.                                                                                                 
Total time to complete Offline                                                                                                                   
data collection:                (  591) seconds.                                                                                                 
Offline data collection                                                                                                                           
capabilities:                    (0x73) SMART execute Offline immediate.                                                                         
                                        Auto Offline data collection on/off support.                                                             
                                        Suspend Offline collection upon new                                                                       
                                        command.                                                                                                 
                                        No Offline surface scan supported.                                                                       
                                        Self-test supported.                                                                                     
                                        Conveyance Self-test supported.                                                                           
                                        Selective Self-test supported.                                                                           
SMART capabilities:            (0x0003) Saves SMART data before entering                                                                         
                                        power-saving mode.                                                                                       
                                        Supports SMART auto save timer.                                                                           
Error logging capability:        (0x01) Error logging supported.                                                                                 
                                        General Purpose Logging supported.                                                                       
Short self-test routine                                                                                                                           
recommended polling time:        (   1) minutes.                                                                                                 
Extended self-test routine                                                                                                                       
recommended polling time:        ( 667) minutes.                                                                                                 
Conveyance self-test routine                                                                                                                     
recommended polling time:        (   2) minutes.                                                                                                 
SCT capabilities:              (0x50bd) SCT Status supported.                                                                                     
                                        SCT Error Recovery Control supported.                                                                     
                                        SCT Feature Control supported.                                                                           
                                        SCT Data Table supported.                                                                                 
                                                                                                                                                  
SMART Attributes Data Structure revision number: 10                                                                                               
Vendor Specific SMART Attributes with Thresholds:                                                                                                 
ID# ATTRIBUTE_NAME          FLAG     VALUE WORST THRESH TYPE      UPDATED  WHEN_FAILED RAW_VALUE                                                 
  1 Raw_Read_Error_Rate     0x000f   082   046   044    Pre-fail  Always       -       158654090                                                 
  3 Spin_Up_Time            0x0003   093   093   000    Pre-fail  Always       -       0                                                         
  4 Start_Stop_Count        0x0032   098   098   020    Old_age   Always       -       3005                                                       
  5 Reallocated_Sector_Ct   0x0033   100   100   010    Pre-fail  Always       -       2                                                         
  7 Seek_Error_Rate         0x000f   096   060   045    Pre-fail  Always       -       3946843830                                                 
  9 Power_On_Hours          0x0032   029   029   000    Old_age   Always       -       62930 (27 99 0)                                           
 10 Spin_Retry_Count        0x0013   100   100   097    Pre-fail  Always       -       0                                                         
 12 Power_Cycle_Count       0x0032   098   098   020    Old_age   Always       -       3005                                                       
184 End-to-End_Error        0x0032   100   100   099    Old_age   Always       -       0                                                         
187 Reported_Uncorrect      0x0032   001   001   000    Old_age   Always       -       12492                                                     
188 Command_Timeout         0x0032   100   099   000    Old_age   Always       -       322127462475                                               
189 High_Fly_Writes         0x003a   100   100   000    Old_age   Always       -       0                                                         
190 Airflow_Temperature_Cel 0x0022   046   033   040    Old_age   Always   In_the_past 54 (Min/Max 44/55 #977)                                   
191 G-Sense_Error_Rate      0x0032   100   100   000    Old_age   Always       -       0                                                         
192 Power-Off_Retract_Count 0x0032   100   100   000    Old_age   Always       -       1714                                                       
193 Load_Cycle_Count        0x0032   033   033   000    Old_age   Always       -       135689                                                     
194 Temperature_Celsius     0x0022   054   067   000    Old_age   Always       -       54 (0 10 0 0 0)                                           
197 Current_Pending_Sector  0x0012   100   100   000    Old_age   Always       -       24                                                         
198 Offline_Uncorrectable   0x0010   100   100   000    Old_age   Offline      -       24                                                         
199 UDMA_CRC_Error_Count    0x003e   200   200   000    Old_age   Always       -       0                                                         
240 Head_Flying_Hours       0x0000   100   253   000    Old_age   Offline      -       61811 (112 195 0)                                         
241 Total_LBAs_Written      0x0000   100   253   000    Old_age   Offline      -       700909594424                                               
242 Total_LBAs_Read         0x0000   100   253   000    Old_age   Offline      -       482935376144                                               
                                                                                                                                                  
SMART Error Log Version: 1                                                                                                                       
ATA Error Count: 12447 (device log contains only the most recent five errors)                                                                     
        CR = Command Register [HEX]                                                                                                               
        FR = Features Register [HEX]                                                                                                             
        SC = Sector Count Register [HEX]                                                                                                         
        SN = Sector Number Register [HEX]                                                                                                         
        CL = Cylinder Low Register [HEX]                                                                                                         
        CH = Cylinder High Register [HEX]                                                                                                         
        DH = Device/Head Register [HEX]                                                                                                           
        DC = Device Command Register [HEX]                                                                                                       
        ER = Error register [HEX]                                                                                                                 
        ST = Status register [HEX]                                                                                                               
Powered_Up_Time is measured from power on, and printed as                                                                                         
DDd+hh:mm:SS.sss where DD=days, hh=hours, mm=minutes,                                                                                             
SS=sec, and sss=millisec. It "wraps" after 49.710 days.                                                                                           
                                                                                                                                                  
Error 12447 occurred at disk power-on lifetime: 54796 hours (2283 days + 4 hours)                                                                 
  When the command that caused the error occurred, the device was active or idle.                                                                 
                                                                                                                                                  
  After command completion occurred, registers were:                                                                                             
  ER ST SC SN CL CH DH                                                                                                                           
  -- -- -- -- -- -- --                                                                                                                           
  40 51 00 ff ff ff 0f  Error: UNC at LBA = 0x0fffffff = 268435455                                                                               
                                                                                                                                                  
  Commands leading to the command that caused the error were:                                                                                     
  CR FR SC SN CL CH DH DC   Powered_Up_Time  Command/Feature_Name                                                                                 
  -- -- -- -- -- -- -- --  ----------------  --------------------                                                                                 
  25 00 08 ff ff ff ef 00   3d+13:02:17.177  READ DMA EXT                                                                                         
  ec 00 00 b0 40 c0 a0 00   3d+13:02:17.123  IDENTIFY DEVICE                                                                                     
  25 00 08 ff ff ff ef 00   3d+13:02:14.379  READ DMA EXT                                                                                         
  ec 00 00 b0 40 c0 a0 00   3d+13:02:14.343  IDENTIFY DEVICE                                                                                     
  25 00 08 ff ff ff ef 00   3d+13:02:11.577  READ DMA EXT                                                                                         
                                                                                                                                                  
Error 12446 occurred at disk power-on lifetime: 54796 hours (2283 days + 4 hours)                                                                 
  When the command that caused the error occurred, the device was active or idle.                                                                 
                                                                                                                                                  
  After command completion occurred, registers were:                                                                                             
  ER ST SC SN CL CH DH                                                                                                                           
  -- -- -- -- -- -- --                                                                                                                           
  40 51 00 ff ff ff 0f  Error: UNC at LBA = 0x0fffffff = 268435455                                                                               
                                                                                                                                                  
  Commands leading to the command that caused the error were:                                                                                     
  CR FR SC SN CL CH DH DC   Powered_Up_Time  Command/Feature_Name                                                                                 
  -- -- -- -- -- -- -- --  ----------------  --------------------                                                                                 
  25 00 08 ff ff ff ef 00   3d+13:02:14.379  READ DMA EXT                                                                                         
  ec 00 00 b0 40 c0 a0 00   3d+13:02:14.343  IDENTIFY DEVICE                                                                                     
  25 00 08 ff ff ff ef 00   3d+13:02:11.577  READ DMA EXT                                                                                         
  ec 00 00 b0 40 c0 a0 00   3d+13:02:11.514  IDENTIFY DEVICE                                                                                     
  25 00 08 ff ff ff ef 00   3d+13:02:08.780  READ DMA EXT                                                                                         
                                                                                                                                                  
Error 12445 occurred at disk power-on lifetime: 54796 hours (2283 days + 4 hours)                                                                 
  When the command that caused the error occurred, the device was active or idle.                                                                 
                                                                                                                                                  
  After command completion occurred, registers were:                                                                                             
  ER ST SC SN CL CH DH                                                                                                                           
  -- -- -- -- -- -- --                                                                                                                           
  40 51 00 ff ff ff 0f  Error: UNC at LBA = 0x0fffffff = 268435455                                                                               
                                                                                                                                                  
  Commands leading to the command that caused the error were:                                                                                     
  CR FR SC SN CL CH DH DC   Powered_Up_Time  Command/Feature_Name                                                                                 
  -- -- -- -- -- -- -- --  ----------------  --------------------                                                                                 
  25 00 08 ff ff ff ef 00   3d+13:02:11.577  READ DMA EXT                                                                                         
  ec 00 00 b0 40 c0 a0 00   3d+13:02:11.514  IDENTIFY DEVICE                                                                                     
  25 00 08 ff ff ff ef 00   3d+13:02:08.780  READ DMA EXT                                                                                         
  ec 00 00 b0 40 c0 a0 00   3d+13:02:08.745  IDENTIFY DEVICE                                                                                     
  25 00 08 ff ff ff ef 00   3d+13:02:06.032  READ DMA EXT                                                                                         
                                                                                                                                                  
Error 12444 occurred at disk power-on lifetime: 54796 hours (2283 days + 4 hours)                                                                 
  When the command that caused the error occurred, the device was active or idle.                                                                 
                                                                                                                                                  
  After command completion occurred, registers were:                                                                                             
  ER ST SC SN CL CH DH                                                                                                                           
  -- -- -- -- -- -- --                                                                                                                           
  40 51 00 ff ff ff 0f  Error: UNC at LBA = 0x0fffffff = 268435455                                                                               
                                                                                                                                                  
  Commands leading to the command that caused the error were:                                                                                     
  CR FR SC SN CL CH DH DC   Powered_Up_Time  Command/Feature_Name                                                                                 
  -- -- -- -- -- -- -- --  ----------------  --------------------                                                                                 
  25 00 08 ff ff ff ef 00   3d+13:02:08.780  READ DMA EXT                                                                                         
  ec 00 00 b0 40 c0 a0 00   3d+13:02:08.745  IDENTIFY DEVICE                                                                                     
  25 00 08 ff ff ff ef 00   3d+13:02:06.032  READ DMA EXT                                                                                         
  ec 00 00 b0 40 c0 a0 00   3d+13:02:05.804  IDENTIFY DEVICE                                                                                     
  25 00 08 ff ff ff ef 00   3d+13:02:03.086  READ DMA EXT                                                                                         
                                                                                                                                                  
Error 12443 occurred at disk power-on lifetime: 54796 hours (2283 days + 4 hours)                                                                 
  When the command that caused the error occurred, the device was active or idle.                                                                 
                                                                                                                                                  
  After command completion occurred, registers were:                                                                                             
  ER ST SC SN CL CH DH                                                                                                                           
  -- -- -- -- -- -- --                                                                                                                           
  40 51 00 ff ff ff 0f  Error: UNC at LBA = 0x0fffffff = 268435455                                                                               
                                                                                                                                                  
  Commands leading to the command that caused the error were:                                                                                     
  CR FR SC SN CL CH DH DC   Powered_Up_Time  Command/Feature_Name                                                                                 
  -- -- -- -- -- -- -- --  ----------------  --------------------                                                                                 
  25 00 08 ff ff ff ef 00   3d+13:02:06.032  READ DMA EXT                                                                                         
  ec 00 00 b0 40 c0 a0 00   3d+13:02:05.804  IDENTIFY DEVICE                                                                                     
  25 00 08 ff ff ff ef 00   3d+13:02:03.086  READ DMA EXT                                                                                         
  25 00 08 ff ff ff ef 00   3d+13:02:03.053  READ DMA EXT                                                                                         
  35 00 80 ff ff ff ef 00   3d+13:02:03.053  WRITE DMA EXT                                                                                       
                                                                                                                                                  
SMART Self-test log structure revision number 1                                                                                                   
Num  Test_Description    Status                  Remaining  LifeTime(hours)  LBA_of_first_error                                                   
# 1  Extended offline    Completed: read failure       10%     41409         -                                                                   
# 2  Short offline       Completed without error       00%     41402         -                                                                   
# 3  Short offline       Completed: read failure       90%     33030         -                                                                   
# 4  Extended offline    Completed: read failure       90%     33030         -                                                                   
# 5  Short offline       Completed: read failure       90%     33030         -                                                                   
# 6  Extended offline    Completed: read failure       90%     33017         -                                                                   
# 7  Short offline       Completed: read failure       90%     33017         -                                                                   
                                                                                                                                                  
SMART Selective self-test log data structure revision number 1                                                                                   
 SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS                                                                                                     
    1        0        0  Not_testing                                                                                                             
    2        0        0  Not_testing                                                                                                             
    3        0        0  Not_testing                                                                                                             
    4        0        0  Not_testing                                                                                                             
    5        0        0  Not_testing                                                                                                             
Selective self-test flags (0x0):                                                                                                                 
  After scanning selected spans, do NOT read-scan remainder of disk.                                                                             
If Selective self-test is pending on power-up, resume after 0 minute delay.

I see there are some errors highlighted.

prpr said:
Install the fix-disk package too, as it fixes a display bug in the 3.14 firmware version.

fix-disk is installed at version 0.7. Is this current?

prpr said:
To speed up the overall process, you can set the long SMART test going while still using the box in normal mode, again on the Admin menu, and monitor periodically for when it finds the error. Then you can go to MM and the fixdisk stage, and use the options: -s -y -r
and just leave it and hopefully come back to find it fixed tomorrow.

Noted.

One last question. Is it possible to switch off auto processing completely?

Thanks again.

prpr · 2025-12-12T17:22:02+0000

lashers said:
Humax1TB# cat /mod/webif/lib/auto/deq
#!/mod/bin/jimsh
source /mod/webif/lib/setup
require queue.class system.class

proc fixflags {dir} {

That's from .../lib/auto/upgrade, so I guess you've got whatever the Ext3 version of a cross-linked file is called, possibly caused by your underlying bad sectors on the disk.

fix-disk is installed at version 0.7. Is this current?

Yes.

One last question. Is it possible to switch off auto processing completely?

You can do it on the Settings page for Auto-processing settings by assigning all 24 hours to the "Disable during" box. But I'm not sure why you'd want to.

BTW, your disk is the same type as I lost catastrophically last year. I've also just lost another of the slightly newer type of Seagate 4TB Video drives, although I was on to it straight away this time and managed to (mostly) back it up before it died (catastrophically again). Maybe I'll write it all up in a separate thread if anyone's interested.

Auto decrypt/shrink events not processing

lashers

Member

Black Hole

May contain traces of nut

prpr

Well-Known Member

prpr

Well-Known Member

lashers

Member

Black Hole

May contain traces of nut

prpr

Well-Known Member

prpr

Well-Known Member

lashers

Member

prpr

Well-Known Member