brand new HDD but EXTENTS_FL errors

aha! found the answer, just on terminal (in the freefilesync folder) I need to write: sudo ./FreeFileSync.
...
You were specifically advised against that, FWIW because of possible unwanted side-effects, such as configuration files of your Ubuntu user account becoming owned by root. Sadly this solution was also recommended by a poster to the product forum.
 
Last edited:
On the command line:

> sudo <command> executes that command with root privilege, and you will be prompted for the admin password if sudo has not been used in that session within the last few minutes.

> sudo -i can be run on a line on its own to give all subsequent commands root privilege until "exit".
You were specifically advised against that, FWIW because of possible unwanted side-effects, such as configuration files of your Ubuntu user account becoming owned by root. Sadly this solution was also recommended by a poster to the product forum.

@/df Where was I advised not to do that? Black Hole just spoke about the process

Well I guess I'll leave it copying and then plug it back in and see what happens. What suitable test (if any) can I do to be sure there are no problems?
 
Hi all, as promised...

I've just plugged my old HDD back in to get the SMART data and a list of the packages I had installed. Sorry firefox is not playing ball when copying pasting it in so sorry about the formatting).

Some people reviewing the data below may so "oh there is nothing wrong with your HDD, the count of reallocated sectors is really low". However, there is still something wrong with it that fixdisk in the humax isn't wanting to fix. There is also the LBA 0 error (and as suggested in a previous post will only probably go away if you do a security delete [I think], which invariably means you've got to copy off the data anyway as it will delete the drive content [i think]). Also whenever you play a recording or stop it, it takes about 45 seconds to come back to life (during this time you can hear the HDD head cycliing (cyclic redundancy thing) trying to read/write. Fixdisk did fix some things but obviously not enough in order to resolve the problems. Oh and it also continues to reboot after about every 5 minutes at the moment too. The display counts you down saying it's going to reboot. It doesn't matter what channel you are on and I've also disabled the rewind tv feature but not improvement.

Thanks

Rodp




SMART data read from device /dev/sdb

Disk Information
SMART StatusPASSED
Model FamilySeagate Video 3.5 HDD
Device ModelST1000VM002-1CT162
Serial NumberW1G0EJH0
LU WWN Device Id5 000c50 05c5de4b9
Firmware VersionSC23
User Capacity1,000,204,886,016 bytes [1.00 TB]
Sector Sizes512 bytes logical, 4096 bytes physical
Rotation Rate5900 rpm
Form Factor3.5 inches
Device isIn smartctl database [for details use: -P show]
ATA Version isATA8-ACS T13/1699-D revision 4
SATA Version isSATA 3.0, 6.0 Gb/s (current: 3.0 Gb/s)
Local Time isSat Sep 12 14:28:32 2020 BST
SMART support isAvailable - device has SMART capability.
SMART support isEnabled
Attributes
IDNameFlagsRaw ValueValueWorstThresholdLife LeftNotes
1Raw_Read_Error_RatePOSR--213690035107084006-
3Spin_Up_TimePO----0097097000-
4Start_Stop_Count-O--CK973009109102089%-
5Reallocated_Sector_CtPO--CK488100100036100%-
7Seek_Error_RatePOSR--609702513087060030-
9Power_On_Hours-O--CK2799706906900069%-
10Spin_Retry_CountPO--C-0100100097100%-
12Power_Cycle_Count-O--CK972709109102089%-
184End-to-End_Error-O--CK0100100099-
187Reported_Uncorrect-O--CK5632001001000-
188Command_Timeout-O--CK4295032833100099000-
189High_Fly_Writes-O-RCK1219001001000-
190Airflow_Temperature_Cel-O---K28072 (28°C)034 (66°C)045 (55°C)In_the_past
191G-Sense_Error_Rate-O--CK0100100000-
192Power-Off_Retract_Count-O--CK972509609600096%-
193Load_Cycle_Count-O--CK973109609600096%-
194Temperature_Celsius-O---K28028066000-
197Current_Pending_Sector-O--C-104100098000-
198Offline_Uncorrectable----C-104100098000-
199UDMA_CRC_Error_Count-OSRCK0200200000-
Self-test logs
No.DescriptionStatusRemainingWhenFirst Error LBA
# 1Short offlineCompleted: read failure90%279210
# 2Short offlineCompleted: read failure90%279210
# 3Short offlineCompleted: read failure90%279210
# 4Short offlineCompleted: read failure90%279210
# 5Short offlineCompleted: read failure90%279210
# 6Short offlineCompleted: read failure80%279210
# 7Short offlineCompleted: read failure90%279210
# 8Short offlineCompleted: read failure90%279210
# 9Short offlineCompleted: read failure90%279210
#10Short offlineCompleted: read failure90%279210
#11Short offlineCompleted: read failure90%279210
#12Short offlineCompleted: read failure90%279210
#13Short offlineCompleted: read failure90%279210
#14Short offlineCompleted: read failure90%279210
#15Short offlineCompleted: read failure90%279210
#16Short offlineCompleted: read failure80%279210
#17Short offlineCompleted: read failure90%279210
#18Short offlineCompleted: read failure90%279210
#19Short offlineCompleted: read failure90%279210
#20Short offlineCompleted: read failure90%279210
#21Short offlineCompleted: read failure90%279210


 
Would it really have taken 5 days+ to bung it in, format it and then copy the old stuff?

Been err busy working ;) also I had so much trouble copying the data off it in the first place I didn't just want to start it copying and walk away. It probably wouldn't have copied the hidden . files anyway if I'd plugged the old HDD into the humax. I needed to use something lie freefilesync to be sure everything had copied over.
 
However, there is still something wrong with it that fixdisk in the humax isn't wanting to fix

Just did a little investigation and spotted / remembered there is a safe mode option in the diagnostics page. So I tried this with the old HDD in and it's now stable. no crashing! this is off thread now so I'll create a new thread to ask how I start trouble shooting to find out what part of the CF is making it reboot. (link: https://hummy.tv/forum/threads/troubleshooting-rebooting-all-ok-in-safe-mode.9866/ if anyone is interested)


it takes about 45 seconds to come back to life

Again with the humax in Safe mode it responds nice and quickly now.

Oh well, I've wanted 2TB HDD for sometime so don't feel I've wasted my money.... just my time (But I guess bad sectors were starting to appear)
 
Last edited:
Some people reviewing the data below may so "oh there is nothing wrong with your HDD, the count of reallocated sectors is really low". However, there is still something wrong with it that fixdisk in the humax isn't wanting to fix.
The issue with hard drive is that fix-disk isn't managing to reduce the current_pending_sector count to zero.
 
The issue with hard drive is that fix-disk isn't managing to reduce the current_pending_sector count to zero.

Correct - it's not sorting it out. Maybe a later version of e2fsck may (ie on Ubuntu 16.04) but not got to that point yet. I want to trouble shoot the rebooting - it started to reboot itself after I ran fixdisk but what it's done I don't know. I'm reading through https://hummy.tv/forum/threads/steps-for-resolving-hdr-fox-crash-reboot-issues.5320/ at the moment, will try deleting the DNLA database first -
delete the file dms_cds.db from the root of the second partition on the disk
.
 
Correct - it's not sorting it out. Maybe a later version of e2fsck may (ie on Ubuntu 16.04) but not got to that point yet. I want to trouble shoot the rebooting - it started to reboot itself after I ran fixdisk but what it's done I don't know.
This is a link to fixing bad sectors https://www.amolak.net/fix-hard-disk-bad-sectors-in-linux/ I haven't tried it but you haven't got a lot to lose with the old hard drive.
 
Surely with a SMART-enabled disk the approach proposed there would only be applicable when the disk has exceeded its built-in pool of spare sectors, by which time it would probably be failing further sectors all the time. So you'd get a bit of operation, then hours of software-based disk checking, then a bit more operation, ...

This page describes the approach used by fix-disk, which is based on the use of the disk firmware, SMART in particular, to detect bad sectors and force them to be remapped to spare good sectors, and then fixing the affected filesystem(s).

This page gives more details of the approach and tools used in the quoted link, which dates back to the era when disk sectors were actually enumerated by sector numbers and not virtualised by on-board controller firmware, and so it was necessary to record bad sectors as part of the filesystem.

Personally, I'd back up everything from the suspect disk (if a filesystem won't mount, or there are too many errors to copy by file, I'd take an image backup using ddrescue).

Then, in order:
  1. Secure Erase and test with a long SMART test
  2. Try to zero the disk with dd if=/dev/zero ... and test with a long SMART test
  3. Try badblocks per the quoted link
  4. Let the drive's components become reused via the electronics recycling bin.
 
Personally, I'd back up everything from the suspect disk (if a filesystem won't mount, or there are too many errors to copy by file, I'd take an image backup using ddrescue).

Then, in order:
  1. Secure Erase and test with a long SMART test
  2. Try to zero the disk with dd if=/dev/zero ... and test with a long SMART test
  3. Try badblocks per the quoted link
  4. Let the drive's components become reused via the electronics recycling bin.

backup / image backup might need to be done out of the box but are you suggesting to do the rest whilst the HDD is in the Humax?

no. 4...... They make good paper weights!!

How do you execute a long SMART test? is that a normal fixdisk?

All these options will remove the current setup of the webif and it's pacakages (not forgetting the recordings) and there is no easy way it seems other than writing down what you had installed and then going through it once re installed and set it all back up. If someone knows an easier way that would be great to know.... I am assuming you are not sugesting to copy the image back over to the HDD after using ddrescue - that might bring back corrupted files etc.?

Thanks

Rodp
 
backup / image backup might need to be done out of the box but are you suggesting to do the rest whilst the HDD is in the Humax?
#2 and #3 will be much faster with the disk in a caddy attached to a more capable machine.
...How do you execute a long SMART test? is that a normal fixdisk?
It's an option there, but otherwise smartctl -t long /dev/sdx (from memory) where sdx has to be replaced by the appropriate value for the disk. Then after some period that it will suggest check the result with smartctl -l selftest /dev/sdx, and again later if the test hasn't finished, and so on.

All these options will remove the current setup of the webif and its packages (not forgetting the recordings) and there is no easy way it seems other than writing down what you had installed and then going through it once re installed and set it all back up. ...
Some settings and packages live in the flash storage and will persist regardless of the disk.

Everything else lives in /mod. Therefore you can copy over your saved /mod tree (exclude /mod/boot, which is actually the flash storage) to restore your system. In case some package files might be corrupted, you can reinstall all the packages, either manually or with a script; as the list of packages is in flash storage, you could actually do that without copying the original package files, but not all package settings are in the proper places, namely root's home directory and /mod/etc (eg, Mediatomb), so it's easier to copy everything.

As for the recordings, one benefit of ddrescue is that it tells you (like fix-disk which files might be affected by disk errors, so saving you the many hours you would otherwise have to use to watch each programme to check for errors.
 
update...

How do you execute a long SMART test? is that a normal fixdisk?

I think I figured it out.... I did fixdisk with the options -l -y and let is go - for 2 days!

Attached is the logs. It seems the long run picked up a lot more bad stuff than the normal one. My SMART log in terms of re-allocated sectors has jumped up dramatically. So I'm glad I did buy new HDD. I suspect if I run the long process again I might find more issues but it's probably time to install the new one and make sure that after having done the copying over of the recordings using a PC Live Ubuntu CD and running Freefilesync under SUDO mode, the files are still accessable, otherwise I'll be asking about I use chown
Code:
chown
and @/df will feel all smug and reply saying I told you so!! ;)


Old HDD after Normal and Long fix-disk process (just noticed after a reboot it's saving the drive is sdb - perhaps it needs a cold boot)
1600170082219.png
1600170124180.png

1600170568939.png


line 197 and 198 is building.

So I'm thinking the HDD after a few more runs detecting bad blocks (in a caddy) I'l like to use it as a temporary drive. (of non prescious stuff). What is the process? I'll probably convert if over to NTFS for what I have in mind and split it possibly into two partitions. Would that remove all the current bad blocks and I'd be back to square one again or would the HDD remember? Does formatting mean I don't need to worry about doing a security delete?

Any thoughts on the logs attached would be most welcome - some constructive comments wouldn't go a miss in amongst the - "yep - time to change it!")

Thanks

Rodp
PS. To stop the rebooting (yes still rebooting after about 5-10 minutes even though mediatomb is now off) I have turned off the recursive autoshrink and auto decrypt as suspect that is causing issues too.
 

Attachments

  • fix-disk.0 (2020-09-15) long.log
    109.8 KB · Views: 2
  • fix-disk.1 (2020-09-14) normal.log
    5.9 KB · Views: 0
Would that remove all the current bad blocks and I'd be back to square one again or would the HDD remember?
As long as there are spare sectors then the bad blocks should be mapped out by the hard drive firmware and will be remembered.
Any thoughts on the logs attached would be most welcome - some constructive comments wouldn't go a miss in amongst the - "yep - time to change it!")
The latest run still hasn't reduced the Current_pending_sector count to zero. To be honest, I wouldn't be spending any more time on this hard drive but if you want to carry on, then good luck and interested to see what you find.
 
So I'm thinking the HDD after a few more runs detecting bad blocks (in a caddy) I'l like to use it as a temporary drive. (of non prescious stuff). What is the process?
For <deity>'s sake:
Copy anything of it you want to keep. Security delete if there's anything sensitive on it. Put it in the WEEE bin. Stop trying to use it. It's broken beyond help.
 
Back
Top