[FlatView] Provide flattened view of recordings

[Black Hole]

This has now sorted itself out, there appears to be a period of time where the file is deleted from [Flatview] but is still present in the folder hierarchy, however the folder version also finds it's way to [Deleted] after this delay

You have to remember that the flatview package creates its effect by interacting with the SUI. When you delete the proxy of a recording in the [Flatview] folder using the SUI, the package has to detect this and then roll the effect through to the real recording (which then ends up in the undelete bin). Hence the delay.

 

[xyz321]

I imagine this means there is no actual deletion and undelete is not invoked?

Undelete will be invoked on the "copy" in the hierarchical tree when it is targeted for deletion by flatview.

At what point is the flatview listing frozen - is it invoked on the end-of-recording event, or periodically refreshed on scan? To create the initial flattened view on installation there has to be a scanning process, and if there is a periodic scan then the moved entry will be found again .

All of the above. The periodic scan takes place every 20 minutes by the "auto" process in cron. This performs housekeeping for various pacakges including flatview.

 

[xyz321]

Question : Having watched a recording by selecting it from the [Flatview] folder, I then deleted the file from [flatview], (I have Undelete installed), however when I navigated to the folder where the recording resides, the recording was still there. I presumed that there was a single file with two ways to get to it i.e. via [flatview] and the folder hierarchy, but if this is the case shouldn't both the [flatview] and the folder versions both be deleted at the same time or in my case both versions moved to the [Deleted] folder?
EDIT
This has now sorted itself out, there appears to be a period of time where the file is deleted from [Flatview] but is still present in the folder hierarchy, however the folder version also finds it's way to [Deleted] after this delay

Another file deleted from [flatview] took over 10 Mins. before it's twin folder was moved to [Deleted]

The deletions are normally picked up by the cron task which runs every 20 minutes.

 

[af123]

The deletions are normally picked up by the cron task which runs every 20 minutes.

There is also recmon integration which should have picked that instance up earlier (remon.log might have some clues). It's likely that it couldn't get a lock because some other part of flatview was already running.
It is likely that in some cases you'll see almost immediate results and in others there may be a delay of up to 20 minutes.

 

[rpb424]

I've encountered an issue that I'm not quite sure how to get out of...

I installed FlatView, and set it to show recordings newer than 7 days, including already watched. After a while the folder populated with the relevant recordings - great. Later on I decided that I'd prefer the folder to be called ' [Recent]' (including the leading space), so set this in the options. A ' [Recent]' folder duly appeared, but the original ' [FlatView]' folder also remained, both of which were populated. I wasn't sure whether it would be safe to simply ssh in and delete the [FlatView] folder contents and then the folder itself, in case it took all the recordings from the real location away with it as well, not understanding the underlying mechanism.

I tried an uninstall of the FlatView package, which took away the [Recent] folder, but has left the original [FlatView] folder behind, so the question is how do I safely get rid of this without losing the recordings that it still lists?

 

[MontysEvilTwin]

Excellent package. I never bothered with Flatten because I like series to be kept in folders; this is like having your cake and eating it.
I have run in to a similar problem to rpb424 though. I also renamed the folder to ' [Recent]' and got this and a ' [FlatView]' folder. I rebooted a couple of times and left it for a while but it persisted, so I deleted the FlatView folder. This seemed OK, but as the FlatView folder, now in '[Deleted Items]', was still populated I decided to fully delete it. I thought it better to risk losing some recordings now before the encrypted originals are deleted too. Deleting the Flatview folder did not delete the recordings from their true locations but it did cause problems in Web-If. For example, a folder containing a single series recording that was linked to in the deleted FlatView folder now appears almost empty (8.0KB), but still contains the recording, and shows the true file size (1.8GB) when I navigate into the folder. I uninstalled the FlatView package and Web-If returned to normal. But if I reinstall the package again the problem returns. The FlatView folder is still called 'Recent' too (which I want), so I presume a configuration/ database file was left behind when the package was removed. I have uninstalled the package again now. Presumably editing the config. file to remove the list of recordings before reinstalling again would fix the problem?
BTW the the FlatView (and renamed Flatview) folders have a new icon in Web-If. Other bracketed folders (e.g. [Deleted Items]) also have this icon too when the package is installed.

 

[af123]

I've encountered an issue that I'm not quite sure how to get out of...

It is safe to remove the original [FlatView] folder via the web interface, command line or the standard Humax GUI.

 

[af123]

..., so I presume a configuration/ database file was left behind when the package was removed. I have uninstalled the package again now. Presumably editing the config. file to remove the list of recordings before reinstalling again would fix the problem?

I can't explain this but I'll try to replicate it!
Changing the folder from the settings screen should really handle this for you, I'll add that to the next version.

 

[af123]

MontysEvilTwin - I can't replicate it on my box, is there anything in your webif-error log?

 

[MontysEvilTwin]

MontysEvilTwin - I can't replicate it on my box, is there anything in your webif-error log?

I'll have a look tonight. After I changed the folder name in the settings panel, I also increased the number of days to show, so the ' [Flatview]' folder I deleted had fewer entries in it than the new folder I created. I don't know if this is significant.

 

[af123]

Try clearing your browser cache too if you haven't already. The only thing that flatview does to the standard browsing screen in your version is to add the 'noflatten' icons and OPT+ menu items to manage them.

 

[MymsMan]

Flatview is not working for me - the directory is empty.

I don't currently have anything in series folders since I have only just uninstalled Flatten but I do have a number of recent entries in the root My Videos folder which I would expect to see (unless I have misunderstood the intent).

I can't see anything that might be relevant in any of the logs

I think I have found the problem - for some reason (lost in the mists of time) my 'My Video' had the No Flatten flag set and it appears that was causing FlatView to delete the files soon after adding them to the directory. Now that I have removed the flag the directory is populated though it hasn't yet found the older recordings after I removed the Age limit option,

What is nice is that the DetactAds -crop files for active recordings have appeared allowing chase play even though the recordings themselves haven't appeared.

Why doesn't the Recmon exit trigger on -start rather than -stop to allow chase play of all recordings?

There does appear to be a least one undefined variable error in the code
recmon.log

905 at file "/mod/webif/plugin/flatview/auto.hook", line 252
904 in procedure '::flatview::link_rec' called at file "/mod/webif/plugin/flatview/auto.hook", line 290
903 in procedure '::flatview::process_dir' called at file "/mod/webif/plugin/flatview/auto.hook", line 287
902 in procedure 'process_dir' called at file "/mod/webif/plugin/flatview/auto.hook", line 305
901 in procedure '::flatview::scan' called at file "/mod/etc/recmon.d/flatview", line 38
900 /mod/webif/plugin/flatview/auto.hook:252: Error: can't read "f": no such variable
899 14/10/2015 14:59:51 detectads: -delete {/media/My Video/ [FlatView]/Countdown_20151014_1409}
898 14/10/2015 14:59 - FV: --> Removing Countdown_20151014_1409 (orphaned)
897 14/10/2015 14:59 - FV: --> Removing Countdown_20151014_1409-dec (orphaned)
896 at file "/mod/webif/lib/fileops", line 80
895 in procedure 'file' called at file "/mod/webif/plugin/flatview/auto.hook", line 123
894 in procedure '::flatview::build_flatlist' called at file "/mod/webif/plugin/flatview/auto.hook", line 303
893 in procedure '::flatview::scan' called at file "/mod/etc/recmon.d/flatview", line 38
892 /mod/webif/lib/fileops:80: Error: Cannot read /media/My Video/ [FlatView]/Countdown_20151014_1409.info
891 14/10/2015 14:59:48 detectads: -delete {/media/My Video/ [FlatView]/Countdown_20151014_1409-dec}
890 14/10/2015 14:59:39 detectads: -delete {/media/My Video/Countdown/Countdown_20151014_1409-dec}
889 14/10/2015 14:59:38 detectads: -stop {/media/My Video/Countdown/Countdown_20151014_1409-dec}
888 14/10/2015 14:59 - FV: +++ Adding Countdown_20151014_1409-dec
887 14/10/2015 14:59:37 detectads: -move {/media/My Video/Countdown/Countdown_20151014_1409}
886 14/10/2015 14:59 - FV: +++ Adding Countdown_20151014_1409
885 14/10/2015 14:59:16 detectads: -stop {/media/My Video/Countdown/Countdown_20151014_1409}
884 14/10/2015 14:59:12 detectads: -start {/media/My Video/Fifteen To One/Fifteen to One_20151014_1459}
883 14/10/2015 14:09:22 detectads: -start {/media/My Video/Countdown/Countdown_20151014_1409}

auto.log

3616 14/10/2015 14:25:16 - Completed postexpirescan plugin ::flatview::scan
3615 14/10/2015 14:25:16 -   @ /mod/webif/lib/bin/auto:::flatview::scan:123
3614 14/10/2015 14:25:16 -   @ /mod/webif/plugin/flatview/auto.hook:process_dir:305
3613 14/10/2015 14:25:16 -   @ /mod/webif/plugin/flatview/auto.hook:::flatview::process_dir:287
3612 14/10/2015 14:25:16 -   @ /mod/webif/plugin/flatview/auto.hook:::flatview::link_rec:290
3611 14/10/2015 14:25:16 -   @ /mod/webif/plugin/flatview/auto.hook::252
3610 14/10/2015 14:25:16 - Plugin error: can't read "f": no such variable
3609 14/10/2015 14:25:16 - FV: +++ Adding Countdown_20151014_1409-crop
3608 14/10/2015 14:25:16 - FV:   [/media/My Video/Countdown]
3607 14/10/2015 14:25:16 - FV: +++ Adding New_ The Gadget Show_20151013_1900
3606 14/10/2015 14:25:16 - FV:   [/media/My Video/New_ The Gadget Show]
3605 14/10/2015 14:25:16 - FV:   [/media/My Video/BBC News at Ten]
3604 14/10/2015 14:25:16 - FV: +++ Adding River_20151013_2101
3603 14/10/2015 14:25:16 - FV:   [/media/My Video/River]
3602 14/10/2015 14:25:16 - FV:   [/media/My Video/The Chase]
3601 14/10/2015 14:25:16 - FV: +++ Adding Tipping Point_20151012_1555
3600 14/10/2015 14:25:15 - FV: +++ Adding New_ CSI_ Cyber_20151013_2259
3599 14/10/2015 14:25:15 - FV:   [/media/My Video/New_ CSI_ Cyber]
3598 14/10/2015 14:25:15 - FV:   [/media/My Video/New_ Lewis]
3597 14/10/2015 14:25:15 - FV: +++ Adding South Today_20151013_1828
3596 14/10/2015 14:25:15 - FV:   [/media/My Video/South Today]
3595 14/10/2015 14:25:15 - FV: [/media/My Video]
3594 14/10/2015 14:25:15 - Running postexpirescan plugin ::flatview::scan (priority 50) [processed_files]

 

[Ezra Pound]

I have an entry in [flatview] I wasn't expecting, I have Unwatched only = No and limited by age = yes (90 days)



The entry came from the folder below where there are entries called Hitchhiker's01 to 12, not sure why it only included 11, it is also older than 90 days, I was wondering if the problem was the apostrophe. The file in [flatview] is not an orphaned *.hmt as the folder has a full set of files for '11'



EDIT
I have a bit more info.,
1) The file was automatically removed at a later date from [flatview]
2) I now realise that I played a small part of '11' yesterday
3) The recording is from BBC radio (audio only)

 

[MontysEvilTwin]

Try clearing your browser cache too if you haven't already. The only thing that flatview does to the standard browsing screen in your version is to add the 'noflatten' icons and OPT+ menu items to manage them.

I've refreshed the cache, installed and reinstalled the package, reinstalled Web-If, and tried moving the recordings to new folders, deleting the original folders and renaming the new folders: if you recreate the old folder name the problem reappears. I have pasted examples below. Compare the sizes viewed from 'My Video' to the sizes within the actual folders:

Is the FlatView file information stored in a database? The above only occurs with files that were listed in the original FlatView folder that I deleted. I don't believe it is cache related as I get the same in three different browsers on different platforms (Android and Windows). If I uninstall Flatview, the filesizes are displayed correctly again:

 

[HarveyB]

Same problem here.
I have two episodes of Lewis in the Lewis folder. Each is 1GB.
I have watched one episode.
[Flatview] lists the unwatched episode.

The Lewis Folder shows a size of 1GB instead I'd 2GB!!!!

EDIT: It does seem a bit random though. In another case I have a folder with five recordings, all unwatched.
One is listed in Flatview (7 day rule), but folder size is correct.

 

[cdmackay]

A friend has a problem... (no really, it's not me this time)

I strongly recommended FlatView, but he mistakenly installed flatten, and it has, well, flattened his recordings.

This was on a 2TB machine, with almost 2,000 recordings. so he now has problems doing anything...

Is there any way (other than backups), he can get back what was there before?

[apols, I suppose this should be in a flatten thread, if there is one?]

thanks much.

===

re FlatView

I tried disabling the age limit, but it resulted in a FlatView dir that WebIF spent lots of time without loading, so I gave up on it. I too have hundreds of recordings...

 

[MymsMan]

A friend has a problem... (no really, it's not me this time)

I strongly recommended FlatView, but he mistakenly installed flatten, and it has, well, flattened his recordings.

This was on a 2TB machine, with almost 2,000 recordings. so he now has problems doing anything...

Is there any way (other than backups), he can get back what was there before?

[apols, I suppose this should be in a flatten thread, if there is one?]

thanks much.

You might be able to create some sweeper rules to move them back to the correct folders but it would take a bit of effort to create and test.

An alternative would be to use command line and a series of generic move commands to move whole series to a new folder.

Both of these ideas assume he hasn't used dedupe or similar and that the series name is still at the beginning of the filename otherwise it will be more difficult to find a pattern to match a series of programs.

 

[af123]

The hmt files may still contain the original folder and if so it would be possible to write a script to move everything back to where it was originally recorded. I'm not is a position to look at it for half an hour but I can have a look then.

 

[af123]

cdmackay - ask your "friend" to run the unflatten-test diagnostic. That should list the first 20 recordings along with where it thinks it originally came from. If that looks ok, the unflatten diagnostic should move them all back.

 

[Black Hole]