1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Transmission rss feed or dropbox style folder?

Discussion in 'HD/HDR-FOX T2 Customised Firmware' started by darkflare, Feb 8, 2012.

  1. darkflare

    darkflare Member

    Hi

    I have enabled transmission and it seems to now be working excellently. In the past I have used vuze and utorrent which both have plugins for rss feed scanning and auto downloading. Good for tv episodes etc.

    Does transmission have this feature or does anyone have a solution that will sync a folder to the humax such that I can drop torrents to download into said folder and have them autostart in transmission.

    Alec.
     
  2. af123

    af123 Administrator Staff Member

    In principle you can configure transmission to look for new torrents in a directory, and if you install samba on the Humax then you could mount that directory from a PC on your network. I haven't tried that combination myself though.
     
  3. darkflare

    darkflare Member

    Interesting idea however that would require both the pc and the humax device be on and locatable at the same time.

    I'd really like to be able to set something up on the box that pulled in the torrent files rather than having to push to them. With this in mind an rss downloader is perfect as I can then host an rss feed for it to pull from. Whats the best way to build this solution. I'm an android/java programmer by trade but I noticed there are packages for python available.

    What do you think about building an rss downloader?
     
  4. darkflare

    darkflare Member

    Just to clarrify, I'm not asking you to personally build an rss downloader for me but I would value your opinion on how possible it would be to accomplish this task.

    Are there any docs on development or how to run software/scripts on the humax? I noticed theres Acron which looks like it'd be useful but im not sure how to set it up and use it.
     
  5. darkflare

    darkflare Member

    After some research I think the best approach might be to use this: http://flexget.com it seems like its already part of transmission?
     
  6. af123

    af123 Administrator Staff Member

    Sorry, I meant to get back to you. If you can find an RSS downloader written in perl, python or TCL then you could easily convert it to run on the Humax. Flexget looks perfect.
     
  7. darkflare

    darkflare Member

    The process of conversion, what does this involve?

    From the flexget site it looks like I just install some modules into transmission, install flexget, add it to cron(acron) and call it a day. If I follow this and create it for my box only what will happen when the transmission package is updated in hummy.pgk?

    I notice that flexget requires python, in order to enable python do I simply install the package via the hummy web interface?

    I really appreciate your assistance and please take your time in getting back to me. the multiple posts I placed where just to get as much information on this subject on this site so that others that may be interested have a head start!

    Alec
     
  8. darkflare

    darkflare Member

    So I've got flexget working with transmission watch folder: heres a quick summary of how to do it:

    in hummy install the following packages:
    • bash
    • python setup
    • anacron
    download a copy of flexget as a zip from there svn repo (reason being hummy svn doesnt appear to work correctly + I couldnt get a regular install of flexget to work [pip issues])

    extract flexget on server and run python bootstrap.py as detailed here http://flexget.com/wiki/Subversion

    next create a file to run flexget such as

    #!/bin/bash
    cd /mod/flexget/trunk/bin/
    source activate
    flexget

    save it (whatever.sh) chmod +x it and run it.

    You'll still need to create a config.yml but thats all explained on the flexget site. Personally I use the following:
    /mod/.flexget/config.yml
    feeds:
    tv-shows:
    rss: <rss feed url>
    download: /mnt/hd2/mod/torrents/
    accept_all: yes
    presets: {}

    after this I created the following in my anacrontab (/mod/etc/anacrontab)

    1 0 flexget bash /mod/flexgetfire.sh

    Im not sure if the cron job works just yet as I dont know how to force fire the anacron, ideas anyone?

    Oh and add the following to your transmission settings.json

    "watch-dir": "/mnt/hd2/mod/torrents/",
    "watch-dir-enabled": true

    Anyway armed with all this information does anyone thing they can package this beast into a package?

    Whatch think?
     
  9. af123

    af123 Administrator Staff Member

    Looks good. I'll package it up for you if you like. I wouldn't use bash, it's far too heavyweight for what you're doing and the standard busybox shell will work fine (it's /bin/sh)

    anacron is designed to run things one a day and is good for systems that aren't powered on all of the time.
    cron is designed to run things from time to time.

    If once a day is enough for you then anacron's fine but if you want it to run every 30 minutes while powered on for example, then you need to use cron - the configuration file for that is in /mod/var/spool/cron/crontabs/root
     
  10. darkflare

    darkflare Member

    Hi af123,

    I'd love it if you could package it for me.

    Ahhhh I see how to use sh now, its just sh script.sh. I was trying ./script.sh and it was not working.

    Hmm, I think cron may be a better route.

    With subversion i had this problem:

    svn co http://svn.flexget.com/trunk ~/flexget-dev
    svn: Can't read directory '/mod/flexget-dev': Operation now in progress

    Is it possible to have the humax start up at 1am and shutdown at 7am (good for avoiding isp bit torrent throttling) ? And the icing on the cake, have the humax shutdown if theres no network activity, so saving energy if theres no reason to stay on over night.
     
  11. af123

    af123 Administrator Staff Member

    How often do you want it to run by default?

    Yes, I see it now - strange, it works fine for everything I check in from my repository.

    Yes through the standard on/off timers or by adding extra timers through the rs portal.
    You can also tell Transmission to only download at those times of course.

    Nobody has worked out how to do that yet although it may be possible to inject something into the remote control stream from within the box (a side project of mine which isn't anywhere near finished yet)
     
  12. darkflare

    darkflare Member

    I think hourly would be a good time. I *think* that will avoid being banned from rss feed's.
    Any longer and I worry it could never be fired due to the box being on standby etc.

    I've got transmission doing some specialised timed downloading and I'll adjust my on and of times for the box, thanks.

    Good luck!
     
  13. af123

    af123 Administrator Staff Member

    The flexget package is in the repository now. I've packaged it without the compiled python modules so the first time it runs it takes a bit longer because it needs to create them but it keeps the package much smaller.

    It installs a demo config file in /mod/.flexget/config.yml and an empty /mod/torrents directory but doesn't modify the transmission configuration automatically. It adds a cron entry (run crontab -l to view the entries) to run the job once an hour.

    It's working fine on my box and has nicely automated something I used to do by hand : ) Thanks for the pointer!

    Can you give it a go and see if it works as expected?
     
  14. darkflare

    darkflare Member

    So I installed it... wow, it works beautifully. I've no idea how you got flexget executing without using virtualenv thank you!!

    I installed it however it didnt overwrite my config.yml so I cant verify that a dummy config is created but on the first run of flexget it'll create the config.yml if it doesnt exist.

    A little tip for a personal torrent rss stream is to use ReadItLaterList and save your torrents to download on that. It produces an rss feed that you can plug into flexget. Theres a firefox plugin for firefox that allows rightclick "save to read it later" which makes adding things to your hummy transmission a doddle.

    Thanks again for packaging it up!
     
  15. af123

    af123 Administrator Staff Member

    That's fine - I told the packaging systmem that config.yml is a config file so it won't overwrite any that is there but there is a placeholder file in the package.

    Glad it's working for you - I've just pointed mine at a well known easytv feed and it's working a treat.
     
  16. Andi

    Andi New Member

    Morning all.

    Watched this thread with interest - returned from holiday to find it's come a long way!!

    Upon installing, I get this error:

    Code:
    
    >>> opkg install flexget
    
    Installing flexget (1.0r2710) to root...
    
    Downloading http://hummypkg.org.uk/hdrfoxt2/base/flexget_1.0r2710_mipsel.opk.
    
    Configuring flexget.
    
    Collected errors:
    
    * file_md5sum_alloc: Failed to open file /mod/.flexget/config.yml: No such file or directory.
    
    I telnet'd in and ran the file:
    Code:
    
    humax# flexget
    2012-02-19 01:26 INFO manager Tried to read from: /mnt /hd2/mod/lib/flexget, /mod/.flexget
    2012-02-19 01:26 CRITICAL mainFailed to find configura tion file config.yml
    2012-02-19 01:26 INFO manager Tried to read from: /mnt /hd2/mod/lib/flexget, /mod/.flexget
    2012-02-19 01:26 CRITICAL mainFailed to find configura tion file config.yml
    
    So, as a default, I have no config.yml file...
    I'll create that folder and get a config.yml file setup from the Flexget website and report back.
     
  17. Andi

    Andi New Member

    So, created the config.yml, found the settings.json for Transmission, all tweaked as the post above, and all running great!

    Even tweaked Transmission to plonk its finished downloads in a [Torrents] folder instead of torrents - so it's like the other "special" folders in My Videos.

    Simple question - adding another rss feed to config.yml would just be adding another rss: line?
     
  18. darkflare

    darkflare Member

    You need to add another section, here is an example with 2 rss feeds:

    Code:
    feeds:
      tv-shows:
        rss: http://rss1
        download: /mnt/hd2/mod/torrents/
        accept_all: yes
      xmarks:
        rss: http://rss2
        download: /mnt/hd2/mod/torrents/
        accept_all: yes
    presets: {}
    Note the spacing is important :)
    What do you mean by special folders? That sounds interesting.
     
  19. Andi

    Andi New Member

    Ah, I get it now. Perfect, thanks :)
    Could we get unrar compiled for Humax and then triggered by Transmission... ?

    And special folders as in the ones created in My Videos by Undelete and EasyNetworkMount :)
     
  20. af123

    af123 Administrator Staff Member

    Special folders are just ones where the name is bracketed with square braces. It is a convention that has been adopted over the past few months and several packages leave those folders alone when scanning the disk.

    unrar could be compiled (or probably something like 7-zip instead) - just need to watch how much load you're putting on the box if you want it to carry on doing its day job.

    Regarding torrents, the odd one is ok but if you had a long list of active torrents it might start to cause issues. It would be interesting to hear from anyone who has a few on the go (seeding or downloading)