How do I install Flexget FreeNAS 9.3

[John Croney]

I am trying to install flexget as I have done in the previous versions in a jail but getting that flexget is not found.

 

[Joshua Parker Ruehlig]

I am trying to install flexget as I have done in the previous versions in a jail but getting that flexget is not found.

http://www.freshports.org/www/py-flexget/
looks like no package is available cause it doesn't work with the latest py-dateutil. you should be able to work around this

 

[Scharbag]

From my other post (search for FlexGet):

Here is a simple shell script that will get FlexGet installed super fast in a standard jail in 9.3:

Code:

#!/bin/sh
pkg upgrade -y
pkg install -y net/py-urllib3 databases/py-sqlite3 devel/py-pip rar unrar nano

pip install --upgrade pip
pip install --upgrade setuptools
pip install flexget
pip install --upgrade flexget
pip install transmissionrpc
pip install --upgrade transmissionrpc

RAR, UNRAR and NANO are not needed. I use them though.

Cheers,

 

[John Croney]

Thanks Joshua. I was able to get it install flexget but it an old version. Is there a way to upgrade or get a newer version?

 

[John Croney]

Thanks also Scharbag. Have you tested that in 9.3? I know how to install flexget but it seems that it is not in the ports for 9.3 and therefore return a not found.

As mentioned above in my post I was able to install flexget with the help from Joshua so I cant install flexget again but this is an example and it is somewhat like the response I get from pip install flexget.

Code:

 
pip install --upgrade setuptools
Cannot fetch index base URL http://pypi.python.org/simple/
Could not find any downloads that satisfy the requirement distribute in /usr/local/lib/python2.7/site-packages/distribute-0.6.35-py2.7.egg
Downloading/unpacking distribute
No distributions at all found for distribute in /usr/local/lib/python2.7/site-packages/distribute-0.6.35-py2.7.egg
Storing complete log in /root/.pip/pip.log

 

[Scharbag]

If you create a standard jail in 9.3 and run the commands in my post, FlexGet will be installed as the latest version and will work fine. I have it running on 9.3 now at 1.2.264. I think the biggest thing that needs to be done is the pkg upgrade. There are a few dependencies that are just too old for FlexGet in the base jail.

Cheers,

 

[John Croney]

Thanks Scharbag for the help. I have done as you said and this is the result

Code:

Updating FreeBSD repository catalogue...
FreeBSD repository is up-to-date.
All repositories are up-to-date.
Checking for upgrades (0 candidates): 100%
Processing candidates (0 candidates): 100%
Checking integrity... done (0 conflicting)
Your packages are up to date.
Updating FreeBSD repository catalogue...
FreeBSD repository is up-to-date.
All repositories are up-to-date.
Checking integrity... done (0 conflicting)
The most recent version of packages are already installed
Cannot fetch index base URL http://pypi.python.org/simple/
Could not find any downloads that satisfy the requirement pip in /usr/local/lib/python2.7/site-packages/pip-1.2.1-py2.7.egg
Downloading/unpacking pip
No distributions at all found for pip in /usr/local/lib/python2.7/site-packages/pip-1.2.1-py2.7.egg
Storing complete log in /root/.pip/pip.log
Cannot fetch index base URL http://pypi.python.org/simple/
Could not find any downloads that satisfy the requirement distribute in /usr/local/lib/python2.7/site-packages/distribute-0.6.35-py2.7.egg
Downloading/unpacking distribute
No distributions at all found for distribute in /usr/local/lib/python2.7/site-packages/distribute-0.6.35-py2.7.egg
Storing complete log in /root/.pip/pip.log
Requirement already satisfied (use --upgrade to upgrade): flexget in /usr/local/lib/python2.7/site-packages
Requirement already satisfied (use --upgrade to upgrade): FeedParser>=5.1.2 in /usr/local/lib/python2.7/site-packages (from flexget)
Requirement already satisfied (use --upgrade to upgrade): SQLAlchemy>=0.7,<0.7.99 in /usr/local/lib/python2.7/site-packages (from flexget)
Requirement already satisfied (use --upgrade to upgrade): PyYAML in /usr/local/lib/python2.7/site-packages (from flexget)
Requirement already satisfied (use --upgrade to upgrade): BeautifulSoup>=3.2,<3.3 in /usr/local/lib/python2.7/site-packages (from flexget)
Requirement already satisfied (use --upgrade to upgrade): beautifulsoup4>=4.1,<4.2 in /usr/local/lib/python2.7/site-packages (from flexget)
Requirement already satisfied (use --upgrade to upgrade): html5lib>=0.11 in /usr/local/lib/python2.7/site-packages (from flexget)
Requirement already satisfied (use --upgrade to upgrade): PyRSS2Gen in /usr/local/lib/python2.7/site-packages (from flexget)
Requirement already satisfied (use --upgrade to upgrade): pynzb in /usr/local/lib/python2.7/site-packages (from flexget)
Requirement already satisfied (use --upgrade to upgrade): progressbar in /usr/local/lib/python2.7/site-packages (from flexget)
Requirement already satisfied (use --upgrade to upgrade): jinja2 in /usr/local/lib/python2.7/site-packages (from flexget)
Requirement already satisfied (use --upgrade to upgrade): flask in /usr/local/lib/python2.7/site-packages (from flexget)
Requirement already satisfied (use --upgrade to upgrade): cherrypy in /usr/local/lib/python2.7/site-packages (from flexget)
Downloading/unpacking requests>=0.14,<0.15 (from flexget)
  Cannot fetch index base URL http://pypi.python.org/simple/
  Could not find any downloads that satisfy the requirement requests>=0.14,<0.15 (from flexget)
No distributions at all found for requests>=0.14,<0.15 (from flexget)
Storing complete log in /root/.pip/pip.log
Cannot fetch index base URL http://pypi.python.org/simple/
Could not find any downloads that satisfy the requirement flexget in /usr/local/lib/python2.7/site-packages
Downloading/unpacking flexget
No distributions at all found for flexget in /usr/local/lib/python2.7/site-packages
Storing complete log in /root/.pip/pip.log
Requirement already satisfied (use --upgrade to upgrade): transmissionrpc in /usr/local/lib/python2.7/site-packages
Requirement already satisfied (use --upgrade to upgrade): six>=1.1.0 in /usr/local/lib/python2.7/site-packages (from transmissionrpc)
Cleaning up...
Cannot fetch index base URL http://pypi.python.org/simple/
Could not find any downloads that satisfy the requirement transmissionrpc in /usr/local/lib/python2.7/site-packages
Downloading/unpacking transmissionrpc
No distributions at all found for transmissionrpc in /usr/local/lib/python2.7/site-packages
Storing complete log in /root/.pip/pip.log
root@Flexget:/ # flexget -V
1.0.3273

 

[Scharbag]

I copied the text from the post above and it replaced the -- with strange characters... Check and make sure the syntax is OK.

I had one though, though it should not matter, but asa result I changed the script to:

Code:

#!/bin/sh

pkg upgrade -y
pkg install -y net/py-urllib3 databases/py-sqlite3 devel/py-pip rar unrar nano
pip install flexget
pip install transmissionrpc
pip install --upgrade pip
pip install --upgrade setuptools
pip install --upgrade flexget
pip install --upgrade transmissionrpc

It changes the order of when pip and setuptools are updated. Don't see why this would make a diff but it does work.

I just ran the script above in a fresh standard jail and it all worked fine (I even setup the user and shares and executed a copy of my config):

Code:

sh FlexGetInstaller.sh

Updating FreeBSD repository catalogue...

[Test] Fetching meta.txz: 100%   968 B   1.0k/s    00:01   

[Test] Fetching digests.txz: 100%    2 MB   1.0M/s    00:02   

[Test] Fetching packagesite.txz: 100%    5 MB   1.1M/s    00:05   

Removing expired repository entries: 100%

Processing new repository entries: 100%

FreeBSD repository update completed. 23774 packages processed:

  22695 updated, 824 removed and 1079 added.

New version of pkg detected; it needs to be installed first.

The following 1 packages will be affected (of 0 checked):



Installed packages to be UPGRADED:

    pkg: 1.3.7 -> 1.4.4



The operation will free 96 kB.

2 MB to be downloaded.

[Test] Fetching pkg-1.4.4.txz: 100%    2 MB   1.0M/s    00:02   

Checking integrity... done (0 conflicting)

[Test] [1/1] Upgrading pkg from 1.3.7 to 1.4.4: 100%

Updating FreeBSD repository catalogue...

FreeBSD repository is up-to-date.

All repositories are up-to-date.

Checking for upgrades (26 candidates): 100%

Processing candidates (26 candidates): 100%

The following 29 packages will be affected (of 0 checked):



New packages to be INSTALLED:

    gettext-runtime: 0.19.3

    libffi: 3.2.1

    gettext-tools: 0.19.3



Installed packages to be UPGRADED:

    subversion: 1.8.10_1 -> 1.8.11

    sqlite3: 3.8.6 -> 3.8.7.4

    serf: 1.3.7 -> 1.3.8

    python27: 2.7.8_4 -> 2.7.9

    perl5: 5.16.3_11 -> 5.18.4_11

    p5-Socket: 2.015 -> 2.016_1

    p5-Net-SSLeay: 1.65 -> 1.66_1

    p5-Net-SMTP-SSL: 1.01_2 -> 1.01_3

    p5-Mozilla-CA: 20130114 -> 20130114_1

    p5-MIME-Base64: 3.14 -> 3.15

    p5-IO-Socket-SSL: 1.997_2 -> 2.009

    p5-IO-Socket-IP: 0.31 -> 0.36

    p5-GSSAPI: 0.28 -> 0.28_1

    p5-Error: 0.17022 -> 0.17022_1

    p5-Digest-HMAC: 1.03 -> 1.03_1

    p5-Authen-SASL: 2.16 -> 2.16_1

    libiconv: 1.14_3 -> 1.14_6

    indexinfo: 0.2 -> 0.2.2

    git: 2.1.0 -> 2.2.2_1

    gettext: 0.18.3.1_1 -> 0.19.3

    expat: 2.1.0_1 -> 2.1.0_2

    db5: 5.3.28_1 -> 5.3.28_2

    curl: 7.37.1_2 -> 7.40.0

    ca_root_nss: 3.16.3 -> 3.17.3_1

    apr: 1.5.1.1.5.3_4 -> 1.5.1.1.5.4



Installed packages to be REINSTALLED:

    gdbm-1.11_2 (direct dependency changed)

.
.
.

New packages to be INSTALLED:

    py27-urllib3: 1.10

    py27-sqlite3: 2.7.9_5

    py27-pip: 1.5.6

    rar: 5.1.0,3

    unrar: 5.10,5

    nano: 2.2.6

    py27-ndg_httpsclient: 0.3.3

    py27-openssl: 0.14

    py27-cryptography: 0.5.4

    py27-six: 1.8.0

    py27-setuptools27: 5.5.1

    py27-cffi: 0.8.6_2

    py27-pycparser: 2.10

    python2: 2_3

    py27-asn1: 0.1.7,1

.
.
.

Downloading/unpacking flexget

  Downloading FlexGet-1.2.264.tar.gz (862kB): 862kB downloaded

  Running setup.py (path:/tmp/pip_build_root/flexget/setup.py) egg_info for package flexget

.
.
.

root@Test:/mnt/Warez/FreeNAS Files # flexget -V

1.2.264

You are on the latest release.

root@Test:/mnt/Warez/FreeNAS Files # pip install --upgrade flexget

Requirement already up-to-date: flexget in /usr/local/lib/python2.7/site-packages

Requirement already up-to-date: FeedParser>=5.1.3 in /usr/local/lib/python2.7/site-packages (from flexget)

Requirement already up-to-date: SQLAlchemy!=0.9.0,<0.9.99,>=0.7.5 in /usr/local/lib/python2.7/site-packages (from flexget)

Requirement already up-to-date: PyYAML in /usr/local/lib/python2.7/site-packages (from flexget)

Requirement already up-to-date: beautifulsoup4!=4.2.0,<4.4,>=4.1 in /usr/local/lib/python2.7/site-packages (from flexget)

Requirement already up-to-date: html5lib>=0.11 in /usr/local/lib/python2.7/site-packages (from flexget)

Requirement already up-to-date: PyRSS2Gen in /usr/local/lib/python2.7/site-packages (from flexget)

Requirement already up-to-date: pynzb in /usr/local/lib/python2.7/site-packages (from flexget)

Requirement already up-to-date: progressbar in /usr/local/lib/python2.7/site-packages (from flexget)

Requirement already up-to-date: rpyc in /usr/local/lib/python2.7/site-packages (from flexget)

Requirement already up-to-date: jinja2 in /usr/local/lib/python2.7/site-packages (from flexget)

Requirement already up-to-date: requests!=2.4.0,<2.99,>=1.0 in /usr/local/lib/python2.7/site-packages (from flexget)

Requirement already up-to-date: python-dateutil!=2.0,!=2.2 in /usr/local/lib/python2.7/site-packages (from flexget)

Requirement already up-to-date: jsonschema>=2.0 in /usr/local/lib/python2.7/site-packages (from flexget)

Requirement already up-to-date: python-tvrage in /usr/local/lib/python2.7/site-packages (from flexget)

Requirement already up-to-date: tmdb3 in /usr/local/lib/python2.7/site-packages (from flexget)

Requirement already up-to-date: path.py in /usr/local/lib/python2.7/site-packages (from flexget)

Requirement already up-to-date: guessit>=0.9.3 in /usr/local/lib/python2.7/site-packages (from flexget)

Requirement already up-to-date: apscheduler in /usr/local/lib/python2.7/site-packages (from flexget)

Requirement already up-to-date: six in /usr/local/lib/python2.7/site-packages (from html5lib>=0.11->flexget)

Requirement already up-to-date: setuptools in /usr/local/lib/python2.7/site-packages (from pynzb->flexget)

Requirement already up-to-date: plumbum in /usr/local/lib/python2.7/site-packages (from rpyc->flexget)

Requirement already up-to-date: markupsafe in /usr/local/lib/python2.7/site-packages (from jinja2->flexget)

Requirement already up-to-date: BeautifulSoup in /usr/local/lib/python2.7/site-packages (from python-tvrage->flexget)

Requirement already up-to-date: babelfish>=0.5.3 in /usr/local/lib/python2.7/site-packages (from guessit>=0.9.3->flexget)

Requirement already up-to-date: stevedore>=0.14 in /usr/local/lib/python2.7/site-packages (from guessit>=0.9.3->flexget)

Requirement already up-to-date: argparse in /usr/local/lib/python2.7/site-packages (from guessit>=0.9.3->flexget)

Requirement already up-to-date: futures in /usr/local/lib/python2.7/site-packages (from apscheduler->flexget)

Requirement already up-to-date: pytz in /usr/local/lib/python2.7/site-packages (from apscheduler->flexget)

Requirement already up-to-date: tzlocal in /usr/local/lib/python2.7/site-packages (from apscheduler->flexget)

Requirement already up-to-date: pbr!=0.7,<1.0,>=0.6 in /usr/local/lib/python2.7/site-packages (from stevedore>=0.14->guessit>=0.9.3->flexget)

Requirement already up-to-date: pip in /usr/local/lib/python2.7/site-packages (from pbr!=0.7,<1.0,>=0.6->stevedore>=0.14->guessit>=0.9.3->flexget)

I suggest you try this on a completely fresh 9.3 jail and see if you can get it to work.

To be complete, there are a few environment variables that you need to set in the .cshrc for FlexGet to execute without strange errors (and to use nano instead of vi):

Code:

setenv  EDITOR nano
setenv LC_ALL 'en_US.UTF-8'
setenv LANG 'en_US.UTF-8'
setenv MM_CHARSET 'UTF-8'
setenv TZ America/<TIMEZONEHERE>

If you want FlexGet to start with the jail, execute the following crontab from the user that runs FlexGet (assuming you use the FlexGet scheduler plugin):

Code:

# +--------- Minute (0-59)                    | Output Dumper: >/dev/null 2>&1
# | +------- Hour (0-23)                      | Multiple Values Use Commas: 3,12,47
# | | +----- Day Of Month (1-31)              | Do every X intervals: */X  -> Example: */15 * * * *  Is every 15 minutes
# | | | +--- Month (1 -12)                    | Aliases: @reboot -> Run once at startup; @hourly -> 0 * * * *;
# | | | | +- Day Of Week (0-6) (Sunday = 0)   | @daily -> 0 0 * * *; @weekly -> 0 0 * * 0; @monthly ->0 0 1 * *;
# | | | | |                                   | @yearly -> 0 0 1 1 *;
# * * * * * COMMAND                           |
@reboot /usr/local/bin/flexget daemon start -d

 

[John Croney]

Thanks very much for your help

I know how it is when it works one place and not another.

I was thinking of the same thing, of creating a new jail. I also wanted to move to a USB for jails but wanted to get it to work first.

with regards to .cshrc, do I just run those commands from that folder or vi .cshrc and add the lines. (I then to like vi than nano)

Would keep you posted on the result of the new jail and flexget

Again thanks

 

[Scharbag]

Yeah, you have to vi .cshrc and add the lines in the environment variables section. I am sure there is some other way to push the edits in but I am not that good with the terminal.

Definitely try a new jail. I banged my head against this for a little while using the same jail that previously failed to work properly and it never worked out. It is so quick to make a new jail in FreeNAS too!!

Let me know how it goes.

Cheers,

 

[John Croney]

Did not work.

This is the code

Code:

#!/bin/sh
pkg upgrade -y
pkg install -y net/py-urllib3 databases/py-sqlite3 devel/py-pip rar unrar nano
pip install --upgrade pip
pip install --upgrade setuptools
pip install flexget
pip install —upgrade flexget
pip install transmissionrpc
pip install —upgrade transmissionrpc

This the result

Code:

 ./installflexget
Updating local repository catalogue...
pkg: file:///usr/ports/packages/meta.txz: No such file or directory
pkg: repository local has no meta file, using default settings
pkg: file:///usr/ports/packages/digests.txz: No such file or directory
pkg: Unable to update repository local
All repositories are up-to-date.
Checking for upgrades (1 candidates): 100%
Checking integrity... done (0 conflicting)
Your packages are up to date.
Updating local repository catalogue...
pkg: file:///usr/ports/packages/meta.txz: No such file or directory
pkg: repository local has no meta file, using default settings
pkg: file:///usr/ports/packages/digests.txz: No such file or directory
pkg: Unable to update repository local
All repositories are up-to-date.
pkg: No packages available to install matching 'net/py-urllib3' have been found in the repositories
./installflexget: pip: not found
./installflexget: pip: not found
./installflexget: pip: not found
./installflexget: pip: not found
./installflexget: pip: not found
./installflexget: pip: not found

 

[Scharbag]

Did you call your script installflexget?

I call the shell script with "sh <scriptname>.sh" while logged in as the root user in a new jail. Make sure that the script is executable with a "chmod +x <scriptname>.sh

What do you get if you execute pkg upgrade -y at a root level prompt?

Cheers,

 

[John Croney]

[root@freenas] ~# su
[root@freenas] ~# pkg upgrade -y
Updating local repository catalogue...
pkg: file:///usr/ports/packages/meta.txz: No such file or directory
pkg: repository local has no meta file, using default settings
pkg: file:///usr/ports/packages/digests.txz: No such file or directory
pkg: Unable to update repository local
All repositories are up-to-date.
Checking for upgrades (1 candidates): 100%
Checking integrity... done (0 conflicting)
Your packages are up to date.

 

[Scharbag]

Are you running that command in the jail or in the freeness system? Cause [root@freenas] is not the prompt you want to be at (unless you named your jail freenas).

Use jls to list the jails. Then use jexec <#> csh to enter the jail. Then execute the script.

Code:

[adm@freenas] /# jls
   JID  IP Address      Hostname                      Path
     1  -               FlexGet                       /mnt/fasttank/Jail/FlexGet
     2  -               VirtualBox                    /mnt/fasttank/Jail/VirtualBox
     3  -               transmission_1                /mnt/fasttank/Jail/transmission_1
[adm@freenas] /# jexec 1 csh
root@FlexGet:/ # <run script from here>

Cheers,

 

[John Croney]

Sorry my bad. I notice that after but i am getting problems getting in to the new jail. I created the new jail on the additional USB driver. Doing a reboot to see if that help.

 

[Scharbag]

It is best to run your jails from your pool. The USB disk (if it is a simple memory stick) is not really built for lots of read/writes.

You can also access the cli for the jail through the Jails tab in the gui.

Hope it works out.

 

[John Croney]

This is going to take some time to recreate the new jail

 

[Scharbag]

Once you download the standard template (the first time you create a jail), then the next jail you make should be really fast.

Cheers,

 

[John Croney]

Thanks very much for your time and help. I was able to install the flexget. I am now unable to install any plugins. LOL Is this not fun.

I will do a re-install and add back the jail and see how that go.

Code:

Jan 18 08:56:53 freenas warden: Building new Jail... Please wait...
Jan 18 08:56:53 freenas warden: zfs clone disk1/jails/.warden-template-pluginjail@clean disk1/jails/mediabrowser_1
Jan 18 08:56:54 freenas warden: Success!
Jan 18 08:56:54 freenas warden: Jail created at /mnt/disk1/jails/mediabrowser_1
Jan 18 08:56:55 freenas epair8a: Ethernet address: 02:61:f4:00:19:0a
Jan 18 08:56:55 freenas epair8b: Ethernet address: 02:61:f4:00:1a:0b
Jan 18 08:56:55 freenas kernel: epair8a: link state changed to UP
Jan 18 08:56:55 freenas kernel: epair8a: link state changed to UP
Jan 18 08:56:55 freenas kernel: epair8b: link state changed to UP
Jan 18 08:56:55 freenas kernel: epair8b: link state changed to UP
Jan 18 08:56:55 freenas kernel: epair8a: promiscuous mode enabled
Jan 18 08:56:55 freenas kernel: ng_ether_ifnet_arrival_event: can't re-name node epair8b
Jan 18 08:56:55 freenas kernel: ng_ether_ifnet_arrival_event: can't re-name node epair8b
Jan 18 08:57:01 freenas manage.py: [middleware.exceptions:38] [MiddlewareError: The command /usr/sbin/jexec 9 /usr/local/sbin/pbi_add  -f --no-checksig /.plugins/mediabrowser-3.0.5490.2-amd64.pbi failed: ""]

 

[Scharbag]

Freaky. Never had that error with jails.

I have tried to run MediaBrowser as a plugin and I prefer to run it in a Windows VM within VirtualBox on the FreeNAS server. Less issues for me, easier updates, no problems with sharing and permissions (metadata ownership). Just my opinion on the matter.

Good luck, glad to hear FlexGet installed for you!

Cheers,