Quantcast
Channel: help - Forum - FlexGet
Viewing all articles
Browse latest Browse all 837

CRITICAL task_queue (BUG: Unhandled exception during task queue run loop)

$
0
0

@papaulm wrote:

Hello to the forum,
I'm new to flexget and I used the config file from here: https://github.com/Jonybat/flexget_config.
All seem to work fine, the check passed and when I run it manually there are no errors.

But when I let the cron or daemon do the job, I always get this error:

2016-09-30 06:10 CRITICAL task_queue BUG: Unhandled exception during task queue run loop.
2016-09-30 06:10 CRITICAL manager An unexpected crash has occurred. Writing crash report to /home/osmc/.flexget/crash_report.2016.09.30.061027223453.log. Please verify you are running the latest version of flexget by using "flexget -V" from CLI or by using version_checker plugin at http://flexget.com/wiki/Plugins/version_checker. You are currently using version 2.3.37

So I try every day to update flexget and as you can see I'm on 2.3.37, I think this is the latest release by now.

Here is my last crash-report:

2016-09-30 04:45 INFO     exec          move-movies     Stdout: find: `/media/Elements/Downloads/flexget/filme/*': No such file or directory\n
2016-09-30 04:45 CRITICAL task          download-subtitles Plugin `subliminal` cannot be used because dependency `subliminal` is missing.
2016-09-30 04:45 WARNING  task          download-subtitles Aborting task (plugin: subliminal)
2016-09-30 05:02 CRITICAL task          download-series-magnets Plugin `convert_magnet` cannot be used because dependency `libtorrent` is missing.
2016-09-30 05:02 WARNING  task          download-series-magnets Aborting task (plugin: convert_magnet)
2016-09-30 05:15 INFO     move          move-series     `/media/Elements/Downloads/flexget/serien/Grey's Anatomy/Grey's Anatomy - S13E02 - Catastrophe and the Cure - [720p hdtv h264].mkv` has been moved to `/media/Elements/TV Shows/Greys Anatomy/Greys Anatomy - S13E02 - Catastrophe and the Cure - [720p hdtv h264].mkv`
2016-09-30 05:15 INFO     move          move-series     Path `/media/Elements/Downloads/flexget/serien/Grey's Anatomy` has been deleted because was less than clean_source safe value.
2016-09-30 05:15 INFO     exec          move-series     Stdout: find: `/media/Elements/Downloads/flexget/serien/*': No such file or directory\n
2016-09-30 05:15 INFO     exec          move-movies     Stdout: find: `/media/Elements/Downloads/flexget/filme/*': No such file or directory\n
2016-09-30 05:15 CRITICAL task          download-subtitles Plugin `subliminal` cannot be used because dependency `subliminal` is missing.
2016-09-30 05:15 WARNING  task          download-subtitles Aborting task (plugin: subliminal)
2016-09-30 05:32 CRITICAL task          download-series-magnets Plugin `convert_magnet` cannot be used because dependency `libtorrent` is missing.
2016-09-30 05:32 WARNING  task          download-series-magnets Aborting task (plugin: convert_magnet)
2016-09-30 05:45 INFO     exec          move-series     Stdout: find: `/media/Elements/Downloads/flexget/serien/*': No such file or directory\n
2016-09-30 05:45 INFO     exec          move-movies     Stdout: find: `/media/Elements/Downloads/flexget/filme/*': No such file or directory\n
2016-09-30 05:45 CRITICAL task          download-subtitles Plugin `subliminal` cannot be used because dependency `subliminal` is missing.
2016-09-30 05:45 WARNING  task          download-subtitles Aborting task (plugin: subliminal)
2016-09-30 06:03 CRITICAL task          download-series-magnets Plugin `convert_magnet` cannot be used because dependency `libtorrent` is missing.
2016-09-30 06:03 WARNING  task          download-series-magnets Aborting task (plugin: convert_magnet)
2016-09-30 06:04 INFO     task          download-series-discover Plugin next_series_episodes has requested task to be ran again after execution has completed. Reason: Look for next season
2016-09-30 06:10 INFO     task          download-series-discover Rerunning the task in case better resolution can be achieved.
2016-09-30 06:10 CRITICAL task_queue                    BUG: Unhandled exception during task queue run loop.
2016-09-30 06:10 CRITICAL manager                       An unexpected crash has occurred. Writing crash report to /home/osmc/.flexget/crash_report.2016.09.30.061027223453.log. Please verify you are running the latest version of flexget by using "flexget -V" from CLI or by using version_checker plugin at http://flexget.com/wiki/Plugins/version_checker. You are currently using version 2.3.37
2016-09-30 06:29 INFO     exec          move-series     Stdout: find: `/media/Elements/Downloads/flexget/serien/*': No such file or directory\n
2016-09-30 06:29 INFO     exec          move-movies     Stdout: find: `/media/Elements/Downloads/flexget/filme/*': No such file or directory\n
2016-09-30 06:29 CRITICAL task          download-subtitles Plugin `subliminal` cannot be used because dependency `subliminal` is missing.
2016-09-30 06:29 WARNING  task          download-subtitles Aborting task (plugin: subliminal)
2016-09-30 06:32 CRITICAL task          download-series-magnets Plugin `convert_magnet` cannot be used because dependency `libtorrent` is missing.
2016-09-30 06:32 WARNING  task          download-series-magnets Aborting task (plugin: convert_magnet)
2016-09-30 06:45 INFO     exec          move-series     Stdout: find: `/media/Elements/Downloads/flexget/serien/*': No such file or directory\n
2016-09-30 06:45 INFO     exec          move-movies     Stdout: find: `/media/Elements/Downloads/flexget/filme/*': No such file or directory\n
2016-09-30 06:45 CRITICAL task          download-subtitles Plugin `subliminal` cannot be used because dependency `subliminal` is missing.
2016-09-30 06:45 WARNING  task          download-subtitles Aborting task (plugin: subliminal)
2016-09-30 07:02 CRITICAL task          download-series-magnets Plugin `convert_magnet` cannot be used because dependency `libtorrent` is missing.
2016-09-30 07:02 WARNING  task          download-series-magnets Aborting task (plugin: convert_magnet)
2016-09-30 07:15 INFO     exec          move-series     Stdout: find: `/media/Elements/Downloads/flexget/serien/*': No such file or directory\n
2016-09-30 07:15 INFO     exec          move-movies     Stdout: find: `/media/Elements/Downloads/flexget/filme/*': No such file or directory\n
2016-09-30 07:15 CRITICAL task          download-subtitles Plugin `subliminal` cannot be used because dependency `subliminal` is missing.
2016-09-30 07:15 WARNING  task          download-subtitles Aborting task (plugin: subliminal)
2016-09-30 07:32 CRITICAL task          download-series-magnets Plugin `convert_magnet` cannot be used because dependency `libtorrent` is missing.
2016-09-30 07:32 WARNING  task          download-series-magnets Aborting task (plugin: convert_magnet)
2016-09-30 07:45 INFO     exec          move-series     Stdout: find: `/media/Elements/Downloads/flexget/serien/*': No such file or directory\n
2016-09-30 07:45 INFO     exec          move-movies     Stdout: find: `/media/Elements/Downloads/flexget/filme/*': No such file or directory\n
2016-09-30 07:45 CRITICAL task          download-subtitles Plugin `subliminal` cannot be used because dependency `subliminal` is missing.
2016-09-30 07:45 WARNING  task          download-subtitles Aborting task (plugin: subliminal)
2016-09-30 08:03 CRITICAL task          download-series-magnets Plugin `convert_magnet` cannot be used because dependency `libtorrent` is missing.
2016-09-30 08:03 WARNING  task          download-series-magnets Aborting task (plugin: convert_magnet)
2016-09-30 08:04 INFO     task          download-series-discover Plugin next_series_episodes has requested task to be ran again after execution has completed. Reason: Look for next season
2016-09-30 08:09 INFO     task          download-series-discover Rerunning the task in case better resolution can be achieved.
2016-09-30 08:09 CRITICAL task_queue                    BUG: Unhandled exception during task queue run loop.
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/flexget/task_queue.py", line 48, in run
    self.current_task.execute()
  File "/usr/local/lib/python2.7/dist-packages/flexget/task.py", line 72, in wrapper
    return func(self, *args, **kw)
  File "/usr/local/lib/python2.7/dist-packages/flexget/task.py", line 638, in execute
    self._execute()
  File "/usr/local/lib/python2.7/dist-packages/flexget/task.py", line 568, in _execute
    merge_dict_from_to(task_templates, hashable_config)
  File "/usr/local/lib/python2.7/dist-packages/flexget/utils/tools.py", line 171, in merge_dict_from_to
    k, type(v).__name__, type(d2[k]).__name__))
MergeException: u"Merging key series failed, conflicting datatypes 'dict' vs. 'list'."

And my config:

secrets: secrets.yml
schedules:
  - tasks: ['populate-*', 'clean-*', 'update-*']
    schedule:
      hour: 0
  - tasks: ['purge-*', 'fill-*', '*-rss', '*-magnets']
    schedule:
      minute: 0,30
  - tasks: ['*-discover', '*-manual']
    schedule:
      hour: '*/2'
  - tasks: ['move-*', download-subtitles]
    schedule:
      minute: 15,45

templates:

##### Series config
#
  series:
    thetvdb_lookup: yes
    include: series.yml
    configure_series:
      from:
        entry_list: trakt-series
      settings:
        identified_by: ep
        timeframe: 16 hours
        target: hdtv+ 720p !10bit !h265
        quality: webrip+ 720p !10bit !h265
        propers: 16 hours
        specials: no
    content_size:
      min: 250
    content_filter:
      require:
        - '*.mkv'

##### Movies config
#
  movies-1080p:
    tmdb_lookup: yes
    movie_list: trakt-movies
    quality: 1080p webdl+ !10bit !h265
    content_size:
      min: 1000
      max: 6000

  movies-720p:
    tmdb_lookup: yes
    movie_list: trakt-movies
    quality: 720p webdl+ !10bit !h265
    content_size:
      min: 500
      max: 3000

##### Transmission config
#
  transmission-anchors:
    _transmission-settings: &transmission-settings
      host: '{{secrets.transmission.host}}'
      port: 9091
      username: '{{secrets.transmission.user}}'
      password: '{{secrets.transmission.pass}}'

##### Common rejections
#
  reject:
    regexp:
      reject:
        - (s|d)ub(s|bed|lado|titulado)?\b
        - \bdual\b
        - \b3d\b
        - \b(fr)(ench)?\b
        - \b(ita)(lian)?\b
        - \b(spa)(nish)?\b
        - \b(ger)(man)?\b
        - \bcastellano\b
        - \brus(sian)?\b
    content_filter:
      reject:
        - '*.rar'
        - '*.zip'


##### ADVANCED SETTINGS #####

##### Global config
#
  global:
    no_entries_ok: yes
    pathscrub: windows
    free_space:
      path: '/{{secrets.folder.root}}'
      space: 5000
    # Requires log_filter plugin
    log_filter:
      task:
        - marked seen
        - because quality already downloaded
        - because episode has already been downloaded
        - Task does not have any
      move:
        - left because it exceeds safety value
        - does not exists (anymore)
      urlrewriter:
        - URL rewritten to
      enzyme.mkv:
        - Reading
        - Processing
      enzyme.parsers.ebml.core:
        - ignored
        - Maximum level
      subliminal.video:
        - Scanning video
      parser_internal:
        - appears to be an episode pack
      content_size:
        - rejecting
      search_rss:
        - Error
      assume_quality:
        - ""
      utils.requests:
        - Waiting

##### Common torrents config
#
  torrents:
    torrent_alive:
      min_seeds: 3
      reject_for: 15 minutes
    magnets: no
    # Might need to disable if you are getting errors connecting to https sources
    # Can remove if you upgrade to python 2.7.9+ or install requests[security]
    #verify_ssl_certificates: no
    domain_delay:
      thepiratebay.se: 10 seconds
      thepiratebay.org: 10 seconds
      extratorrent.cc: 3 seconds
      nyaa.se: 3 seconds

##### Transmission series config
#
  transmission-series:
    transmission:
      <<: *transmission-settings
      main_file_only: yes
      include_subs: yes
      rename_like_files: yes
      content_filename: "{{tvdb_series_name|default(series_name)|pathscrub}} - {{tvdb_ep_id|default(series_id)}}{% if tvdb_ep_name|default(False) %} - {{tvdb_ep_name|pathscrub}}{% endif %}{% if quality|default(False) %} - [{{quality}}]{% endif %}"
      path: "/{{secrets.folder.root}}{{secrets.folder.downseries}}{{tvdb_series_name|default(series_name)|pathscrub}}/"

##### Transmission movies config
#
  transmission-movies:
    transmission:
      <<: *transmission-settings
      main_file_only: yes
      include_subs: yes
      rename_like_files: yes
      content_filename: "{{tmdb_name|pathscrub}} ({{tmdb_year}}){% if quality|default(False) %} - [{{quality}}]{% endif %}"
      path: "/{{secrets.folder.root}}{{secrets.folder.downmovies}}{{movie_name|pathscrub}}"

##### Pushbullet config
#
  pushbullet:
    pushbullet:
      apikey: '{{secrets.pushbullet.api}}'
      title: "[flexget] {{task}}"
      body: "{{title}}"

##### Disable builtins for some tasks
#
  disable-seen-retry:
    disable:
      - seen
      - seen_info_hash
      - retry_failed

##### Series metainfo mainly for move and update tasks
#
  series-metainfo:
    metainfo_series: yes
    thetvdb_lookup: yes

##### Guessit parsing for some series tasks and anime, not applied to all tasks because it causes issues with "name (year)" based series, like scandal
#
  series-guessit:
    parsing:
      series: guessit

##### Movies metainfo mainly for move and update tasks
#
  movies-metainfo:
    tmdb_lookup: yes
    parsing:
      movie: guessit

tasks:

##### Populates the series database with the files on the library, to avoid duplicate downloads
#
  populate-series-db:
    priority: 1
    template:
      - series-metainfo
    seen: local
    filesystem:
      path: '/{{secrets.folder.root}}{{secrets.folder.series}}'
      recursive: yes
      retrieve: files
      regexp: '.*\.(avi|mkv|mp4)$'
    accept_all: yes
    configure_series:
      from:
        filesystem:
          path: '/{{secrets.folder.root}}{{secrets.folder.series}}'
          retrieve: dirs
      settings:
        tracking: no


##### Purge the series list to allow full sync with trakt series list
#
  purge-series-list:
    priority: 2
    template:
      - disable-seen-retry
    entry_list: trakt-series
    accept_all: yes
    list_remove:
      - entry_list: trakt-series


##### Fetch, format and output trakt series list to a custom entry list
#
  fill-series-list:
    priority: 3
    template:
      - disable-seen-retry
      - series-metainfo
    trakt_list:
      account: '{{secrets.trakt.account}}'
      list: '{{secrets.trakt.series}}'
      type: shows
    accept_all: yes
    set:
      title: "{{tvdb_series_name|escape|replace('&#39;', '')}}"
    list_add:
      - entry_list: trakt-series

##### Download episodes from manually downloaded torrents
#
  download-series-manual:
    priority: 11
    template:
      - disable-seen-retry
      - series-metainfo
      - series-guessit
      - transmission-series
      #- pushbullet
    filesystem:
      path: '/{{secrets.folder.root}}{{secrets.folder.downseries}}'
      mask: '*.torrent'
    accept_all: yes
    exec:
      on_output:
        for_accepted: rm -f "{{location}}"

##### Download episodes from RSS feeds
#
  download-series-rss:
    priority: 12
    template:
      - series
      - reject
      - torrents
      - transmission-series
      #- pushbullet
    inputs:
      - rss: https://eztv.unblocked.live/ezrss.xml
      - rss: https://extratorrent.cc/rss.xml?cid=8&type=last
      - rss: https://www.torrentfunk.com/tv/rss.xml

##### Download episodes from RSS magnets feeds, as a fallback from the previous task
#
  download-series-magnets:
    priority: 13
    template:
      - series
      - reject
      - torrents
      - transmission-series
      #- pushbullet
    magnets: yes
    convert_magnet: yes
    inputs:
      - rss:
          url: http://showrss.info/feeds/all.rss
          all_entries: yes

##### Discover and download older episodes and pilots from recently added series
#
  download-series-discover:
    priority: 14
    template:
      - series
      - reject
      - torrents
      - transmission-series
      #- pushbullet
    discover:
      release_estimations: ignore
      interval: 15 minutes
      what:
        - next_series_episodes:
            from_start: yes
      from:
        - piratebay:
            category: highres tv

##### Remove manually downloaded movies from the movie queue and trakt list
#
  clean-movie-queue:
    priority: 22
    template:
      - disable-seen-retry
      - movies-metainfo
    filesystem:
      path: '/{{secrets.folder.root}}{{secrets.folder.movies}}'
      recursive: yes
      retrieve: files
      regexp: '.*\.(avi|mkv|mp4)$'
    accept_all: yes
    list_remove:
      - movie_list: trakt-movies
      - trakt_list:
          account: '{{secrets.trakt.account}}'
          list: '{{secrets.trakt.movies}}'
          type: movies

##### Fill the movie queue with movies from trakt list
#
  fill-movie-queue:
    priority: 23
    trakt_list:
      account: '{{secrets.trakt.account}}'
      list: '{{secrets.trakt.movies}}'
      type: movies
      strip_dates: yes
    accept_all: yes
    list_add:
      - movie_list: trakt-movies

##### Download movies manually downloaded torrents
#
  download-movies-manual:
    priority: 24
    template:
      - disable-seen-retry
      - movies-metainfo
      - transmission-movies
      #- pushbullet
    filesystem:
      path: '/{{secrets.folder.root}}{{secrets.folder.downmovies}}'
      mask: '*.torrent'
    accept_all: yes
    exec:
      on_output:
        for_accepted: rm -f "{{location}}"
    list_remove:
      - movie_list: trakt-movies
      - trakt_list:
          account: '{{secrets.trakt.account}}'
          list: '{{secrets.trakt.movies}}'
          type: movies

##### Discover and download 1080p movies
#
  download-movies-1080p-discover:
    priority: 26
    template:
      - movies-1080p
      - reject
      - torrents
      - transmission-movies
      #- pushbullet
    exists_movie:
      - '/{{secrets.folder.root}}{{secrets.folder.downmovies}}'
      - '/{{secrets.folder.root}}{{secrets.folder.movies}}'
    discover:
      release_estimations: loose
      interval: 15 minutes
      what:
        - movie_list: trakt-movies
      from:
        - piratebay:
            category: highres movies
        - extratorrent:
            category: movies
    list_match:
      from:
        - movie_list: trakt-movies
    list_remove:
      - trakt_list:
          account: '{{secrets.trakt.account}}'
          list: '{{secrets.trakt.movies}}'
          type: movies

##### Discover and download 720p movies, if the movie is not recent
#
  download-movies-720p-discover:
    priority: 27
    template:
      - movies-720p
      - reject
      - torrents
      - transmission-movies
      #- pushbullet
    exists_movie:
      - '/{{secrets.folder.root}}{{secrets.folder.downmovies}}'
      - '/{{secrets.folder.root}}{{secrets.folder.movies}}'
    discover:
      release_estimations: loose
      interval: 15 minutes
      what:
        - movie_list: trakt-movies
      from:
        - piratebay:
            category: highres movies
        - extratorrent:
            category: movies
    if:
      - tmdb_year > now.year - 1: reject
    list_match:
      from:
        - movie_list: trakt-movies
    list_remove:
      - trakt_list:
          account: '{{secrets.trakt.account}}'
          list: '{{secrets.trakt.movies}}'
          type: movies

##### Move series from downloads folder to respective folders, along with existing subtitles and adding the files to the subtitle queue
#
  move-series:
    priority: 31
    template:
      - disable-seen-retry
      - series-metainfo
    filesystem:
      path: '/{{secrets.folder.root}}{{secrets.folder.downseries}}'
      recursive: yes
      retrieve: files
      regexp: '.*\.(avi|mkv|mp4)$'
    accept_all: yes
    move:
      to: "/{{secrets.folder.root}}{{secrets.folder.series}}{{tvdb_series_name|escape|replace('&#39;', '')|pathscrub}}/"
      filename: "{{tvdb_series_name|escape|replace('&#39;', '')|pathscrub}} - {{tvdb_ep_id|default(series_id)}}{% if tvdb_ep_name|default(False) %} - {{tvdb_ep_name|pathscrub}}{% endif %}{% if quality|default(False) %} - [{{quality}}]{% endif %}"
      along:
        files:
          - srt
          - sub
        subdirs:
          - Subs
      clean_source: 50
    list_add:
      - subtitle_list:
          list: subtitles
          path: "{{location}}"
          remove_after: 7 days
    exec:
      on_exit:
        phase: find '/{{secrets.folder.root}}{{secrets.folder.downseries}}'* -type d -empty -delete

##### Move movies from downloads folder to the movies folder, along with possible subtitles and adding the files to the subtitle queue
#
  move-movies:
    priority: 33
    template:
      - disable-seen-retry
      - movies-metainfo
    filesystem:
      path: '/{{secrets.folder.root}}{{secrets.folder.downmovies}}'
      recursive: yes
      retrieve: files
      regexp: '.*\.(avi|mkv|mp4)$'
    accept_all: yes
    regexp:
      reject:
        - \btrailer\b
        - \bsample\b
    move:
      to: '/{{secrets.folder.root}}{{secrets.folder.movies}}'
      filename: "{{tmdb_name|pathscrub}} ({{tmdb_year}}){% if quality|default(False) %} - [{{quality}}]{% endif %}"
      along:
        files:
          - srt
          - sub
        subdirs:
          - Subs
      clean_source: 100
    list_add:
      - subtitle_list:
          list: subtitles
          path: "{{location}}"
          remove_after: 7 days
    exec:
      on_exit:
        phase: find '/{{secrets.folder.root}}{{secrets.folder.downmovies}}'* -type d -empty -delete

##### Download subtitles for the previously queued files
#
  download-subtitles:
    priority: 35
    template:
      - disable-seen-retry
    subtitle_list:
      list: subtitles
    list_match:
      from:
        - subtitle_list:
            list: subtitles
    subliminal:
      exact_match: yes
      languages:
        - eng

##### Clean finished torrents from transmission
#
  clean-transmission:
    priority: 37
    disable: details
    clean_transmission:
      <<: *transmission-settings
      finished_for: 1 hour

##### Update trakt series list from local series folders, excluding the ones that already ended
#
  update-series-list:
    priority: 41
    template:
      - disable-seen-retry
      - series-metainfo
    filesystem:
      path: '/{{secrets.folder.root}}{{secrets.folder.series}}'
      retrieve: dirs
    manipulate:
      - title:
          replace:
            regexp: '$'
            format: ' S01E01'
    accept_all: yes
    if:
      - tvdb_status == 'Ended': reject
    list_add:
      - trakt_list:
          account: '{{secrets.trakt.account}}'
          list: '{{secrets.trakt.series}}'
          type: shows

##### Clean the series that already ended from trakt series list
#
  clean-series-list:
    priority: 43
    delay: 8 day
    template:
      - disable-seen-retry
      - series-metainfo
      #- pushbullet
    trakt_list:
      account: '{{secrets.trakt.account}}'
      list: '{{secrets.trakt.series}}'
      type: shows
    if:
      - tvdb_status == 'Ended': accept
    list_remove:
      - trakt_list:
          account: '{{secrets.trakt.account}}'
          list: '{{secrets.trakt.series}}'
          type: shows

please help me, at this point I can't get any further and don't know how to solve this problem.

Thank you!
Adrian

Posts: 4

Participants: 2

Read full topic


Viewing all articles
Browse latest Browse all 837

Trending Articles