Cookies/headers not being sent?

@oblongcheese wrote:

Hello all. I am trying to configure Flexget to use cookies against a website that requires login authentication to access the RSS feed and to download the files.

My questions:
* Why is Flexget seemingly ignoring the request headers that I have configured? These do not appear to be used by Flexget when making the request, according to the debug log. This results in an HTTP 403 page being downloaded instead of the intended file.
* Why is Flexget changing the URL when making the request to the RSS feed?

Thank-you in advance for your help and assistance.

My configuration looks like this:

> tasks:
>   formula1:
>     headers:
>       User-Agent: "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/65.0.3325.181 Safari/537.36"
>       Cookie: "uid=NUMERICID; idh=ALPHANUMERICID; PHPSESSID=ALPHANUMERICID"
>     regexp:
>       accept:
>         - "Formula1\\.2018\\.Round[0-9]{2}\\.(.*?)\\.Race\\.SkySportsF1\\.(.*?)\\.English"
>       from: title
>     rss: "https://www.racingwebsite.com/rss/UID/APIKEY&:c ookie:uid=NUMERICID;idh=ALPHANUMERICID/6030"
>     download: ~/rtorrent/watch

(ignore the space in 'cookie' in the URL above, the forum software kept changing that word to an emoji)

Then when I execute the task with debug log, I see these entries:

2018-04-03 10:11 DEBUG rss formula1 Requesting task formula1 url https://www.racingwebsite.com/rss/UID/ALPHANUMERICID/6030
2018-04-03 10:11 DEBUG utils.requests formula1 Fetching URL https://www.racingwebsite.com/rss/UID/ALPHANUMERICID/6030 with args () and kwargs {'headers': {'Connection': 'keep-alive', 'Accept-Encoding': 'gzip, deflate', 'Accept': '/', u'User-Agent': u'FlexGet/2.13.6 (www.flexget.com)'}, 'allow_redirects': True, 'timeout': 60, 'auth': None}
[... some output omitted ...]
2018-04-03 10:11 DEBUG download formula1 Downloading url 'https://www.racingwebsite.com/download/134505/Formula1.2018.Round01.Australia.Race.SkySportsF1.X264.English'
2018-04-03 10:11 DEBUG utils.requests formula1 Fetching URL https://www.racingfor.me/download/134505/Formula1.2018.Round01.Australia.Race.SkySportsF1.X264.English with args () and kwargs {'allow_redirects': True, u'timeout': 30, 'auth': None}
[... some output omitted ...]
2018-04-03 10:11 DEBUG download formula1 Mimetype guess for text/html is ['.html', '.htm', '.shtml']
[... some output omitted ...]
2018-04-03 10:11 DEBUG entry formula1 Marking entry 'Formula1.2018.Round01.Australia.Race.SkySportsF1.X264.English' as failed
2018-04-03 10:11 ERROR entry formula1 Failed Formula1.2018.Round01.Australia.Race.SkySportsF1.X264.English (Unexpected html content received from https://www.racingwebsite.com/download/134505/Formula1.2018.Round01.Australia.Race.SkySportsF1.X264.English - maybe a login page?)
[... some output omitted ...]

Posts: 1

Participants: 1

Read full topic