Matching problem on TheTVDB

[Sheldon]

Hi,

if I send a search request for

series: Colony
season: 1
episode: 1
language: en

to TheTVDB via FileBot CLI I receive the episode info for

series: The Colony
season: 1
episode: 1.
anguage: en

Both series exist at TheTVDB but if I send the exact series name I should get the right one.
How can I automatically match the right series?

Kind regards,

Sheldon

[rednoah]

1.
Search for the colony works as expected:

Code: Select all

filebot -list --db thetvdb --q "the colony"

Code: Select all

The Colony - 1x01 - Arrival and Survival
The Colony - 1x02 - Power Struggle
The Colony - 1x03 - Comfort in Chaos
…

2.
You probably mean to say Some file did not get matched correctly! to which I say What's the output?

Include file paths as text when reporting mismatches

@see viewtopic.php?f=6&t=1868#p10869

[Sheldon]

There is a misunderstanding. The series "The Colony" and "Colony" are 2 different series.
If I search for "Colony" I get the data for "The Colony".

[rednoah]

No worries, I got your drift, I tried that as well:

Code: Select all

filebot -list --db thetvdb --q "colony"

Code: Select all

Colony - 1x01 - Pilot
Colony - 1x02 - A Brave New World
Colony - 1x03 - 98 Seconds
…

[Sheldon]

I do the same and receive the data for "The Colony".
I use the jar version 3.6.1 (r3508).

[rednoah]

Alright, I can confirm that it doesn't work with the latest revision. Thanks for reporting. I'll have a look at it.

[rednoah]

Is this merely an issue of calling filebot -list --db thetvdb --q "colony" or do you actually get any Colony files mismatched as The Colony when renaming?

[Sheldon]

It's about using the list command including language, filter and format option.

[rednoah]

Please try r3516.

[Sheldon]

I tested r3516 and now I receive the correct data for the series "Colony". Thanks for fixing it!

But I recognized another similar issue. At TheTVDB you find the following 4 series

The Odd Couple - English
Männerwirtschaft - German (german version of The Odd Couple - English)
The Odd Couple (2015) - English
Odd Couple - German (german version of The Odd Couple (2015) - English)

If I search for episodes for series Odd Couple - German I receive the data for Männerwirtschaft - German. That's wrong
But if I search for episodes for series The Odd Couple (2015) - German I receive the data for Odd Couple - German. That's correct.

[rednoah]

Try r3520.

[Sheldon]

Great! Now I receive the data for series "Odd Couple - German" by both searches
"Odd Couple - German" and "The Odd Couple (2015) - German". That's perfect!
I also cross-checked the series "Colony" again and it works fine.
So thanks a lot for fixing the issues!

[kim]

Somewhere between version FileBot 4.6.1 (r3436) and FileBot 4.6.1 (r3541) something is wrong:

CLI: AMC and show "Colony"
r3436:
in strict mode Colony --> lookup yes and correct

r3541:
in strict mode Colony --> lookup NO
in NON-strict mode Colony --> lookup yes, BUT --> "The Colony" (WRONG show)

[Sheldon]

I cannot copy this.
For FileBot CLI (r3541) strict I get
Colony -> Colony (correct matching)

[kim]

Are you using filter ?
I'm not

FileBot 4.6.1 (r3541) / Java(TM) SE Runtime Environment 1.8.0_73

-script fn:amc ... --log-file amc.log --action move --def unsorted=y --conflict auto --encoding UTF-8 --def artwork=y --def clean=y --def skipExtract=y

Rename episodes using [TheTVDB]
Auto-detected query: [Colony]
CmdlineException: Multiple options: Force auto-select requires non-strict matching: [The Colony, Colony, The Colony (Australia), Roanoke: Search for the Lost Colony]

[Sheldon]

Yes, I use a filter to find the corresponding episode.

[kim]

test with Colony.S01E06 as the Colony.S01E05 and down looks ok in NON-strict only, NOT strict as worked in r3436 with NO filter

As you can see thetvdb has the data "Colony - 1x06 - Yoknapatawpha" so why any diff. from 1x05 ?

FileBot.exe -list --db thetvdb --q "Colony"
Colony - 1x01 - Pilot
Colony - 1x02 - A Brave New World
Colony - 1x03 - 98 Seconds
Colony - 1x04 - Blind Spot
Colony - 1x05 - Geronimo
Colony - 1x06 - Yoknapatawpha
Colony - 1x07 - Broussard
Colony - 1x08 - From the Cold
Colony - 1x09 - Zero Day
Colony - 1x10 - Gateway
Colony - 0xSpecial 1 - Behind the Wall

Code: Select all

http://thetvdb.com/api/GetSeries.php?seriesname=Colony&language=en
http://thetvdb.com/api/694FAD89942D3827/series/105521/all/en.xml
http://thetvdb.com/api/694FAD89942D3827/series/284210/all/en.xml
http://thetvdb.com/api/694FAD89942D3827/series/142011/all/en.xml
http://thetvdb.com/api/GetSeries.php?seriesname=The+Colony&language=en
http://thetvdb.com/api/694FAD89942D3827/series/105521/banners.xml

[rednoah]

1.
Different people may have different cache states. If you want reliable test results you may need to run -clear-cache once first.


2.
I will not investigate these issues unless you give me a file path that I can use for testing.


Looks legit:

Code: Select all

Group: [tvs:colony] => [Colony.S01E06.mkv]
Rename episodes using [TheTVDB]
Auto-detected query: [Colony]
Fetching episode data for [The Colony]
Fetching episode data for [Colony]
Fetching episode data for [The Colony (Australia)]
[TEST] Rename [Colony.S01E06.mkv] to [TV Shows/Colony/Season 01/Colony - S01E06 - Loss and Communication.mkv]
Processed 1 files

[Sheldon]

I use the list command and not the rename command. Maybe that's a hint.

[kim]

This is from the WRONG show --> "THE Colony" and not just "Colony"

Colony - S01E06 - Loss and Communication

the correct is

Colony - 1x06 - Yoknapatawpha

file path dont matter... just "Colony.S01E06.mkv" or Colony/Colony.S01E06.mkv = wrong show

btw: i use " -clear-cache" every time i TEST

[Sheldon]

So maybe the 2 commands (list and rename) lead to different results.
Kim is right. The result should be "Colony - 1x06 - Yoknapatawpha".
I get this using the list command.

[rednoah]

Something changed... seems to be working as expected now...

Code: Select all

Group: [tvs:colony] => [Colony.S01E06.mkv]
Rename episodes using [TheTVDB]
Auto-detected query: [colony]
Fetching episode data for [The Colony]
Fetching episode data for [Colony]
Fetching episode data for [The Colony (Australia)]
[TEST] Rename [Colony.S01E06.mkv] to [TV Shows/Colony/Season 01/Colony - S01E06 - Yoknapatawpha.mkv]

EDIT:

I think I may have used --lang de in the previous test... This one is using --lang en.

[kim]

I'm sorry the PATH do matter:

you see i use "unsorted=y" first in strict mode so the path get to be
"D:\_DoWnLoaD\Done\Unsorted\Colony.S01E06.mp4"

and this gets this WRONG show...
and if you dont see this then PLEASE tell me how you test it ?

[rednoah]

Yes, FilePath matters, but not in any meaningful way. Might as well throw a coin.

Code: Select all

EpisodeFunnel: 0.5000: [Colony.S01E06.mkv, The Colony - 1x01 - Arrival and Survival]
EpisodeFunnel: 0.5000: [Colony.S01E06.mkv, The Colony - 1x02 - Power Struggle]
EpisodeFunnel: 0.5000: [Colony.S01E06.mkv, The Colony - 1x03 - Comfort in Chaos]
EpisodeFunnel: 0.5000: [Colony.S01E06.mkv, The Colony - 1x04 - Safety and Security]
EpisodeFunnel: 0.5000: [Colony.S01E06.mkv, The Colony - 1x05 - A Stranger Among Us]
EpisodeFunnel: 1.0000: [Colony.S01E06.mkv, The Colony - 1x06 - Loss and Communication]
EpisodeFunnel: 0.5000: [Colony.S01E06.mkv, The Colony - 1x07 - A Test of Faith]
EpisodeFunnel: 0.5000: [Colony.S01E06.mkv, The Colony - 1x08 - Recon Mission]
EpisodeFunnel: 0.5000: [Colony.S01E06.mkv, The Colony - 1x09 - Breaking Point]
EpisodeFunnel: 0.5000: [Colony.S01E06.mkv, The Colony - 1x10 - Exodus]
EpisodeFunnel: -1.0000: [Colony.S01E06.mkv, The Colony - 2x01 - New Beginning]
EpisodeFunnel: -1.0000: [Colony.S01E06.mkv, The Colony - 2x02 - After the Fall]
EpisodeFunnel: -1.0000: [Colony.S01E06.mkv, The Colony - 2x03 - Trust]
EpisodeFunnel: -1.0000: [Colony.S01E06.mkv, The Colony - 2x04 - To Have and Have Not]
EpisodeFunnel: -1.0000: [Colony.S01E06.mkv, The Colony - 2x05 - The Abduction]
EpisodeFunnel: 0.5000: [Colony.S01E06.mkv, The Colony - 2x06 - Skout]
EpisodeFunnel: -1.0000: [Colony.S01E06.mkv, The Colony - 2x07 - Tick]
EpisodeFunnel: -1.0000: [Colony.S01E06.mkv, The Colony - 2x08 - Defense]
EpisodeFunnel: -1.0000: [Colony.S01E06.mkv, The Colony - 2x09 - The Virus]
EpisodeFunnel: -1.0000: [Colony.S01E06.mkv, The Colony - 2x10 - Don't Look Back]
EpisodeFunnel: 0.5000: [Colony.S01E06.mkv, Colony - 1x01 - Pilot]
EpisodeFunnel: 0.5000: [Colony.S01E06.mkv, Colony - 1x02 - A Brave New World]
EpisodeFunnel: 0.5000: [Colony.S01E06.mkv, Colony - 1x03 - 98 Seconds]
EpisodeFunnel: 0.5000: [Colony.S01E06.mkv, Colony - 1x04 - Blind Spot]
EpisodeFunnel: 0.5000: [Colony.S01E06.mkv, Colony - 1x05 - Geronimo]
EpisodeFunnel: 1.0000: [Colony.S01E06.mkv, Colony - 1x06 - Yoknapatawpha]
EpisodeFunnel: 0.5000: [Colony.S01E06.mkv, Colony - 1x07 - Broussard]
EpisodeFunnel: 0.5000: [Colony.S01E06.mkv, Colony - 1x08 - From the Cold]
EpisodeFunnel: 0.5000: [Colony.S01E06.mkv, Colony - 1x09 - Zero Day]
EpisodeFunnel: 0.5000: [Colony.S01E06.mkv, Colony - 1x10 - Gateway]
EpisodeFunnel: -1.0000: [Colony.S01E06.mkv, Colony - 0xSpecial 1 - Behind the Wall]
EpisodeFunnel: 0.5000: [Colony.S01E06.mkv, The Colony (Australia) - 1x01 - When Worlds Collide]
EpisodeFunnel: 0.5000: [Colony.S01E06.mkv, The Colony (Australia) - 1x02 - Survival]
EpisodeFunnel: 0.5000: [Colony.S01E06.mkv, The Colony (Australia) - 1x03 - This Land is Ours]
EpisodeFunnel: 0.5000: [Colony.S01E06.mkv, The Colony (Australia) - 1x04 - Rebellion]
EpisodeFunnel: 0.5000: [Colony.S01E06.mkv, The Colony (Australia) - 1x05 - After the Storm]
EpisodeFunnel: 1.0000: [Colony.S01E06.mkv, The Colony (Australia) - 1x06 - Back to Reality]
EpisodeBalancer: 1.1000: [Colony.S01E06.mkv, The Colony - 1x06 - Loss and Communication]
EpisodeBalancer: 1.1000: [Colony.S01E06.mkv, Colony - 1x06 - Yoknapatawpha]
EpisodeBalancer: 0.1000: [Colony.S01E06.mkv, The Colony (Australia) - 1x06 - Back to Reality]
AirDate: 0.0000: [Colony.S01E06.mkv, The Colony - 1x06 - Loss and Communication]
AirDate: 0.0000: [Colony.S01E06.mkv, Colony - 1x06 - Yoknapatawpha]
MetaAttributes: 0.0000: [Colony.S01E06.mkv, The Colony - 1x06 - Loss and Communication]
MetaAttributes: 0.0000: [Colony.S01E06.mkv, Colony - 1x06 - Yoknapatawpha]
SubstringFields: 0.0000: [Colony.S01E06.mkv, The Colony - 1x06 - Loss and Communication]
SubstringFields: 0.0000: [Colony.S01E06.mkv, Colony - 1x06 - Yoknapatawpha]
SeriesNameBalancer: 1.0000: [Colony.S01E06.mkv, The Colony - 1x06 - Loss and Communication]
SeriesNameBalancer: 1.0000: [Colony.S01E06.mkv, Colony - 1x06 - Yoknapatawpha]
SeriesName: 1.0000: [Colony.S01E06.mkv, The Colony - 1x06 - Loss and Communication]
SeriesName: 1.0000: [Colony.S01E06.mkv, Colony - 1x06 - Yoknapatawpha]
RegionHint: 0.0000: [Colony.S01E06.mkv, The Colony - 1x06 - Loss and Communication]
RegionHint: 0.0000: [Colony.S01E06.mkv, Colony - 1x06 - Yoknapatawpha]
Numeric: 1.0000: [Colony.S01E06.mkv, The Colony - 1x06 - Loss and Communication]
Numeric: 1.0000: [Colony.S01E06.mkv, Colony - 1x06 - Yoknapatawpha]
NumericSequence: 1.0000: [Colony.S01E06.mkv, The Colony - 1x06 - Loss and Communication]
NumericSequence: 1.0000: [Colony.S01E06.mkv, Colony - 1x06 - Yoknapatawpha]
SeriesRating: 0.0000: [Colony.S01E06.mkv, The Colony - 1x06 - Loss and Communication]
SeriesRating: 0.0000: [Colony.S01E06.mkv, Colony - 1x06 - Yoknapatawpha]
TimeStamp: 1.0000: [Colony.S01E06.mkv, The Colony - 1x06 - Loss and Communication]
TimeStamp: 1.0000: [Colony.S01E06.mkv, Colony - 1x06 - Yoknapatawpha]
FilePathBalancer: 0.2500: [Colony.S01E06.mkv, The Colony - 1x06 - Loss and Communication]
FilePathBalancer: 0.2500: [Colony.S01E06.mkv, Colony - 1x06 - Yoknapatawpha]
FilePath: 0.2154: [Colony.S01E06.mkv, The Colony - 1x06 - Loss and Communication]
FilePath: 0.2308: [Colony.S01E06.mkv, Colony - 1x06 - Yoknapatawpha]

Same show name, both fairly new, neither series particularly more popular than the other ... just use a --filter to get rid of "The Colony", or wait until lots of people give "Colony" lots of high ratings.

[Sheldon]

But that's confusing me a bit. If he sends the correct series "Colony" he should never get episodes for "The Colony" if you simply match the series names strictly. It looks like you do some kind of partial matching here. Is it?