[amc] Fixing bad matches & improving auto-detection

All your suggestions, requests and ideas for future development
ahennen
Posts: 2
Joined: 23 Mar 2015, 00:33

[amc] Fixing bad matches & improving auto-detection

Post by ahennen »

SOS for Shahs of Sunset
and
MBFAGW for My Big Fat American Gypsy Wedding

Sorry we just cancelled cable so now I have to download all my wife's reality crap.

Thanks!
User avatar
rednoah
The Source
Posts: 19364
Joined: 16 Nov 2011, 08:59
Location: Taipei
Contact:

Re: Exclude Blacklist & Series-Mappings

Post by rednoah »

Please post the original filenames.
:idea: Please read the FAQ and How to Request Help.
ahennen
Posts: 2
Joined: 23 Mar 2015, 00:33

Re: Exclude Blacklist & Series-Mappings

Post by ahennen »

My Big Fat American Gypsy Wedding Season 4 Episode 1
MBFAGW.S04E01.Greek.Goddess.WS.DSR.x264-[NY2].mp4

should map to this episode
http://www.thetvdb.com/?tab=episode&se ... 4440&lid=7


Shahs of Sunset Season 4 Episode 2
SOS.S04E02.What.Happened.In.Turkey.WS.DSR.x264-[NY2].mp4

should map to this episode
http://www.thetvdb.com/?tab=episode&ser ... 9805&lid=7

Thanks again!
nekromantik
Posts: 22
Joined: 13 Jul 2015, 21:25

Re: Exclude Blacklist & Series-Mappings

Post by nekromantik »

Scream The TV Series dont match correctly cause Series is in blacklist.
Can this be added to exclusions?
User avatar
rednoah
The Source
Posts: 19364
Joined: 16 Nov 2011, 08:59
Location: Taipei
Contact:

Re: Exclude Blacklist & Series-Mappings

Post by rednoah »

Can you give me an example filename for testing please?
:idea: Please read the FAQ and How to Request Help.
nekromantik
Posts: 22
Joined: 13 Jul 2015, 21:25

Re: Exclude Blacklist & Series-Mappings

Post by nekromantik »

rednoah wrote:Can you give me an example filename for testing please?
Scream.The.TV.Series.S01E05.720p.HDTV.HEVC.x265.mkv

This gets renamed to The UP Show S01E05
User avatar
rednoah
The Source
Posts: 19364
Joined: 16 Nov 2011, 08:59
Location: Taipei
Contact:

Re: Exclude Blacklist & Series-Mappings

Post by rednoah »

Nope, it doesn't match because the name of the series is "Scream" not "Scream The TV Series". Adding "The TV Series" to the exclude-blacklist might at least help avoid the "The UP Show" mismatch though.
:idea: Please read the FAQ and How to Request Help.
nekromantik
Posts: 22
Joined: 13 Jul 2015, 21:25

Re: Exclude Blacklist & Series-Mappings

Post by nekromantik »

Ah OK.
Is there anything I can do to make it match correctly?
User avatar
rednoah
The Source
Posts: 19364
Joined: 16 Nov 2011, 08:59
Location: Taipei
Contact:

Re: Exclude Blacklist & Series-Mappings

Post by rednoah »

:idea: Please read the FAQ and How to Request Help.
nekromantik
Posts: 22
Joined: 13 Jul 2015, 21:25

Re: Exclude Blacklist & Series-Mappings

Post by nekromantik »

rednoah wrote:See FAQ #2 => Q: How do I "fix" the misidentified files?
I saw that but I mean when using the automated AMC script?
Without manual intervention?
Like a whitelist to match files against that always get matched wrongly.
User avatar
rednoah
The Source
Posts: 19364
Joined: 16 Nov 2011, 08:59
Location: Taipei
Contact:

Re: Exclude Blacklist & Series-Mappings

Post by rednoah »

The --filter option.

@see viewtopic.php?f=3&t=2127
:idea: Please read the FAQ and How to Request Help.
nekromantik
Posts: 22
Joined: 13 Jul 2015, 21:25

Re: Exclude Blacklist & Series-Mappings

Post by nekromantik »

thanks
hellmaker
Donor
Posts: 35
Joined: 13 Jan 2016, 20:43

Re: Exclude Blacklist & Series-Mappings

Post by hellmaker »

How can I use my own series mapping list offline and not the online one?
User avatar
rednoah
The Source
Posts: 19364
Joined: 16 Nov 2011, 08:59
Location: Taipei
Contact:

Re: Exclude Blacklist & Series-Mappings

Post by rednoah »

Yes. But you have yet to contribute a single pattern to the global mappings, so you should give that a try first. ;)
:idea: Please read the FAQ and How to Request Help.
hellmaker
Donor
Posts: 35
Joined: 13 Jan 2016, 20:43

Re: Exclude Blacklist & Series-Mappings

Post by hellmaker »

ok so i have problem with csi (germany) and stargate sg-1.

File:
CSI---Den-Tätern-auf-der-Spur.64.Wer-ist-Sqweegel_.mkv

is always failing and become unsorted.
It should be assigned to csi series.

File:
Stargate.10.Der-Planet-der-Eiszeit.mkv

is always matched to Stargate the movie. It shoud be the series Stargate SG-1 series.

It seems that thetvdb.com is down at the moment, so i can paste the correct series links in here at the moment.
User avatar
rednoah
The Source
Posts: 19364
Joined: 16 Nov 2011, 08:59
Location: Taipei
Contact:

Re: Exclude Blacklist & Series-Mappings

Post by rednoah »

Well, you can't really expect horrible filenames (no SxE number, bad episode title) to just work. I wouldn't know what to do with those files, so the amc script putting them in "Unsorted" is the best thing that could happen, and with a bit of bad luck you'll get a mismatch. The series/movie mismatch can be fixed by passing the correct label though.

The GUI will just ask you to confirm the series, and assuming you have Language Preference set to German it might even be able to match it to the right episode.

Hence, use FileBot GUI to deal with these horrible filenames. ;)

PS: Series detection is not a problem in this case, and there's no way you can magically make it work for these filenames just by adding a few magic patterns to the *.txt files this thread is about. ;)
:idea: Please read the FAQ and How to Request Help.
hellmaker
Donor
Posts: 35
Joined: 13 Jan 2016, 20:43

Re: Exclude Blacklist & Series-Mappings

Post by hellmaker »

Don´t get this wrong.
I don´t want to blame the script for doing a bad job. I´m realy happy about finding this page and this script is awesome.
And as far as i monitored this, i think this script can work like it want to have it.
But i´m stuck with customizing it. Feeling like lost in the jungle, so i need the direction i have to walk.

So sadly you are not able to get a EPG data service with full SxxExx labeling for your showns in germany.
I´m using epgdata.com, a paid service, for having at least a valid episode number and a correct episode title. These titles are correct every time.
So having the series name, series episode number and series episode title is enough input for identify a file correct. Your scricpt is doing fine with it a lot of times.
Just in some cases it has a missmatch.

I´m using filebot on a synology nas with filebot-node also.
So there is no real GUI for me..........

So i have only 2 needs for improving my digital live with this script.

First: In many cases it is finding a series and a movie for a file. This leads into unable to differentiate. In most cases (>90%) it is a series and not a movie. So how can i make the script to dismiss the movie and use the found series instead of doing nothing?

Example:

Code: Select all

Undercover-Boss.1.MeinFernbus-FlixBus.mkv [series: Undercover Boss, movie: The Boss (1973)]
Unable to differentiate: [Undercover-Boss.1.MeinFernbus-FlixBus.mkv] => [Undercover Boss] VS [The Boss (1973)]
Second: How can i include hardcoded text pattern like "Stargate" and point to a series it should take like "Stargate SG-1"?
Example:

Code: Select all

Stargate.14.Die-verhinderte-Allianz.mkv [series: Stargate, movie: Stargate (1994)]
User avatar
rednoah
The Source
Posts: 19364
Joined: 16 Nov 2011, 08:59
Location: Taipei
Contact:

Re: Exclude Blacklist & Series-Mappings

Post by rednoah »

As explained in the manual, you're supposed to pass in a label to force series/movie mode. The FileBot Node GUI makes this available as option as well.

If you know that you only have episodes, then you can easily force series mode. If you know that epsiode titles will be in German then you can set language to German so episode data better matches your files.

So --lang and --def ut_label is probably all you need. If not, then there is --filter but that's more difficult to use.
:idea: Please read the FAQ and How to Request Help.
User avatar
rednoah
The Source
Posts: 19364
Joined: 16 Nov 2011, 08:59
Location: Taipei
Contact:

Re: Exclude Blacklist & Series-Mappings

Post by rednoah »

You might want to write your own script that moves files into TV and Movies folders according to your own rules, and then have the amc script pick up from there.

EDIT:

Does your EPG allow you to separate TV shows and Movies? Preferably sorting files into different folders, or otherwise tagging files?
:idea: Please read the FAQ and How to Request Help.
hellmaker
Donor
Posts: 35
Joined: 13 Jan 2016, 20:43

Re: Exclude Blacklist & Series-Mappings

Post by hellmaker »

ok i use the following call:

Code: Select all

filebot -script 'fn:amc' /volume1/TV-Aufnahmen/sort --output /volume1/TV-Aufnahmen/Fertig --action move -non-strict --conflict override --lang de --def 'unsorted=y' 'artwork=y' 'clean=y' 'deleteAfterExtract=y' 'minLengthMS=300000' --log all --log-file '/volume1/@appstore/filebot-node/filebot.log' >> '/volume1/@appstore/filebot-node/log/1452584449904.log' 2>&1
My EPG data delievers i.e. category "series" or "movie"
I´m using tvheadend-4.0 as tv recorder. But dunno how to get this category into the filename or how i can use it.

Code: Select all

<programme start="20160205190000 +0100" stop="20160205200000 +0100" channel="atlantic.sky.de">
    <title>Supernatural</title>
    <sub-title>Was sie trugen</sub-title>
    <desc>Eine Soldatin wurde bestialisch getötet. Sam und Dean vermuten, dass sie es mit einem Dämonen zu tun haben, doch ein anderer Soldat war involviert, der sich vor der Tat merkwürdig verhalten hat.</desc>
    <credits>
      <director>John Badham</director>
      <actor>Jared Padalecki</actor>
      <actor>Jensen Ackles</actor>
      <actor>J. Alex Brinson</actor>
      <actor>Travis Aaron Wade</actor>
      <actor>Richard de Klerk</actor>
      <actor>Michelle Morgan</actor>
      <actor>Helena Marie</actor>
      <actor>Peter Anderson</actor>
      <actor>Ian Collins</actor>
      <actor>Christopher Patrick Dwyer</actor>
      <actor>Russell Thomas</actor>
      <actor>Crystal Mudry</actor>
    </credits>
    <date>2014</date>
    <category>series</category>
    <category>Mystery + Horror</category>
    <length units="hours">1</length>
    <country>USA</country>
    <episode-num system="onscreen">15</episode-num>
    <video>
      <colour>yes</colour>
      <aspect>16:9</aspect>
    </video>
    <audio>
      <stereo>dolby digital</stereo>
    </audio>
    <rating>
      <value>16</value>
    </rating>
  </programme>
I have another question about the --filter age parameter. You say it is comparing the air date. Is this also fitting the air date for german tv?
How is this air date used? Will it help me to use age<2 because i´m running filebot every night.
User avatar
rednoah
The Source
Posts: 19364
Joined: 16 Nov 2011, 08:59
Location: Taipei
Contact:

Re: Exclude Blacklist & Series-Mappings

Post by rednoah »

1.
The age --filter approach would not work well for German airdates, and especially not for reruns (e.g. old Stargate episodes). Also, the --filter option can't help with series/movie detection.

In the manual you'll see this. The --def ut_label options is used to force TV Series mode, and the --filter option is used to help with episode selection:

Code: Select all

--filter "age < 7" --def "ut_label=TV"
This won't work for you because you are dealing with series and movie type files, and I doubt that there's any correlation between your recording date, and the original airdate.

PS: The Exclude Blacklist & Series-Mappings discussed in this thread are another thing entirely. It's complicated. :lol:


2.
So tvheadend should have all the information it needs to put category series files and category movie files into different folders. I'm sure that's supported, and if not, then maybe that feature can be added.
:idea: Please read the FAQ and How to Request Help.
User avatar
rednoah
The Source
Posts: 19364
Joined: 16 Nov 2011, 08:59
Location: Taipei
Contact:

Re: Exclude Blacklist & Series-Mappings

Post by rednoah »

Well, the way I understand it, filename is generated from the EPG data, so if you know the episode title, you also know the category. It already supports some sort of subdirectory feature. Just make a feature request and see what happens. ;)
:idea: Please read the FAQ and How to Request Help.
hellmaker
Donor
Posts: 35
Joined: 13 Jan 2016, 20:43

Re: Exclude Blacklist & Series-Mappings

Post by hellmaker »

yes i will post a request .................. maybe it will happen.
Right now i created two profiles for recording......... one for movie and one for series with different output folders.
So i have to chose the right profile when creating the recording. Sadly this is far away from automation and i dunno know how to teach my wife :o

Another one:
Group: [tvs:undercover boss us] => [Undercover Boss.MeinFernbus FlixBus.mkv]
[MOVE] Rename [/volume1/TV-Aufnahmen/sort/Undercover Boss.MeinFernbus FlixBus.mkv] to [/volume1/TV-Aufnahmen/Fertig/TV Shows/Undercover Boss (US)/Season 01/Undercover Boss (US) - S01E09 - 1-800-Flowers.mkv]

Why is it choosing the (US) series of Undercover Boss? The language is set to DE.
The right thetvdb.com entry should be: http://thetvdb.com/?tab=series&id=248243&lid=14
User avatar
rednoah
The Source
Posts: 19364
Joined: 16 Nov 2011, 08:59
Location: Taipei
Contact:

Re: Exclude Blacklist & Series-Mappings

Post by rednoah »

If that file would say Undercover Boss (DE) then it should work. Undercover Boss is highly ambiguous. Picking series Undercover Boss for a file called Undercover Boss is not exactly unreasonable. :D

The US version matches the filename perfectly, and it's more popular than the DE version. However, this is the kind of scenario where adding a --filter rule might work (assuming that multiple Undercover Boss shows make it past the first round of series detection).
:idea: Please read the FAQ and How to Request Help.
hellmaker
Donor
Posts: 35
Joined: 13 Jan 2016, 20:43

Re: Exclude Blacklist & Series-Mappings

Post by hellmaker »

Thats true.

How can i exclude the "Undercover Boss (US)" for all following search actions and having a hit on "Undercover Boss (DE)"?

BTW: Feel free to split this thread when it becomes tooo off-topic. ;)
Post Reply