Issues with 4400 and CSI Vegas

[pax0707]

These two reboots/spinoffs keep getting misidentified as the original series, even after several episodes are out.
This is a test I tried to make sure there's not something wrong with my full formating, also latest and some older episodes.

Sysinfo:

Code: Select all

FileBot 4.9.4 (r8736)
JNA Native: 6.1.0
MediaInfo: 20.09
7-Zip-JBinding: 16.02
Tools: fpcalc/1.5.0
Extended Attributes: OK
Unicode Filesystem: OK
Script Bundle: 2021-08-02 (r761)
Groovy: 3.0.8
JRE: OpenJDK Runtime Environment 16.0.2
JVM: 64-bit OpenJDK 64-Bit Server VM
CPU/MEM: 12 Core / 4.3 GB Max Memory / 22 MB Used Memory
OS: Windows 10 (amd64)
STORAGE: NTFS [SYSTEM] @ 96 GB | NTFS [COLOSSUS] @ 3.1 TB | NTFS [P027] @ 275 GB | NTFS [P023] @ 28 GB
DATA: C:\Users\pax07\AppData\Roaming\FileBot
Package: MSI
License: FileBot License P27428475 (Valid-Until: 2022-08-04)

Args file:

Code: Select all

-script
fn:amc
D:/TEMP/In
--output
D:/TEMP/Out
--log-file
D:/Filebot/log/test.log
--action
hardlink
--conflict
auto
-non-strict
--def
seriesFormat=D:/TEMP/Out/{any{ny}{n}} - {s00e00} - {t}
movieFormat=D:/TEMP/Out/{ny}
--def
unsorted=y
--filter
'age < 30 || !model.any{ it.age < 30 }'

Log: https://pastebin.com/0zUe70zf

[rednoah]

Please use filebot -revert to un-rename previously miss-renamed files, because that will reset both the file path and xattr metadata and you don't want to forget about the latter:
viewtopic.php?t=12133

Code: Select all

filebot -revert --mode interactive

If you manually un-rename a file, then this will not reset xattr metadata and thus subsequent filebot calls will be inclined to make the exact same match for the exact same file. You'll want to clear xattr metadata (via filebot -revert or filebot -script fn:xattr --action clear) before re-processing previously processed and miss-identified files.


i.e. new files never have xattr, so if you see xattr in the log, then your test case is not clean:

Code: Select all

xattr: [4400.S01E03.That.LaDonna.Life.1080p.AMZN.WEB-DL.DDP5.1.H.264-NTb.mkv] => [The 4400 - 1x03 - Becoming]
...
xattr: [CSI.Vegas.S01E06.Funhouse.1080p.AMZN.WEB-DL.DDP5.1.H.264-NTb.mkv] => [CSI: Crime Scene Investigation - 1x06 - Who Are You?]
...

Please read Metadata and Extended Attributes for details.

[pax0707]

I disabled xattr since I do hard linking and it works for new episodes but model doesn't deal with older episodes.
They are not even put as unsorted.
Added Dexter New blood since it's the same thing happening.

Code: Select all

-script
fn:amc
D:/TEMP/In
--output
D:/TEMP/Out
--log-file
D:/Filebot/log/test.log
--action
hardlink
--conflict
auto
-non-strict
--def
seriesFormat=D:/TEMP/Out/{any{ny}{n}} - {s00e00} - {t}
movieFormat=D:/TEMP/Out/{ny}
unsorted=y
--filter
age < 14 || !model.any{ it.age < 14 }

Code: Select all

Run script [fn:amc] at [Mon Nov 29 13:19:41 CET 2021]
Parameter: seriesFormat = D:/TEMP/Out/{any{ny}{n}} - {s00e00} - {t}
Parameter: movieFormat = D:/TEMP/Out/{ny}
Parameter: unsorted = y
Argument[0]: D:\TEMP\In
Input: D:\TEMP\In\4400.s01e01.1080p.web.h264-cakes.mkv
Input: D:\TEMP\In\4400.S01E02.All.Things.Are.Possible.1080p.AMZN.WEB-DL.DDP5.1.H.264-NTb.mkv
Input: D:\TEMP\In\4400.S01E03.That.LaDonna.Life.1080p.AMZN.WEB-DL.DDP5.1.H.264-NTb.mkv
Input: D:\TEMP\In\4400.S01E04.Harlems.Renaissance.Man.1080p.AMZN.WEB-DL.DDP5.1.H.264-NTb.mkv
Input: D:\TEMP\In\4400.S01E05.The.Way.We.Were.1080p.AMZN.WEB-DL.DDP5.1.H.264-NTb.mkv
Input: D:\TEMP\In\csi.vegas.s01e03.1080p.web.h264-cakes.mkv
Input: D:\TEMP\In\CSI.Vegas.S01E05.Let.the.Chips.Fall.1080p.AMZN.WEB-DL.DDP5.1.H.264-NTb.mkv
Input: D:\TEMP\In\CSI.Vegas.S01E06.Funhouse.1080p.AMZN.WEB-DL.DDP5.1.H.264-NTb.mkv
Input: D:\TEMP\In\CSI.Vegas.S01E07.In.the.Blood.1080p.AMZN.WEB-DL.DDP5.1.H.264-NTb.mkv
Input: D:\TEMP\In\CSI.Vegas.S01E08.REPACK.1080p.WEB.h264-GOSSIP.mkv
Input: D:\TEMP\In\Dexter.New.Blood.S01E01.Cold.Snap.1080p.AMZN.WEB-DL.DDP5.1.H.264-NTb.mkv
Input: D:\TEMP\In\Dexter.New.Blood.S01E03.Smoke.Signals.1080p.AMZN.WEB-DL.DDP5.1.H.264-NTb.mkv
Input: D:\TEMP\In\Dexter.New.Blood.S01E04.H.is.for.Hero.1080p.AMZN.WEB-DL.DDP5.1.H.264-NTb.mkv
Group: {Series=the 4400} => [4400.s01e01.1080p.web.h264-cakes.mkv, 4400.S01E02.All.Things.Are.Possible.1080p.AMZN.WEB-DL.DDP5.1.H.264-NTb.mkv, 4400.S01E03.That.LaDonna.Life.1080p.AMZN.WEB-DL.DDP5.1.H.264-NTb.mkv, 4400.S01E04.Harlems.Renaissance.Man.1080p.AMZN.WEB-DL.DDP5.1.H.264-NTb.mkv, 4400.S01E05.The.Way.We.Were.1080p.AMZN.WEB-DL.DDP5.1.H.264-NTb.mkv]
Group: {Series=csi crime scene investigation} => [csi.vegas.s01e03.1080p.web.h264-cakes.mkv, CSI.Vegas.S01E05.Let.the.Chips.Fall.1080p.AMZN.WEB-DL.DDP5.1.H.264-NTb.mkv, CSI.Vegas.S01E06.Funhouse.1080p.AMZN.WEB-DL.DDP5.1.H.264-NTb.mkv, CSI.Vegas.S01E07.In.the.Blood.1080p.AMZN.WEB-DL.DDP5.1.H.264-NTb.mkv, CSI.Vegas.S01E08.REPACK.1080p.WEB.h264-GOSSIP.mkv]
Group: {Series=dexters laboratory} => [Dexter.New.Blood.S01E01.Cold.Snap.1080p.AMZN.WEB-DL.DDP5.1.H.264-NTb.mkv, Dexter.New.Blood.S01E03.Smoke.Signals.1080p.AMZN.WEB-DL.DDP5.1.H.264-NTb.mkv, Dexter.New.Blood.S01E04.H.is.for.Hero.1080p.AMZN.WEB-DL.DDP5.1.H.264-NTb.mkv]
Rename episodes using [TheTVDB] with [Airdate]
Lookup via [The 4400, 4400]
Fetching episode data for [The 4400]
Fetching episode data for [The 100]
Fetching episode data for [4400]
Apply filter [age < 14 || !model.any{ it.age < 14 }] on [180] options
Include [4400 - 1x05 - The Way We Were]
Include [4400 - 1x06 - If You Love Something]
[2] options remaining
No matching episode: D:\TEMP\In\4400.S01E02.All.Things.Are.Possible.1080p.AMZN.WEB-DL.DDP5.1.H.264-NTb.mkv
No matching episode: D:\TEMP\In\4400.S01E03.That.LaDonna.Life.1080p.AMZN.WEB-DL.DDP5.1.H.264-NTb.mkv
No matching episode: D:\TEMP\In\4400.S01E04.Harlems.Renaissance.Man.1080p.AMZN.WEB-DL.DDP5.1.H.264-NTb.mkv
[HARDLINK] from [D:\TEMP\In\4400.s01e01.1080p.web.h264-cakes.mkv] to [D:\TEMP\Out\4400 (2021) - S01E06 - If You Love Something.mkv]
[HARDLINK] from [D:\TEMP\In\4400.S01E05.The.Way.We.Were.1080p.AMZN.WEB-DL.DDP5.1.H.264-NTb.mkv] to [D:\TEMP\Out\4400 (2021) - S01E05 - The Way We Were.mkv]
Processed 2 files
Rename episodes using [TheTVDB] with [Airdate]
Lookup via [CSI: Crime Scene Investigation, csi vegas]
Fetching episode data for [CSI: Crime Scene Investigation]
Fetching episode data for [Mayday]
Fetching episode data for [The Investigation]
Fetching episode data for [CSI: Vegas]
Apply filter [age < 14 || !model.any{ it.age < 14 }] on [585] options
Include [CSI: Vegas - 1x07 - In the Blood]
Include [CSI: Vegas - 1x08 - Pipe Cleaner]
[2] options remaining
No matching episode: D:\TEMP\In\csi.vegas.s01e03.1080p.web.h264-cakes.mkv
No matching episode: D:\TEMP\In\CSI.Vegas.S01E05.Let.the.Chips.Fall.1080p.AMZN.WEB-DL.DDP5.1.H.264-NTb.mkv
No matching episode: D:\TEMP\In\CSI.Vegas.S01E06.Funhouse.1080p.AMZN.WEB-DL.DDP5.1.H.264-NTb.mkv
Stripping invalid characters from new path: D:/TEMP/Out/CSI: Vegas (2021) - S01E07 - In the Blood
Stripping invalid characters from new path: D:/TEMP/Out/CSI: Vegas (2021) - S01E08 - Pipe Cleaner
[HARDLINK] from [D:\TEMP\In\CSI.Vegas.S01E07.In.the.Blood.1080p.AMZN.WEB-DL.DDP5.1.H.264-NTb.mkv] to [D:\TEMP\Out\CSI Vegas (2021) - S01E07 - In the Blood.mkv]
[HARDLINK] from [D:\TEMP\In\CSI.Vegas.S01E08.REPACK.1080p.WEB.h264-GOSSIP.mkv] to [D:\TEMP\Out\CSI Vegas (2021) - S01E08 - Pipe Cleaner.mkv]
Processed 2 files
Rename episodes using [TheTVDB] with [Airdate]
Lookup via [Dexter's Laboratory, Dexter, dexter new blood]
Fetching episode data for [Dexter's Laboratory]
Fetching episode data for [Dexter]
Fetching episode data for [Dexter: New Blood]
Fetching episode data for [New Blood]
Apply filter [age < 14 || !model.any{ it.age < 14 }] on [369] options
Include [Dexter: New Blood - 1x03 - Smoke Signals]
Include [Dexter: New Blood - 1x04 - H is for Hero]
[2] options remaining
No matching episode: D:\TEMP\In\Dexter.New.Blood.S01E01.Cold.Snap.1080p.AMZN.WEB-DL.DDP5.1.H.264-NTb.mkv
Stripping invalid characters from new path: D:/TEMP/Out/Dexter: New Blood (2021) - S01E03 - Smoke Signals
Stripping invalid characters from new path: D:/TEMP/Out/Dexter: New Blood (2021) - S01E04 - H is for Hero
[HARDLINK] from [D:\TEMP\In\Dexter.New.Blood.S01E03.Smoke.Signals.1080p.AMZN.WEB-DL.DDP5.1.H.264-NTb.mkv] to [D:\TEMP\Out\Dexter New Blood (2021) - S01E03 - Smoke Signals.mkv]
[HARDLINK] from [D:\TEMP\In\Dexter.New.Blood.S01E04.H.is.for.Hero.1080p.AMZN.WEB-DL.DDP5.1.H.264-NTb.mkv] to [D:\TEMP\Out\Dexter New Blood (2021) - S01E04 - H is for Hero.mkv]
Processed 2 files
Done ヾ(＠⌒ー⌒＠)ノ

[rednoah]

Yes. That is what your --filter does. It makes things work better for recent episodes by making things work worse for old episodes. Unfortunately, you can't have both at the same time. Using the filter above, you cannot process old episodes of currently airing shows. You'll want to change --filter depending on the task at hand. The "age filter" approach only works well for the "process this weeks episode" use case. Since The 4400 / Original CSI / Original Dexter are all pretty old, using a "process this years episode" like --filter "age < 360" would also work just fine in this case. It's just about including good options and excluding the bad options.


The !model.any{ it.age < 14 } part merely allows you to process old shows where every single episode is old, since age < 14 by itself would eliminate all options and thus not allow you to process old shows at all. That means you can only process shows that are old as a whole, or new episodes of new shows, but not old episodes of new shows.


--filter is a double-edged sword. For example, if you pass in --filter "age < 14" then you guarantee that that the files you pass in as input match the filter you pass in, and things will go awry if that promise is broken, specially in -non-strict mode. You could do --filter "y >= 2015" to focus on newer shows in general, at the expense not being able to process older shows. You could also have your own include list / exclude list for ruling in or ruling out one specific show or another.




EDIT:

Well. Long story short. The xattr from the original run were the reason why it didn't work on your second run when you tried to fix things. But the original problem has already resolved itself, so there's not reason to fiddle with --filter any longer in the first place, and the latter will just make things worse if used incorrectly for the specific use case at hand.

Code: Select all

$ filebot -rename *.mkv --db TheTVDB -non-strict --log INFO --action TEST
[TEST] from [4400.s01e01.mkv] to [4400 - 1x01 - Past Is Prologue.mkv]
[TEST] from [Dexter.New.Blood.S01E02.mkv] to [Dexter New Blood - 1x02 - Storm of Fuck.mkv]
[TEST] from [csi.vegas.s01e03.mkv] to [CSI Vegas - 1x03 - Under the Skin.mkv]

[pax0707]

Thanks for the clarification on age, makes sense now.
I will try running with it for a time and observe the results.
Since I put processed episodes in the exclude list everything should be either a new episode or seasons of old series.

Cheers.

[rednoah]

Since I put processed episodes in the exclude list everything should be either a new episode or seasons of old series.

Yep, that's the ideal case. That should work. Please report back after a few weeks how things ended up working out in production.