FileBot 'Ignore Pattern' When it Shouldn't

All your suggestions, requests and ideas for future development
Post Reply
kmlucy
Posts: 3
Joined: 29 Jun 2016, 19:33

FileBot 'Ignore Pattern' When it Shouldn't

Post by kmlucy »

I am running FileBot 4.7.2 in a Docker container through coppit/filebot. The container is based on Ubuntu 16.04, the host system is Debian Jessie.

The problem I am having is that some movies are being ignored when they shouldn't be. Here is an example log of a movie that is ignored:

Code: Select all

Locking /files/amc.log
Run script [fn:amc] at [Tue Nov 29 03:31:58 UTC 2016]
Parameter: ut_dir = /input/movies
Parameter: ut_kind = multi
Parameter: ut_title = Movie Added to Library
Parameter: ut_label = MOVIE
Parameter: deleteAfterExtract = y
Parameter: excludeList = /config/amc-exclude-list.txt
Parameter: ignore = sdh|SDH|\.sub|\.idx|\.ac3
Parameter: movieFormat = Movies/{n.replaceAll(/[\`\u00b4\u2018\u2019\u02bb]/, "'").replaceAll(/[\u201c\u201d]/, '""')} ({y}){'.'+lang}
Parameter: plex = *****
Parameter: mail = *****
Parameter: mailto = *****
Parameter: reportError = y
Use excludes: /config/amc-exclude-list.txt (3857)
Ignore pattern: /input/movies/Fight.Club.1999.1080p.BluRay.x264.AC3-ETRG
No files selected for processing
Failure (°_°)
Because this is running in a Docker container, it is very easy to verify that there are no files holding exclude lists simply by recreating the container. I have deleted my amc-exclude-list.txt, and the same thing happens. I have checked, and that ignore pattern is not even in the amc-exclude-list file. The only files that persist across the container being recreated are my script, a few config files, and amc-exclude-list. The only other locations mounted are the input and output folders, which only house media. I have not found any pattern to the movies that are ignored, but it has not been a problem until within the last couple of months.

By renaming the file, I can get it to process, but only if I significantly rename it:

Code: Select all

Locking /files/amc.log
Run script [fn:amc] at [Tue Nov 29 03:32:59 UTC 2016]
Parameter: ut_dir = /input/movies
Parameter: ut_kind = multi
Parameter: ut_title = Movie Added to Library
Parameter: ut_label = MOVIE
Parameter: deleteAfterExtract = y
Parameter: excludeList = /config/amc-exclude-list.txt
Parameter: ignore = sdh|SDH|\.sub|\.idx|\.ac3
Parameter: movieFormat = Movies/{n.replaceAll(/[\`\u00b4\u2018\u2019\u02bb]/, "'").replaceAll(/[\u201c\u201d]/, '""')} ({y}){'.'+lang}
Parameter: plex = *****
Parameter: mail = *****
Parameter: mailto = *****
Parameter: reportError = y
Use excludes: /config/amc-exclude-list.txt (3857)
Input: /input/movies/Fight.Club.1999/Fight.Club.1990.mp4
Group: [mov:fight club 1999] => [Fight.Club.1990.mp4]
Rename movies using [TheMovieDB]
Auto-detect movie from context: [/input/movies/Fight.Club.1999/Fight.Club.1990.mp4]
[MOVE] Rename [/input/movies/Fight.Club.1999/Fight.Club.1990.mp4] to [/output/Movies/Fight Club (1999).mp4]
Processed 1 files
Notify Plex: [host:*******, token:********]
GET: http://********:32400/library/sections/all/refresh?X-Plex-Token=**********
     [mail] Sending email: [FileBot] Movie Added to Library
     [mail] Sent email with 0 attachments
Done ヾ(@⌒ー⌒@)ノ
My commands have been working perfectly for a long time, and nothing has changed that led to this issue:

Code: Select all

filebot -script fn:amc -no-xattr --output /output --log-file /files/amc.log --action move --conflict skip -non-strict \
  --def ut_dir=/input/movies ut_kind=multi ut_title="Movie Added to Library" ut_label=MOVIE \
  deleteAfterExtract=y excludeList=/config/amc-exclude-list.txt "ignore=sdh|SDH|\.sub|\.idx|\.ac3" \
  movieFormat="$MOVIE_FORMAT" plex=*IPADDR*:*TOKEN* \
  mail=smtp.*SERVER*:587:filebot@*HOST.DOMAIN*:*UNAME*:*PASS* mailto=*EMAIL* reportError=y
  
with the following variables set:

Code: Select all

MOVIE_FORMAT="Movies/{n.$QUOTE_FIXER} ({y}){'.'+lang}"
  
QUOTE_FIXER='replaceAll(/[\`\u00b4\u2018\u2019\u02bb]/, "'"'"'").replaceAll(/[\u201c\u201d]/, '"'"'""'"'"')'
Output of sysinfo:

Code: Select all

filebot -script fn:sysinfo
FileBot 4.7.2 (r4178)
JNA Native: 4.0.1
MediaInfo: 0.7.69
7-Zip-JBinding: 9.20
Nov 30, 2016 2:14:22 AM java.util.prefs.FileSystemPreferences$1 run
INFO: Created user preferences directory.
Chromaprint: 1.1.0
Extended Attributes: java.lang.RuntimeException: java.lang.RuntimeException: java.nio.file.FileSystemException: /root/.filebot/.xattr: Error writing extended attribute 'net.filebot.metadata': Operation not supported
GVFS: OK
Script Bundle: 2016-11-07 (r458)
Groovy: 2.4.7
JRE: Java(TM) SE Runtime Environment 1.8.0_101 (headless)
JVM: 64-bit Java HotSpot(TM) 64-Bit Server VM
CPU/MEM: 16 Core / 5 GB Max Memory / 24 MB Used Memory
OS: Linux (amd64)
Package: DEB
Data: /root/.filebot
uname: Linux a668291cc9d9 3.16.0-4-amd64 #1 SMP Debian 3.16.36-1+deb8u2 (2016-10-19) x86_64 x86_64 x86_64 GNU/Linux

------------------- UPDATE AVAILABLE: FileBot 4.7.5 (r4600) --------------------

Done ?(?????)?
Does anybody with more knowledge of FileBot have any idea where the 'Ignore pattern' is coming from, or why it is happening?

Thanks,
Kyle
User avatar
rednoah
The Source
Posts: 23932
Joined: 16 Nov 2011, 08:59
Location: Taipei
Contact:

Re: FileBot 'Ignore Pattern' When it Shouldn't

Post by rednoah »

The ignore pattern ".ac3" matches (case-insensitively) the filename, specifically the ".AC3" part. The pattern may not always have been case-insensitive in the past, but it wasn't documented either way, so now it's case-insensitive by specification.
:idea: Please read the FAQ and How to Request Help.
kmlucy
Posts: 3
Joined: 29 Jun 2016, 19:33

Re: FileBot 'Ignore Pattern' When it Shouldn't

Post by kmlucy »

So would adding a end of line anchor to the ignore expression fix the match? Like this:

Code: Select all

"ignore=sdh|SDH|\.sub$|\.idx$|\.ac3$"
Also, thanks for the quick response.
User avatar
rednoah
The Source
Posts: 23932
Joined: 16 Nov 2011, 08:59
Location: Taipei
Contact:

Re: FileBot 'Ignore Pattern' When it Shouldn't

Post by rednoah »

Yes, that'll work.
:idea: Please read the FAQ and How to Request Help.
kmlucy
Posts: 3
Joined: 29 Jun 2016, 19:33

Re: FileBot 'Ignore Pattern' When it Shouldn't

Post by kmlucy »

Great, thank you for the help!
Post Reply