Page 1 of 1

FileBot 'Ignore Pattern' When it Shouldn't

Posted: 30 Nov 2016, 02:26
by kmlucy
I am running FileBot 4.7.2 in a Docker container through coppit/filebot. The container is based on Ubuntu 16.04, the host system is Debian Jessie.

The problem I am having is that some movies are being ignored when they shouldn't be. Here is an example log of a movie that is ignored:

Code: Select all

Locking /files/amc.log
Run script [fn:amc] at [Tue Nov 29 03:31:58 UTC 2016]
Parameter: ut_dir = /input/movies
Parameter: ut_kind = multi
Parameter: ut_title = Movie Added to Library
Parameter: ut_label = MOVIE
Parameter: deleteAfterExtract = y
Parameter: excludeList = /config/amc-exclude-list.txt
Parameter: ignore = sdh|SDH|\.sub|\.idx|\.ac3
Parameter: movieFormat = Movies/{n.replaceAll(/[\`\u00b4\u2018\u2019\u02bb]/, "'").replaceAll(/[\u201c\u201d]/, '""')} ({y}){'.'+lang}
Parameter: plex = *****
Parameter: mail = *****
Parameter: mailto = *****
Parameter: reportError = y
Use excludes: /config/amc-exclude-list.txt (3857)
Ignore pattern: /input/movies/Fight.Club.1999.1080p.BluRay.x264.AC3-ETRG
No files selected for processing
Failure (°_°)
Because this is running in a Docker container, it is very easy to verify that there are no files holding exclude lists simply by recreating the container. I have deleted my amc-exclude-list.txt, and the same thing happens. I have checked, and that ignore pattern is not even in the amc-exclude-list file. The only files that persist across the container being recreated are my script, a few config files, and amc-exclude-list. The only other locations mounted are the input and output folders, which only house media. I have not found any pattern to the movies that are ignored, but it has not been a problem until within the last couple of months.

By renaming the file, I can get it to process, but only if I significantly rename it:

Code: Select all

Locking /files/amc.log
Run script [fn:amc] at [Tue Nov 29 03:32:59 UTC 2016]
Parameter: ut_dir = /input/movies
Parameter: ut_kind = multi
Parameter: ut_title = Movie Added to Library
Parameter: ut_label = MOVIE
Parameter: deleteAfterExtract = y
Parameter: excludeList = /config/amc-exclude-list.txt
Parameter: ignore = sdh|SDH|\.sub|\.idx|\.ac3
Parameter: movieFormat = Movies/{n.replaceAll(/[\`\u00b4\u2018\u2019\u02bb]/, "'").replaceAll(/[\u201c\u201d]/, '""')} ({y}){'.'+lang}
Parameter: plex = *****
Parameter: mail = *****
Parameter: mailto = *****
Parameter: reportError = y
Use excludes: /config/amc-exclude-list.txt (3857)
Input: /input/movies/Fight.Club.1999/Fight.Club.1990.mp4
Group: [mov:fight club 1999] => [Fight.Club.1990.mp4]
Rename movies using [TheMovieDB]
Auto-detect movie from context: [/input/movies/Fight.Club.1999/Fight.Club.1990.mp4]
[MOVE] Rename [/input/movies/Fight.Club.1999/Fight.Club.1990.mp4] to [/output/Movies/Fight Club (1999).mp4]
Processed 1 files
Notify Plex: [host:*******, token:********]
GET: http://********:32400/library/sections/all/refresh?X-Plex-Token=**********
     [mail] Sending email: [FileBot] Movie Added to Library
     [mail] Sent email with 0 attachments
Done ヾ(@⌒ー⌒@)ノ
My commands have been working perfectly for a long time, and nothing has changed that led to this issue:

Code: Select all

filebot -script fn:amc -no-xattr --output /output --log-file /files/amc.log --action move --conflict skip -non-strict \
  --def ut_dir=/input/movies ut_kind=multi ut_title="Movie Added to Library" ut_label=MOVIE \
  deleteAfterExtract=y excludeList=/config/amc-exclude-list.txt "ignore=sdh|SDH|\.sub|\.idx|\.ac3" \
  movieFormat="$MOVIE_FORMAT" plex=*IPADDR*:*TOKEN* \
  mail=smtp.*SERVER*:587:filebot@*HOST.DOMAIN*:*UNAME*:*PASS* mailto=*EMAIL* reportError=y
  
with the following variables set:

Code: Select all

MOVIE_FORMAT="Movies/{n.$QUOTE_FIXER} ({y}){'.'+lang}"
  
QUOTE_FIXER='replaceAll(/[\`\u00b4\u2018\u2019\u02bb]/, "'"'"'").replaceAll(/[\u201c\u201d]/, '"'"'""'"'"')'
Output of sysinfo:

Code: Select all

filebot -script fn:sysinfo
FileBot 4.7.2 (r4178)
JNA Native: 4.0.1
MediaInfo: 0.7.69
7-Zip-JBinding: 9.20
Nov 30, 2016 2:14:22 AM java.util.prefs.FileSystemPreferences$1 run
INFO: Created user preferences directory.
Chromaprint: 1.1.0
Extended Attributes: java.lang.RuntimeException: java.lang.RuntimeException: java.nio.file.FileSystemException: /root/.filebot/.xattr: Error writing extended attribute 'net.filebot.metadata': Operation not supported
GVFS: OK
Script Bundle: 2016-11-07 (r458)
Groovy: 2.4.7
JRE: Java(TM) SE Runtime Environment 1.8.0_101 (headless)
JVM: 64-bit Java HotSpot(TM) 64-Bit Server VM
CPU/MEM: 16 Core / 5 GB Max Memory / 24 MB Used Memory
OS: Linux (amd64)
Package: DEB
Data: /root/.filebot
uname: Linux a668291cc9d9 3.16.0-4-amd64 #1 SMP Debian 3.16.36-1+deb8u2 (2016-10-19) x86_64 x86_64 x86_64 GNU/Linux

------------------- UPDATE AVAILABLE: FileBot 4.7.5 (r4600) --------------------

Done ?(?????)?
Does anybody with more knowledge of FileBot have any idea where the 'Ignore pattern' is coming from, or why it is happening?

Thanks,
Kyle

Re: FileBot 'Ignore Pattern' When it Shouldn't

Posted: 30 Nov 2016, 12:04
by rednoah
The ignore pattern ".ac3" matches (case-insensitively) the filename, specifically the ".AC3" part. The pattern may not always have been case-insensitive in the past, but it wasn't documented either way, so now it's case-insensitive by specification.

Re: FileBot 'Ignore Pattern' When it Shouldn't

Posted: 30 Nov 2016, 14:58
by kmlucy
So would adding a end of line anchor to the ignore expression fix the match? Like this:

Code: Select all

"ignore=sdh|SDH|\.sub$|\.idx$|\.ac3$"
Also, thanks for the quick response.

Re: FileBot 'Ignore Pattern' When it Shouldn't

Posted: 30 Nov 2016, 15:43
by rednoah
Yes, that'll work.

Re: FileBot 'Ignore Pattern' When it Shouldn't

Posted: 30 Nov 2016, 15:45
by kmlucy
Great, thank you for the help!