License server spamming due to failed java

Support for Ubuntu and other Desktop Linux distributions
Post Reply
bashers
Posts: 20
Joined: 09 Mar 2014, 09:07

License server spamming due to failed java

Post by bashers »

Recently i recieved an email from your servers regarding spamming of your license server.
On checking i can see the application failing to run on every timed retry.
I've not changed the script or file version recently, but i think i did perform an update of centos before this.
Any ideas what might be aggrevating filebot's process all of the sudden here?

Java version

Code: Select all

[root@transcoder scripts]# java -version
openjdk version "1.8.0_362"
OpenJDK Runtime Environment (build 1.8.0_362-b08)
OpenJDK 64-Bit Server VM (build 25.362-b08, mixed mode)
OS

Code: Select all

[root@transcoder scripts]# cat /etc/centos-release
CentOS Linux release 7.9.2009 (Core)

Code: Select all

/opt/filebot-portable/filebot.sh: line 57:  8142 Aborted                 java -Dapplication.deployment=tar -Dnet.filebot.license="$FILEBOT_HOME/data/.license" -Dnet.filebot.media.parser="$MEDIA_PARSER" -Dnet.filebot.archive.extractor="$ARCHIVE_EXTRACTOR" -Dunixfs=false -DuseExtendedFileAttributes=true -DuseCreationDate=false -Djava.net.useSystemProxies=true -Djna.nosys=true -Djna.nounpack=true -Djna.boot.library.path="$LIBRARY_PATH" -Djna.library.path="$LIBRARY_PATH" -Djava.library.path="$LIBRARY_PATH" -Dapplication.dir="$APP_DATA" -Dapplication.cache="$APP_DATA/cache" -Djava.io.tmpdir="$APP_DATA/tmp" -Dfile.encoding="UTF-8" -Dsun.jnu.encoding="UTF-8" -Duser.home="$APP_DATA" -Djava.util.prefs.PreferencesFactory=net.filebot.util.prefs.FilePreferencesFactory -Dnet.filebot.util.prefs.file="$APP_DATA/prefs.properties" $JAVA_OPTS $FILEBOT_OPTS -jar "$FILEBOT_HOME/jar/filebot.jar" "$@"
Locking /mnt/torrents/Filebot_linux/films_4k.log
May 30, 2023 7:41:04 PM net.sf.ehcache.store.disk.DiskStorageFactory <init>
WARNING: The index for data file /opt/filebot-portable/data/root/cache/0/github_stable_0.data is out of date, probably due to an unclean shutdown. Deleting index file /opt/filebot-portable/data/root/cache/0/github_stable_0.index
Run script [fn:amc] at [Tue May 30 19:41:06 GMT 2023]
Parameter: movieFormat = /mnt/films_4k/{n}-{vf}-({y})
Parameter: clean = y
Parameter: seriesFormat = /mnt/video/TV_Series/{n}/{n} - {'Season '+s}/{n }-{s00e00}-{vf}
Parameter: music = n
Parameter: artwork = n
Parameter: excludeList = /mnt/torrents/Filebot_linux/films_4k_exclude.log
Parameter: exec = curl http://192.168.2.25:32400/library/sections/23/refresh?X-Plex-Token=xxxxxxxxxxxxxxxxxxxxxxxxxxxxxx
Argument[0]: /mnt/torrents/downloads/films_4k
May 30, 2023 7:41:06 PM net.sf.ehcache.store.disk.DiskStorageFactory <init>
[b]WARNING: The index for data file /opt/filebot-portable/data/root/cache/0/filebot_1.data is out of date, probably due to an unclean shutdown. Deleting index file /opt/filebot-portable/data/root/cache/0/filebot_1.index
Activate License Pxxxxxxxxxxxxx[/b]
Use excludes: /mnt/torrents/Filebot_linux/films_4k_exclude.log (13)
No files selected for processing
Done ¯\_(ツ)_/¯
User avatar
rednoah
The Source
Posts: 22923
Joined: 16 Nov 2011, 08:59
Location: Taipei
Contact:

Re: License server spamming due to failed java

Post by rednoah »

:?: Where does it crash? What does the console output say when it crashes? (NOTE: the console output you posted shows filebot running successfully; "unclean shutdown" suggests that the filebot process crashed and was thus killed by the OS)


:?: What does filebot -script fn:sysinfo say?


:?: I don't know what "timed retry" means, but if you do kill -9 mid-process then that can lead to unpredictable behaviours:
rednoah wrote: 29 Dec 2018, 06:21 DO NOT forcibly kill the filebot process:

Code: Select all

WARNING: The index for data file *.data is out of date, probably due to an unclean shutdown.
:!: Consider using -XX:ActiveProcessorCount=1 and -Xmx256m to limit resource usage. That being said, FileBot may not be suitable for shared virtualized environments where the host OS randomly terminates processes that exceed allotted resource limits.

:arrow: You'll want to ensure that filebot does not crash on every run, but we need to first find out where / why it crashes. The console output (NOTE: not to be confused with the FileBot log file) will likely give us detailed information where / why it crashes sometimes.
:idea: Please read the FAQ and How to Request Help.
bashers
Posts: 20
Joined: 09 Mar 2014, 09:07

Re: License server spamming due to failed java

Post by bashers »

Code: Select all

[root@transcoder ~]# filebot -script fn:sysinfo
FileBot 4.8.5 (r6224)
JNA Native: 5.2.2
MediaInfo: 23.03
7-Zip-JBinding: 9.20
Chromaprint: java.io.IOException: Cannot run program "fpcalc": error=2, No such file or directory
Extended Attributes: OK
Unicode Filesystem: OK
Script Bundle: 2019-05-15 (r565)
Groovy: 2.5.6
JRE: OpenJDK Runtime Environment 1.8.0_362
JVM: 64-bit OpenJDK 64-Bit Server VM
CPU/MEM: 8 Core / 843 MB Max Memory / 28 MB Used Memory
OS: Linux (amd64)
HW: Linux transcoder.home.lan 3.10.0-1160.88.1.el7.x86_64 #1 SMP Tue Mar 7 15:41:52 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
DATA: /opt/filebot-portable/data/root
Package: TAR
License: FileBot License Pxxxxxxxxxx (Valid-Until: 2024-01-13)

------------------- UPDATE AVAILABLE: FileBot 5.0.3 (r9760) --------------------

Done ヾ(@⌒ー⌒@)ノ
Im not forcibly killing this process.
The first i knew is the email i received prompting me to stop reactivating the license leading to to investigate the logs

process run from console;

Code: Select all

[root@transcoder ~]# /opt/filebot-portable/filebot.sh -script fn:amc /mnt/torrents/downloads/finished/ -no-xattr --log-file /mnt/torrents/Filebot_linux/films.log --action copy --conflict auto  --def unsorted=y --def unsortedFormat="/mnt/video/_unsorted/{fn}.{ext}" --def clean=y --def "movieFormat=/mnt/films/_Films_3/{n}-({y})/{n}-{vf}-({y})"  -non-strict --def "seriesFormat=/mnt/video/TV_Series/{n}/{n} - {'Season '+s}/{n }-{s00e00}-{vf}" -non-strict --def music=n artwork=n --def excludeList=/mnt/torrents/Filebot_linux/films_exclude.log
Locking /mnt/torrents/Filebot_linux/films.log
Run script [fn:amc] at [Wed May 31 07:16:04 GMT 2023]
Parameter: unsorted = y
Parameter: unsortedFormat = /mnt/video/_unsorted/{fn}.{ext}
Parameter: clean = y
Parameter: movieFormat = /mnt/films/_Films_3/{n}-({y})/{n}-{vf}-({y})
Parameter: seriesFormat = /mnt/video/TV_Series/{n}/{n} - {'Season '+s}/{n }-{s00e00}-{vf}
Parameter: music = n
Parameter: artwork = n
Parameter: excludeList = /mnt/torrents/Filebot_linux/films_exclude.log
Argument[0]: /mnt/torrents/downloads/finished
Use excludes: /mnt/torrents/Filebot_linux/films_exclude.log (176)
Read archive [citadel.s01e01.1080p.web.h264-cakes.rar] and extract to [/mnt/torrents/downloads/finished/Citadel.S01E01.1080p.WEB.H264-CAKES/citadel.s01e01.1080p.web.h264-cakes/Citadel.S01E01.1080p.WEB.H264-CAKES]
Skipped extracting files [/mnt/torrents/downloads/finished/Citadel.S01E01.1080p.WEB.H264-CAKES/citadel.s01e01.1080p.web.h264-cakes/Citadel.S01E01.1080p.WEB.H264-CAKES/citadel.s01e01.1080p.web.h264-cakes.mkv]
#
# A fatal error has been detected by the Java Runtime Environment:
#
#  SIGSEGV (0xb) at pc=0x00007f2b40eecb5f, pid=9905, tid=0x00007f2b70a3d700
#
# JRE version: OpenJDK Runtime Environment (8.0_362-b08) (build 1.8.0_362-b08)
# Java VM: OpenJDK 64-Bit Server VM (25.362-b08 mixed mode linux-amd64 compressed oops)
# Problematic frame:
# C  [libmediainfo.so.0.2303.0+0x140b5f]  ZenLib::BitStream_LE::Get(unsigned long)+0x1f
#
# Failed to write core dump. Core dumps have been disabled. To enable core dumping, try "ulimit -c unlimited" before starting Java again
#
# An error report file with more information is saved as:
# /root/hs_err_pid9905.log
#
# If you would like to submit a bug report, please visit:
#   https://bugzilla.redhat.com/enter_bug.cgi?product=Red%20Hat%20Enterprise%20Linux%207&component=java-1.8.0-openjdk
# The crash happened outside the Java Virtual Machine in native code.
# See problematic frame for where to report the bug.
#
/opt/filebot-portable/filebot.sh: line 57:  9905 Aborted                 java -Dapplication.deployment=tar -Dnet.filebot.license="$FILEBOT_HOME/data/.license" -Dnet.filebot.media.parser="$MEDIA_PARSER" -Dnet.filebot.archive.extractor="$ARCHIVE_EXTRACTOR" -Dunixfs=false -DuseExtendedFileAttributes=true -DuseCreationDate=false -Djava.net.useSystemProxies=true -Djna.nosys=true -Djna.nounpack=true -Djna.boot.library.path="$LIBRARY_PATH" -Djna.library.path="$LIBRARY_PATH" -Djava.library.path="$LIBRARY_PATH" -Dapplication.dir="$APP_DATA" -Dapplication.cache="$APP_DATA/cache" -Djava.io.tmpdir="$APP_DATA/tmp" -Dfile.encoding="UTF-8" -Dsun.jnu.encoding="UTF-8" -Duser.home="$APP_DATA" -Djava.util.prefs.PreferencesFactory=net.filebot.util.prefs.FilePreferencesFactory -Dnet.filebot.util.prefs.file="$APP_DATA/prefs.properties" $JAVA_OPTS $FILEBOT_OPTS -jar "$FILEBOT_HOME/jar/filebot.jar" "$@"
User avatar
rednoah
The Source
Posts: 22923
Joined: 16 Nov 2011, 08:59
Location: Taipei
Contact:

Re: License server spamming due to failed java

Post by rednoah »

rednoah wrote: 29 Dec 2018, 06:21 5.
DO monitor the console output (and not just the --log-file) for crash logs to make sure that 3rd party native libraries (e.g. libmediainfo) aren't crashing the filebot process:

Code: Select all

filebot -script fn:sysinfo
:!: If you are using a Debian-based Linux distribution, please use apt to install filebot (and not the *.deb file) to ensure that all dependencies are binary-compatible with your specific Linux system.

:idea: Your OS is forcibly killing the filebot process because libmediainfo crashes:

Code: Select all

SIGSEGV (0xb) at pc=0x00007f2b40eecb5f, pid=9905, tid=0x00007f2b70a3d700

Code: Select all

# C  [libmediainfo.so.0.2303.0+0x140b5f]  ZenLib::BitStream_LE::Get(unsigned long)+0x1f

:arrow: You can resolve the issue by installing a libmediainfo.so that is binary-compatible with your specific OS version, or by removing libmediainfo.so entirely so that it can't be loaded and thus can't crash the process.


:idea: The TAR package ships with a generic Linux libmediainfo.so binary, but this binary may not necessarily be binary-compatible with all Linux versions past and future. FileBot 4.8.5 suggests that you're using FileBot binaries from 2018. MediaInfo: 23.03 suggests that you have installed libmediainfo via your Linux distributions package repository, and so FileBot is using that. However, libmediainfo 23.03 seems to be faulty. Based on other reports, the solution may be as easy as updating your packages. If not, then you will want to report the issue to the CentOS package maintainers.
:idea: Please read the FAQ and How to Request Help.
bashers
Posts: 20
Joined: 09 Mar 2014, 09:07

Re: License server spamming due to failed java

Post by bashers »

Thank @rednoah. I first attempted an update of libmedia and its all good now
Cheers
Post Reply