Filebot 4.8.2 on QNAP - MediaInfoException: Unable to load amd64 (64-bit) native library libmediainfo.so

[muschikatze]

Hey there!

It seems that there is a problem using the filebot 4.8.2 qpkg from your repository at QNAP x86_64 devices in case of using (or needing) libmediainfo:

Code: Select all

bla@BLABLUB: /share/CACHEDEV1_DATA/.qpkg/filebot/lib/x86_64 $ filebot -script fn:sysinfo
x86_64
FileBot 4.8.2 (r5789)
JNA Native: 5.2.2
MediaInfo: net.filebot.mediainfo.MediaInfoException: Unable to load amd64 (64-bit) native library libmediainfo.so: Unable to load library 'mediainfo': Native library (linux-x86-64/libmediainfo.so) not found in resource path ([file:/share/CACHEDEV1_DATA/.qpkg/filebot/jar/filebot.jar])
7-Zip-JBinding: 9.20
Chromaprint: java.io.IOException: Cannot run program "fpcalc": error=2, No such file or directory
Extended Attributes: OK
Unicode Filesystem: OK
Script Bundle: 2018-08-14 (r534)
Groovy: 2.5.1
JRE: Java(TM) SE Runtime Environment 1.8.0_181
JVM: 64-bit Java HotSpot(TM) 64-Bit Server VM
CPU/MEM: 8 Core / 13 GB Max Memory / 14 MB Used Memory
OS: Linux (amd64)
HW: Linux SERVER01 4.2.8 #1 SMP Tue Jul 10 09:40:35 CST 2018 x86_64 GNU/Linux
DATA: /share/CACHEDEV1_DATA/.qpkg/filebot/data/ursgerger
Package: QPKG
License: FileBot License XXXXXXXX (Valid-Until: 2068-08-15)
Done ヾ(＠⌒ー⌒＠)ノ

After a several trys, i could fix it by replacing the "libmediainfo.so"-file located at $QPKGROOT/filebot/lib/x86_64 with an older version (0.7.69) from your github-page: https://github.com/filebot/filebot/comm ... d503e6c691

Any chance to fix this, so that future releases / updates for QNAP devices will work?

Thanks!

Kind regards from austria!
...and sorry if my english isn't the best

[rednoah]

I guess the QNAP OS is based on a pretty old Linux environment. I'll see what I can do.


EDIT:

Please try this one: FileBot_4.8.4.qpkg

[muschikatze]

Thanks!

Seems to work now:

Code: Select all

$ filebot -script fn:sysinfo
FileBot 4.8.4 (r5835)
JNA Native: 5.2.2
MediaInfo: 0.7.69
Apache Commons VFS: [zip, rar]
FFprobe: 3.3.6
Chromaprint: 1.4.2
Extended Attributes: OK
Unicode Filesystem: OK
Script Bundle: 2018-08-14 (r534)
Groovy: 2.5.1
JRE: Java(TM) SE Runtime Environment 1.8.0_181
JVM: 64-bit Java HotSpot(TM) 64-Bit Server VM
CPU/MEM: 8 Core / 13 GB Max Memory / 41 MB Used Memory
OS: Linux (amd64)
HW: Linux SERVER01 4.2.8 #1 SMP Tue Jul 10 09:40:35 CST 2018 x86_64 GNU/Linux
DATA: /share/CACHEDEV1_DATA/.qpkg/filebot/data/ursgerger
Package: QPKG
License: FileBot License XXXXXXX (Valid-Until: 2068-08-15)
Done ヾ(＠⌒ー⌒＠)ノ

Chromaprint is fixed too.

Is there any way to upgrade mediainfo for QNAP devices, because (for example) files with "x265" codec get renamed to "HEVC".

Kind regards!

[rednoah]

Unfortunately, no. QNAP is based on some really limited Linux base system, and generic Linux builds of newer versions of libmediainfo are just not compatible with that anymore.

If you have a very strong Linux / C++ background, then you might be able to compile newer versions of libmediainfo for QNAP.

[muschikatze]

after some trial and error, i found a working libmediainfo.so in version 0.7.87 inside the Qmono-Package of Qnapclub.
This QPKG can be found here: https://www.qnapclub.eu/en/qpkg/193

Code: Select all

$ filebot -script fn:sysinfo
FileBot 4.8.4 (r5835)
JNA Native: 5.2.2
MediaInfo: 0.7.87
Apache Commons VFS: [zip, rar]
FFprobe: 3.3.6
Chromaprint: 1.4.2
Extended Attributes: OK
Unicode Filesystem: OK
Script Bundle: 2018-08-14 (r534)
Groovy: 2.5.1
JRE: Java(TM) SE Runtime Environment 1.8.0_181
JVM: 64-bit Java HotSpot(TM) 64-Bit Server VM
CPU/MEM: 8 Core / 13 GB Max Memory / 41 MB Used Memory
OS: Linux (amd64)
HW: Linux SERVER01 4.2.8 #1 SMP Tue Jul 10 09:40:35 CST 2018 x86_64 GNU/Linux
DATA: /share/CACHEDEV1_DATA/.qpkg/filebot/data/ursgerger
Package: QPKG
License: FileBot License XXXXXXX (Valid-Until: 2068-08-15)
Done ヾ(＠⌒ー⌒＠)ノ

With this one, the codec "x265" will be recognized as "x265" and not as "HEVC". Also the code "ATEME" (ATEME Titan File) is recognized correctly.

Hope this helps?

[muschikatze]

Seems that we wrote at the same time

in case of 1: hmm... thats the problem. linux should be ok, but c++
several years ago i tried to compile some modules/tools for my old qnap, but it didn't work all the time so i gave up.

and 2: the newer versions will recognize it as x265 and so on.
i hope my info with version 0.7.87 will help.

kind regards.

[rednoah]

Do newer versions of libmediainfo actually give you x265 instead of HEVC though? Because x265 is an valid implementation for the HEVC standard.

What does libmediainfo 0.7.69 give you? You can use this command to pretty print the raw metadata:

Code: Select all

filebot *.mkv -script "g:println new JsonBuilder(args.collect{ MediaInfo.snapshot(it) }).toPrettyString()"

EDIT: I'll look into extracting the binaries from the QMONO QPKG. What's the MD5 fingerprint of the libmediainfo that works for you?

[muschikatze]

ok, i had tried some more.

before i moved .qpgk/Qmono/lib/libmediainfo.so.0.0.0 to .qpkg/filebot/lib/x86_64/libmediainfo.so and it worked.
then i uninstalled the Qmono-Page and it doesn't work any more:

Code: Select all

MediaInfo: net.filebot.mediainfo.MediaInfoException: Unable to load amd64 (64-bit) native library libmediainfo.so: Unable to load library 'mediainfo': Native library (linux-x86-64/libmediainfo.so) not found in resource path ([file:/share/CACHEDEV1_DATA/.qpkg/filebot/jar/filebot.jar])

so i installed it again and it works...

at the Qmono-Pagage-lib-dir:

Code: Select all

[/share/CACHEDEV1_DATA/.qpkg/Qmono/lib] # ls -al libmediainfo.*
-rwxrwxr-x 1 admin administrators 18155606 2016-08-19 17:08 libmediainfo.a*
-rwxrwxr-x 1 admin administrators     1496 2016-08-19 17:08 libmediainfo.la*
lrwxrwxrwx 1 admin administrators       21 2018-08-16 08:57 libmediainfo.so -> libmediainfo.so.0.0.0*
lrwxrwxrwx 1 admin administrators       21 2018-08-16 08:57 libmediainfo.so.0 -> libmediainfo.so.0.0.0*
-rwxrwxr-x 1 admin administrators  8221576 2016-08-19 17:08 libmediainfo.so.0.0.0*

now i moved all this files to the filebot-lib directory and uninstalled Qmono again: Same error as before.

Seems that there is a depency to other files from Qmono-package:
with strace:

Code: Select all

[pid 13418] open("/opt/Qmono/lib/tls/x86_64/libcurl.so.4", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
[pid 13418] stat("/opt/Qmono/lib/tls/x86_64", 0x7f36ce0005b0) = -1 ENOENT (No such file or directory)
[pid 13418] open("/opt/Qmono/lib/tls/libcurl.so.4", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
[pid 13418] stat("/opt/Qmono/lib/tls", 0x7f36ce0005b0) = -1 ENOENT (No such file or directory)
[pid 13418] open("/opt/Qmono/lib/x86_64/libcurl.so.4", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
[pid 13418] stat("/opt/Qmono/lib/x86_64", 0x7f36ce0005b0) = -1 ENOENT (No such file or directory)
[pid 13418] open("/opt/Qmono/lib/libcurl.so.4", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
[pid 13418] stat("/opt/Qmono/lib", 0x7f36ce0005b0) = -1 ENOENT (No such file or directory)

only moving the libmediainfo-files seems not to work.

hope this helps.

[muschikatze]

here is the md5sum:

Code: Select all

[/share/CACHEDEV1_DATA/.qpkg/filebot/lib/x86_64] # md5sum libmediainfo.so
a823ed2d2b2749208b1a7cfc2ea6005a  libmediainfo.so

[rednoah]

Does it work if you copy both libmediainfo.so and libcurl.so (the real files, not the versioned symlinks)? There might be additional dependencies once libcurl.so is satisfied though.

If you could run some more tests, that would be appreciated, since I don't have a x86_64 QNAP NAS to run these kinds of tests.

[muschikatze]

tested, but it does not work.

if i copy libcurl.so to filebot/lib/x86_64 an run strace, it only looks at these paths as followed:

Code: Select all

[pid  9083] lstat("/share/CACHEDEV1_DATA/.qpkg/filebot/lib/x86_64/libmediainfo.so", {st_mode=S_IFREG|0775, st_size=8221576, ...}) = 0
[pid  9099] futex(0x7f1340212854, FUTEX_WAIT_BITSET_PRIVATE, 881, {1948709, 871102345}, 0xffffffff <unfinished ...>
[pid  9083] stat("/share/CACHEDEV1_DATA/.qpkg/filebot/lib/x86_64/libmediainfo.so", {st_mode=S_IFREG|0775, st_size=8221576, ...}) = 0
[pid  9083] open("/share/CACHEDEV1_DATA/.qpkg/filebot/lib/x86_64/libmediainfo.so", O_RDONLY|O_CLOEXEC) = 71
[pid  9083] read(71, "\177ELF\2\1\1\3\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\360\216\17\0\0\0\0\0"..., 832) = 832
[pid  9083] fstat(71, {st_mode=S_IFREG|0775, st_size=8221576, ...}) = 0
[pid  9083] mmap(NULL, 9715424, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 71, 0) = 0x7f12b33b2000
[pid  9083] mprotect(0x7f12b3ad2000, 2097152, PROT_NONE) = 0
[pid  9083] mmap(0x7f12b3cd2000, 143360, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 71, 0x720000) = 0x7f12b3cd2000
[pid  9083] mmap(0x7f12b3cf5000, 3808, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x7f12b3cf5000
[pid  9083] close(71)                   = 0
[pid  9083] open("/opt/Qmono/lib/tls/x86_64/libcurl.so.4", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
[pid  9083] stat("/opt/Qmono/lib/tls/x86_64", 0x7f13484515b0) = -1 ENOENT (No such file or directory)
[pid  9083] open("/opt/Qmono/lib/tls/libcurl.so.4", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
[pid  9083] stat("/opt/Qmono/lib/tls", 0x7f13484515b0) = -1 ENOENT (No such file or directory)
[pid  9083] open("/opt/Qmono/lib/x86_64/libcurl.so.4", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
[pid  9083] stat("/opt/Qmono/lib/x86_64", 0x7f13484515b0) = -1 ENOENT (No such file or directory)
[pid  9083] open("/opt/Qmono/lib/libcurl.so.4", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
[pid  9083] stat("/opt/Qmono/lib", 0x7f13484515b0) = -1 ENOENT (No such file or directory)
[pid  9083] open("/root/toolchain/docker_deploy/dockerfile/CT_auto_build/CT/x86_64-QNAP-linux-gnu/cross-tools/x86_64-QNAP-linux-gnu/lib/../lib64/tls/x86_64/libcurl.so.4", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
[pid  9083] stat("/root/toolchain/docker_deploy/dockerfile/CT_auto_build/CT/x86_64-QNAP-linux-gnu/cross-tools/x86_64-QNAP-linux-gnu/lib/../lib64/tls/x86_64", 0x7f13484515b0) = -1 ENOENT (No such file or directory)
[pid  9083] open("/root/toolchain/docker_deploy/dockerfile/CT_auto_build/CT/x86_64-QNAP-linux-gnu/cross-tools/x86_64-QNAP-linux-gnu/lib/../lib64/tls/libcurl.so.4", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
[pid  9083] stat("/root/toolchain/docker_deploy/dockerfile/CT_auto_build/CT/x86_64-QNAP-linux-gnu/cross-tools/x86_64-QNAP-linux-gnu/lib/../lib64/tls", 0x7f13484515b0) = -1 ENOENT (No such file or directory)
[pid  9083] open("/root/toolchain/docker_deploy/dockerfile/CT_auto_build/CT/x86_64-QNAP-linux-gnu/cross-tools/x86_64-QNAP-linux-gnu/lib/../lib64/x86_64/libcurl.so.4", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
[pid  9083] stat("/root/toolchain/docker_deploy/dockerfile/CT_auto_build/CT/x86_64-QNAP-linux-gnu/cross-tools/x86_64-QNAP-linux-gnu/lib/../lib64/x86_64", 0x7f13484515b0) = -1 ENOENT (No such file or directory)
[pid  9083] open("/root/toolchain/docker_deploy/dockerfile/CT_auto_build/CT/x86_64-QNAP-linux-gnu/cross-tools/x86_64-QNAP-linux-gnu/lib/../lib64/libcurl.so.4", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
[pid  9083] stat("/root/toolchain/docker_deploy/dockerfile/CT_auto_build/CT/x86_64-QNAP-linux-gnu/cross-tools/x86_64-QNAP-linux-gnu/lib/../lib64", 0x7f13484515b0) = -1 ENOENT (No such file or directory)
[pid  9083] open("/share/CACHEDEV1_DATA/.qpkg/java-8-installer/jdk1.8.0_181/bin/../lib/amd64/jli/libcurl.so.4", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
[pid  9083] open("/share/CACHEDEV1_DATA/.qpkg/java-8-installer/jdk1.8.0_181/bin/../lib/amd64/libcurl.so.4", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
[pid  9083] open("/etc/ld.so.cache", O_RDONLY|O_CLOEXEC) = 71
[pid  9083] fstat(71, {st_mode=S_IFREG|0644, st_size=38265, ...}) = 0
[pid  9083] mmap(NULL, 38265, PROT_READ, MAP_PRIVATE, 71, 0) = 0x7f12e8bf4000
[pid  9083] close(71)                   = 0
[pid  9083] open("/usr/lib/libcurl.so.4", O_RDONLY|O_CLOEXEC) = 71

now, i have tried to copy "libcurl.so" to "/share/CACHEDEV1_DATA/.qpkg/java-8-installer/jdk1.8.0_181/bin/../lib/amd64/libcurl.so.4" and more dependencys are coming up... (i don't post it now becaue it's a litte "all of text" )

So i think, in this case it's not worth to try more?

Your fixed libmediainfo (0.7.69) seems to be ok for the moment (for the most users i think) on QNAP-Devices and with an installed Qmono-Package, ist possible to run 0.7.87 if copied or linked.

If i have more time the next days, i will "try" to compile a newer libmediainfo for x86_64-QNAP-Devices but i can not guarantee that i will get this working.
i can only try

Thanks for your help until now

Kind regards!

[rednoah]

I've tried the Qmono package on my aarch64 QNAP device, and libmediainfo is notably absent, along other related libraries.

Presumably, you'll need:

Code: Select all

libmediainfo.so
libzen.so
libcurl.so

These are notably absent in my Qmono package, though there might be more.

strace shows where it's searching for libraries, and filebot/lib/x86_64 is being search for by libmediainfo.so because FileBot is loading it directly, but for transitive dependencies loaded automatically because libmediainfo.so requires them, aren't loaded from filebot/lib/x86_64 as far as I can tell.

Setting LD_LIBRARY_PATH explicitly is definitely worth a try and should result in filebot/lib/x86_64 being search for first for all dependencies:

Code: Select all

export LD_LIBRARY_PATH=/share/CACHEDEV1_DATA/.qpkg/filebot/lib/x86_64
filebot -script fn:sysinfo

[muschikatze]

i tied it but it does not work.

i have copied the files:

Code: Select all

[/share/CACHEDEV1_DATA/.qpkg/filebot/lib/x86_64] # ls -al
total 30204
drwxr-xr-x 2 admin administrators    4096 2018-08-16 11:38 ./
drwxr-xr-x 6 admin administrators    4096 2018-08-15 22:11 ../
-rwxr-xr-x 1 admin administrators 5157056 2018-08-15 22:11 fpcalc*
-rw-r--r-- 1 admin administrators 2745145 2018-08-15 22:11 lib7-Zip-JBinding.so
-rwxrwxr-x 1 admin administrators  505744 2016-08-19 16:22 libcurl.so*
-rw-r--r-- 1 admin administrators  112921 2018-08-15 22:11 libjnidispatch.so
-rwxrwxr-x 1 admin administrators 8221576 2016-08-19 17:08 libmediainfo.so*
-rw-r--r-- 1 admin administrators 5571128 2018-08-15 22:11 _libmediainfo.so.backup
-rw-rw-r-- 1 admin administrators 8221576 2016-08-19 17:08 _libmediainfo.so.mono
-rwxrwxr-x 1 admin administrators  355536 2016-08-19 16:47 libzen.so*

uninstalled Qmono an tried it again:

Code: Select all

 $ export LD_LIBRARY_PATH=/share/CACHEDEV1_DATA/.qpkg/filebot/lib/x86_64
 $ filebot -script fn:sysinfo
FileBot 4.8.4 (r5835)
JNA Native: 5.2.2
MediaInfo: net.filebot.mediainfo.MediaInfoException: Unable to load amd64 (64-bit) native library libmediainfo.so: Unable to load library 'mediainfo': Native library (linux-x86-64/libmediainfo.so) not found in resource path ([file:/share/CACHEDEV1_DATA/.qpkg/filebot/jar/filebot.jar])
Apache Commons VFS: [zip, rar]
FFprobe: 3.3.6
Chromaprint: 1.4.2
Extended Attributes: OK
Unicode Filesystem: OK
Script Bundle: 2018-08-14 (r534)
Groovy: 2.5.1
JRE: Java(TM) SE Runtime Environment 1.8.0_181
JVM: 64-bit Java HotSpot(TM) 64-Bit Server VM
CPU/MEM: 8 Core / 13 GB Max Memory / 36 MB Used Memory
OS: Linux (amd64)
HW: Linux SERVER01 4.2.8 #1 SMP Tue Jul 10 09:40:35 CST 2018 x86_64 GNU/Linux
DATA: /share/CACHEDEV1_DATA/.qpkg/filebot/data/ursgerger
Package: QPKG
License: FileBot License XXXXXX (Valid-Until: 2068-08-15)
Done ヾ(＠⌒ー⌒＠)ノ

thanks!!!

[rednoah]

Sorry, I meant with strace so we can see what's going on:

Code: Select all

export LD_LIBRARY_PATH=/share/CACHEDEV1_DATA/.qpkg/filebot/lib/x86_64
strace filebot -script fn:sysinfo

[muschikatze]

Sorry, i know. i tried it with strace -f before, but there are tonns of dependencys of files from the Qmono package.

now, i have tried to copy "libcurl.so" to "/share/CACHEDEV1_DATA/.qpkg/java-8-installer/jdk1.8.0_181/bin/../lib/amd64/libcurl.so.4" and more dependencys are coming up... (i don't post it now becaue it's a litte "all of text" )

So i think, in this case it's not worth to try more?

after its had loaded "/share/CACHEDEV1_DATA/.qpkg/java-8-installer/jdk1.8.0_181/bin/../lib/amd64/libcurl.so.4", many files were missing (minimum of 20?) and strace ran almost 1 minute long till it was finished.

i will try it the next days, if i have more time.

Thanks!
Kind regards!

[rednoah]

Alright, no worries. Let's leave it with 0.7.69 for now.

[dci2112]

Is there a working link to the updated qpkg? The link from this thread gives a 404 not found error. The official QNAP repo still has the broken libmediainfo.so:

Code: Select all

x86_64
FileBot 4.8.2 (r5789)
JNA Native: 5.2.2
MediaInfo: net.filebot.mediainfo.MediaInfoException: Unable to load amd64 (64-bit) native library libmediainfo.so: Unable to load library 'mediainfo': Native library (linux-x86-64/libmediainfo.so) not found in resource path ([file:/share/CACHEDEV1_DATA/.qpkg/filebot/jar/filebot.jar])
7-Zip-JBinding: 9.20
Chromaprint: java.io.IOException: Cannot run program "fpcalc": error=2, No such file or directory
Extended Attributes: OK
Unicode Filesystem: OK
Script Bundle: 2019-02-26 (r552)
Groovy: 2.5.1
JRE: Java(TM) SE Runtime Environment 1.8.0_201
JVM: 64-bit Java HotSpot(TM) 64-Bit Server VM
CPU/MEM: 4 Core / 430 MB Max Memory / 17 MB Used Memory
OS: Linux (amd64)
HW: Linux QNAP 4.2.8 #1 SMP Wed Nov 14 00:59:01 CST 2018 x86_64 GNU/Linux
DATA: /share/CACHEDEV1_DATA/.qpkg/filebot/data/admin
Package: QPKG
License: UNREGISTERED

[rednoah]

Check the 4.8.5 forum thread for download links.