Apache Commons VFS cannot extract RAR v5 compressed archives

Support for Synology NAS, QNAP NAS and other Embedded Linux systems
Post Reply
erki
Posts: 8
Joined: 28 Feb 2019, 12:50

Apache Commons VFS cannot extract RAR v5 compressed archives

Post by erki » 28 Feb 2019, 12:56

I used an older version before and it worked well but i thought it was time for an upgrade and downloaded the latest version and bought a license.

Sysinfo:

Code: Select all

FileBot 4.8.5 (r6143)
JNA Native: 5.2.2
MediaInfo: 17.12
Apache Commons VFS: [zip, rar]
FFprobe: java.io.IOException: Cannot run program "/volume1/@appstore/MediaServer/bin/ffprobe": error=2, No such file or directory
Chromaprint: java.io.IOException: Cannot run program "fpcalc": error=2, No such file or directory
Extended Attributes: OK
Unicode Filesystem: OK
Script Bundle: 2019-02-26 (r552)
Groovy: 2.5.6
JRE: Java(TM) SE Embedded Runtime Environment 1.8.0_91
JVM: 32-bit Java HotSpot(TM) Embedded Client VM
CPU/MEM: 1 Core / 247 MB Max Memory / 11 MB Used Memory
OS: Linux (arm)
HW: Linux NASET 2.6.32.12 #23824 Fri Oct 26 18:29:17 CST 2018 armv5tel GNU/Linux synology_88f6282_413j
DATA: /volume1/@appstore/filebot/data/root
Package: SPK
License: FileBot License P7115082 (Valid-Until: 2020-03-06)
Done ヾ(@⌒ー⌒@)ノ
Log file:

Code: Select all

Read archive [modern.family.s10e16.720p.hdtv.x264-avs.rar] and extract to [/volume3/DOWNLOAD/Modern.Family.S10E16.720p.HDTV.x264-AVS/modern.family.s10e16.720p.hdtv.x264-avs/Modern.Family.S10E16.720p.HDTV.x264-AVS]
Ignore video extra: /volume3/DOWNLOAD/Modern.Family.S10E16.720p.HDTV.x264-AVS/Sample/sample-modern.family.s10e16.720p.hdtv.x264-avs.mkv
Read archive [modern.family.s10e16.720p.hdtv.x264-avs.rar] and extract to [/volume3/DOWNLOAD/Modern.Family.S10E16.720p.HDTV.x264-AVS/modern.family.s10e16.720p.hdtv.x264-avs/Modern.Family.S10E16.720p.HDTV.x264-AVS]
Input: /volume3/DOWNLOAD/Modern.Family.S10E16.720p.HDTV.x264-AVS/modern.family.s10e16.720p.hdtv.x264-avs.rar
Group: [tvs:modern family] => [modern.family.s10e16.720p.hdtv.x264-avs.rar]
Rename episodes using [TheTVDB]
Processing 1 unsorted files
[MOVE] from [/volume3/DOWNLOAD/Modern.Family.S10E16.720p.HDTV.x264-AVS/modern.family.s10e16.720p.hdtv.x264-avs.rar] to [/volume4/Media3/Unsorted/Modern.Family.S10E16.720p.HDTV.x264-AVS/modern.family.s10e16.720p.hdtv.x264-avs.rar]

User avatar
rednoah
The Source
Posts: 16984
Joined: 16 Nov 2011, 08:59
Location: Taipei
Contact:

Re: Extracting files does no longer work

Post by rednoah » 28 Feb 2019, 17:11

1.
Not all *.rar files are made equal. Some may work. Some may not. Depends on the compression level and rar algorithm version used. In particular, Apache Commons VFS cannot extract RAR v5 compressed archives.

:?: Does -extract work at all for this particular archive?

Code: Select all

filebot -extract *.rar

2.
The log seems incomplete. What's the filebot command you're using? Are you capturing output by using the --log-file option or by redirecting output?
:idea: Please read the FAQ and How to Request Help.

erki
Posts: 8
Joined: 28 Feb 2019, 12:50

Re: Apache Commons VFS cannot extract RAR v5 compressed archives

Post by erki » 28 Feb 2019, 21:57

1. If i open the rar file with winrar it says RAR 4.X volume (number 1)

Code: Select all

filebot -extract *.rar
Read archive [modern.family.s10e16.720p.hdtv.x264-avs.rar] and extract to [/volume3/DOWNLOAD/Test/modern.family.s10e16.720p.hdtv.x264-avs]
[modern.family.s10e16.720p.hdtv.x264-avs.rar] contains [0] files
2.

Code: Select all

export JAVA_OPTS="-Xmx256m"
/usr/local/bin/filebot -script fn:amc --log all  --output "/volume4/Media3" --action move --conflict override -non-strict --def deleteAfterExtract=y archives=delete unsorted=y clean=y kodi=192.168.1.77 artwork=y subtitles=en "ut_dir=/volume3/DOWNLOAD/" "ut_kind=multi" 1>&2 > /volume1/filebot.log
Filebot.log

Code: Select all

Run script [fn:amc] at [Thu Feb 28 14:08:46 CET 2019]
Parameter: deleteAfterExtract = y
Parameter: archives = delete
Parameter: unsorted = y
Parameter: clean = y
Parameter: kodi = *****
Parameter: artwork = y
Parameter: subtitles = en
Parameter: ut_dir = /volume3/DOWNLOAD/
Parameter: ut_kind = multi
Ignore hidden: /volume3/DOWNLOAD/.TemporaryItems
Ignore hidden: /volume3/DOWNLOAD/.DS_Store
Ignore system path: /volume3/DOWNLOAD/@eaDir
Ignore system path: /volume3/DOWNLOAD/Test/@eaDir
Read archive [modern.family.s10e16.720p.hdtv.x264-avs.rar] and extract to [/volume3/DOWNLOAD/Test/modern.family.s10e16.720p.hdtv.x264-avs/Test]
Read archive [modern.family.s10e16.720p.hdtv.x264-avs.rar] and extract to [/volume3/DOWNLOAD/Test/modern.family.s10e16.720p.hdtv.x264-avs/Test]
Input: /volume3/DOWNLOAD/Test/modern.family.s10e16.720p.hdtv.x264-avs.rar
Group: [tvs:modern family] => [modern.family.s10e16.720p.hdtv.x264-avs.rar]
Rename episodes using [TheTVDB]
Processing 1 unsorted files
[MOVE] from [/volume3/DOWNLOAD/Test/modern.family.s10e16.720p.hdtv.x264-avs.rar] to [/volume4/Media3/Unsorted/modern.family.s10e16.720p.hdtv.x264-avs.rar]
Processed 1 files
Notify Kodi: [host:192.168.1.77]

User avatar
rednoah
The Source
Posts: 16984
Joined: 16 Nov 2011, 08:59
Location: Taipei
Contact:

Re: Apache Commons VFS cannot extract RAR v5 compressed archives

Post by rednoah » 28 Feb 2019, 22:11

Looks like this particular archive won't work, because the library can't can't find any files in the archive:

Code: Select all

[modern.family.s10e16.720p.hdtv.x264-avs.rar] contains [0] files

I'll see if I can switch to just using the QNAP / SYNO built-in unrar command in future revisions.
:idea: Please read the FAQ and How to Request Help.

erki
Posts: 8
Joined: 28 Feb 2019, 12:50

Re: Apache Commons VFS cannot extract RAR v5 compressed archives

Post by erki » 28 Feb 2019, 22:16

Okay so this is just bad luck? Has nothing to do that i upgraded from 4.7.X version to newest? Never had this problem before today and used filebot for years..

erki
Posts: 8
Joined: 28 Feb 2019, 12:50

Re: Apache Commons VFS cannot extract RAR v5 compressed archives

Post by erki » 28 Feb 2019, 22:21

I will modify my postprocess file and use unrar command myself and disable extract in filebot for now. Just tested the unrar and worked perfect on that archive

User avatar
rednoah
The Source
Posts: 16984
Joined: 16 Nov 2011, 08:59
Location: Taipei
Contact:

Re: Apache Commons VFS cannot extract RAR v5 compressed archives

Post by rednoah » 28 Feb 2019, 22:21

Pretty much bad luck with this particular archive. You can try older versions, but AFAIK the junrar code hasn't changed in years, so older versions will likely work exactly the same.
:idea: Please read the FAQ and How to Request Help.

erki
Posts: 8
Joined: 28 Feb 2019, 12:50

Re: Apache Commons VFS cannot extract RAR v5 compressed archives

Post by erki » 01 Mar 2019, 12:05

Sorry but i don't think it's bad luck. Now i tried with another archive and same result.

filebot -extract *.rar
Read archive [south.park.s22e10.720p.hdtv.x264-avs.rar] and extract to [/volume3/DOWNLOAD/Test/south.park.s22e10.720p.hdtv.x264-avs]
[south.park.s22e10.720p.hdtv.x264-avs.rar] contains [0] files

something must have changed in the new version that makes it not working anymore. Please let me know if i should test or do anything on my Synology to find out the error for you?

User avatar
rednoah
The Source
Posts: 16984
Joined: 16 Nov 2011, 08:59
Location: Taipei
Contact:

Re: Apache Commons VFS cannot extract RAR v5 compressed archives

Post by rednoah » 01 Mar 2019, 14:37

It's probably more common from one point in time to the next simply because somebody on the other end screwed up their WinRAR settings, and now all the releases use bad settings.

By convention, rar archives should use uncompressed settings, which makes them easy to extract and allows players like a VLC to play the files directly.

Not to worry. Future releases will delegate to the unrar tool that ships with DSM, which is the only reliable tool to extract rar archives, because it's made by rar labs.
:idea: Please read the FAQ and How to Request Help.

erki
Posts: 8
Joined: 28 Feb 2019, 12:50

Re: Apache Commons VFS cannot extract RAR v5 compressed archives

Post by erki » 12 Mar 2019, 14:48

Hello,
I upgraded the filebot today and now i get this error instead:

COMMAND:

Code: Select all

export JAVA_OPTS="-Xmx256m"
/usr/local/bin/filebot -script dev:amc --log all --log-file "/volume1/filebot.log"  --output "/volume4/Media3" --action move --conflict override -non-strict --def deleteAfterExtract=y archives=delete unsorted=y clean=y kodi=192.168.1.77 artwork=y subtitles=en "ut_dir=/volume3/DOWNLOAD/" "ut_kind=multi"

Code: Select all

Run script [dev:amc] at [Tue Mar 12 15:29:36 CET 2019]
Parameter: deleteAfterExtract = y
Parameter: archives = delete
Parameter: unsorted = y
Parameter: clean = y
Parameter: kodi = *****
Parameter: artwork = y
Parameter: subtitles = en
Parameter: ut_dir = /volume3/DOWNLOAD/
Parameter: ut_kind = multi
Ignore hidden: /volume3/DOWNLOAD/.TemporaryItems
Ignore hidden: /volume3/DOWNLOAD/.DS_Store
Ignore system path: /volume3/DOWNLOAD/South.Park.S22E10.720p.HDTV.x264-AVS/@eaDir
Read archive [south.park.s22e10.720p.hdtv.x264-avs.rar] and extract to [/volume3/DOWNLOAD/South.Park.S22E10.720p.HDTV.x264-AVS/south.park.s22e10.720p.hdtv.x264-avs/South.Park.S22E10.720p.HDTV.x264-AVS]
Extracting files [/volume3/DOWNLOAD/South.Park.S22E10.720p.HDTV.x264-AVS/south.park.s22e10.720p.hdtv.x264-avs/South.Park.S22E10.720p.HDTV.x264-AVS/South.Park.S22E10.720p.HDTV.x264-AVS.mkv]
IOException: [unrar, x, -y, /volume3/DOWNLOAD/South.Park.S22E10.720p.HDTV.x264-AVS/south.park.s22e10.720p.hdtv.x264-avs.rar, /volume3/DOWNLOAD/South.Park.S22E10.720p.HDTV.x264-AVS/south.park.s22e10.720p.hdtv.x264-avs/South.Park.S22E10.720p.HDTV.x264-AVS] failed with exit code 10: UNRAR 5.21 freeware Copyright (c) 1993-2015 Alexander Roshal Extracting from /volume3/DOWNLOAD/South.Park.S22E10.720p.HDTV.x264-AVS/south.park.s22e10.720p.hdtv.x264-avs.rar Extracting from /volume3/DOWNLOAD/South.Park.S22E10.720p.HDTV.x264-AVS/south.park.s22e10.720p.hdtv.x264-avs.r00 Extracting from /volume3/DOWNLOAD/South.Park.S22E10.720p.HDTV.x264-AVS/south.park.s22e10.720p.hdtv.x264-avs.r01 Extracting from /volume3/DOWNLOAD/South.Park.S22E10.720p.HDTV.x264-AVS/south.park.s22e10.720p.hdtv.x264-avs.r02 Extracting from /volume3/DOWNLOAD/South.Park.S22E10.720p.HDTV.x264-AVS/south.park.s22e10.720p.hdtv.x264-avs.r03 Extracting from /volume3/DOWNLOAD/South.Park.S22E10.720p.HDTV.x264-AVS/south.park.s22e10.720p.hdtv.x264-avs.r04 Extracting from /volume3/DOWNLOAD/South.Park.S22E10.720p.HDTV.x264-AVS/south.park.s22e10.720p.hdtv.x264-avs.r05 Extracting from /volume3/DOWNLOAD/South.Park.S22E10.720p.HDTV.x264-AVS/south.park.s22e10.720p.hdtv.x264-avs.r06 No files to extract
Read archive [south.park.s22e10.720p.hdtv.x264-avs.rar] and extract to [/volume3/DOWNLOAD/South.Park.S22E10.720p.HDTV.x264-AVS/south.park.s22e10.720p.hdtv.x264-avs/South.Park.S22E10.720p.HDTV.x264-AVS]
Extracting files [/volume3/DOWNLOAD/South.Park.S22E10.720p.HDTV.x264-AVS/south.park.s22e10.720p.hdtv.x264-avs/South.Park.S22E10.720p.HDTV.x264-AVS/South.Park.S22E10.720p.HDTV.x264-AVS.mkv]
IOException: [unrar, x, -y, /volume3/DOWNLOAD/South.Park.S22E10.720p.HDTV.x264-AVS/south.park.s22e10.720p.hdtv.x264-avs.rar, /volume3/DOWNLOAD/South.Park.S22E10.720p.HDTV.x264-AVS/south.park.s22e10.720p.hdtv.x264-avs/South.Park.S22E10.720p.HDTV.x264-AVS] failed with exit code 10: UNRAR 5.21 freeware Copyright (c) 1993-2015 Alexander Roshal Extracting from /volume3/DOWNLOAD/South.Park.S22E10.720p.HDTV.x264-AVS/south.park.s22e10.720p.hdtv.x264-avs.rar Extracting from /volume3/DOWNLOAD/South.Park.S22E10.720p.HDTV.x264-AVS/south.park.s22e10.720p.hdtv.x264-avs.r00 Extracting from /volume3/DOWNLOAD/South.Park.S22E10.720p.HDTV.x264-AVS/south.park.s22e10.720p.hdtv.x264-avs.r01 Extracting from /volume3/DOWNLOAD/South.Park.S22E10.720p.HDTV.x264-AVS/south.park.s22e10.720p.hdtv.x264-avs.r02 Extracting from /volume3/DOWNLOAD/South.Park.S22E10.720p.HDTV.x264-AVS/south.park.s22e10.720p.hdtv.x264-avs.r03 Extracting from /volume3/DOWNLOAD/South.Park.S22E10.720p.HDTV.x264-AVS/south.park.s22e10.720p.hdtv.x264-avs.r04 Extracting from /volume3/DOWNLOAD/South.Park.S22E10.720p.HDTV.x264-AVS/south.park.s22e10.720p.hdtv.x264-avs.r05 Extracting from /volume3/DOWNLOAD/South.Park.S22E10.720p.HDTV.x264-AVS/south.park.s22e10.720p.hdtv.x264-avs.r06 No files to extract
Input: /volume3/DOWNLOAD/South.Park.S22E10.720p.HDTV.x264-AVS/south.park.s22e10.720p.hdtv.x264-avs.rar
Group: [Series:south park] => [south.park.s22e10.720p.hdtv.x264-avs.rar]
Rename episodes using [TheTVDB]
CmdlineException: No media files: [/volume3/DOWNLOAD/South.Park.S22E10.720p.HDTV.x264-AVS/south.park.s22e10.720p.hdtv.x264-avs.rar]
Processing 1 unsorted files
[OVERRIDE] Delete [/volume4/Media3/Unsorted/South.Park.S22E10.720p.HDTV.x264-AVS/south.park.s22e10.720p.hdtv.x264-avs.rar]
[MOVE] from [/volume3/DOWNLOAD/South.Park.S22E10.720p.HDTV.x264-AVS/south.park.s22e10.720p.hdtv.x264-avs.rar] to [/volume4/Media3/Unsorted/South.Park.S22E10.720p.HDTV.x264-AVS/south.park.s22e10.720p.hdtv.x264-avs.rar]
Processed 1 files
Notify Kodi: [host:192.168.1.77]
POST: http://192.168.1.77:8080/jsonrpc {"jsonrpc":"2.0","method":"GUI.ShowNotification","params":{"title":"FileBot finished processing 1 files","message":"\u2022 south.park.s22e10.720p.hdtv.x264-avs","image":"https://app.filebot.net/icon.png"},"id":1}
POST: http://192.168.1.77:8080/jsonrpc {"jsonrpc":"2.0","method":"VideoLibrary.Scan","id":1}
Delete archive /volume3/DOWNLOAD/South.Park.S22E10.720p.HDTV.x264-AVS/south.park.s22e10.720p.hdtv.x264-avs.rar
Delete archive volume /volume3/DOWNLOAD/South.Park.S22E10.720p.HDTV.x264-AVS/south.park.s22e10.720p.hdtv.x264-avs.r00
Delete archive volume /volume3/DOWNLOAD/South.Park.S22E10.720p.HDTV.x264-AVS/south.park.s22e10.720p.hdtv.x264-avs.r01
Delete archive volume /volume3/DOWNLOAD/South.Park.S22E10.720p.HDTV.x264-AVS/south.park.s22e10.720p.hdtv.x264-avs.r02
Delete archive volume /volume3/DOWNLOAD/South.Park.S22E10.720p.HDTV.x264-AVS/south.park.s22e10.720p.hdtv.x264-avs.r03
Delete archive volume /volume3/DOWNLOAD/South.Park.S22E10.720p.HDTV.x264-AVS/south.park.s22e10.720p.hdtv.x264-avs.r04
Delete archive volume /volume3/DOWNLOAD/South.Park.S22E10.720p.HDTV.x264-AVS/south.park.s22e10.720p.hdtv.x264-avs.r05
Delete archive volume /volume3/DOWNLOAD/South.Park.S22E10.720p.HDTV.x264-AVS/south.park.s22e10.720p.hdtv.x264-avs.r06
Delete archive /volume3/DOWNLOAD/South.Park.S22E10.720p.HDTV.x264-AVS/south.park.s22e10.720p.hdtv.x264-avs.rar
Clean clutter files and empty folders
Done ヾ(@⌒ー⌒@)ノ

User avatar
rednoah
The Source
Posts: 16984
Joined: 16 Nov 2011, 08:59
Location: Taipei
Contact:

Re: Apache Commons VFS cannot extract RAR v5 compressed archives

Post by rednoah » 12 Mar 2019, 14:56

Any idea why this unrar command might not be working?

Code: Select all

unrar x -y "/volume3/DOWNLOAD/South.Park.S22E10.720p.HDTV.x264-AVS/south.park.s22e10.720p.hdtv.x264-avs.rar" "/volume3/DOWNLOAD/South.Park.S22E10.720p.HDTV.x264-AVS/south.park.s22e10.720p.hdtv.x264-avs/South.Park.S22E10.720p.HDTV.x264-AVS"
The good thing about using the unrar tool, is that you can easily try it yourself, to figure out if it's possible in the first place, and what to change to make it work.


EDIT:

Google search indicates that maybe unrar isn't creating the output folder if necessary. Not sure if FileBot is doing that. Maybe FileBot ensure the output folder exists before calling unrar. Maybe that's the issue here. Maybe not. Anyway, uploading new builds with a potential fix.
:idea: Please read the FAQ and How to Request Help.

erki
Posts: 8
Joined: 28 Feb 2019, 12:50

Re: Apache Commons VFS cannot extract RAR v5 compressed archives

Post by erki » 13 Mar 2019, 12:01

Success now extract works!

Do you know how i can fix this problem:

Code: Select all

Fetch failed: Try again in 5 seconds (2 more) => javax.net.ssl.SSLHandshakeException: sun.security.validator.                    ValidatorException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: un                    able to find valid certification path to requested target
Fetch failed: Try again in 10 seconds (1 more) => javax.net.ssl.SSLHandshakeException: sun.security.validator                    .ValidatorException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: u                    nable to find valid certification path to requested target
Fetch failed: https://webservice.fanart.tv/v3/tv/75897?api_key=***REMOVED***
javax.net.ssl.SSLHandshakeException: sun.security.validator.ValidatorException: PKIX path building failed: su                    n.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requeste                    d target
        at net.filebot.web.WebRequest.fetch(WebRequest.java:142)
        at net.filebot.CachedResource.lambda$fetchIfModified$9(CachedResource.java:215)
        at net.filebot.CachedResource.lambda$null$0(CachedResource.java:87)
        at net.filebot.CachedResource.retry(CachedResource.java:121)
        at net.filebot.CachedResource.retry(CachedResource.java:133)
        at net.filebot.CachedResource.retry(CachedResource.java:133)
        at net.filebot.CachedResource.lambda$get$1(CachedResource.java:87)
        at net.filebot.Cache.computeIf(Cache.java:90)
        at net.filebot.CachedResource.get(CachedResource.java:82)
        at net.filebot.web.FanartTVClient.getArtwork(FanartTVClient.java:45)
        at net.filebot.web.ArtworkProvider$getArtwork.call(Unknown Source)
        at Script2.fetchSeriesFanart(Script2.groovy:120)
        at Script2$_fetchSeriesArtworkAndNfo_closure5.doCall(Script2.groovy:185)
        at Script2$_fetchSeriesArtworkAndNfo_closure5.doCall(Script2.groovy)
        at net.filebot.cli.ScriptShellBaseClass.tryLogCatch(ScriptShellBaseClass.java:152)
        at Script2.fetchSeriesArtworkAndNfo(Script2.groovy:157)
        at Script1$_run_closure52$_closure94$_closure101.doCall(Script1.groovy:374)
        at Script1$_run_closure52$_closure94.doCall(Script1.groovy:372)
        at Script1$_run_closure52.doCall(Script1.groovy:369)
        at Script1.run(Script1.groovy:349)
        at net.filebot.cli.ScriptShell.evaluate(ScriptShell.java:64)
        at net.filebot.cli.ScriptShell.runScript(ScriptShell.java:74)
        at net.filebot.cli.ArgumentProcessor.runScript(ArgumentProcessor.java:163)
        at net.filebot.cli.ArgumentProcessor.run(ArgumentProcessor.java:37)
        at net.filebot.Main.main(Main.java:132)
Caused by: javax.net.ssl.SSLHandshakeException: sun.security.validator.ValidatorException: PKIX path building                     failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path                     to requested target
        at net.filebot.web.WebRequest.fetch(WebRequest.java:139)
        ... 24 more
Caused by: sun.security.validator.ValidatorException: PKIX path building failed: sun.security.provider.certpa                    th.SunCertPathBuilderException: unable to find valid certification path to requested target
        ... 25 more
Caused by: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification pat                    h to requested target
        ... 25 more

SSLHandshakeException: sun.security.validator.ValidatorException: PKIX path building failed: sun.security.pro                    vider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target

User avatar
rednoah
The Source
Posts: 16984
Joined: 16 Nov 2011, 08:59
Location: Taipei
Contact:

Re: Apache Commons VFS cannot extract RAR v5 compressed archives

Post by rednoah » 13 Mar 2019, 12:13

A common issue. Not specifically related to FileBot thought.

Might go away by itself. Might require additional SSL root certificates on your machine. Depending on how you've installed the JDK, you might need additional packages to configure the ca certificates correctly.

A general Google search might yield a solution that works for you:
https://confluence.atlassian.com/kb/una ... 55358.html
:idea: Please read the FAQ and How to Request Help.

Post Reply