Speeding up unpacking

Support for Ubuntu and other Desktop Linux distributions
Post Reply
DubstepNinja
Posts: 7
Joined: 30 Mar 2016, 19:16

Speeding up unpacking

Post by DubstepNinja »

Hi,

I love using Filebot its a great time saver, however I currently have a lftp downloading files from a seedbox, and I have Filebot unpacking them and sorting them (at the same time using screen) however Filebot seems to take ages unpacking, around 20 mins for movies.

cpu: i3-3220
Ram: 3.5G
files are on stored 2 usbs in stripe using usb 3.0 the files are being moved to a 8drive raidz2

Code: Select all

sudo filebot -script fn:amc --output "/mnt/media/Media/" --log-file /mnt/media/Documents/Scripts/pi/logs/second.log --action copy "/mnt/usb/sync" --conflict auto --def clean=y --def unsorted=y --def gmail=***********:********* --def myepisodes=*******:****** --def "seriesFormat=/mnt/media/Media/Tv shows/{n}/Season {s}/{s00e00} - {t}" "movieFormat=/mnt/media/Media/Movies/{n} ({y})/{n} ({y}"

Code: Select all

marcus@MarcusVirtualPc:~$ sudo filebot -script fn:sysinfo
FileBot 4.6.1 (r3315)
JNA Native: 4.0.1
MediaInfo: MediaInfoLib - v0.7.69
7-Zip-JBinding: 9.20
Chromaprint: fpcalc version 1.1.0 (/usr/share/filebot/fpcalc)
Extended Attributes: OK
Groovy Engine: 2.4.5
JRE: Java(TM) SE Runtime Environment 1.8.0_77 (headless)
JVM: 32-bit Java HotSpot(TM) Server VM
CPU/MEM: 3 Core / 768 MB Max Memory / 31 MB Used Memory
OS: Linux (i386)
Package: DEB
Data: /home/marcus/.filebot
uname: Linux MarcusVirtualPc 3.19.0-56-generic #62~14.04.1-Ubuntu SMP Fri Mar 11 11:03:33 UTC 2016 i686 i686 i686 GNU/Linux
Done ヾ(@⌒ー⌒@)ノ

User avatar
rednoah
The Source
Posts: 22923
Joined: 16 Nov 2011, 08:59
Location: Taipei
Contact:

Re: Speeding up unpacking

Post by rednoah »

1.
What kind of archives?

2.
You're using the 7-Zip-JBinding extraction method. That's already native code and it won't get much faster than that. If you think that the 7z command-line tool can do a better job (unlikely) there's an option for that:

Code: Select all

-Dnet.filebot.Archive.extractor=SevenZipExecutable
:idea: Please read the FAQ and How to Request Help.
DubstepNinja
Posts: 7
Joined: 30 Mar 2016, 19:16

Re: Speeding up unpacking

Post by DubstepNinja »

rednoah wrote:1.
What kind of archives?

2.
You're using the 7-Zip-JBinding extraction method. That's already native code and it won't get much faster than that. If you think that the 7z command-line tool can do a better job (unlikely) there's an option for that:

Code: Select all

-Dnet.filebot.Archive.extractor=SevenZipExecutable
there just split rar files, as far as Im aware no compression,
User avatar
rednoah
The Source
Posts: 22923
Joined: 16 Nov 2011, 08:59
Location: Taipei
Contact:

Re: Speeding up unpacking

Post by rednoah »

If you think that it should be faster, then you should at least post the numbers of the tests you ran.

Take an archive:
* time unrar
* time 7z
* time filebot -extract

Try that on different filesystems to make sure it's not just a matter of hardware being slow.
:idea: Please read the FAQ and How to Request Help.
DubstepNinja
Posts: 7
Joined: 30 Mar 2016, 19:16

Re: Speeding up unpacking

Post by DubstepNinja »

Think it might be due to being a virtual machine as the other pcs on my network are around 2-4mins,
as thats the only real variable (other than os? this one is Ubuntu server , all my other Computers are windows,)

btw is there a way of showing a percentage of unpacking in command line?
User avatar
rednoah
The Source
Posts: 22923
Joined: 16 Nov 2011, 08:59
Location: Taipei
Contact:

Re: Speeding up unpacking

Post by rednoah »

I'd start by running a few tests and collecting some data:

Code: Select all

time unrar x "test.rar"
time 7z x "test.rar"
time filebot -extract "test.rar"
:idea: Please read the FAQ and How to Request Help.
Post Reply