Partial File Copy Fix?

Running FileBot from the console, Groovy scripting, shell scripts, etc
Post Reply
JohnnyT009
Posts: 15
Joined: 19 Dec 2016, 02:16

Partial File Copy Fix?

Post by JohnnyT009 »

I have been having issues with filebot renaming my files and copying them but sometimes it does not copy the whole file. This has been happening randomly as sometimes I have no issues at all. It does not always fail at the same time or same length. Is there a way I can put in the script to check the original file to the "finished" copied file and if it is not correct , delete the copy and retry? Thank you

btw. I am using filebot docker by coppit https://github.com/coppit/docker-filebot in unraid.
User avatar
rednoah
The Source
Posts: 22985
Joined: 16 Nov 2011, 08:59
Location: Taipei
Contact:

Re: Partial File Copy Fix?

Post by rednoah »

I don't think anybody has reported anything like that before. It's probably related to your specific setup, such as hardware issues, docker sandbox issues or some other filesystem issues.

In the end FileBot is just asking the OS to do the move/copy operations. It's highly unlikely that that doesn't work reliably (because otherwise everything would randomly fail all the time). But if the OS in fact only does a partial move/copy but doesn't report any errors to FileBot, then there's nothing FileBot can do about it.
:idea: Please read the FAQ and How to Request Help.
JohnnyT009
Posts: 15
Joined: 19 Dec 2016, 02:16

Re: Partial File Copy Fix?

Post by JohnnyT009 »

I thought that was probably the case but chasing that down is going to be difficult at best. Would there be a way for me to force a file compare from the original to the new file? I love FileBot and all the awesomeness it is doing for me but I am not savvy enough to write a program to do this for me. Could you point me in the right direction if I wanted to have FileBot confirm the copy? Would I be able to run a script of my own after Filebot is done, comparing the original to the rename? Thank you
User avatar
rednoah
The Source
Posts: 22985
Joined: 16 Nov 2011, 08:59
Location: Taipei
Contact:

Re: Partial File Copy Fix?

Post by rednoah »

FileBot will store source and destination path in the history, so you can build your own script that that checks if those files are equal.

You could also add {crc32} in the format. If you have the checksum for each file in the name, then you can easily check if the file is corrupt or not later on.
:idea: Please read the FAQ and How to Request Help.
JohnnyT009
Posts: 15
Joined: 19 Dec 2016, 02:16

Re: Partial File Copy Fix?

Post by JohnnyT009 »

I did also notice last night that it was unraring a file and it must have stopped part way as the file should have been 16gb but was only 4gb. FileBot then renamed and copied the 4gb movie file which was incomplete. Does it do any sort of check to say yeah this is good and is the full file? I will investigate more to see if this is happening on rar's or large files in general. I am not sure how it is a system issue as I don't have any problems manually copying and moving files. Is there a log I can look at for FileBot to see why it thought it was done unrarring? Thanks
User avatar
rednoah
The Source
Posts: 22985
Joined: 16 Nov 2011, 08:59
Location: Taipei
Contact:

Re: Partial File Copy Fix?

Post by rednoah »

So it took you 3 posts to mention this? I always appreciated it if people waste my time by omitting (obviously) vital pieces of information.

* You're processing unusually large files and didn't bother to mention that?

* You're extracting unusually large files from unusually large rar archives and didn't bother to mention that?

* Presumably all files larger than ~ 4GB are cut off at exactly 2^32 bytes (~4 GB) which is the maximum value for a 32-bit Integer. (Achievement: you have learned why USB drives that use FAT32 don't support files larger than ~4 GB)


Well, moving on...


Surely you have confirmed that files are extracted correctly in the first place, right? As to confirm the issue is not extracting files, but copying files, as mentioned in the OP, right?

PS: It is now time to send me the filebot -script fn:sysinfo which you should have done in the first post already. ;)
:idea: Please read the FAQ and How to Request Help.
JohnnyT009
Posts: 15
Joined: 19 Dec 2016, 02:16

Re: Partial File Copy Fix?

Post by JohnnyT009 »

This is inside of a docker as I am running unraid. I would like to update it to the latest FileBot but I am not sure how. I am well aware of the fat32 filesystem and its limitations. My filesystem is using XFS and the machine is using 64bit architecture. I am not completely sure if it is only rar files that fail or large files in general as it is random and I am not getting large files daily but I will keep an eye out. I am not sure what you consider to be unusually large but yes the ones that fail have been so far bigger than 4gb.

Code: Select all

root@davidFlix:/# docker exec -it FileBot bash
root@389697dfac50:/# filebot -script fn:sysinfo
FileBot 4.7.2 (r4178)
JNA Native: 4.0.1
MediaInfo: 0.7.69
7-Zip-JBinding: 9.20
Chromaprint: 1.1.0
Extended Attributes: OK
GVFS: OK
Script Bundle: 2016-11-07 (r458)
Groovy: 2.4.7
JRE: Java(TM) SE Runtime Environment 1.8.0_101 (headless)
JVM: 64-bit Java HotSpot(TM) 64-Bit Server VM
CPU/MEM: 6 Core / 3 GB Max Memory / 15 MB Used Memory
OS: Linux (amd64)
Package: DEB
Data: /root/.filebot
uname: Linux 389697dfac50 4.4.30-unRAID #2 SMP PREEMPT Sat Nov 5 12:09:05 PDT 2016 x86_64 x86_64 x86_64 GNU/Linux

------------------- UPDATE AVAILABLE: FileBot 4.7.5 (r4600) --------------------

Done ?(?????)?
User avatar
rednoah
The Source
Posts: 22985
Joined: 16 Nov 2011, 08:59
Location: Taipei
Contact:

Re: Partial File Copy Fix?

Post by rednoah »

Unfortunately, 7-Zip-JBinding project is no longer actively maintained, so if extraction doesn't work, it just doesn't work, and probably never will because I don't have time to work on other projects.

Install the 7z command-line tools and then set the net.filebot.Archive.extractor Java Property to SevenZipExecutable:

Code: Select all

-Dnet.filebot.Archive.extractor=SevenZipExecutable
Using the 7z command-line tool instead of the 7-Zip-JBinding native library may solve the issue.
:idea: Please read the FAQ and How to Request Help.
JohnnyT009
Posts: 15
Joined: 19 Dec 2016, 02:16

Re: Partial File Copy Fix?

Post by JohnnyT009 »

Hmmm..ok. Well I installed using apt-get install p7zip which seemed to work fine.

I modified root@389697dfac50:/usr/share/filebot/bin/filebot.sh to look like this.

Code: Select all

java -Dunixfs=false -DuseGVFS=true -DuseExtendedFileAttributes=true -DuseCreationDate=false -Djava.net.useSystemProxies=false -Djna.nosys=true -Dapplication.deployment=deb "-Dapplication.di
r=$APP_DATA" "-Djava.io.tmpdir=$APP_DATA/temp" "-Dnet.filebot.AcoustID.fpcalc=$APP_ROOT/fpcalc" "-Dnet.filebot.Archive.extractor=SevenZipExecutable" $JAVA_OPTS -jar "$APP_ROOT/FileBot.jar"
"$@"
When I run filebot -script fn:sysinfo I get

Code: Select all

"filebot.sh" 19 lines, 715 characters written
root@389697dfac50:/usr/share/filebot/bin# filebot -script fn:sysinfo
FileBot 4.7.2 (r4178)
JNA Native: 4.0.1
MediaInfo: 0.7.69
p7zip: java.io.IOException: Cannot run program "7z": error=2, No such file or directory
Chromaprint: 1.1.0
Extended Attributes: OK
GVFS: OK
Script Bundle: 2016-11-07 (r458)
Groovy: 2.4.7
JRE: Java(TM) SE Runtime Environment 1.8.0_101 (headless)
JVM: 64-bit Java HotSpot(TM) 64-Bit Server VM
CPU/MEM: 6 Core / 3 GB Max Memory / 16 MB Used Memory
OS: Linux (amd64)
Package: DEB
Data: /root/.filebot
uname: Linux 389697dfac50 4.4.30-unRAID #2 SMP PREEMPT Sat Nov 5 12:09:05 PDT 2016 x86_64 x86_64 x86_64 GNU/Linux

------------------- UPDATE AVAILABLE: FileBot 4.7.5 (r4600) --------------------

Done ?(?????)?
User avatar
rednoah
The Source
Posts: 22985
Joined: 16 Nov 2011, 08:59
Location: Taipei
Contact:

Re: Partial File Copy Fix?

Post by rednoah »

The 7z tool is not installed or not in the $PATH or not called 7z for some reason.

Code: Select all

Cannot run program "7z": error=2, No such file or directory
Note that you may need to install the unrar plugin in addition to the 7z package if you want to extract rar archives. Best to runs some tests with the 7z tool yourself first.
:idea: Please read the FAQ and How to Request Help.
JohnnyT009
Posts: 15
Joined: 19 Dec 2016, 02:16

Re: Partial File Copy Fix?

Post by JohnnyT009 »

I ran

Code: Select all

apt-get install p7zip-full
and this installed the rar component too. It now looks like it is working as intended. I will let you know if I still have issues.

Code: Select all

root@389697dfac50:/usr/share/filebot/bin# filebot -script fn:sysinfo
FileBot 4.7.2 (r4178)
JNA Native: 4.0.1
MediaInfo: 0.7.69
p7zip: Version 9.20 (locale=C,Utf16=off,HugeFiles=on,6 CPUs)
Chromaprint: 1.1.0
Extended Attributes: OK
GVFS: OK
Script Bundle: 2016-11-07 (r458)
Groovy: 2.4.7
JRE: Java(TM) SE Runtime Environment 1.8.0_101 (headless)
JVM: 64-bit Java HotSpot(TM) 64-Bit Server VM
CPU/MEM: 6 Core / 3 GB Max Memory / 15 MB Used Memory
OS: Linux (amd64)
Package: DEB
Data: /root/.filebot
uname: Linux 389697dfac50 4.4.30-unRAID #2 SMP PREEMPT Sat Nov 5 12:09:05 PDT 2016 x86_64 x86_64 x86_64 GNU/Linux

------------------- UPDATE AVAILABLE: FileBot 4.7.5 (r4600) --------------------

Done ?(?????)?
JohnnyT009
Posts: 15
Joined: 19 Dec 2016, 02:16

Re: Partial File Copy Fix?

Post by JohnnyT009 »

Well it is happening again. This time it is not a rar file. I ran a test with a 13.2gb file and filebot found it and then started the copy/rename. This was going fine and then all of a sudden stopped at 8.5gb and then filebot notified me it was finished. Any ideas?
User avatar
rednoah
The Source
Posts: 22985
Joined: 16 Nov 2011, 08:59
Location: Taipei
Contact:

Re: Partial File Copy Fix?

Post by rednoah »

Logs?

* Presumably, you're using the amc script, and it'll create a log. Please post that log.
* Trying the latest version before reporting a bug is generally considered polite (even though it probably won't make a difference in this case).
:idea: Please read the FAQ and How to Request Help.
JohnnyT009
Posts: 15
Joined: 19 Dec 2016, 02:16

Re: Partial File Copy Fix?

Post by JohnnyT009 »

AMC Log - First part is the first time it tried to copy and that one only did a partial file copy. Second attempt after I cleared it from the exclusion list did a full copy. I will work on updating it to the latest version. I also started a thread on unraid to see if they had any ideas. Thanks

Code: Select all

Run script [fn:amc] at [Thu Dec 22 20:48:27 CST 2016]
Parameter: ut_dir = /input
Parameter: ut_kind = multi
Parameter: music = y
Parameter: excludeList = /config/amc-exclude-list.txt
Parameter: SUBTITLE_OPTION = en
Parameter: movieFormat = Movies/{collection+'/'}{n.replaceAll(/[\`\u00b4\u2018\u2019\u02bb]/, "'").replaceAll(/[\u201c\u201d]/, '""')} ({y})/{n.replaceAll(/[\`\u00b4\u2018\u2019\u02bb]/, "'").replaceAll(/[\u201c\u201d]/, '""')} ({y}) {vf} {ac}-{channels}{' CD'+pi}
Parameter: musicFormat = Music/{n.replaceAll(/[\`\u00b4\u2018\u2019\u02bb]/, "'").replaceAll(/[\u201c\u201d]/, '""')}/{album.replaceAll(/[\`\u00b4\u2018\u2019\u02bb]/, "'").replaceAll(/[\u201c\u201d]/, '""')}/{media.TrackPosition.pad(2)} - {t.replaceAll(/[\`\u00b4\u2018\u2019\u02bb]/, "'").replaceAll(/[\u201c\u201d]/, '""')}
Parameter: seriesFormat = TV Shows/{n}/{episode.special ? 'Special' : 'Season '+s.pad(2)}/{n} - {episode.special ? 'S00E'+special.pad(2) : s00e00} - {t.replaceAll(/[\`\u00b4\u2018\u2019\u02bb]/, "'").replaceAll(/[\u201c\u201d]/, '""').replaceAll(/[!?.]+$/).replacePart(', Part ')}{'.'+lang}.{vf}.{ac}
Parameter: pushbullet = *****
Use excludes: /config/amc-exclude-list.txt (507)
Ignore extra: /input/Shooter.S01E05.720p.HDTV.x264-SVA/Sample
Ignore extra: /input/The.Daily.Show.2016.12.05.Van.Jones.720p.HDTV.x264-FLEET/Sample
Ignore extra: /input/Shooter.S01E04.720p.HDTV.x264-FLEET/Sample
Ignore extra: /input/At.Midnight.2016.12.05.720p.HDTV.x264-CROOKS/Sample
Ignore extra: /input/When.Calls.the.Heart.S03E07.720p.HDTV.x264-W4F/SAMPLE
Ignore extra: /input/When.Calls.the.Heart.S03E06.720p.HDTV.x264-W4F/SAMPLE
Ignore extra: /input/When.Calls.the.Heart.S03E01.REAL.720p.HDTV.x264-W4F/SAMPLE
Ignore extra: /input/When.Calls.the.Heart.S03E08.720p.HDTV.x264-W4F/SAMPLE
Ignore extra: /input/When.Calls.the.Heart.S03E05.720p.HDTV.x264-W4F/SAMPLE
Skip small video file: /input/Supernatural.S01-S11.720p.BluRay.WEB-DL.nHD.x264-NhaNc3/Supernatural.S02E01.720p.BluRay.nHD.x264-NhaNc3.mkv
Skip short video: /input/A.Charlie.Brown.Thanksgiving.1973.BRRIP.720p.x264.AAC.INFERNO/A Charlie Brown Thanksgiving 1973sample.mp4
Ignore extra: /input/Marvels.Agents.of.S.H.I.E.L.D.S04E08.720p.HDTV.X264-DIMENSION/Sample
Ignore extra: /input/Designated.Survivor.S01E09.720p.HDTV.x264-KILLERS/Sample
Ignore extra: /input/Sully.2016.1080p.BluRay.Atmos.TrueHD7.1.x264-iFT/Sample.mkv
Ignore extra: /input/Mission Impossible - Ghost Protocol 2011 1080p HC BRrip XVID AC3 BHRG/Mission Impossible - Ghost Protocol 2011 1080p HC BRrip XVID AC3 BHRG sample.avi
Ignore extra: /input/Mission Impossible - Ghost Protocol..2011.Bluray.1080p.DD5.1.x264-PRiME-HD/SAMPLE.mkv
Ignore extra: /input/When.Calls.the.Heart.S03E02.720p.HDTV.x264-W4F/SAMPLE
Ignore extra: /input/The.Daily.Show.2016.12.12.President.Barack.Obama.720p.HDTV.x264-BRISK/Sample
Ignore extra: /input/At.Midnight.2016.12.12.Reggie.Watts.720p.HDTV.x264-BRISK/Sample
Ignore extra: /input/Morgan.2016.1080p.BluRay.DTS-HD.MA7.1.x264-iFT/Sample.mkv
Ignore extra: /input/Tucker.And.Dale.vs.Evil.2010.1080p.BluRay.DTS-HD.MA.5.1.x264-LEGi0N/Tucker.And.Dale.vs.Evil.2010.1080p.BluRay.DTS-HD.MA.5.1.x264-LEGi0N.sample.mkv
Ignore extra: /input/Hesher 2010 1080p BluRay DD5.1 x264-DON/Sample-Hesher 2010 1080p BluRay DD5.1 x264-DON.mkv
Ignore extra: /input/Your Highness UNRATED 2011 1080p BluRay DTS x264-CtrlHD/!sample.mkv
Input: /input/Minority Report [2002] [tt0181689] [1080p].mkv
Group: [mov:minority report 2002] => [Minority Report [2002] [tt0181689] [1080p].mkv]
Rename movies using [TheMovieDB]
Auto-detect movie from context: [/input/Minority Report [2002] [tt0181689] [1080p].mkv]
[COPY] Rename [/input/Minority Report [2002] [tt0181689] [1080p].mkv] to [/output/Movies/Minority Report (2002)/Minority Report (2002) 1080p DTS-5.1.mkv]
Processed 1 files
Sending PushBullet report
Done ヾ(@⌒ー⌒@)ノ

Run script [fn:amc] at [Thu Dec 22 21:10:55 CST 2016]
Parameter: ut_dir = /input
Parameter: ut_kind = multi
Parameter: music = y
Parameter: excludeList = /config/amc-exclude-list.txt
Parameter: SUBTITLE_OPTION = en
Parameter: movieFormat = Movies/{collection+'/'}{n.replaceAll(/[\`\u00b4\u2018\u2019\u02bb]/, "'").replaceAll(/[\u201c\u201d]/, '""')} ({y})/{n.replaceAll(/[\`\u00b4\u2018\u2019\u02bb]/, "'").replaceAll(/[\u201c\u201d]/, '""')} ({y}) {vf} {ac}-{channels}{' CD'+pi}
Parameter: musicFormat = Music/{n.replaceAll(/[\`\u00b4\u2018\u2019\u02bb]/, "'").replaceAll(/[\u201c\u201d]/, '""')}/{album.replaceAll(/[\`\u00b4\u2018\u2019\u02bb]/, "'").replaceAll(/[\u201c\u201d]/, '""')}/{media.TrackPosition.pad(2)} - {t.replaceAll(/[\`\u00b4\u2018\u2019\u02bb]/, "'").replaceAll(/[\u201c\u201d]/, '""')}
Parameter: seriesFormat = TV Shows/{n}/{episode.special ? 'Special' : 'Season '+s.pad(2)}/{n} - {episode.special ? 'S00E'+special.pad(2) : s00e00} - {t.replaceAll(/[\`\u00b4\u2018\u2019\u02bb]/, "'").replaceAll(/[\u201c\u201d]/, '""').replaceAll(/[!?.]+$/).replacePart(', Part ')}{'.'+lang}.{vf}.{ac}
Parameter: pushbullet = *****
Use excludes: /config/amc-exclude-list.txt (508)
Ignore extra: /input/Shooter.S01E05.720p.HDTV.x264-SVA/Sample
Ignore extra: /input/The.Daily.Show.2016.12.05.Van.Jones.720p.HDTV.x264-FLEET/Sample
Ignore extra: /input/Shooter.S01E04.720p.HDTV.x264-FLEET/Sample
Ignore extra: /input/At.Midnight.2016.12.05.720p.HDTV.x264-CROOKS/Sample
Ignore extra: /input/When.Calls.the.Heart.S03E07.720p.HDTV.x264-W4F/SAMPLE
Ignore extra: /input/When.Calls.the.Heart.S03E06.720p.HDTV.x264-W4F/SAMPLE
Ignore extra: /input/When.Calls.the.Heart.S03E01.REAL.720p.HDTV.x264-W4F/SAMPLE
Ignore extra: /input/When.Calls.the.Heart.S03E08.720p.HDTV.x264-W4F/SAMPLE
Ignore extra: /input/When.Calls.the.Heart.S03E05.720p.HDTV.x264-W4F/SAMPLE
Skip small video file: /input/Supernatural.S01-S11.720p.BluRay.WEB-DL.nHD.x264-NhaNc3/Supernatural.S02E01.720p.BluRay.nHD.x264-NhaNc3.mkv
Skip short video: /input/A.Charlie.Brown.Thanksgiving.1973.BRRIP.720p.x264.AAC.INFERNO/A Charlie Brown Thanksgiving 1973sample.mp4
Ignore extra: /input/Marvels.Agents.of.S.H.I.E.L.D.S04E08.720p.HDTV.X264-DIMENSION/Sample
Ignore extra: /input/Designated.Survivor.S01E09.720p.HDTV.x264-KILLERS/Sample
Ignore extra: /input/Sully.2016.1080p.BluRay.Atmos.TrueHD7.1.x264-iFT/Sample.mkv
Ignore extra: /input/Mission Impossible - Ghost Protocol 2011 1080p HC BRrip XVID AC3 BHRG/Mission Impossible - Ghost Protocol 2011 1080p HC BRrip XVID AC3 BHRG sample.avi
Ignore extra: /input/Mission Impossible - Ghost Protocol..2011.Bluray.1080p.DD5.1.x264-PRiME-HD/SAMPLE.mkv
Ignore extra: /input/When.Calls.the.Heart.S03E02.720p.HDTV.x264-W4F/SAMPLE
Ignore extra: /input/The.Daily.Show.2016.12.12.President.Barack.Obama.720p.HDTV.x264-BRISK/Sample
Ignore extra: /input/At.Midnight.2016.12.12.Reggie.Watts.720p.HDTV.x264-BRISK/Sample
Ignore extra: /input/Morgan.2016.1080p.BluRay.DTS-HD.MA7.1.x264-iFT/Sample.mkv
Ignore extra: /input/Tucker.And.Dale.vs.Evil.2010.1080p.BluRay.DTS-HD.MA.5.1.x264-LEGi0N/Tucker.And.Dale.vs.Evil.2010.1080p.BluRay.DTS-HD.MA.5.1.x264-LEGi0N.sample.mkv
Ignore extra: /input/Hesher 2010 1080p BluRay DD5.1 x264-DON/Sample-Hesher 2010 1080p BluRay DD5.1 x264-DON.mkv
Ignore extra: /input/Your Highness UNRATED 2011 1080p BluRay DTS x264-CtrlHD/!sample.mkv
No files selected for processing
Failure (°_°)

Run script [fn:amc] at [Thu Dec 22 21:14:16 CST 2016]
Parameter: ut_dir = /input
Parameter: ut_kind = multi
Parameter: music = y
Parameter: excludeList = /config/amc-exclude-list.txt
Parameter: SUBTITLE_OPTION = en
Parameter: movieFormat = Movies/{collection+'/'}{n.replaceAll(/[\`\u00b4\u2018\u2019\u02bb]/, "'").replaceAll(/[\u201c\u201d]/, '""')} ({y})/{n.replaceAll(/[\`\u00b4\u2018\u2019\u02bb]/, "'").replaceAll(/[\u201c\u201d]/, '""')} ({y}) {vf} {ac}-{channels}{' CD'+pi}
Parameter: musicFormat = Music/{n.replaceAll(/[\`\u00b4\u2018\u2019\u02bb]/, "'").replaceAll(/[\u201c\u201d]/, '""')}/{album.replaceAll(/[\`\u00b4\u2018\u2019\u02bb]/, "'").replaceAll(/[\u201c\u201d]/, '""')}/{media.TrackPosition.pad(2)} - {t.replaceAll(/[\`\u00b4\u2018\u2019\u02bb]/, "'").replaceAll(/[\u201c\u201d]/, '""')}
Parameter: seriesFormat = TV Shows/{n}/{episode.special ? 'Special' : 'Season '+s.pad(2)}/{n} - {episode.special ? 'S00E'+special.pad(2) : s00e00} - {t.replaceAll(/[\`\u00b4\u2018\u2019\u02bb]/, "'").replaceAll(/[\u201c\u201d]/, '""').replaceAll(/[!?.]+$/).replacePart(', Part ')}{'.'+lang}.{vf}.{ac}
Parameter: pushbullet = *****
Use excludes: /config/amc-exclude-list.txt (507)
Ignore extra: /input/Shooter.S01E05.720p.HDTV.x264-SVA/Sample
Ignore extra: /input/The.Daily.Show.2016.12.05.Van.Jones.720p.HDTV.x264-FLEET/Sample
Ignore extra: /input/Shooter.S01E04.720p.HDTV.x264-FLEET/Sample
Ignore extra: /input/At.Midnight.2016.12.05.720p.HDTV.x264-CROOKS/Sample
Ignore extra: /input/When.Calls.the.Heart.S03E07.720p.HDTV.x264-W4F/SAMPLE
Ignore extra: /input/When.Calls.the.Heart.S03E06.720p.HDTV.x264-W4F/SAMPLE
Ignore extra: /input/When.Calls.the.Heart.S03E01.REAL.720p.HDTV.x264-W4F/SAMPLE
Ignore extra: /input/When.Calls.the.Heart.S03E08.720p.HDTV.x264-W4F/SAMPLE
Ignore extra: /input/When.Calls.the.Heart.S03E05.720p.HDTV.x264-W4F/SAMPLE
Skip small video file: /input/Supernatural.S01-S11.720p.BluRay.WEB-DL.nHD.x264-NhaNc3/Supernatural.S02E01.720p.BluRay.nHD.x264-NhaNc3.mkv
Skip short video: /input/A.Charlie.Brown.Thanksgiving.1973.BRRIP.720p.x264.AAC.INFERNO/A Charlie Brown Thanksgiving 1973sample.mp4
Ignore extra: /input/Marvels.Agents.of.S.H.I.E.L.D.S04E08.720p.HDTV.X264-DIMENSION/Sample
Ignore extra: /input/Designated.Survivor.S01E09.720p.HDTV.x264-KILLERS/Sample
Ignore extra: /input/Sully.2016.1080p.BluRay.Atmos.TrueHD7.1.x264-iFT/Sample.mkv
Ignore extra: /input/Mission Impossible - Ghost Protocol 2011 1080p HC BRrip XVID AC3 BHRG/Mission Impossible - Ghost Protocol 2011 1080p HC BRrip XVID AC3 BHRG sample.avi
Ignore extra: /input/Mission Impossible - Ghost Protocol..2011.Bluray.1080p.DD5.1.x264-PRiME-HD/SAMPLE.mkv
Ignore extra: /input/When.Calls.the.Heart.S03E02.720p.HDTV.x264-W4F/SAMPLE
Ignore extra: /input/The.Daily.Show.2016.12.12.President.Barack.Obama.720p.HDTV.x264-BRISK/Sample
Ignore extra: /input/At.Midnight.2016.12.12.Reggie.Watts.720p.HDTV.x264-BRISK/Sample
Ignore extra: /input/Morgan.2016.1080p.BluRay.DTS-HD.MA7.1.x264-iFT/Sample.mkv
Ignore extra: /input/Tucker.And.Dale.vs.Evil.2010.1080p.BluRay.DTS-HD.MA.5.1.x264-LEGi0N/Tucker.And.Dale.vs.Evil.2010.1080p.BluRay.DTS-HD.MA.5.1.x264-LEGi0N.sample.mkv
Ignore extra: /input/Hesher 2010 1080p BluRay DD5.1 x264-DON/Sample-Hesher 2010 1080p BluRay DD5.1 x264-DON.mkv
Ignore extra: /input/Your Highness UNRATED 2011 1080p BluRay DTS x264-CtrlHD/!sample.mkv
Input: /input/Minority Report [2002] [tt0181689] [1080p].mkv
Group: [mov:minority report 2002] => [Minority Report [2002] [tt0181689] [1080p].mkv]
Rename movies using [TheMovieDB]
Auto-detect movie from context: [/input/Minority Report [2002] [tt0181689] [1080p].mkv]
[COPY] Rename [/input/Minority Report [2002] [tt0181689] [1080p].mkv] to [/output/Movies/Minority Report (2002)/Minority Report (2002) 1080p DTS-5.1.mkv]
Processed 1 files
Sending PushBullet report
Done ヾ(@⌒ー⌒@)ノ
JohnnyT009
Posts: 15
Joined: 19 Dec 2016, 02:16

Re: Partial File Copy Fix?

Post by JohnnyT009 »

I believe I know what is causing this. I have filebot run on a schedule and it looks like it is running on files before they are finished being moved to that directory. My current setup is Torrent starts in Deluge -> DL Temp folder-> Finished Torrent -> MediaFinal -> FileBot scans "MediaFinal" It looks like before deluge completes moving the file to MediaFinal deluge picks it up. I thought filebot checked to see if a file was still changing but maybe I am wrong. I might have to find a way to run filebot inside my deluge docker.
User avatar
rednoah
The Source
Posts: 22985
Joined: 16 Nov 2011, 08:59
Location: Taipei
Contact:

Re: Partial File Copy Fix?

Post by rednoah »

If you call filebot on partial files, then I wouldn't be surprised if only partial files are copied.

FileBot absolutely does not check if files are changing, and neither does any other command-line tool. You can make your own find -exec call to select files that haven't been changed for X amount of time and run filebot on that.

@see https://linuxaria.com/howto/linux-shell ... h-examples
:idea: Please read the FAQ and How to Request Help.
Pukinator
Posts: 4
Joined: 23 Aug 2016, 18:43

Re: Partial File Copy Fix?

Post by Pukinator »

I have the same problem. In my setup deluge downloads to /downloading and then moves the finished files to /downloads, so there shouldn't be a problem. I'll have to look if it's only 4 GB+ files
Post Reply