Filebot skips all other files, if first one already exists.

All your suggestions, requests and ideas for future development
Post Reply
D3LZ
Posts: 2
Joined: 18 Jul 2017, 14:45

Filebot skips all other files, if first one already exists.

Post by D3LZ » 18 Jul 2017, 14:55

Recently filebot has started skipping all other episodes if one of the files already exists in the target directory. ( it used to work , i haven't changed anything)

Code: Select all

Argument[0]: F:\downloaded
Ignore hidden: F:\downloaded\desktop.ini
Input: F:\downloaded\Dark.Matter.S03E05.1080p.HEVC.x265-MeGusta\Dark.Matter.S03E05.1080p.HEVC.x265-MeGusta.mkv
Input: F:\downloaded\Dark.Matter.S03E06.720p.HEVC.x265-MeGusta\Dark.Matter.S03E06.720p.HEVC.x265-MeGusta.mkv
Input: F:\downloaded\Dark.Matter.S03E07.1080p.HEVC.x265-MeGusta\Dark.Matter.S03E07.1080p.HEVC.x265-MeGusta.mkv
Input: F:\downloaded\Zoo.S03E02.720p.HEVC.x265-MeGusta\Zoo.S03E02.720p.HEVC.x265-MeGusta.mkv
Input: F:\downloaded\Zoo.S03E03.720p.HEVC.x265-MeGusta\Zoo.S03E03.720p.HEVC.x265-MeGusta.mkv
Group: [tvs:dark matter] => [Dark.Matter.S03E05.1080p.HEVC.x265-MeGusta.mkv, Dark.Matter.S03E06.720p.HEVC.x265-MeGusta.mkv, Dark.Matter.S03E07.1080p.HEVC.x265-MeGusta.mkv]
Group: [tvs:zoo] => [Zoo.S03E02.720p.HEVC.x265-MeGusta.mkv, Zoo.S03E03.720p.HEVC.x265-MeGusta.mkv]
Rename episodes using [TheTVDB]
Auto-detected query: [Dark Matter]
Fetching episode data for [Dark Matter]
Fetching episode data for [Dark Matters]
Fetching episode data for [Work Matters]
Fetching episode data for [Dark Matter, Dark Energy - The Dark Side of the Universe]
Processed 0 files
CmdlineException: Failed to process [F:\downloaded\Dark.Matter.S03E05.1080p.HEVC.x265-MeGusta\Dark.Matter.S03E05.1080p.HEVC.x265-MeGusta.mkv] because [T:\TV Shows\Dark Matter\Season 03\Dark Matter - S03E05 - Give It Up, Princess.mkv] is an exact copy and already exists
Rename episodes using [TheTVDB]
Auto-detected query: [Zoo]
Fetching episode data for [Zoo]
Fetching episode data for [The Zoo (2017)]
Fetching episode data for [Zoo Mix]
Fetching episode data for [Zoo Days]
Fetching episode data for [Zoo Vets]
Processed 0 files
CmdlineException: Failed to process [F:\downloaded\Zoo.S03E02.720p.HEVC.x265-MeGusta\Zoo.S03E02.720p.HEVC.x265-MeGusta.mkv] because [T:\TV Shows\Zoo\Season 03\Zoo - S03E02 - Diaspora.mkv] is an exact copy and already exists
Finished without processing any files
Failure (°_°)
Press any key to continue . . .

User avatar
rednoah
The Source
Posts: 18650
Joined: 16 Nov 2011, 08:59
Location: Taipei
Contact:

Re: Filebot skips all other files, if first one already exists.

Post by rednoah » 18 Jul 2017, 15:51

Why would you process the same files over and over? What you're trying to do fails the sanity check:

Code: Select all

Failed to process [F:\downloaded\Dark.Matter.S03E05.1080p.HEVC.x265-MeGusta\Dark.Matter.S03E05.1080p.HEVC.x265-MeGusta.mkv] because [T:\TV Shows\Dark Matter\Season 03\Dark Matter - S03E05 - Give It Up, Princess.mkv] is an exact copy and already exists
If you process the same folder over and over, then you need to specify an exclude list so FileBot can know which files have already been processed and which haven't.
:idea: Please read the FAQ and How to Request Help.

D3LZ
Posts: 2
Joined: 18 Jul 2017, 14:45

Re: Filebot skips all other files, if first one already exists.

Post by D3LZ » 19 Jul 2017, 10:11

I have a downloads folder which filebot copies the files from, once they have finished seeding those files are deleted, was never a problem before as filebot would skip the files that had already been copied, and still process the rest.

so while T:\TV Shows\Dark Matter\Season 03\Dark Matter - S03E05 - Give It Up, Princess.mkv has already been copied and already exists. S03E06 and S03E07 have not, but filebot is not processing those files.

Ok I added the exclude list, thanks :-)

jake
Donor
Posts: 9
Joined: 07 Nov 2017, 07:42

Re: Filebot skips all other files, if first one already exists.

Post by jake » 07 Nov 2017, 08:20

rednoah wrote:
18 Jul 2017, 15:51
Why would you process the same files over and over? What you're trying to do fails the sanity check:

Code: Select all

Failed to process [F:\downloaded\Dark.Matter.S03E05.1080p.HEVC.x265-MeGusta\Dark.Matter.S03E05.1080p.HEVC.x265-MeGusta.mkv] because [T:\TV Shows\Dark Matter\Season 03\Dark Matter - S03E05 - Give It Up, Princess.mkv] is an exact copy and already exists
If you process the same folder over and over, then you need to specify an exclude list so FileBot can know which files have already been processed and which haven't.
I have a lot of folders where episodes are autodownload in different versions and resolutions when available. After the season is finished I use a seasonpack to make sure everything is in high res and with the correct subs ...

Problem is that filebot gives up with "exact copy and already exists" early in the process and there is no way to override this. I experimented with the --conflict but it seems it doesnt change this behaviour.

User avatar
rednoah
The Source
Posts: 18650
Joined: 16 Nov 2011, 08:59
Location: Taipei
Contact:

Re: Filebot skips all other files, if first one already exists.

Post by rednoah » 07 Nov 2017, 09:43

It'll work without a fuss as long as you process different encodes of the same movie.

The exact copy and already exists warning is about processing the exact same file (bit for byte) multiple times.
:idea: Please read the FAQ and How to Request Help.

jake
Donor
Posts: 9
Joined: 07 Nov 2017, 07:42

Re: Filebot skips all other files, if first one already exists.

Post by jake » 07 Nov 2017, 09:53

rednoah wrote:
07 Nov 2017, 09:43
It'll work without a fuss as long as you process different encodes of the same movie.

The exact copy and already exists warning is about processing the exact same file (bit for byte) multiple times.
I understand how it works. But I dont know what version a file is after autodownload.
And if one file is the same as in the moviepack filebot aborts and is not processing the 10 other files that are low quality and should be replaced.

User avatar
rednoah
The Source
Posts: 18650
Joined: 16 Nov 2011, 08:59
Location: Taipei
Contact:

Re: Filebot skips all other files, if first one already exists.

Post by rednoah » 07 Nov 2017, 10:00

But you won't have the same version twice? So how come you're processing the exact same file twice?

--conflict auto will take care of picking the best file for the final destination folder and --def excludeList (assuming you're using the amc script) will take care of not processing the same input file twice.
:idea: Please read the FAQ and How to Request Help.

jake
Donor
Posts: 9
Joined: 07 Nov 2017, 07:42

Re: Filebot skips all other files, if first one already exists.

Post by jake » 07 Nov 2017, 10:15

rednoah wrote:
07 Nov 2017, 10:00
But you won't have the same version twice? So how come you're processing the exact same file twice?

--conflict auto will take care of picking the best file for the final destination folder and --def excludeList (assuming you're using the amc script) will take care of not processing the same input file twice.
It can be the same version - its pure coincidence if its the same file as in the pack. --def excludeList will not work for me as the first autodownload is not processed by filebot.

It just want it to do its magic no matter what is in the destination dir ;). It may be the same - then just skip it or do what is defined by --conflict but please do not abort.

User avatar
rednoah
The Source
Posts: 18650
Joined: 16 Nov 2011, 08:59
Location: Taipei
Contact:

Re: Filebot skips all other files, if first one already exists.

Post by rednoah » 07 Nov 2017, 10:31

Unfortunately, this warning and fail behaviour is important to prohibit abuse. This corner case happens to be collateral damage.

However, you could call the amc script on each individual file, instead of the whole folder, so that each individual amc call can succeed or fail independently. It's easy with bash, but not sure about PowerShell.
:idea: Please read the FAQ and How to Request Help.

jake
Donor
Posts: 9
Joined: 07 Nov 2017, 07:42

Re: Filebot skips all other files, if first one already exists.

Post by jake » 07 Nov 2017, 10:33

rednoah wrote:
07 Nov 2017, 10:31
Unfortunately, this warning and fail behaviour is important to prohibit abuse. This corner case happens to be collateral damage.

However, you could call the amc script on each individual file, instead of the whole folder, so that each individual amc call can succeed or fail independently. It's easy with bash, but not sure about PowerShell.
Good idea! I'll try that

Thanks for your help!

User avatar
rednoah
The Source
Posts: 18650
Joined: 16 Nov 2011, 08:59
Location: Taipei
Contact:

Re: Filebot skips all other files, if first one already exists.

Post by rednoah » 07 Nov 2017, 10:39

Please share the PowerShell code that is equivalent to bash find -exec once you've got it. ;)
:idea: Please read the FAQ and How to Request Help.

jake
Donor
Posts: 9
Joined: 07 Nov 2017, 07:42

Re: Filebot skips all other files, if first one already exists.

Post by jake » 07 Nov 2017, 11:37

rednoah wrote:
07 Nov 2017, 10:39
Please share the PowerShell code that is equivalent to bash find -exec once you've got it. ;)
Sorry, no windows here :)

I used:

Code: Select all

find <path-to-folder>  -regex '.*\.\(rar\|mkv\|avi\)' -type f -exec filebot {} --def clean=y --def extractFolder=/tmp --action move --conflict auto --lang de -non-strict -script fn:amc --output /mnt/unionfs/Media/ --def "ut_label=tv" \;
edit: add regex to exclude .r01 type of files

User avatar
rednoah
The Source
Posts: 18650
Joined: 16 Nov 2011, 08:59
Location: Taipei
Contact:

Re: Filebot skips all other files, if first one already exists.

Post by rednoah » 07 Nov 2017, 15:14

jake wrote:
07 Nov 2017, 11:37
Sorry, no windows here :)
That sure makes things a lot easier. :lol:
:idea: Please read the FAQ and How to Request Help.

Post Reply