--conflict auto

[Whispering Klaxon]

This is more of a question than a request, so I apologise if this is the wrong place for it.

The new --conflict auto in version 4 is a great option.

* Support new option --conflict auto which will only override inferior files

How does it decide which file is inferior?

What does it do if the two files are the same size and type? Hopefully it chooses the newer modification date.

[rednoah]

I haven't specified that exactly, but ideally it's "better video" as you and me would think.

So currently it's implement with:

1. Video Resolution (requires MediaInfo)
2. File Size

Having modification date doesn't really make sense to me.

[Clint]

Great feature! Couldn't this be combined with something like "--precedence"? Personally I always look out for the 'extended' versions of my movies and would love to see it "win" in a conflict even though it may be a GB or so smaller. Most auto downloaders (as me) has a size span set so the possibility of the extended version beeing smaller is a possibility.

[rednoah]

Probably, but where's the limit?

What if the new version has a lower resolution but 10 min longer? Does that count as an extended version we wanna keep? How much lower resolution is acceptable? 10% less resolution still beats 10% longer?

I can easily implement any logic you can come up with, but you need to clearly specify the logic, and there is a lot of things to consider. So right now keep it clear and simple which I think is probably best.

[Clint]

Fair enough, I'll sit down later on and try to come up with a suggestion.

[Whispering Klaxon]

The reason I asked about modification date is because sometimes Transmission detects errors in a download a day or so after it has finished (and has been processed by FileBot).

When Transmission goes back to the source and corrects the errors, it also changes the file modification date.

At that point the two files are the same size and duration, but the older one has errors.

[rednoah]

That's a bug with Transmission then. The torrent file already has all the hashes it needs to verify integrity for each piece of the file.

Otherwise you'd be seeding corrupted pieces right? Naturally the torrent protocol make that virtually impossible.

[Whispering Klaxon]

I'm not really in a position to diagnose the causes of the issue, I just know that the newer copy of the file is better.

[rednoah]

If you all factors are equal filebot will prefer the file that it's currently processing, that would most likely be the newer copy.

[Whispering Klaxon]

Yep, that works for me

[wisomtooth]

Video Resolution (requires MediaInfo)

Where should MediaInfo be put?

[rednoah]

See FAQ.

Also that depends entirely on your OS and how you installed FileBot.

[DaLeberkasPepi]

i've got a little problem with the way --conflict auto evaluates the better of two versions.

Here is the the part of the log of what he is doing:

Code: Select all

Skipped [/media/Downloads/Fertig/tvs-got-dd51-dl-18p-azhd-x264-701-rp/Game.of.Thrones.S07E01.Drachenstein.REPACK.German.DD+51.DL.1080p.AmazonHD.x264-TVS/tvs-got-dd51-dl-18p-azhd-x264-701-rp.mkv] because [/media/Serien/Game of Thrones/Season 07/Game of Thrones - S07E01 - Dragonstone.mkv] already exists

but filbot should replace the current episode with the newly downloaded version. Maybe the problem is that the video of the newly downloaded version and the old version is nearly the same but in the newly downloaded version the german audio line is dd5.1 and in the existing one the german audio line is only 2.0 but the bitrate overall of the newer version is a little bit lower

Just some german information why i very often get the situation where i have to replace an existing episode with 2.0 audio with a newer version of the same episode with 5.1 audio:

Code: Select all

Game of Thrones – Staffel 7 – WEB – SD/720p/1080p
Cover

In der Fantasyserie um die sieben Königreiche des fiktiven Kontinents Westeros kämpfen die verschiedenen Adelsgeschlechter um die politische Vorherrschaft. Raffinierte Intrigen und brutale Gewalt sind an der Tagesordnung, und obendrein wird Westeros von finsteren Mächten bedroht, die hinter einem uralten Schutzwall lauern.

Die Versionen im Überblick
4SJ: Bestes Bild (von Amazon, mit englischen Untertiteln bei fremdsprachigen Stellen), Stereo-Ton – verfügbar am frühen Montagmorgen, wird ab Dienstag durch TVS ersetzt
TVP: Mischmasch/Chaos (mit englischen Untertiteln bei fremdsprachigen Stellen) – verfügbar im Laufe des Dienstags
TVS: Bestes Bild (von Amazon, mit deutschen Untertiteln bei fremdsprachigen Stellen), bester 5.1-Ton, deutsche und englische Untertitel – verfügbar ab Dienstag
OMGtv: Gutes Bild (von iTunes, mit deutschen Untertiteln bei fremdsprachigen Stellen), guter 5.1-Ton – verfügbar im Laufe des Dienstags
Die deutsche Tonspur besitzt in allen Versionen die korrekte Tonhöhe, die englische Tonspur nur in den TVS-Versionen.

Basically it says that the first version of GoT is from 4SJ with video from Amazon and dubbed 2.0 audio. At the next day it gets reuploaded with the tvs tag with the same video but with 5.1 audio

Metadata with Amazon Video and 2.0 audio:

Code: Select all

General
Unique ID                   : 182138459045599511233627654724855370716 (0x8906975ADA338C5193FACE9D8EFD93DC)
Complete name               : \\HOMESERVER\Serien\Game of Thrones\Season 07\Game of Thrones - S07E04 - The Spoils of War.mkv
Format                      : Matroska
Format version              : Version 4 / Version 2
File size                   : 3.05 GiB
Duration                    : 49 min 15 s
Overall bit rate mode       : Variable
Overall bit rate            : 8 867 kb/s
Encoded date                : UTC 2017-08-07 02:07:09
Writing application         : mkvmerge v13.0.0 ('The Juggler') 64bit
Writing library             : libebml v1.3.4 + libmatroska v1.4.5

Video
ID                          : 1
Format                      : AVC
Format/Info                 : Advanced Video Codec
Format profile              : High@L4
Format settings, CABAC      : Yes
Format settings, ReFrames   : 4 frames
Codec ID                    : V_MPEG4/ISO/AVC
Duration                    : 49 min 15 s
Bit rate mode               : Variable
Bit rate                    : 8 193 kb/s
Maximum bit rate            : 15.0 Mb/s
Width                       : 1 920 pixels
Height                      : 1 080 pixels
Display aspect ratio        : 16:9
Frame rate mode             : Constant
Frame rate                  : 25.000 FPS
Color space                 : YUV
Chroma subsampling          : 4:2:0
Bit depth                   : 8 bits
Scan type                   : Progressive
Bits/(Pixel*Frame)          : 0.158
Stream size                 : 2.82 GiB (92%)
Default                     : Yes
Forced                      : No
Color range                 : Limited
Color primaries             : BT.709
Transfer characteristics    : BT.709
Matrix coefficients         : BT.709

Audio #1
ID                          : 2
Format                      : AC-3
Format/Info                 : Audio Coding 3
Format settings, Endianness : Big
Codec ID                    : A_AC3
Duration                    : 49 min 15 s
Bit rate mode               : Constant
Bit rate                    : 224 kb/s
Channel(s)                  : 2 channels
Channel positions           : Front: L R
Sampling rate               : 48.0 kHz
Frame rate                  : 31.250 FPS (1536 spf)
Bit depth                   : 16 bits
Compression mode            : Lossy
Stream size                 : 78.9 MiB (3%)
Language                    : German
Service kind                : Complete Main
Default                     : Yes
Forced                      : No

Audio #2
ID                          : 3
Format                      : AC-3
Format/Info                 : Audio Coding 3
Format settings, Endianness : Big
Codec ID                    : A_AC3
Duration                    : 49 min 15 s
Bit rate mode               : Constant
Bit rate                    : 448 kb/s
Channel(s)                  : 6 channels
Channel positions           : Front: L C R, Side: L R, LFE
Sampling rate               : 48.0 kHz
Frame rate                  : 31.250 FPS (1536 spf)
Bit depth                   : 16 bits
Compression mode            : Lossy
Stream size                 : 158 MiB (5%)
Language                    : English
Service kind                : Complete Main
Default                     : No
Forced                      : No

Text
ID                          : 4
Format                      : UTF-8
Codec ID                    : S_TEXT/UTF8
Codec ID/Info               : UTF-8 Plain Text
Duration                    : 5 s 0 ms
Bit rate                    : 27 b/s
Count of elements           : 1
Stream size                 : 17.0 Bytes (0%)
Language                    : German
Default                     : Yes
Forced                      : Yes

Metadata with Amazon Video and 5.1 audio:

Code: Select all

General
Unique ID                   : 246315228432130466976942201490163839384 (0xB94E9661218C9E428E807923168F3198)
Complete name               : \\HOMESERVER\Downloads\Fertig\tvs-got-dd51-dl-18p-azhd-x264-704\Game.of.Thrones.S07E04.Kriegsbeute.German.DD+51.DL.1080p.AmazonHD.x264-TVS\tvs-got-dd51-dl-18p-azhd-x264-704.mkv
Format                      : Matroska
Format version              : Version 4 / Version 2
File size                   : 2.90 GiB
Duration                    : 49 min 29 s
Overall bit rate mode       : Variable
Overall bit rate            : 8 403 kb/s
Encoded date                : UTC 2017-08-08 00:48:10
Writing application         : mkvmerge v13.0.0 ('The Juggler') 64bit
Writing library             : libebml v1.3.4 + libmatroska v1.4.5

Video
ID                          : 1
Format                      : AVC
Format/Info                 : Advanced Video Codec
Format profile              : High@L4
Format settings, CABAC      : Yes
Format settings, ReFrames   : 4 frames
Codec ID                    : V_MPEG4/ISO/AVC
Duration                    : 49 min 29 s
Bit rate mode               : Variable
Bit rate                    : 7 121 kb/s
Maximum bit rate            : 15.0 Mb/s
Width                       : 1 920 pixels
Height                      : 1 080 pixels
Display aspect ratio        : 16:9
Frame rate mode             : Constant
Frame rate                  : 23.976 (24000/1001) FPS
Color space                 : YUV
Chroma subsampling          : 4:2:0
Bit depth                   : 8 bits
Scan type                   : Progressive
Bits/(Pixel*Frame)          : 0.143
Stream size                 : 2.46 GiB (85%)
Default                     : Yes
Forced                      : No
Color range                 : Limited
Color primaries             : BT.709
Transfer characteristics    : BT.709
Matrix coefficients         : BT.709

Audio #1
ID                          : 2
Format                      : E-AC-3
Format/Info                 : Enhanced Audio Coding 3
Format settings, Endianness : Big
Codec ID                    : A_EAC3
Duration                    : 49 min 29 s
Bit rate mode               : Constant
Bit rate                    : 640 kb/s
Channel(s)                  : 6 channels
Channel positions           : Front: L C R, Side: L R, LFE
Sampling rate               : 48.0 kHz
Frame rate                  : 187.500 FPS (256 spf)
Compression mode            : Lossy
Stream size                 : 227 MiB (8%)
Language                    : German
Service kind                : Complete Main
Default                     : Yes
Forced                      : No

Audio #2
ID                          : 3
Format                      : E-AC-3
Format/Info                 : Enhanced Audio Coding 3
Format settings, Endianness : Big
Codec ID                    : A_EAC3
Duration                    : 49 min 29 s
Bit rate mode               : Constant
Bit rate                    : 640 kb/s
Channel(s)                  : 6 channels
Channel positions           : Front: L C R, Side: L R, LFE
Sampling rate               : 48.0 kHz
Frame rate                  : 187.500 FPS (256 spf)
Compression mode            : Lossy
Stream size                 : 227 MiB (8%)
Language                    : English
Service kind                : Complete Main
Default                     : No
Forced                      : No

Text #1
ID                          : 4
Format                      : UTF-8
Codec ID                    : S_TEXT/UTF8
Codec ID/Info               : UTF-8 Plain Text
Duration                    : 6 s 0 ms
Bit rate                    : 22 b/s
Count of elements           : 1
Stream size                 : 17.0 Bytes (0%)
Title                       : Forced
Language                    : German
Default                     : Yes
Forced                      : Yes

Text #2
ID                          : 5
Format                      : UTF-8
Codec ID                    : S_TEXT/UTF8
Codec ID/Info               : UTF-8 Plain Text
Duration                    : 45 min 21 s
Bit rate                    : 43 b/s
Count of elements           : 413
Stream size                 : 14.5 KiB (0%)
Language                    : German
Default                     : No
Forced                      : No

Text #3
ID                          : 6
Format                      : UTF-8
Codec ID                    : S_TEXT/UTF8
Codec ID/Info               : UTF-8 Plain Text
Duration                    : 48 min 0 s
Bit rate                    : 47 b/s
Count of elements           : 572
Stream size                 : 16.8 KiB (0%)
Language                    : English
Default                     : No
Forced                      : No

is there a --conflict replace option or some parameter to specify how much the overall bitrate of a newer version can differ to still replace the file despite the fact that the bitrate is a little bit lower?

[rednoah]

Since the video resolution is the same, the deciding factor is file size, so it'll keep the larger file.

The audio codec is not used at all. Might make sense it this case, might not make sense in a lot of other cases.

"better" is a bit of a tricky question. If you need manual control, then I'd use --conflict index and pick the better one manually after files have been processed.

[DaLeberkasPepi]

Is there a - - conflict replace option as well? So that it replaces the file regardless of quality differences?
And how can it be done so that filebot replaces an existing 420p video.avi file with a better version for example an 1080p video.mkv file?
Right now it keeps both versions

Thanks in advance for your awesome work!

[rednoah]

If you use --conflict index then it'll keep both files and add a number to the filename. If you use --conflict override then it'll override any existing files and thus just keep the latest one.