Web Sources

Running FileBot from the console, Groovy / FileBot scripting, shell scripts, etc
Post Reply
devster
Posts: 332
Joined: 06 Jun 2017, 22:56

Web Sources

Post by devster » 15 Apr 2019, 23:41

More and more streaming services exist. More and more releases come from them.
The current {source} binding takes care of identifying the broad "WEBDL" or "WEBRip" and similar, but does not include where exactly from.
I'll share my solution to this particularly pointless problem.

Code: Select all

      { def file = new File('/scripts/websources.txt')
        def websources = file.exists() ? readLines(file).join("|") : null // to avoid non-existing paths failing the whole block
        def isWeb = (source ==~ /WEB.*/)
        // or def isWeb = source.matches(/WEB.*/) don't know which one is preferrable
        def lfr = { if (isWeb) fn.match(/($websources)\.(?i)WEB/) } // logo free release
        return allOf{fn.match(/(?i)(UHD).$source/).upper()}{lfr}{source}.join(".") } // it also specifies that source is downscaled from a 4K stream 
the magic happens in the websources.txt file which contains a fairly comprehensive list of shortcode for websources.

Code: Select all

9NOW
AE
AUBC
AMBC
AS
AJAZ
AMZN
AMC
ATK
ANPL
ANLB
AOL
ARD
iP
BRAV
CNLP
CN
CBC
CBS
4OD
CHGD
CMAX
CNBC
CC
CCGC
COOK
CMT
CRKL
CR
CSPN
CTV
CUR
CWS
DSKI
DHF
DEST
DDY
DTV
DISC
DSNY
DIY
DOCC
DPLY
ETV
ETTV
EPIX
ESPN
ESQ
FAM
FJR
FOOD
FOX
FREE
FYI
GLBL
GLOB
GO90
GC
HLMK
HBO
HGTV
HIDI
HIST
HULU
TOU
IFC
ID
iT
ITV
KNOW
LIFE
LN
MNBC
MTOD
MTV
NATG
NBA
NBC
NF
NFLN
NFL
NICK
NRK
PLUZ
PBS
PBSK
PSN
RSTR
RTE
SBS
SESO
SHMI
SPIK
SNET
SPRT
STAN
STZ
SVT
SWER
SYFY
TBS
TEN
TFOU
TLC
TRVL
TUBI
TV3
TV4
TVL
VH1
VICE
VMEO
UFC
UKTV
UNIV
VLCT
VIAP
VRV
WNET
WME
WWEN
XBOX
YHOO
RED
ZDF
I only work in black and sometimes very, very dark grey. (Batman)

orcoboi
Posts: 7
Joined: 18 Oct 2018, 20:11

Re: Web Sources

Post by orcoboi » 24 Apr 2019, 19:59

Aren't those release groups?
I don't know all of those, but AMZN and ETTV are release groups.

devster
Posts: 332
Joined: 06 Jun 2017, 22:56

Re: Web Sources

Post by devster » 24 Apr 2019, 20:09

Never heard about them.
In any case, they're also commonly used to identify the source of WEB-DL and WEBRip releases:
Roswell.New.Mexico.S01.1080p.AMZN.WEBRip.DDP5.1.x264-NTb
NTb = release group, AMZN.WEBRip = websource

Family.Food.Fight.AU.S01.720p.9NOW.WEBRip.AAC2.0.x264-RTN
RTN = release group, 9NOW.WEBRip = websource

Fangbone.S01.1080p.NF.WEBRip.DD5.1.x264-RCVR
RCVR = release group, NF.WEBRip = websource

Club.de.Cuervos.Presents.The.Ballad.of.Hugo.Sanchez.S01.SPANISH.1080p.NF.WEB-DL.DD5.1.x264-NTb
NTb = release group, NF.WEB-DL = websource

just the first few on google search.
If the above don't work then my format has an issue.
I only work in black and sometimes very, very dark grey. (Batman)

User avatar
rednoah
The Source
Posts: 16546
Joined: 16 Nov 2011, 08:59
Location: Taipei
Contact:

Re: Web Sources

Post by rednoah » 25 Apr 2019, 06:42

I'm considering add the more popular patterns to the {source} list. At least patterns like AMZN.WEBRip make sense to me.

:?: Your full list is too large for me though, can you recommend a small section of post popular once where it makes sense that {source} includes that?
:idea: Please read the FAQ and How to Request Help.

devster
Posts: 332
Joined: 06 Jun 2017, 22:56

Re: Web Sources

Post by devster » 26 Apr 2019, 00:57

I'm not sure I'd include it in {source}, I would consider this an additional, optional detail.
Besides the possibility of this info not always being present (which could fit into the allOf{b1}{b2} pattern), I see this information more akin to the {group} binding, and potentially implementable in a similar manner (remote, updatable file from which to retrieve a pattern).

The reasoning is that there may be new providers (e.g. Disney this year) with massive amount of viewers and the list would need to be updated to match that.
In addition, I believe the list was also created to distinguish releases of shows (and increasingly movies) which were released on a popular provider first and were subsequently re-released by a proprietary streaming service.

Anyway, I guess the most common ones would correspond to the most used streaming services (Amazon, Netflix, Hulu, Google PLAY, Crunchy Roll, iTunes, Vimeo, YouTube RED [yes, season 2 of Cobra Kai was released as Cobra.Kai.S02.1080p.RED.WEB-DL...]); however many acronyms also correspond to tv networks (HBO, STRZ [Starz], SYFY, CC [Comedy Central], CSPN [Cspan, who the hell releases these??], DSNY [Disney]) and it may be worth adding some of the biggest ones (I'm thinking about CW for the Arrow/Flash/Supergirl/etc. or HBO for example).
I only work in black and sometimes very, very dark grey. (Batman)

User avatar
rednoah
The Source
Posts: 16546
Joined: 16 Nov 2011, 08:59
Location: Taipei
Contact:

Re: Web Sources

Post by rednoah » 26 Apr 2019, 07:07

Alright, lets not make any premature decisions then, see how things develop, collect some sample data, and then see what makes the most sense.
:idea: Please read the FAQ and How to Request Help.

Post Reply