Confused by results from 'Print Missing Episodes' function

Running FileBot from the console, Groovy scripting, shell scripts, etc
Post Reply
nartana
Posts: 35
Joined: 02 May 2019, 22:28

Confused by results from 'Print Missing Episodes' function

Post by nartana »

I frequently use the "Print Missing Episodes" function. Recently, however, the results have been unreliable. Specifically, the report indicates some episodes are missing, when the files exist within the same directory.

The function I call:

Code: Select all

filebot -script fn:miss /Volumes/Media/Series
The function correctly reports that these files exist:

Code: Select all

TheTVDB::403623 | Mrs. Davis - 1x05 - A Great Place to Drink to Gain Control of Your Drink | /Volumes/Media/Series/Mrs. Davis/Mrs. Davis (Season 1)/Mrs. Davis (S01E05) A Great Place to Drink to Gain Control of Your Drink [FHD 8.0 mbps] EAC3 5.1 (60mins).mkv
TheTVDB::403623 | Mrs. Davis - 1x06 - Allison Treasures: A Southern California Story | /Volumes/Media/Series/Mrs. Davis/Mrs. Davis (Season 1)/Mrs. Davis (S01E06) Allison Treasures A Southern California Story [FHD 8.0 mbps] EAC3 5.1 (57mins).mkv
TheTVDB::403623 | Mrs. Davis - 1x07 - Great Gatsby 2001: A Space Odyssey | /Volumes/Media/Series/Mrs. Davis/Mrs. Davis (Season 1)/Mrs. Davis (S01E07) Great Gatsby 2001 A Space Odyssey [FHD 8.0 mbps] EAC3 5.1 (56mins).mkv
TheTVDB::403623 | Mrs. Davis - 1x08 - The Final Intercut: So I'm Your Horse | /Volumes/Media/Series/Mrs. Davis/Mrs. Davis (Season 1)/Mrs. Davis (S01E08) The Final Intercut So I'm Your Horse [FHD 8.0 mbps] EAC3 5.1 (59mins).mkv
The function incorrectly reports that these files are missing:

Code: Select all

Mrs. Davis - 1x01 - Mother of Mercy: The Call of the Horse
Mrs. Davis - 1x02 - Zwei Sie Piel mit Seitung Sie Wirtschaftung
Mrs. Davis - 1x03 - A Baby with Wings, a Sad Boy with Wings and a Great Helmet
Mrs. Davis - 1x04 - Beautiful Things That Come with Madness
I had expected the function to find no missing files in my "Mrs. Davis" directory, because, there is none missing.

Here are the actual files I see in Finder:

Code: Select all

folder.jpg
Mrs. Davis (S01E01) Mother of Mercy The Call of the Horse [FHD 8.0 mbps] EAC3 5.1 (55mins).mkv
Mrs. Davis (S01E01) Mother of Mercy The Call of the Horse [FHD 8.0 mbps] EAC3 5.1 (55mins).nfo
Mrs. Davis (S01E01) Mother of Mercy The Call of the Horse [FHD 8.0 mbps] EAC3 5.1 (55mins).srr
Mrs. Davis (S01E02) Zwei Sie Piel mit Seitung Sie Wirtschaftung [FHD 8.0 mbps] EAC3 5.1 (49mins).mkv
Mrs. Davis (S01E02) Zwei Sie Piel mit Seitung Sie Wirtschaftung [FHD 8.0 mbps] EAC3 5.1 (49mins).nfo
Mrs. Davis (S01E02) Zwei Sie Piel mit Seitung Sie Wirtschaftung [FHD 8.0 mbps] EAC3 5.1 (49mins).srr
Mrs. Davis (S01E03) A Baby with Wings, a Sad Boy with Wings and a Great Helmet [FHD 8.0 mbps] EAC3 5.1 (55mins).mkv
Mrs. Davis (S01E03) A Baby with Wings, a Sad Boy with Wings and a Great Helmet [FHD 8.0 mbps] EAC3 5.1 (55mins).nfo
Mrs. Davis (S01E03) A Baby with Wings, a Sad Boy with Wings and a Great Helmet [FHD 8.0 mbps] EAC3 5.1 (55mins).srr
Mrs. Davis (S01E04) Beautiful Things That Come with Madness [FHD 8.0 mbps] EAC3 5.1 (61mins).mkv
Mrs. Davis (S01E04) Beautiful Things That Come with Madness [FHD 8.0 mbps] EAC3 5.1 (61mins).nfo
Mrs. Davis (S01E04) Beautiful Things That Come with Madness [FHD 8.0 mbps] EAC3 5.1 (61mins).srr
Mrs. Davis (S01E05) A Great Place to Drink to Gain Control of Your Drink [FHD 8.0 mbps] EAC3 5.1 (60mins).mkv
Mrs. Davis (S01E05) A Great Place to Drink to Gain Control of Your Drink [FHD 8.0 mbps] EAC3 5.1 (60mins).nfo
Mrs. Davis (S01E05) A Great Place to Drink to Gain Control of Your Drink [FHD 8.0 mbps] EAC3 5.1 (60mins).srr
Mrs. Davis (S01E06) Allison Treasures A Southern California Story [FHD 8.0 mbps] EAC3 5.1 (57mins).mkv
Mrs. Davis (S01E06) Allison Treasures A Southern California Story [FHD 8.0 mbps] EAC3 5.1 (57mins).nfo
Mrs. Davis (S01E06) Allison Treasures A Southern California Story [FHD 8.0 mbps] EAC3 5.1 (57mins).srr
Mrs. Davis (S01E07) Great Gatsby 2001 A Space Odyssey [FHD 8.0 mbps] EAC3 5.1 (56mins).mkv
Mrs. Davis (S01E07) Great Gatsby 2001 A Space Odyssey [FHD 8.0 mbps] EAC3 5.1 (56mins).nfo
Mrs. Davis (S01E07) Great Gatsby 2001 A Space Odyssey [FHD 8.0 mbps] EAC3 5.1 (56mins).srr
Mrs. Davis (S01E08) The Final Intercut So I'm Your Horse [FHD 8.0 mbps] EAC3 5.1 (59mins).mkv
Mrs. Davis (S01E08) The Final Intercut So I'm Your Horse [FHD 8.0 mbps] EAC3 5.1 (59mins).nfo
Mrs. Davis (S01E08) The Final Intercut So I'm Your Horse [FHD 8.0 mbps] EAC3 5.1 (59mins).srr
poster.jpg
What additional information could I provide, to help discover why "fn: miss" has begun misreporting some episodes as missing?

I'm assuming there's something (the function) is not seeing, in my renaming method, perhaps; but, the function always has worked reliably until now. My formatting (renaming style) has remained the same.
User avatar
rednoah
The Source
Posts: 22923
Joined: 16 Nov 2011, 08:59
Location: Taipei
Contact:

Re: Confused by results from 'Print Missing Episodes' function

Post by rednoah »

:?: What does xattr metadata say?

Code: Select all

filebot -script fn:xattr /path/to/files

:idea: The miss script works exclusively with the numeric Episode ID comparing xattr metadata from the files you have with the episode listing. If you have the Episode ID in your collection then the episode is not missing. The miss script notably does not guess any information from the file name.
:idea: Please read the FAQ and How to Request Help.
nartana
Posts: 35
Joined: 02 May 2019, 22:28

Re: Confused by results from 'Print Missing Episodes' function

Post by nartana »

Below are the results of the xattr metadata function from the entire Season 1 folder:

Code: Select all

/Volumes/Media/Series/Mrs. Davis/Mrs. Davis (Season 1)/Mrs. Davis (S01E05) A Great Place to Drink to Gain Control of Your Drink [FHD 8.0 mbps] EAC3 5.1 (60mins).mkv
	net.filebot.metadata: {"@type":"Episode","seriesName":"Mrs. Davis","season":1,"episode":5,"title":"A Great Place to Drink to Gain Control of Your Drink","absolute":5,"airdate":{"year":2023,"month":4,"day":27},"id":9734219,"seriesInfo":{"database":"TheTVDB","order":"Airdate","language":"en-US","type":"TV Series","id":403623,"name":"Mrs. Davis","aliasNames":["Миссис Дэвис","Місіс Девіс","修女戴維斯","戴维斯夫人","미세스 데이비스"],"startDate":{"year":2023,"month":4,"day":20},"genres":["Science Fiction","Drama","Action"],"rating":14753.0,"runtime":57,"status":"Continuing"}}
	net.filebot.filename: mrs.davis.s01e05.1080p.web.h264-cakes.mkv
/Volumes/Media/Series/Mrs. Davis/Mrs. Davis (Season 1)/Mrs. Davis (S01E05) A Great Place to Drink to Gain Control of Your Drink [FHD 8.0 mbps] EAC3 5.1 (60mins).nfo
	net.filebot.metadata: {"@type":"Episode","seriesName":"Mrs. Davis","season":1,"episode":5,"title":"A Great Place to Drink to Gain Control of Your Drink","absolute":5,"airdate":{"year":2023,"month":4,"day":27},"id":9734219,"seriesInfo":{"database":"TheTVDB","order":"Airdate","language":"en-US","type":"TV Series","id":403623,"name":"Mrs. Davis","aliasNames":["Миссис Дэвис","Місіс Девіс","修女戴維斯","戴维斯夫人","미세스 데이비스"],"startDate":{"year":2023,"month":4,"day":20},"genres":["Science Fiction","Drama","Action"],"rating":14753.0,"runtime":57,"status":"Continuing"}}
	net.filebot.filename: mrs.davis.s01e05.1080p.web.h264-cakes.nfo
/Volumes/Media/Series/Mrs. Davis/Mrs. Davis (Season 1)/Mrs. Davis (S01E05) A Great Place to Drink to Gain Control of Your Drink [FHD 8.0 mbps] EAC3 5.1 (60mins).srr
	net.filebot.metadata: {"@type":"Episode","seriesName":"Mrs. Davis","season":1,"episode":5,"title":"A Great Place to Drink to Gain Control of Your Drink","absolute":5,"airdate":{"year":2023,"month":4,"day":27},"id":9734219,"seriesInfo":{"database":"TheTVDB","order":"Airdate","language":"en-US","type":"TV Series","id":403623,"name":"Mrs. Davis","aliasNames":["Миссис Дэвис","Місіс Девіс","修女戴維斯","戴维斯夫人","미세스 데이비스"],"startDate":{"year":2023,"month":4,"day":20},"genres":["Science Fiction","Drama","Action"],"rating":14753.0,"runtime":57,"status":"Continuing"}}
	net.filebot.filename: mrs.davis.s01e05.1080p.web.h264-cakes.srr
/Volumes/Media/Series/Mrs. Davis/Mrs. Davis (Season 1)/Mrs. Davis (S01E06) Allison Treasures A Southern California Story [FHD 8.0 mbps] EAC3 5.1 (57mins).mkv
	net.filebot.metadata: {"@type":"Episode","seriesName":"Mrs. Davis","season":1,"episode":6,"title":"Allison Treasures: A Southern California Story","airdate":{"year":2023,"month":5,"day":4},"id":9734220,"seriesInfo":{"database":"TheTVDB","order":"Airdate","language":"en-US","type":"TV Series","id":403623,"name":"Mrs. Davis","aliasNames":[],"startDate":{"year":2023,"month":4,"day":20},"genres":["Science Fiction","Drama","Action"],"rating":7940.0,"runtime":55,"status":"Continuing"}}
	net.filebot.filename: mrs.davis.s01e06.1080p.web.h264-cakes.mkv
/Volumes/Media/Series/Mrs. Davis/Mrs. Davis (Season 1)/Mrs. Davis (S01E06) Allison Treasures A Southern California Story [FHD 8.0 mbps] EAC3 5.1 (57mins).nfo
	net.filebot.metadata: {"@type":"Episode","seriesName":"Mrs. Davis","season":1,"episode":6,"title":"Allison Treasures: A Southern California Story","airdate":{"year":2023,"month":5,"day":4},"id":9734220,"seriesInfo":{"database":"TheTVDB","order":"Airdate","language":"en-US","type":"TV Series","id":403623,"name":"Mrs. Davis","aliasNames":[],"startDate":{"year":2023,"month":4,"day":20},"genres":["Science Fiction","Drama","Action"],"rating":7940.0,"runtime":55,"status":"Continuing"}}
	net.filebot.filename: mrs.davis.s01e06.1080p.web.h264-cakes.nfo
/Volumes/Media/Series/Mrs. Davis/Mrs. Davis (Season 1)/Mrs. Davis (S01E06) Allison Treasures A Southern California Story [FHD 8.0 mbps] EAC3 5.1 (57mins).srr
	net.filebot.metadata: {"@type":"Episode","seriesName":"Mrs. Davis","season":1,"episode":6,"title":"Allison Treasures: A Southern California Story","airdate":{"year":2023,"month":5,"day":4},"id":9734220,"seriesInfo":{"database":"TheTVDB","order":"Airdate","language":"en-US","type":"TV Series","id":403623,"name":"Mrs. Davis","aliasNames":[],"startDate":{"year":2023,"month":4,"day":20},"genres":["Science Fiction","Drama","Action"],"rating":7940.0,"runtime":55,"status":"Continuing"}}
	net.filebot.filename: mrs.davis.s01e06.1080p.web.h264-cakes.srr
/Volumes/Media/Series/Mrs. Davis/Mrs. Davis (Season 1)/Mrs. Davis (S01E07) Great Gatsby 2001 A Space Odyssey [FHD 8.0 mbps] EAC3 5.1 (56mins).mkv
	net.filebot.metadata: {"@type":"Episode","seriesName":"Mrs. Davis","season":1,"episode":7,"title":"Great Gatsby 2001: A Space Odyssey","absolute":7,"airdate":{"year":2023,"month":5,"day":11},"id":9734221,"seriesInfo":{"database":"TheTVDB","order":"Airdate","language":"en-US","type":"TV Series","id":403623,"name":"Mrs. Davis","aliasNames":["Миссис Дэвис","Місіс Девіс","修女戴維斯","戴维斯夫人","미세스 데이비스"],"startDate":{"year":2023,"month":4,"day":20},"genres":["Science Fiction","Drama","Action"],"rating":14753.0,"runtime":57,"status":"Continuing"}}
	net.filebot.filename: mrs.davis.s01e07.1080p.web.h264-cakes.mkv
/Volumes/Media/Series/Mrs. Davis/Mrs. Davis (Season 1)/Mrs. Davis (S01E07) Great Gatsby 2001 A Space Odyssey [FHD 8.0 mbps] EAC3 5.1 (56mins).nfo
	net.filebot.metadata: {"@type":"Episode","seriesName":"Mrs. Davis","season":1,"episode":7,"title":"Great Gatsby 2001: A Space Odyssey","absolute":7,"airdate":{"year":2023,"month":5,"day":11},"id":9734221,"seriesInfo":{"database":"TheTVDB","order":"Airdate","language":"en-US","type":"TV Series","id":403623,"name":"Mrs. Davis","aliasNames":["Миссис Дэвис","Місіс Девіс","修女戴維斯","戴维斯夫人","미세스 데이비스"],"startDate":{"year":2023,"month":4,"day":20},"genres":["Science Fiction","Drama","Action"],"rating":14753.0,"runtime":57,"status":"Continuing"}}
	net.filebot.filename: mrs.davis.s01e07.1080p.web.h264-cakes.nfo
/Volumes/Media/Series/Mrs. Davis/Mrs. Davis (Season 1)/Mrs. Davis (S01E07) Great Gatsby 2001 A Space Odyssey [FHD 8.0 mbps] EAC3 5.1 (56mins).srr
	net.filebot.metadata: {"@type":"Episode","seriesName":"Mrs. Davis","season":1,"episode":7,"title":"Great Gatsby 2001: A Space Odyssey","absolute":7,"airdate":{"year":2023,"month":5,"day":11},"id":9734221,"seriesInfo":{"database":"TheTVDB","order":"Airdate","language":"en-US","type":"TV Series","id":403623,"name":"Mrs. Davis","aliasNames":["Миссис Дэвис","Місіс Девіс","修女戴維斯","戴维斯夫人","미세스 데이비스"],"startDate":{"year":2023,"month":4,"day":20},"genres":["Science Fiction","Drama","Action"],"rating":14753.0,"runtime":57,"status":"Continuing"}}
	net.filebot.filename: mrs.davis.s01e07.1080p.web.h264-cakes.srr
/Volumes/Media/Series/Mrs. Davis/Mrs. Davis (Season 1)/Mrs. Davis (S01E08) The Final Intercut So I'm Your Horse [FHD 8.0 mbps] EAC3 5.1 (59mins).mkv
	net.filebot.metadata: {"@type":"Episode","seriesName":"Mrs. Davis","season":1,"episode":8,"title":"The Final Intercut: So I'm Your Horse","airdate":{"year":2023,"month":5,"day":18},"id":9734222,"seriesInfo":{"database":"TheTVDB","order":"Airdate","language":"en-US","type":"TV Series","id":403623,"name":"Mrs. Davis","aliasNames":[],"startDate":{"year":2023,"month":4,"day":20},"genres":["Science Fiction","Drama","Action"],"rating":14753.0,"runtime":57,"status":"Continuing"}}
	net.filebot.filename: mrs.davis.s01e08.1080p.web.h264-cakes.mkv
/Volumes/Media/Series/Mrs. Davis/Mrs. Davis (Season 1)/Mrs. Davis (S01E08) The Final Intercut So I'm Your Horse [FHD 8.0 mbps] EAC3 5.1 (59mins).nfo
	net.filebot.metadata: {"@type":"Episode","seriesName":"Mrs. Davis","season":1,"episode":8,"title":"The Final Intercut: So I'm Your Horse","airdate":{"year":2023,"month":5,"day":18},"id":9734222,"seriesInfo":{"database":"TheTVDB","order":"Airdate","language":"en-US","type":"TV Series","id":403623,"name":"Mrs. Davis","aliasNames":[],"startDate":{"year":2023,"month":4,"day":20},"genres":["Science Fiction","Drama","Action"],"rating":14753.0,"runtime":57,"status":"Continuing"}}
	net.filebot.filename: mrs.davis.s01e08.1080p.web.h264-cakes.nfo
/Volumes/Media/Series/Mrs. Davis/Mrs. Davis (Season 1)/Mrs. Davis (S01E08) The Final Intercut So I'm Your Horse [FHD 8.0 mbps] EAC3 5.1 (59mins).srr
	net.filebot.metadata: {"@type":"Episode","seriesName":"Mrs. Davis","season":1,"episode":8,"title":"The Final Intercut: So I'm Your Horse","airdate":{"year":2023,"month":5,"day":18},"id":9734222,"seriesInfo":{"database":"TheTVDB","order":"Airdate","language":"en-US","type":"TV Series","id":403623,"name":"Mrs. Davis","aliasNames":[],"startDate":{"year":2023,"month":4,"day":20},"genres":["Science Fiction","Drama","Action"],"rating":14753.0,"runtime":57,"status":"Continuing"}}
	net.filebot.filename: mrs.davis.s01e08.1080p.web.h264-cakes.srr
User avatar
rednoah
The Source
Posts: 22923
Joined: 16 Nov 2011, 08:59
Location: Taipei
Contact:

Re: Confused by results from 'Print Missing Episodes' function

Post by rednoah »

According to the console output above, episode files S01E01 through S01E04 do not have xattr metadata and thus the corresponding Episode IDs are marked as "missing".


:idea: Please read Metadata and Extended Attributes for details on how xattr metadata works. If you rely on tools such as the miss script then you will want to keep xattr metadata in mind because it can get lost easily if you're not aware of its existence and purpose.
:idea: Please read the FAQ and How to Request Help.
nartana
Posts: 35
Joined: 02 May 2019, 22:28

Re: Confused by results from 'Print Missing Episodes' function

Post by nartana »

Thank you. I'll add the "show metadata" function into my text list of commands, for next time I have this issue.

If I understand correctly, FileBot doesn't mess with the metadata. But, can you suggest a good way to fix, or add, the ID tags (metadata) to files? I've done this with MusicBrainz (audio files) but I've never messed with my video files...
nartana
Posts: 35
Joined: 02 May 2019, 22:28

Re: Confused by results from 'Print Missing Episodes' function

Post by nartana »

I have been reading the many threads (posts) about generating and storing xattr metadata with Filebot.

In viewtopic.php?t=9847 you mention a command for this?

Code: Select all

filebot -script fn:properties --def net.filebot.xattr.store=.xattr
I do my renaming with the app (Mac OSX) but maybe I should try this command (above) on a test folder?

When I rename with the app, I always check the output queue before renaming, so I'm sure it's correct. Is there a way to use the app and generate/store xattr metadata? I'm really trying to find the answer myself, on the forum, but most of the posts seem concerned with avoiding the xattr tags. Whereas, I want (need) to create and store some for files that are missing the metadata.

Thanks.
User avatar
rednoah
The Source
Posts: 22923
Joined: 16 Nov 2011, 08:59
Location: Taipei
Contact:

Re: Confused by results from 'Print Missing Episodes' function

Post by rednoah »

:arrow: You can generate/store xattr metadata simply by renaming files with FileBot again.

:arrow: You can enable the Export .xattr folders feature to export .xattr folders in addition to native file system xattr metadata when renaming files just in case. (NOTE: FileBot does not read .xattr folders unless explicitly configured to do so)



:idea: xattr metadata is stored by FileBot when you rename files, and is notably completely different and unrelated to embedded metadata:
rednoah wrote: 24 Oct 2012, 11:16 FileBot uses xattr (i.e. Extended Attributes / NTFS Alternate Data Streams) to store full metadata in file system attributes. These xattr are not to be confused with traditional tags that are embedded in the file content, but additional data streams stored in the file system for each file that are not part of the file itself. As such, xattr requires a filesystem that supports xattr, and xattr may be silently lost if files are moved to a filesystem that doesn't support xattr.
:idea: The following command configures FileBot to store metadata as plain/text file structure, instead of native file system xattr metadata, to make them easy to see and hard to lose, but also harder to manage, since the file system is no longer doing that for you. Also, if you change how FileBot stores metadata, then FileBot will no longer be able to read previously stored metadata that was stored differently:
rednoah wrote: 24 Oct 2012, 11:16 Configure FileBot to store xattr metadata in plain text files instead of filesystem xattr streams:

Code: Select all

filebot -script fn:properties --def net.filebot.xattr.store=.xattr


tl;dr

:idea: xattr metadata is a file system feature. It allows you to add arbitrary extra information to a file path independent and separate from the file or folder content. This is what FileBot uses.

:idea: MKV metadata / ID metadata / etc are specific to a file format and part of the file content. Modifying MKV metadata / ID metadata / etc thus requires modifying the file content. This is not what FileBot uses.
:idea: Please read the FAQ and How to Request Help.
nartana
Posts: 35
Joined: 02 May 2019, 22:28

Re: Confused by results from 'Print Missing Episodes' function

Post by nartana »

Follow-up: I applied the info you provided and renamed the folders with "missing / not missing" files.

Then, I re-ran the Missing Episodes command: it went from 1,184 missing episodes... to 56. And, the reported missing files are actually missing.

So, it's all working 100 percent correctly, now. Thank you.

P.S. I had a "DOH" moment when I finally noticed the brief pop-up window in the app, after files are renamed: "Applying extended attributes," aka "xattr." I get it now.
Post Reply