Subtitle search finds nothing but exists in OSDB

All your suggestions, requests and ideas for future development
Post Reply
c17r
Posts: 5
Joined: 23 Jun 2016, 14:42

Subtitle search finds nothing but exists in OSDB

Post by c17r »

I don't know if it's a OSDB feed vs site issue or something within Filebot but it seems more and more Filebot is telling me it can't find a match and yet when I browse OpenSubtitles on my own, I'll find what I'm looking for. Here's a recent example:

Image
User avatar
rednoah
The Source
Posts: 23932
Joined: 16 Nov 2011, 08:59
Location: Taipei
Contact:

Re: Subtitle search finds nothing but exists in OSDB

Post by rednoah »

The API might be behind the website due to caching. Subtitles should be visible via the API at least 24 hours after upload.

You can see what FileBot sees by running this command:

Code: Select all

filebot -script fn:osdb.explain /path/to/file -non-strict
:idea: Please read the FAQ and How to Request Help.
c17r
Posts: 5
Joined: 23 Jun 2016, 14:42

Re: Subtitle search finds nothing but exists in OSDB

Post by c17r »

So had issues again today.
Image

(edit: removed first example, realized what I did wrong, making it irrelevant)

If I run the command from the directory where the file exists:

Code: Select all

[21:40:20] $ filebot -script fn:osdb.explain ./Silicon.Valley.S03E10.PROPER.720p.HDTV.x264-KILLERS.mkv -non-strict
File: /Volumes/Recorded TV/_Z_to_be_filed/Silicon.Valley.S03E10.PROPER.720p.HDTV.x264-KILLERS[rarbg]/Silicon.Valley.S03E10.PROPER.720p.HDTV.x264-KILLERS.mkv
Hash/Tag Lookup (hash: ca8395374fad4b83, size: 639511378, lang: eng, tag: Silicon.Valley.S03E10.PROPER.720p.HDTV.x264-KILLERS)
Result 1: [IDSubtitle:6668985, IDSubtitleFile:1955249076, IDSubMovieFile:14333511, IDMovie:403036, IDMovieImdb:5218514, SubFileName:Silicon.Valley.S03E10.PROPER.720p.HDTV.x264-KILLERS.en.srt, SubLastTS:00:28:16, SubFormat:srt, SubEncoding:ASCII, SubHash:284bd0df5fc7ffd2a6ad2754db69510e, SubSize:46898, MovieHash:ca8395374fad4b83, MovieByteSize:639511378, MovieName:"Silicon Valley" The Uptick, MovieNameEng:, MovieYear:2016, MovieReleaseName:Silicon.Valley.S03E10.PROPER.720p.HDTV.x264-KILLERS.mkv, MovieTimeMS:1775040, MovieFPS:23.976, MovieImdbRating:9.1, MovieKind:episode, SeriesSeason:3, SeriesEpisode:10, SeriesIMDBParent:2575988, SubLanguageID:eng, ISO639:en, LanguageName:English, UserID:3760161, UserRank:administrator, UserNickName:kazekira, SubAddDate:2016-06-27 21:56:48, SubAuthorComment:, SubFeatured:0, SubComments:0, SubDownloadsCnt:905, SubHearingImpaired:0, SubRating:0.0, SubHD:1, SubBad:0, SubActualCD:1, SubSumCD:1, MatchedBy:moviehash, QueryNumber:0, SubtitlesLink:http://www.opensubtitles.org/en/subtitles/6668985/sid-r1mk4ec069nfkvngcbsaqivo45/silicon-valley-the-uptick-en, SubDownloadLink:http://dl.opensubtitles.org/en/download/src-api/vrf-19c10c59/sid-r1mk4ec069nfkvngcbsaqivo45/file/1955249076.gz, ZipDownloadLink:http://dl.opensubtitles.org/en/download/src-api/vrf-f5850bc9/sid-r1mk4ec069nfkvngcbsaqivo45/sub/6668985]
Result 2: [IDSubtitle:6668708, IDSubtitleFile:1955248795, IDSubMovieFile:14334276, IDMovie:403036, IDMovieImdb:5218514, SubFileName:Silicon.Valley.S03E10.PROPER.HDTV.x264-KILLERS.srt, SubLastTS:00:28:24, SubFormat:srt, SubEncoding:ASCII, SubHash:4c110d3f8e92812c8de551a3034706ad, SubSize:51220, MovieHash:ca8395374fad4b83, MovieByteSize:639511378, MovieName:"Silicon Valley" The Uptick, MovieNameEng:, MovieYear:2016, MovieReleaseName:Silicon.Valley.S03E10.PROPER.HDTV.x264-KILLERS, MovieTimeMS:0, MovieFPS:23.976, MovieImdbRating:9.1, MovieKind:episode, SeriesSeason:3, SeriesEpisode:10, SeriesIMDBParent:2575988, SubLanguageID:eng, ISO639:en, LanguageName:English, UserID:1566989, UserRank:administrator, UserNickName:GoldenBeard, SubAddDate:2016-06-27 15:49:44, SubAuthorComment:, SubFeatured:0, SubComments:0, SubDownloadsCnt:1663, SubHearingImpaired:0, SubRating:0.0, SubHD:1, SubBad:0, SubActualCD:1, SubSumCD:1, MatchedBy:moviehash, QueryNumber:0, SubtitlesLink:http://www.opensubtitles.org/en/subtitles/6668708/sid-r1mk4ec069nfkvngcbsaqivo45/silicon-valley-the-uptick-en, SubDownloadLink:http://dl.opensubtitles.org/en/download/src-api/vrf-19d50c60/sid-r1mk4ec069nfkvngcbsaqivo45/file/1955248795.gz, ZipDownloadLink:http://dl.opensubtitles.org/en/download/src-api/vrf-f5720bc2/sid-r1mk4ec069nfkvngcbsaqivo45/sub/6668708]
Best Hash Match: [IDSubtitle:6668985, IDSubtitleFile:1955249076, IDSubMovieFile:14333511, IDMovie:403036, IDMovieImdb:5218514, SubFileName:Silicon.Valley.S03E10.PROPER.720p.HDTV.x264-KILLERS.en.srt, SubLastTS:00:28:16, SubFormat:srt, SubEncoding:ASCII, SubHash:284bd0df5fc7ffd2a6ad2754db69510e, SubSize:46898, MovieHash:ca8395374fad4b83, MovieByteSize:639511378, MovieName:"Silicon Valley" The Uptick, MovieNameEng:, MovieYear:2016, MovieReleaseName:Silicon.Valley.S03E10.PROPER.720p.HDTV.x264-KILLERS.mkv, MovieTimeMS:1775040, MovieFPS:23.976, MovieImdbRating:9.1, MovieKind:episode, SeriesSeason:3, SeriesEpisode:10, SeriesIMDBParent:2575988, SubLanguageID:eng, ISO639:en, LanguageName:English, UserID:3760161, UserRank:administrator, UserNickName:kazekira, SubAddDate:2016-06-27 21:56:48, SubAuthorComment:, SubFeatured:0, SubComments:0, SubDownloadsCnt:905, SubHearingImpaired:0, SubRating:0.0, SubHD:1, SubBad:0, SubActualCD:1, SubSumCD:1, MatchedBy:moviehash, QueryNumber:0, SubtitlesLink:http://www.opensubtitles.org/en/subtitles/6668985/sid-r1mk4ec069nfkvngcbsaqivo45/silicon-valley-the-uptick-en, SubDownloadLink:http://dl.opensubtitles.org/en/download/src-api/vrf-19c10c59/sid-r1mk4ec069nfkvngcbsaqivo45/file/1955249076.gz, ZipDownloadLink:http://dl.opensubtitles.org/en/download/src-api/vrf-f5850bc9/sid-r1mk4ec069nfkvngcbsaqivo45/sub/6668985]
Name Lookup (file: Silicon.Valley.S03E10.PROPER.720p.HDTV.x264-KILLERS, strict: false, lang: eng)
Result 1: [IDSubtitle:6668692, IDSubtitleFile:1955248779, IDSubMovieFile:0, IDMovie:403036, IDMovieImdb:5218514, SubFileName:Silicon.Valley.S03E10.PROPER.720p.HDTV.x264-KILLERS.srt, SubLastTS:00:28:16, SubFormat:srt, SubEncoding:ASCII, SubHash:a95a0db29e290932906e6b46a53ba201, SubSize:49851, MovieHash:0, MovieByteSize:0, MovieName:"Silicon Valley" The Uptick, MovieNameEng:, MovieYear:2016, MovieReleaseName:Silicon.Valley.S03E10.PROPER.720p.HDTV.x264-KILLERS, MovieTimeMS:0, MovieFPS:23.976, MovieImdbRating:9.1, MovieKind:episode, SeriesSeason:3, SeriesEpisode:10, SeriesIMDBParent:2575988, SubLanguageID:eng, ISO639:en, LanguageName:English, UserID:3564446, UserRank:gold member, UserNickName:lazyI, SubAddDate:2016-06-27 15:31:34, SubAuthorComment:, SubFeatured:0, SubComments:0, SubDownloadsCnt:360, SubHearingImpaired:0, SubRating:0.0, SubHD:1, SubBad:0, SubActualCD:1, SubSumCD:1, MatchedBy:imdbid, QueryNumber:0, SubtitlesLink:http://www.opensubtitles.org/en/subtitles/6668692/sid-r1mk4ec069nfkvngcbsaqivo45/silicon-valley-the-uptick-en, SubDownloadLink:http://dl.opensubtitles.org/en/download/src-api/vrf-19d50c62/sid-r1mk4ec069nfkvngcbsaqivo45/file/1955248779.gz, ZipDownloadLink:http://dl.opensubtitles.org/en/download/src-api/vrf-f57b0bc4/sid-r1mk4ec069nfkvngcbsaqivo45/sub/6668692]
Result 2: [IDSubtitle:6668689, IDSubtitleFile:1955248776, IDSubMovieFile:0, IDMovie:403036, IDMovieImdb:5218514, SubFileName:Silicon.Valley.S03E10.HDTV.1080i.DD5.1.H264-BS666.srt, SubLastTS:00:27:07, SubFormat:srt, SubEncoding:ASCII, SubHash:31bba3e59a04163b3ba25a0737ed02b6, SubSize:49851, MovieHash:0, MovieByteSize:0, MovieName:"Silicon Valley" The Uptick, MovieNameEng:, MovieYear:2016, MovieReleaseName:Silicon.Valley.S03E10.HDTV.1080i.DD5.1.H264-BS666, MovieTimeMS:0, MovieFPS:25.000, MovieImdbRating:9.1, MovieKind:episode, SeriesSeason:3, SeriesEpisode:10, SeriesIMDBParent:2575988, SubLanguageID:eng, ISO639:en, LanguageName:English, UserID:3564446, UserRank:gold member, UserNickName:lazyI, SubAddDate:2016-06-27 15:28:38, SubAuthorComment:, SubFeatured:0, SubComments:0, SubDownloadsCnt:191, SubHearingImpaired:0, SubRating:0.0, SubHD:1, SubBad:0, SubActualCD:1, SubSumCD:1, MatchedBy:imdbid, QueryNumber:0, SubtitlesLink:http://www.opensubtitles.org/en/subtitles/6668689/sid-r1mk4ec069nfkvngcbsaqivo45/silicon-valley-the-uptick-en, SubDownloadLink:http://dl.opensubtitles.org/en/download/src-api/vrf-19d20c5f/sid-r1mk4ec069nfkvngcbsaqivo45/file/1955248776.gz, ZipDownloadLink:http://dl.opensubtitles.org/en/download/src-api/vrf-f5800bca/sid-r1mk4ec069nfkvngcbsaqivo45/sub/6668689]
Result 3: [IDSubtitle:6668706, IDSubtitleFile:1955248793, IDSubMovieFile:0, IDMovie:403036, IDMovieImdb:5218514, SubFileName:Silicon.Valley.S03E10.PROPER.HDTV.x264-KILLERS.srt, SubLastTS:00:29:28, SubFormat:srt, SubEncoding:UTF-8, SubHash:8db42960f16b794f00f247216aab3d0a, SubSize:55509, MovieHash:0, MovieByteSize:0, MovieName:"Silicon Valley" The Uptick, MovieNameEng:, MovieYear:2016, MovieReleaseName:Silicon.Valley.S03E10.PROPER.HDTV.x264-KILLERS, MovieTimeMS:0, MovieFPS:23.976, MovieImdbRating:9.1, MovieKind:episode, SeriesSeason:3, SeriesEpisode:10, SeriesIMDBParent:2575988, SubLanguageID:eng, ISO639:en, LanguageName:English, UserID:1566989, UserRank:administrator, UserNickName:GoldenBeard, SubAddDate:2016-06-27 15:49:22, SubAuthorComment:, SubFeatured:0, SubComments:0, SubDownloadsCnt:636, SubHearingImpaired:1, SubRating:0.0, SubHD:1, SubBad:0, SubActualCD:1, SubSumCD:1, MatchedBy:imdbid, QueryNumber:0, SubtitlesLink:http://www.opensubtitles.org/en/subtitles/6668706/sid-r1mk4ec069nfkvngcbsaqivo45/silicon-valley-the-uptick-en, SubDownloadLink:http://dl.opensubtitles.org/en/download/src-api/vrf-19d30c5e/sid-r1mk4ec069nfkvngcbsaqivo45/file/1955248793.gz, ZipDownloadLink:http://dl.opensubtitles.org/en/download/src-api/vrf-f5700bc0/sid-r1mk4ec069nfkvngcbsaqivo45/sub/6668706]
Result 4: [IDSubtitle:6668708, IDSubtitleFile:1955248795, IDSubMovieFile:0, IDMovie:403036, IDMovieImdb:5218514, SubFileName:Silicon.Valley.S03E10.PROPER.HDTV.x264-KILLERS.srt, SubLastTS:00:28:24, SubFormat:srt, SubEncoding:ASCII, SubHash:4c110d3f8e92812c8de551a3034706ad, SubSize:51220, MovieHash:0, MovieByteSize:0, MovieName:"Silicon Valley" The Uptick, MovieNameEng:, MovieYear:2016, MovieReleaseName:Silicon.Valley.S03E10.PROPER.HDTV.x264-KILLERS, MovieTimeMS:0, MovieFPS:23.976, MovieImdbRating:9.1, MovieKind:episode, SeriesSeason:3, SeriesEpisode:10, SeriesIMDBParent:2575988, SubLanguageID:eng, ISO639:en, LanguageName:English, UserID:1566989, UserRank:administrator, UserNickName:GoldenBeard, SubAddDate:2016-06-27 15:49:44, SubAuthorComment:, SubFeatured:0, SubComments:0, SubDownloadsCnt:220, SubHearingImpaired:0, SubRating:0.0, SubHD:1, SubBad:0, SubActualCD:1, SubSumCD:1, MatchedBy:imdbid, QueryNumber:0, SubtitlesLink:http://www.opensubtitles.org/en/subtitles/6668708/sid-r1mk4ec069nfkvngcbsaqivo45/silicon-valley-the-uptick-en, SubDownloadLink:http://dl.opensubtitles.org/en/download/src-api/vrf-19d50c60/sid-r1mk4ec069nfkvngcbsaqivo45/file/1955248795.gz, ZipDownloadLink:http://dl.opensubtitles.org/en/download/src-api/vrf-f5720bc2/sid-r1mk4ec069nfkvngcbsaqivo45/sub/6668708]
Best Name Match: [IDSubtitle:6668692, IDSubtitleFile:1955248779, IDSubMovieFile:0, IDMovie:403036, IDMovieImdb:5218514, SubFileName:Silicon.Valley.S03E10.PROPER.720p.HDTV.x264-KILLERS.srt, SubLastTS:00:28:16, SubFormat:srt, SubEncoding:ASCII, SubHash:a95a0db29e290932906e6b46a53ba201, SubSize:49851, MovieHash:0, MovieByteSize:0, MovieName:"Silicon Valley" The Uptick, MovieNameEng:, MovieYear:2016, MovieReleaseName:Silicon.Valley.S03E10.PROPER.720p.HDTV.x264-KILLERS, MovieTimeMS:0, MovieFPS:23.976, MovieImdbRating:9.1, MovieKind:episode, SeriesSeason:3, SeriesEpisode:10, SeriesIMDBParent:2575988, SubLanguageID:eng, ISO639:en, LanguageName:English, UserID:3564446, UserRank:gold member, UserNickName:lazyI, SubAddDate:2016-06-27 15:31:34, SubAuthorComment:, SubFeatured:0, SubComments:0, SubDownloadsCnt:360, SubHearingImpaired:0, SubRating:0.0, SubHD:1, SubBad:0, SubActualCD:1, SubSumCD:1, MatchedBy:imdbid, QueryNumber:0, SubtitlesLink:http://www.opensubtitles.org/en/subtitles/6668692/sid-r1mk4ec069nfkvngcbsaqivo45/silicon-valley-the-uptick-en, SubDownloadLink:http://dl.opensubtitles.org/en/download/src-api/vrf-19d50c62/sid-r1mk4ec069nfkvngcbsaqivo45/file/1955248779.gz, ZipDownloadLink:http://dl.opensubtitles.org/en/download/src-api/vrf-f57b0bc4/sid-r1mk4ec069nfkvngcbsaqivo45/sub/6668692]
Done ヾ(@⌒ー⌒@)ノ
User avatar
rednoah
The Source
Posts: 23932
Joined: 16 Nov 2011, 08:59
Location: Taipei
Contact:

Re: Subtitle search finds nothing but exists in OSDB

Post by rednoah »

Does it work if you wait 1-2 days? How many times a day do you check for subtitles?

PS: it works for me (at least name search)
:idea: Please read the FAQ and How to Request Help.
c17r
Posts: 5
Joined: 23 Jun 2016, 14:42

Re: Subtitle search finds nothing but exists in OSDB

Post by c17r »

I *think* it works after a few days. It's happened enough that when FileBot says it can't find a subtitle I tend to not believe it and check OSDB directly and download it.

Based on what you had me try, it appears that the command line tool is finding things but the GUI is not?
User avatar
rednoah
The Source
Posts: 23932
Joined: 16 Nov 2011, 08:59
Location: Taipei
Contact:

Re: Subtitle search finds nothing but exists in OSDB

Post by rednoah »

You will only find new subtitles once per day. Any result you get will be cached for 18 hours. If you search for subtitles before there are subtitles, it won't give you any new results until the next day.

The GUI and the CLI is the same, but if you run multiple instances of filebot at the same time they will not share the same cache.
:idea: Please read the FAQ and How to Request Help.
c17r
Posts: 5
Joined: 23 Jun 2016, 14:42

Re: Subtitle search finds nothing but exists in OSDB

Post by c17r »

My usual process is to first thing in the morning:
  1. Check if anything has been downloaded overnight
  2. Check if any of the files already have subtitles (either separate files or baked in)
  3. Start FileBot GUI
  4. For the ones that don't have subtitles
    1. Drag files that need subtitles onto blue download button under Subtitles
    2. Click download
  5. Drag everything that now has subtitles into Rename
    1. Click Match
    2. Click Rename
  6. Quit FileBot GUI
And then I don't open FileBot GUI again until the next morning. I do it this way because I want to "process into Plex" anything that has a subtitle ONLY.

Since you say the cache is 18 hours long, that shouldn't be coming into play here.

Also, why cache empty results? I can understand if it found something that you don't want to keep banging on OSDB but caching a miss seems a little extreme.
User avatar
rednoah
The Source
Posts: 23932
Joined: 16 Nov 2011, 08:59
Location: Taipei
Contact:

Re: Subtitle search finds nothing but exists in OSDB

Post by rednoah »

If you only use FileBot once every 24 hours then this kind of caching will have no effect.

You can test it though. If you run FileBot and you don't get any subtitles the first time around, just CTRL+SHIFT+DEL to clear the cache and drag files in again and see if it makes a difference.

All the automated setups abuse OSDB on files that don't have and probably never will have subtitles, because they'll never be excluded in future runs, plus it's a corner-case that most people don't think of.

If you had a http caching proxy or cloudflare cdn in between it'd work the same because a "miss" will still give you a 200 OK response. I'm not sure to what degree OSDB caches responses on the server-side though. FileBot is already banned from using the search API though due to abuse though, probably due to people that repeatedly searching for the same stuff without results.
:idea: Please read the FAQ and How to Request Help.
Post Reply