Crawl for imdb ID from subscene / folders?

All your suggestions, requests and ideas for future development
Post Reply
denywinarto
Donor
Posts: 28
Joined: 30 Jul 2013, 01:15

Crawl for imdb ID from subscene / folders?

Post by denywinarto »

Would it be possible using filebot / groovy script to crawl for imdb from subscene or from folders?

I'm limiting my library to the movies & tvshows that has subs from my country only..
My library already has movie.nfo for almost all movies
And i need some sort of method to connect my library with subscene..
And they only have IMDB links on each sub page unfortunately..

So it's probably like this :
1. Subscene has a page that can filter subs based on country alphabetically
2. Crawl that page for IMDB links
3. Crawl My library for IMDB links
4. Compare both of them and see which one is missing

Is it possible to do this?

Thanks before.
User avatar
rednoah
The Source
Posts: 22923
Joined: 16 Nov 2011, 08:59
Location: Taipei
Contact:

Re: Crawl for imdb ID from subscene / folders?

Post by rednoah »

1.
Search for *.nfo files with IMDb is easy.

2.
Scraping Subscene and downloading subtitles is tricky. I don't do scrapers, and it's probably not allowed according their ToS. But if they had an API for 3rd party programs then I could have a look.
:idea: Please read the FAQ and How to Request Help.
User avatar
rednoah
The Source
Posts: 22923
Joined: 16 Nov 2011, 08:59
Location: Taipei
Contact:

Re: Crawl for imdb ID from subscene / folders?

Post by rednoah »

Does that API support download of subtitles, not just search with links to pages of other sites?
:idea: Please read the FAQ and How to Request Help.
denywinarto
Donor
Posts: 28
Joined: 30 Jul 2013, 01:15

Re: Crawl for imdb ID from subscene / folders?

Post by denywinarto »

rednoah wrote:1.
Search for *.nfo files with IMDb is easy.

2.
Scraping Subscene and downloading subtitles is tricky. I don't do scrapers, and it's probably not allowed according their ToS. But if they had an API for 3rd party programs then I could have a look.
I found a third party subscene API.. but it seems to be inactive, is it possible to use it?

https://github.com/andy-pham/subscene-api

1. Really it's possible ? Mind giving me a hint how to do it rednoah?

How can i crawl for IMDB links from this kind of page?

http://v2.subscene.com/subtitles/indone ... guage.aspx
Could it search for IMDB links within a subscene page?
User avatar
rednoah
The Source
Posts: 22923
Joined: 16 Nov 2011, 08:59
Location: Taipei
Contact:

Re: Crawl for imdb ID from subscene / folders?

Post by rednoah »

After 5 seconds link clicky-clicky... the "API" returns 503 Over Quota server error and the "Popcorn Time" has a DMCA takedown notice.

For future reference, by API I mean an officially endorsed API.

THREAD CLOSED.
:idea: Please read the FAQ and How to Request Help.
Post Reply