Page 1 of 1

Is there a way to allow bigger CSV files to be used?

Posted: 13 Feb 2015, 16:05
by DevXen
So I got this great idea, of making a CSV File to hold additional info that can't be found with FileBot. and using it to further organize the movies, or in other cases add additional information when available.

The idea was to find lists of movies. and save them into a CSV File. and use that to tell FileBot where to put them.
So for example Animated movies by Disney will go in the: [Animated]/Disney/ folder.
The Lion King;[Animated]/Disney/

Iron man will be in: [Comic Book Movies]/Marvel/
While Superman will be in: [Comic Book Movies/DC/



And i did this with lots of movie lists.
Dark Comedy, Movies like Saw, Lifetime movies, SyFy Movies, Movies in my state, etc. Really just anything I found I wanted organized separately.
and i used the full list, not just what I had, cause anything I don't have, i may get in the future, and I want it organized correctly then as well.

the one CSV File i have is about 97K, and that's not even half of what i will be needing it to be. i may need it to be even upto 500k, i don't know, i'm not done with my lists yet.

But I found that the 97k CSV File. won't find matches, when i trimmed it down to a few lines. then it worked great. so i can only assume the filesize is too big to work with FileBot.
And I would assume this is to keep the performance high and quick. but when it comes to organizing my Files, i'd take quality over performance. Maybe that could be an option to allow bigger CSV files to be used when needed.

The only other thing I could do, is split it down into like 50 different files. which would make my naming script insanely long, when that shouldn't be necessary.

-Dev

Re: Is there a way to allow bigger CSV files to be used?

Posted: 13 Feb 2015, 19:31
by DavidRTurner
I've identified a limit to the GUI buffer of about 8,000 characters.
Perhaps there is a limit to the 'extended' buffer of external files as 'included' in the format.

I can only suggest until red comes in: count the characters in the format & CSVs & see if it suggests anything...
Can you find "the line" where it stops working? Then try adding small lines to see if that 'buffer' is really the cause?

Re: Is there a way to allow bigger CSV files to be used?

Posted: 14 Feb 2015, 23:04
by DevXen
DavidRTurner wrote:I've identified a limit to the GUI buffer of about 8,000 characters.
Perhaps there is a limit to the 'extended' buffer of external files as 'included' in the format.

I can only suggest until red comes in: count the characters in the format & CSVs & see if it suggests anything...
Can you find "the line" where it stops working? Then try adding small lines to see if that 'buffer' is really the cause?

I think I got it. apparently Notepad which is what i am/was using for quick editing/did the first half of my lists in, before i got LibreOffice. Saves in ANSI Encoding
which is fine, except it had special characters that caused the reading of the csv file to fail. I changed that encoding to UTF-8, and it seems to be working now.


Now i just need to get my Language based on the file encoded audio tracks working, and i'll be all set to rename and organize all my movies. yey!