Help with Malformed input or input contains unmappable chac

[rednoah]

Not sure but I guess maybe your filesystem doesn't allow these Unicode characters?

You can use the .ascii() function in the format to simplify unicode text to ASCII-only text. Or maybe there is a way to make Unicode work on the lower java or filesystem layers.

[rednoah]

export LANG=en_US.UTF-8 should do the trick. If it doesn't work I have no idea, make sure filesystem entries are UTF-8 encoded. In anycase, Somehow the Java IO can't properly interface with the filesystem due to some misconfiguration.

[Clint]

I stumbled upon the same problem, solved it another way. Just add "-Dfile.encoding=UTF-8" to java arguments line in filebot.sh.

Code: Select all

java -Dunixfs=false -Dfile.encoding=UTF-8 -DuseExtendedFileAttributes=false...~

[gala]

Hi I'm using filebot 4.5 on raspberry and I have problems with accented characters.
The two fix described in the thread (export LANG and encoding UTF-8) are already in /opt/share/filebot/bin/filebot, but I still get the error "InvalidPathException".
Below:
- content of /opt/share/filebot/bin/filebot
- output of filebotRun.sh (the script I use to run filebot)
- content of filebotRun.sh
- output of sudo /opt/share/filebot/bin/filebot -script fn:sysenv
Any help appreciated. Thanks!

Code: Select all

pi@raspberrypi /opt/share/filebot/bin $ cat filebot
#!/bin/sh

# force JVM language and encoding settings
export LANG=en_US.utf8

java -Dunixfs=false -DuseExtendedFileAttributes=true -DuseCreationDate=false -Dfile.encoding=UTF-8 -Dsun.net.client.defaultConnectTimeout=10000 -Dsun.net.client.defaultReadTimeout=60000 -Dapplication.deployment=ipkg -Dapplication.analytics=true -Duser.home=/opt/share/filebot/data -Dapplication.dir=/opt/share/filebot/data -Djava.io.tmpdir=/opt/share/filebot/data/temp -Djna.library.path=/opt/share/filebot -Djava.library.path=/opt/share/filebot -Dnet.filebot.AcoustID.fpcalc=/opt/share/filebot/fpcalc -jar /opt/share/filebot/FileBot.jar "$@"

Code: Select all

pi@raspberrypi /code $ sudo ./filebotRun.sh
Parameter: music = y
Parameter: subtitles = en
Parameter: artwork = y
Argument: /media/hd/rtorrent/videos
Input: /media/hd/rtorrent/videos/Hannibal.S01E01.720p.HDTV.X264-DIMENSION.mkv
Input: /media/hd/rtorrent/videos/Hannibal.S01E01.720p.HDTV.X264-DIMENSION.eng.srt
Group: [tvs:hannibal] => [Hannibal.S01E01.720p.HDTV.X264-DIMENSION.mkv, Hannibal.S01E01.720p.HDTV.X264-DIMENSION.eng.srt]
No missing subtitles
Rename episodes using [TheTVDB]
Auto-detected query: [Hannibal]
Fetching episode data for [Hannibal]
Auto-detected query: [Hannibal]
Fetching episode data for [Hannibal]
[MOVE] Rename [/media/hd/rtorrent/videos/Hannibal.S01E01.720p.HDTV.X264-DIMENSION.mkv] to [/media/tav/Video/Angelo/TV Shows/Hannibal/Season 01/Hannibal - S01E01 - Apéritif.mkv]
InvalidPathException: Malformed input or input contains unmappable characters: /media/tav/Video/Angelo/TV Shows/Hannibal/Season 01/Hannibal - S01E01 - Apéritif.mkv
Finished without processing any files
Failure (°_°)

Code: Select all

pi@raspberrypi /code $ cat filebotRun.sh
#!/bin/bash
#
# Download video info and move video to XBMC folder structure

fldr="/media/hd/rtorrent"
src=$fldr"/videos"
dst="/media/tav/Video/Angelo/"

#check root
s1=`whoami`
s2="root"

if [ "$s1" != "$s2" ]
then
  echo "not root!"
  exit
fi

/opt/share/filebot/bin/filebot -script fn:amc "$src" --output "$dst" --action move --conflict override -non-strict --def music=y subtitles=en artwork=y

Code: Select all

pi@raspberrypi /code $ sudo /opt/share/filebot/bin/filebot -script fn:sysenv
# Environment Variables #
MAIL: /var/mail/root
LOGNAME: root
SUDO_UID: 1000
SUDO_COMMAND: /opt/share/filebot/bin/filebot -script fn:sysenv
SUDO_USER: pi
HOME: /root
PATH: /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
XFILESEARCHPATH: /usr/dt/app-defaults/%L/Dt
SHELL: /bin/bash
TERM: xterm
NLSPATH: /usr/dt/lib/nls/msg/%L/%N.cat
LANG: en_US.utf8
PWD: /code
USER: root
SUDO_GID: 1000
LS_COLORS: rs=0:di=01;34:ln=01;36:mh=00:pi=40;33:so=01;35:do=01;35:bd=40;33;01:cd=40;33;01:or=40;31;01:su=37;41:sg=30;43:ca=30;41:tw=30;42:ow=34;42:st=37;44:ex=01;32:*.tar=01;31:*.tgz=01;31:*.arj=01;31:*.taz=01;31:*.lzh=01;31:*.lzma=01;31:*.tlz=01;31:*.txz=01;31:*.zip=01;31:*.z=01;31:*.Z=01;31:*.dz=01;31:*.gz=01;31:*.lz=01;31:*.xz=01;31:*.bz2=01;31:*.bz=01;31:*.tbz=01;31:*.tbz2=01;31:*.tz=01;31:*.deb=01;31:*.rpm=01;31:*.jar=01;31:*.war=01;31:*.ear=01;31:*.sar=01;31:*.rar=01;31:*.ace=01;31:*.zoo=01;31:*.cpio=01;31:*.7z=01;31:*.rz=01;31:*.jpg=01;35:*.jpeg=01;35:*.gif=01;35:*.bmp=01;35:*.pbm=01;35:*.pgm=01;35:*.ppm=01;35:*.tga=01;35:*.xbm=01;35:*.xpm=01;35:*.tif=01;35:*.tiff=01;35:*.png=01;35:*.svg=01;35:*.svgz=01;35:*.mng=01;35:*.pcx=01;35:*.mov=01;35:*.mpg=01;35:*.mpeg=01;35:*.m2v=01;35:*.mkv=01;35:*.webm=01;35:*.ogm=01;35:*.mp4=01;35:*.m4v=01;35:*.mp4v=01;35:*.vob=01;35:*.qt=01;35:*.nuv=01;35:*.wmv=01;35:*.asf=01;35:*.rm=01;35:*.rmvb=01;35:*.flc=01;35:*.avi=01;35:*.fli=01;35:*.flv=01;35:*.gl=01;35:*.dl=01;35:*.xcf=01;35:*.xwd=01;35:*.yuv=01;35:*.cgm=01;35:*.emf=01;35:*.axv=01;35:*.anx=01;35:*.ogv=01;35:*.ogx=01;35:*.aac=00;36:*.au=00;36:*.flac=00;36:*.mid=00;36:*.midi=00;36:*.mka=00;36:*.mp3=00;36:*.mpc=00;36:*.ogg=00;36:*.ra=00;36:*.wav=00;36:*.axa=00;36:*.oga=00;36:*.spx=00;36:*.xspf=00;36:
USERNAME: root


# Java System Properties #
path.separator: :
jna.library.path: /opt/share/filebot
java.vm.name: Java HotSpot(TM) Client VM
java.io.tmpdir: /opt/share/filebot/data/temp
user.country: US
user.home: /opt/share/filebot/data
useExtendedFileAttributes: true
java.vm.vendor: Oracle Corporation
user.language: en
java.vendor: Oracle Corporation
java.vendor.url.bug: http://bugreport.sun.com/bugreport/
sun.net.client.defaultReadTimeout: 60000
java.specification.name: Java Platform API Specification
os.name: Linux
java.runtime.name: Java(TM) SE Runtime Environment
application.deployment: ipkg
file.separator: /
sun.net.client.defaultConnectTimeout: 10000
java.vm.specification.version: 1.8
sun.boot.class.path: /usr/lib/jvm/jdk-8-oracle-arm-vfp-hflt/jre/lib/resources.jar:/usr/lib/jvm/jdk-8-oracle-arm-vfp-hflt/jre/lib/rt.jar:/usr/lib/jvm/jdk-8-oracle-arm-vfp-hflt/jre/lib/sunrsasign.jar:/usr/lib/jvm/jdk-8-oracle-arm-vfp-hflt/jre/lib/jsse.jar:/usr/lib/jvm/jdk-8-oracle-arm-vfp-hflt/jre/lib/jce.jar:/usr/lib/jvm/jdk-8-oracle-arm-vfp-hflt/jre/lib/charsets.jar:/usr/lib/jvm/jdk-8-oracle-arm-vfp-hflt/jre/lib/jfr.jar:/usr/lib/jvm/jdk-8-oracle-arm-vfp-hflt/jre/classes
application.analytics: true
java.version: 1.8.0
http.agent: FileBot 4.5
java.library.path: /opt/share/filebot
unixfs: false
awt.toolkit: sun.awt.X11.XToolkit
java.vm.specification.name: Java Virtual Machine Specification
os.version: 3.12.26+
useCreationDate: false
file.encoding: UTF-8
java.awt.printerjob: sun.print.PSPrinterJob
grape.root: /opt/share/filebot/data/grape
java.class.version: 52.0
java.ext.dirs: /usr/lib/jvm/jdk-8-oracle-arm-vfp-hflt/jre/lib/ext:/usr/java/packages/lib/ext
java.specification.version: 1.8
net.filebot.AcoustID.fpcalc: /opt/share/filebot/fpcalc
java.vendor.url: http://java.oracle.com/
ehcache.disk.store.dir: /opt/share/filebot/data/cache/1
sun.os.patch.level: unknown
sun.java.launcher: SUN_STANDARD
os.arch: arm
user.dir: /code
line.separator:

user.timezone: Etc/UTC
sun.cpu.endian: little
java.vm.specification.vendor: Oracle Corporation
java.home: /usr/lib/jvm/jdk-8-oracle-arm-vfp-hflt/jre
sun.management.compiler: HotSpot Client Compiler
sun.arch.data.model: 32
java.endorsed.dirs: /usr/lib/jvm/jdk-8-oracle-arm-vfp-hflt/jre/lib/endorsed
file.encoding.pkg: sun.io
java.specification.vendor: Oracle Corporation
sun.boot.library.path: /usr/lib/jvm/jdk-8-oracle-arm-vfp-hflt/jre/lib/arm
sun.jnu.encoding: ANSI_X3.4-1968
sun.arch.abi: gnueabihf
java.runtime.version: 1.8.0-b132
java.vm.info: mixed mode
java.vm.version: 25.0-b70
sun.io.unicode.encoding: UnicodeLittle
java.awt.graphicsenv: sun.awt.X11GraphicsEnvironment
application.dir: /opt/share/filebot/data
java.class.path: /opt/share/filebot/FileBot.jar
sun.java.command: /opt/share/filebot/FileBot.jar -script fn:sysenv
sun.cpu.isalist:
user.name: root


# Arguments #
args[0] = -script
args[1] = fn:sysenv


Done ヾ(＠⌒ー⌒＠)ノ

[rednoah]

The system encoding is set to ASCII:

Code: Select all

sun.jnu.encoding: ANSI_X3.4-1968

Ideally setting LANG should fix that. But if it doesn't you'll have to figure out another way to set that.

You could try this:

Code: Select all

export LC_ALL="en_US.UTF-8"

[gala]

Code: Select all

pi@raspberrypi /code $ export LC_ALL="en_US.UTF-8"
-bash: warning: setlocale: LC_ALL: cannot change locale (en_US.UTF-8)

To fix it I used

Code: Select all

sudo dpkg-reconfigure locales

And then it worked! Many many thanks!

[cowboytronic]

export LANG=en_US.UTF-8 should do the trick. If it doesn't work I have no idea, make sure filesystem entries are UTF-8 encoded. In anycase, Somehow the Java IO can't properly interface with the filesystem due to some misconfiguration.

I just want to report that I was also having this issue running FileBot on an UnRAID server. After searching the forums I found this thread, and the fix.

Code: Select all

export LANG=en_US.UTF-8

After running this command, I have had no further issues due to special characters in file names.

Thanks!