GPG file in the HEAD repository

Any questions? Need some help?
Post Reply
User avatar
Sheldon
Posts: 188
Joined: 14 Apr 2014, 14:39

GPG file in the HEAD repository

Post by Sheldon »

Hi,

currently I only see a GPG file in the HEAD repository.
Will you continue providing the plane jar as before?

Otherwise GPG is not very easy to handle on a Windows machine.
Do i need a key?

Kind regards,

Sheldon
User avatar
rednoah
The Source
Posts: 24644
Joined: 16 Nov 2011, 08:59
Location: Taipei
Contact:

Re: GPG file in the HEAD repository

Post by rednoah »

The HEAD jar is used for unattended updates by alot of people these days. It's now digitally signed with GnuPG for security reasons. You can use this public key to verify that the package has been uploaded by me and that is has not been modified by a 3rd party.
:idea: Please read the FAQ and How to Request Help.
User avatar
Sheldon
Posts: 188
Joined: 14 Apr 2014, 14:39

Re: GPG file in the HEAD repository

Post by Sheldon »

I understand but if I try to decrypt the current gpg file using gpg4win it tells me that there is no data.
User avatar
rednoah
The Source
Posts: 24644
Joined: 16 Nov 2011, 08:59
Location: Taipei
Contact:

Re: GPG file in the HEAD repository

Post by rednoah »

Works fine with the gpg.exe command-line tool as far as I can tell. Maybe there's a bug in the software you're using.


0. Fetch public key (only required once):

Code: Select all

gpg --recv-keys 4E402EBF7C3C6A71
1. Verify signature and extract signed data:

Code: Select all

gpg --trusted-key 4E402EBF7C3C6A71 --output FileBot.jar.xz --decrypt FileBot.jar.xz.gpg
2. Unpack data:

Code: Select all

xz --decompress FileBot.jar.xz

If you use Windows Bash then update-filebot.sh should work out of the box. If you're stuck with CMD then you can make your own little script with the commands above. Since I update the jar every other day, automating the processing of updating the jar is probably a good idea. ;)
:idea: Please read the FAQ and How to Request Help.
User avatar
Sheldon
Posts: 188
Joined: 14 Apr 2014, 14:39

Re: GPG file in the HEAD repository

Post by Sheldon »

Thanks! Please provide a download link to the command line tool gpg.exe you are using. Google didn't find it! :-)
User avatar
rednoah
The Source
Posts: 24644
Joined: 16 Nov 2011, 08:59
Location: Taipei
Contact:

Re: GPG file in the HEAD repository

Post by rednoah »

1.
It's on the official site. It's the second download for Windows:
https://www.gnupg.org/ftp/gcrypt/binary ... 170403.exe

@see https://www.gnupg.org/download/index.en.html


2.
xz binaries for Windows are here:
http://tukaani.org/xz/xz-5.2.3-windows.7z

@see http://tukaani.org/xz/
:idea: Please read the FAQ and How to Request Help.
User avatar
Sheldon
Posts: 188
Joined: 14 Apr 2014, 14:39

Re: GPG file in the HEAD repository

Post by Sheldon »

That works fine! Thanks for your help!
User avatar
Sheldon
Posts: 188
Joined: 14 Apr 2014, 14:39

Re: GPG file in the HEAD repository

Post by Sheldon »

Will the url remain like this

Code: Select all

https://sourceforge.net/projects/filebot/files/filebot/HEAD/FileBot.jar.xz.gpg/download
without the version in the jar?
Without the version it is easier to automize. :)
User avatar
rednoah
The Source
Posts: 24644
Joined: 16 Nov 2011, 08:59
Location: Taipei
Contact:

Re: GPG file in the HEAD repository

Post by rednoah »

Yep. That's pretty much how update-filebot.sh works.
:idea: Please read the FAQ and How to Request Help.
User avatar
Sheldon
Posts: 188
Joined: 14 Apr 2014, 14:39

Re: GPG file in the HEAD repository

Post by Sheldon »

Great! Thanks!
Chryses
Posts: 66
Joined: 26 Aug 2012, 19:11

Re: GPG file in the HEAD repository

Post by Chryses »

Wow. Sorry if I jump to this thread.

I always update the FileBot head with a custom script, today I tried to update FileBot because the cleaner script don't works anymore and if I understand the situation, I need to keep update FileBot.

So I discovered this thread and the link for the update-filebot.sh, I downloaded it and the maintainer.pub, put both in the FileBot directory and launched the sh file, but I've some error

Code: Select all

[~] # sh /share/CACHEDEV1_DATA/.qpkg/Entware-ng/share/filebot/update-filebot.sh
/share/CACHEDEV1_DATA/.qpkg/Entware-ng/share/filebot/FileBot.jar.xz.gpg: No such file or directory
Update /share/CACHEDEV1_DATA/.qpkg/Entware-ng/share/filebot/FileBot.jar.xz.gpg
Warning: Illegal date format for -z, --timecond (and not a file name).
Warning: Disabling time condition. See curl_getdate(3) for valid date syntax.
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
  0 15547    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
  0   357    0     0    0     0      0      0 --:--:--  0:00:01 --:--:--     0
  0   439    0     0    0     0      0      0 --:--:--  0:00:02 --:--:--     0
  0   353    0     0    0     0      0      0 --:--:--  0:00:02 --:--:--     0
100 17.7M  100 17.7M    0     0  2902k      0  0:00:06  0:00:06 --:--:-- 5672k
/share/CACHEDEV1_DATA/.qpkg/Entware-ng/share/filebot/FileBot.jar.xz.gpg [d71088da176c5aaf3e314e4d6309bf07]
gpg: keyring `/share/CACHEDEV1_DATA/.qpkg/Entware-ng/share/filebot/data/.gpg/secring.gpg' created
gpg: keyring `/share/CACHEDEV1_DATA/.qpkg/Entware-ng/share/filebot/data/.gpg/pubring.gpg' created
gpg: no valid OpenPGP data found.
gpg: Total number processed: 0
gpg: Signature made Sun 16 Apr 2017 07:11:50 PM CEST using RSA key ID 7C3C6A71
gpg: Can't check signature: public key not found
and at the end I've the FileBot.jar.xz file

Any idea?
User avatar
rednoah
The Source
Posts: 24644
Joined: 16 Nov 2011, 08:59
Location: Taipei
Contact:

Re: GPG file in the HEAD repository

Post by rednoah »

1.
Console output says that it failed to import the public key:

Code: Select all

gpg: no valid OpenPGP data found.
gpg: Total number processed: 0
Looks like this line doesn't work for some reason:

Code: Select all

gpg --homedir "$GPG_HOME" --import "$APP_ROOT/maintainer.pub"
@see https://github.com/filebot/filebot/blob ... bot.sh#L62


2.
If you want to update to the latest stable release, then you can just do this:

Code: Select all

cd /path/to/filebot
curl https://raw.githubusercontent.com/filebot/plugins/master/installer/portable.sh | sh -xu
:idea: I recommend always using the latest stable release. The latest revision (that this thread is all about) may not always be stable and sometimes may not work at all.
:idea: Please read the FAQ and How to Request Help.
Chryses
Posts: 66
Joined: 26 Aug 2012, 19:11

Re: GPG file in the HEAD repository

Post by Chryses »

Tnx like always.

Btw, your excellent file, is made for "normal" linux, I use a qnap with entware, so I installed the coreutils-sha256sum.

I think the sha approach to check first if there's a new version is the best! Do you think is possible to use this way on this? https://raw.githubusercontent.com/fileb ... ortable.sh
User avatar
rednoah
The Source
Posts: 24644
Joined: 16 Nov 2011, 08:59
Location: Taipei
Contact:

Re: GPG file in the HEAD repository

Post by rednoah »

The SHA256 is used to verify portable package to make sure that it hasn't been tampered with. Future releases will use GPG signatures as well.
:idea: Please read the FAQ and How to Request Help.
Chryses
Posts: 66
Joined: 26 Aug 2012, 19:11

Re: GPG file in the HEAD repository

Post by Chryses »

I mean this

Code: Select all

if [ "$PACKAGE_HASH" == "$PACKAGE_HASH_EXPECTED" ]; then
	echo "$PACKAGE_FILE [$PACKAGE_HASH]"
	exit 0
fi
Is a very good idea to prevent to download each time the whole file!

So in future also the latest stable release will use GPG?
User avatar
rednoah
The Source
Posts: 24644
Joined: 16 Nov 2011, 08:59
Location: Taipei
Contact:

Re: GPG file in the HEAD repository

Post by rednoah »

1.
The hash was primarily used to make sure that the data received from the untrusted mirror wasn't tampered with, but still gave ultimate trust to SourceForge. This problem has been fixed with GPG signatures which give ultimate trust to nobody but me.


2.
Yes, GPG signatures will be used for all files, except maybe for the packages where sha256 digests are known and verified by the package manager (i.e. synology and brew cask packages).
:idea: Please read the FAQ and How to Request Help.
viking
Power User
Posts: 110
Joined: 14 Jul 2013, 08:21

Re: GPG file in the HEAD repository

Post by viking »

Sorry for my ignorance....I am quite lost.

I am on Windows and I use the portable version.
In the past, I have just downloaded the jar (e.g. filebot-r4991.jar.xz) and replaced the old jar file.
How do I update on windows now without having to download extra programs?

Do I use "update-filebot.sh"? What is this and how do I use it?
User avatar
rednoah
The Source
Posts: 24644
Joined: 16 Nov 2011, 08:59
Location: Taipei
Contact:

Re: GPG file in the HEAD repository

Post by rednoah »

Does installing the Windows subsystem for Linux count as downloading extra programs?

You will need a program they can verify gpg signatures and a program that can decompress xz archives. On Windows, neither is installed by default. On Linux, including WSL, it'll work out of the box.
:idea: Please read the FAQ and How to Request Help.
viking
Power User
Posts: 110
Joined: 14 Jul 2013, 08:21

Re: GPG file in the HEAD repository

Post by viking »

I have a program that can decompress the archives (Winrar). That is how I did it before the gpg was added.
Now I can't just unrar anymore...

I didn't understand your comment about Linux. Do I need to use Linux to use "update-filebot.sh"? Can I use it with Windows directly? What is "update-filebot.sh" and how do I use it?
User avatar
rednoah
The Source
Posts: 24644
Joined: 16 Nov 2011, 08:59
Location: Taipei
Contact:

Re: GPG file in the HEAD repository

Post by rednoah »

Option A: Use gpg.exe and xz.exe

You just need gpg.exe and xz.exe to verify and unpack the jar.


Option B: Use WSL

If you want to use update-filebot.sh then you need the Windows Subsystem for Linux.


:idea: I'm sure there's GUI tools that can deal with gpg and xz files. I'd automate the process with the curl, gpg and xz commands though.
:idea: Please read the FAQ and How to Request Help.
User avatar
MindTooth
Donor
Posts: 13
Joined: 20 Mar 2017, 07:23

Re: GPG file in the HEAD repository

Post by MindTooth »

Code: Select all

○ → ./update-filebot.sh
./update-filebot.sh: 38: [: 970ab82154b44551c2510e4c0ec42e70: unexpected operator
Update /home/mt/filebot/FileBot.jar.xz.gpg
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
  0   370    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
  0 15534    0     0    0     0      0      0 --:--:--  0:00:01 --:--:--     0
  0   429    0     0    0     0      0      0 --:--:--  0:00:02 --:--:--     0
  0   343    0     0    0     0      0      0 --:--:--  0:00:02 --:--:--     0
  0     0    0     0    0     0      0      0 --:--:--  0:00:03 --:--:--     0
/home/mt/filebot/FileBot.jar.xz.gpg [970ab82154b44551c2510e4c0ec42e70]
gpg: Problem reading source (2111675 bytes remaining)
gpg: handle plaintext failed: file read error
Can't seem to pull a working copy. Also, some script error. This is on OpenMediaVault 3.0 (Debian Jessie I believe).

Ed1t: Worked fine to decrypt yesterdays r5040 release, I guess this is the new r5041 you talked about?
User avatar
Sheldon
Posts: 188
Joined: 14 Apr 2014, 14:39

Re: GPG file in the HEAD repository

Post by Sheldon »

The current xz file can't be decompressed using XZ Utils
Yesterday's file worked fine. Please check!
User avatar
rednoah
The Source
Posts: 24644
Joined: 16 Nov 2011, 08:59
Location: Taipei
Contact:

Re: GPG file in the HEAD repository

Post by rednoah »

File size looks off. I guess the file wasn't uploaded completely.
:idea: Please read the FAQ and How to Request Help.
User avatar
Sheldon
Posts: 188
Joined: 14 Apr 2014, 14:39

Re: GPG file in the HEAD repository

Post by Sheldon »

Now it works fine! Thanks!
viking
Power User
Posts: 110
Joined: 14 Jul 2013, 08:21

Re: GPG file in the HEAD repository

Post by viking »

rednoah wrote:
Option B: Use WSL

If you want to use update-filebot.sh then you need the Windows Subsystem for Linux.


:idea: I'm sure there's GUI tools that can deal with gpg and xz files. I'd automate the process with the curl, gpg and xz commands though.

The link above takes me to Bash On Windows, However, I need to run Windows 10 but I run Windows 7. Thus not an option for me :(

(There is no help section on this forum for Windows 7 users)
User avatar
Sheldon
Posts: 188
Joined: 14 Apr 2014, 14:39

Re: GPG file in the HEAD repository

Post by Sheldon »

I followed the initial approach using XZ Utils and GnuGP combined with a batch holding the provided commands from above. That works fine

If I got you right you work in a portable enviroment like me. XZ as a binary is portable as well as GnuGP. After installing GnuGP once you can copy the app folder to a location of your choice and uninstall GnuGP. This is a common practice for many portable apps not following the PortableApps.com standard approach.
viking
Power User
Posts: 110
Joined: 14 Jul 2013, 08:21

Re: GPG file in the HEAD repository

Post by viking »

Sheldon wrote:I followed the initial approach using XZ Utils and GnuGP combined with a batch holding the provided commands from above. That works fine

If I got you right you work in a portable enviroment like me. XZ as a binary is portable as well as GnuGP. After installing GnuGP once you can copy the app folder to a location of your choice and uninstall GnuGP. This is a common practice for many portable apps not following the PortableApps.com standard approach.
I had actually installed GPG4Win a few years ago and that apparently also installed GnuGP. I ran the command

Code: Select all

gpg --trusted-key 4E402EBF7C3C6A71 --output FileBot.jar.xz --decrypt FileBot.jar.xz.gpg
followed by extraction with WinRar and got the filebot.jar :)

BTW, how can I find out the version number of the filebot.jar ?
User avatar
Sheldon
Posts: 188
Joined: 14 Apr 2014, 14:39

Re: GPG file in the HEAD repository

Post by Sheldon »

Instead of installing GPG4win I use this.

To find out the JAR version you can use the corresponding CLI command.

Code: Select all

filebot -version
But I would recommend to get the sysinfo using the sysinfo script with the CLI.

Code: Select all

filebot -script "sysinfo"
Leokosta
Posts: 10
Joined: 08 Apr 2017, 18:25

Re: GPG file in the HEAD repository

Post by Leokosta »

Hello, Viking ... Try using 7zip to extract the file. I got some errors, but in the end I could replace the .jar file, and Filebot seemes to be working fine.
viking
Power User
Posts: 110
Joined: 14 Jul 2013, 08:21

Re: GPG file in the HEAD repository

Post by viking »

Sheldon wrote:Instead of installing GPG4win I use this.

To find out the JAR version you can use the corresponding CLI command.

Code: Select all

filebot -version
But I would recommend to get the sysinfo using the sysinfo script with the CLI.

Code: Select all

filebot -script "sysinfo"
I was wondering if there is some way to tell the version in the jar file itself?
If I have several jar files I may not want to copy them one-by-one to the FileBot directory and run the script just to find the version..
viking
Power User
Posts: 110
Joined: 14 Jul 2013, 08:21

Re: GPG file in the HEAD repository

Post by viking »

Leokosta wrote:Hello, Viking ... Try using 7zip to extract the file. I got some errors, but in the end I could replace the .jar file, and Filebot seemes to be working fine.
As explained above, I am using WinRAR to extract; that works fine. The issue was GPG, but as I also explained above, that has also been taken care of.
User avatar
rednoah
The Source
Posts: 24644
Joined: 16 Nov 2011, 08:59
Location: Taipei
Contact:

Re: GPG file in the HEAD repository

Post by rednoah »

You can get the revision for each jar like this:

Code: Select all

java -jar /path/to/FileBot.jar -version
:idea: Please read the FAQ and How to Request Help.
viking
Power User
Posts: 110
Joined: 14 Jul 2013, 08:21

Re: GPG file in the HEAD repository

Post by viking »

rednoah wrote:You can get the revision for each jar like this:

Code: Select all

java -jar /path/to/FileBot.jar -version
That worked. Thanks!
User avatar
Sheldon
Posts: 188
Joined: 14 Apr 2014, 14:39

Re: GPG file in the HEAD repository

Post by Sheldon »

Hi,

there seems to be a problem with the latest gpg file.
The xz decompression throws an "Unexpected end of input" exception.

Please have a look!

Kind regards,

Sheldon
User avatar
rednoah
The Source
Posts: 24644
Joined: 16 Nov 2011, 08:59
Location: Taipei
Contact:

Re: GPG file in the HEAD repository

Post by rednoah »

Fixed.
:idea: Please read the FAQ and How to Request Help.
User avatar
Sheldon
Posts: 188
Joined: 14 Apr 2014, 14:39

Re: GPG file in the HEAD repository

Post by Sheldon »

Now it works fine! Thanks!
User avatar
Sheldon
Posts: 188
Joined: 14 Apr 2014, 14:39

Re: GPG file in the HEAD repository

Post by Sheldon »

Hi,

calling https://sourceforge.net/projects/filebo ... ebot/HEAD/
throws a 404 exception.
Please have a look!

Kind regards,

Sheldon
User avatar
rednoah
The Source
Posts: 24644
Joined: 16 Nov 2011, 08:59
Location: Taipei
Contact:

Re: GPG file in the HEAD repository

Post by rednoah »

:idea: Please read the FAQ and How to Request Help.
User avatar
Sheldon
Posts: 188
Joined: 14 Apr 2014, 14:39

Re: GPG file in the HEAD repository

Post by Sheldon »

User avatar
rednoah
The Source
Posts: 24644
Joined: 16 Nov 2011, 08:59
Location: Taipei
Contact:

Re: GPG file in the HEAD repository

Post by rednoah »

Yes. This is my own server so it won't depend on SF or be affected by SF issues. The update-filebot.sh has been updated accordingly.
:idea: Please read the FAQ and How to Request Help.
User avatar
Sheldon
Posts: 188
Joined: 14 Apr 2014, 14:39

Re: GPG file in the HEAD repository

Post by Sheldon »

Thanks!
User avatar
Sheldon
Posts: 188
Joined: 14 Apr 2014, 14:39

Re: GPG file in the HEAD repository

Post by Sheldon »

https://get.filebot.net/filebot/latest/
FileBot.jar.xz.gpg 24-Jun-2017 23:29 18M

Is the version FileBot 4.7.10 (r5140) still correct?
User avatar
rednoah
The Source
Posts: 24644
Joined: 16 Nov 2011, 08:59
Location: Taipei
Contact:

Re: GPG file in the HEAD repository

Post by rednoah »

Due to CloudFlare caching, you may be seeing cached content. Just use the update-filebot.sh script once in a while and you'll be fine. You'll get the latest and greatest eventually.
:idea: Please read the FAQ and How to Request Help.
User avatar
Sheldon
Posts: 188
Joined: 14 Apr 2014, 14:39

Re: GPG file in the HEAD repository

Post by Sheldon »

Now it's FileBot 4.7.11 (r5154). Thanks!
User avatar
Sheldon
Posts: 188
Joined: 14 Apr 2014, 14:39

Re: GPG file in the HEAD repository

Post by Sheldon »

If I download

FileBot.jar.xz.gpg 02-Aug-2017 23:40 18M

I still receive r5179. it seems to be the cache problem again.
Can this be somehow be avoided in the future?
User avatar
rednoah
The Source
Posts: 24644
Joined: 16 Nov 2011, 08:59
Location: Taipei
Contact:

Re: GPG file in the HEAD repository

Post by rednoah »

Unfortunately, the index page and the actual files may be cached differently.

I'd just call the update-filebot script once a week and not check the index page manually. ;)
:idea: Please read the FAQ and How to Request Help.
User avatar
Sheldon
Posts: 188
Joined: 14 Apr 2014, 14:39

Re: GPG file in the HEAD repository

Post by Sheldon »

The check for a new file is automized.
I receive a news in my rss feed if the file was updated.

I fetch it as a Java InputStream from

https://get.filebot.net/filebot/latest/ ... jar.xz.gpg

but I always get r5179.

It's the same for the manual download. Really annoying! :cry:
User avatar
rednoah
The Source
Posts: 24644
Joined: 16 Nov 2011, 08:59
Location: Taipei
Contact:

Re: GPG file in the HEAD repository

Post by rednoah »

Caching is set to a week, but I also seem to be getting stale content:

Code: Select all

$ curl -I https://get.filebot.net/filebot/latest/FileBot.jar.xz.gpg
HTTP/1.1 200 OK
Date: Mon, 07 Aug 2017 15:43:01 GMT
...
Last-Modified: Mon, 24 Jul 2017 15:38:52 GMT
ETag: "11bf21b-5551203104e40"
CF-Cache-Status: HIT
Expires: Tue, 08 Aug 2017 15:43:01 GMT
...
I'll clear the cache manually for now. This might just a a small CloudFlare bug.
:idea: Please read the FAQ and How to Request Help.
User avatar
Sheldon
Posts: 188
Joined: 14 Apr 2014, 14:39

Re: GPG file in the HEAD repository

Post by Sheldon »

Thanks! Now it's FileBot 4.7.12 (r5192).

Maybe you can have a job clearing the cache after the new version upload.
User avatar
Sheldon
Posts: 188
Joined: 14 Apr 2014, 14:39

Re: GPG file in the HEAD repository

Post by Sheldon »

I received a news about

FileBot.jar.xz.gpg - 07-Aug-2017 08:37

but on the website it's still

FileBot.jar.xz.gpg - 02-Aug-2017 23:40.

What should it be?
User avatar
rednoah
The Source
Posts: 24644
Joined: 16 Nov 2011, 08:59
Location: Taipei
Contact:

Re: GPG file in the HEAD repository

Post by rednoah »

The latest jar is from 07 Aug:

Code: Select all

$ curl -I https://get.filebot.net/filebot/latest/FileBot.jar.xz.gpg
HTTP/1.1 200 OK
Date: Sun, 13 Aug 2017 15:22:54 GMT
...
Last-Modified: Mon, 07 Aug 2017 15:37:50 GMT
ETag: "11d8b13-5562ba1282426"
:idea: Please read the FAQ and How to Request Help.
User avatar
Sheldon
Posts: 188
Joined: 14 Apr 2014, 14:39

Re: GPG file in the HEAD repository

Post by Sheldon »

Nope, I still get r5192.
User avatar
Sheldon
Posts: 188
Joined: 14 Apr 2014, 14:39

Re: GPG file in the HEAD repository

Post by Sheldon »

Now it's forbidden?
User avatar
rednoah
The Source
Posts: 24644
Joined: 16 Nov 2011, 08:59
Location: Taipei
Contact:

Re: GPG file in the HEAD repository

Post by rednoah »

I disabled the index because it seems to be causing confusion.

The latest jar is available. I don't know what revision that is, but you can see the Last Modified date in my post above.
:idea: Please read the FAQ and How to Request Help.
User avatar
Sheldon
Posts: 188
Joined: 14 Apr 2014, 14:39

Re: GPG file in the HEAD repository

Post by Sheldon »

The revision is still r5192.

That's bad because my RSS feed is based on the index page.
I don't see any confusion. The only problem is that the wrong revision is provided.
That needs to be solved.
How can I see if there is a new revision in the future?

Currently I get a 403 Foridden exception. Please make the index available again.
User avatar
rednoah
The Source
Posts: 24644
Joined: 16 Nov 2011, 08:59
Location: Taipei
Contact:

Re: GPG file in the HEAD repository

Post by rednoah »

You can use the curl command to fetch and update the latest version. That's what the update-filebot.sh script does. The HTTP protocol does exactly what we need. Fetch new file if there is a new file.

Not sure what you're doing, but there is no RSS feed and parsing HTML index pages is generally a bad idea.
:idea: Please read the FAQ and How to Request Help.
User avatar
Sheldon
Posts: 188
Joined: 14 Apr 2014, 14:39

Re: GPG file in the HEAD repository

Post by Sheldon »

I download the source of the index page and parse it.
That works fine if there is something!:-)
SO PLEASE ENABLE IT!!!
User avatar
rednoah
The Source
Posts: 24644
Joined: 16 Nov 2011, 08:59
Location: Taipei
Contact:

Re: GPG file in the HEAD repository

Post by rednoah »

Use HTTP HEAD requests. You're doing something very simple in an unnecessarily complicated way.
:idea: Please read the FAQ and How to Request Help.
User avatar
Sheldon
Posts: 188
Joined: 14 Apr 2014, 14:39

Re: GPG file in the HEAD repository

Post by Sheldon »

I do this for all my RSS feeds for website without one.
I asked you in the beginning if it will staz like this and you said yes.
Now you change it again and I have to adapt. Just enable the index and it's fine.
User avatar
Sheldon
Posts: 188
Joined: 14 Apr 2014, 14:39

Re: GPG file in the HEAD repository

Post by Sheldon »

I am not familiar with curl so it's again additional work for me. And I need it on windos.
Can you even provide some script I can use. This is really annoying.
Enabling the index would be much easier.
User avatar
rednoah
The Source
Posts: 24644
Joined: 16 Nov 2011, 08:59
Location: Taipei
Contact:

Re: GPG file in the HEAD repository

Post by rednoah »

HTTP is the most common network protocol. There are many many many tools that you can use. curl or wget would be among the most commonly used tools.

You have a bad solution that just so happened to kinda work. Now it doesn't, so it's time to do it properly. You will find that it'll be significantly easier (1 line) compared to whatever concoction you've come up with. I've been telling you to use curl for months. Please do. ;)

Here is a script for you:
https://github.com/filebot/filebot/blob ... filebot.sh

You can refer to this script on how to use curl, gpg and xz to download, verify and extract the jar.
:idea: Please read the FAQ and How to Request Help.
User avatar
Sheldon
Posts: 188
Joined: 14 Apr 2014, 14:39

Re: GPG file in the HEAD repository

Post by Sheldon »

We never talked about curl. This is the first time for me.
You are joking. Such an effort only for the info that there is a new version.
I thought curl can do this.
User avatar
Sheldon
Posts: 188
Joined: 14 Apr 2014, 14:39

Re: GPG file in the HEAD repository

Post by Sheldon »

I tried

curl -I https://get.filebot.net/filebot/latest/

and received

HTTP/2 403
date: Mon, 14 Aug 2017 14:37:40 GMT
content-type: text/html; charset=iso-8859-1
set-cookie: __cfduid=dc5720c2bd71f8c3534e5f8cd39c6ef221502721460; expires=Tue,
4-Aug-18 14:37:40 GMT; path=/; domain=.filebot.net; HttpOnly
vary: Accept-Encoding
cf-cache-status: EXPIRED
server: cloudflare-nginx
cf-ray: 38e4a747a808232a-FRA

And bow?
User avatar
Sheldon
Posts: 188
Joined: 14 Apr 2014, 14:39

Re: GPG file in the HEAD repository

Post by Sheldon »

If I try

Code: Select all

curl  -I https://get.filebot.net/filebot/latest/FileBot.jar.xz.gpg 
I get

Code: Select all

HTTP/2 200 
date: Mon, 14 Aug 2017 15:40:26 GMT
content-type: application/x-xz
content-length: 18713363
set-cookie: __cfduid=d10ddd5d3474533c37c51e8e1c94e555d1502725225; expires=Tue, 14-Aug-18 15:40:25 GMT; path=/; domain=.filebot.net; HttpOnly
last-modified: Mon, 07 Aug 2017 15:37:50 GMT
etag: "11d8b13-5562ba1282426"
cf-cache-status: HIT
expires: Tue, 15 Aug 2017 15:40:26 GMT
cache-control: public, max-age=86400
accept-ranges: bytes
server: cloudflare-nginx
cf-ray: 38e5033579bf2732-FRA
Your script downloads the gpg id HTTP_Code ne 200.
So this is the identifier right?
Last edited by Sheldon on 14 Aug 2017, 15:48, edited 1 time in total.
User avatar
rednoah
The Source
Posts: 24644
Joined: 16 Nov 2011, 08:59
Location: Taipei
Contact:

Re: GPG file in the HEAD repository

Post by rednoah »

Does this look like a large amount of effort? :lol:

Code: Select all

curl -L -o FileBot.jar.gpg -z FileBot.jar.gpg https://get.filebot.net/filebot/latest/FileBot.jar.xz.gpg
Whenever you call this command, it'll either download the latest version, or not download the latest version if there is none.
:idea: Please read the FAQ and How to Request Help.
User avatar
Sheldon
Posts: 188
Joined: 14 Apr 2014, 14:39

Re: GPG file in the HEAD repository

Post by Sheldon »

Yes it is because your command doesn't help at all. You directly download the gpg.
I need the info if there is a new version in an automized way.

Let's get back to my command.
If I get it right a download should be omitted if HTTP code equals 200.
For my RSS feed I can fetch the last modified if HTTP code not equals 200.
is this right?

So I have to parse the reponse,and put the data in the right format.
Additionally curl has to be added to my enviroment properly.
A bunch of work for somethng I already have.
User avatar
rednoah
The Source
Posts: 24644
Joined: 16 Nov 2011, 08:59
Location: Taipei
Contact:

Re: GPG file in the HEAD repository

Post by rednoah »

1.
Get Last Modified date for FileBot.jar.gpg and save it to a variable.

2.
Use curl with -z option so it doesn't download the file if it hasn't been modified.

3.
Get Last Modified date for FileBot.jar.gpg again and compare it to the previously stored variable. Did it change? If yes, then you have a new version. If no, then nothing has changed.


Not quite sure why you're talking about RSS feeds... Whatever you're doing with scraping HTML pages, you already did it the complicated way, so doing it the easy way now won't be very difficult for you, and you should have been doing it this way all along anyway. ;)
:idea: Please read the FAQ and How to Request Help.
User avatar
Sheldon
Posts: 188
Joined: 14 Apr 2014, 14:39

Re: GPG file in the HEAD repository

Post by Sheldon »

As I mentiond above it's unnecessary effort but I will handle it.
Thanks for that and your support.
User avatar
Sheldon
Posts: 188
Joined: 14 Apr 2014, 14:39

Re: GPG file in the HEAD repository

Post by Sheldon »

My RSS feed works properly again.
Please make sure that there are no more old revision cache issues in the future.
How do we get new lib files?
User avatar
rednoah
The Source
Posts: 24644
Joined: 16 Nov 2011, 08:59
Location: Taipei
Contact:

Re: GPG file in the HEAD repository

Post by rednoah »

Do you mean the native libraries? You can get them from the original author or compile it yourself for your platform. I also maintain some binaries for common platforms in the GitHub repository.
:idea: Please read the FAQ and How to Request Help.
User avatar
Sheldon
Posts: 188
Joined: 14 Apr 2014, 14:39

Re: GPG file in the HEAD repository

Post by Sheldon »

Yes, it's about the natives. Please provide some links.
heed
Posts: 19
Joined: 23 Dec 2014, 01:17

Re: GPG file in the HEAD repository

Post by heed »

Can not decrypt 4.7.12 Filebot.jar.xz.gpg getting the following error
PS C:\Program Files (x86)\GnuPG> gpg --trusted-key 4E402EBF7C3C6A71 --output FileBot.jar.xz --decrypt FileBot.jar.xz.gpg

gpg: Signature made 08/22/17 08:34:16 Pacific Daylight Time
gpg: using RSA key B0976E51E5C047AD0FD051294E402EBF7C3C6A71
gpg: issuer "[email protected]"
gpg: Can't check signature: No public key
PS C:\Program Files (x86)\GnuPG>
PS C:\Program Files (x86)\GnuPG> gpg --trusted-key 4E402EBF7C3C6A71 --output FileBot.jar.xz --decrypt FileBot.jar.xz.gpg

File 'FileBot.jar.xz' exists. Overwrite? (y/N) y
gpg: Signature made 08/22/17 08:34:16 Pacific Daylight Time
gpg: using RSA key B0976E51E5C047AD0FD051294E402EBF7C3C6A71
gpg: issuer "[email protected]"
gpg: Can't check signature: No public key
PS C:\Program Files (x86)\GnuPG>
Am i doing something wrong?
User avatar
rednoah
The Source
Posts: 24644
Joined: 16 Nov 2011, 08:59
Location: Taipei
Contact:

Re: GPG file in the HEAD repository

Post by rednoah »

You need to import my public key first and set it as trusted.
:idea: Please read the FAQ and How to Request Help.
kim
Power User
Posts: 1251
Joined: 15 May 2014, 16:17

Re: GPG file in the HEAD repository

Post by kim »

it this and error or have you closed access to updates ?

https://get.filebot.net/filebot/latest/ ... jar.xz.gpg
Not Found

The requested URL /filebot/latest/FileBot.jar.xz.gpg was not found on this server.

Additionally, a 404 Not Found error was encountered while trying to use an ErrorDocument to handle the request.
User avatar
rednoah
The Source
Posts: 24644
Joined: 16 Nov 2011, 08:59
Location: Taipei
Contact:

Re: GPG file in the HEAD repository

Post by rednoah »

The latest jar is no longer compatible with Java 8 which is a breaking change for most users. In fact, my automated tests run on my Synology NAS which only runs Java 8, so I've removed the latest jar so it doesn't auto-update to a jar that doesn't work.

Now that I think if it, the latest jar would also make a good addition as one of the perks of the crowded funded FileBot for Linux plan:
https://www.patreon.com/filebot


EDIT:

Sorry for the capitalism here, but if anybody that uses the latest jar could pledge $1 on Patreon that would give me a good indication for how many users want to see continued support for that. :roll:
:idea: Please read the FAQ and How to Request Help.
kim
Power User
Posts: 1251
Joined: 15 May 2014, 16:17

Re: GPG file in the HEAD repository

Post by kim »

I'm sorry to see this development, but I understand why... however you can still share the file with a different URL path.

I think you are going about this "patreon" the wrong way, too "under the radar"... maybe release a new Filebot version that inform and link to https://www.patreon.com/filebot and with better info about how this works... as I read it:
"...$1,000 per release" = NO release if the goal isn't reached ?
if the goal isn't reached = users get nothing for their money ?
is the release a minor or major release ?
what if some feature stop working the next day after new release ?

maybe
"...$1,000 per release" = major release
"...$100 per release" = minor release
or
$5/10 per user = major release
$1 per user = minor release

If people do not know about this or it takes too long to reach the goal, people will move on and forget about Filebot, I think.
User avatar
rednoah
The Source
Posts: 24644
Joined: 16 Nov 2011, 08:59
Location: Taipei
Contact:

Re: GPG file in the HEAD repository

Post by rednoah »

$1k is the absolute minimum target, but more would be better. Nobody gets charged anything until I publish a release and and collect one round of pledges.

:arrow: You can use Google / YouTube to learn more about how Patreon works. Support your favorite YouTube artists and see for yourself.

It's less about making money, and more about gauging the level of interest in continued support for Linux, and if anybody asks for updates then I have Patreon page I can refer people to, instead of just turning them down.

As long as FileBot 4.7.9 is around and works mostly just fine, I don't expect there to be much interest. But the Patreon page is there now, and we'll see how it goes.
:idea: Please read the FAQ and How to Request Help.
Post Reply