How could --compression be missing from my wget?

Clash Royale CLAN TAG#URR8PPP
up vote
0
down vote
favorite
I have experience with the Windows version:
GNU Wget 1.19.4 built on mingw32.
But now on Ubuntu, I have:
GNU Wget 1.19.4, a non-interactive network retriever.
There is a relatively new option called --compression that was added in 1.19.2:
- New option --compression for gzip Content-Encoding
And in 1.19.4 release notes this is also talked about.
When running wget -h the --compression is missing on the Ubuntu version. How could I get a version that has it, or how do I enable the possibility of using it? When I try to run an actual command it just says:
wget: unrecognized option '--compression=auto'
wget gzip
add a comment |Â
up vote
0
down vote
favorite
I have experience with the Windows version:
GNU Wget 1.19.4 built on mingw32.
But now on Ubuntu, I have:
GNU Wget 1.19.4, a non-interactive network retriever.
There is a relatively new option called --compression that was added in 1.19.2:
- New option --compression for gzip Content-Encoding
And in 1.19.4 release notes this is also talked about.
When running wget -h the --compression is missing on the Ubuntu version. How could I get a version that has it, or how do I enable the possibility of using it? When I try to run an actual command it just says:
wget: unrecognized option '--compression=auto'
wget gzip
1
@steeldriver yes, and those changes were merged upstream in wget 1.19.4; but they address the runtime behaviour (--compressiondefaults tononeeven when the build supports it).
â Stephen Kitt
Aug 23 at 12:11
@StephenKitt ah thanks - got it
â steeldriver
Aug 23 at 12:13
Without this, it downloads some files - like SVG - as .svg.gz and the contents of the file is actually compressed data. The .html files still reference an .svg file iirc. Even if it referenced the .svg.gz file it wouldn't work, at least not when browsing offline, locally.
â Firsh - letsWP.io
Aug 23 at 12:43
add a comment |Â
up vote
0
down vote
favorite
up vote
0
down vote
favorite
I have experience with the Windows version:
GNU Wget 1.19.4 built on mingw32.
But now on Ubuntu, I have:
GNU Wget 1.19.4, a non-interactive network retriever.
There is a relatively new option called --compression that was added in 1.19.2:
- New option --compression for gzip Content-Encoding
And in 1.19.4 release notes this is also talked about.
When running wget -h the --compression is missing on the Ubuntu version. How could I get a version that has it, or how do I enable the possibility of using it? When I try to run an actual command it just says:
wget: unrecognized option '--compression=auto'
wget gzip
I have experience with the Windows version:
GNU Wget 1.19.4 built on mingw32.
But now on Ubuntu, I have:
GNU Wget 1.19.4, a non-interactive network retriever.
There is a relatively new option called --compression that was added in 1.19.2:
- New option --compression for gzip Content-Encoding
And in 1.19.4 release notes this is also talked about.
When running wget -h the --compression is missing on the Ubuntu version. How could I get a version that has it, or how do I enable the possibility of using it? When I try to run an actual command it just says:
wget: unrecognized option '--compression=auto'
wget gzip
wget gzip
asked Aug 23 at 11:37
Firsh - letsWP.io
1104
1104
1
@steeldriver yes, and those changes were merged upstream in wget 1.19.4; but they address the runtime behaviour (--compressiondefaults tononeeven when the build supports it).
â Stephen Kitt
Aug 23 at 12:11
@StephenKitt ah thanks - got it
â steeldriver
Aug 23 at 12:13
Without this, it downloads some files - like SVG - as .svg.gz and the contents of the file is actually compressed data. The .html files still reference an .svg file iirc. Even if it referenced the .svg.gz file it wouldn't work, at least not when browsing offline, locally.
â Firsh - letsWP.io
Aug 23 at 12:43
add a comment |Â
1
@steeldriver yes, and those changes were merged upstream in wget 1.19.4; but they address the runtime behaviour (--compressiondefaults tononeeven when the build supports it).
â Stephen Kitt
Aug 23 at 12:11
@StephenKitt ah thanks - got it
â steeldriver
Aug 23 at 12:13
Without this, it downloads some files - like SVG - as .svg.gz and the contents of the file is actually compressed data. The .html files still reference an .svg file iirc. Even if it referenced the .svg.gz file it wouldn't work, at least not when browsing offline, locally.
â Firsh - letsWP.io
Aug 23 at 12:43
1
1
@steeldriver yes, and those changes were merged upstream in wget 1.19.4; but they address the runtime behaviour (
--compression defaults to none even when the build supports it).â Stephen Kitt
Aug 23 at 12:11
@steeldriver yes, and those changes were merged upstream in wget 1.19.4; but they address the runtime behaviour (
--compression defaults to none even when the build supports it).â Stephen Kitt
Aug 23 at 12:11
@StephenKitt ah thanks - got it
â steeldriver
Aug 23 at 12:13
@StephenKitt ah thanks - got it
â steeldriver
Aug 23 at 12:13
Without this, it downloads some files - like SVG - as .svg.gz and the contents of the file is actually compressed data. The .html files still reference an .svg file iirc. Even if it referenced the .svg.gz file it wouldn't work, at least not when browsing offline, locally.
â Firsh - letsWP.io
Aug 23 at 12:43
Without this, it downloads some files - like SVG - as .svg.gz and the contents of the file is actually compressed data. The .html files still reference an .svg file iirc. Even if it referenced the .svg.gz file it wouldn't work, at least not when browsing offline, locally.
â Firsh - letsWP.io
Aug 23 at 12:43
add a comment |Â
1 Answer
1
active
oldest
votes
up vote
3
down vote
accepted
--compression is only available if wget is built with zlib (a library used for compression and decompression). The wget package in Debian doesnâÂÂt explicitly build-depend on that library, it gets it indirectly, via another library, the GNU TLS library; the Ubuntu build drops the latter, and ends up losing support for compression as a result.
You can see this in the build logs:
checking for ZLIB... no
checking for compress in -lz... no
Rebuilding the package to enable --compression can be done as follows:
cd /tmp
apt source wget
cd wget-1.19.4
apt build-dep wget
apt install zlib1g-dev
dch -n "Rebuild with compression support."
dpkg-buildpackage -us -uc
This will produce a package in /tmp, which you can then install with dpkg -i. You might need to adjust the cd step above, depending on the version of wget your repositories contain. You might also need to add deb-src lines in /etc/apt/sources.list, matching your deb lines, to be able to download the source code using apt source.
Note that enabling compression by default (--compression=auto) can have surprising consequences, which is why the release notes mention that
As it turns out, implementing gzip support is not trivial; especially in the
face of many buggy servers that we have to support. Hence, for the time being,
connection compression support has been marked as experimental and disabled by
default.
See Debian bug 887910 for an example (thanks to steeldriver for mentioning it). IâÂÂve filed Debian bug 907047 and Ubuntu bug 1788608 asking for a fix, if the maintainer agrees youâÂÂll see the Ubuntu package acquire support for --compression once the fix is implemented (and migrates to Ubuntu, if the Debian package is fixed first).
Sorry, I'm a newbie but is it possible to (re)build it with zlib?
â Firsh - letsWP.io
Aug 23 at 12:00
No need to apologise, we were all newbies at some stage ;-). It should be possible, IâÂÂll check and update my answer.
â Stephen Kitt
Aug 23 at 12:01
It worked, yay!
â Firsh - letsWP.io
Aug 23 at 20:43
add a comment |Â
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
up vote
3
down vote
accepted
--compression is only available if wget is built with zlib (a library used for compression and decompression). The wget package in Debian doesnâÂÂt explicitly build-depend on that library, it gets it indirectly, via another library, the GNU TLS library; the Ubuntu build drops the latter, and ends up losing support for compression as a result.
You can see this in the build logs:
checking for ZLIB... no
checking for compress in -lz... no
Rebuilding the package to enable --compression can be done as follows:
cd /tmp
apt source wget
cd wget-1.19.4
apt build-dep wget
apt install zlib1g-dev
dch -n "Rebuild with compression support."
dpkg-buildpackage -us -uc
This will produce a package in /tmp, which you can then install with dpkg -i. You might need to adjust the cd step above, depending on the version of wget your repositories contain. You might also need to add deb-src lines in /etc/apt/sources.list, matching your deb lines, to be able to download the source code using apt source.
Note that enabling compression by default (--compression=auto) can have surprising consequences, which is why the release notes mention that
As it turns out, implementing gzip support is not trivial; especially in the
face of many buggy servers that we have to support. Hence, for the time being,
connection compression support has been marked as experimental and disabled by
default.
See Debian bug 887910 for an example (thanks to steeldriver for mentioning it). IâÂÂve filed Debian bug 907047 and Ubuntu bug 1788608 asking for a fix, if the maintainer agrees youâÂÂll see the Ubuntu package acquire support for --compression once the fix is implemented (and migrates to Ubuntu, if the Debian package is fixed first).
Sorry, I'm a newbie but is it possible to (re)build it with zlib?
â Firsh - letsWP.io
Aug 23 at 12:00
No need to apologise, we were all newbies at some stage ;-). It should be possible, IâÂÂll check and update my answer.
â Stephen Kitt
Aug 23 at 12:01
It worked, yay!
â Firsh - letsWP.io
Aug 23 at 20:43
add a comment |Â
up vote
3
down vote
accepted
--compression is only available if wget is built with zlib (a library used for compression and decompression). The wget package in Debian doesnâÂÂt explicitly build-depend on that library, it gets it indirectly, via another library, the GNU TLS library; the Ubuntu build drops the latter, and ends up losing support for compression as a result.
You can see this in the build logs:
checking for ZLIB... no
checking for compress in -lz... no
Rebuilding the package to enable --compression can be done as follows:
cd /tmp
apt source wget
cd wget-1.19.4
apt build-dep wget
apt install zlib1g-dev
dch -n "Rebuild with compression support."
dpkg-buildpackage -us -uc
This will produce a package in /tmp, which you can then install with dpkg -i. You might need to adjust the cd step above, depending on the version of wget your repositories contain. You might also need to add deb-src lines in /etc/apt/sources.list, matching your deb lines, to be able to download the source code using apt source.
Note that enabling compression by default (--compression=auto) can have surprising consequences, which is why the release notes mention that
As it turns out, implementing gzip support is not trivial; especially in the
face of many buggy servers that we have to support. Hence, for the time being,
connection compression support has been marked as experimental and disabled by
default.
See Debian bug 887910 for an example (thanks to steeldriver for mentioning it). IâÂÂve filed Debian bug 907047 and Ubuntu bug 1788608 asking for a fix, if the maintainer agrees youâÂÂll see the Ubuntu package acquire support for --compression once the fix is implemented (and migrates to Ubuntu, if the Debian package is fixed first).
Sorry, I'm a newbie but is it possible to (re)build it with zlib?
â Firsh - letsWP.io
Aug 23 at 12:00
No need to apologise, we were all newbies at some stage ;-). It should be possible, IâÂÂll check and update my answer.
â Stephen Kitt
Aug 23 at 12:01
It worked, yay!
â Firsh - letsWP.io
Aug 23 at 20:43
add a comment |Â
up vote
3
down vote
accepted
up vote
3
down vote
accepted
--compression is only available if wget is built with zlib (a library used for compression and decompression). The wget package in Debian doesnâÂÂt explicitly build-depend on that library, it gets it indirectly, via another library, the GNU TLS library; the Ubuntu build drops the latter, and ends up losing support for compression as a result.
You can see this in the build logs:
checking for ZLIB... no
checking for compress in -lz... no
Rebuilding the package to enable --compression can be done as follows:
cd /tmp
apt source wget
cd wget-1.19.4
apt build-dep wget
apt install zlib1g-dev
dch -n "Rebuild with compression support."
dpkg-buildpackage -us -uc
This will produce a package in /tmp, which you can then install with dpkg -i. You might need to adjust the cd step above, depending on the version of wget your repositories contain. You might also need to add deb-src lines in /etc/apt/sources.list, matching your deb lines, to be able to download the source code using apt source.
Note that enabling compression by default (--compression=auto) can have surprising consequences, which is why the release notes mention that
As it turns out, implementing gzip support is not trivial; especially in the
face of many buggy servers that we have to support. Hence, for the time being,
connection compression support has been marked as experimental and disabled by
default.
See Debian bug 887910 for an example (thanks to steeldriver for mentioning it). IâÂÂve filed Debian bug 907047 and Ubuntu bug 1788608 asking for a fix, if the maintainer agrees youâÂÂll see the Ubuntu package acquire support for --compression once the fix is implemented (and migrates to Ubuntu, if the Debian package is fixed first).
--compression is only available if wget is built with zlib (a library used for compression and decompression). The wget package in Debian doesnâÂÂt explicitly build-depend on that library, it gets it indirectly, via another library, the GNU TLS library; the Ubuntu build drops the latter, and ends up losing support for compression as a result.
You can see this in the build logs:
checking for ZLIB... no
checking for compress in -lz... no
Rebuilding the package to enable --compression can be done as follows:
cd /tmp
apt source wget
cd wget-1.19.4
apt build-dep wget
apt install zlib1g-dev
dch -n "Rebuild with compression support."
dpkg-buildpackage -us -uc
This will produce a package in /tmp, which you can then install with dpkg -i. You might need to adjust the cd step above, depending on the version of wget your repositories contain. You might also need to add deb-src lines in /etc/apt/sources.list, matching your deb lines, to be able to download the source code using apt source.
Note that enabling compression by default (--compression=auto) can have surprising consequences, which is why the release notes mention that
As it turns out, implementing gzip support is not trivial; especially in the
face of many buggy servers that we have to support. Hence, for the time being,
connection compression support has been marked as experimental and disabled by
default.
See Debian bug 887910 for an example (thanks to steeldriver for mentioning it). IâÂÂve filed Debian bug 907047 and Ubuntu bug 1788608 asking for a fix, if the maintainer agrees youâÂÂll see the Ubuntu package acquire support for --compression once the fix is implemented (and migrates to Ubuntu, if the Debian package is fixed first).
edited Aug 23 at 12:39
answered Aug 23 at 11:59
Stephen Kitt
146k22320386
146k22320386
Sorry, I'm a newbie but is it possible to (re)build it with zlib?
â Firsh - letsWP.io
Aug 23 at 12:00
No need to apologise, we were all newbies at some stage ;-). It should be possible, IâÂÂll check and update my answer.
â Stephen Kitt
Aug 23 at 12:01
It worked, yay!
â Firsh - letsWP.io
Aug 23 at 20:43
add a comment |Â
Sorry, I'm a newbie but is it possible to (re)build it with zlib?
â Firsh - letsWP.io
Aug 23 at 12:00
No need to apologise, we were all newbies at some stage ;-). It should be possible, IâÂÂll check and update my answer.
â Stephen Kitt
Aug 23 at 12:01
It worked, yay!
â Firsh - letsWP.io
Aug 23 at 20:43
Sorry, I'm a newbie but is it possible to (re)build it with zlib?
â Firsh - letsWP.io
Aug 23 at 12:00
Sorry, I'm a newbie but is it possible to (re)build it with zlib?
â Firsh - letsWP.io
Aug 23 at 12:00
No need to apologise, we were all newbies at some stage ;-). It should be possible, IâÂÂll check and update my answer.
â Stephen Kitt
Aug 23 at 12:01
No need to apologise, we were all newbies at some stage ;-). It should be possible, IâÂÂll check and update my answer.
â Stephen Kitt
Aug 23 at 12:01
It worked, yay!
â Firsh - letsWP.io
Aug 23 at 20:43
It worked, yay!
â Firsh - letsWP.io
Aug 23 at 20:43
add a comment |Â
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2funix.stackexchange.com%2fquestions%2f464372%2fhow-could-compression-be-missing-from-my-wget%23new-answer', 'question_page');
);
Post as a guest
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
1
@steeldriver yes, and those changes were merged upstream in wget 1.19.4; but they address the runtime behaviour (
--compressiondefaults tononeeven when the build supports it).â Stephen Kitt
Aug 23 at 12:11
@StephenKitt ah thanks - got it
â steeldriver
Aug 23 at 12:13
Without this, it downloads some files - like SVG - as .svg.gz and the contents of the file is actually compressed data. The .html files still reference an .svg file iirc. Even if it referenced the .svg.gz file it wouldn't work, at least not when browsing offline, locally.
â Firsh - letsWP.io
Aug 23 at 12:43