(SOLVED) Problem with Certbot or Python on Raspbian

[Cuervo]

Hello, I am doing tests with Raspbian Raspberry Pi 4 4GB following a tutorial and I need to install Certbot with the following command:

Code: Select all

wget https://dl.eff.org/certbot-auto
sudo mv certbot-auto /usr/local/bin/certbot-auto
sudo chown root /usr/local/bin/certbot-auto
sudo chmod 0755 /usr/local/bin/certbot-auto
/usr/local/bin/certbot-auto --install-only

They seem like problems with Python, but honestly I don't know what I need to solve it, there isn't much information related to this.

Thank you

But I am getting the following problem:

root@mail:~# /usr/local/bin/certbot-auto --install-only
Bootstrapping dependencies for Debian-based OSes... (you can skip this with --no-bootstrap)
Hit:1 http://archive.raspberrypi.org/debian buster InRelease
Hit:2 http://raspbian.raspberrypi.org/raspbian buster InRelease
Reading package lists... Done
Reading package lists... Done
Building dependency tree
Reading state information... Done
ca-certificates is already the newest version (20190110).
gcc is already the newest version (4:8.3.0-1+rpi2).
gcc set to manually installed.
python is already the newest version (2.7.16-1).
openssl is already the newest version (1.1.1d-0+deb10u2+rpt1).
The following additional packages will be installed:
libexpat1-dev libpython-dev libpython2-dev libpython2.7-dev python-pip-whl
python-pkg-resources python2-dev python2.7-dev python3-distutils python3-lib2to3
python3-virtualenv
Suggested packages:
augeas-doc augeas-tools libssl-doc python-setuptools
The following NEW packages will be installed:
augeas-lenses libaugeas0 libexpat1-dev libffi-dev libpython-dev libpython2-dev
libpython2.7-dev libssl-dev python-dev python-pip-whl python-pkg-resources
python-virtualenv python2-dev python2.7-dev python3-distutils python3-lib2to3
python3-virtualenv virtualenv
0 upgraded, 18 newly installed, 0 to remove and 0 not upgraded.
Need to get 543 kB/35.9 MB of archives.
After this operation, 60.5 MB of additional disk space will be used.
Do you want to continue? [Y/n] y
Get:1 http://raspbian.raspberrypi.org/raspbian buster/main armhf python2-dev armhf 2.7.16-1 [1,216 B]
Get:2 http://raspbian.raspberrypi.org/raspbian buster/main armhf python-dev armhf 2.7.16-1 [1,192 B]
Get:3 http://mirrors.switch.ca/raspbian/raspbian buster/main armhf python-pkg-resources all 40.8.0-1 [182 kB]
Get:4 http://raspbian.freemirror.org/raspbian buster/main armhf python-virtualenv all 15.1.0+ds-2 [61.5 kB]
Get:5 http://mirrors.switch.ca/raspbian/raspbian buster/main armhf python3-lib2to3 all 3.7.3-1 [76.7 kB]
Get:6 http://mirrors.switch.ca/raspbian/raspbian buster/main armhf python3-distutils all 3.7.3-1 [142 kB]
Get:7 http://raspbian.freemirror.org/raspbian buster/main armhf python3-virtualenv all 15.1.0+ds-2 [58.1 kB]
Get:8 http://raspbian.freemirror.org/raspbian buster/main armhf virtualenv all 15.1.0+ds-2 [20.1 kB]
Fetched 543 kB in 4s (135 kB/s)
Selecting previously unselected package augeas-lenses.
(Reading database ... 53996 files and directories currently installed.)
Preparing to unpack .../00-augeas-lenses_1.11.0-3_all.deb ...
Unpacking augeas-lenses (1.11.0-3) ...
Selecting previously unselected package libaugeas0:armhf.
Preparing to unpack .../01-libaugeas0_1.11.0-3_armhf.deb ...
Unpacking libaugeas0:armhf (1.11.0-3) ...
Selecting previously unselected package libexpat1-dev:armhf.
Preparing to unpack .../02-libexpat1-dev_2.2.6-2+deb10u1_armhf.deb ...
Unpacking libexpat1-dev:armhf (2.2.6-2+deb10u1) ...
Selecting previously unselected package libffi-dev:armhf.
Preparing to unpack .../03-libffi-dev_3.2.1-9_armhf.deb ...
Unpacking libffi-dev:armhf (3.2.1-9) ...
Selecting previously unselected package libpython2.7-dev:armhf.
Preparing to unpack .../04-libpython2.7-dev_2.7.16-2+deb10u1_armhf.deb ...
Unpacking libpython2.7-dev:armhf (2.7.16-2+deb10u1) ...
Selecting previously unselected package libpython2-dev:armhf.
Preparing to unpack .../05-libpython2-dev_2.7.16-1_armhf.deb ...
Unpacking libpython2-dev:armhf (2.7.16-1) ...
Selecting previously unselected package libpython-dev:armhf.
Preparing to unpack .../06-libpython-dev_2.7.16-1_armhf.deb ...
Unpacking libpython-dev:armhf (2.7.16-1) ...
Selecting previously unselected package libssl-dev:armhf.
Preparing to unpack .../07-libssl-dev_1.1.1d-0+deb10u2+rpt1_armhf.deb ...
Unpacking libssl-dev:armhf (1.1.1d-0+deb10u2+rpt1) ...
Selecting previously unselected package python2.7-dev.
Preparing to unpack .../08-python2.7-dev_2.7.16-2+deb10u1_armhf.deb ...
Unpacking python2.7-dev (2.7.16-2+deb10u1) ...
Selecting previously unselected package python2-dev.
Preparing to unpack .../09-python2-dev_2.7.16-1_armhf.deb ...
Unpacking python2-dev (2.7.16-1) ...
Selecting previously unselected package python-dev.
Preparing to unpack .../10-python-dev_2.7.16-1_armhf.deb ...
Unpacking python-dev (2.7.16-1) ...
Selecting previously unselected package python-pip-whl.
Preparing to unpack .../11-python-pip-whl_18.1-5+rpt1_all.deb ...
Unpacking python-pip-whl (18.1-5+rpt1) ...
Selecting previously unselected package python-pkg-resources.
Preparing to unpack .../12-python-pkg-resources_40.8.0-1_all.deb ...
Unpacking python-pkg-resources (40.8.0-1) ...
Selecting previously unselected package python-virtualenv.
Preparing to unpack .../13-python-virtualenv_15.1.0+ds-2_all.deb ...
Unpacking python-virtualenv (15.1.0+ds-2) ...
Selecting previously unselected package python3-lib2to3.
Preparing to unpack .../14-python3-lib2to3_3.7.3-1_all.deb ...
Unpacking python3-lib2to3 (3.7.3-1) ...
Selecting previously unselected package python3-distutils.
Preparing to unpack .../15-python3-distutils_3.7.3-1_all.deb ...
Unpacking python3-distutils (3.7.3-1) ...
Selecting previously unselected package python3-virtualenv.
Preparing to unpack .../16-python3-virtualenv_15.1.0+ds-2_all.deb ...
Unpacking python3-virtualenv (15.1.0+ds-2) ...
Selecting previously unselected package virtualenv.
Preparing to unpack .../17-virtualenv_15.1.0+ds-2_all.deb ...
Unpacking virtualenv (15.1.0+ds-2) ...
Setting up augeas-lenses (1.11.0-3) ...
Setting up python-pkg-resources (40.8.0-1) ...
Setting up libffi-dev:armhf (3.2.1-9) ...
Setting up libexpat1-dev:armhf (2.2.6-2+deb10u1) ...
Setting up libaugeas0:armhf (1.11.0-3) ...
Setting up libssl-dev:armhf (1.1.1d-0+deb10u2+rpt1) ...
Setting up python-pip-whl (18.1-5+rpt1) ...
Setting up python3-lib2to3 (3.7.3-1) ...
Setting up python-virtualenv (15.1.0+ds-2) ...
Setting up python3-distutils (3.7.3-1) ...
Setting up libpython2.7-dev:armhf (2.7.16-2+deb10u1) ...
Setting up python3-virtualenv (15.1.0+ds-2) ...
Setting up virtualenv (15.1.0+ds-2) ...
Setting up libpython2-dev:armhf (2.7.16-1) ...
Setting up python2.7-dev (2.7.16-2+deb10u1) ...
Setting up python2-dev (2.7.16-1) ...
Setting up libpython-dev:armhf (2.7.16-1) ...
Setting up python-dev (2.7.16-1) ...
Processing triggers for man-db (2.8.5-2) ...
Processing triggers for install-info (6.5.0.dfsg.1-4+b1) ...
Processing triggers for libc-bin (2.28-10+rpi1) ...
Creating virtual environment...
Installing Python packages...
Had a problem while installing Python packages.

pip prints the following errors:
=====================================================
Collecting ConfigArgParse==1.0 (from -r /tmp/tmp.mD75mHpS3S/letsencrypt-auto-requirements.txt (line 12))
Downloading https://files.pythonhosted.org/packages ... 1.0.tar.gz (40kB)
Collecting certifi==2019.11.28 (from -r /tmp/tmp.mD75mHpS3S/letsencrypt-auto-requirements.txt (line 14))
Downloading https://files.pythonhosted.org/packages ... ne-any.whl (156kB)
Collecting cffi==1.13.2 (from -r /tmp/tmp.mD75mHpS3S/letsencrypt-auto-requirements.txt (line 17))
Downloading https://files.pythonhosted.org/packages ... 3.2.tar.gz (460kB)
Collecting chardet==3.0.4 (from -r /tmp/tmp.mD75mHpS3S/letsencrypt-auto-requirements.txt (line 51))
Downloading https://files.pythonhosted.org/packages ... ne-any.whl (133kB)
Collecting configobj==5.0.6 (from -r /tmp/tmp.mD75mHpS3S/letsencrypt-auto-requirements.txt (line 54))
Downloading https://files.pythonhosted.org/packages ... 0.6.tar.gz
Collecting cryptography==2.8 (from -r /tmp/tmp.mD75mHpS3S/letsencrypt-auto-requirements.txt (line 56))
Downloading https://files.pythonhosted.org/packages ... 2.8.tar.gz (504kB)
Collecting distro==1.4.0 (from -r /tmp/tmp.mD75mHpS3S/letsencrypt-auto-requirements.txt (line 78))
Retrying (Retry(total=4, connect=None, read=None, redirect=None)) after connection broken by 'ProtocolError('Connection aborted.', BadStatusLine('No status line received - the server has closed the connection',))': /simple/distro/
Downloading https://files.pythonhosted.org/packages ... ne-any.whl
Collecting enum34==1.1.6 (from -r /tmp/tmp.mD75mHpS3S/letsencrypt-auto-requirements.txt (line 81))
Downloading https://files.pythonhosted.org/packages ... ne-any.whl
Collecting funcsigs==1.0.2 (from -r /tmp/tmp.mD75mHpS3S/letsencrypt-auto-requirements.txt (line 86))
Downloading https://files.pythonhosted.org/packages ... ne-any.whl
Collecting idna==2.8 (from -r /tmp/tmp.mD75mHpS3S/letsencrypt-auto-requirements.txt (line 89))
Downloading https://files.pythonhosted.org/packages ... ne-any.whl (58kB)
Collecting ipaddress==1.0.23 (from -r /tmp/tmp.mD75mHpS3S/letsencrypt-auto-requirements.txt (line 92))
Downloading https://files.pythonhosted.org/packages ... ne-any.whl
Collecting josepy==1.2.0 (from -r /tmp/tmp.mD75mHpS3S/letsencrypt-auto-requirements.txt (line 95))
Downloading https://files.pythonhosted.org/packages ... ne-any.whl (57kB)
Collecting mock==1.3.0 (from -r /tmp/tmp.mD75mHpS3S/letsencrypt-auto-requirements.txt (line 98))
Downloading https://files.pythonhosted.org/packages ... ne-any.whl (56kB)
Collecting parsedatetime==2.5 (from -r /tmp/tmp.mD75mHpS3S/letsencrypt-auto-requirements.txt (line 101))
Downloading https://files.pythonhosted.org/packages ... ne-any.whl (40kB)
Collecting pbr==5.4.4 (from -r /tmp/tmp.mD75mHpS3S/letsencrypt-auto-requirements.txt (line 104))
Downloading https://files.pythonhosted.org/packages ... ne-any.whl (110kB)
Collecting pyOpenSSL==19.1.0 (from -r /tmp/tmp.mD75mHpS3S/letsencrypt-auto-requirements.txt (line 107))
Downloading https://files.pythonhosted.org/packages ... ne-any.whl (53kB)
Collecting pyRFC3339==1.1 (from -r /tmp/tmp.mD75mHpS3S/letsencrypt-auto-requirements.txt (line 110))
Downloading https://files.pythonhosted.org/packages ... ne-any.whl
Collecting pycparser==2.19 (from -r /tmp/tmp.mD75mHpS3S/letsencrypt-auto-requirements.txt (line 113))
Downloading https://www.piwheels.org/simple/pycpars ... ne-any.whl (111kB)
Collecting pyparsing==2.4.6 (from -r /tmp/tmp.mD75mHpS3S/letsencrypt-auto-requirements.txt (line 115))
Downloading https://files.pythonhosted.org/packages ... ne-any.whl (67kB)
Collecting python-augeas==0.5.0 (from -r /tmp/tmp.mD75mHpS3S/letsencrypt-auto-requirements.txt (line 118))
Downloading https://files.pythonhosted.org/packages ... 5.0.tar.gz (90kB)
Collecting pytz==2019.3 (from -r /tmp/tmp.mD75mHpS3S/letsencrypt-auto-requirements.txt (line 120))
Downloading https://files.pythonhosted.org/packages ... ne-any.whl (509kB)
Collecting requests==2.22.0 (from -r /tmp/tmp.mD75mHpS3S/letsencrypt-auto-requirements.txt (line 123))
Downloading https://files.pythonhosted.org/packages ... ne-any.whl (57kB)
Collecting requests-toolbelt==0.9.1 (from -r /tmp/tmp.mD75mHpS3S/letsencrypt-auto-requirements.txt (line 126))
Downloading https://files.pythonhosted.org/packages ... ne-any.whl (54kB)
Collecting six==1.14.0 (from -r /tmp/tmp.mD75mHpS3S/letsencrypt-auto-requirements.txt (line 129))
Downloading https://files.pythonhosted.org/packages ... ne-any.whl
Collecting urllib3==1.25.8 (from -r /tmp/tmp.mD75mHpS3S/letsencrypt-auto-requirements.txt (line 132))
Downloading https://files.pythonhosted.org/packages ... ne-any.whl (125kB)
Collecting zope.component==4.6 (from -r /tmp/tmp.mD75mHpS3S/letsencrypt-auto-requirements.txt (line 135))
Downloading https://www.piwheels.org/simple/zope-co ... ne-any.whl (70kB)
Collecting zope.deferredimport==4.3.1 (from -r /tmp/tmp.mD75mHpS3S/letsencrypt-auto-requirements.txt (line 137))
Downloading https://files.pythonhosted.org/packages ... ne-any.whl
Collecting zope.deprecation==4.4.0 (from -r /tmp/tmp.mD75mHpS3S/letsencrypt-auto-requirements.txt (line 140))
Downloading https://files.pythonhosted.org/packages ... ne-any.whl
Collecting zope.event==4.4 (from -r /tmp/tmp.mD75mHpS3S/letsencrypt-auto-requirements.txt (line 143))
Downloading https://files.pythonhosted.org/packages ... ne-any.whl
Collecting zope.hookable==5.0.0 (from -r /tmp/tmp.mD75mHpS3S/letsencrypt-auto-requirements.txt (line 146))
Downloading https://files.pythonhosted.org/packages ... 0.0.tar.gz
Collecting zope.interface==4.7.1 (from -r /tmp/tmp.mD75mHpS3S/letsencrypt-auto-requirements.txt (line 186))
Retrying (Retry(total=4, connect=None, read=None, redirect=None)) after connection broken by 'ProtocolError('Connection aborted.', BadStatusLine('No status line received - the server has closed the connection',))': /simple/zope-interface/
Downloading https://files.pythonhosted.org/packages ... 7.1.tar.gz (151kB)
Collecting zope.proxy==4.3.3 (from -r /tmp/tmp.mD75mHpS3S/letsencrypt-auto-requirements.txt (line 226))
Retrying (Retry(total=4, connect=None, read=None, redirect=None)) after connection broken by 'ProtocolError('Connection aborted.', BadStatusLine('No status line received - the server has closed the connection',))': /simple/zope-proxy/
Downloading https://files.pythonhosted.org/packages ... 3.3.tar.gz (44kB)
Collecting letsencrypt==0.7.0 (from -r /tmp/tmp.mD75mHpS3S/letsencrypt-auto-requirements.txt (line 274))
Downloading https://files.pythonhosted.org/packages ... ne-any.whl
Collecting certbot==1.3.0 (from -r /tmp/tmp.mD75mHpS3S/letsencrypt-auto-requirements.txt (line 278))
Downloading https://files.pythonhosted.org/packages ... ne-any.whl (231kB)
Collecting acme==1.3.0 (from -r /tmp/tmp.mD75mHpS3S/letsencrypt-auto-requirements.txt (line 281))
Downloading https://files.pythonhosted.org/packages ... ne-any.whl
Collecting certbot-apache==1.3.0 (from -r /tmp/tmp.mD75mHpS3S/letsencrypt-auto-requirements.txt (line 284))
Downloading https://files.pythonhosted.org/packages ... ne-any.whl (86kB)
Collecting certbot-nginx==1.3.0 (from -r /tmp/tmp.mD75mHpS3S/letsencrypt-auto-requirements.txt (line 287))
Downloading https://files.pythonhosted.org/packages ... ne-any.whl (45kB)
Requirement already satisfied: setuptools>=1.0 in /opt/eff.org/certbot/venv/lib/python2.7/site-packages (from josepy==1.2.0->-r /tmp/tmp.mD75mHpS3S/letsencrypt-auto-requirements.txt (line 95))
THESE PACKAGES DO NOT MATCH THE HASHES FROM THE REQUIREMENTS FILE. If you have updated the package versions, please update the hashes. Otherwise, examine the package contents carefully; someone may have tampered with them.
pycparser==2.19 from https://www.piwheels.org/simple/pycpars ... f56ff9cab6 (from -r /tmp/tmp.mD75mHpS3S/letsencrypt-auto-requirements.txt (line 113)):
Expected sha256 a988718abfad80b6b157acce7bf130a30876d27603738ac39f140993246b25b3
Got bc15573b7c6edd24407526dbbc7a0bd33d80d8af44231c37f58d73f56ff9cab6

zope.component==4.6 from https://www.piwheels.org/simple/zope-co ... af46f6f6a5 (from -r /tmp/tmp.mD75mHpS3S/letsencrypt-auto-requirements.txt (line 135)):
Expected sha256 ec2afc5bbe611dcace98bb39822c122d44743d635dafc7315b9aef25097db9e6
Got 74f55521dec189c08d98341edce929eba6bb2404662d1878f1b289af46f6f6a5
=====================================================

Certbot has problem setting up the virtual environment.

We were not be able to guess the right solution from your pip
output.

Consult https://certbot.eff.org/docs/install.ht ... nvironment
for possible solutions.
You may also find some support resources at https://certbot.eff.org/support/ .
root@mail:~#

[DougieLawson]

Make this change to the certbot-auto script

Before

Code: Select all

pycparser==2.19 \
    --hash=sha256:a988718abfad80b6b157acce7bf130a30876d27603738ac39f140993246b25b3

After

Code: Select all

pycparser==2.19 \
    --hash=sha256:a988718abfad80b6b157acce7bf130a30876d27603738ac39f140993246b25b3 \
    --hash=sha256:bc15573b7c6edd24407526dbbc7a0bd33d80d8af44231c37f58d73f56ff9cab6

Edit: there's another change needed

Before

Code: Select all

zope.component==4.6 \
    --hash=sha256:ec2afc5bbe611dcace98bb39822c122d44743d635dafc7315b9aef25097db9e6

After

Code: Select all

zope.component==4.6 \
    --hash=sha256:ec2afc5bbe611dcace98bb39822c122d44743d635dafc7315b9aef25097db9e6 \
    --hash=sha256:74f55521dec189c08d98341edce929eba6bb2404662d1878f1b289af46f6f6a5

[nigelbartlett1]

Don't follow out of date tutorials! To install Certbot:

Code: Select all

sudo apt -y install certbot

[DougieLawson]

Don't follow out of date tutorials! To install Certbot:

Code: Select all

sudo apt -y install certbot

And get an old version of the script that will self-update and break in just the way described above.

[nigelbartlett1]

@DougieLawson: "And get an old version of the script that will self-update and break in just the way described above." Well, no. I just tried it on a fully patched Raspbian Buster install and it worked properly.

Code: Select all

nigelb@rlcvps:~$ sudo apt -y install certbot
Reading package lists... Done
Building dependency tree
Reading state information... Done
Suggested packages:
  python3-certbot-apache python3-certbot-nginx python-certbot-doc
The following NEW packages will be installed:
  certbot
0 upgraded, 1 newly installed, 0 to remove and 0 not upgraded.
Need to get 0 B/38.5 kB of archives.
After this operation, 69.6 kB of additional disk space will be used.
Selecting previously unselected package certbot.
(Reading database ... 99829 files and directories currently installed.)
Preparing to unpack .../certbot_0.31.0-1_all.deb ...
Unpacking certbot (0.31.0-1) ...
Setting up certbot (0.31.0-1) ...
Processing triggers for man-db (2.8.5-2) ...

[DougieLawson]

Has it self-updated?

The latest version at https://github.com/certbot/certbot/blob ... rtbot-auto has the wrong sha256 sums.

I'm not too bothered as I run it with the --no-self-upgrade flag and only bother updating it when there's a thread on here so I can publish the changes needed to fix it.

[nigelbartlett1]

Dougie, I don't think that the Raspbian install procedure uses that script. Allowing an install script to get the latest version of any package just isn't the Debian way. The level installed on Buster is 0.31.0-1 whereas the latest Certbot version seems to be 1.3.0.

Just to be sure I tried a Raspbian full-upgrade after installing Certbot and it reported that there was nothing to update.

[DougieLawson]

Just to be sure I tried a Raspbian full-upgrade after installing Certbot and it reported that there was nothing to update.

That's typical of the very conservative Debian way.

[Cuervo]

Thanks for the help

I just had to install:

Code: Select all

sudo apt install python-certbot-apache

But the main mistake was not the installation, I made the mistake of not opening port 80 on the router and so I was not creating the certificates.

Cheers