RPi 3B+ gigabit ethernet bad download speeds.

[RPIgoodSBC]

More screenshots...

2018-07-19-dsl-reports-test-quality.png (199.49 KiB) Viewed 5730 times

2018-07-19-RPI3B-plus-overclocked-ram-550-and-gpu-450.png (229.63 KiB) Viewed 5730 times

[tfontaine]

I found the following settings help transfer speeds for the Ethernet port
Run as root

Code: Select all

sysctl -w net.core.rmem_max=8388608
sysctl -w net.core.wmem_max=8388608
sysctl -w net.core.rmem_default=65536
sysctl -w net.core.wmem_default=65536
sysctl -w net.ipv4.tcp_rmem='4096 87380 8388608'
sysctl -w net.ipv4.tcp_wmem='4096 65536 8388608'
sysctl -w net.ipv4.tcp_mem='8388608 8388608 8388608'
sysctl -w net.ipv4.route.flush=1

If I change this value, it looks like it worked, but checking afterwards, does not seem to have changed it.

Code: Select all

pi@p1mon:/$ sudo sysctl -w net.core.wmem_default=65536
net.core.wmem_default = 65536
pi@p1mon:/$ sudo sysctl -a | grep core.rmem
net.core.rmem_default = 163840

I was very enthusiastic and hoping this would fix it, but forgot to check what the default values were...
The speedtest did not change anything for me.

I also have 200 Mbit down / 20 up, but never get these figures from the download.
Only if I connect the Pi to my Ziggo (provider) router direct, it give me figures around the 200.
Now I have behind my provider router a Ubiquiti router and switch and the speeds are 1/4th of normal.
This is only the case for my Pi, a NAS, also on the same switch, does get the normal Internet speeds :-/

Code: Select all

root@p1mon:~# speedtest-cli --server 3587 --secure --no-upload
Retrieving speedtest.net configuration...
Testing from Ziggo (xx.xx.xx.xx)...
Retrieving speedtest.net server list...
Retrieving information for the selected server...
Hosted by LeaseWeb (Haarlem) [26.84 km]: 904.579 ms
Testing download speed................................................................................
Download: 57.82 Mbit/s
Skipping upload test
root@p1mon:~# 

I'm rocking a USG 3 and US-8-60W-to enable Flow Control, you have to go to the Unifi Controller, Devices, then click on the switch and at the right-side navigation, you have to go to the Config tab, Services and check "Enable flow control". Queue Changes, then apply the changes. Voila! Flow control enabled. This helped immensely with my home network and the Pi 3B+.

[Eichhorn18]

There is a suspected issue with Samba (and perhaps other network sharing mechanisms) that we haven't got to the bottom of yet, that may be unrelated.

The speedtest-cli result look exactly like flow control is not working effectively.

Is there any known issues with cifs as an alternative to samba?

Just for another data point, I have 800 Mbit/s service and i've connected a laptop with gigabit ethernet and gotten that delivery speed. The Raspberry Pi 3B+ on the same physical wire gives between 120 - 165 Mbit/s download, and upload between 100 - 220 Mbit/s.

[6by9]

There is a suspected issue with Samba (and perhaps other network sharing mechanisms) that we haven't got to the bottom of yet, that may be unrelated.

The speedtest-cli result look exactly like flow control is not working effectively.

Is there any known issues with cifs as an alternative to samba?

Just for another data point, I have 800 Mbit/s service and i've connected a laptop with gigabit ethernet and gotten that delivery speed. The Raspberry Pi 3B+ on the same physical wire gives between 120 - 165 Mbit/s download, and upload between 100 - 220 Mbit/s.

CIFS is a dialect of the SMB protocol that Samba implements.
We're fairly certain that has been resolved now anyway. It was stalling a single TCP connection rather than a speed issue.
https://github.com/raspberrypi/linux/issues/2449
https://github.com/raspberrypi/linux/issues/2482

Yours sounds like the standard type of flow control issue. You have a bottle-neck in the USB2 interface from the ethernet adapter to the Pi of a theoretical max of 480Mbit/s, but more realisitcally around 250Mbit/s. The adapter will be sending ethernet flow control pause frames when it backs up, but those only work over the local network. There is no mechanism to make an internet server back off other than rely on TCP's standard backoff/retry mechanisms.

[Eichhorn18]

CIFS is a dialect of the SMB protocol that Samba implements.
We're fairly certain that has been resolved now anyway. It was stalling a single TCP connection rather than a speed issue.
https://github.com/raspberrypi/linux/issues/2449
https://github.com/raspberrypi/linux/issues/2482

Yours sounds like the standard type of flow control issue. You have a bottle-neck in the USB2 interface from the ethernet adapter to the Pi of a theoretical max of 480Mbit/s, but more realisitcally around 250Mbit/s. The adapter will be sending ethernet flow control pause frames when it backs up, but those only work over the local network. There is no mechanism to make an internet server back off other than rely on TCP's standard backoff/retry mechanisms.

So I'm trying to transfer files through my local network, and scp from my windows machine is showing a max transfer speed of 11.5 MB/s.

What is required to check if flow control is turned on/off? I'm running an enterprise network through switches and some managed hubs.

[6by9]

So I'm trying to transfer files through my local network, and scp from my windows machine is showing a max transfer speed of 11.5 MB/s.

What is required to check if flow control is turned on/off? I'm running an enterprise network through switches and some managed hubs.

Code: Select all

pi@raspberrypi:~ $ sudo ethtool -a eth0
Pause parameters for eth0:
Autonegotiate:	on
RX:		on
TX:		on
RX negotiated:	on
TX negotiated:	on

on = good. off = bad.
Most managed switches will have options to enable/disable flow control. Unmanaged switches tend to have it enabled.

[Eichhorn18]

So I'm trying to transfer files through my local network, and scp from my windows machine is showing a max transfer speed of 11.5 MB/s.

What is required to check if flow control is turned on/off? I'm running an enterprise network through switches and some managed hubs.

Code: Select all

pi@raspberrypi:~ $ sudo ethtool -a eth0
Pause parameters for eth0:
Autonegotiate:	on
RX:		on
TX:		on
RX negotiated:	on
TX negotiated:	on

on = good. off = bad.
Most managed switches will have options to enable/disable flow control. Unmanaged switches tend to have it enabled.

Have done this today and all are reporting as 'on'. I tested my 3B+ several more times with speedtest-cli and getting average 145 Mbit/s download.
Seperatly I have copied an 800 MB file from the 3B+ to a network mounted folder on a windows machine, with gigabit ethernet. Time to copy was 63 seconds, giving a speed of approximately 14 MB/s or 110 Mbit/s. This seems far below the stated speed of the 3B+ of 300 Mbit/s max, but still you would expect better than this.

[drgeoff]

Seperatly I have copied an 800 MB file from the 3B+ to a network mounted folder on a windows machine, with gigabit ethernet. Time to copy was 63 seconds, giving a speed of approximately 14 MB/s or 110 Mbit/s. This seems far below the stated speed of the 3B+ of 300 Mbit/s max, but still you would expect better than this.

Copied from where on the 3B+? How fast can that place source data continuously?

[Eichhorn18]

Copied from where on the 3B+? How fast can that place source data continuously?

Copied from the SD card. I realize that in itself is an unfortunate bottleneck.

I have also written files that are stored in RAM, directly to a network mounted folder on a windows machine using CIFS. The transfer speed from RAM to the network folder (over a gigabit network and onto a gigabit enabled machine) was 30 MB/s, transferring 184MB of files in 6.13 sec.

Someone has suggested to me that running Stretch lite may have a different result. What do people think about that? I'm running Stretch Desktop at the moment.

[drgeoff]

Copied from where on the 3B+? How fast can that place source data continuously?

Copied from the SD card. I realize that in itself is an unfortunate bottleneck.

I have also written files that are stored in RAM, directly to a network mounted folder on a windows machine using CIFS. The transfer speed from RAM to the network folder (over a gigabit network and onto a gigabit enabled machine) was 30 MB/s, transferring 184MB of files in 6.13 sec.

Well, from RAM you get 30 Mbyte/s. That is 240 Mbit/s which is approaching the expected max rate of ethernet on a RPi 3B+.

[Eichhorn18]

Well, from RAM you get 30 Mbyte/s. That is 240 Mbit/s which is approaching the expected max rate of ethernet on a RPi 3B+.

It's true that is pretty decent. I wonder why the big difference (approximately 50%) for an internet connection that is supposed to give 800 Mbits/s on gigabit ethernet computers. What is the raspberry Pi doing for a speed test that it's not doing for a local network transfer--assuming the internet connection is not the limiting factor.

[ajp2k19]

Maybe I'm late to the party but here is what I have discovered so far...

https://www.snbforums.com/threads/slow- ... net.55114/

[6by9]

Maybe I'm late to the party but here is what I have discovered so far...

https://www.snbforums.com/threads/slow- ... net.55114/

So the same statement that has been made many times over in this thread then. Yes the Pi 3B+ requires ethernet flow control to be on to give reliable results. You can use "sudo ethtool -a eth0" to confirm whether it is on or off.
There was an intention to back off down to 100Mbit/s should flow control fail to be negotiated, but there hasn't been much progress on that.

[ajp2k19]

Maybe I'm late to the party but here is what I have discovered so far...

https://www.snbforums.com/threads/slow- ... net.55114/

So the same statement that has been made many times over in this thread then. Yes the Pi 3B+ requires ethernet flow control to be on to give reliable results. You can use "sudo ethtool -a eth0" to confirm whether it is on or off.
There was an intention to back off down to 100Mbit/s should flow control fail to be negotiated, but there hasn't been much progress on that.

Thanks, I wasn't sure there was any consenus on it. Now I have to figure out if I can enable it directly on my router, probably not...

[cdsgames]

Any news on the fix ??

[inShaneity]

I just purchased a 3B+ yesterday and I'm also experiencing slow speeds. My ISP is rated at 400Mbs up/20 down. My Pi is connected through the PoE hat and also has 1 HDD drive connected to it that's using Samba for network access. Seeing some issues in here about Samba, not sure about the PoE hat though. Running latest Stretch.

Before any changes and running speetest-cli, I was averaging about 30Mbs. Then I read up on enabling ethernet flow control. I have a Unifi 16 port PoE switch, so it was easy to find that setting and enable it. Now the speeds are averaging 125Mbs. If the max of this Pi is 300Mbs, then I'm still not even half way there.

Seeing people bouncing to different threads but I haven't found a consistent answer yet. Again, mostly concerned on maybe it being the PoE Hat in my case. Either way, I tried the Samba fix of turning off rx and tx, but I got an error that it was permitted to do that, so that didn't work.

What are my next steps from here, if there are any? Let me know if you need more information and I can provide that when I get home from work today.

[jamesh]

Not sure what to suggest. There's nothing wrong with the Pi I suspect, all the standard things have helpped, so there's something in the rest of the system going on to prevent higher speeds.

EDIT: Can you try powering it via a different mechanism to see if the that helps?

[inShaneity]

Not sure what to suggest. There's nothing wrong with the Pi I suspect, all the standard things have helpped, so there's something in the rest of the system going on to prevent higher speeds.

EDIT: Can you try powering it via a different mechanism to see if the that helps?

After further testing: Disabling Samba, removing the HDD, disabling WiFi, and removing the PoE hat, nothing changed. Speeds were still constant at around 125Mbs. I messed with the ethtool and changed it to 100 full, got worse speeds. Changed it back to 1000 and I was back at 125Mbs.

Then I randomly stumbled upon a post, not sure it if was in this thread, that said to try and update the FW using sudo rpi-update. The FW updated from 4.16.x to 4.19.37, I believe and it updated successfully. Running another speedtest-cli, increased my speeds by double! I was now seeing a constant 225Mbs - 250Mbs with the PoE Hat.

I still feel like the speeds should still be faster than that though. I'll keep doing some more tests...

[RPIgoodSBC]

This is a test gigabit ethernet on the new raspberry pi4 2Gb RAM...

pi@raspberrypi:~ $ sudo iperf3 -c xxx.xxx.x.xxx -R
Connecting to host xxx.xxx.x.xxx, port 5201
Reverse mode, remote host xxx.xxx.x.xxx is sending
[ 5] local yyy.yyy.y.yyy port 38716 connected to xxx.xxx.x.xxx port 5201
[ ID] Interval Transfer Bitrate
[ 5] 0.00-1.00 sec 112 MBytes 942 Mbits/sec
[ 5] 1.00-2.00 sec 112 MBytes 941 Mbits/sec
[ 5] 2.00-3.00 sec 112 MBytes 941 Mbits/sec
[ 5] 3.00-4.00 sec 112 MBytes 941 Mbits/sec
[ 5] 4.00-5.00 sec 112 MBytes 941 Mbits/sec
[ 5] 5.00-6.00 sec 112 MBytes 941 Mbits/sec
[ 5] 6.00-7.00 sec 112 MBytes 941 Mbits/sec
[ 5] 7.00-8.00 sec 112 MBytes 941 Mbits/sec
[ 5] 8.00-9.00 sec 112 MBytes 941 Mbits/sec
[ 5] 9.00-10.00 sec 112 MBytes 941 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bitrate Retr
[ 5] 0.00-10.03 sec 1.10 GBytes 942 Mbits/sec 0 sender
[ 5] 0.00-10.00 sec 1.10 GBytes 941 Mbits/sec receiver

iperf Done.
pi@raspberrypi:~ $ uname -a
Linux raspberrypi 4.19.57-v7l+ #1244 SMP Thu Jul 4 18:48:07 BST 2019 armv7l GNU/Linux

[Try2useRasp]

I am having difficulties with the ethernet on my raspberry pi model 3+. It just lockups when downloading a file and internetraffic load is high speed.
uname -a :

Linux NasPi 5.4.51-v7+ #1333 SMP Mon Aug 10 16:45:19 BST 2020 armv7l GNU/Linux

cat /sys/firmware/devicetree/base/model ;echo
Raspberry Pi 3 Model B Plus Rev 1.3


I have tried all sorts of things, the ram and cpu freq, they are on 450 and 1200. Used different network cables. The cable length is about 1 meter.
I have the original 5v 2.5A power supply, though i did use my lab power supply with 5v and set it to 6 amps but same results.
Also i tried numerous different SD cards, but same result everytime.
I have nothing attached on usb. The oly 2 cables to the pi are the power cable and the ethernet cable.

So i read this post and saw i could try lower the internet speed and did:

sudo ethtool -s eth0 speed 100 duplex full

As soon as i hit the return key, or enter key. The pi locked up.
(so i will go now and pull the power ... again, and see what has happened, then again hope my sd card is still good, otherwise i will put in a new one ... again)
Any help on this, i have been fighting this problem for years now, and i do not seem to find any answer. I know 200 milion people have the same pi and have no problems what so ever.
I gave up for a while, but i just want the thing to work and do what i tell it to do.

[Try2useRasp]

Well i found a hdmi cable, and a hdmi to dvi plug. So i attached it to the pi and i got on it.
Then i could change the ethtool eth0 to 100 and autonegotiate to off.
But ... it makes it worse, when downloadinga 500mb file it got to 0 percent and locked up.
So reverting back to 1000 and autonegotiate to on.
Then i get to 27 percent downloading the file until it locks up.
I am fed up with it now. i will take my mind of it i am getting heart problems again, because of this thing not working like it should.
And no i am not going to change my router for a new one.

[ejolson]

So reverting back to 1000 and autonegotiate to on.
Then i get to 27 percent downloading the file until it locks up.

What curious problems. Is it possible you have two devices with the same IP or MAC numbers on your local network?

[Try2useRasp]

What curious problems. Is it possible you have two devices with the same IP or MAC numbers on your local network?

No, i just checked. MAC is unique and also the ip is unique. I set all my ip addresses to static in the router. And also set eth0 to static ip in dhcpcd.conf.


I just tested again, downloading a different 10mb file, with speed up to 27mb/s all is ok.
(wget -O /dev/null http://speedtest.ams01.softlayer.com/do ... test10.zip)

then a 500 mb file at 27 mb/s it looked good, but then at 80 percent or so, it locked up again.
(wget -O /dev/null http://speedtest.ams01.softlayer.com/do ... est500.zip)

So i just pull the cord, and put it back in, restarts, then the same file of 500 mb/s.
lockup at 0 percent at 19 mb/s.

Against all my personal feelings i did a rpi-update just now, tested again but same results.
Thanks btw for even taking time to read and typing something back.

[Try2useRasp]

first time:

• wget -O /dev/null http://cachefly.cachefly.net/100mb.test
  --2020-09-08 18:25:47-- http://cachefly.cachefly.net/100mb.test
  Resolving cachefly.cachefly.net (cachefly.cachefly.net)... 205.234.175.175
  Connecting to cachefly.cachefly.net (cachefly.cachefly.net)|205.234.175.175|:80... connected.
  HTTP request sent, awaiting response... 200 OK
  Length: 104857600 (100M) [application/octet-stream]
  Saving to: ‘/dev/null’
  
  /dev/null 100%[===================>] 100.00M 29.9MB/s in 3.4s
  
  2020-09-08 18:25:50 (29.5 MB/s) - ‘/dev/null’ saved [104857600/104857600]

Second time:

• wget -O /dev/null http://cachefly.cachefly.net/100mb.test
  --2020-09-08 18:25:53-- http://cachefly.cachefly.net/100mb.test
  Resolving cachefly.cachefly.net (cachefly.cachefly.net)... 205.234.175.175
  Connecting to cachefly.cachefly.net (cachefly.cachefly.net)|205.234.175.175|:80... connected.
  HTTP request sent, awaiting response... 200 OK
  Length: 104857600 (100M) [application/octet-stream]
  Saving to: ‘/dev/null’
  
  /dev/null 100%[===================>] 100.00M 29.1MB/s in 3.5s

Third time and locks up / freezes or how you may call it:

• wget -O /dev/null http://cachefly.cachefly.net/100mb.test
  --2020-09-08 18:25:58-- http://cachefly.cachefly.net/100mb.test
  Resolving cachefly.cachefly.net (cachefly.cachefly.net)... 205.234.175.175
  Connecting to cachefly.cachefly.net (cachefly.cachefly.net)|205.234.175.175|:80... connected.
  HTTP request sent, awaiting response... 200 OK
  Length: 104857600 (100M) [application/octet-stream]
  Saving to: ‘/dev/null’
  
  /dev/null 29%[====> ] 29.58M 29.6MB/s

I just don't know anymore.

[Try2useRasp]

Now i did the same with Wifi, pulled out the ethernet cable and on wifi the speed is way slower, butthen it survives 3 times the 100mb file and once 500 mb, no lock up.

First time:

• wget -O /dev/null http://cachefly.cachefly.net/100mb.test
  --2020-09-08 18:39:53-- http://cachefly.cachefly.net/100mb.test
  Resolving cachefly.cachefly.net (cachefly.cachefly.net)... 205.234.175.175
  Connecting to cachefly.cachefly.net (cachefly.cachefly.net)|205.234.175.175|:80. .. connected.
  HTTP request sent, awaiting response... 200 OK
  Length: 104857600 (100M) [application/octet-stream]
  Saving to: ‘/dev/null’
  
  /dev/null 100%[=============================>] 100.00M 3.46MB/s in 37s
  
  2020-09-08 18:41:18 (3.45 MB/s) - ‘/dev/null’ saved [104857600/104857600]

Second time:

• wget -O /dev/null http://cachefly.cachefly.net/100mb.test
  --2020-09-08 18:41:20-- http://cachefly.cachefly.net/100mb.test
  Resolving cachefly.cachefly.net (cachefly.cachefly.net)... 205.234.175.175
  Connecting to cachefly.cachefly.net (cachefly.cachefly.net)|205.234.175.175|:80... connected.
  HTTP request sent, awaiting response... 200 OK
  Length: 104857600 (100M) [application/octet-stream]
  Saving to: ‘/dev/null’
  
  /dev/null 100%[=============================>] 100.00M 3.01MB/s in 32s
  
  2020-09-08 18:41:52 (3.14 MB/s) - ‘/dev/null’ saved [104857600/104857600]

Third time:

• wget -O /dev/null http://cachefly.cachefly.net/100mb.test
  --2020-09-08 18:41:20-- http://cachefly.cachefly.net/100mb.test
  Resolving cachefly.cachefly.net (cachefly.cachefly.net)... 205.234.175.175
  Connecting to cachefly.cachefly.net (cachefly.cachefly.net)|205.234.175.175|:80... connected.
  HTTP request sent, awaiting response... 200 OK
  Length: 104857600 (100M) [application/octet-stream]
  Saving to: ‘/dev/null’
  
  /dev/null 100%[=============================>] 100.00M 3.01MB/s in 32s
  
  2020-09-08 18:41:52 (3.14 MB/s) - ‘/dev/null’ saved [104857600/104857600]

Fourth time 500 mb file:

• wget -O /dev/null http://speedtest.ams01.softlayer.com/do ... est500.zip
  --2020-09-08 18:41:53-- http://speedtest.ams01.softlayer.com/do ... est500.zip
  Resolving speedtest.ams01.softlayer.com (speedtest.ams01.softlayer.com)... 159.253.132.18
  Connecting to speedtest.ams01.softlayer.com (speedtest.ams01.softlayer.com)|159.253.132.18|:80... connected.
  HTTP request sent, awaiting response... 200 OK
  Length: 524288000 (500M) [application/zip]
  Saving to: ‘/dev/null’
  
  /dev/null 100%[=============================>] 500.00M 5.23MB/s in 1m 45s
  
  2020-09-08 18:43:39 (4.76 MB/s) - ‘/dev/null’ saved [524288000/524288000]

So i am just guessing, but could it be the speed is to great or something, is there a way to limit the speed to say 20 mb/s and then try lowering it down per 5 mb/s?
I just do not know how to that, but will go and search the internet again to see if it is possible to slow down on the pi side. In my router i can not do qos, because i need the nat boost and both can not work.


I also did changes like they said on elinux.org, like this:
Crashes occur with high network load

The USB driver allocates memory from the kernel, and when traffic is very high (e.g. when using torrents/newsgroup downloads) this memory can be exhausted causing crashes/hangs. (Crashes with high network load can also be related to your power supply, try a powered usb hub.) You should have a line like:

vm.min_free_kbytes = 8192

in /etc/sysctl.conf. Try increasing that number to 16384. If that doesn't work, try adding to /boot/cmdline.txt

smsc95xx.turbo_mode=N

However it is unclear to me if the free kbytes mem thing should be reverted back when using smsc95xx.turbo mode to no?
I tried both, no cure.

I connect my lab power supply so i can see the current, at the lock up it is the same current as when downlaoding starts arround 0.650 amps at 5 volts.

temperature cpu around 58'C.