Lipown
Posts: 86
Joined: Sun Oct 13, 2019 8:32 am

Poor SATA to USB HDD performance.

Mon Jan 06, 2020 2:07 pm

Hi,

I am running the raspian from SSD on Raspberry PI 4 4GB. Sometimes when watching movie in Full HD in Kodi, I have small miliseconds freezes including little crack in sound.

I have also second drive connected to second USB (its 5400 rpm WD drive 1,5TB). When I am watchin movies from this drive, the freezes, repeats more often.

Also when copying from the WD drive to SSD the speed drops from 80MBs in few minutes to around 20MBs and the processor running on 100%.

Anyone has similar issue and found the solution? It seems that the drives running in PIO instad of UDMA (not an expert but it came up to my mind as in the past I was switchning those modes in Windows 98)

jamesh
Raspberry Pi Engineer & Forum Moderator
Raspberry Pi Engineer & Forum Moderator
Posts: 24987
Joined: Sat Jul 30, 2011 7:41 pm

Re: Poor SATA to USB HDD performance.

Mon Jan 06, 2020 2:40 pm

Have you updated to the latest USB controller firmware? https://www.raspberrypi.org/forums/view ... 8&t=250990
Principal Software Engineer at Raspberry Pi (Trading) Ltd.
Contrary to popular belief, humorous signatures are allowed. Here's an example...
“I own the world’s worst thesaurus. Not only is it awful, it’s awful."

Lipown
Posts: 86
Joined: Sun Oct 13, 2019 8:32 am

Re: Poor SATA to USB HDD performance.

Mon Jan 06, 2020 3:05 pm

Is that updated by rpi-update please? If not, I did not and will try.

jamesh
Raspberry Pi Engineer & Forum Moderator
Raspberry Pi Engineer & Forum Moderator
Posts: 24987
Joined: Sat Jul 30, 2011 7:41 pm

Re: Poor SATA to USB HDD performance.

Mon Jan 06, 2020 3:30 pm

Lipown wrote:
Mon Jan 06, 2020 3:05 pm
Is that updated by rpi-update please? If not, I did not and will try.
The linked thread explains how to install the latest VLI firmware, don't think it is in rpi-update.
Principal Software Engineer at Raspberry Pi (Trading) Ltd.
Contrary to popular belief, humorous signatures are allowed. Here's an example...
“I own the world’s worst thesaurus. Not only is it awful, it’s awful."

Lipown
Posts: 86
Joined: Sun Oct 13, 2019 8:32 am

Re: Poor SATA to USB HDD performance.

Mon Jan 06, 2020 3:52 pm

jamesh wrote:
Mon Jan 06, 2020 3:30 pm
Lipown wrote:
Mon Jan 06, 2020 3:05 pm
Is that updated by rpi-update please? If not, I did not and will try.
The linked thread explains how to install the latest VLI firmware, don't think it is in rpi-update.
Flashed by the newer revision in this: https://www.raspberrypi.org/forums/view ... e#p1588905

Will report how it works in few days as I am not physically now near the PI.

Lipown
Posts: 86
Joined: Sun Oct 13, 2019 8:32 am

Re: Poor SATA to USB HDD performance.

Tue Jan 07, 2020 5:07 pm

Firmware helped with backpowering - I can restart the PI without disconnecting the HDD of external power supply

First test
- Coping files trough samba from windows device to Westren Digital drive on raspbery pi - 30MB/s,
- Pi Processor on 40% but the freezes in movies remains
- Musing trough raspotify unlistenable due to freezes

Update: I am running the audio interface from USB, maybe this is an issue to...

Maze_fr
Posts: 46
Joined: Wed Dec 04, 2019 9:57 pm
Location: France

Re: Poor SATA to USB HDD performance.

Tue Jan 07, 2020 9:26 pm

"Don't believe in forum signature quotations, they may be fakes" - Victor Hugo

BeauSlim
Posts: 106
Joined: Mon Jul 31, 2017 10:02 am

Re: Poor SATA to USB HDD performance.

Wed Jan 08, 2020 2:43 am

I have two guesses for you:
1. You need to change your kodi cache settings to buffer local file systems: https://kodi.wiki/view/HOW-TO:Modify_the_video_cache
2. You have a power issue. Try with the HD unplugged. Try with a powered hub. Try with a different 3A power supply.

User avatar
mikronauts
Posts: 2741
Joined: Sat Jan 05, 2013 7:28 pm
Contact: Website

Re: Poor SATA to USB HDD performance.

Wed Jan 08, 2020 4:15 am

Is the usb drive formatted to ntfs?
Lipown wrote:
Mon Jan 06, 2020 2:07 pm
Hi,

I am running the raspian from SSD on Raspberry PI 4 4GB. Sometimes when watching movie in Full HD in Kodi, I have small miliseconds freezes including little crack in sound.

I have also second drive connected to second USB (its 5400 rpm WD drive 1,5TB). When I am watchin movies from this drive, the freezes, repeats more often.

Also when copying from the WD drive to SSD the speed drops from 80MBs in few minutes to around 20MBs and the processor running on 100%.

Anyone has similar issue and found the solution? It seems that the drives running in PIO instad of UDMA (not an expert but it came up to my mind as in the past I was switchning those modes in Windows 98)
http://Mikronauts.com - home of EZasPi, RoboPi, Pi Rtc Dio and Pi Jumper @Mikronauts on Twitter
Advanced Robotics, I/O expansion and prototyping boards for the Raspberry Pi

Lipown
Posts: 86
Joined: Sun Oct 13, 2019 8:32 am

Re: Poor SATA to USB HDD performance.

Wed Jan 08, 2020 2:44 pm

Maze_fr wrote:
Tue Jan 07, 2020 9:26 pm
Did you try this ? https://www.raspberrypi.org/forums/view ... 8&t=245931
Will try and report back in few days. Unfortunatelly I do not know how to perform step 1 on SSD drive as the system is running through it. Any help? Note I have both drives connected trough same USB3-Sata convertor

Lipown
Posts: 86
Joined: Sun Oct 13, 2019 8:32 am

Re: Poor SATA to USB HDD performance.

Wed Jan 08, 2020 2:46 pm

BeauSlim wrote:
Wed Jan 08, 2020 2:43 am
I have two guesses for you:
1. You need to change your kodi cache settings to buffer local file systems: https://kodi.wiki/view/HOW-TO:Modify_the_video_cache
2. You have a power issue. Try with the HD unplugged. Try with a powered hub. Try with a different 3A power supply.
1) The latest test was performed by raspotify and VLC, not Kodi. But anyway will try and report back.
2) I did the test running only SSD witouth supply, with, running both drives supplied with power externally, running ssd without and wdc drive with supply. Same performance.

Lipown
Posts: 86
Joined: Sun Oct 13, 2019 8:32 am

Re: Poor SATA to USB HDD performance.

Wed Jan 08, 2020 2:46 pm

mikronauts wrote:
Wed Jan 08, 2020 4:15 am
Is the usb drive formatted to ntfs?
Lipown wrote:
Mon Jan 06, 2020 2:07 pm
Hi,

I am running the raspian from SSD on Raspberry PI 4 4GB. Sometimes when watching movie in Full HD in Kodi, I have small miliseconds freezes including little crack in sound.

I have also second drive connected to second USB (its 5400 rpm WD drive 1,5TB). When I am watchin movies from this drive, the freezes, repeats more often.

Also when copying from the WD drive to SSD the speed drops from 80MBs in few minutes to around 20MBs and the processor running on 100%.

Anyone has similar issue and found the solution? It seems that the drives running in PIO instad of UDMA (not an expert but it came up to my mind as in the past I was switchning those modes in Windows 98)
Correct. The western digital drive had NTFS.

User avatar
mikronauts
Posts: 2741
Joined: Sat Jan 05, 2013 7:28 pm
Contact: Website

Re: Poor SATA to USB HDD performance.

Thu Jan 09, 2020 3:18 am

reformat as ext4
Lipown wrote:
Wed Jan 08, 2020 2:46 pm
mikronauts wrote:
Wed Jan 08, 2020 4:15 am
Is the usb drive formatted to ntfs?
Lipown wrote:
Mon Jan 06, 2020 2:07 pm
Hi,

I am running the raspian from SSD on Raspberry PI 4 4GB. Sometimes when watching movie in Full HD in Kodi, I have small miliseconds freezes including little crack in sound.

I have also second drive connected to second USB (its 5400 rpm WD drive 1,5TB). When I am watchin movies from this drive, the freezes, repeats more often.

Also when copying from the WD drive to SSD the speed drops from 80MBs in few minutes to around 20MBs and the processor running on 100%.

Anyone has similar issue and found the solution? It seems that the drives running in PIO instad of UDMA (not an expert but it came up to my mind as in the past I was switchning those modes in Windows 98)
Correct. The western digital drive had NTFS.
http://Mikronauts.com - home of EZasPi, RoboPi, Pi Rtc Dio and Pi Jumper @Mikronauts on Twitter
Advanced Robotics, I/O expansion and prototyping boards for the Raspberry Pi

Lipown
Posts: 86
Joined: Sun Oct 13, 2019 8:32 am

Re: Poor SATA to USB HDD performance.

Thu Jan 09, 2020 3:39 pm

Then I am not able to copy lagre files over samba and dont know why. Already tried. Performance was with some smaller files same.
mikronauts wrote:
Thu Jan 09, 2020 3:18 am
reformat as ext4
Lipown wrote:
Wed Jan 08, 2020 2:46 pm
mikronauts wrote:
Wed Jan 08, 2020 4:15 am
Is the usb drive formatted to ntfs?

Correct. The western digital drive had NTFS.

LTolledo
Posts: 2588
Joined: Sat Mar 17, 2018 7:29 am
Location: Anime Heartland

Re: Poor SATA to USB HDD performance.

Thu Jan 09, 2020 9:56 pm

The only problem that I have with copying large files to NTFS volumes over samba was....

copy failed for files with very long file names (seems not supported in NTFS)
changing the HDD format from NTFS to EXT4 solved it

single file size of 8GB and sometimes 16GB.... file copy no problem.

definitely follow the procedure as outlined here:
https://www.raspberrypi.org/forums/view ... 8&t=245931
"Don't come to me with 'issues' for I don't know how to deal with those
Come to me with 'problems' and I'll help you find solutions"

Some people be like:
"Help me! Am drowning! But dont you dare touch me nor come near me!"

Lipown
Posts: 86
Joined: Sun Oct 13, 2019 8:32 am

Re: Poor SATA to USB HDD performance.

Fri Jan 10, 2020 11:36 am

I believe 30MB/s is not bad at all however if I will use quirks, it seems the speed will drop down even more right?
LTolledo wrote:
Thu Jan 09, 2020 9:56 pm
The only problem that I have with copying large files to NTFS volumes over samba was....

copy failed for files with very long file names (seems not supported in NTFS)
changing the HDD format from NTFS to EXT4 solved it

single file size of 8GB and sometimes 16GB.... file copy no problem.

definitely follow the procedure as outlined here:
https://www.raspberrypi.org/forums/view ... 8&t=245931

Lipown
Posts: 86
Joined: Sun Oct 13, 2019 8:32 am

Re: Poor SATA to USB HDD performance.

Fri Jan 10, 2020 11:38 am

Update: Now the PI freezes randomly in two days. As I have just a remote access I did not get any logs. Doing restarts by wifi socket. After restart everything works ok till next freeze.
Lipown wrote:
Tue Jan 07, 2020 5:07 pm
Firmware helped with backpowering - I can restart the PI without disconnecting the HDD of external power supply

First test
- Coping files trough samba from windows device to Westren Digital drive on raspbery pi - 30MB/s,
- Pi Processor on 40% but the freezes in movies remains
- Musing trough raspotify unlistenable due to freezes

Update: I am running the audio interface from USB, maybe this is an issue to...

Lipown
Posts: 86
Joined: Sun Oct 13, 2019 8:32 am

Re: Poor SATA to USB HDD performance.

Fri Jan 10, 2020 11:41 am

Lipown wrote:
Fri Jan 10, 2020 11:36 am

How do i get the information that the guide tell you to get by the disconnecting the USB drive if one of mine is system drive so the system get stucked after removing please?

EDIT: just did the "hack" the pi did not boot. I need to resolve it as I get physically near it.
LTolledo wrote:
Thu Jan 09, 2020 9:56 pm
The only problem that I have with copying large files to NTFS volumes over samba was....

copy failed for files with very long file names (seems not supported in NTFS)
changing the HDD format from NTFS to EXT4 solved it

single file size of 8GB and sometimes 16GB.... file copy no problem.

definitely follow the procedure as outlined here:
https://www.raspberrypi.org/forums/view ... 8&t=245931

Lipown
Posts: 86
Joined: Sun Oct 13, 2019 8:32 am

Re: Poor SATA to USB HDD performance.

Fri Jan 10, 2020 3:50 pm

So little update after using the quide

Pros:
1) Speed ~ 40MBs both drives
2) Boot is faster than ever

Cons:
1) When I disconnect USB (Zigbee sniffer) and connect another USB (wemos D1), it is not get recognized after qirks hack :/
2) Backpowering issue is back so I need to disconnct the WDC drive prior rebooting otherwise it wont restart/start the system
3) Now it randomly starting to crashing raspbian
4) Glitches in sound almost the same. Maybe a little bit better

Anyone can recomend adapter that works without qirks hack?

gkreidl
Posts: 6195
Joined: Thu Jan 26, 2012 1:07 pm
Location: Germany

Re: Poor SATA to USB HDD performance.

Fri Jan 10, 2020 6:03 pm

I have a number of Seagate USB3 3.5 " drives connected to my RPi 4. They work without the quirks. Speed is about 100 MB/sec.
Minimal Kiosk Browser (kweb)
Slim, fast webkit browser with support for audio+video+playlists+youtube+pdf+download
Optional fullscreen kiosk mode and command interface for embedded applications
Includes omxplayerGUI, an X front end for omxplayer

Lipown
Posts: 86
Joined: Sun Oct 13, 2019 8:32 am

Re: Poor SATA to USB HDD performance.

Sat Jan 11, 2020 12:18 am

By adapter?
gkreidl wrote:
Fri Jan 10, 2020 6:03 pm
I have a number of Seagate USB3 3.5 " drives connected to my RPi 4. They work without the quirks. Speed is about 100 MB/sec.

svenger
Posts: 1
Joined: Mon Jan 13, 2020 6:25 am

Re: Poor SATA to USB HDD performance.

Mon Jan 13, 2020 6:27 am

This sounds like the problem i have with my JMicron USB to SATA bridge attached to RPI4.

Could you post the output of the "dmesg" command?
Maybe also "dmesg | grep uas_eh_abort_handler"

Lipown
Posts: 86
Joined: Sun Oct 13, 2019 8:32 am

Re: Poor SATA to USB HDD performance.

Mon Jan 13, 2020 11:12 am

Yesterday I spend whole day figuring this out. Yes there is JMS controller in the USB Sata Bridge.

Updated 15.1.

1) First Bridge that connects SSD that running system SDA - When I update firmware on the bridge it won't boot or It is slow as hell. Will do another test after update of RPI and VLI firmware today. Currently running old FW on the bridge. The SSD is Intel something.

2) Second Bridge that connect WDC 1,5TB drive SDB - Bridge flashed with latest JMS firmware. Did reflash more times at it failed to mount the drive after flash. Now it's running with latest JMS controller FW but I have not get the time to perform the tests The drive is Wester Digital Green 1,5TB 5400RPM. Update: If first one is not powered, the PI won't boot. Previously if second flashed by base firmware, the PI booted even first was not powered.

Dmesg output:

https://pastebin.com/embed_js/VBEBrV29

dmesg | grep uas_eh_abort_handler gives nothing
svenger wrote:
Mon Jan 13, 2020 6:27 am
This sounds like the problem i have with my JMicron USB to SATA bridge attached to RPI4.

Could you post the output of the "dmesg" command?
Maybe also "dmesg | grep uas_eh_abort_handler"

Return to “Troubleshooting”