Page 1 of 1

Raspberry Pi3 shows benchmark results for TWO times less

Posted: Mon Dec 05, 2016 10:12 pm
by carter
Hi everyone.

First one. I found this page in internet https://www.element14.com/community/com ... hmark-ever
And I was intrigued and wondered how my Pi 3 gonna run with this benchmark. Tried this benchmark and had surprised. For example you can test it as well.

Code: Select all

sudo apt-get install sysbench
sysbench --num-threads=4 --test=cpu --cpu-max-prime=20000 --validate run
After this test my Raspberry Pi 3 shows this result
Test execution summary:
total time: 242.0059s
total number of events: 10000
total time taken by event execution: 967.8505
per-request statistics:
min: 95.43ms
avg: 96.79ms
max: 155.89ms
approx. 95 percentile: 98.96ms

Threads fairness:
events (avg/stddev): 2500.0000/39.62
execution time (avg/stddev): 241.9626/0.03
I also have Raspberry Pi 2 and ran this benchmark as well
Test execution summary:
total time: 255.5132s
total number of events: 10000
total time taken by event execution: 1021.8823
per-request statistics:
min: 77.96ms
avg: 102.19ms
max: 168.08ms
approx. 95 percentile: 118.15ms

Threads fairness:
events (avg/stddev): 2500.0000/7.45
execution time (avg/stddev): 255.4706/0.02
Shocked! This test on Pi2 shows almost SAME result as on Pi3.

All the tests have given figures of two times worse than that of the author of the article. Not for 5-10% difference, but 100%. TWO TIMES! How it possible?
Bench test from article:

Total time 119.4716 !!!!

per request statistics
min 47.69 ms
avg 47.78 ms
max 59.04 ms
Okay. Probably this test is pretty subjective. Lets try another benchmark test.

For this test you need install pigz.

Code: Select all

sudo apt-get install pigz
And after this put command below to start this test

Code: Select all

dd bs=1k count=1M if=/dev/urandom |pigz -p 8 - > /dev/null
[email protected]:~ $ dd bs=1k count=1M if=/dev/urandom |pigz -p 8 - > /dev/null
1048576+0 records in
1048576+0 records out
1073741824 bytes (1.1 GB) copied, 458.207 s, 2.3 MB/s
I bought my Raspberries Pi3 on Amazon. My old friend from Europe bought Pi3 in the market in his country. And we started these tests on the same OS versions with same kernel and on the same boards. Everything was completely same.

His test shows different result with my Pi3. And his Pi3 two times faster than mine.
[email protected]:~/test $ dd bs=1k count=1M if=/dev/urandom |pigz -p 8 - > /dev/null
1048576+0 records in
1048576+0 records out
1073741824 bytes (1.1 GB) copied, 240.172 s, 4.5 MB/s !!!! TWO TIMES MORE !
His 'sysbench' test also shows better performance for TWO times! AGAIN FOR TWO TIMES!
total time: 112.6931s
And rest of other also same with article.

I have _four_(4) RPi3 and they show completely same results. All these Pi3 I bought on Amazon and Ebay in the USA.

I do not want to believe that I was cheated. And bought something for which I did not pay. But, seems that for the US market and European there different boards are made. I would like to hear the explanation from those who designed, produces and sells this boards. What do you think guys?

Probably I did somewhere incorrectly, or configured, or installed, or ran? Maybe. But I do not think so.

Re: Raspberry Pi3 shows benchmark results for TWO times less

Posted: Tue Dec 06, 2016 1:14 am
by ejolson
Unless you install a heatsink with fan, the Pi 3B hardware will throttle down to 600 MHz from the standard speed of 1200 MHz almost as soon as the benchmark starts. This results in 1/2 the expected performance numbers.

Re: Raspberry Pi3 shows benchmark results for TWO times less

Posted: Tue Dec 06, 2016 5:05 am
by carter
Thank you for your response. I installed cooper heat sink. Temperature never get high than 54C.
Check attach please. Also set the frequency to maximum 1.2Ghz and got completely same result.
Any ideas?

Re: Raspberry Pi3 shows benchmark results for TWO times less

Posted: Tue Dec 06, 2016 9:24 am
by jahboater
Sysbench cpu is explicitly a 64-bit benchmark so I am not sure if its useful on the Pi running Raspbian. I would expect this to take about 7 - 8 seconds on a Pi3 with a 64-bit OS. That may be quick enough to avoid throttling.

Code: Select all

Test execution summary:
    total time:                          5.5439s
    total number of events:              10000
    total time taken by event execution: 22.1473
    per-request statistics:
         min:                                  2.18ms
         avg:                                  2.21ms
         max:                                 13.72ms
         approx.  95 percentile:               2.23ms

Threads fairness:
    events (avg/stddev):           2500.0000/21.15
    execution time (avg/stddev):   5.5368/0.01
for the same cpu (cortex-a53 in 64-bit mode at 1.7GHz).

Re: Raspberry Pi3 shows benchmark results for TWO times less

Posted: Tue Dec 06, 2016 1:42 pm
by piuser72
Results for my Pi 3 running following (prime to 20000, 4 threads, 110 seconds 40C (ambient 20C)):

sysbench --num-threads=4 --test=cpu --cpu-max-prime=20000 --validate run

Code: Select all

[email protected]:~ $ sysbench --num-threads=4 --test=cpu --cpu-max-prime=20000 --validate run
sysbench 0.4.12:  multi-threaded system evaluation benchmark

Running the test with following options:
Number of threads: 4
Additional request validation enabled.


Doing CPU performance benchmark

Threads started!
Done.

Maximum prime number checked in CPU test: 20000


Test execution summary:
    total time:                          110.5353s
    total number of events:              10000
    total time taken by event execution: 442.0022
    per-request statistics:
         min:                                 44.02ms
         avg:                                 44.20ms
         max:                                105.68ms
         approx.  95 percentile:              44.30ms

Threads fairness:
    events (avg/stddev):           2500.0000/8.77
    execution time (avg/stddev):   110.5006/0.02

while true; do vcgencmd measure_clock arm; vcgencmd measure_temp; sleep 10; done

Code: Select all

[email protected]:~ $ while true; do vcgencmd measure_clock arm; vcgencmd measure_temp; sleep 10; done
frequency(45)=1300136000
temp=30.6'C
frequency(45)=1300000000
temp=36.5'C
frequency(45)=1300000000
temp=37.6'C
frequency(45)=1300000000
temp=38.6'C
frequency(45)=1300000000
temp=39.2'C
frequency(45)=1300000000
temp=39.7'C
frequency(45)=1300000000
temp=39.7'C
frequency(45)=1300002000
temp=39.7'C
frequency(45)=1300000000
temp=40.8'C
frequency(45)=1300000000
temp=40.8'C
frequency(45)=1300000000
temp=40.8'C
frequency(45)=1300000000
temp=40.8'C
frequency(45)=1300000000
temp=35.4'C
frequency(45)=600000000
temp=31.6'C

Re: Raspberry Pi3 shows benchmark results for TWO times less

Posted: Tue Dec 06, 2016 2:37 pm
by lumsdot
my pi3 with no heat sink took 120 seconds, how certain are you that you have a PI3?

Test execution summary:
total time: 119.9304s
total number of events: 10000
total time taken by event execution: 479.5922
per-request statistics:
min: 47.69ms
avg: 47.96ms
max: 142.64ms
approx. 95 percentile: 48.29ms

Threads fairness:
events (avg/stddev): 2500.0000/5.24
execution time (avg/stddev): 119.8980/0.01

Re: Raspberry Pi3 shows benchmark results for TWO times less

Posted: Tue Dec 06, 2016 2:41 pm
by RaTTuS
cat /proc/cpuinfo

Re: Raspberry Pi3 shows benchmark results for TWO times less

Posted: Tue Dec 06, 2016 2:47 pm
by jahboater
Or this to give the Pi's name:

Code: Select all

cat /sys/firmware/devicetree/base/model

Re: Raspberry Pi3 shows benchmark results for TWO times less

Posted: Tue Dec 06, 2016 3:50 pm
by carter
Last login: Mon Dec 5 21:16:37 2016
[email protected]:~ $ cat /sys/firmware/devicetree/base/model
Raspberry Pi 3 Model B Rev 1.2
[email protected]:~ $
Can you send your model info please ?
I'm not sure that the heat sink or temperature is a reason why my Pi3 working slowly. But I will try install today more powerful heat sink just for sure.

Re: Raspberry Pi3 shows benchmark results for TWO times less

Posted: Tue Dec 06, 2016 4:30 pm
by carter
jahboater wrote:Sysbench cpu is explicitly a 64-bit benchmark so I am not sure if its useful on the Pi running Raspbian. I would expect this to take about 7 - 8 seconds on a Pi3 with a 64-bit OS. That may be quick enough to avoid throttling.
This is not about bits. Jessie is the 32-bit OS. As I wrote before we tested two completely same Pi3. Same board, OS, kernel version and even heat sinks almost same. Doesn't matter. My Pi3 working slowly for two times then being bought on the europe market.

I even tried overclock my Pi3 up to 1.3 Ghz
arm_freq=1300
over_voltage=5
gpu_freq=550

# sdram overclock
sdram_freq=550
sdram_schmoo=0x02000020
over_voltage_sdram_p=6
over_voltage_sdram_i=4
over_voltage_sdram_c=4
Same result again
total time: 234.5720s !!! WHY ??!
total number of events: 10000
total time taken by event execution: 938.1447
per-request statistics:
min: 44.02ms
avg: 93.81ms
max: 224.22ms
approx. 95 percentile: 99.02ms

Threads fairness:
events (avg/stddev): 2500.0000/34.34
execution time (avg/stddev): 234.5362/0.02

[email protected]:~ $ cpufreq-info -s -m
1.30 GHz:100.00%
[email protected]:~ $
I have no idea about why my Pi3 working slow.

Re: Raspberry Pi3 shows benchmark results for TWO times less

Posted: Tue Dec 06, 2016 4:40 pm
by jahboater
carter wrote:Can you send your model info please ?
Its the same as yours ....
[email protected]:~ $ cat /sys/firmware/devicetree/base/model
Raspberry Pi 3 Model B Rev 1.2
[email protected]:~ $
and like every one elses, it runs sysbench in 120 seconds at stock speed:

Code: Select all

Maximum prime number checked in CPU test: 20000

Test execution summary:
    total time:                          119.9203s
    total number of events:              10000
    total time taken by event execution: 479.5689
    per-request statistics:
         min:                                 47.69ms
         avg:                                 47.96ms
         max:                                 94.07ms
         approx.  95 percentile:              47.87ms

Threads fairness:
    events (avg/stddev):           2500.0000/4.53
    execution time (avg/stddev):   119.8922/0.01
Have you altered anything in /boot/config.txt?
Edit: sorry about crossed posts, I see you know about the settings in config.txt!

Re: Raspberry Pi3 shows benchmark results for TWO times less

Posted: Tue Dec 06, 2016 4:47 pm
by jahboater
Perhaps just quickly try a fresh install of Raspbian Lite on an old card.

I see you have cpufrequtils installed, hope that's not interfering with anything.

Re: Raspberry Pi3 shows benchmark results for TWO times less

Posted: Tue Dec 06, 2016 5:02 pm
by carter
Seems I found problem. Power source. Pi3 very sensitive for stable voltage. When voltage drop lower than 5.1v then performance also goes down. Connected to samsung genuine power source with 5.3 voltage output and got good results. Thanks to everyone for help.