dom
Raspberry Pi Engineer & Forum Moderator
Raspberry Pi Engineer & Forum Moderator
Posts: 5149
Joined: Wed Aug 17, 2011 7:41 pm
Location: Cambridge

Re: Moving Linux kernel to 4.14

Tue Feb 13, 2018 3:08 pm

paul433 wrote:
Tue Feb 13, 2018 3:03 am
Running Headless or putting dwc_otg.fiq_enable=0 and dwc_otg.fiq_fsm_enable=0 on the command line also reduce/eliminate the kernel panics.
Have you ever seen the panic with dwc_otg.fiq_enable=0 and dwc_otg.fiq_fsm_enable=0 ?
It makes a big difference to identifying where the bug is if the result is panic is eliminated, compared to panic is reduced.

dom
Raspberry Pi Engineer & Forum Moderator
Raspberry Pi Engineer & Forum Moderator
Posts: 5149
Joined: Wed Aug 17, 2011 7:41 pm
Location: Cambridge

Re: Moving Linux kernel to 4.14

Tue Feb 13, 2018 3:13 pm

paul433 wrote:
Tue Feb 13, 2018 3:03 am
However the PREEMPT and PREEMPT_RT kernels are still showing the crash as posted above.
So are you using our kernel tree unpatched, or is that a tree modified with RT patches?
The RT patches are not supported by us and not expected to work with fiq based USB driver.

paul433
Posts: 11
Joined: Sun Dec 30, 2012 10:46 pm

Re: Moving Linux kernel to 4.14

Tue Feb 13, 2018 3:56 pm

We have seen issues with all 4.14.y kernels. RPI tree unpatched, RPI tree with changing config to Voluntary Preemption, and then a full RT patch. I understand that you don't support the RT patches. The RT patch was something new that we were trying out. But the other 2 kernels worked completely fine under 4.9.y

This is the type of problem that is moving around, and as soon as you think X setting fixes the problem, the problem comes back. As soon as I typed the message in the forums about the unpatched kernel being ok.....one of the beta testers reported back that it was having the problem again.

We just started to investigate FIQ settings over the weekend, I'll have to setup some more tests with the unpatched kernel. This error only happens during boot. As my previous messages have noted, there are a lot of conditions/settings that affect it. Eliminate is tough thing to say, but normally around 200 reboots without an error I think we could call it good.

jdb
Raspberry Pi Engineer & Forum Moderator
Raspberry Pi Engineer & Forum Moderator
Posts: 1785
Joined: Thu Jul 11, 2013 2:37 pm

Re: Moving Linux kernel to 4.14

Wed Feb 14, 2018 12:37 pm

Regarding the crash on boot with USB, there's a clue in what each CPU is doing.

CPU1 just entered the FIQ handler, and CPU2 is in dwc_otg_driver_init(). I think there may be some racy behaviour between taking an interrupt too early and the coherence of the driver state.

I note that the USB register offset (xx98xxxx) appears nowhere in the stack or in the register dump. In a comparable dump from a locally compiled kernel (offsets probably completely munged) the code is approximately:

Code: Select all

1266            gintsts.d32 = FIQ_READ(state->dwc_regs_base + GINTSTS);
   0x004c2d2c <+88>:    ldr     r3, [r4, #24]
   0x004c2d30 <+92>:    ldr     r6, [r3, #20]

1267            gintmsk.d32 = FIQ_READ(state->dwc_regs_base + GINTMSK);
   0x004c2d34 <+96>:    ldr     r10, [r3, #24]
So in this case, at least 1 register should have a recognisable virtual address of the register space.
Rockets are loud.
https://astro-pi.org

paul433
Posts: 11
Joined: Sun Dec 30, 2012 10:46 pm

Re: Moving Linux kernel to 4.14

Thu Feb 15, 2018 3:29 pm

Further testing

Setting dwc_otg.fiq_enable=0 and dwc_otg.fiq_fsm_enable=0

Unpatched rpi kernel (SMP kernel) - two different systems with over 500 reboot cycles without crash.


I see this commit in the kernel tree. https://github.com/raspberrypi/linux/co ... 5978fe6280

I'll build this tonight and test it out.

jdb
Raspberry Pi Engineer & Forum Moderator
Raspberry Pi Engineer & Forum Moderator
Posts: 1785
Joined: Thu Jul 11, 2013 2:37 pm

Re: Moving Linux kernel to 4.14

Thu Feb 22, 2018 1:08 pm

Latest rpi-update contains a potential fix for the crash on boot.
Rockets are loud.
https://astro-pi.org

paul433
Posts: 11
Joined: Sun Dec 30, 2012 10:46 pm

Re: Moving Linux kernel to 4.14

Thu Mar 15, 2018 1:04 pm

Kernel 4.14.21 seemed to be really stable, 4.14.24 we started seeing these kernel panics again. Seems that we have not round the race condition that is causing the problem.

User avatar
manawyrm
Posts: 30
Joined: Mon Apr 15, 2013 6:18 am
Location: Alfeld (Leine), Germany
Contact: Website

Re: Moving Linux kernel to 4.14

Thu Mar 15, 2018 5:36 pm

Have updated the new Raspberry Pi 3B+ to the 4.14 kernel -- works nicely! :)

Code: Select all

[email protected]:~# uname -a
Linux raspi3bp 4.14.26-v7+ #1099 SMP Wed Mar 14 14:59:28 GMT 2018 armv7l GNU/Linux

jdb
Raspberry Pi Engineer & Forum Moderator
Raspberry Pi Engineer & Forum Moderator
Posts: 1785
Joined: Thu Jul 11, 2013 2:37 pm

Re: Moving Linux kernel to 4.14

Thu Mar 15, 2018 7:38 pm

paul433 wrote:
Thu Mar 15, 2018 1:04 pm
Kernel 4.14.21 seemed to be really stable, 4.14.24 we started seeing these kernel panics again. Seems that we have not round the race condition that is causing the problem.
Is the dmesg log/stacktrace any different?
Rockets are loud.
https://astro-pi.org

paul433
Posts: 11
Joined: Sun Dec 30, 2012 10:46 pm

Re: Moving Linux kernel to 4.14

Sat Mar 17, 2018 4:32 pm

Looked similar, but that's far from conclusive. I didn't have the pause_on_oops set on the command line when it happened. And of course, now it is being elusive. I'll keep watch and post a full trace if I see it.

darksky
Posts: 37
Joined: Sun Feb 12, 2017 11:34 am

Re: Moving Linux kernel to 4.14

Mon Mar 26, 2018 8:07 am

dom wrote:
Tue Nov 14, 2017 2:25 pm
Update with:

Code: Select all

sudo rpi-update
and reboot. Ideally nothing much will change.
Please report if there are any regressions compared to the 4.9 kernel.
I just flashed XBian_Latest_rpi3.img and am booted into xbian on my RPi3. It's running 4.9.87+. Which package provides the script you reference above?

dom
Raspberry Pi Engineer & Forum Moderator
Raspberry Pi Engineer & Forum Moderator
Posts: 5149
Joined: Wed Aug 17, 2011 7:41 pm
Location: Cambridge

Re: Moving Linux kernel to 4.14

Mon Mar 26, 2018 11:09 am

darksky wrote:
Mon Mar 26, 2018 8:07 am
I just flashed XBian_Latest_rpi3.img and am booted into xbian on my RPi3. It's running 4.9.87+. Which package provides the script you reference above?
rpi-update is designed for raspbian and the raspbian package is rpi-update.
I believe xbian uses a custom kernel so running rpi-update would likely be a bad idea. You should ask on xbian forums.

ShiftPlusOne
Raspberry Pi Engineer & Forum Moderator
Raspberry Pi Engineer & Forum Moderator
Posts: 5308
Joined: Fri Jul 29, 2011 5:36 pm
Location: The unfashionable end of the western spiral arm of the Galaxy

Re: Moving Linux kernel to 4.14

Wed Mar 28, 2018 1:53 pm

The raspberrypi-kernel package apt has been updated to 4.14 now.

User avatar
PeterO
Posts: 4243
Joined: Sun Jul 22, 2012 4:14 pm

Re: Moving Linux kernel to 4.14

Wed Mar 28, 2018 9:52 pm

OOOooo... Shiney :-)

Code: Select all

[email protected]:~ $ uname -a
Linux raspberrypi 4.14.30-v7+ #1102 SMP Mon Mar 26 16:45:49 BST 2018 armv7l GNU/Linux
[email protected]:~ $ 
PeterO
Discoverer of the PI2 XENON DEATH FLASH!
Interests: C,Python,PIC,Electronics,Ham Radio (G0DZB),Aeromodelling,1960s British Computers.
"The primary requirement (as we've always seen in your examples) is that the code is readable. " Dougie Lawson

beta-tester
Posts: 1207
Joined: Fri Jan 04, 2013 1:57 pm
Location: de_DE

Re: Moving Linux kernel to 4.14

Wed Mar 28, 2018 10:14 pm

ShiftPlusOne wrote:
Wed Mar 28, 2018 1:53 pm
The raspberrypi-kernel package apt has been updated to 4.14 now.
nice... :D
is it way too early to ask what kernel version will be next? :oops:
(4.15 or 4.16)
{ I only give negative feedback }
RPi Model B (rev1, 256MB) & B (rev2, 512MB) & B+, RPi2B (1GB), 64GB microSDXC1 class 10, HDMI 1920x1080, keyboard-mouse-combo (wireless), PiCamera, ethernet-cable, 5V/1.2A power supply, Wifi dongle (rt5370)

sharukins
Posts: 1
Joined: Thu Mar 29, 2018 5:56 am

Re: Moving Linux kernel to 4.14

Thu Mar 29, 2018 5:58 am

beta-tester wrote:
Wed Mar 28, 2018 10:14 pm
ShiftPlusOne wrote:
Wed Mar 28, 2018 1:53 pm
The raspberrypi-kernel package apt has been updated to 4.14 now.
nice... :D
is it way too early to ask what kernel version will be next? :oops:
(4.15 or 4.16)
probably the next LTS version, (4.19 maybe)

hommar
Posts: 142
Joined: Sat Mar 25, 2017 1:55 pm
Location: Russia, Yekaterinburg

Re: Moving Linux kernel to 4.14

Thu Mar 29, 2018 8:52 am

beta-tester wrote:
Wed Mar 28, 2018 10:14 pm
ShiftPlusOne wrote:
Wed Mar 28, 2018 1:53 pm
The raspberrypi-kernel package apt has been updated to 4.14 now.
nice... :D
is it way too early to ask what kernel version will be next? :oops:
(4.15 or 4.16)
The raspberrypi-kernel package apt use LTS always
LTS will be 4.19 possible
(becouse 4.4, 4.9, 4.14 is LTS)

PS Why git clone previous version?

Code: Select all

git clone --depth=1 https://github.com/raspberrypi/linux

User avatar
kneekoo
Posts: 19
Joined: Mon Dec 29, 2014 7:08 am

Re: Moving Linux kernel to 4.14

Thu Mar 29, 2018 9:38 am

Will we get a blog article about the new kernel? Is there anything notable about it? Any improvements, RAM usage differences, support for new devices, etc.

6by9
Raspberry Pi Engineer & Forum Moderator
Raspberry Pi Engineer & Forum Moderator
Posts: 5671
Joined: Wed Dec 04, 2013 11:27 am
Location: ZZ9 Plural Z Alpha, aka just outside Cambridge.

Re: Moving Linux kernel to 4.14

Thu Mar 29, 2018 9:39 am

hommar wrote:
Thu Mar 29, 2018 8:52 am
PS Why git clone previous version?

Code: Select all

git clone --depth=1 https://github.com/raspberrypi/linux
The default branch on https://github.com/raspberrypi/linux/ hasn't been updated, that's all. I'll nudge relevant people.
Software Engineer at Raspberry Pi Trading. Views expressed are still personal views.
Please don't send PMs asking for support - use the forum.
I'm not interested in doing contracts for bespoke functionality - please don't ask.

dom
Raspberry Pi Engineer & Forum Moderator
Raspberry Pi Engineer & Forum Moderator
Posts: 5149
Joined: Wed Aug 17, 2011 7:41 pm
Location: Cambridge

Re: Moving Linux kernel to 4.14

Thu Mar 29, 2018 10:19 am

6by9 wrote:
Thu Mar 29, 2018 9:39 am
The default branch on https://github.com/raspberrypi/linux/ hasn't been updated, that's all. I'll nudge relevant people.
Should be updated now.

dom
Raspberry Pi Engineer & Forum Moderator
Raspberry Pi Engineer & Forum Moderator
Posts: 5149
Joined: Wed Aug 17, 2011 7:41 pm
Location: Cambridge

Re: Moving Linux kernel to 4.14

Thu Mar 29, 2018 10:33 am

kneekoo wrote:
Thu Mar 29, 2018 9:38 am
Will we get a blog article about the new kernel? Is there anything notable about it? Any improvements, RAM usage differences, support for new devices, etc.
Probably best to follow the four links in the first post. For most users there will be no visible change. Everything should work as before,
with no significant change in performance or memory usage.

There are many drivers added for new hardware, bug fixes, new features and security improvements, but these are upstream changes rather than things we are responsible for, and are best described by upstream sources.

User avatar
kneekoo
Posts: 19
Joined: Mon Dec 29, 2014 7:08 am

Re: Moving Linux kernel to 4.14

Thu Mar 29, 2018 11:21 pm

Thanks for your reply. I won't add the same information here, but rather the link to my comment on the blog post about MagPi 68.

The on thing that is new and doesn't seem to work is the vc4-hdmi entry in the audio applet menu, which doesn't seem to do anything if you click on it. Can anyone confirm this feature to appear after the upgrade to kernel 4.14? Does it work for anyone?

dom
Raspberry Pi Engineer & Forum Moderator
Raspberry Pi Engineer & Forum Moderator
Posts: 5149
Joined: Wed Aug 17, 2011 7:41 pm
Location: Cambridge

Re: Moving Linux kernel to 4.14

Fri Mar 30, 2018 10:47 am

kneekoo wrote:
Thu Mar 29, 2018 11:21 pm
The on thing that is new and doesn't seem to work is the vc4-hdmi entry in the audio applet menu, which doesn't seem to do anything if you click on it. Can anyone confirm this feature to appear after the upgrade to kernel 4.14? Does it work for anyone?
Can you explain exactly what you mean by the audio applet menu? Where is this menu, what did it used to do and how has it changed?

tvjon
Posts: 629
Joined: Mon Jan 07, 2013 9:11 am

Re: Moving Linux kernel to 4.14

Fri Mar 30, 2018 11:19 am

@kneekoo

If you mean this:

(see attached jpeg. I have no javascript on this browser so it won't go inline)

I also see no effect on omxplayer for example.

I haven't noticed this before as I almost always specify the destination in the omxplayer statement, for example:

omxplayer -o alsa:pcm.default ...

I've just tried setting the applet to HDMI & simply used:

omxplayer music.mp3

& it played from the HDMI monitor.

Changing the applet to Analog

restart:

omxplayer music.mp3

still played through the monitor.
Attachments
audio-out-applet.jpg
audio-out-applet.jpg (2.89 KiB) Viewed 2190 times

User avatar
kneekoo
Posts: 19
Joined: Mon Dec 29, 2014 7:08 am

Re: Moving Linux kernel to 4.14

Fri Mar 30, 2018 3:26 pm

dom wrote:
Fri Mar 30, 2018 10:47 am
Can you explain exactly what you mean by the audio applet menu? Where is this menu, what did it used to do and how has it changed?

This is the sound applet menu, and clicking vc4-hdmi has absolutely no effect, other than closing the menu.
Image

Return to “Advanced users”

Who is online

Users browsing this forum: No registered users and 9 guests