zetoune
Posts: 23
Joined: Sun May 27, 2018 9:50 pm

RPi can't sent video (and audio) when joining a Jitsi meeting room

Sun May 27, 2018 10:43 pm

Hi there,

I'm trying to make this tutorial: How to join Jitsi Meet video conferences over the Web work.
I've just installed a fresh install of the latest version of Raspbian and all required libraries described in the tutorial.

I'm using the UV4L Streaming Server / Join a Jitsi Meet Room to make the tests. I didn't change anything from the default settings except the name of the room and the username

Image

Long story short, when I try to access a room, I do see the RPi to connect but Jitsi meeting says: "Rpi is having connectivity issues". (member is muted and his camera is off).

Image

Looking at the logs doesn't provide any other directions to debug this issue.

Code: Select all

[email protected]:~$ sudo journalctl -u uv4l_raspicam.service -f
-- Logs begin at Thu 2016-11-03 13:16:43 EDT. --
May 27 17:37:09 raspberrypi uv4l[343]: <notice> [driver] Selected format: 1920x1080, encoding: mjpeg, JPEG Video Capture
May 27 17:37:09 raspberrypi uv4l[343]: <notice> [driver] Framerate max. 30 fps
May 27 17:37:09 raspberrypi uv4l[343]: <info> [driver] ROI: 0, 0, 1, 1
May 27 17:37:09 raspberrypi uv4l[343]: <notice> [core] Device detected!
May 27 17:37:09 raspberrypi uv4l[343]: <notice> [core] Trying to load the the Streaming Server plug-in...
May 27 17:37:09 raspberrypi uv4l[343]: <notice> [server] HTTP/HTTPS Streaming & WebRTC Signalling Server v1.1.112 built on Feb 25 2018
May 27 17:37:09 raspberrypi uv4l[343]: <warning> [server] SSL is not enabled for the Streaming Server. Using unsecure HTTP.
May 27 17:37:09 raspberrypi uv4l[343]: <notice> [core] Streaming Server loaded!
May 27 17:37:09 raspberrypi uv4l[343]: <notice> [core] Registering device node /dev/video0
May 27 17:37:09 raspberrypi uv4l[343]: <notice> [server] Web Streaming Server listening on port 8080
May 27 17:39:57 raspberrypi uv4l[343]: <notice> [server] WebRTC Renderer extension successfully loaded
May 27 17:39:57 raspberrypi uv4l[343]: <notice> [server] WebRTC, Signalling Server and STUN Server extensions successfully loaded
May 27 17:39:57 raspberrypi uv4l[343]: <info> [server] Connecting to the XMPP Bridge...
May 27 17:40:33 raspberrypi uv4l[343]: <info> [server] Stopping XMPP Session...
May 27 17:45:09 raspberrypi uv4l[343]: <info> [server] Connecting to the XMPP Bridge...
May 27 17:45:14 raspberrypi uv4l[343]: <info> [driver] connecting preview component...
May 27 17:45:14 raspberrypi uv4l[343]: <info> [driver] Camera ready!
May 27 17:45:14 raspberrypi uv4l[343]: <info> [driver] Camera successfully initialized. Total memory available to the GPU: 256M
May 27 17:45:14 raspberrypi uv4l[343]: <info> [driver] Close down completed, all components disconnected, disabled and destroyed
May 27 17:45:14 raspberrypi uv4l[343]: <info> [driver] connecting preview component...
May 27 17:45:14 raspberrypi uv4l[343]: <info> [driver] Camera ready!
May 27 17:45:14 raspberrypi uv4l[343]: <info> [driver] Camera successfully initialized. Total memory available to the GPU: 256M
May 27 17:45:14 raspberrypi uv4l[343]: <info> [driver] Close down completed, all components disconnected, disabled and destroyed
May 27 17:45:14 raspberrypi uv4l[343]: <info> [driver] connecting preview component...
May 27 17:45:14 raspberrypi uv4l[343]: <info> [driver] Camera ready!
May 27 17:45:14 raspberrypi uv4l[343]: <info> [driver] Camera successfully initialized. Total memory available to the GPU: 256M
May 27 17:45:14 raspberrypi uv4l[343]: <info> [driver] Close down completed, all components disconnected, disabled and destroyed
May 27 17:45:15 raspberrypi uv4l[343]: <info> [driver] connecting preview component...
May 27 17:45:15 raspberrypi uv4l[343]: <info> [driver] Camera ready!
May 27 17:45:15 raspberrypi uv4l[343]: <info> [driver] Camera successfully initialized. Total memory available to the GPU: 256M
May 27 17:45:15 raspberrypi uv4l[343]: <info> [driver] connecting preview component...
May 27 17:45:15 raspberrypi uv4l[343]: <info> [driver] Camera ready!
May 27 17:45:17 raspberrypi uv4l[343]: <info> [server] Data Channel created with label: uv4l

Code: Select all

[email protected]:~$ sudo journalctl -u uv4l_xmpp_bridge.service -f
-- Logs begin at Thu 2016-11-03 13:16:43 EDT. --
May 27 17:39:29 raspberrypi systemd[1]: Starting LSB: XMPP Bridge for UV4L...
May 27 17:39:29 raspberrypi uv4l_xmpp_bridge[1158]: Starting XMPP Bridge for UV4L: xmpp-bridge
May 27 17:39:29 raspberrypi systemd[1]: Started LSB: XMPP Bridge for UV4L.
I want to create a Video-Intercom based on the Rpi and I thought this option should be an easy way to achieve this. Obviously I failed :(
So the RPi should received audio from other users and other users should receive video and audio from the Rpi.

I did try to record a sound from the rpi microphone and it works. Same thing for audio out. I can play mp3 from the pi.


I don't know where to look at to fix the problem.
Any helps would be very appreciated.
Raspberry 3B
Raspbian GNU/Linux 9.4 (stretch)
uv4l: Version 1.9.16 built on Jan 28 2018
Omnivision 5647 Camera
Audio out
Microphone

zetoune
Posts: 23
Joined: Sun May 27, 2018 9:50 pm

Re: RPi can't sent video (and audio) when joining a Jitsi meeting room

Tue May 29, 2018 12:52 am

Still searching & digging...

To see if I could get some other logs from the server, I've installed my own Jitsi Meet server.
I know it works because I could make a meeting between two computers on my LAN. Great!

So I tried to connect the Rpi to this server, still no lucks!
This is what I see from the command "/usr/bin/xmpp-bridge"

Code: Select all

New request
Data bytes available: 16392
Frame received (length=16384, flags=0x82)
Executing message...
Starting session...
connecting...
Message executed
connected
presence sent
presence sent
presence sent
etc...
In the conference room, I see the Rpi avatar but it keeps saying "Connecting..."
I think, it may be a config on the Rpi, but I don't know which one.

Still no one?

Morok
Posts: 1
Joined: Fri Jun 08, 2018 2:04 pm

Re: RPi can't sent video (and audio) when joining a Jitsi meeting room

Fri Jun 08, 2018 2:10 pm

Hi,

I have same issue. I found out, that if you rejoin the room with other member, PRi start to streaming, but I got black screen.

zetoune
Posts: 23
Joined: Sun May 27, 2018 9:50 pm

Re: RPi can't sent video (and audio) when joining a Jitsi meeting room

Sat Jun 09, 2018 11:23 pm

In my case, It doesn't stream at all. When I join with another user in Chrome on my laptop, I only see RPi saying "Connecting..."

Mike W
Posts: 1
Joined: Tue Jun 12, 2018 2:19 pm

Re: RPi can't sent video (and audio) when joining a Jitsi meeting room

Tue Jun 12, 2018 2:24 pm

I have similar issues with Jitsi on the RPi.
In my case I'm using the Pi camera with a RPi 3B+ and I'm getting an error that "the camera doesn't support the required resolution."
I've tested the camera using

raspistill -o cam.jpg

and it works ok.

zetoune
Posts: 23
Joined: Sun May 27, 2018 9:50 pm

Re: RPi can't sent video (and audio) when joining a Jitsi meeting room

Tue Jun 12, 2018 2:40 pm

I have a RPi 3B and Pi Camera clone (GPU 256 MB)

The MJPEG stream from uv4l server (http://<raspberry-ip-address>:8080/stream) does work.

Other error, I can't disconnect the RPi from the chat room. As soon as I try, uv4l server hangs, there is no other solution that rebooting the RPi.

soytoledano
Posts: 1
Joined: Sun Jul 08, 2018 10:00 pm

Re: RPi can't sent video (and audio) when joining a Jitsi meeting room

Sun Jul 08, 2018 10:07 pm

Hi Zetoune,

funny I´m following your same steps. Want to do exactly the same and thought jitsi meet would be the best option after some research. Faced the same issues than you and now I´m not sure what is the best way to go. Have you been able to get it working or have you tried any other software for the video intercom?

Thanks.

zetoune
Posts: 23
Joined: Sun May 27, 2018 9:50 pm

Re: RPi can't sent video (and audio) when joining a Jitsi meeting room

Mon Jul 09, 2018 1:10 pm

I finally succeed to make it run. What did I do to make it run? I've read somewhere that my audio device needed to be the default ones for WebRTC. UV4L Streaming Server uses WebRTC and XMPP bridge to make the PI join the Jitsi meeting, so I started to investigate this way. My microphone was not the default ALSA device (even if I could record with it by specifying the hardware index) and my speaker was using PulseAudio virtual driver.
I removed the configuration of my speaker and re-enabled built-in output sound card and change /etc/asound.conf to make my microphone the default one.
One other thing. I did have to modify the raspicam-config driver (/etc/uv4l/uv4l-raspicam.conf).

Code: Select all

#server-option = --xmpp-bridge-host=localhost
to

Code: Select all

server-option = --xmpp-bridge-host=X.X.X.X 
where obviously X.X.X.X is the ip of the RPi.

After that, I could have a "working" video conference. I put the word working between double-quotes because it's not stable at all.
if the sound works flawlessly, the video crashes 2 times on 3 and hangs forever. Moreover, it usually takes up to 20 seconds to establish the connexion which is way too long for my needs.

I'm still looking for another solution. If I find one, I'll make you updated.

wsdukai
Posts: 2
Joined: Thu Jun 20, 2019 9:08 pm

Re: RPi can't sent video (and audio) when joining a Jitsi meeting room

Thu Jun 20, 2019 9:11 pm

Any update on your Jitsi things? I'm also working on a project which makes the raspberry pi to do peer to peer video streaming without setting the port forwarding on the router.

User avatar
HermannSW
Posts: 1569
Joined: Fri Jul 22, 2016 9:09 pm
Location: Eberbach, Germany
Contact: Website Twitter YouTube

Re: RPi can't sent video (and audio) when joining a Jitsi meeting room

Thu Jun 20, 2019 11:24 pm

Somebody should report the issues on u4vl project contacts page:
http://www.linux-projects.org/contact/
⇨https://stamm-wilbrandt.de/en/Raspberry_camera.html

https://github.com/Hermann-SW/Raspberry_v1_camera_global_external_shutter
https://gitlab.freedesktop.org/HermannSW/gst-template
https://github.com/Hermann-SW/fork-raspiraw
https://twitter.com/HermannSW

zetoune
Posts: 23
Joined: Sun May 27, 2018 9:50 pm

Re: RPi can't sent video (and audio) when joining a Jitsi meeting room

Fri Jun 21, 2019 5:48 pm

wsdukai wrote:
Thu Jun 20, 2019 9:11 pm
Any update on your Jitsi things? I'm also working on a project which makes the raspberry pi to do peer to peer video streaming without setting the port forwarding on the router.
Nope, I gave up with Jitsi.
I had different results with different cameras.
It finally worked with an USB camera instead of the Pi-Camera like. But resolution is really bad (something like 320x240) and it takes forever to connect (approx 2-3 minutes).

With the support of WebRTC with mobile browsers, other solutions can be used (such as WebRTC on u4vl server)
HermannSW wrote: Somebody should report the issues on u4vl project contacts page:
http://www.linux-projects.org/contact/
Thank you. I didn't think about it. I will

wsdukai
Posts: 2
Joined: Thu Jun 20, 2019 9:08 pm

Re: RPi can't sent video (and audio) when joining a Jitsi meeting room

Thu Aug 29, 2019 5:33 pm

Thank you for the update! Have you tried Janus? I did some research, it seems works. The UV4L Janus is working for my RPi3, it can send video stream to the public video room, but I failed it on ZeroW.

jegK
Posts: 3
Joined: Mon Oct 16, 2017 9:46 am

Re: RPi can't sent video (and audio) when joining a Jitsi meeting room

Tue Nov 05, 2019 9:42 am

Hi!

ended up here after trying to get started with uv4l + jitsi-meet with this tuto: https://www.linux-projects.org/uv4l/tut ... itsi-meet/

uv4l install seems ok (i can access the stream through the browser)

But the pi is not able to join a jitsi meet room

All i can find is this log from uv4l_raspicam

Code: Select all

[email protected]:/etc/uv4l $ sudo journalctl -u uv4l_raspicam.service -f
-- Logs begin at Thu 2016-11-03 18:16:42 CET. --
nov. 05 10:32:14 raspberrypi uv4l[8299]: <warning> [server] XMPP session error: Connection refused
nov. 05 10:32:14 raspberrypi uv4l[8299]: <notice> [server] Waiting for 2 seconds before reconnecting to localhost:7999...
nov. 05 10:32:16 raspberrypi uv4l[8299]: <warning> [server] XMPP session error: Connection refused
nov. 05 10:32:16 raspberrypi uv4l[8299]: <notice> [server] Waiting for 2 seconds before reconnecting to localhost:7999...
nov. 05 10:32:18 raspberrypi uv4l[8299]: <warning> [server] XMPP session error: Connection refused
nov. 05 10:32:18 raspberrypi uv4l[8299]: <notice> [server] Waiting for 2 seconds before reconnecting to localhost:7999...
nov. 05 10:32:20 raspberrypi uv4l[8299]: <warning> [server] XMPP session error: Connection refused
and from uv4l_xmpp_bridge

Code: Select all

[email protected]:/etc/uv4l $ sudo journalctl -u uv4l_xmpp_bridge.service
-- No entries --
any ideas welcome!

zetoune
Posts: 23
Joined: Sun May 27, 2018 9:50 pm

Re: RPi can't sent video (and audio) when joining a Jitsi meeting room

Tue Nov 05, 2019 2:48 pm

Hi jegK,

In my case it has been very buggy. I haven't been able to make it work with a PiCamera. (CSI Interface).
I had better results with USB camera but once again, It could take one minute for the RPi to jump on the call and resolution was awful.
I did search for a better solution. Now, mobile browsers accept WebRTC.
Having that said, uv4l_xmpp_bridge.service doesn't seem to work. You have to launch it manually with sudo xmpp_bridge.
Ensure you specify the IP of the XMPP bridge in config file as I said earlier

jegK
Posts: 3
Joined: Mon Oct 16, 2017 9:46 am

Re: RPi can't sent video (and audio) when joining a Jitsi meeting room

Wed Nov 06, 2019 10:27 pm

hi zetoune,

Thanks for this!
but even after starting manually xmpp_bridge, i still have the same connection error in the log when trying to connect to a jitsi room "XMPP session error: Connection refused" ...

I ve read your post and mixed results, and i ve seen that you can indeed start a webrtc call directly in the browser, but i m looking for a solution that would push the stream to a webrtc session without having to start a browser, so it can run headless with a simple script to start it, (only one way video, the pi wouldn t need to receive streams from others)

UV4L seemed like a good option to get there quickly, so was keen to give it a shot, but it seems it might not be so straightforward.

what solution did you finally end up with?

zetoune
Posts: 23
Joined: Sun May 27, 2018 9:50 pm

Re: RPi can't sent video (and audio) when joining a Jitsi meeting room

Thu Nov 07, 2019 2:39 pm

Actually, It's headless too.
My project is a doorbell. The idea is to see from my phone the camera feed of the RaspberryPI. I don't run the RPi with a desktop environment.
I ended up with the WebRTC solution of UV4L. It doesn't use a browser on the RPi side. It responds to the call from the server side.
RPi does not receive the video of my cell phone but does receive the audio.

I had to modify the source code of UV4L - WebRTC to make it work with mobile browsers but it works out of the box on desktop browsers.
My idea is: Someone press the doorbell button, it send me a custom link which I can click on and that would open browser window with video feed. I want to have a mobile user-friendly (UV4L - WebRTC is not responsive at all) UI so I need to modify the HTML source code to achieve that.

If you use a CSI Camera (not USB) you can give a try to this project too : https://github.com/kclyu/rpi-webrtc-streamer.
It does work pretty well.

jegK
Posts: 3
Joined: Mon Oct 16, 2017 9:46 am

Re: RPi can't sent video (and audio) when joining a Jitsi meeting room

Thu Nov 07, 2019 10:39 pm

ok thanks for sharing, I ll take a look at your setup. just starting, so plenty to learn for me in this webrtc world :-)

zetoune
Posts: 23
Joined: Sun May 27, 2018 9:50 pm

Re: RPi can't sent video (and audio) when joining a Jitsi meeting room

Fri Nov 08, 2019 3:51 am

When I have a working solution, I'll share my GitHub project here.

Return to “Camera board”