Gstreamer 1.0 for raspbian

[Defiant]

works fine with videotestsrc. when i try with different video clips, outpit.avi size is zero.

exact pipeline please

[email protected] ~ $ gst-launch-1.0 -v filesrc location=Raspberry-Pi-logo.jpg ! decodebin ! imagefreeze ! autovideosink

i could only see little part of leaf clear from Raspberry-Pi-logo.jpg image and remaining is not clear.
I am checking with GStreamer1.0 pre-built binaries.

Yes, I guess this is a bug in gst-omx.

[sody]

Hi,
I searched the documentation for playing video via Mulicast but found none.
is it possible to make gstream run multicast stream supplying the multicast ip/group ?
I have a testbed where multicast stream is sent in the netwrok, i can use vlc on my desktop to open it.
what i want to achieve is an always running (starts at boot) that searches for stream on specific multicast group and plays the video (h264) if there is any, if not to show some image/logo.
I want it for video room at college as a part of a project.

Thanks in advance,
Sami

[Defiant]

The elements udpsink/udpsrc do support Multicast.

[sody]

Thanks for the reply.
I can't find a decent documentation to use gst-launch maybe you can point me?

I'd be glad if you help me issue command that will do:
0. - my pc is streaming to ip=10.0.0.3 , port=5044, udp/rtp h264 as i choose
1. i would like rasp-pi do: get the stream from 10.0.0.3:5044 and play it to X (port 6000)
2. i would like rasp-pi do: get the stream from 10.0.0.3:5044 and play it to console

in 1 & 2 i'm uing ssh

Thanks in advance,
Sami

[Defiant]

I can't find a decent documentation to use gst-launch maybe you can point me?

The official one:
http://gstreamer.freedesktop.org/data/d ... index.html

0. - my pc is streaming to ip=10.0.0.3 , port=5044, udp/rtp h264 as i choose
1. i would like rasp-pi do: get the stream from 10.0.0.3:5044 and play it to X (port 6000)
2. i would like rasp-pi do: get the stream from 10.0.0.3:5044 and play it to console

If 1. and 2. is the same Computer I wouldn't use Multicast for that. With the tee element you can get gstreamer to output to 2 sinks, e.g.

Code: Select all

gst-launch-1.0 videotestsrc ! tee name=out1 ! queue ! autovideosink out1. ! queue ! autovideosink

And how did you manage the rpi to have two (Console and X) Heads at the same time?

[rangelreale]

Following these instructions I was able to play MP4 files perfectly, but not VC-1 WMV. I bought the license, and it works perfectly in omxplayer, but using gst-omx, I get this (Bad port index). Any ideas?

Code: Select all

 $ gst-launch-1.0 --gst-debug omx*:5  playbin uri=file:///home/pi/f_184.bin.wmv
Setting pipeline to PAUSED ...
Pipeline is PREROLLING ...
0:00:00.761259508  2597   0x201c60 DEBUG                    omx gstomx.c:2758:plugin_init: Registering element 'omxmpeg2videodec'
0:00:00.764297390  2597   0x201c60 DEBUG                    omx gstomx.c:2758:plugin_init: Registering element 'omxmpeg4videodec'
0:00:00.766645300  2597   0x201c60 DEBUG                    omx gstomx.c:2758:plugin_init: Registering element 'omxh263dec'
0:00:00.769115204  2597   0x201c60 DEBUG                    omx gstomx.c:2758:plugin_init: Registering element 'omxh264dec'
0:00:00.770573147  2597   0x201c60 DEBUG                    omx gstomx.c:2758:plugin_init: Registering element 'omxtheoradec'
0:00:00.773794023  2597   0x201c60 DEBUG                    omx gstomx.c:2758:plugin_init: Registering element 'omxvp8dec'
0:00:00.776275926  2597   0x201c60 DEBUG                    omx gstomx.c:2758:plugin_init: Registering element 'omxmjpegdec'
0:00:00.778765830  2597   0x201c60 DEBUG                    omx gstomx.c:2758:plugin_init: Registering element 'omxvc1dec'
0:00:00.780051780  2597   0x201c60 DEBUG                    omx gstomx.c:2758:plugin_init: Registering element 'omxh264enc'
0:00:00.783500647  2597   0x201c60 DEBUG                    omx gstomx.c:2659:_class_init: No src template caps specified for element 'omxvc1dec', using default 'video/x-raw, width = (int) [ 1, max ], height = (int) [ 1, max ], framerate = (fraction) [ 0, max ]'
0:00:00.787106507  2597   0x201c60 DEBUG                    omx gstomx.c:2684:_class_init: Using hack: no-component-role
0:00:00.793024278  2597   0x201c60 DEBUG            omxvideodec gstomxvideodec.c:731:gst_omx_video_dec_open:<omxwmvdec-omxvc1dec0> Opening decoder
0:00:00.807414720  2597   0x201c60 DEBUG                    omx gstomx.c:129:gst_omx_core_acquire: Successfully loaded core '/opt/vc/lib/libopenmaxil.so'
0:00:00.812541521  2597   0x201c60 DEBUG                    omx gstomx.c:144:gst_omx_core_acquire: Successfully initialized core '/opt/vc/lib/libopenmaxil.so'
0:00:00.816939351  2597   0x201c60 DEBUG                    omx gstomx.c:653:gst_omx_component_new:<omxwmvdec-omxvc1dec0> Successfully got component handle 0x30be30 (OMX.broadcom.video_encode) from core '/opt/vc/lib/libopenmaxil.so'
0:00:00.819010271  2597   0x201c60 DEBUG                    omx gstomx.c:807:gst_omx_component_get_state:<omxwmvdec-omxvc1dec0> Getting state of video_encode
0:00:00.821262184  2597   0x201c60 DEBUG                    omx gstomx.c:884:gst_omx_component_get_state:<omxwmvdec-omxvc1dec0> video_encode returning state Loaded
0:00:00.823679090  2597   0x201c60 DEBUG                    omx gstomx.c:906:gst_omx_component_add_port:<omxwmvdec-omxvc1dec0> video_encode adding port 130
0:00:00.824698051  2597   0x201c60 DEBUG                    omx gstomx.c:997:gst_omx_component_get_parameter:<omxwmvdec-omxvc1dec0> Getting video_encode parameter at index 0x02000001
0:00:00.827297950  2597   0x201c60 DEBUG                    omx gstomx.c:1000:gst_omx_component_get_parameter:<omxwmvdec-omxvc1dec0> Got video_encode parameter at index 0x02000001: Bad port index (0x8000101b)
0:00:00.830305833  2597   0x201c60 ERROR                    omx gstomx.c:915:gst_omx_component_add_port:<omxwmvdec-omxvc1dec0> video_encode failed to add port 130: Bad port index (0x8000101b)
0:00:00.831894772  2597   0x201c60 DEBUG                    omx gstomx.c:906:gst_omx_component_add_port:<omxwmvdec-omxvc1dec0> video_encode adding port 131
0:00:00.833234720  2597   0x201c60 DEBUG                    omx gstomx.c:997:gst_omx_component_get_parameter:<omxwmvdec-omxvc1dec0> Getting video_encode parameter at index 0x02000001
0:00:00.835026650  2597   0x201c60 DEBUG                    omx gstomx.c:1000:gst_omx_component_get_parameter:<omxwmvdec-omxvc1dec0> Got video_encode parameter at index 0x02000001: Bad port index (0x8000101b)
0:00:00.835532631  2597   0x201c60 ERROR                    omx gstomx.c:915:gst_omx_component_add_port:<omxwmvdec-omxvc1dec0> video_encode failed to add port 131: Bad port index (0x8000101b)

[Defiant]

Sounds like a bug to me, please report it at the GStreamer Bug tracker.

[hd1080ide]

ok cool, I copied them over:

/etc/apt/sources.list:

Code: Select all

deb http://vontaene.de/raspbian-updates/ . main

Is this still up-to-date?

I added this line to /etc/apt/sources.list but when I do sudo apt-get update it ignores the packages from http://vontaene.de. Besides, there is a 404 Error:

Code: Select all

[email protected] ~ $ sudo apt-get update
Ign http://vontaene.de . Release.gpg
OK   http://raspberrypi.collabora.com wheezy Release.gpg
OK   http://raspberrypi.collabora.com wheezy Release
Ign http://vontaene.de . Release
OK   http://mirrordirector.raspbian.org wheezy Release.gpg
OK   http://repository.wolfram.com stable Release.gpg
OK   http://mirrordirector.raspbian.org wheezy Release
OK   http://raspberrypi.collabora.com wheezy/rpi armhf Packages
OK   http://archive.raspberrypi.org wheezy Release.gpg
OK   http://archive.raspberrypi.org wheezy Release
OK   http://mirrordirector.raspbian.org wheezy/main armhf Packages
OK   http://repository.wolfram.com stable Release
OK   http://mirrordirector.raspbian.org wheezy/contrib armhf Packages
OK   http://archive.raspberrypi.org wheezy/main armhf Packages
OK   http://mirrordirector.raspbian.org wheezy/non-free armhf Packages
OK   http://mirrordirector.raspbian.org wheezy/rpi armhf Packages
OK   http://repository.wolfram.com stable/non-free armhf Packages
Ign http://raspberrypi.collabora.com wheezy/rpi Translation-de_DE
Fehl http://vontaene.de ./main armhf Packages
  404  Not Found
Ign http://raspberrypi.collabora.com wheezy/rpi Translation-de
Ign http://vontaene.de ./main Translation-de_DE
Ign http://raspberrypi.collabora.com wheezy/rpi Translation-en
Ign http://vontaene.de ./main Translation-de
Ign http://vontaene.de ./main Translation-en
Ign http://archive.raspberrypi.org wheezy/main Translation-de_DE
Ign http://archive.raspberrypi.org wheezy/main Translation-de
Ign http://archive.raspberrypi.org wheezy/main Translation-en
Ign http://repository.wolfram.com stable/non-free Translation-de_DE
Ign http://repository.wolfram.com stable/non-free Translation-de
Ign http://mirrordirector.raspbian.org wheezy/contrib Translation-de_DE
Ign http://repository.wolfram.com stable/non-free Translation-en
Ign http://mirrordirector.raspbian.org wheezy/contrib Translation-de
Ign http://mirrordirector.raspbian.org wheezy/contrib Translation-en
Ign http://mirrordirector.raspbian.org wheezy/main Translation-de_DE
Ign http://mirrordirector.raspbian.org wheezy/main Translation-de
Ign http://mirrordirector.raspbian.org wheezy/main Translation-en
Ign http://mirrordirector.raspbian.org wheezy/non-free Translation-de_DE
Ign http://mirrordirector.raspbian.org wheezy/non-free Translation-de
Ign http://mirrordirector.raspbian.org wheezy/non-free Translation-en
Ign http://mirrordirector.raspbian.org wheezy/rpi Translation-de_DE
Ign http://mirrordirector.raspbian.org wheezy/rpi Translation-de
Ign http://mirrordirector.raspbian.org wheezy/rpi Translation-en
W: Fehlschlag beim Holen von http://vontaene.de/rasbian-updates/dists/./main/binary-armhf/Packages  404  Not Found

E: Einige Indexdateien konnten nicht heruntergeladen werden. Sie wurden ignoriert oder alte an ihrer Stelle benutzt.

(I set german as default language and I don't know how to change it. Sorry for that.)

Am I doing something wrong?

Thanks for help!

[Defiant]

Check your spelling of "raspbian-updates", more precisely the 'p'.

[hd1080ide]

Thank you very much! I triple-checked the URL but i was blind for that 'p'.

[snehsach]

Hello All,

I am using Raspberry Pi from some streaming application using gstreamer. The decoded output is not realtime and is blocking and lagged for 1080p and 720p streams.

I have overclocked the board's to 950 Mhz and also increased the GPU memory usage to 256. I have installed the pre-build gstreamer using

# sudo apt-get install gstreamer1.0

Following is the set-up

I am using 2 Pi board, one as server and other as client. I am using following commands to stream 1080p mp4 stream .

Server command
gst-launch-1.0 -v filesrc location=stream1.mp4 ! qtdemux ! h264parse ! rtph264pay config-interval=1 timestamp=0 seqnum=0 perfect-rtptime=true ! udpsink port=5000 host=$IP_ADDRESS sync=true

Client command
gst-launch-1.0 -v udpsrc port=5000 caps="application/x-rtp, clock-rate=90000,encoding-name=H264,payload=96" ! queue ! rtpjitterbuffer ! rtph264depay ! h264parse ! omxh264dec ! eglglessink sync=true

Please let me know if I am missing any thing to play realtime 1080p stream in RaspberryPi using gstreamer1.0

Regards
Sachin

[michaeltyson]

I'm seeing the same thing, snehsach - although 720p works nice and smoothly as long as I use sync=false for eglglessink.

I might add that it's most definitely a problem on the playback end - if I use my Mac as a receiver, I get 1080p at full framerate, no problems.

It happens for me both with the vontaene.de debs and my own built from 1.2.3 source.

I've posted a question about it to the Gstreamer-devel mailing list: http://lists.freedesktop.org/archives/g ... 46440.html

I also noticed this bug report reporting poor performance at 1080p, from 29 May 2013, which has purportedly been solved: http://comments.gmane.org/gmane.comp.vi ... ugs/107759

Given that version 1.2.3 (which I've built from source and which still exhibits the 1080p framerate problem) was created 2 weeks ago, I would imagine this should have contained the fix described in that bug report. So, there's something still wrong.

[Kentzo]

What are the other parameters of your file? Could you attach output of `gst-discoverer --verbose <file>`?

[Kentzo]

Raspbian is based on Debian. Building and Installing Debian packages is well documented.
See http://www.debian.org/doc/manuals/maint-guide/

Yes, last Version I have compiled is 1.0.9.

If you just want to install them, see http://wiki.matthiasbock.net/index.php/ ... spberry_Pi

Could you add packages for the most recent versions of gstreamer?

[Defiant]

For the new Gstreamer versions (>1.0.x) I would like to have the raspbian people packaging them for jessie. Because the new versions need some dependencies which are not part of wheezy.

[Kentzo]

For the new Gstreamer versions (>1.0.x) I would like to have the raspbian people packaging them for jessie. Because the new versions need some dependencies which are not part of wheezy.

I'm not familiar with packagining system on linux. Do you mean that you cannot add missing deps to your own repo and recompile everything as needed? Do new packages conflict with wheezy?

[Defiant]

No, its I don't plan to add a dependency like some CD library.

[snehsach]

Yes Michael the problem is with the playback with gstreamer.

I was able to play 1080p with omxplayer with VLC streaming from my PC, only issue here is omxplayer cannot loop the udp stream

Do we need any more dependency to play realtime 1080p wth gstreamer.

Thanks,
Sachin

[allsorts]

Just downloaded Gst and OMX, after a fair bit of messing about to produce a working pipeline I've got it all working producing an H264 MP4 time lapse from jpg stills taken every minute. The issues I sorted out:

Only making an video file containing 56 frames - don't use hours & minutes to "sequentially" number your still images. Doh!

Red/green coloured noise section/bar along the bottom of the video. I think this may be down to my orginal stills being 800x450. Saw a comment in another place that H264 should have dimensions divisable by 16. Changed the jpg's to 800x448 and the bar has now gone but I also changed other things before looking at the output again.

Files playable but would crash or confuse some players. Using do-timestamp=1 with multifilesrc and dts-method=asc presentation-time=1 with mp4mux seems to have cured that and a DTS unable to reorder error.

The only problem I have now is that of video quality, it's very low. No detail, unless it moves, blocky, etc. If I try to use the control-rate or target-bitrate settings for omxh264enc it fails with:

Code: Select all

ERROR: Pipeline doesn't want to pause.
ERROR: from element /GstPipeline:pipeline0/GstOMXH264Enc-omxh264enc:omxh264enc-omxh264enc0: Could not initialise supporting library.
Additional debug info:
gstvideoencoder.c(1418): gst_video_encoder_change_state (): /GstPipeline:pipelin
e0/GstOMXH264Enc-omxh264enc:omxh264enc-omxh264enc0:
Failed to open encoder

With --gst-debug 5 this is the relevant bit of the log:

Code: Select all

omx gstomx.c:1019:gst_omx_component_set_parameter:<omxh264enc-omxh264enc0>
Set video_encode parameter at index 0x06000004: Bad parameter (0x80001005)
0:00:02.485850673  3601   0xeae000 ERROR   omxvideoenc gstomxvideoenc.c:307:gst_omx_video_enc_open:<omxh264enc-omxh264enc0
> Failed to set bitrate parameters: Bad parameter (0x80001005)
0:00:02.486065665  3601   0xeae000 WARN   videoencoder gstvideoencoder.c:1418:gst_video_encoder_change_state:<omxh264enc-o
mxh264enc0> error: Failed to open encoder

The orginal jpgs are pretty good, example here (updates every minute, so a black farme during local night): http://www.howhill.com/weather/webcam/camera-1.jpg I'm not scaling for the MP4. A short 10 s (660k) mp4 here: http://www.howhill.com/weather/webcam/camera-1.mp4.
None of the decode methods of jpegdec make any difference to the mp4. Finally my pipeline:

Code: Select all

gst-launch-1.0 multifilesrc \
  location="$path/camera-1-%04d.jpg" \
  index="$start_index" stop-index="$stop_index" \
  do-timestamp="1" \
  caps="image/jpeg,frameframerate=$framerate/1" ! \
  progressreport name=Progress: ! \
  jpegdec ! \
  omxh264enc ! \
  h264parse ! \
  mp4mux dts-method=asc presentation-time=1 ! \
  filesink location="$path/camera-1.mp4"

It's in a bash script hence the variables. If the video quality could improved I'd be a very happy bunny.

Will the omxh264enc control-rate and target-bitrate have the desired effect? Or is it just lack of source data from the jpg's, would upping their resolution/quality help? Currently they are produced by raspistill at 800x448 with quality 15 and sharpness 75 to get the filesize down to something sensible on a web page.

Cheers
Dave.

[erickpeniche]

Hi, i want to capture video with the C920 at the best possible quality to a file. Do i need gstreamer in order to do it or can i do it with v4l2? Thanks

[mr.fusion]

Hi Defiant,
first of all thank you very much for packaging gst-omx, works great!
One question: Are your packages signed? I imported the keys I found here: http://vontaene.de/apt/README.txt 0C667A3E
But on install I still get

Code: Select all

WARNING: The following packages cannot be authenticated!
  gir1.2-gstreamer-1.0 gir1.2-gst-plugins-base-1.0 libgstreamer1.0-dev libgstreamer-plugins-base1.0-dev
Install these packages without verification [y/N]?

Thank you!

[Defiant]

No sorry, its on the todo list to recompile them with the key one day.

(Actually my preferred solution is still to see the packages in stock raspbian)

[fmk]

Hi,

First of all: Defiant, thanks for packaging gstreamer! You are my hero
On arch I did not get any usefull output from gstreamer1.0 at all. (Well, I have to admit, I did not investigate any further, but it was not running "out-of-the-box" as your package does....)


To my problem:

I am trying to play a video and output the sound through pulseaudio.
Unfortunately, my pipeline

Code: Select all

gst-launch-1.0 filesrc location=big_buck_bunny_720p_h264.mov ! qtdemux name=demuxer demuxer. ! queue ! faad ! pulsesink device=0 sync=false  demuxer. ! queue max-size-bytes=30000000 ! h264parse ! omxh264dec ! queue max-size-buffers=6  ! eglglessink

does in fact play the video (even though its dropping some frames from time to time) but there is no sound at all.

If I run the audio part and the video part separately, both works fine:

Code: Select all

gst-launch-1.0 filesrc location=big_buck_bunny_720p_h264.mov ! qtdemux name=demuxer demuxer. ! queue max-size-bytes=30000000 ! h264parse ! omxh264dec ! queue max-size-buffers=6  ! eglglessink

Code: Select all

gst-launch-1.0 filesrc location=big_buck_bunny_720p_h264.mov ! qtdemux name=demuxer demuxer. ! queue ! faad ! pulsesink device=0 sync=false 

The video is running very smooth and the sound from pulse and my usb-soundcard is amazing compared to what I get from the 3.5mm-jack

I am not very experienced with gstreamer, so I have ground-loop distorted no clue what I am missing here.
I have been googleing around, but I did not find anything that has helped....

How do I tell gstreamer to use pulse as default audio sink? The same as with gstreamer0.10 (i.e. via gconftool-2)?

I would really appreciate it, if someone would have a tip for me to get it running...

[Defiant]

Your pipeline works for me if I use alsasink instead of pulseaudio. Sorry can't help you much since I'm not a user of pa, why do you need pa? - And did you try the playbin element?

Afaik gconf only sets the value for gconfaudiosink/gconvideosink, for autoaudiosink the rank is used.

[fmk]

It's not that I really need pa, it's more a matter of convenience
I have had the USB-soundcard running on a PC, that had to play sound from other computers in the network. This is basically obsolete now. But I remember back with pain to the time I had to get the card running at all and I never got a clear sound with alsa alone. After a little modification of the pulse config I got a crystal clear sound. Strange as it sounds, adding another layer fixes the sound...

Anyway I think I should do some digging into the mysteries of the alsa config. The pi's CPU will be happy too if I get it working without pulse, I guess....