A cheap way to get HDMI input to Raspberry Pi

[BliMatrix]

This is a cheap way to get HDMI input to Raspberry Pi.The main chip of the module is Toshiba TC358743XBG. It's usage is exactly the same as the ordinary Raspberry Pi camera.https://www.youtube.com/watch?v=lYQuocM7VPI

[RaTTuS]

viewtopic.php?t=101999
https://raspberrypi.org/forums/viewtopi ... 8&t=120702
but ^^ is selling for$20....

[6by9]

As you're using the same handle here as YouTube, I assume you are the person manufacturing.

Please be very aware that using raspivid etc with this chip is very limited (720P only) and is NOT SUPPORTED. raspivid will even print that every time you run it with this chip attached.

Having said that, the links that RaTTus has linked to details how to use the Linux kernel drivers (which are supported), and those allow you to capture up to 1080P50 from the chip. I'm glad to see that you have brought out the I2S audio pins as well, as those can be linked up to capture synchronised audio too. It's all relatively easy using a recent build of GStreamer (Raspbian Stretch is a touch too old though).

At that price I expect people will be biting your hand off - I'm tempted to order a couple of spares! The alternative board is the Auvidea B101 https://auvidea.eu/product/70501/. That comes in at ~£65 via mouser.com
(~£78 for the B102 which should allow 1080P60, but the H264 encoder will struggle at that. Even 1080P50 requires an overclock).

[BliMatrix]

As you're using the same handle here as YouTube, I assume you are the person manufacturing.

Please be very aware that using raspivid etc with this chip is very limited (720P only) and is NOT SUPPORTED. raspivid will even print that every time you run it with this chip attached.

Having said that, the links that RaTTus has linked to details how to use the Linux kernel drivers (which are supported), and those allow you to capture up to 1080P50 from the chip. I'm glad to see that you have brought out the I2S audio pins as well, as those can be linked up to capture synchronised audio too. It's all relatively easy using a recent build of GStreamer (Raspbian Stretch is a touch too old though).

At that price I expect people will be biting your hand off - I'm tempted to order a couple of spares! The alternative board is the Auvidea B101 https://auvidea.eu/product/70501/. That comes in at ~£65 via mouser.com
(~£78 for the B102 which should allow 1080P60, but the H264 encoder will struggle at that. Even 1080P50 requires an overclock).

Thanks! I am the module manufacturer,I hope you can contact me hzzfly@gmail.com

[RaTTuS]

where are you based and do you accept paypal

[BliMatrix]

where are you based and do you accept paypal

Beijing,China.The module can be booked by mail and paid by paypal. Contact hzzfly@gmail.com

[RaTTuS]

Ill bite ..... email sent

[fanoush]

This is a cheap way to get HDMI input to Raspberry Pi.The main chip of the module is Toshiba TC358743XBG. It's usage is exactly the same as the ordinary Raspberry Pi camera.https://www.youtube.com/watch?v=lYQuocM7VPI

Why the video mentions 1080p/25fps? Is more fps possible? This is because of some limit on Pi side?
Toshiba page mentions 1920x1080, 60 fps, 24 bpp

As for Pi side can this work as passthru to hdmi out (possibly including audio) with some overlays drawn over it?

[6by9]

This is a cheap way to get HDMI input to Raspberry Pi.The main chip of the module is Toshiba TC358743XBG. It's usage is exactly the same as the ordinary Raspberry Pi camera.https://www.youtube.com/watch?v=lYQuocM7VPI

Why the video mentions 1080p/25fps? Is more fps possible? This is because of some limit on Pi side?
Toshiba page mentions 1920x1080, 60 fps, 24 bpp

As for Pi side can this work as passthru to hdmi out (possibly including audio) with some overlays drawn over it?

The video is using the unsupported firmware drivers for this chip via raspivid.
This advertises a fixed EDID which says 720P60 is the preferred and native mode. I thought it didn't support anything other than 720P60, but there may be some mode switching supported in there (I'm not going to investigate).
Using this path you are limited in modes and data rates, and I will not be fixing anything that doesn't work as you want it.

Using the Linux kernel drivers, it exposes options to run the CSI2 lanes faster (972Mbits/s/lane), and choose between 24bpp RGB and 16bpp UYVY formats.
Very rough calcs (mainly as they ignore the blanking periods which do have to be considered)
1920*1080*16bpp is 33177600bits/frame. Over 2 lanes you have 2*972 = 1944 Mbits/s available. 1944*1000000 / 33177600 = 58.5fps.
(1920*1080*24bpp is 49766400bits/frame -> 39.0fps)

For things like video encoding you want YUV420, therefore the conversion on the TC358743 doesn't lose you anything you wouldn't have thrown away anyway.
With 4 lanes you can capture 1080P60 into memory, but requires a Compute Module (and Auvidea B102) to do so.

The codec block is only rated at 1080P30. With an overclock I have captured 1080P50 UYVY, although I don't recall how thoroughly I checked for frame drops.

Yes, you can render this through to the HDMI output with additional layers on top, up to the limits of the HVS.

It appears that the relevant audio pins have been brought through to a pin header, therefore you should be able to use the same wiring I got working on the B101/102 - viewtopic.php?f=38&t=120702&start=400#p1339178

AFAIK there are no simple plug and play tools for using this. The closest is GStreamer (1.14 or above) as it supports using dma-bufs for efficient buffer passing between components. You still have to do some setup manually as it does not support setting the DV timings parameters for the chip first, nor does it handle resolution changes.

[BliMatrix]

This is a cheap way to get HDMI input to Raspberry Pi.The main chip of the module is Toshiba TC358743XBG. It's usage is exactly the same as the ordinary Raspberry Pi camera.https://www.youtube.com/watch?v=lYQuocM7VPI

Why the video mentions 1080p/25fps? Is more fps possible? This is because of some limit on Pi side?
Toshiba page mentions 1920x1080, 60 fps, 24 bpp

As for Pi side can this work as passthru to hdmi out (possibly including audio) with some overlays drawn over it?

The limit is indeed in Pi.
This is the python code used in my video.The Pi uses an official image with no other changes.

Code: Select all

from picamera import PiCamera
from time import sleep
camera = PiCamera()
camera.start_preview()
sleep(1000)
camera.stop_preview()

The HDMI source supported by Raspberry Pi with the module is 720p50,720p60,1080i50,1080p24,1080p25. Lower resolution is also working

[6by9]

This is a cheap way to get HDMI input to Raspberry Pi.The main chip of the module is Toshiba TC358743XBG. It's usage is exactly the same as the ordinary Raspberry Pi camera.https://www.youtube.com/watch?v=lYQuocM7VPI

Why the video mentions 1080p/25fps? Is more fps possible? This is because of some limit on Pi side?
Toshiba page mentions 1920x1080, 60 fps, 24 bpp

As for Pi side can this work as passthru to hdmi out (possibly including audio) with some overlays drawn over it?

The limit is indeed in Pi.
This is the python code used in my video.The Pi uses an official image with no other changes.

Code: Select all

from picamera import PiCamera
from time import sleep
camera = PiCamera()
camera.start_preview()
sleep(1000)
camera.stop_preview()

The HDMI source supported by Raspberry Pi with the module is 720p50,720p60,1080i50,1080p24,1080p25. Lower resolution is also working

I will stress again, the use of the firmware is unsupported, and may be removed at a future point in time. It was code written for a demo, and is quite likely to include bugs. The use of the kernel drivers is very strongly recommended.

I'd be very surprised if it actually worked with 1080i50 even though it is advertised in the EDID. Nothing in the camera stack supports deinterlacing, and the way the TC358743 transports interlaced video is odd to say the least. And, no, I'm not going to fix it (see the note about it being unsupported!)

[XiLENCE]

Hi,

if I connect a camera via HDMI to the auvidea board, will the b101 also feed the raspberry pi with sound coming from the camera over the HDMI-cable? Or does it only support video-input and no audio directly over HDMI?

[6by9]

Hi,

if I connect a camera via HDMI to the auvidea board, will the b101 also feed the raspberry pi with sound coming from the camera over the HDMI-cable? Or does it only support video-input and no audio directly over HDMI?

You ask about the Auvidea board on a post that is about an alternative? Ho hum.

Audio can be routed out as I2S from the TC358743. The later versions of the B101/102 boards have I2S brought out to pin headers on the side of the board (it is not routed up the flexi cable). See viewtopic.php?f=38&t=120702&start=400#p1339178 for configuration.

[6by9]

I'm just wondering if anyone has actually bitten and received one (or more) of these.
I have emailed them and had a price back for shipping, but been busy with other things so held off actually ordering. Throwing random money via Paypal always seems a little iffy.

[6by9]

I'm just wondering if anyone has actually bitten and received one (or more) of these.
I have emailed them and had a price back for shipping, but been busy with other things so held off actually ordering. Throwing random money via Paypal always seems a little iffy.

Anyone?

[RaTTuS]

not got one yet - I've nto heard anything for them

[allegfede]

I sent an email to ask if item still avalaible.

No answer 'till now

[no sleep]

I got mine in June, delivery to Germany took 2 weeks after placing the order. It's working as described but I couldn't get any audio out of it. My support request via email from June 28th is still unanswered. Not sure what is happening there.

Therefore I switched to the Elgato CamLink 4K on the RPI4 to capture and stream in 720p60.

[onos9]

This is a cheap way to get HDMI input to Raspberry Pi.The main chip of the module is Toshiba TC358743XBG. It's usage is exactly the same as the ordinary Raspberry Pi camera.https://www.youtube.com/watch?v=lYQuocM7VPI

This is my first time posting in this forum, just want ask if anyone has successfully purchase and use this board. thanks

[htcohio]

This is a cheap way to get HDMI input to Raspberry Pi.The main chip of the module is Toshiba TC358743XBG. It's usage is exactly the same as the ordinary Raspberry Pi camera.https://www.youtube.com/watch?v=lYQuocM7VPI

This is my first time posting in this forum, just want ask if anyone has successfully purchase and use this board. thanks

Hi,

Yes it definitely works. We use it for OpenHD / Wifibroadcast.

Just be advised that different action camera output settings seem to vary with what works as the video input.

Here is a video I posted.
https://youtu.be/SM8dHXmP0Nw

[mattkrebs]

I got mine in June, delivery to Germany took 2 weeks after placing the order. It's working as described but I couldn't get any audio out of it. My support request via email from June 28th is still unanswered. Not sure what is happening there.

Therefore I switched to the Elgato CamLink 4K on the RPI4 to capture and stream in 720p60.

did you ever get this working on your RPI4 and CamLink? Would be curious to know how you did it.

Thanks

[no sleep]

did you ever get this working on your RPI4 and CamLink? Would be curious to know how you did it.

Thanks

Yeah it worked with (almost) no issues with a stock raspbian buster, my ffmpeg command line for streaming to twitch is as follows:

Code: Select all

ffmpeg -f v4l2 -framerate 60 -input_format yuyv422 -i /dev/video0 -f alsa -itsoffset 0.2 -i hw:1,0 -acodec aac -ab 128k \
-vcodec h264_omx -profile:v high -vsync 0 -b:v 4500k -minrate 4500k -maxrate 4500k -bufsize 9000k -f flv "rtmp://live-fra.twitch.tv/app/$STREAM_KEY"

The audio was slightly out of sync so I added -itsoffset.
I configured my source device (Nintendo Switch in my case) to output 720p, because ffmpeg stalls with resolutions > 720p. I never experienced any dropped frames and the cpu load is around 50-60%. The CPU is not overclocked and the RPI case is the Armor-"sandwich" without fans.

Feel free to ask if there's anything unclear.

[Tom42 59]

it might not be in your code but how do you add a duration for the video. I was hoping to create an automatic security camera but i cant get a correct time duration duration on it.

[allegfede]

This is a cheap way to get HDMI input to Raspberry Pi.The main chip of the module is Toshiba TC358743XBG. It's usage is exactly the same as the ordinary Raspberry Pi camera.https://www.youtube.com/watch?v=lYQuocM7VPI

This is my first time posting in this forum, just want ask if anyone has successfully purchase and use this board. thanks

Hi,

Yes it definitely works. We use it for OpenHD / Wifibroadcast.

Just be advised that different action camera output settings seem to vary with what works as the video input.

Here is a video I posted.
https://youtu.be/SM8dHXmP0Nw

trying to use this boards (not the auvidea b101, but the "chinese" ones) with no success:

The driver for the TC358743 HDMI to CSI2 chip you are using is NOT supported.
They were written for a demo purposes only, and are in the firmware on an as-is
basis and therefore requests for support or changes will not be acted on.

seems there where some changes in kernel and drivers from your test htcohio ...

do you have your original image to test against? could you please upload it on mega.nz or other site?
thanks

[6by9]

trying to use this boards (not the auvidea b101, but the "chinese" ones) with no success:

The driver for the TC358743 HDMI to CSI2 chip you are using is NOT supported.
They were written for a demo purposes only, and are in the firmware on an as-is
basis and therefore requests for support or changes will not be acted on.

seems there where some changes in kernel and drivers from your test htcohio ...

do you have your original image to test against? could you please upload it on mega.nz or other site?
thanks

It's been stated that the use of raspivid and tc358743 is on an as-is basis since November 2017
They should work, but I'm not interested should you have issues.