6by9
Raspberry Pi Engineer & Forum Moderator
Raspberry Pi Engineer & Forum Moderator
Posts: 5793
Joined: Wed Dec 04, 2013 11:27 am
Location: ZZ9 Plural Z Alpha, aka just outside Cambridge.

Re: Raw sensor access / CSI-2 receiver peripheral

Wed Jul 25, 2018 10:34 am

@luiscgalo: branching the conversation off to a new thread, as we've now got three interleaved conversations going on. I'll respond there.
viewtopic.php?f=43&t=218928
(I'll be doing the same thing with grimepoch's thread in a moment).
Software Engineer at Raspberry Pi Trading. Views expressed are still personal views.
Please don't send PMs asking for support - use the forum.
I'm not interested in doing contracts for bespoke functionality - please don't ask.

6by9
Raspberry Pi Engineer & Forum Moderator
Raspberry Pi Engineer & Forum Moderator
Posts: 5793
Joined: Wed Dec 04, 2013 11:27 am
Location: ZZ9 Plural Z Alpha, aka just outside Cambridge.

Re: Raw sensor access / CSI-2 receiver peripheral

Wed Jul 25, 2018 10:56 am

@grimepoch: As with luiscgalo, branching the conversation off to a new thread.
viewtopic.php?f=43&t=218933
Software Engineer at Raspberry Pi Trading. Views expressed are still personal views.
Please don't send PMs asking for support - use the forum.
I'm not interested in doing contracts for bespoke functionality - please don't ask.

6by9
Raspberry Pi Engineer & Forum Moderator
Raspberry Pi Engineer & Forum Moderator
Posts: 5793
Joined: Wed Dec 04, 2013 11:27 am
Location: ZZ9 Plural Z Alpha, aka just outside Cambridge.

Re: Raw sensor access / CSI-2 receiver peripheral

Wed Jul 25, 2018 11:57 am

General comment, if you're looking at interfacing a new chip/sensor/FPGA/thingamebob in, please start a new thread and post a link on this thread.
This thread is already 20 pages long, and is likely to grow in a fairly uncontrolled manner if people try adding all sorts of random support requests on it.
Thank you.
Software Engineer at Raspberry Pi Trading. Views expressed are still personal views.
Please don't send PMs asking for support - use the forum.
I'm not interested in doing contracts for bespoke functionality - please don't ask.

Edeard95
Posts: 3
Joined: Tue Jul 17, 2018 4:07 pm

Re: Raw sensor access / CSI-2 receiver peripheral

Mon Jul 30, 2018 4:37 pm

Question relating to the process of adding sensor compatibility:

viewtopic.php?f=43&t=219263

6by9
Raspberry Pi Engineer & Forum Moderator
Raspberry Pi Engineer & Forum Moderator
Posts: 5793
Joined: Wed Dec 04, 2013 11:27 am
Location: ZZ9 Plural Z Alpha, aka just outside Cambridge.

Re: Raw sensor access / CSI-2 receiver peripheral

Mon Aug 20, 2018 5:07 pm

There appears to be a further issue with rawcam in the latest firmwares (since the July 30th release) where it is even more prone to getting buffers out of step. I am investigating.

If people want to play, then I have done a significant hack around with raspiraw to optionally run a very simple grey world AWB algorithm. See https://github.com/6by9/raspiraw/tree/temp_awb. It could do with some rough edges being cleaned up (almost no error handling!), but I'm tempted to merge it back into master anyway.
That branch also includes a fix for IMX219 having H & V flips swapped. I'm slightly surprised that hadn't been picked up before (or apologies if it had been reported and I totally missed it).
Software Engineer at Raspberry Pi Trading. Views expressed are still personal views.
Please don't send PMs asking for support - use the forum.
I'm not interested in doing contracts for bespoke functionality - please don't ask.

VinoE
Posts: 2
Joined: Tue Aug 21, 2018 12:08 pm

Re: Raw sensor access / CSI-2 receiver peripheral

Thu Aug 23, 2018 10:04 am

Hello,

I'm just starting in RB Pi world and I would like some help with a project related to this thread's work. I have a Camera which sends its data (Pan or Bayer filtered) via 1 LVDS channel at 120MHz, it also has a Byte Strobe differential signal and the Clock.

I have a RB Pi Zero and I don't know if I can use its Camera connector and CSI 2 or if I should use the GPIO. In either case, besides the LVDS to Sub LVDS or 3v3CMOS conversion, what other aspects should I consider to achieve the speed and communication I want?

Thank you for your help,

Eddy

6by9
Raspberry Pi Engineer & Forum Moderator
Raspberry Pi Engineer & Forum Moderator
Posts: 5793
Joined: Wed Dec 04, 2013 11:27 am
Location: ZZ9 Plural Z Alpha, aka just outside Cambridge.

Re: Raw sensor access / CSI-2 receiver peripheral

Thu Aug 23, 2018 10:16 am

VinoE wrote:
Thu Aug 23, 2018 10:04 am
I'm just starting in RB Pi world and I would like some help with a project related to this thread's work. I have a Camera which sends its data (Pan or Bayer filtered) via 1 LVDS channel at 120MHz, it also has a Byte Strobe differential signal and the Clock.

I have a RB Pi Zero and I don't know if I can use its Camera connector and CSI 2 or if I should use the GPIO. In either case, besides the LVDS to Sub LVDS or 3v3CMOS conversion, what other aspects should I consider to achieve the speed and communication I want?
Sorry, the Pi doesn't support LVDS, and GPIOs will be too slow.

There are bridge chips around that will convert from various interfaces to MIPI CSI2. A quick Google would provide you with hits such as
http://www.latticesemi.com/Products/Des ... ridge.aspx (FPGA solution, and Sony sub-LVDS to CSI2)
or https://e2e.ti.com/support/interface/hi ... 8/t/614881 suggesting the TI DS90UH947-Q1 feeding a DS90UH940-Q1,
or http://www.lontiumsemi.com/uploadfiles/ ... _Brief.pdf

You'll need to do your own research to find a conversion solution that matches your use case.
Software Engineer at Raspberry Pi Trading. Views expressed are still personal views.
Please don't send PMs asking for support - use the forum.
I'm not interested in doing contracts for bespoke functionality - please don't ask.

6by9
Raspberry Pi Engineer & Forum Moderator
Raspberry Pi Engineer & Forum Moderator
Posts: 5793
Joined: Wed Dec 04, 2013 11:27 am
Location: ZZ9 Plural Z Alpha, aka just outside Cambridge.

Re: Raw sensor access / CSI-2 receiver peripheral

Thu Aug 23, 2018 10:46 am

For those seing issues with rawcam, I've put a new firmware at https://drive.google.com/file/d/1pfj5OY ... sp=sharing that I believe fixes the problem. Please test and report back. It should get merged into the main firmware releases in the next few days anyway.
Software Engineer at Raspberry Pi Trading. Views expressed are still personal views.
Please don't send PMs asking for support - use the forum.
I'm not interested in doing contracts for bespoke functionality - please don't ask.

VinoE
Posts: 2
Joined: Tue Aug 21, 2018 12:08 pm

Re: Raw sensor access / CSI-2 receiver peripheral

Thu Aug 23, 2018 12:10 pm

6by9 wrote:
Thu Aug 23, 2018 10:16 am
VinoE wrote:
Thu Aug 23, 2018 10:04 am
I'm just starting in RB Pi world and I would like some help with a project related to this thread's work. I have a Camera which sends its data (Pan or Bayer filtered) via 1 LVDS channel at 120MHz, it also has a Byte Strobe differential signal and the Clock.

I have a RB Pi Zero and I don't know if I can use its Camera connector and CSI 2 or if I should use the GPIO. In either case, besides the LVDS to Sub LVDS or 3v3CMOS conversion, what other aspects should I consider to achieve the speed and communication I want?
Sorry, the Pi doesn't support LVDS, and GPIOs will be too slow.

There are bridge chips around that will convert from various interfaces to MIPI CSI2. A quick Google would provide you with hits such as
http://www.latticesemi.com/Products/Des ... ridge.aspx (FPGA solution, and Sony sub-LVDS to CSI2)
or https://e2e.ti.com/support/interface/hi ... 8/t/614881 suggesting the TI DS90UH947-Q1 feeding a DS90UH940-Q1,
or http://www.lontiumsemi.com/uploadfiles/ ... _Brief.pdf

You'll need to do your own research to find a conversion solution that matches your use case.
Thanks for your repply 6by9. One last question, after the conversion to CSI2, what do I need to do in order to access these port in the Raspberry? As far as I read, this port only supports the Raspberry Camera Module.

Thank you,

Eddy

6by9
Raspberry Pi Engineer & Forum Moderator
Raspberry Pi Engineer & Forum Moderator
Posts: 5793
Joined: Wed Dec 04, 2013 11:27 am
Location: ZZ9 Plural Z Alpha, aka just outside Cambridge.

Re: Raw sensor access / CSI-2 receiver peripheral

Thu Aug 23, 2018 12:21 pm

VinoE wrote:
Thu Aug 23, 2018 12:10 pm
Thanks for your repply 6by9. One last question, after the conversion to CSI2, what do I need to do in order to access these port in the Raspberry? As far as I read, this port only supports the Raspberry Camera Module.
You have two choices, both of them requiring some effort from you.

First is that there is a V4L2 driver for the CSI2 peripheral. You need to connect it to a sensor driver, and it then delivers frames back via V4L2.
This is the preferred route.

Second there is the firmware based driver being discussed on this thread - a MMAL component called rawcam.
raspiraw is an example app that uses that component. All setup of the sensor is down to the application. raspiraw has example register commands to configure either version of the Pi camera (and an analogue video chip). You need to add the relevant config to set up your sensor.
Software Engineer at Raspberry Pi Trading. Views expressed are still personal views.
Please don't send PMs asking for support - use the forum.
I'm not interested in doing contracts for bespoke functionality - please don't ask.

HermannSW
Posts: 781
Joined: Fri Jul 22, 2016 9:09 pm

Re: Raw sensor access / CSI-2 receiver peripheral

Fri Oct 05, 2018 9:55 pm

I did not do much high framerate capturing lately. Only simple 180fps raspivid videos of payload dropped from drone.

I got asked whether Pi camera can do [email protected], the 640xH high framerate modes were not sufficient horizontal resolution for scanner camera application.

I did test with v2 camera today, started with 3280x2464 tool and then: half vertical resolution, double framerate, repeat.
I ended up at 998fps for 3280x32, but a frame skip rate that I did not like.
I reduced to framerate with <1% frame skips, and that was 720fps.
I did same for 3280x64 and ended up with 500fps.

Summary:
v2 camera can do [email protected] and [email protected] with frame skip rate less than 1% (tools attached).
Similar to be expected for v1 camera (a little more than half the corresponding v2 framerate).
Attachments
3280fast.zip
(1.19 KiB) Downloaded 15 times
bookmark list: https://stamm-wilbrandt.de/en/Raspberry_camera.html

https://github.com/Hermann-SW/fork-raspiraw      https://github.com/Hermann-SW/userland
https://github.com/Hermann-SW/wireless-control-Eachine-E52-drone      https://twitter.com/HermannSW

Mike_green
Posts: 7
Joined: Wed Oct 17, 2018 6:36 am

Re: Raw sensor access / CSI-2 receiver peripheral

Mon Oct 22, 2018 9:00 am

Hi there! Here is our post about AR0144 sensor. Could you give us some tips?
viewtopic.php?f=43&t=225272

Return to “Camera board”