ffinsterbusch
Posts: 3
Joined: Thu Jun 04, 2020 2:32 pm

Problem, the entire system is erased

Thu Jun 04, 2020 4:22 pm

Dear Raspberry PI comunity,

Along with saying hello, I introduce myself, my name is Fernando Finsterbusch, and I work in the development department of an environmental control company in Chile.
We have been using the Raspberry PI 3 for some years for the design and manufacture of gas measurement equipment in real time, using code in Python.

In the last time we have experienced some complications to which we cannot find a solution.

In certain situations, the Raspbian system starts to fail up to a point where the microSD card is completely erased, upon testing we notice that the services are gradually falling, first the SFTP, then the SSH, openVPN, etc., even when we are still still connected to the computer, stop recognizing basic commands like sudo, ls, cd, etc.

We are currently using the following configuration on all our field equipment:


- Raspberry PI 3
- MicroSD Kingston Class 10
- Raspbian 9
- Python 2.7
- 2G connection with Sim800L via UART

Although we have almost 80 devices operating in the field today, this has happened to us in certain situations, mainly with the new communication integrations, the tests we have carried out are the following:

Test 1:
- Raspberry PI 3
- MicroSD Kingston Class 10
- Raspbian 9 (stretch)
- Python 2.7
- 3G connection with 3G UL865-NAD (digi 3Gbee) via UART

SAME FAILURE

Test2:
- Raspberry PI 3
- MicroSD Kingston 10 Class
- Raspbian 9 (buster)
- Python 3
- GPRS connection with 3G UL865-NAD (digi 3Gbee) via UART

It had no problems for a long time in the laboratory (2 months), when installed in the field, it lasted 24 hours and had the same failure.

Test 3:
- Raspberry PI 3
- MicroSD Kingston 10 Class
- Raspbian 9 (stretch)
- Python 2.7
- Navigateworx industrial router connected via ethernet

It worked in the field for almost 48 hours and presented the same failure.

Test 4:

- Raspberry PI 3
- MicroSD Kingston 10 Class
- Raspbian 9 (stretch)
- Python 2.7
- Teltonika RUT950 industrial router connected via wifi.


It has been operating for almost 2 weeks without problems.


The strangest thing is that a couple of days ago, we connected remotely via SSH and / or SFTP to some devices that had been operating for a long time, to do an update of a couple of lines of code, and when making the modifications, presented the same fails (devices with original configuration).

Every time we review MicroSD cards after failures, they are completely erased, only with the original blank partition.

I thank you in advance for your comments and brainstorming that can lead us to the solution of our problem.
Viva RaspberryPI

ShiftPlusOne
Raspberry Pi Engineer & Forum Moderator
Raspberry Pi Engineer & Forum Moderator
Posts: 6228
Joined: Fri Jul 29, 2011 5:36 pm
Location: The unfashionable end of the western spiral arm of the Galaxy

Re: Problem, the entire system is erased

Thu Jun 04, 2020 4:25 pm

I wonder if you'd find f2fs any more reliable, or if it fails in the same way.

viewtopic.php?f=66&t=273490

lane
Posts: 3
Joined: Thu Jun 04, 2020 3:58 pm

Re: Problem, the entire system is erased

Thu Jun 04, 2020 6:17 pm

This sounds like SD corruption. Do you cleanly shut down the pis or do you just unplug them?

ffinsterbusch
Posts: 3
Joined: Thu Jun 04, 2020 2:32 pm

Re: Problem, the entire system is erased

Fri Jun 05, 2020 2:10 am

lane wrote:
Thu Jun 04, 2020 6:17 pm
This sounds like SD corruption. Do you cleanly shut down the pis or do you just unplug them?
Thanks for the answer.

It is a permanently powered system with a power source with UPS function, we believe that we have programmed all kinds of shutdown or restart in Python to be done safely.

ffinsterbusch
Posts: 3
Joined: Thu Jun 04, 2020 2:32 pm

Re: Problem, the entire system is erased

Fri Jun 05, 2020 2:16 am

ShiftPlusOne wrote:
Thu Jun 04, 2020 4:25 pm
I wonder if you'd find f2fs any more reliable, or if it fails in the same way.

viewtopic.php?f=66&t=273490
we are pretty sure that we are dealing with microsd card corruption but it has been difficult to find the reason.
I think this is a very good idea, we have not tested with that file system.

I will do the tests and tell how it goes

Really thanks

Return to “Advanced users”