Torrent server


197 posts   Page 5 of 8   1, 2, 3, 4, 5, 6, 7, 8
by juanmol » Tue Jun 26, 2012 10:54 pm
transmission and qbitorrent, and a nas mount using cifs. I have try to use rtorrent but i have no idea ;-)
Posts: 44
Joined: Thu May 17, 2012 10:43 am
by errikos » Tue Jun 26, 2012 11:03 pm
Hmmm I think it works because of the nas thing... The problem occurs in my case if I try to download to a usb drive. Probably because Ethernet and USB shares the same bandwidth... If it is possible, can you try downloading to a USB HDD or flash drive?
Posts: 30
Joined: Thu Feb 09, 2012 12:47 pm
by errikos » Tue Jun 26, 2012 11:12 pm
juanmol wrote:i'm using now the uukrul img and ... works! i don't know why but works. The only thing i don't understand is that i had to change the name of the interface from eth0 to eth1 in /etc/network/interfaces
I'm trying with 5 of the top 100 of piratebay magnets ... i can't believe, why?


It works with a USB drive?
Posts: 30
Joined: Thu Feb 09, 2012 12:47 pm
by david_Est » Tue Jun 26, 2012 11:16 pm
errikos wrote:
juanmol wrote:i'm using now the uukrul img and ... works! i don't know why but works. The only thing i don't understand is that i had to change the name of the interface from eth0 to eth1 in /etc/network/interfaces
I'm trying with 5 of the top 100 of piratebay magnets ... i can't believe, why?


It works with a USB drive?

I'm using it with a external USB hard disk and it works!
Posts: 6
Joined: Sun Jun 17, 2012 4:58 pm
by errikos » Wed Jun 27, 2012 12:12 am
david_Est wrote:
errikos wrote:
juanmol wrote:i'm using now the uukrul img and ... works! i don't know why but works. The only thing i don't understand is that i had to change the name of the interface from eth0 to eth1 in /etc/network/interfaces
I'm trying with 5 of the top 100 of piratebay magnets ... i can't believe, why?


It works with a USB drive?

I'm using it with a external USB hard disk and it works!

With what client?
Posts: 30
Joined: Thu Feb 09, 2012 12:47 pm
by raspberrypivictim » Wed Jun 27, 2012 6:30 am
I was also experiencing kernel panic issues under Debian Squeeze when using rtorrent after fifteen minutes usage. Yesterday I updated the firmware via rpi-update and then upgraded to kernel 3.2.21

The rtorrent client has been working since then for more than twelve hours without kernel panic. Only one torrent file, no upload/download limit, not sure about this but at an average speed of 20 KB/s, arround 5% cpu usage, and sd card download directory

I still need to do more testing, but I think this is a good starting point to use the rpi as a full-time light torrent/donkey client.

I hope this would work for somebody else.
Posts: 29
Joined: Sun Jan 22, 2012 10:35 pm
by uukrul » Wed Jun 27, 2012 6:42 am
errikos wrote:With what client?


transmission-daemon
Posts: 43
Joined: Mon Jun 25, 2012 10:27 am
by errikos » Wed Jun 27, 2012 12:35 pm
raspberrypivictim wrote:I was also experiencing kernel panic issues under Debian Squeeze when using rtorrent after fifteen minutes usage. Yesterday I updated the firmware via rpi-update and then upgraded to kernel 3.2.21

The rtorrent client has been working since then for more than twelve hours without kernel panic. Only one torrent file, no upload/download limit, not sure about this but at an average speed of 20 KB/s, arround 5% cpu usage, and sd card download directory

I still need to do more testing, but I think this is a good starting point to use the rpi as a full-time light torrent/donkey client.

I hope this would work for somebody else.

Can you try downloading to a USB drive? I believe that is the one that causes problems (and the most usual use case as well)

Thank you! It is good to see some progress...
Posts: 30
Joined: Thu Feb 09, 2012 12:47 pm
by NotungX » Wed Jun 27, 2012 6:21 pm
I had lot of crashes the past days using transmission-daemon in raspbian (hexx image) with the latest firmware. However I had the kernel 3.2.19 or 3.2.20 (don't remember well right now). As I could not manage to compile nodejs with hardfloat support I installed squeeze.

Now I have the Squeeze from the download section of raspberry with a kernel 3.2.21-rpi1+ downladed from Chris (http://www.bootc.net/projects/raspberry-pi-kernel/) and the latest firmware installed with hexx's rpi-update tool.

Till now I've been downloading for a few hours @1MB/s with no crashes using transmission daemon.

:D

I have to say that this looks really good now... (let's hope it continues like this).

BTW, I am also using ethernet (no wifi) and downloading to the sd card... not the worst of the scenarios but two days ago this was crashing as well. Will try to do it to NAS/USB HD.

In my /etc/sysctl.conf I have at the end the following lines as well:
vm.min_free_kbytes = 8192
vm.swappiness=1

I hope it will work for you...

Greetings,

NotungX

PS: I think that yesterday they updated the kernel in raspbian to 2.6.21-rpi1+ so if you have raspbian try upgrading first and updating the firmware!
Posts: 1
Joined: Wed Jun 27, 2012 6:01 pm
by raspberrypivictim » Fri Jun 29, 2012 7:33 am
errikos wrote:Can you try downloading to a USB drive? I believe that is the one that causes problems (and the most usual use case as well)

Thank you! It is good to see some progress...


The rtorrent has been downloading 2 files into a usb directory during the whole night without a kernel panic. Not sure about how much time or speed as my flat mat shutdowns the router sometime during early morning.

With last kernel/firmware, kernel panic appeared after only few usage minutes.
Posts: 29
Joined: Sun Jan 22, 2012 10:35 pm
by errikos » Fri Jun 29, 2012 11:43 am
NotungX wrote:PS: I think that yesterday they updated the kernel in raspbian to 2.6.21-rpi1+ so if you have raspbian try upgrading first and updating the firmware!


How can I do that? Do you use Hexxeh image? Just downloaded it and in apt-get upgrade or apt-get dist-upgrade id does not show a new kernel...
Posts: 30
Joined: Thu Feb 09, 2012 12:47 pm
by Sc0ut » Fri Jun 29, 2012 2:45 pm
uukrul wrote:You can download my image from here: http://athletictv.es/uukrul/raspbian_de ... _25_06.rar

Test and report.


How can I mount my own drive as you did with your maxtor?
Posts: 9
Joined: Tue Jan 17, 2012 11:10 am
by errikos » Sat Jun 30, 2012 12:32 pm
So I took my DSLR and managed to capture the kernel message. I hope it will help with the debugging.
The configuration is Raspbian hexxeh image updated with apt-get update && apt-get dist-upgrade, stock kernel, firmware updated with rpi-update today.
Downloading from ethernet to a USB HDD drive @ about 800KB/sec with rtorrent
After ~ 2 minutes it crashed. The screen kept printing this:

I have not used any other parameters like
vm.min_free_kbytes = 8192

Image
Posts: 30
Joined: Thu Feb 09, 2012 12:47 pm
by errikos » Sat Jun 30, 2012 5:11 pm
I tried the default squeeze image with the upgraded kernel and the new firmware from rpi-update and it seems to work ok!
just 2 problems:
1) Dmesg is flooded with this message:

[ 3729.788441] smsc95xx 1-1.1:1.0: eth0: kevent 2 may have been dropped
[ 3729.788464] smsc95xx 1-1.1:1.0: eth0: kevent 2 may have been dropped
[ 3729.788509] smsc95xx 1-1.1:1.0: eth0: kevent 2 may have been dropped
[ 3729.788538] smsc95xx 1-1.1:1.0: eth0: kevent 2 may have been dropped
[ 3729.788563] smsc95xx 1-1.1:1.0: eth0: kevent 2 may have been dropped
[ 3729.788586] smsc95xx 1-1.1:1.0: eth0: kevent 2 may have been dropped
[ 3729.788632] smsc95xx 1-1.1:1.0: eth0: kevent 2 may have been dropped


2) For some weird reason, swat for samba does not start.


It is good to solve one problem but really linux is like a hydra, one problem is solved, numerous other emerge :D :twisted:
Posts: 30
Joined: Thu Feb 09, 2012 12:47 pm
by errikos » Sun Jul 01, 2012 8:40 am
I also tried raspbian with the updated kernel (I had to force installation --force-architecture) It booted, but it still freezes with rtorrent. It is very weird, I cannot spot what exact module is responsible for the freezes... It is not the kernel or the firmware...
Posts: 30
Joined: Thu Feb 09, 2012 12:47 pm
by uukrul » Mon Jul 02, 2012 9:41 am
Mine freezes too, after 72+ hours of non-stop donwloads with transmission-daemon on a NTFS disk.

I´m tired of testing. I supposse I´ll wait for any distribution that works fine.

:(
Posts: 43
Joined: Mon Jun 25, 2012 10:27 am
by ROFLhoff » Mon Jul 02, 2012 5:05 pm
errikos wrote:I tried the default squeeze image with the upgraded kernel and the new firmware from rpi-update and it seems to work ok!
just 2 problems:
1) Dmesg is flooded with this message:

[ 3729.788441] smsc95xx 1-1.1:1.0: eth0: kevent 2 may have been dropped
[ 3729.788464] smsc95xx 1-1.1:1.0: eth0: kevent 2 may have been dropped
[ 3729.788509] smsc95xx 1-1.1:1.0: eth0: kevent 2 may have been dropped
[ 3729.788538] smsc95xx 1-1.1:1.0: eth0: kevent 2 may have been dropped
[ 3729.788563] smsc95xx 1-1.1:1.0: eth0: kevent 2 may have been dropped
[ 3729.788586] smsc95xx 1-1.1:1.0: eth0: kevent 2 may have been dropped
[ 3729.788632] smsc95xx 1-1.1:1.0: eth0: kevent 2 may have been dropped


2) For some weird reason, swat for samba does not start.


It is good to solve one problem but really linux is like a hydra, one problem is solved, numerous other emerge :D :twisted:



Have you tried adding "smsc95xx.turbo_mode=N" to /boot/cmdline.txt? That's how I kept my log files from completely filling my rootfs.
Posts: 7
Joined: Tue Jun 19, 2012 2:21 pm
by dom » Mon Jul 02, 2012 6:08 pm
errikos wrote:I have not used any other parameters like
vm.min_free_kbytes = 8192


Are you saying you don't have a vm.min_free_kbytes entry? You are guaranteed to get kernel panics if you don't.
Raspberry Pi Engineer & Forum Moderator
Raspberry Pi Engineer & Forum Moderator
Posts: 4042
Joined: Wed Aug 17, 2011 7:41 pm
Location: Cambridge
by errikos » Tue Jul 03, 2012 11:08 am
http://img823.imageshack.us/img823/2605/dsc7979h.jpg

This is the image of the kernel panic (didn't show clearly in previous post). I will try with the parameters...
Posts: 30
Joined: Thu Feb 09, 2012 12:47 pm
by errikos » Tue Jul 03, 2012 9:45 pm
I have currently 10 hours uptime with Raspbian hexxeh image, updated kernel Linux raspbian 3.2.21-rpi1+ #9 Sat Jun 23 11:07:26 BST 2012 armv6l GNU/Linux from chris, updated firmware and with the two parameters "smsc95xx.turbo_mode=N" to /boot/cmdline.txt and
vm.min_free_kbytes =16384

No error message and swat works ok. We will see the next days, but still seems ok!
Posts: 30
Joined: Thu Feb 09, 2012 12:47 pm
by Zekta » Wed Jul 04, 2012 1:16 am
Hi all,

I had been facing the same problem and applied some possible fix,
I am not sure if they are really relevant, so would appreciate if someone can help to evaluate them...
from the /var/log/message it is related to the page fault, we probably wouldn't go wrong with that..


1. increase the vm.min_free_kbytes to 16mb, so that the system will always have room to breath
2. Setting a memory limit on the torrent client (rtorrent in my case), so that it'll only consume 100 Mb

Here are the actions, I am not sure related or not :roll:
3. Increase the swapiness to 75%, since I am using a 256Mb swapfile on USB HDD, this shouldn't hurt the flash, although may slow down the machine a bit
4. setting a ulimit on memory for rtorrent (Which I didn't look into yet, is that a good direction?)

Thanks
Posts: 2
Joined: Mon Jul 02, 2012 9:14 am
by juanmol » Wed Jul 04, 2012 6:36 am
hi, i've installed (again) Debian from official downloads, update firmware and updated kernel. Then i've modified params vm and try with 5 of the top 100 torrents in piratebay and works. But with others torrents (multiple files torrents i think) makes the kernel panic.
Other error i've now is that mi X10 Home Automation don't works. It uses cm15pro usb, i think is for the firmware update.
I'm feel a bit sad with my Raspberry.
Posts: 44
Joined: Thu May 17, 2012 10:43 am
by gregd » Thu Jul 05, 2012 4:01 pm
Hello,

I was experiencing the same problems using Debian Squeeze (19-04-2012) and deluge, and after reading some posts here and there, I did the following and it seems to work well. As Ethernet and USB share the same bus on rPi, heavy load on both of them simultaneously (typically what deluge or rtorrent does when files are stored on a external USB disk) almost always lead to kernel panic/freeze/whatever and kevent dropped.

So here are the tricks I did :
1. Changed min_free_kbytes in /etc/sysctl.conf to 32M (vm.min_free_kbytes = 32768 + vm.swappiness=1), but 16M should be enough
2. Added a swap 512M bigfile on SD (yeah I know, that's not really a good way to make the SD card last, it would be much better to have it on a HDD, but then again that means USB traffic... I tried, doesn't work), 128M should be enough too
3. Plugged the HDD on my box, and mounted it on the rPi using Samba
4. Set Deluge temporary folder on SD card and download folder on the Samba-mounted drive
5. Set peers limit to 50 and active transfers to 10, no upload or download speed limit

When you reach ~40/50 peers on a transfer, the swap is heavily used, but it is freed when download is complete. And there is no more "kevent drop" or "page fault" in the logs. Though my SD card may die in a few months...

Hope that will help.
Posts: 1
Joined: Thu Jul 05, 2012 3:38 pm
by Caótico Fanegas » Thu Jul 05, 2012 5:35 pm
Hi again, everyone,

In my case, looks like it was a power problem. I have been using a cell phone charger (a good quality one) and it ended up panicking at some point after 24 hours of uptime, so I connected it to a USB port from my router, and it's been working for 48 without problems now. I still have configured very restrictive connections and speed limits, I if it can hold for 72 hours without errors, I'll start rising both connections and speed limits, and see what happens.

Dont be mad about your RPi performance, it's an experimental platform, so give it some time and you'll see how it gets better.
Posts: 14
Joined: Fri Jun 15, 2012 7:45 pm
by purohitanuj » Fri Jul 06, 2012 7:07 am
All,
I have done lot of testing for this using (Pi with Squeeze and latest firmware (rpi-update))
1.Transmission (both cli and Gui)
2.rTorrent
3.Torrentflux-b4rt (python)
4.TorrentFlux (python)

For all of these above, 4 tests were done which were
1.Download Dir on sd card with swap
2.Download Dir on sd card without swap
3.Download Dir on USB attached with swap
4.Download Dir on USB attached without swap

My Findings:

1.Pi doesn't like swap at all. Period. The architecture of same usb bus sharing Lan and Usb makes a swap on external drive more problematic.
2.Pi dies due to number of connection (even if it has free RAM).
3.I have now torrentflux_b4rt with max connections of 20 per torrent and pi works for a maximum of 3 concurrent torrents. With 20 connections, I am able to hit 100Kb/s (mind the unit) per torrent and Pi has an uptime of more than a week.

I would recommend all to:

1. Install webmin to manage your pi from web interface. Creating swap, mounting fs, etc.
2. Use 32 mb GPU elf
3. Possibly do not use NTFS as mount.ntfs is an overkill for pi
4. Use torrent download dir in sd card itself and transfer file later, once done.
Posts: 6
Joined: Wed May 23, 2012 10:35 am