spock
Posts: 223
Joined: Sun Oct 02, 2011 10:33 am

Re: A supercomputer for £100

Thu Feb 23, 2012 8:29 pm

the gpu is good at doing lots of parallel calculations where nothing depends on each other (like vertex and pixel shaders). most real world problems don't work like that. so i doubt the usefulness of the gpu besides using it for opengl graphics and video decoding.

even the high end cuda gpus still are quite limited in what they can do. they aren't general purpose processors.

User avatar
rurwin
Forum Moderator
Forum Moderator
Posts: 4257
Joined: Mon Jan 09, 2012 3:16 pm
Contact: Website

Re: A supercomputer for £100

Thu Feb 23, 2012 10:39 pm

diegod said:

Now, from what I gather from the thread is that the way to link them would be with the ethernet, that is bot bad, does anybody have an idea of how it could be done (the linking them and having them work as one computer) the screen and all that is not so hard to figure out, much less storage... but the linking them is the hardest part. Any ideas???
Use Ethernet. It may be a bottleneck, but not as much as anything else you build.

And then research something called OpenSSI.

diegod
Posts: 2
Joined: Thu Feb 23, 2012 2:30 pm

Re: A supercomputer for £100

Fri Feb 24, 2012 1:39 pm

Cool, thanks a lot, I will be putting what I can get to here to share my mistakes and wins... thanks a lot guys.

jromero
Posts: 1
Joined: Mon Mar 05, 2012 10:34 pm
Contact: Website

Re: A supercomputer for £100

Mon Mar 05, 2012 11:20 pm

Thinking loud here:

Rasberri pi:

35$/25Gflops = 0.7 dolars/GFlop

Intel Core i7-980X (Gulftown 6c/12t)

1050$ /107.58GFlops = 9.7 dolar/GFlop

The price per GFlop is lower and power consumption is lower. If you build your cluster with zeroMQ or similar messaging system, your the tasks are fairly large… (couple of seconds) and u do not move much data over the network i think you can build a pretty nice system here…

karol
Posts: 3
Joined: Sat Feb 18, 2012 2:00 am

Re: A supercomputer for £100

Tue Mar 06, 2012 12:10 am

Are you sure you can program Raspberry Pie's GPU the same way you can program that Intel CPU? Why not buy a CUDA GPU? You can have 100+ GFlops per card.

EricMiddleton
Posts: 47
Joined: Wed Jan 18, 2012 3:47 am

Re: A supercomputer for £100

Tue Mar 06, 2012 6:09 am

jromero said:


Thinking loud here:

Rasberri pi:

35$/25Gflops = 0.7 dolars/GFlop

Intel Core i7-980X (Gulftown 6c/12t)

1050$ /107.58GFlops = 9.7 dolar/GFlop

The price per GFlop is lower and power consumption is lower. If you build your cluster with zeroMQ or similar messaging system, your the tasks are fairly large… (couple of seconds) and u do not move much data over the network i think you can build a pretty nice system here…


It's not a good idea to compare CPU and GPU GFlops because they are designed to do different things. If you want a more valid comparison, how about an Nvidia GTX 590 that can pump out up to ~2.5 TFlops for only $699 (about $0.28/GFlop). It also comes with about 3GB of memory.

zzarbi
Posts: 5
Joined: Thu Mar 08, 2012 7:23 am

Re: A supercomputer for £100

Thu Mar 08, 2012 7:34 am

Hadoop is an open source Apache project that was built to be run on commodity hardware. It's in JAVA so it can run on pretty much anything that has JAVA.

Right now I'm running hadoop on 5 big servers (opteron) that cost me $2500 each. I'm collecting 12GB of data every day. That's 40core of 2Ghz running for $12500.

For $2800 I can have 80 Rpi. Since data is distributed over the network, for less $$ the Rpi would be faster than my 5 Big clusters.

Shorack
Posts: 10
Joined: Fri Jan 13, 2012 2:37 pm

Re: A supercomputer for £100

Thu Mar 08, 2012 4:32 pm

Aren't you forgetting the basic load on each node?

Say (can't find exact numbers) that just having hadoop on a node means 128mb ram consumed. On a system with 5 strong nodes, that is peanuts.

On a system with many weak nodes (as would be the case with R-Pi), that is half your ram gone already.

zzarbi
Posts: 5
Joined: Thu Mar 08, 2012 7:23 am

Re: A supercomputer for £100

Thu Mar 08, 2012 4:53 pm

It actually depends of what you want to deal with but in an hadoop cluster you have a namenode and the secondary namenode that consume lots of memory.

Then you have the datanode which doesn't consume as much. The map reduce may consume a lot of memory depending of the task.

Like I said it depends of what you want to do but Hadoop was built for commodity hardware.

stevetmq
Posts: 10
Joined: Tue Mar 13, 2012 12:29 am

Re: A supercomputer for £100

Tue Mar 13, 2012 12:43 am

JamesH said:


This has been discussed a bit on the fourms, but the Arm at only 700Mhz doesnt give supercomputer levels of performance, even if you use a lot of them.

What a cluster of these devices would do is give people a cheaper platform for trying out various schemes for distributed computing.

That said, if we could get a way of harnessing the GPU performance then you are talking some serious horsepower. They can give about 25GFlops. Which is a awful lot considering the low power consumption. I"m slowly looking in to it.


First sorry for the spelling I am dislex......   Don't be such a party pouper! The "Cray 1" was a 80Mhz that gave only 80 MFLOPA and no one would say that was not a suppercomputer.  From small acorns do large oaks grow.  Yes you may not get the horsepower but in devlopment It's the idears that count!

stevetmq
Posts: 10
Joined: Tue Mar 13, 2012 12:29 am

Re: A supercomputer for £100

Tue Mar 13, 2012 12:58 am

P.S.  OK I know its not anythink like:

http://www.cray.com/Assets/PDF.....ochure.pdf

But you don't find radical things but keeping with convention.


Return to “Other projects”