Guest post from Mythic Beasts: how we dealt with those DDoS attacks

Do you remember the distributed denial of service (DDoS) attacks this website was undergoing a few months ago? They made the news (partly because it was just so bizarre to see someone attacking an educational computing charity) – if you want to refresh your memory, see this, this, or this.

Pete Stevens, who runs marathons and our hosting company, Mythic Beasts, thought you’d be interested in what he’s been doing to try to ensure this can’t happen again. (Famous last words, Pete.) Here’s what he did. Over to Pete!

In the past we’ve had occasional trouble with denial of service attacks against the Raspberry Pi website. In particular, simply overflowing us with traffic has proved not that difficult – the server only has a 1Gbps uplink. When your admin (me) cocks up, it turns out you can saturate a core calculating syncookies leaving the other cores idle because he should have configured IRQ balancing properly.

Pete, pounding the pavement. Click the image for what is possibly the funniest local news story to come out of Cambridge in the last decade.

We briefly investigated cloud based DDoS protection which we still hold in reserve, but it has a habit of declaring that Liz can’t post things because apparently she’s a spambot. We also had to switch off IPv6 access to the website to use them, which, for an educational project, was unfortunate as there is going to eventually be a large network transition to IPv6 and allowing people to learn about it and use it is desirable.

So we’ve scaled out the hosting infrastructure out to a distributed cluster of machines. We’ve installed four additional little dual core machines, two in our Telecity Sovereign House site, two in our Telecity Harbour Exchange site. Each of these runs a load balancer and forwards connections back to the main webserver. This means the inbound load is now shared over 4 separate 1Gbps links and there’s rather more CPU available to calculate syncookies when required and rather more bandwidth to saturate.

We load balance over the load balancers using DNS round robin, as you can see from our public DNS.

$ dig www.raspberrypi.org AAAA +short
lb.raspberrypi.org.
2a00:1098:0:80:1000:13:0:5
2a00:1098:0:80:1000:13:0:6
2a00:1098:0:82:1000:13:0:5
2a00:1098:0:82:1000:13:0:6

$ dig www.raspberrypi.org A +short
lb.raspberrypi.org.
93.93.130.39
93.93.130.214
93.93.128.211
93.93.128.230

Now, everybody knows that this is a stupid way of load balancing, and you don’t get anything like even usage across your sites. This isn’t even slightly born out by the bandwidth figures for the last few days:

93.93.128.211 347.04 GB
93.93.128.230 341.61 GB
93.93.130.39 349.58 GB
93.93.130.214 347.88 GB

That’s agreement to within 2%, which is a pretty even split. So much for commonly held wisdom, we prefer science.

We’ve set the entire internal network up with IPv6. So when you connect to one of the front end machines, it’ll connect back to the main webserver over IPv6. One of the reasons for this is so we’re now running mission critical services over IPv6 – a move to IPv6 worldwide is happening at a glacial pace, and we want to make sure that our support works well. Having an angry Liz phone you up if it doesn’t is a very effective motivator.

You may have seen odd forum and comment issue while we were setting this up. One of the forum spam filters allowed filtering people based on source IP address. The move to the new setup means that clicking the filter by IP address feature resulted in dropping all new comments from that load balancer – a quarter of our traffic. *Oops*. We had to fix that to read the forwarded-by headers.

Now of course the real question is, why aren’t we fronting the site with a massive cluster of Pis? Testing with hping3 suggests that a Pi starts to struggle at around 2500 syns/sec. The front-ends we have are absolutely fine at at 50,000 syncs/sec (reading roughly 10% cpu), so with four of them we can probably handle around 1,000,000+ syns/second. That’d require 400 Pis to keep up, so it’d be a very very large cluster of Pis, not to mention 5 switches in each site.

Of course a very stern warning has been given out to people who have access to the front end machines – not only can they receive a million syns/sec, they can also send them, and that could seriously upset other internet users if it was directed at them.

Now, a side effect of this scale-out is we’re left with a bunch of machines that have a reasonable amount of excess CPU. Eben has *strong views* about wasting CPU cycles, it makes him very sad. So we’ve put them to use.

Rob Bishop and Gordon Hollingworth at Raspberry Pi spend quite a lot of time building software. Compiling it is time-consuming, and their laptops get hot and make fan noises. So we’ve installed a set of dual core VMs on the five core servers running under KVM. When everything is fully operational the software team can kick off a build from the master VM which will then use distcc to farm out the compile across all five machines. This means there’s effectively 10 cores available most of the time for building software. When the website gets busy, the lower priority VMs slow down and hand the cycles back to the load balancer/Apache/PHP/MySQL.

Now, the Raspberry Pi is an educational project. It’s not just about educating children: adults still need to learn things, and that includes me. We’ve run many dual stack IPv4/IPv6 machines before, but we thought we’d try IPv6 only machines and discover the difficulties in order to improve our support for IPv6. So the distcc VMs are IPv6 only – they can’t access anything on the internet that isn’t accessible over IPv6. In reality this means they can see Google, Facebook, lots of mirror servers and a small fraction of other sites.

In the process of setting this up I discovered that I was unable to get the Debian Squeeze network installer to install from an IPv6 only network, so I had to do the initial install to the VMs from a full install image rather than the cut down one. I then realised that Mythic Beasts still doesn’t have an IPv6 aware resolver yet, which we need to sort out, so I had to use Googles public resolver. This is still on my todo list along with full DNSSEC resolver support.

Happily Debian appears to work fine with IPv6 only. The mirrors are v6 enabled, so the VMs recieve updates and can install packages fine, and so far it appears to be going well.

There’s still some things to do and questions to answer: should we move apache/php processing to the front end nodes? Will WordPress Supercache and the other plugins cope in a distributed environment? Will file uploads still work? Can we solve that with NFS? Does NFS even work over IPv6? Should we install a varnish cache on the front end nodes and disable WordPress Supercache? Should we do both? Will it confuse people if we have two layers of caching that expire at different times? Is that better than what we have now? Instead of having tcp-syn cookies on the whole time we could only enable them when under attack. Have we made a dreadful mistake with the build VMS, and is it all going to go offline when Rob tries to compile OpenOffice? Should we stop worrying about all of these questions and instead work out whose job it is to buy the first round at the Cambridge beer festival?

If this is the sort of thing you’d find interesting, and you would like to be paid to solve exactly these sorts of questions, Mythic Beasts is recruiting.

http://www.mythic-beasts.com/cgi-bin/job.pl

We’re looking for both junior and senior people, we very strongly like bright motivated people who get things done, and we’re not overly impressed by certifications. We’d really like a full time person or two but are not averse to taking on summer or gap year students providing they’re smart and they get things done.


Happy birthday to us!

Today’s a very special day for us here at Raspberry Pi. It’s the first anniversary of the Pi’s launch day. (It’s as near as we can get; we launched on a leap day last year. We’re going to have a really great party in 2016.)

It’s been a crazy, wonderful year, and usually I’d have a lot to say about it. We never thought we’d find ourselves in the position we’re in today, with a million Pis sold, a sprawling community, real evidence that kids are picking the Pi up and learning with it, and new friends from all over the world.

But you hear from me all the time. So for today’s post I’ve asked members of the Pi family to share a few words with us about the way this year has looked to them instead. This is a long post. But it’s a good’un.

Clive Beale, Director of Educational Development, Raspberry Pi
When I asked everyone for a couple of paragraphs, Clive was the only one who responded with a screenplay. Before coming to work for us full-time, Clive volunteered for the Foundation on things educational, and also moderated the forums. Wondering where Scep went? He’s Clive.

Last year, Clive built a whole-pig-roasting device out of a dead shopping trolley.

FADE IN:

INT. STUDY – NIGHT

CLIVE is hunched over a crufty computer keyboard, cursing under his breath and frantically mashing keys like someone playing Track and Field after eighteen double espressos.

DISSOLVE TO:

INT. STUDY – DAY

Clive is now pressing the F5 key once a minute with his nose. He bobs slowly up and down, like a sad Dippy Bird who has lost his top hat. He is weeping gently.

I cannot tell a lie, I killed that server.  I did it with my little F5 key.  But it paid off though, and a month later I had one of the first Raspberry Pis. Since then it’s been a complete blur of a year: mainly manic, sometimes surreal; but always exciting, always fun and always rewarding. One of the highlights for me was writing the blog for a couple of weeks while Liz took a break – I’m always amazed by what the community is doing with the Raspberry Pi and it was a pleasure to show their projects off. The forum members deserve a special mention too – it’s a huge community now (with nearly 58,000 members at the last count), but still has a helpful, friendly feel to it, and there’s a real energy about the place with tons of fantastic stuff going on.

It has been a remarkable year for the Raspberry Pi Foundation but also for me – two weeks ago I left teaching to start work as the Foundation’s Director of Educational Development. Our mission is (and always has been) an educational one. We want to change how people see computing, to give them access to stuff so that they can create and play and learn. We want kids of all ages to be empowered by computer science, to learn essential life skills and to have fun on the way. I’m looking forward to helping make that happen.

Mike Buffham, Premier Farnell/element14
Mike’s been our main contact at Farnell all along, and has worked wonders with negotiating parts prices, liaising with manufacturers and sorting out distribution. His personalised numberplate makes us all numb with envy.

If ever there was a word to describe the last 12 months it would be “Rollercoaster”! Six AM (UK) on Wednesday 29 February 2012 is a time I remember well, as I was sitting in my hotel room in Nuremberg, logged onto the Farnell/element14 website to check that everything went live OK. And then…BOOM!

To say that the demand for Raspberry Pi on day one was unprecedented would be an understatement, so by the time we got to the “launch” on our stand at Embedded World later that day (complete with an actual working model!) I had worn out 2 batteries on my Blackberry getting the latest demand updates, production updates and so on. The first few weeks continued to be fairly spectacular as we worked with the Raspberry Pi Foundation to close out various compliance testing, production and componentry issues, not to mention component supply. I remember one pivotal week in early April very well, when from my holiday deckchair, we negotiated supply of Broadcom 2835s and Samsung memory through to the end of September which, on reflection, gave us the platform to build our production plans on for the year!

Supply was clearly a challenge in the first few months, but during this time we worked very hard both with our original contract manufacturer in China, to drive the production volumes we required, and with the Foundation to bring the manufacturing of the Raspberry Pi to the UK. When we announced the deal with Sony UK Tec in September it was quickly followed by the launch of the 512MB board in October. The move to UK production remains something we are very proud to have been involved in. Now with Model As launched and shipping I have to admit at looking forward to year two with even more excitement, as there is no doubt in my mind that the success of Raspberry Pi has only just begun as it continues to change the computing landscape in education and elsewhere!

James Hughes, Broadcom
James likes cars and Kylie Minogue. (He likes her so much that he’s got a little photo of her tacked up above his desk.) He accidentally grew a beard for Movember because nobody told him he was supposed to concentrate on the top lip only.

It’s been quite a year! As  someone who has helped out in the forums from very early days, but who is also an employee of Broadcom who works with the VideoCore every day, it’s been fascinating being part of this Raspberry Pi phenomenon. From the lead-up to the launch, helping out with testing out wireless adapters, trying different languages and applications (and learning much more Linux on the way) to the complete panic of the launch day when it suddenly became clear that this device was going to be much more popular than anyone had ever imagined, it’s been a fantastic roller-coaster ride. The last year, which has simply flown by, has been mainly forum moderation (a very busy work life on other stuff at Broadcom preventing any real development work), and it has been a real privilege to help out, and see the community grow from the first few members to the over 55 thousand we have today.

There have been ups and down as with any venture; occasional rants from irate members, desperate dealings with those who have waited such a long time to get their Raspberry Pi’s, fencing with OSS people on the subject of binary blobs, and of course the occasional fed up emails from an irate Liz after something behind the scenes has derailed the latest blog posting!

So, what is on the list for the coming year? Well, more development work on the camera module code is my current project, for which I have high hopes, and of course, more forum moderation, but the community is doing so well in supporting itself that that job becomes less and less onerous every day. And I think that highlights the most impressive thing about the last year – the way in which the community has grown from a tiny acorn, to a fascinating oak tree of  people who, by now, know much more about the Raspberry Pi than I do, and are more than willing to donate their knowledge and time to help out this tiny charity with big educational aims.

Dr Gordon Hollingworth, Head of Software, Raspberry Pi
Gordon has a really interestingly shaped collar bone, thanks to a bike-racing accident. There are guinea pigs in his dining room. He is subject to brain-freeze if there isn’t a Rubik’s cube within arm’s length. Don’t start a conversation about cycling with him unless there’s nowhere you need to be soon.

Looking back over the past year, I must admit there are a few words I’d rather have had to live without: “USB, Synopsys, FIQ, IRQ, Split transactions”. They have been the bane of the last nine months!

My journey with Raspberry Pi probably started back three years ago with something we called the MicroDB at the time, when I played around with the helmet cam I’d hooked up for my bike, and after shoving it under Eben’s nose for the tenth time he and David finally took it to the BBC and showed them how small and beautiful such a piece of engineering could be. People just didn’t understand that a whole computer could be encapsulated into such a small space, and that first interview sparked the imagination of a million people.

I remember Eben telling me about the Foundation’s plan to create the hardware based on BCM2835 (a chip I had a lot of involvement in creating), and him saying that he thought 10K was a good number to start with!

My involvement from that point on was more of a friend to the project, using my group’s resources to help progress the project, organising and pushing for support at Broadcom both over and under the radar!  In my past work at Broadcom I wrote the USB boot code for 2835 (this is the ability of the 2835 to boot directly from a PC with no SD card), so when I realised there were problems in the USB that couldn’t just be explained away by power problems I got out the USB analyser and got to work.

Over the past year I realised that my job at Broadcom was becoming less fun and my Raspberry Pi work more fun until I finally decided it was time to work full time for Raspberry Pi.

What am I doing now? Well in general it’s USB, camera board, display board, some things I have been forbidden to talk about at all…oh, and herding cats, but that’s a story for another day!

Helen Lynn, High Priestess of Facebook, Raspberry Pi
Once, Helen and I went skinny-dipping in the Cam on a sunny midsummer’s evening, out in the countryside where the river is full of rats and barbed wire. Happily, nobody caught anything. 

When Eben and Liz first suggested that I do some work on behalf of the Raspberry Pi Foundation during the ten-ish hours out of every 24 for which my then-almost-one-year-old was sort of reliably asleep, I regretfully turned them down; it was quite clearly a daft idea.

Ho hum.

Several months, a surprise bout of meningitis and most of a pregnancy later, I’m running Facebook and Google+ pages for Raspberry Pi and reflecting on their cunning, as well as their incomprehensible conviction that I’m not about to disappear again without warning thanks to early labour or a freak accident with a Tommee Tippee sippy cup or, I dunno, rabies. The Raspberry Pi Foundation is new to both social media platforms, but the astonishing community of Pi fans isn’t; we’ve been warmly welcomed, and it’s exciting to begin figuring out what we can do with these new ways of talking with people.

If, over the next year, we can support teenagers to participate in the kind of active, knowledgeable, helpful and enthusiastic Raspberry Pi communities that adult makers and hackers currently enjoy, I’ll be thrilled. We need to make sure there are obvious ways in and plenty of support for young people whose family and friends aren’t engineers and programmers and scientists, and who haven’t been given reasons to start from the assumption that they’re going to be able to do this; and, crucially, we have to make sure we’re talking to girls as well as boys. I’ll be watching from behind a couple of very small people.

Glenn Jarrett, RS Components
Glen’s our main contact at RS. My mother-in-law saw him on the TV news at our launch last year and has been describing him as “that lovely man on television” ever since. 

Wow, what a year!  In the 75 year history of RS we have never experienced a phenomenon like the Pi that has seen such a fantastic level of interest and demand.  I think we can all confidently say that we’ll look back at Raspberry Pi as a milestone in the history of technology, and  I’m very proud that RS has been a part of bringing Raspberry Pi to the world.  Even though this first year has flashed past (not without a few challenges on the way!) it’s clear that this is the beginning of something much bigger.  We’d like to congratulate the Raspberry Pi Foundation and the Pi community for their spirit of innovation, vision and tenacity, and their contribution to the world of technology, education and industry.

Paul Beech, Pimoroni
Paul’s had as curious a trajectory as any of us this year. When he won the competition to design a logo for the Raspberry Pi, he was a jobbing freelance designer. Now he’s a factory owner and employer, making awesome stuff to go with your Pi. Paul has a fetching selection of bobble hats. Next week, he’s helping me decorate the office. He says he’s found some raspberry-coloured blackboard paint.

Year 1 of the Pi. It’s been about transformation. The ludicrously low price of the Pi helps those who most need a leg up. It’s the difference between a lot of things happening or not happening. For Pimoroni it’s been about changing from coders and designers to makers and engineers. For a movement built around a neat little hardware board the people have been the best thing. The people at the Jams who ask “What can I do with my Pi?”, the people who’ve taken the time to tell us how they’re using the Pibow. The wonderful peeps at Adafruit and our friends at MagPi, Access Space, NottingHack and EMFCamp. Most of all the people of the Raspberry Pi Foundation for working tirelessly to make things better. Eben and Liz. We less-than-three you :D

What’s the plan for Year 2? First job: deliver on our promise of the Picade. It’s going to be awesome and we’re having fun overcoming the design challenges and noodling. Now that Pis are in the hands of a lot of people, we want to help them understand the possibilites and use the Pi to make insanely great stuff. We’ll be making tutorials and videos available and visiting a lot of Maker Faires. We’ll be producing add-on kits for the Pi. We’ll have more maker stuff available in our new shop and we’re working on making 2013 the year Making became big, with the Raspberry Pi as a wonderful beating heart.

We want people to do something rather than nothing.

Pete Stevens, Mythic Beasts
Pete directs the Cambridge company that hosts this website. He is bearded, he runs faster than burglars, and he is marrying the luscious Fiona this summer. 

A year ago at around 6am, we replaced the main Raspberry Pi website with a static page with the launch announcement expecting a bit of traffic. About thirty seconds after this went up and we saw the actual traffic load destroy all the linked-to sites, we wondered if we needed to start making a bigger plan.

We moved the main Pi website and forums to a decently fast server to provide a set of forums where trolls can be rude to us all are thrashed to within an inch of their lives with the Golden Banhammer. I stole Mooncake, ransomed her back for my first Pi, and turned it into a mirror server which shipped around 3000 SD card images before dying last week with a flash card filesystem error. Turns out the USB networking code wasn’t quite as crash prone as we all expected!

Pete Lomas, Founding Trustee and Hardware Guru, Raspberry Pi Foundation
You all know who Pete is, but what you might not know is that he owns a pair of tartan trousers.

I’ve spent the week at Embedded World in Germany, where Raspberry Pi had its first official outing just a year ago. People also ask me “why has Raspberry Pi been so successful?” It’s something I’ve pondered over the last few weeks. In large part it’s all the people who have posted their thoughts and comments in this blog. Without them, their damn hard work and their support for the vision we all share as to what Raspberry Pi is all about we would be – well – nowhere.

So to all one million of you, thanks a million for making Raspberry Pi what it is!

Jack Lang, Chair, Raspberry Pi Foundation
Jack’s a king among entrepreneurs, has a brick pizza oven in his garden and holds a commercial fireworks licence.

What a year it has been! Who knew we would sell over a million units?  We could not have done it without the support of the community, both locally in Cambridge, our manufacturing and distribution partners and wider via the forums, blogs and twitters Thank you all. We seem to have discovered both a new category of computer hardware, and a new business model. One of the key lessons is how effective the open source community is, and the importance of the engineering staff meeting and communicating with the users in the community.

However we must not get complacent and let hubris take over; there is still a lot to do, in both hardware and software.  In hardware we must continue to optimise, innovate and improve cost/performance both of the core product and peripherals such as the upcoming camera board. In software there is optimisation, documentation, and fixing holes like HTML5 performance. We need to make the out-of-the-box experience easier for non-experts. There is a whole slew of learning software and content we want to support, and I’m working on author assessable MOOCs (Massive Open Online Courses) to support our educational mission. We should also acknowledge the wonderful work being done by the Computing at School group.

We want to bring enlightenment and knowledge, based on solid computational thinking, to many. We have been handed golden opportunities to build on.

What time are we going to the pub?

James Adams, Head of Hardware, Raspberry Pi
When I first met James, his car door wouldn’t open, so he had to get in and out like a more muscly version of Bo from the Dukes of Hazzard. He brews his own beer and owns a lathe.

Not much for me to write seeing as I’ve only been here 3 weeks! :)

I suppose the Raspberry Pi story for me started several years ago when I was leading the Broadcom ASIC team designing the 3D graphics accelerator in VideoCore4 (BCM2835). I certainly didn’t expect that chip to end up where it is today. Later on, I left Broadcom for another engineering job in Cambridge, but stayed in touch with Eben and the team.

Having watched the Raspberry Pi phenomenon grow over the past year I was delighted to join the engineering team in January as its newest member. I very much look forward to working with everyone to help further the exceptional work that has already taken place on this most worthy of projects!

Eben Upton, Executive Director, Raspberry Pi
Last year, Eben thought he might have got gout. Turns out he just has flat feet. Although he is 34 years old, Eben still plays with LEGO.

This year’s had some good bits and some tough bits (things like the surprise EMC testing, the magjack nightmare and the cynical and occasionally downright nasty reaction from some people to our very earnest attempt to open source as much of the multimedia drivers as possible) – but the good bits outweigh the tough so much. For me, the best part has been watching kids using the Pi and learning the things I’ve always loved: the schools visits, events like Broadcom MASTERS and the photos and videos parents and the children themselves send us discussing their projects make me very happy.

It’s great to see companies like Google and Broadcom, in their different ways, embrace and encourage Raspberry Pi. Broadcom has started really regarding the Raspberry Pi as something it believes in and is proud to be involved with. We are so grateful for their continuing to allow their engineers to volunteer for the Foundation, and the projects that we have been involved in through the Broadcom Foundation align really well with our educational aims. And, of course, concrete support like the million-dollar grant we just received from Google goes a long way to helping us achieve our goals.

One of the wonderful things about the success of the Pi has been that we’re able to take the money that we make from selling them, and do a range of things which we think are really useful for the community. On the technical side we are able to subsidise development and optimisation of open-source software like Pixman, Weston, Scratch and LibreOffice (you’ll see the results of this work later this year). And on the educational side, we’re developing educational materials and employing people like Clive to work with our partners to make the whole enterprise run smoothly; and to allow us to get Pis into the hands of the kids we want to see using them.

It’s been a privilege to work with so many remarkable engineers, business people and educators. It’s been a privilege to meet so many hackers, kids and electronic enthusiasts. And it’s been a privilege to be involved in something which I think just might end up changing the way we learn and the things we build for good.

UKScone, Forum Mod and Shoulder to Cry On, Raspberry Pi
A genuine Englishman in New York, Scone is a caffeinated gentleman who carries a stick, mostly, from what I can make out, to whack unruly youngsters with. He’s rubbish at using chopsticks. He mails me cheerful things and keeps me sane. Scone is brilliant.

It’s been a year since the Raspberry Pi was unleashed on the public, although thanks to a quirk of the calendar it’s only a quarter of a year and because “she who cannot be named, but who has a distinct lack of understanding on the meaning of the word quarter when talking about dates” probably chose the the day the 29th of February as the release date, I’ve christened this event the “1st Annual Raspberry Pi Liziversary”.

It’s has been a hell of a year though. The Raspberry Pi has gone from zero in the wild to over a million with no sign of the sales slowing down, and the Raspberry Pi community has grown from a couple of hundred members to over fifty five thousand on the forums alone. Several successful businesses have either been started or expanded to supply cases, add-ons, books and other Raspberry Pi related doodads, and the bottom line of the two manufacturing partners looks much more rosy these days thanks to the Raspberry Pi.

It hasn’t all been sweetness and light, unicorns, bluebirds and rainbows however, as there were teething problems with manufacture, supply, delays, a couple of design buglets (which were fixed in Revs 1.1 & 2) and the things that you’d expect when you have a global business with no actual employees. But on a scale of one to ten for the Raspberry Pi Foundation’s goals I’d say they were at a seven: they’ve got the hardware out there, a nice ecosystem of third parties offering extras and the educational documentation and software is steadily progressing. Bravo Raspberry Pi Foundation.

On a personal level the Raspberry Pi has changed my life. I’ve gone from basically being a bit agoraphobic and anti-social to someone who actually ventures outside for things other than to do the grocery shopping and laundry and I actually talk to people occasionally. As a direct result of the Raspberry Pi I’ve been to two OHSummits, two Maker Faire NYC’s and started taking an interest in what others are doing hardware and software wise. I’ve actually completed a few projects I’d been putting off for years, and have started building hardware again after a twenty-year break. I also have a supplier who can satisfy my desire for illicit Twiglets. :) However, it hasn’t all been positive, as I now spend the majority of my day on the Raspberry Pi forum moderating and replying to posts to the detriment of the housework and my “playing with the cats” time, and my addiction to “cozy” mysteries is going unsatisfied as I can no longer read one every day or so; it’s taking me a week to read only one.

Where will things be in a years time? I don’t know, but remember that the Amstrad CPC line sold 3 million in its lifetime, The BBC Micro 1.5 million and the Sinclair Spectrum 5 million; so round that up to 10 million, think of the number of professional engineers and programmers they produced between them, and then think of the 1 million (so far) Raspberry Pis out there. It’s only ten percent, but that’s still an awful lot compared to just a few years ago.

Good things are going to happen. Happy birthday Raspberry Pi!

Rob Bishop, Developer Evangelist, Raspberry Pi
Rob was a full 24 hours later than anyone else in getting me some text for this post. He rides a skateboard to the office.

When I began my internship at Broadcom aged 18, straight out of school, I had no idea that it would be the start of a journey that would eventually find me writing about being the first engineering employee of the fastest-growing computer company in the world from a hotel room in Lisbon, Portugal after giving a public workshop so popular that we had over 200 people on the waiting list…

In many ways I owe all of my involvement in the Raspberry Pi journey to that internship. I got to spend that year working with a Broadcom team on what would be marketed at CES as “the world’s smallest HD camcorder” and which ended up being in many ways the proof of concept for a Broadcom processor based Raspberry Pi. I still remember meeting Eben for the first time after we had the early prototypes of that hardware back from manufacture and how passionate he was about making a “keychain computer” that everybody could own. If it wasn’t for his passion I’m fairly sure there would be roughly a million people who wouldn’t now own something very similar to what he talked to me about on that day. Thanks for everything Eben.

I can’t wait to see where we end up by this time next year…

Professor Alan Mycroft, Founding Trustee, Raspberry Pi Foundation
Alan has treated this post as an exercise in talking about himself in the third person. He is terrifyingly, preternaturally good at chess, and co-wrote the Norcroft C complier, which means his terrifying, preternatural DNA is still present in ARM’s commercial compiler offering.

Alan Mycroft seems to have fallen into the role of doing talks on Raspberry Pi, e.g. for Sky News, BBC (Newsround, not Newsnight, unfortunately) and was part of the Guardian’s panel on ICT and Computer Literacy.

He also gave invited presentations to Computing at School, Campus Party Europe (10,000 geeks at Berlin Tempelhof ex-airport) and at ComputerBasedMath.org at the Royal Institution. Currently he is in India mixing his day job (researcher in programming languages, compilation and static analysis) with Raspberry Pi interests — not to mention a good bit of tourism in this amazing country.

He gave the Indian Institute of Technology Bombay (IIT’s are the Indian Oxbridge for Computer Science and Engineering and related subjects) talk “Raspberry Pi — putting the fun back into computing”) on 27 February, and is talking to possible partners in India.

The Raspberry Pi Foundation is investigating reasons why BRICS countries (Brazil, Russia, India, China, South Africa) import far fewer Raspberry Pis than more advanced economies, and that’s something Alan is exploring in India — partly tariffs, but complaints on the ground include delivery mark-ups etc.

Plans for next year include more of the same and a regression to a misspent electronics youth (rehab anyone?) in finding time to assemble the hardware and software to replace current automated-number-plate-recognition equipment at the (University of Cambridge’s) Computer Laboratory with a Raspberry Pi version.

Dr Lorna Lynch, Raspberry Pi Foundation
Lorna has a PhD and three (count them) Masters’ degrees. She knits complicated and beautiful things, and makes her own yarn on a proper spinning wheel. One of my proudest achievements of the last year has been teaching her toddler how to Vogue. 

I’ve only been working directly for the Foundation since December, but I’ve been following the development of the Raspberry Pi with interest for ages: it’s a wonderful device, and I’m so excited to see all the amazing projects users have been working on during this first year.

I’ve been working on trademark enforcement, running the Twelve Pis of Christmas auction, and doing other general bits and pieces. Because I have a small child at home, I’m working part-time, but I’m very happy to have this chance to be working with friends, and supporting a project in which I wholeheartedly believe. My son really is too small to learn to use a Pi at the moment (at just two, he’d probably reduce one to its constituent atoms within minutes), but I can’t wait for the time when he is old enough to start tinkering around with one, and learning to write his own games, just like his dad did on a BBC Micro back in the 80s. I’m even feeling a strong temptation to start learning Python myself! I can’t wait to see what the next year brings, but I know I am both excited and grateful to be a part of it.

David Braben, Founding Trustee, Raspberry Pi Foundation
David is the guy who ensured many of the Foundation’s employees got lousy school reports because we were all to busy playing Elite. He has excellent glasses that make him look like a German architect.

It is now a year since we went ‘live’ selling Raspberry Pis, selling out in a small number of seconds at 6am on 29th February. A year ago I did the rounds at Television Centre – BBC News 24, BBC Radio 4’s today program, Radio 5 Live, BBC Worldwide, and a few local stations. By the end of that we had sold out of our initial batch.

The reaction and positivity to Raspberry Pi has been great. From that initial reaction from John Humphrys and Jim Nauchtie, to David Cameron, to all the excellent projects we have seen since. As we crossed a million sales just after Christmas, I loved the idea that a million people have been inspired to do something new. While I appreciate that many will be used in media centres or whatever, I like to think we have already made a difference to a lot of people.

It has certainly changed thinking. We already have Computer Science coming back to schools as part of the EBacc, but we have an exciting future too. Fantastic help from many, and a generous donation from Google, all help with this.

Here’s to another great year!

Abishur, Forum Mod Extraordinaire, Raspberry Pi
We wouldn’t have a forum without Abishur; he puts in a vast amount of behind-the-scenes work, and he’s patient, affable and knowledgeable. He’s the only person in this lengthy post whom I haven’t met yet (pesky geography), but I feel like we’ve been friends for ages – when I’m next in Texas I’m going to make the trip to Fort Worth just to see him, and buy him a very large, cold beer. 

Today the Pi turns one. (Happy Birthday Raspberry Pi Foundation!) It’s been an immensely fun ride thus far. I’ve been one of the lucky few who found the Pi in its infancy when it was just a simple blog with some people in the comments wondering about getting a forum. When said forum arrived, I remember being so excited when we hit 500 forum members… and then 1000 and 2000. People grew concerned that they might be one of the unlucky few who wouldn’t get a Pi. Just before the launch the forum had 12,123 members, and as it turns out that was the tiniest fraction of people who wanted a Pi and wanted it *right* now.

Today we have 57,544 board members, 86,518 Twitter followers, and just as many “likes” spread across the various Raspberry Pi Facebook sites.  There are more than 1 million Raspberry Pi boards out there now. It’s a staggering number for a device that we thought, back when there were only 500 of us, would sell 10K in its entire lifetime.

While it goes without say that we’re all enamored with Eben and co for working so hard to make this device, and with Liz for running all over the globe to make sure things continue to run smoothly for the Pi, a huge thanks goes out to all of the community members! The Pi is only as amazing as it is because y’all (yes, y’all, I’m a Texan :-p ) have run with it. You’ve turned it into a music controller for a printer, LED games stations, media centers, retro gaming consoles, you’ve dedicated bandwidth to help host Pi installation images, Raspbian repositories, and your own special code. You’ve sent it into (near) space and across the world.

Thanks everyone for making Year One of the Raspberry Pi so incredible!  Hopefully Year Two will push the Pi even further, though if you could make your posts a little less interesting I’d really appreciate it. I’d like to finally be able to get my own Pi Sprinkler Control finished at some point!

Mooncake, Official Cat, Raspberry Pi Foundation
Mooncake doesn’t really do much besides sleeping and eating. She has not really been very helpful this year, but we like having her around.

Meeow.

Alex Bradbury, University of Cambridge and mighty Linux hacker
When he’s not working on his thesis, Alex volunteers for Raspberry Pi, doing arcane and wonderful things to improve the software stack. He had a birthday yesterday too.

The year since the launch of the Raspberry Pi has of course been both busy and exciting. We’ve seen major developments in the Raspberry Pi software stack including improved performance. A significant event was the release of Raspbian (a Debian port optimised for the Raspberry Pi’s CPU) which is to me still the most impressive Raspberry Pi-related project. I’ve also enjoyed the opportunity to attend and talk at great conferences like Linux.conf.au, keynote at both PyCon UK and PyCon IE, as well as give a range of smaller talks. I’ve met many fantastic people I would not have had the opportunity to meet otherwise and hope this will continue. In the next year, I think we’ll really start to see what sort of performance can be squeezed out of the device. There’s been fantastic progress made so far, but it will be exciting to see what more can be done as applications like Scratch and key libraries like Pixman receive significant optimisation work. I’m also expecting to see the continued development of the library of Raspberry Pi-oriented educational material. With events like the release of Minecraft Pi and so much more in the pipeline, I believe it’s completely feasible for the Raspberry Pi to be a top present for kids next Christmas.

Dom Cobley, Broadcom
Dom’s another indefatigable volunteer. He’s upsettingly clever. He will beat you at any board game you put in front of him, usually for money, and has lovely big blue eyes. Dom is mostly nocturnal.

About two and a half years ago, after years of working with VideoCore, I got presented with a BCM2835 development board and a vague request to get Linux and 3d and video demos running. The ARM was snuck into 2835 as a bit of skunkworks from Eben, who had these wild ideas about the general public being able to buy a breakout board for our chip and program it themselves. Sounded great to me, but far-fetched. The only problem was that I knew very little about Linux. None of us did. But we had printk, and text came out of the uart, so that was enough to get started.

And eventually we got Ubuntu to boot. And Firefox to open a web page. Now, we’ve since discovered dozens of things that make the chip faster, but back then it took many minutes to render the simplest webpage. But you could see the potential. “apt-get install” seemed magical. I’ve ported all sorts of software to VideoCore, and it’s hard work, but the ARM had all the packages you could think of, just there.

Just over a year ago, Eben put the first “production” Pi board on my desk. Apart from one brief scare (the red bodge wire in the beta boards), I got it up and running and that evening recorded a video of it doing stuff called Raspberry Pi Beta Board Bring up. It was viewed by 100K people in a few days. And since then I’ve been busy…

Liz Upton, Head of Communications, Raspberry Pi Foundation
Liz is…ah, forget it. 

I’ve not got much to add. Thank you all for making this the most exciting, exhausting, entertaining year I’ve ever spent. Thanks to all my colleagues for being some of the best people in the world to work with. Thanks to the volunteers for your generosity: nothing’s worth more than your personal time, and we’re still amazed that so many of you offer it so freely. Big shout-out to the forum and blog mods and admins, the MagPi guys and the Raspberry Jammers here – you rock. Thanks to the open-source community for all the work on documenting, porting and evangelising you do. Thanks to Eben for managing to carry on doing some superb husbanding, despite some pretty serious stressors. (It’s tough enough doing his job, but doing it with a wife who sleep-talks about banhammers is awful, or so I’m led to believe.)

And thanks to you personally, whoever you are, for reading this blog and for being curious about what we do here. This year’s been a hell of a ride. I hope you’ll stay with us to watch what we do with the next one.


A Raspberry Pi, hosting…Raspberry Pi

Liz: Here’s a guest post from our old friend Pete Stevens, who runs Mythic Beasts, the hosting company that keeps this website on its legs even though more than 100,000 of you visit every day. He’s in charge of a Raspberry Pi which has some of the best connections in the world. And we don’t mean social connections: read down to learn more. (This post was first published at http://blog.mythic-beasts.com/.) Thanks Pete!

Raspberry Pi hosts itself

We’re now running a mirror for the Raspberry Pi download server and the Raspbian apt repository on a Raspberry Pi.

The first problem was obtaining a Raspberry Pi as buying one was tricky: firstly the online shops were down, then the queue for a Pi was rather long. As any banker can tell you, occasionally crime does pay, so I abducted Mooncake, a cat which owns Liz and Eben. I then ransomed the feline back in exchange for a Raspberry Pi.

[Liz interjects: and Mooncake hasn't got over it yet. She now hides every time someone with a beard visits the house.]

The hardware setup starts with a power supply with an IEC14 connector connected to the masterswitch for remote power cycling. This PSU connects to a powered USB hub, with a USB lead connecting to the power connector on the Raspberry Pi. The Pi is then connected back to the hub on the data cable with a 1TB USB external hard disk attached to that. There’s a 100Mbit ethernet cable which connects up to the core Mythic Beasts network and out to the Internet. Technically the switch port on the other end is 1Gbit but the Raspberry Pi isn’t fast enough to use that.

The yellow fibre in the background is a very large Internet exchange with over a terabit of bandwidth. The Pi isn’t connected directly (that’d be too stupid even for us) and the packets travel from the Pi to the exchange a couple of feet away via another building. However with LONAP and LINX within 2ms and AMSIX a mere 8ms away it’s still rather well connected.

The software setup on the Pi is fairly straightforward. We started with the Debian squeeze image, ssh/apache enabled, munin enabled (graphs here). We’ve changed the password (obviously), the ssh keys (shipping the same ssh key on every OS image isn’t optimal), and moved /var/www and /var/log to the USB disk so as not to fill the SSD card. rpi-update was needed to make the USB/network setup stable under load as the initial image kept crashing. We also set the RAM split to 224MB for Linux as we really aren’t using the GPU.

It’s up and running both IPv4 (93.93.128.128) and IPv6 (2a00:1098:0:80:1000:13:0:3), as the core Raspbian server is also running IPv6 and the main Raspberry Pi server is also IPv6 at present; this machine has seen more than 50% of its traffic over IPv6. I suspect this will change as people download images from it though.

At present the Raspberry Pi is devoting nearly half its CPU to drawing munin graphs so I need to benchmark the new Raspbian distribution to see if the hard float debian build improves the anti-aliasing, as presently all the calculations are done without using the FPU on the arm core in the Pi. Benchmarking suggests that we can deliver 35-50Mbps of file downloads reasonably comfortably at present.

Is this sensible? We’ve had a few customers ask us if the Raspberry Pi would be a sensible device for hosting on as it’s very cheap and very low power. Unfortunately it’s also very slow for this kind of application and the supporting hardware is very bulky. The i7 quad core Mac Mini occupies less space than the Pi + hub + disk + PSU, uses about fives times as much electricity, costs about five times as much once you include the supporting hardware but is hundreds of times faster. So revolutionising the hosting industry isn’t going to happen with the Raspberry Pi, at least not until they build a PoE one with gigabit ethernet and more RAM.

[Liz: you may be waiting some time for that, Pete. I'd stick to the Mac Minis.]

 

It’s not currently sensible to do this with shelves full of Raspberry Pis because the performance per Watt isn’t good enough. But we’re working on it.

Thanks go to Liam Fraser and Mike Thompson for adding us to the official mirror lists for the Pi and Raspbian. Additional thanks go to Eben and Liz for paying the ransom fee of one Raspberry Pi in exchange for the safe return of Mooncake.