I definitely agree with the notion of letting kids be kids, but it's obvious from the very fact that you're here asking sensible questions about it that you already know that.
So, I just wanted to share my thoughts, if that's alright!
I was given my first computer more than two decades ago, as a Christmas present when I was at the age of six, after showing a keen interest in computers myself. I still have it right here, in fact, and it gave me the opportunity to pick up various skills and traits which have never left me, as well as firing my imagination in general via the games and software that I bought and used for it.
I am unfortunately not of a programming mindset so it didn't help me too much there (I did give it a good go, and have tried again a number of times since, but I just don't ever gel with it), but it nonetheless helped me to pick up transferrable skills that are still with me today - typing, command-line usage (it helped my memory, considering that back then we didn't have niceties like being able to hit the up arrow-key to use commands from the day before!), general common sense about using differing interfaces (i.e., you can't expect them all to be the same, as they never have been and never will be), that sort of thing.
Of course, it's also left me raising an eyebrow in more recent years whenever I've seen folks freaking out over using command lines (which all of the 8-bit home micros booted to), when there's nothing scary about them...
Not all things learned from a home-computer have to be strictly computing-related, though; I was given a strict limit of one hour per day using it (two hours per day on weekends), though, and with hindsight I can see that this also helped me to learn self-restraint, as well as computing skills (I also got to watch TV, too, and that never did me any harm either
). And, as I'm sure most here know, the dominant software format for the computers of the 1980s was cassette tapes, so plenty of patience was learned via loading things from those, as well as from saving my pennies to buy new software in the first place. Reading the manuals, as well as the computing magazines of the day (which we now have a brilliant present-day equivalent to in the form of The MagPi) also helped me to expand my vocabulary and understanding, too.
If your kids already have an interest in the field, and you want to set them up with practical skills that they can use later on (rather than, say, locking them into how to click particular menus in particular software packages, which will definitely change later on), then I'd say go for it. I've always been very grateful (as you might guess from the above) that my own parents saw it that way.