rohroh
Posts: 1
Joined: Mon Jul 03, 2017 11:31 pm

Assistance for Non-Verbal Child

Thu Aug 17, 2017 12:15 am

Hi, I am working on a project for my own child who is completely blind, learning delayed and Non-verbal.

The long and short of it is that she is attempting to communicate at times by different sounds or actions. What i am looking at doing is to create a Pi based "Box" that has a series of buttons on the top of it for her to press for simple things such as Playing her music, Calling out for Mum or Dad, Asking for Food or Drink etc.

I was hoping to have initially about 10 buttons which will have various textures or shapes on the top of the buttons (3d printer already pumping those out).

My request is that i need some help with the programming of the Pi, I will be putting a small screen on the top for us to view debug etc if needed. I have a small set of computer speakers in it to make the sounds. What i would like to be able to do is trigger the various functions such as playing music from a USB stick after doing a text to speach of "PLAY MUSIC". If the button is pressed again it would stop the music then trigger text to speak "STOP MUSIC" . If she presses the one for Food it should trigger text to speak - "FOOD PLEASE" etc etc etc.

I would prefer that this is written in Python. I will be attaching the buttons to the GPIO pins directly via pull down resistors etc. If we can also Log the various button presses that would be good...

Any help with this project would be greatly appreciated - i don't have enough Python programming skills to do it myself but i am more than happy to document and provide Kudos to those who help out.

User avatar
bensimmo
Posts: 3014
Joined: Sun Dec 28, 2014 3:02 pm
Location: East Yorkshire

Re: Assistance for Non-Verbal Child

Thu Aug 17, 2017 4:11 am

Just pop to the main site, learning/education section and look at the getting started parts.
You'll have the basic code there.
Speach may be harder, unless it's prerecorded voices.

nawbruh
Posts: 1
Joined: Tue Feb 13, 2018 5:47 pm

Re: Assistance for Non-Verbal Child

Tue Feb 13, 2018 5:51 pm

I also have a child that is nonverbal/delayed and was looking to create a communication board also. You said that you have already printed out the buttons on your 3d printer. Do you have the specs for those? Or do you have a place where you are posting your progress? Would love to be able to see how someone else is creating theirs! :)


Thanks again and good luck!

Earlton2
Posts: 45
Joined: Mon May 27, 2013 1:13 am
Location: Tonight it's -28C
Contact: Website

Re: Assistance for Non-Verbal Child

Sat Mar 10, 2018 5:14 pm

Sounds and Speech: There is a train set described on web.ncf.ca/fx829 with an early video of it running. This is controlled from an old telephone dial and as the engines move there are sensors under the track to locate their position. These and user commands trigger both sounds and speech out of four speakers. I use a relay to select one of two audio amplifiers and the audio channel to select which speaker.

Engine sounds are produced by system calls to "aplay". In c-code this is system("aplay DDL.wav -q"). In this case DDL.wav is just a short audio file producing sounds for Diesel Departing Left (channel) speaker. It could just as easily be a recording saying "Jam on toast please". If you have aplay loaded and a wav file available you can test this from the command line.

For train arrival announcements I use system calls to espeak with a text string I built up using sprintf(). i.e. system("espeak txt") where txt was a string. Here is my c-code to say "Ambulance, Fire or Police" in English (northern uk accent) or French. Note how the file from espeak is passed to aplay. This is likely much easier in Python but it's not a language I use and ditto re the command line.

if (fEnglish) sprintf(sEmerg, "espeak -ven-uk-north -a50 -p10 -s150 --stdout"
" \" Am bulance, Fire, or, Police \" 2>/dev/null | aplay -q");
else sprintf(sEmerg, "espeak -vfr -a50 -p10 -s150 --stdout \" Ambulance, "
"pompiers, ou, la, police \" 2>/dev/null | aplay -q");

Also notice how the word Ambulance is broken up, and the additional commas, to make the output easier to understand. I don't know French so I had a neighbour come over with the translation and then to listen to the output. There is a switch on the control panel to select English/French.

For the station announcements I use the string "the train arriving on platform on is the 12 27 from Arnprior, stopping at ..." To get real time in there I added an i2c DS1337 real time clock which is used to set the system clock which I could then read and build up the text e.g. "12 27"

You are welcome to both code and circuits if they are any use to you. I had meant to put them up on the web site but I don't see them there so it was just another job on my to-do list!

mikerr
Posts: 2700
Joined: Thu Jan 12, 2012 12:46 pm
Location: UK
Contact: Website

Re: Assistance for Non-Verbal Child

Sat Mar 10, 2018 9:13 pm

This is much easier in python now with gpiozero:

https://projects.raspberrypi.org/en/pro ... omputing/7 - using buttons
.. and see "making a switch" further down.
Android app - Raspi Card Imager - download and image SD cards - No PC required !

User avatar
Gavinmc42
Posts: 2073
Joined: Wed Aug 28, 2013 3:31 am

Re: Assistance for Non-Verbal Child

Mon Apr 02, 2018 7:38 am

A chordic keyboard is one way to get more info from a small number of switches.
10 buttons = 2^10-1 = 1023 combinations.
USB numeric keypad?
https://www.tekgear.com/twiddler3-blem-blue.html

http://diy3dprinting.blogspot.com.au/20 ... orded.html
I have seen twiddlers made from boxes and a few switches held in the palm with a strap that goes over the back of the hand.

You could do something like a power glove, finger flex/switches, tiny speaker for audio output and and Zero with USB power bank.
I2S DAC/AMP https://www.adafruit.com/product/3006

Plenty of sensors with breakout boards for motion detection.
https://www.adafruit.com/category/59
Use hand tilt for shift type function chordic keys

All sorts of sensors these days.
https://www.adafruit.com/category/35

Even a laser distance sensor, put one on a finger tip and you have whitecane.
https://www.adafruit.com/product/3317
There are people learning to echo sound from mouth clicks.
Would not an electronic sound generator be easier?

I have been wanting to make a body motion sensing suit for my kid, based on 9 axis motion sensors and SonicPi.
Trying to get him interested in music. dance and some exercise ;)
I'm dancing on Rainbows.
Raspberries are not Apples or Oranges

User avatar
DougieLawson
Posts: 33398
Joined: Sun Jun 16, 2013 11:19 pm
Location: Basingstoke, UK
Contact: Website

Re: Assistance for Non-Verbal Child

Mon Apr 02, 2018 7:49 am

bensimmo wrote:
Thu Aug 17, 2017 4:11 am
Just pop to the main site, learning/education section and look at the getting started parts.
You'll have the basic code there.
Speech may be harder, unless it's prerecorded voices.
With an AIY Voicehat it's relatively easy to use Google's text-to-speech service to say your own things.
https://thepihut.com/products/google-aiy-voice-kit
Microprocessor, Raspberry Pi & Arduino Hacker
Mainframe database troubleshooter
MQTT Evangelist
Twitter: @DougieLawson

2012-18: 1B*5, 2B*2, B+, A+, Z, ZW, 3Bs*3, 3B+

Any DMs sent on Twitter will be answered next month.

User avatar
mahjongg
Forum Moderator
Forum Moderator
Posts: 10725
Joined: Sun Mar 11, 2012 12:19 am
Location: South Holland, The Netherlands

Re: Assistance for Non-Verbal Child

Mon Apr 02, 2018 11:44 am

+1, you can find more info about the AIY voicehat here: viewforum.php?f=114

keshymarkyz
Posts: 1
Joined: Thu Apr 05, 2018 8:47 am

Re: Assistance for Non-Verbal Child

Thu Apr 05, 2018 2:22 pm

All of these tectums and maximum of those support

User avatar
bensimmo
Posts: 3014
Joined: Sun Dec 28, 2014 3:02 pm
Location: East Yorkshire

Re: Assistance for Non-Verbal Child

Thu Apr 05, 2018 8:12 pm

Also agree on the VoiceHAT, it comes with all the parts , speaker, microphone and images. It also comes with a good way to connect other things too.
It wasn't out when I first responded to this post, but if using the online Voice part, it get expensive as far as I know, as you pay for it according to https://medium.com/@aallan/a-magic-mirr ... a0fea3b4d6
You should be able to use the hardware with other systems though as I think the local 'free' version is restrictive. Also the pay version is restricted in the EU still.


(I've just setup with the 21-2-18 version and it doesn't match the website https://aiyprojects.withgoogle.com/voice/#users-guide for setup instructions to get the .json file, but that for another day)

Return to “Assistive technology and accessibility”

Who is online

Users browsing this forum: No registered users and 3 guests