Page 2 of 4

Posted: Tue 03 Sep 2013, 21:08
by gcmartin
I love what this thread's community has done with this with other contributions that was pulled together in this distro. This humanitarian offering, though, is very robust offering to desktop users. I love what you've done. And am looking forward as this product continues its evolutionary path. What is so amazing is that this product provides far-reaching uses to those whom it is designed for, but, it ALSO, provides great services and use to those of us who are not hampered.

This has a great mainstream appeal if more of the community knew about it. It there is a manner of making this appealing to a larger audience, this product could morph into one where more users would mean more heads with ideas for expanding and improving upon the great things it already does.

Thanks to all of you for coming together for the version 1.0 of this effort in Puppyland.

Here to help

Obedient Pup (V1 Released 16th August 2013)

Posted: Mon 09 Sep 2013, 07:40
by ETP
@gcmartin,

Thanks for your kind comments. I am keen to hear what issues testers have found and in particular what percentage success rate they had with the walk-through.
Voice control is not without its problems! :)

Image

Posted: Mon 09 Sep 2013, 13:11
by technosaurus
It looks like pocketsphinx_continuous is a good light speech recognition tool to complement espeak for text2speech.

One way to handle the output from speech recognition is to use /dev/stdout as the output and pipe it through a while-read-case block like:

Code: Select all

pocketsphinx_continuous <params>| while read LINE; do
case "$LINE" in
  *)...;; #use different regex here for different actions
esac;
done

Posted: Mon 09 Sep 2013, 20:40
by gcmartin
Thanks @Techno.
You wrote:It looks like pocketsphinx_continuous is a good light speech recognition tool to complement espeak for text2speech.
Is there a chance that a PET can be made for pocketsphinx_continuous? I know that @Ted Dog has contributed "espeak", here, on the FATDOG thread.

Can these 2 packages be installed for 64bit PUPs as well as 32bit PUPs or would there have to be a 32bit version and a separate 64bit version of each?

Thanks in advance, for what this effort is advancing in this distro.

Would this help new user acceptance?
Here's an idea that I think will make it rather simple for anyone to step into this platform's base services.

Shinobar, then TaZoC, 01Micko, and BarryK introduced a "FirstRUN" concept years ago for initial boot and use of their distros. It change Puppy startup from a multi-stop text base unforgiving clunker to a modern interactive use at anytime utility. It single-handedly has revolutionized startups in PUPs. It has been seen as a fabulous manner to start any use of the distro off for users; new users or experienced, alike.

Could/would extending that utility's extension with some of the ideas shown in this thread provide a level of increased comfort when someone new boots to desktop. It could serve as a springboard for any user where he/she might have the FirstRUN tool read-back for entries as well as do some initial audio interactive setup with the person booting ObedientPUP.

I could envision this post earlier as being an initial "get acquainted FirstRUN step" added to propel a user into comfort. Or something equally simlar to elevate the startup experience with user envolvement doing something maeningful and simple, just as FirstRUN does in other PUPs..

I dont have the skills to modify FirstRUN such that it provides the kind of foundation that this distro needs,but, I wonder if that would be as evolutionary as Shinobar's FirstRUN has become in most PUPs.

Here to help

Obedient Pup - Apple iTunes Trailers (Video Add-on)

Posted: Thu 10 Oct 2013, 08:19
by ETP
Please note that the included iTunes add-on is currently not working in XBMC as Apple have completely changed their website/service. The author of the add-on “dersphere

Posted: Fri 11 Oct 2013, 14:41
by technosaurus
I found a decent tutorial/example of using sphinx:
http://hackaday.com/2010/07/11/adding-s ... -platform/

Obedient Pup (V1 Released 16th August 2013)

Posted: Fri 11 Oct 2013, 15:08
by ETP
Hi technosaurus,
Thanks for flagging this up. I understand that Ubuntu 13.10 will include speech recognition (PocketSphinx) by default. The final is due out this month.

http://www.iloveubuntu.net/speech-recog ... 10-default

BK has included support for Ubuntu 13.10 (Saucy Salamander) in Woof and we may well see a Pup based on it.

Posted: Fri 11 Oct 2013, 17:10
by technosaurus
built in precise 3.8.3, but you'll still need to populate /usr/share/pocketsphinx/model from the model directory in the source package here:

http://hivelocity.dl.sourceforge.net/pr ... 0.8.tar.gz

Sorry, those parts were too large for a forum post.

Obedient Pup - Apple iTunes Trailers (Video Add-on)

Posted: Mon 14 Oct 2013, 05:36
by ETP
On 10th October I posted about a global problem with this XBMC add-on which is included in this Pup.
It has now been fixed and the add-on will automatically upgrade to version 0.2.1 the next time XBMC is launched.

Signing off with:
[Tap the HOTKEY and say] “YOUTUBE Brook Benton Rainy Night in Georgia

Posted: Thu 17 Oct 2013, 18:13
by Atle
is there a simple way to create custom speach commands for someone that does not speak very well?

Such as his way of saying "Click" in order to perform a simple mouseclick?

Great efforts here and lots of kreds to devs. Hope to see this merged with OneSwitch one day :-)

Atle

Posted: Thu 17 Oct 2013, 21:20
by Ted Dog
Atle wrote:is there a simple way to create custom speach commands for someone that does not speak very well?

Such as his way of saying "Click" in order to perform a simple mouseclick?

Great efforts here and lots of kreds to devs. Hope to see this merged with OneSwitch one day :-)

Atle
With the large amount of serviceability spin-off ideas floating on the forum you may have missed that I'm working on just such a thing under the OneClick talking onscreen keyboard, I'm wait to see which direction the group is going, since my idea is little more than figuring what is the best way to integrate the pieces, and writing the bubblegum spaghetti code to make it work

Obedient Pup (V1 Released 16th August 2013)

Posted: Fri 18 Oct 2013, 04:55
by ETP
Hi Atle,
Can you please give us some more information?
Is the speech impediment the only disability or are there other issues?
Which specific Puppy do you have in mind and what types of keyboard and mouse are in use? (Standard or laptop)
Does the person use any other OS?

Any current solution may be simple or complex depending on your responses to these questions.

Posted: Fri 18 Oct 2013, 08:05
by Atle
The person i try to help out have the following list in Grub4dos:

ObedientPup (current favorite)
OneSwitch (was a bit to advanced)
DouDouLinux (for training with mouse)
MicroXP for the assistants to use for hourlist etc/ printersupport

Lets say he is about 90% disabled with multiple diagnosis and one arm that can barely move the mouse. The right arm can click on a button, but that takes focus away from the mouse.

I tried the cam and that was good. Yet he can not click a button without looking at it and if speech is used,he "throws" his head when he says a word and its not recognizable as common English, but more like as if something is down the throat.

Anyhow, i came to the conclusion that the only way to get a smooth operating of a PC, was by using the mouse to move cursor and then maybe use simple word commands to click etc.

I though 5 commands would be good to start with and that is:

Click
up
down
rightclick
paste (to paste a smiley into textboxses as reply to thing on facebook.

So I guess I look at a challenging project.

The person had all the bad luck you can have right after birth and is now in the mid twenties. Wheelchair and 24 hour assistance.

BUT... there was a great amount of SUPRISE for the assistants to see Puppy "@ work"... they never saw this before and where very impressed. I honestly believe there is a big future for this, as there is not really anything out there apart from closed source and damn expensive MS plattform solution.

Actually, those in need of some work, could potentially specialize in this software and become consultants, as I feel there is lots of solution to mix between covering most challenges.

My self I will have this as a part of my toolbox in the future as i come across different challenges every now and then...

Kreds to devs again:-)

Obedient Pup (V1 Released 16th August 2013)

Posted: Fri 18 Oct 2013, 18:00
by ETP
Hi Atle,

Given the extent of the disabilities it may well need a custom solution. You have said that he favours Obedient V1 but that you consider voice commands to issue clicks the best option. That would be possible only if a >90% recognition factor could be achieved with Google voice on say 6 words.
Before we go down that route however, may I suggest that you first try on his behalf another simpler single switch Pup where the relevant clicks can be issued by “Radar

Posted: Fri 18 Oct 2013, 20:14
by greengeek
Atle wrote:Anyhow, i came to the conclusion that the only way to get a smooth operating of a PC, was by using the mouse to move cursor and then maybe use simple word commands to click etc.
Hi Atle, I have been working on using technosaurus' "pocketsphinx" pet to get voice recognition working with good reliabilty and I believe it is definitely good enough for some basic local voice command recognition.

I have started a project to control mouseclicks verbally in accordance with your suggestion above.

(The first step is to try my audiotest pet to see if your system is compatible. It is a very quick and easy test)

Project here:
http://murga-linux.com/puppy/viewtopic.php?t=89370

Posted: Fri 18 Oct 2013, 20:43
by Ted Dog
Atle wrote:The person i try to help out have the following list in Grub4dos:

ObedientPup (current favorite)
OneSwitch (was a bit to advanced)
DouDouLinux (for training with mouse)
MicroXP for the assistants to use for hourlist etc/ printersupport

Lets say he is about 90% disabled with multiple diagnosis and one arm that can barely move the mouse. The right arm can click on a button, but that takes focus away from the mouse.

I tried the cam and that was good. Yet he can not click a button without looking at it and if speech is used,he "throws" his head when he says a word and its not recognizable as common English, but more like as if something is down the throat.

Anyhow, i came to the conclusion that the only way to get a smooth operating of a PC, was by using the mouse to move cursor and then maybe use simple word commands to click etc.

I though 5 commands would be good to start with and that is:

Click
up
down
rightclick
paste (to paste a smiley into textboxses as reply to thing on facebook.

So I guess I look at a challenging project.

The person had all the bad luck you can have right after birth and is now in the mid twenties. Wheelchair and 24 hour assistance.

BUT... there was a great amount of SUPRISE for the assistants to see Puppy "@ work"... they never saw this before and where very impressed. I honestly believe there is a big future for this, as there is not really anything out there apart from closed source and damn expensive MS plattform solution.

Actually, those in need of some work, could potentially specialize in this software and become consultants, as I feel there is lots of solution to mix between covering most challenges.

My self I will have this as a part of my toolbox in the future as i come across different challenges every now and then...

Kreds to devs again:-)
Sounds like a good tester person, the doctors I am working with also think individuals with multiple sclerosis would be the best serve and help guide an effort like this. So, I pushed OneSwitch idea to OneClick idea as the most basic function we should build too. Everything should be doable with OneClick

OneClick is like OneSwitch but does NOT require physical connection, the click could be a IR controller, a voiced sound for click, blown into a tube, eye close etc.

Obedient Pup V1 & (V2 Released 23rd October 2013)

Posted: Wed 23 Oct 2013, 11:26
by ETP
In addition to features for the visually impaired, version 2 includes bug fixes and modified scripts to improve reliability on the voice control side of things.
Existing users of voice control are therefore advised to upgrade to this new version.

Main Changes since V1

1. At startup the following greeting is spoken. It uses cloud based TTS to do this and serves to confirm that:
a) The internet connection is working.
b) The speakers are turned on and functional.
c) The pc has booted and is ready for action.
  • Welcome to Obedient Puppy version 2.
    It includes audible cues for the blind or visually impaired to signify,
    1. The start and end of both hotkey and voice mail recording periods.
    2. A different tone just at the beginning of the Google voice search recording period.
    3. Spoken assistance and tones with voice mail.
    Have fun! This is the hotkey sound that you will hear.
2. A new default wallpaper more suitable for the visually impaired.

3. Voice access to the BBC World Service using the new BBC radio iplayer. A new icon in the browser provides access to all BBC local and national radio channels. No license is required for radio.

4. The Chrome extension “Checker Plus for Gmail

Posted: Wed 23 Oct 2013, 16:00
by Atle
Downloaded it and did a frugal. There seem to be some error as the screen freezes within pretty short time. Mouse moves, but could not click on anything. Will try to make a savefile and see if i can figure out what goes wrong.

Posted: Thu 24 Oct 2013, 00:31
by Ted Dog
Ouch mouse freeze, I have had this issue too, but I have not downloaded this yet, what is the base ? percise... I hope not.

Posted: Thu 24 Oct 2013, 01:10
by starhawk
Ted, per the first post in the thread...
ETP wrote:It is based on MouseCam Pup V6, which itself was a re-master of Precise Puppy 5.6.1 (k 3.3.44).
;)