Obedient Pup - (V3 Released 05th November 2013)

For talk and support relating specifically to Puppy derivatives
Message
Author
gcmartin

#21 Post by gcmartin »

I love what this thread's community has done with this with other contributions that was pulled together in this distro. This humanitarian offering, though, is very robust offering to desktop users. I love what you've done. And am looking forward as this product continues its evolutionary path. What is so amazing is that this product provides far-reaching uses to those whom it is designed for, but, it ALSO, provides great services and use to those of us who are not hampered.

This has a great mainstream appeal if more of the community knew about it. It there is a manner of making this appealing to a larger audience, this product could morph into one where more users would mean more heads with ideas for expanding and improving upon the great things it already does.

Thanks to all of you for coming together for the version 1.0 of this effort in Puppyland.

Here to help

User avatar
ETP
Posts: 1193
Joined: Tue 19 Oct 2010, 19:55
Location: UK

Obedient Pup (V1 Released 16th August 2013)

#22 Post by ETP »

@gcmartin,

Thanks for your kind comments. I am keen to hear what issues testers have found and in particular what percentage success rate they had with the walk-through.
Voice control is not without its problems! :)

Image
Regards ETP
[url=http://tinyurl.com/pxzq8o9][img]https://s17.postimg.cc/tl19y14y7/You_Tube_signature80px.png[/img][/url]
[url=http://tinyurl.com/kennels2/]Kennels[/url]

User avatar
technosaurus
Posts: 4853
Joined: Mon 19 May 2008, 01:24
Location: Blue Springs, MO
Contact:

#23 Post by technosaurus »

It looks like pocketsphinx_continuous is a good light speech recognition tool to complement espeak for text2speech.

One way to handle the output from speech recognition is to use /dev/stdout as the output and pipe it through a while-read-case block like:

Code: Select all

pocketsphinx_continuous <params>| while read LINE; do
case "$LINE" in
  *)...;; #use different regex here for different actions
esac;
done
Check out my [url=https://github.com/technosaurus]github repositories[/url]. I may eventually get around to updating my [url=http://bashismal.blogspot.com]blogspot[/url].

gcmartin

#24 Post by gcmartin »

Thanks @Techno.
You wrote:It looks like pocketsphinx_continuous is a good light speech recognition tool to complement espeak for text2speech.
Is there a chance that a PET can be made for pocketsphinx_continuous? I know that @Ted Dog has contributed "espeak", here, on the FATDOG thread.

Can these 2 packages be installed for 64bit PUPs as well as 32bit PUPs or would there have to be a 32bit version and a separate 64bit version of each?

Thanks in advance, for what this effort is advancing in this distro.

Would this help new user acceptance?
Here's an idea that I think will make it rather simple for anyone to step into this platform's base services.

Shinobar, then TaZoC, 01Micko, and BarryK introduced a "FirstRUN" concept years ago for initial boot and use of their distros. It change Puppy startup from a multi-stop text base unforgiving clunker to a modern interactive use at anytime utility. It single-handedly has revolutionized startups in PUPs. It has been seen as a fabulous manner to start any use of the distro off for users; new users or experienced, alike.

Could/would extending that utility's extension with some of the ideas shown in this thread provide a level of increased comfort when someone new boots to desktop. It could serve as a springboard for any user where he/she might have the FirstRUN tool read-back for entries as well as do some initial audio interactive setup with the person booting ObedientPUP.

I could envision this post earlier as being an initial "get acquainted FirstRUN step" added to propel a user into comfort. Or something equally simlar to elevate the startup experience with user envolvement doing something maeningful and simple, just as FirstRUN does in other PUPs..

I dont have the skills to modify FirstRUN such that it provides the kind of foundation that this distro needs,but, I wonder if that would be as evolutionary as Shinobar's FirstRUN has become in most PUPs.

Here to help

User avatar
ETP
Posts: 1193
Joined: Tue 19 Oct 2010, 19:55
Location: UK

Obedient Pup - Apple iTunes Trailers (Video Add-on)

#25 Post by ETP »

Please note that the included iTunes add-on is currently not working in XBMC as Apple have completely changed their website/service. The author of the add-on “dersphere
Regards ETP
[url=http://tinyurl.com/pxzq8o9][img]https://s17.postimg.cc/tl19y14y7/You_Tube_signature80px.png[/img][/url]
[url=http://tinyurl.com/kennels2/]Kennels[/url]

User avatar
technosaurus
Posts: 4853
Joined: Mon 19 May 2008, 01:24
Location: Blue Springs, MO
Contact:

#26 Post by technosaurus »

I found a decent tutorial/example of using sphinx:
http://hackaday.com/2010/07/11/adding-s ... -platform/
Check out my [url=https://github.com/technosaurus]github repositories[/url]. I may eventually get around to updating my [url=http://bashismal.blogspot.com]blogspot[/url].

User avatar
ETP
Posts: 1193
Joined: Tue 19 Oct 2010, 19:55
Location: UK

Obedient Pup (V1 Released 16th August 2013)

#27 Post by ETP »

Hi technosaurus,
Thanks for flagging this up. I understand that Ubuntu 13.10 will include speech recognition (PocketSphinx) by default. The final is due out this month.

http://www.iloveubuntu.net/speech-recog ... 10-default

BK has included support for Ubuntu 13.10 (Saucy Salamander) in Woof and we may well see a Pup based on it.
Regards ETP
[url=http://tinyurl.com/pxzq8o9][img]https://s17.postimg.cc/tl19y14y7/You_Tube_signature80px.png[/img][/url]
[url=http://tinyurl.com/kennels2/]Kennels[/url]

User avatar
technosaurus
Posts: 4853
Joined: Mon 19 May 2008, 01:24
Location: Blue Springs, MO
Contact:

#28 Post by technosaurus »

built in precise 3.8.3, but you'll still need to populate /usr/share/pocketsphinx/model from the model directory in the source package here:

http://hivelocity.dl.sourceforge.net/pr ... 0.8.tar.gz

Sorry, those parts were too large for a forum post.
Attachments
pocketsphinx_continuous-0.8-i486.pet
(160.35 KiB) Downloaded 538 times
Check out my [url=https://github.com/technosaurus]github repositories[/url]. I may eventually get around to updating my [url=http://bashismal.blogspot.com]blogspot[/url].

User avatar
ETP
Posts: 1193
Joined: Tue 19 Oct 2010, 19:55
Location: UK

Obedient Pup - Apple iTunes Trailers (Video Add-on)

#29 Post by ETP »

On 10th October I posted about a global problem with this XBMC add-on which is included in this Pup.
It has now been fixed and the add-on will automatically upgrade to version 0.2.1 the next time XBMC is launched.

Signing off with:
[Tap the HOTKEY and say] “YOUTUBE Brook Benton Rainy Night in Georgia
Regards ETP
[url=http://tinyurl.com/pxzq8o9][img]https://s17.postimg.cc/tl19y14y7/You_Tube_signature80px.png[/img][/url]
[url=http://tinyurl.com/kennels2/]Kennels[/url]

Atle
Posts: 596
Joined: Wed 19 Nov 2008, 12:38
Location: Oslo, Norway
Contact:

#30 Post by Atle »

is there a simple way to create custom speach commands for someone that does not speak very well?

Such as his way of saying "Click" in order to perform a simple mouseclick?

Great efforts here and lots of kreds to devs. Hope to see this merged with OneSwitch one day :-)

Atle

User avatar
Ted Dog
Posts: 3965
Joined: Wed 14 Sep 2005, 02:35
Location: Heart of Texas

#31 Post by Ted Dog »

Atle wrote:is there a simple way to create custom speach commands for someone that does not speak very well?

Such as his way of saying "Click" in order to perform a simple mouseclick?

Great efforts here and lots of kreds to devs. Hope to see this merged with OneSwitch one day :-)

Atle
With the large amount of serviceability spin-off ideas floating on the forum you may have missed that I'm working on just such a thing under the OneClick talking onscreen keyboard, I'm wait to see which direction the group is going, since my idea is little more than figuring what is the best way to integrate the pieces, and writing the bubblegum spaghetti code to make it work

User avatar
ETP
Posts: 1193
Joined: Tue 19 Oct 2010, 19:55
Location: UK

Obedient Pup (V1 Released 16th August 2013)

#32 Post by ETP »

Hi Atle,
Can you please give us some more information?
Is the speech impediment the only disability or are there other issues?
Which specific Puppy do you have in mind and what types of keyboard and mouse are in use? (Standard or laptop)
Does the person use any other OS?

Any current solution may be simple or complex depending on your responses to these questions.
Regards ETP
[url=http://tinyurl.com/pxzq8o9][img]https://s17.postimg.cc/tl19y14y7/You_Tube_signature80px.png[/img][/url]
[url=http://tinyurl.com/kennels2/]Kennels[/url]

Atle
Posts: 596
Joined: Wed 19 Nov 2008, 12:38
Location: Oslo, Norway
Contact:

#33 Post by Atle »

The person i try to help out have the following list in Grub4dos:

ObedientPup (current favorite)
OneSwitch (was a bit to advanced)
DouDouLinux (for training with mouse)
MicroXP for the assistants to use for hourlist etc/ printersupport

Lets say he is about 90% disabled with multiple diagnosis and one arm that can barely move the mouse. The right arm can click on a button, but that takes focus away from the mouse.

I tried the cam and that was good. Yet he can not click a button without looking at it and if speech is used,he "throws" his head when he says a word and its not recognizable as common English, but more like as if something is down the throat.

Anyhow, i came to the conclusion that the only way to get a smooth operating of a PC, was by using the mouse to move cursor and then maybe use simple word commands to click etc.

I though 5 commands would be good to start with and that is:

Click
up
down
rightclick
paste (to paste a smiley into textboxses as reply to thing on facebook.

So I guess I look at a challenging project.

The person had all the bad luck you can have right after birth and is now in the mid twenties. Wheelchair and 24 hour assistance.

BUT... there was a great amount of SUPRISE for the assistants to see Puppy "@ work"... they never saw this before and where very impressed. I honestly believe there is a big future for this, as there is not really anything out there apart from closed source and damn expensive MS plattform solution.

Actually, those in need of some work, could potentially specialize in this software and become consultants, as I feel there is lots of solution to mix between covering most challenges.

My self I will have this as a part of my toolbox in the future as i come across different challenges every now and then...

Kreds to devs again:-)

User avatar
ETP
Posts: 1193
Joined: Tue 19 Oct 2010, 19:55
Location: UK

Obedient Pup (V1 Released 16th August 2013)

#34 Post by ETP »

Hi Atle,

Given the extent of the disabilities it may well need a custom solution. You have said that he favours Obedient V1 but that you consider voice commands to issue clicks the best option. That would be possible only if a >90% recognition factor could be achieved with Google voice on say 6 words.
Before we go down that route however, may I suggest that you first try on his behalf another simpler single switch Pup where the relevant clicks can be issued by “Radar
Regards ETP
[url=http://tinyurl.com/pxzq8o9][img]https://s17.postimg.cc/tl19y14y7/You_Tube_signature80px.png[/img][/url]
[url=http://tinyurl.com/kennels2/]Kennels[/url]

User avatar
greengeek
Posts: 5789
Joined: Tue 20 Jul 2010, 09:34
Location: Republic of Novo Zelande

#35 Post by greengeek »

Atle wrote:Anyhow, i came to the conclusion that the only way to get a smooth operating of a PC, was by using the mouse to move cursor and then maybe use simple word commands to click etc.
Hi Atle, I have been working on using technosaurus' "pocketsphinx" pet to get voice recognition working with good reliabilty and I believe it is definitely good enough for some basic local voice command recognition.

I have started a project to control mouseclicks verbally in accordance with your suggestion above.

(The first step is to try my audiotest pet to see if your system is compatible. It is a very quick and easy test)

Project here:
http://murga-linux.com/puppy/viewtopic.php?t=89370

User avatar
Ted Dog
Posts: 3965
Joined: Wed 14 Sep 2005, 02:35
Location: Heart of Texas

#36 Post by Ted Dog »

Atle wrote:The person i try to help out have the following list in Grub4dos:

ObedientPup (current favorite)
OneSwitch (was a bit to advanced)
DouDouLinux (for training with mouse)
MicroXP for the assistants to use for hourlist etc/ printersupport

Lets say he is about 90% disabled with multiple diagnosis and one arm that can barely move the mouse. The right arm can click on a button, but that takes focus away from the mouse.

I tried the cam and that was good. Yet he can not click a button without looking at it and if speech is used,he "throws" his head when he says a word and its not recognizable as common English, but more like as if something is down the throat.

Anyhow, i came to the conclusion that the only way to get a smooth operating of a PC, was by using the mouse to move cursor and then maybe use simple word commands to click etc.

I though 5 commands would be good to start with and that is:

Click
up
down
rightclick
paste (to paste a smiley into textboxses as reply to thing on facebook.

So I guess I look at a challenging project.

The person had all the bad luck you can have right after birth and is now in the mid twenties. Wheelchair and 24 hour assistance.

BUT... there was a great amount of SUPRISE for the assistants to see Puppy "@ work"... they never saw this before and where very impressed. I honestly believe there is a big future for this, as there is not really anything out there apart from closed source and damn expensive MS plattform solution.

Actually, those in need of some work, could potentially specialize in this software and become consultants, as I feel there is lots of solution to mix between covering most challenges.

My self I will have this as a part of my toolbox in the future as i come across different challenges every now and then...

Kreds to devs again:-)
Sounds like a good tester person, the doctors I am working with also think individuals with multiple sclerosis would be the best serve and help guide an effort like this. So, I pushed OneSwitch idea to OneClick idea as the most basic function we should build too. Everything should be doable with OneClick

OneClick is like OneSwitch but does NOT require physical connection, the click could be a IR controller, a voiced sound for click, blown into a tube, eye close etc.

User avatar
ETP
Posts: 1193
Joined: Tue 19 Oct 2010, 19:55
Location: UK

Obedient Pup V1 & (V2 Released 23rd October 2013)

#37 Post by ETP »

In addition to features for the visually impaired, version 2 includes bug fixes and modified scripts to improve reliability on the voice control side of things.
Existing users of voice control are therefore advised to upgrade to this new version.

Main Changes since V1

1. At startup the following greeting is spoken. It uses cloud based TTS to do this and serves to confirm that:
a) The internet connection is working.
b) The speakers are turned on and functional.
c) The pc has booted and is ready for action.
  • Welcome to Obedient Puppy version 2.
    It includes audible cues for the blind or visually impaired to signify,
    1. The start and end of both hotkey and voice mail recording periods.
    2. A different tone just at the beginning of the Google voice search recording period.
    3. Spoken assistance and tones with voice mail.
    Have fun! This is the hotkey sound that you will hear.
2. A new default wallpaper more suitable for the visually impaired.

3. Voice access to the BBC World Service using the new BBC radio iplayer. A new icon in the browser provides access to all BBC local and national radio channels. No license is required for radio.

4. The Chrome extension “Checker Plus for Gmail
Attachments
Obedient_Pup_V2.png
New default wallpaper for Obedient Pup V2.
(93.45 KiB) Downloaded 626 times
Regards ETP
[url=http://tinyurl.com/pxzq8o9][img]https://s17.postimg.cc/tl19y14y7/You_Tube_signature80px.png[/img][/url]
[url=http://tinyurl.com/kennels2/]Kennels[/url]

Atle
Posts: 596
Joined: Wed 19 Nov 2008, 12:38
Location: Oslo, Norway
Contact:

#38 Post by Atle »

Downloaded it and did a frugal. There seem to be some error as the screen freezes within pretty short time. Mouse moves, but could not click on anything. Will try to make a savefile and see if i can figure out what goes wrong.

User avatar
Ted Dog
Posts: 3965
Joined: Wed 14 Sep 2005, 02:35
Location: Heart of Texas

#39 Post by Ted Dog »

Ouch mouse freeze, I have had this issue too, but I have not downloaded this yet, what is the base ? percise... I hope not.

starhawk
Posts: 4906
Joined: Mon 22 Nov 2010, 06:04
Location: Everybody knows this is nowhere...

#40 Post by starhawk »

Ted, per the first post in the thread...
ETP wrote:It is based on MouseCam Pup V6, which itself was a re-master of Precise Puppy 5.6.1 (k 3.3.44).
;)

Post Reply