Page 1 of 2

Voice recognition

Posted: Mon Oct 18, 2010 10:03 pm
by -Joe
Commmander Joe has been working on a voice recognition command system. It uses the windows 7 inbuilt VR and the glovePIE interface.

Here's the glovePIE script...

// Targetting computer

t = said("weapons target missile") or said("weapons arm missile")
u = said("weapons untarget missile") or said("weapons dissarm missile")
m = said("weapons launch missile") or said("weapons fire missile")
y = said("weapons next missile")
key.Multiply = said("weapons Cycle forward between targets")
key.minus = said("weapons Cycle backward between targets")

// weapons

Tab = said("weapons fire energy bomb")
A = said("weapons fire laser")

if said("weapons fire a 3 second burst") then begin
press A
wait 3000 ms
release A
end

if said("weapons let them have it") then begin
press A
wait 5000 ms
release A
say("Hey commander, we got them that time, we really blasted them.")
end

// tactical

Escape = said("launch escape pod")
L = said("tacticle request docking permission")
R = said("tacticle cycle cargo to dump")
z = said("tacticle zoom display") or said ("tacticle magnify display")
key.\ = said("tacticle next compass mode") or said ("tacticle change compass mode")

if said("tacticle Show log") or said ("tacticle display the ships log")) then begin
press Console
wait 9000 ms
release Console
end

if said("tacticle show advanced navigational array") then begin
press LeftShift+6
wait 9000 ms
release LeftShift+6
end

if said("tacticle show polictical information") then begin
press I
wait 9000 ms
release I
end

if said("tacticle show economic information") then begin
press I
wait 9000 ms
release I
end

if said("tacticle save position") then begin
press F2
wait 100 ms
release F2
wait 1000 ms
press enter
wait 100 ms
release enter
end

if said("tacticle evasive manouvers") then begin
press up
wait 3000 ms
release up
wait 100 ms

press left
wait 500 ms
release left
wait 100 ms
say("evasive manouvers in progress")
press down
wait 500 ms
release down

press right
wait 500 ms
release right
end

F1 = said("tacticle forward view") or said ("tacticle front view")
F2 = said("tacticle rear view")
F3 = said("tacticle left view")
F4 = said("tacticle right view")
r = said("tacticle scan forwards" or said ("tacticle whats that") or said ("tacticle activate forward scan")
F5 = said("tacticle display our reputation") or said ("tacticle display special cargo")
F6 = said("tacticle display short range scan") or said ("tacticle short range scan")
F6 = said("tacticle display long range scan") or said ("tacticle long range scan")
F7 = said("tacticle display data on system") or said ("tacticle data on system") or said ("tacticle display system records")

// helm

key.Apostrophe = said("helm left a bit")
key.Dot= said("helm right a bit")
key.up= said("Up") or said("previous item")
key.Down= said("Down") or said("next item")

w = said("helm increase speed") or said("helm more speed")
s = said("helm decrease speed") or said("helm slow down")

if said("helm engage fuel injectors 3 second burn") then begin
press i
wait 3000 ms
release i
end
if said("helm engage fuel injectors 10 second burn") then begin
press i
wait 10000 ms
release i
end
if said("helm engage fuel injectors 15 second burn") then begin
press i
wait 15000 ms
release i
wait 10000 ms
say("Wha hey commander, that was fun!")
end

j = said("helm engage jump drive") or said("helm engage the jump drive") or said("helm fire up the jump drive")
g = said("helm prepare for galactic hyperspace")
h = said("helm start hyperdrive countdown") or said("helm make it so") or said("helm get us out of here")
c = said("helm start docking proceedure") or said("helm start the docking proceedure")
Shift+C = said("helm lets have a drink") or said("helm time to visit the black monks") or said("helm dock with target") or said("helm dock with that ship")
key.Shift + D = said("helm dock quickly")
F1 = said("helm take us out of dock") or said("helm launch the ship")

// Engineering

F3 = said("engineering we need to buy new equipment")
F3 = said("engineering lets check out the ships for sale")
F2 = said("engineering show the ships options")
p = said("engineering freeze time and space")

if said("engineering fill her up") then begin
say("Okay commander I will get the fuel loaded.")
press F3
wait 100 ms
release F3
wait 500 ms
press enter
wait 100 ms
release enter
end
if said("engineering load a missile") then begin

press F3
wait 100 ms
release F3
wait 500 ms
press down
wait 100 ms
release down
wait 500 ms
press enter
wait 100 ms
release enter
wait 6000 ms
say("Okay commander, I will equip the ship with a standard missile.")
end

if said("engineering damage report") then begin
press F5
wait 100 ms
release F5
wait 3000 ms
say("Oooh commander this ship is as good as she will ever be")
wait 7000 ms
press F1
wait 100 ms
release F1
end

if said("engineering transfer fuel from external tank") then begin
say("Okay commander I will pump the fuel, I hope you've selected the fuel pod properly this time.")
wait 6000 ms
press t
wait 100 ms
release t
wait 500 ms
press key.M
wait 100 ms
release key.M
end
// Trader

F8 = said("trader display market prices") or said("trader display the market prices") or said("trader display market prices on main screen")
F8 = said("trader display contracts") or said("trader display contracts available")

enter = said("trader buy that")
enter = said("trader sell that")

if microphone.partialphrase<>'' then debug = microphone.PartialPhrase

if said("what can I say") then
say("Please ask: What can I say to my helmsman?. What can I say to my trader?. What can I say to my weapons officer?");
end if

if said("What can I say to my weapons officer?") then
say("You can say "
... + "weapons target missile "
... + "weapons untarget missile "
... + "weapons launch missile "
... + "weapons next missile "
... + "weapons fire energy bomb "
... + "weapons fire laser "
... + "weapons fire a 3 second burst ")
end if

if said("What can I say to my tacticle officer?") then
say("You can say: "
... + "launch escape pod "
... + "tacticle request docking permission "
... + "tacticle show advanced navigational array "
... + "tacticle show polictical information "
... + "tacticle show economic information "
... + "tacticle save position "
... + "tacticle evasive manouvers "
... + "tacticle forward view "
... + "tacticle rear view "
... + "tacticle left view "
... + "tacticle right view "
... + "tacticle display short range scan "
... + "tacticle display short range scan "
... + "tacticle display data on system")
end if

if said("What can I say to my trader?") then
say("You can say: "
... + "trader display market prices "
... + "trader buy that "
... + "trader food, textiles, alloys, computers ")
end if

if said("What can I say to my engineer?") then
say("You can say: "
... + "engineering we need to buy new equipment "
... + "engineering lets check out the ships for sale "
... + "engineering show the ships options "
... + "engineering fill her up "
... + "engineering load a missile "
... + "engineering transfer fuel from external tank")
end if

if said("What can I say to my helmsman?") then
say("You can say: "
... + "helm increase speed "
... + "helm decrease speed "
... + "helm engage fuel injectors "
... + "helm engage jump drive "
... + "helm prepare for galactic hyperspace "
... + "helm start hyperdrive countdown "
... + "helm dock quickly "
... + "helm start docking proceedure "
... + "helm take us out of dock ")
end if

Posted: Mon Oct 18, 2010 10:22 pm
by DaddyHoggy
Sounds like an interesting idea - but nobody from Israel will be able to use it... :roll:

Usage

Posted: Mon Oct 18, 2010 10:42 pm
by -Joe
Yeah, that's a glovePIE licence issue. GlovePIE is a nice piece of code however and easy to program.

I think I should maybe develop the Sheepdog flight control system v1 for those pilots with a damaged joystick!

Re: Usage

Posted: Mon Oct 18, 2010 10:49 pm
by DaddyHoggy
-Joe wrote:
Yeah, that's a glovePIE licence issue. GlovePIE is a nice piece of code however and easy to program.

I think I should maybe develop the Sheepdog flight control system v1 for those pilots with a damaged joystick!
:lol:

It works

Posted: Wed Oct 20, 2010 7:40 pm
by -Joe
I went to Maplin Elcteronics and bought myself a micro sized bluetooth earpiece for £6.95 and got that working with my PC as a sound device.

Fired up glovePIE and ran my script as is...... and it works really nicely. Now I havn't even lookled at calibrating the windows 7 VR yet but I'm flying and able to sound out commands it well... it just works.

"Trader market prices" and as if by magic the market screen appears. The VR is quick and responsive, good enough for combat.

In combat "weapons fire laser" well it fires just one pulse, I'm going to modify my script now to also have "weapons fire 3 second laser burst"

Now that I know it works I am going to refine my script to include more options and choices.

I'm going to add the cargo names so I can say.

"helm dock quickly"
"engineering fill her up"
"trade computers"
"trade buy that"
"helm launch"
"helm 3 second injector burn"
"helm activate hyperdrive"

etc

Sheepdog V1 will have to wait till I've got the crew in shape!

commander Joe (Average) (---- ELITE ---- on 5.25")

key press delays

Posted: Wed Oct 20, 2010 8:25 pm
by -Joe
Just found out each key press in a macro needs a 100ms delay to work. Save position now works, working on the rest!

Posted: Wed Oct 20, 2010 9:31 pm
by Cmd. Cheyd
Seems like a cool idea.

But I refuse to install glovePIE. I do not want the author to mistake interest in his software for support of his socio-political idiocy.

Posted: Wed Oct 20, 2010 9:33 pm
by Vaztr
OK All this will be brilliant, BUT...

What is SWMBO going to say when I start talking to 'that game'!!

:wink:

new script for glovePIE

Posted: Wed Oct 20, 2010 10:27 pm
by -Joe
Added spoken feedback, and list the commands with "what can i say?"

Posted: Thu Oct 21, 2010 8:14 am
by Chrisfs
I think this is an awesome idea. I'm sure it will be quite neat.

However I can't help but think of a comedy piece about accents that I just saw, so I am posting it here, as it's relevance will be clear upon watching it.
http://www.youtube.com/watch?v=5FFRoYhTJQQ

Using VR whilst playing Oolite

Posted: Thu Oct 21, 2010 10:06 pm
by -Joe
Just been out for a quick prowl around the Eninry anarchy system with VR active. I like get on the six of my oponents and say "weapons fire 3 second burst" then try to hold my mills on the target. 3 seconds of mill lazer action usually does the trick, hah ha. (fixed the bug in autofire in v2.1)

The missile management is useful too, it works really nicely in real combat situations.

"Tacticile display short range scan" & "Trader display markey prices" are nice for browsing when in the mood with "tactcile forward view" returning from these screens.

My pal has a jedi mind trainer I heard somewhere that they are bluetooth, I wonder if I can fire an energy bomb with the power of thourght alone.

Re: Usage

Posted: Fri Oct 22, 2010 4:28 am
by Gnudoll
-Joe wrote:
I think I should maybe develop the Sheepdog flight control system v1 for those pilots with a damaged joystick!
That sounds painful. . . :oops:

Posted: Fri Oct 22, 2010 8:42 am
by Rxke
I tried to find out what this glovePIE is all about, but the homepage says the account is suspended

Posted: Fri Oct 22, 2010 11:34 am
by Kaks
You can get a download from chip.eu

About glovePIE not working in Israel, I do wonder how he managed to do that! Probably it detects the israeli locale. If that's the case, it's a slightly magnified claim, and not necessarily accurate.

Posted: Fri Oct 22, 2010 12:44 pm
by Cmdr James
It seems that glovePIE checks the regional settings and in some versions also the timezone.

Of course as the license explicitly prevents its use in Israel, it is kind of irrelevant if its possible or not, as no one should be doing it.