Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Relative Gestures #1

Open
likethemammal opened this issue Mar 15, 2013 · 2 comments
Open

Relative Gestures #1

likethemammal opened this issue Mar 15, 2013 · 2 comments

Comments

@likethemammal
Copy link

Thanks for the the amazing gesture recording script. This is extremely useful but obviously every hand motion gesture can't produce the same gesture data every time. Do you have any suggestions on how to create relative data points that can be registered as a gesture, something close, but not exact?

@syntagmatic
Copy link
Owner

As as a starting place, you can use the change in some value (such as X, Y, Z coordinates) from the previous step, rather than the absolute value.

The Leap JS library keeps a history of recent data point, or you could maintain this list yourself by modifying the gesture script. Just be sure to throw away data after 2-3 seconds, since it's not useful for detecting gestures anymore.

For example, to trigger a gesture when the user "swipes right", look for a large change in the X coordinate. A simple test like that might accidentally trigger due to noise (hands or fingers flickering incorrectly), so you might try layering a few simple tests on top of each other.

If you're comfortable with Mongo and Node.js, I also created a simple database-backed gesture recorder. It assembles the gallery automatically from saved gestures, and you can click gesture names to see the diagnostics page. My plan is to eventually to extend that diagnostics page to give some insight to all the data, to get some insight on which attributes are relevant for a particular movement type.

https://github.com/syntagmatic/prehensile

@likethemammal
Copy link
Author

Thanks for the tip. I've started work on a relative gestures script now using js focusing on the basics like you said (change in X, Y, Z). When I get it done I'll post it to the OpenLeap repo for others to use.

I'm hoping that devs will be able to create any custom gesture with your recorder and be able to recognize it with my script. I'll let you know when I get something concrete finished.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants