2015-02-13
Done
Administrivia
- Received confirmation email from Angus Forbes. So we have four members signed up for the committee.
Data Collection
- Explored a lot of sensor and camera options. See blog for details.
- Ordered cheap IMUs and Arduino board to prototype with.
- Pinged Dr. Forbes about possible cache of sensors at EVL. Need to follow up after Arduino experiments play out.
- Pinged Ivana Bukvich to get her take on data collection. Hope to meet with her in the coming weeks.
- Pinged my EE/ME friend David Meyer for some guidance through the electronics minefield.
WebService
- Wrote a little script to translate Parncutt abc corpus to format suitable for the Parncutt C program.
Doing
- Comparing Parncutt source to my Python code.
- Implementing basic color tracking synchronized with MIDI events.
Red Flags
- Over-extending Brian Ziebart vs. under-representing ML on my committee.
- Don't we need a psychologist on the committee? Parncutt? Stellan Ohlsson?
- Do we know Ohlsson would not count as CS faculty?
Hey, Dave --
ReplyDeleteWhat's the technology behind video game consoles like Wii and Xbox One that allow them to mimic a persons movement on screen? I wonder if using a camera mounted at a fixed location then have a glove with different colored dots at different locations on the fingers/hands would help track and pinpoint movement.
Just a thought. Maybe you've all ready considered this.
later,
--dvd
Hey, Dave:
DeleteThe Wii has inertia sensors of some kind and infrared (from the controller to the bar that sits under the TV). It may use other sensors. I am not exactly sure.
Yeah, the computer vision approaches are going to include color tags (either stickers or UV paint) on the fingers. The real challenge is going to be disambiguating the thumb from one of the other fingers when it disappears from view. Hence, a pressure or inertia sensor only on the thumb. I really want to keep skin in contact with keys.
Cheers,
Dave