Hyperpiano Style Interface for DSP
This is a blog detailing the progress on a new project of mine, a portable Hyperpiano style interface for controlling DSP. This started back in May of 2009 but in earnest in Jan 2010. The project is very fluid in the concept and testing state, involving Reactivision, MaxMSP and sampled piano sounds.
Version1 of HyperpianoDSP in testing phase
on 22-May-10 05:05. Comments (0)
OK folks - I've essentially been slaving away at this for the last several weeks and i finally have something to show! I designed a new board from scratch, wider, and a little taller with a "safe region" of sorts. this is a region where the tag data is safely ignored. i've also added a nanokontrol to the situation as i really needed more controls than the sensors could provide.So here it is. it works - but just barely. I couldn't get smooth data out of the sensors so i'm largely ignoring them and using the TUIO vertical data as well as horizontal data (used to determine string "region"). the sensors are still functioning but i'm mainly using them for touch and force resistance. Due to the running of sensor and camera data plus the DSP on the same computer, the CPU is getting hit pretty hard and unfortunately it's pretty crash prone, possibly as a result of this. Certainly it's spitting out gobs and gobs of multiple channels of data. Here's a basic demo.
OK-basic rundown: An object with a fiducial tag is placed on the board. sensor detects the presence of the object, camera determines horizontal position of object (its "region") and ID number which is used to refer to that number sample in a collection of samples set up earlier. Sound is triggered by the MIDI keyboard and pitch of the sample is controlled by position and also by force reading of the sensor.Looping settings and DSP effects like a degrade, filter, ring mod, and reverb are controlled using the nanokontrol for the moment, though there is a plan to integrate them into the sensor interface at some point. Here's a short demo with a bit more DSP:
Write a comment
- Required fields are marked with *.
Posts: 7016
Reply #7015 on : Wed September 08, 2010, 04:17:21
Posts: 7016
Reply #7014 on : Wed September 08, 2010, 04:05:28
Posts: 7016
Reply #7013 on : Wed September 08, 2010, 04:05:11
Posts: 7016
Reply #7012 on : Wed September 08, 2010, 03:41:43
Posts: 7016
Reply #7011 on : Wed September 08, 2010, 03:19:20
Posts: 7016
Reply #7010 on : Wed September 08, 2010, 03:12:03
Posts: 7016
Reply #7009 on : Wed September 08, 2010, 02:56:15
Posts: 7016
Reply #7008 on : Wed September 08, 2010, 01:48:06
Posts: 7016
Reply #7007 on : Wed September 08, 2010, 01:42:39
Prototype Finshed
on 02-Apr-10 05:56. Comments (0)
Hyperpiano DSP Prototype - the setup is essentially trying to act like the inside of a piano when i do my prepared piano thing but for electronics. i'm using ReacTIVision in a very unorthodox way - mainly as something like RFID but with simple horizontal location and rotation data for each tag. the fabric controllers are acting a bit like strings but largely triggered by a standard MIDI keyboard . the mechanics of the setup including camera are now prototyped and working at about 85% efficiency right now.
Certainly doesn't look fancy, but it works reasonably well. The board is adapted from a Playskool chalkboard, with a magnetic dry erase board glued on it. The sensors themselves are on top of a sheet of acetate glued to the surface. The wiring is using internal pull-up resistors on the Teensy, with the conductive lower layer grounded and the piezoresistive fabric on the top attached to bulldog clips and wired to the Teensy. The tags are Duplo blocks with magnets or 4 faces and ReacTIVision fiducials glued to each face.
The strips each cover a range of 3 semitones. the final version will have 8 regions for 25 total keys. The webcam recognizes the horizontal position and rotation of a tag, and different sounds can be played or controlled depending on what's been defined.
Thanks to Adrian Freed at CNMAT for providing materials and expertise for the project.
Posts: 7016
Reply #7016 on : Wed September 08, 2010, 04:17:37