Sunday, 2 October 2011

Audio Visual Information Swapping

With the idea of information interpretation in mind, and the idea of different senses that interpret infomation within different mediums, what would it be like to swap over this information but still have it relative to the visual spectrum or the human audio bandwidth. I get the feeling i may just end up with static and high pitched screeching.



Although if i make if a full screen visualisation to an audio track it may not be so harsh on the senses. All i would have to do is make it a little more relitive and have a single input (such as sound) into a single output (such as colour). Such as this;

(100 Hz = 380 nm) (1,000 Hz = 740 nm) or vice versa. Then simplified into colours within flash. 


(After making this table based on the parameters of human hearing and visible light, i think it may be better to tone down the sound input to just something like the scale of an 88 key piano. The human hearing is a lot broader then the human eye in this sense.) 


EDIT - I've made the scale of the audio input to the rough scale of the human voice (male and female) this is a smaller scale then a piano (4kHz~ - 25Hz~) and of course the human adult ear (20kHz~ - 20Hz~) but should be adequate for the user.





It may even be possible to have a live feed input using a mic into a flash file with a bit of actionscript to make the audio input variable to something like a colour on screen. It may be like a synaesthesia simulator.


Im sure it would be possible to mix in a visual to audio converter as long as you changed the visual to something like a black and white image, but even then you would only be able to take a horizontal strip of that image to convert into audio, and when idol, if the screen is picking up a static/constant amount of light it would just emit the same frequency noise and would most likely be irritating. The audio to visual colour idea i much more peaceful.

No comments:

Post a Comment