HEADSPACE Goes Coast-to-Coast: Dolby Labs NYC

Posted by & filed under Brain Music.

After the success of the Pyramind mixer event in San Francisco in October, the Manhattan Producers’ Alliance, which is based in New York City, decided that this might be a great thing to showcase over there.  Since I was in town anyway for the Spectrum release events, and would have my BCMI equipment with me (I was due to perform the demonstration in the East Village at Spectrum over the weekend), it seemed like a great opportunity.

The format of this demo/presentation was always likely to be different to the Pyramind event, due to the fact that we had arranged for it to take place at Dolby Labs in midtown Manhattan.  Instead of a studio complex, this was a screening room, and as such was more geared towards a lecture-style event than an informal, hands-on walkthrough.

With this in mind, I decided to preface the demo with a broader discussion of ‘where are we going with this’?  It seemed appropriate to try and address the broader context of BCI/BCMI, especially in light of who the audience was.  Since this was taking place as part of the Audio Engineering Society‘s quartetly meeting, there were a lot of engineers, producers and musicians, and slightly less in the way of Bay Area tech-nerd types.  I decided to alter my presentation accordingly, to discuss how brain computer interface technology might be applied in the future not just to games (which is, to pardon the pun, a no-brainer) but potentially to film and other linear media, as well as in a therapeutic context.

And so, after rambling on for some time about this, I handed over to my mad-scientist friend and colleague, Dr John Long, researcher at NYU and fanatical robot-builder.  While he extolled the virtues of Brain Machine Interfaces and even delved into a little philosophical conjecture on the subject, I strapped myself into the Emotiv headset, ready to do some serious sound-shifting in this wonderful theater.

(Cut to post-performance) Although the demonstration went ‘well’, and certainly generated no end of questions from the audience (so much so that I think we kind of overstayed our welcome!) – there were a few, very simple things that I feel I could have, and should have, done differently.  Speaking to an audience member at length afterwards over cocktails confirmed this.  “You should be the performer – the star” – he said, and he’s right.  There I was, controlling this cool brain music system, and I was tucked away in the corner with no light on me, mumbling explanations of what I was doing that no-one could hear.

Instead, I should have thrown off my ‘presenter’ jacket, marched up with confidence to the ‘sweet spot’ seat in the surround theater, and hooked myself up to a microphone.  Sitting amongst the audience would have created a better connection, and the microphone would mean I could mumble instructions (too much projection or articulation would have made for noisy EEG signals) that could be heard by everyone.

I’m certainly planning on developing this 2-part presentation/demo, and I think the ‘lecture’ part really got people thinking about the possibilities.  That said,  I fully recognize that they also need to get turned on by the idea, and being a confident performer who knows how to put on a good show for the audience will likely get me 99% of the way there.

Nono CD nominated as one of the ‘best classical music recordings of 2012′ – New York Times

Posted by & filed under Production.

I was very proud and elated to hear just a few weeks ago that the recording we created in New York a while back has been nominated one of the ‘best classical music recordings of 2012′ by the New York Times!  Considering that this is the very first album I have engineered and produced, I could not really ask for more. You can read the full list  here, and the recent review by Zachary Woolfe here.

This was a first in a number of ways, in addition to being my first production credit.  This is the first time there has ever been a surround-sound rendering of a piece that was created for that format.  Recordings of the seminal piece by the Italian composer have historically been in stereo.  Now with a DTS-CD recording as part of the double-CD offering, those with even a rudimentary surround-sound system will be able to experience a little of the haunting wonder of acclaimed violinist Miranda Cuckson’s playing and – yes – singing (in the original score there are vocalizations that have historically been ignored, but are included here).

Translating an 8-channel work into a 5.1 surround re-imagining was no mean feat, but I was lucky to have a wonderful collaborator in electroacoustic composer Chris Burns, who is arguably the US’ leading performer of the electronics part of the piece.  ‘Back-and-forth’ does not begin to describe the fine detail necessary for obtaining a compelling surround mix and, while my fingers were on the controls, Burns’ creative vision is what makes this recording so unique.  The stereo version attempts to be respectful to the surround version, but it is ultimately a different animal, although itself a unique and to my mind beautiful rendering.

I am now working on another piece, this time by composer Alex Sigman, again featuring Cuckson (this time on viola) – and although there is no blueprint for a re-imagining this time, I am certainly enjoying the adventure of creating a musical space-time continuum where previously there was none.

Your Brain on Music – Expo/Mixer event at Pyramind

Posted by & filed under Uncategorized.

SonicScoop's David Weiss trying out the BCMI

On Friday 26th October, ManhatPro West co-sponsored a mixer event with Pyramind Studios, which showcased the latest developments at the intersection of neuroscience and new media, with a particular focus on music and sound. The mini-expo/mixer, curated by myself in collaboration with the inimitable Steve Horowitz, hosted demonstrations from UCSF, UCSD, Sensebridge, Kizoom Labs and Cognionics.

The ‘main event’ in the 11.2 Meyer sound studio was a live demonstration of brain-controlled surround sound, with real time fourier visualizations based on emotional, cognitive and neuromuscular states. UCSF’s ‘Eye Vapor’ installation in the Lab space was a great demonstration of brain region visualization and sonification, as was UCSD/Cognionics’ 3D system, and ‘Mood Mixer’ was an elegant 2-player music mixing game using emotional state as the driver for music selection. Also present was Sensebridge, with a range of sound-activated wearable electronics, and Kizoom Labs showed off their first iPad E-book app ‘Ned the Neuron’ – an interactive storybook to teach kids first concepts about neuroscience through engaging story and characters. The event was a huge success and drew a packed crowd. CEO Greg Gordon, one of the willing victims for the surround sound demo, was impressed enough to ask us back to recreate it the following night at a VIP industry event.

This could be considered the proverbial ‘tip of the iceberg’ – or, maybe more accurately the ‘chip of the cyborg’.  Companies are sprouting up all over the place touting the latest headgear and attendant cool games and apps.  From Emotiv to Interaxon to Myndplay, everyone seems to want in on the action.  And that includes myself.  As a composer, a new toy like this was always bound to be exciting – a system that can translate your thoughts into sound?  No more tedious writing of melodies on paper or key crunching into Sibelius?  Wonderful!  Well, almost.  Turns out it’s not so simple to extract one’s thoughts and create music from the ether.  The level of control that these devices surging into the consumer market can afford the average user is still relatively low – the Emotiv EPOC system, for example, only has a signal sampling rate of 128Khz, as opposed to at least 512Khz for medical grade lab gear. On the other hand, it is able to detect ERPs (Event Related Potentials), so some of these devices are certainly more than just toys.  The trick is, now that I HAVE the signal, what am I going to do with it?

In the case of this demo, I narrowed my focus to a primary question – is it possible to cognitively control sound in a surround space?  The Emotiv system lets you train in 3 dimensions using the visual field.  Using Max/MSP and a neat little library called MindYourOscs, I was able to remap this to a 2-D auditory plane (a surround sound rig).  Using VBAP (Vector-based Amplitude Panning) and employing a first-order regressive model, I created an auditory corollary of the visual training system.  Although a little clunky and certainly subject to adequate training, we found most people who tried it were able to exert some amount of spatial control.  Which got them very excited.  One gentleman in particular, a Yogi, had such exquisite control I almost felt like we had to hire him.  Maybe when we create our brain music startup, such things will happen…

Watch this space for more brain music projects to come!

Famous for Five Minutes?

Posted by & filed under Brain Music.

Highly risky theremin demonstration of 'proof of context'

Last week, I gave an Ignite Talk.  And not just any Ignite talk – this particular event was being held at Google I/O – one of the largest developer conferences of the year, in the Moscone Center, San Francisco.

Walking into the room, which could easily have housed a major team sporting event, I noticed that it was about a third full – that is to say, about 400 people.  Then the Ignite audience came in, and the room swelled to over 1000.  I steeled myself, flashing through my slides in my head as I rehearsed my spiel one final time.  For anyone not familiar with the Ignite format – it’s five minutes.  You get to talk about whatever you’re passionate about, but once your five minutes are up – that’s it.  Next please.   And here’s the kicker – your slides auto-advance every 15 seconds.  20 of them, in quick succession, with NO speaker notes (that little bit of information I found out the night before the talk).

It’s a pretty terrifying format for the uninitiated, and I was giving a talk about a subject that has significantly more depth than ‘the best way to tie your shoelaces (this was an actual Ignite Talk).  Namely, I was talking about experimental music, and how it can sound bad, and how maybe we as artists can work to achieve a balance between proof of concept and what I call ‘proof of context’.  Throw a live theremin/sampler demo (all of 30 seconds long) into the mix, and there is significant potential for disaster.

That said, my talk went pretty flawlessly (you can view it here – I come in at 38 minutes).  There were a few minor stumblages, and the ending was pretty hasty (since I was out of slides), but overall I was happy with how I delivered it.

Then comes the question of the content.  I’m pretty convinced I will have pissed off at least some small contingent of experimental composers with what I said.  Basically it was along the lines of “let’s do experimental music, but PLEASE, can we try and make it sound pretty?”.  A gross oversimplification, to be sure, but my point was essentially that many experimental composers, at least historically, have been obsessed with algorithm to the detriment of aesthetics, and it doesn’t have to be that way.  I use as an example of this my work with BCMIs (Brain Computer Music Interfaces).  A large scale project that we conducted involved all sorts of cool technology and science, but the output was not, shall we say, particularly musical.  If we had just tweaked a few things on the output end, we could have created a more musical context, but we were primarily concerned with making the damn thing work.

Of course, in building systems such as in Music for Online Performer, certain aspects must take precedence, and time is often of the essence, but if there is anything I learned from the project, it is that without a musical context, such an endeavor becomes less a composition than a science experiment.

Some composers who consider themselves on the leading edge of their art will probably take umbrage at my suggestion that we consider the audience’s reception of our work, but to these I say ‘let’s have a discussion about that’.  I am certainly no stranger to the avant-garde aesthetic, but let’s just say I’ve bought the T-shirt on that one, and am quite willing and able to discuss its merits and shortcomings.  If my approach of incorporating context into our work seems to fly in the face of ‘traditional’ modes of experimental composition, is that not in itself an approach that challenges the status quo, thereby qualifying it as ‘avant-garde’?

So, if the Ignite Talk taught me anything, it was that five minutes is a long time on a stage, and that even complex ideas can be distilled very effectively if faced with these constraints.  For me, the talk forced me to take a position on my art, and elucidate it in front of a broad spectrum audience that didn’t necessarily have a context for my talk’s content.  It was an amazing experience, and one I would highly recommend to anyone who has something they want to formalize, clarify and expound about their passion.  As the Ignite slogan goes ‘Enlighten us, but make it quick’.

Back to the Drawing Board – 04/29

Posted by & filed under Film Music.

I have been working for the past few months on a new film project – “Mobile Moments”, directed by British filmmaker Joanne Ball.  This is a study in minimalism if ever there was one.  The female protagonist is the only person we see on camera.  The style is confessional, similar to an online diary that you might come across while trawling YouTube.  The difference here is that I am scoring the ‘drama’.  While most online journal entries seem to amount to a rambling diatribe with, let’s face it – very low production values, this piece has been composed very meticulously, while at the same time retaining that ‘raw’ quality, shot entirely on an iPhone.

When Joanne approached me with this project, I have to say that I was stumped for a while as to how to deal with it.  On the one hand, there was much scope for emotional underpinnings, given the subject matter (frustration, loneliness, desperation), on the other there was very much the temptation to leave the narrative well alone, given how naked and real it is.  My first attempt grew from a relatively simple piano base to a thick, fleshed out thing that ended up drowning the character in a sea of melodrama.

So I started again.  No more piano or cello, no more ‘indie-esque’ melodic lines.  A few days ago, I decided to strip away the instrumentation down to some very spare lines, using instruments like music box (replete with mechanical/metallic transients) and give the film much more space.  I think it’s working better now, and incidentally, so does the director (which is, after all, the most important thing) but the main takeaway in this exercise is that it is indeed possible to throw it all away and start again.  Often it’s the only thing to do, and the work is the better for it.

 

BCMI PROJECT – Update 04/22/12

Posted by & filed under Brain Music.

I am currently a little over half way through building a training model for our BCMI (Brain Computer Music Interface) project, and it’s no picnic.  The goal is to select 50 2-minute excerpts of piano music in order to build an experimental model for classification by emotional signature.  This will eventually be used as the basis for EEG ‘training’ by the other performer in this piece, the illustrious Tim Mullen (Swarz Center for Neuroscience, UCSD).

The real trick is, given that I’m using genre rather than chronology as my basis, what do I pick as my musical material?  I’m currently at 7 categories, including the usual suspects (Baroque, Romantic, Jazz, etc…) but when we get to the late 20th Century things seem to become less obvious.  Where do we separate the serialists from the maximalists?  Many of them were doing both, and in fact at the same time as they were writing their parametric music they were writing beautiful melodies.  As the 20th Century drew to a close, there was a pervading perception that the purist attitudes of the avant-garde were not sufficient, and the new eclecticism was (is) being hailed as the savior of modern music.  More thinkings to come as the experiment progresses…