Human Redundancies

Here's a recent email I got from Zenph Studios:

First, Sony’s new Tatum album with Zenph is getting remarkable reviews. For example, this review appeared in Sunday’s Buffalo News (page down to ‘Jazz’): http://click.icptrack.com/icp/relay.php?r=13604691&msgid=188312&act=OBBB&c=207937&admin=0&destination=http%3A%2F%2Fwww.buffalonews.com%2Fentertainment%2Fstory%2F370744.html
Come see the show!! We’re presenting a new production at New York’s Apollo Theater this week. It’s a one-man play; on stage is actor Paul Butler playingm the owner of a jazz club. Throughout the show he’s discussing his lifetime friendship with Art Tatum. As events in Tatum’s life are introduced, the high-resolution reproducing piano on stage plays Tatum’s re-performances. It’s been great watching Paul’s reaction during the rehearsals – he’s truly mesmerized. If you are in New York June 19, 20, or 22, you really should see this historic, world-premiere play. Our Web site has details and a link for buying tickets: http://click.icptrack.com/icp/relay.php?r=13604691&msgid=188312&act=OBBB&c=207937&admin=0&destination=http%3A%2F%2Fwww.art-tatum.com%2F
We’re been working closely with the Tatum family, and at the Sunday show, will be donating items from the estate to the Jazz Museum in Harlem – including Tatum’s own grand piano. Here are the details: http://click.icptrack.com/icp/relay.php?r=13604691&msgid=188312&act=OBBB&c=207937&admin=0&destination=http%3A%2F%2Fwww.zenph.com%2Ftatum%2Fgift.html Artwork! The author and painter Robert Andrew Parker will show his original paintings from his new children’s book on Art Tatum at the Thursday, June 19th show, in the Apollo lobby. Painter and jazz saxophonist Scott Gordley will be showing his jazz paintings at the shows on the 20th and 22nd: http://click.icptrack.com/icp/relay.php?r=13604691&msgid=188312&act=OBBB&c=207937&admin=0&destination=http%3A%2F%2Fwww.scottgordleyart.com%2Fjazz%2Fjazz.birdandmonk.htm
BMI, the music licensing organization, is featuring our show on their MySpace site: http://click.icptrack.com/icp/relay.php?r=13604691&msgid=188312&act=OBBB&c=207937&admin=0&destination=http%3A%2F%2Fblog.myspace.com%2Findex.cfm%3Ffuseaction%3Dblog.view%26friendID%3D3423568%26blogID%3D400254844
We appreciate your support and feedback at Zenph Studios. Thanks – John Q. Walker, president

In other hands-free news, read about the upcoming robotic 'flying trucks' that will transport supplies to troops, and troops themselves, without a pilot.

Recording Sample-Free

(Image from Evan Ziporyn's excellent solo clarinet album)

In a recent post I wrote on putting electrodes in our brains and using representative computer code to guide machines in playing real instruments; earlier, I wrote on Melodyne software that can pick out individual notes from individual instruments on a recording for pitch shifting or time stretching.

Last month at the International Conference on Acoustics, Speech and Signal Processing, Mark Bocko introduced a new project he's been working on at the University of Rochester that seeks to eliminate sampling from digital recording. Instead of recording live instruments and sampling at the highest rate possible for CD-quality sound, researchers developed two software models: one that replicates every parameter of a clarinet's sound, and another that codes a clarinet player's physical actions in performance. Once they make a real audio recording of a clarinetist, they can use the second model to determine the various performance actions and run this info into the clarinet sound module to produce a virtual rendition of the original performance.

One of the interesting developments here is the tiny amount of information needed to store such a virtual recording; because the audio is not sampled hundreds of times per second but reproduced based on actual physical gestures and frequencies of a player and nothing more, these recordings are quite small. The twenty-second clarinet solo filled under one kilobyte.

Bocko says, "Maybe the future of music recording lies in reproducing performers and not recording them." This to me sounds like a kind of compromise: let's still use real people initially but then convert their sound into something synthetic, better, and with a minimum of information. I have this image of Charlie Chaplin from Modern Times in my head, but now he's miming all the motions while a robot mimics him, actually screwing on the bolts.


So why not ditch real players and instead program virtuosic performances into the physical model, much like MIDI? This could be a whole new, more flexible version of MIDI, in that MIDI has only 128 (0-127) possibilities for each musical parameter, while this new software may have infinite expressive potential. (From the short article, it sounds like these computer models have continuous, non-incremental parameters, like we do.)

A very relevant comparison to make here is with the highly advanced, Hi-Res MIDI-driven live piano recreations of recordings by Zenph Studios - essentially, high tech player piano. (Hi-Res MIDI uses 1024 possibilities, versus 128.) I'm gonna write up a post on this soon, but Zenph can take an old recording of, say, Glenn Gould playing Bach, code it into Hi-Res MIDI, and play it back in a "re-performance" on an actual Yamaha Disklavier Pro concert grand piano. A convergence of Zenph and Rochester could be very interesting: a Disklavier performance of Art Tatum recorded and re-virtualized with Rochester's modeling technology.

The Rochester folks still have a long way to go in terms of sound quality; the demo recording sounds like low quality MIDI; Vienna Symphonic Library, for example, sounds infinitely better. Still, the potential for vast improvement is there, and also for manufacturing technology-esque 'musical redundancies.'