SynthBuilder and Frankenstein: Tools for the Creation of Musical Physical Models

Nick Porcaro, Stanford University
William Putnam, Stanford University
Pat Scandalis, Stanford University
Tim Stilson, Stanford University
David Jaffe, Stanford University
Julius Smith, Stanford University
Scott Van Duyne, Stanford University




SynthBuilder is a user-extensible, object-oriented, NEXTSTEP Music Kit application for interactive real-time design and performance of synthesizer patches (especially physical models) (Jaffe & Smith, 1983; Smith, 1987). Patches are represented by networks consisting of digital signal processing elements called unit generators and MIDI event elements called note filters and note generators.

The Frankenstein box is a multi-DSP compute engine that was developed as a research platform (Putnam, 1996). The box communicates with an x86 host via an ISA interface card that resides in the host computer. Frankenstein currently contains 8 Motorola 56002 Evaluation Modules (EVMs), and it can be scaled to an additional 8 EVMs for a 16 EVM total. The outputs of EVMs can also be sent to an external mixer.


A Brief History of SynthBuilder and Frankenstein

The original concept of a unit generator-based digital audio synthesis language was pioneered by Bell Labs' Max Mathews in the 1950s, and the concept culminated in the 1960s with the Music V program (Mathews, 1969).

The NeXT Music Kit was developed by David Jaffe and Julius Smith and is an object-oriented library that is implemented in Objective-C and is used in the design of music applications for the NeXT computer ( Jaffe & Boyton , 1989; Smith, 1989). The Next Music Kit combines the gestural control of MIDI with the tumbrel control of MUSIC V and extends the flexibility of both.

In 1989, NeXT employee Michael Minnick developed a prototype called SynthEdit that used graphical application to create MusicKit patches. Minnick then presented a paper on his prototype at the International Computer Music Conference (Minnick, 1990).

Nick Porcaro started work on SynthBuilder in 1992. Initially an extension of GraSP, SynthBuilder was a similar application created in 1992 by Princeton University student Eric Jordan with advisory assistance from David Jaffe (who was teaching at Princeton at the time). Since 1993, Porcaro has extensively developed SynthBuilder with both support from Stanford's Office of Technology and Licensing and with significant contributions from David Jaffe, Pat Scandalis, Julius Smith, Tim Stilson, and Scott Van Duyne. (SynthBuilder also uses code from the NeXT Draw programming example and some icons originally created for SynthEdit.)

In the Summer of 1995, William Putnam and Tim Stilson created the Frankenstein MulitDSP engine as a platform to support physical modeling research that used SynthBuilder (Putnam, 1996). The original Frankestein contained 8 Motorola 56002 Evaluation Modules running at 40 MHz.

SynthBuilder has since been used at CCRMA as a physical modeling research and development tool and as a synthesizer/effects processor in live performances. In 1994, 1995, and 1996, demonstrations were given at the ICMC (Porcaro, 1996). SynthBuilder Alpha30 was released to the Internet in December of 1994, and the current version of SynthBuilder, Beta23, was released to the Internet in September of 1996.


SynthBuilder and Frankenstein Today

The current version of SynthBuilder, Beta23, has been significantly optimized and extended over the pervious version Alpha30. DSP allocation speed, memory usage and drawing performance have similarly been greatly improved. Many new features have been added, and they include sound file writing support for various Intel-based DSP cards, an improved driver for the Frankenstein box (an array of 8 Motorola 56002 DSPs), new unit generators and note filters, context-sensitive help, drop-in subpatches, subpatch variations, inspector improvements, a new trace window, and more robust help/tutorial. Along with numerous bug fixes and paradigm refinements, these features have enabled rapid development of complex patches.

The current version of Frankenstein is now running at 72 MHz, and we have also developed a single card/single EVM version of the Frankenstein called "Cocktail Frank" that also runs at 72 MHz. It has been possible to implement a 6 string electric guitar model with wah-wah/distrortion and amplifier feedback model using this card.


SynthBuilder and Frankenstein Demonstration

In this session, we will demonstrate recent SynthBuilder features, discuss physical model calibration, and show recently-developed SynthBuilder patches including percussion, piano, guitars, harpsichords, and others.

We are currently porting our patches to other platforms. To facilitate this porting, we have developed an interchange format called SynthScript and defined a portable server (SynthServer) that will enable execution of SynthBuilder patches on other computers. Part of the demonstration will present a SynthScript patch running on a native processor. In the near future, we plan to build more patches and to improve SynthBuilder, and we are also discussing the possibility of porting SynthBuilder to Windows NT/95.


Figure

References

Jaffe, D. A. & Smith, J. (1983). Extensions of the karplus-strong plucked string algorithm. Computer Music Journal, 7(2), 56-69.

Jaffe, D. A. & Boyton, L. (1989). An overview of the sound and music kits for the NeXT computer. Computer Music Journal, 14(2), 48-55.

Mathews, M. (1969). The technology of computer music. Cambridge MA: MIT Press.

Minnick, M. (1990). A graphical editor for building unit generator patches. ICMC Proceedings

Porcaro, N., Scandalis, P., Jaffe, D., & Smith, J. (1996). Demonstration: Using SynthBuilder for the creation of physical models. ICMC Proceedings

Putnam, W. & Stilson, T. (1996). Frankenstein: A low cost multi-DSP compute engine for the music kit. ICMC Proceedings

Smith, J. O., Jaffe, D., & Boynton, L. (1989). Music system architecture on the NeXT computer. Proceedings of the 1989 Audio Engineering Society

Smith, J. O. (1987). Music applications of digital waveguides. Center for Computer Research in Music and Acoustics, Music Dept., Stanford University, Report STAN-M-39.


A six string electric guitar model with distortion, feedback and wawa, implemented in SynthBuilder. This model runs on on a single 72Mhz Motorola 56002 DSP.


Nick Porcaro (nick@ccrrma.stanford.edu)
William Putnam (putnam@ccrma.stanford.edu)
Pat Scandalis (gps@ccrma.stanford.edu)
Tim Stilson (stilti@ccrma.stanford.edu)
David Jaffe (daj@ccrma.stanford.edu)
Julius Smith (jos@ccrma.stanford.edu)
Scott Van Duyne (savd@ccrma.stanford.edu)
CCRMA (http://www-ccrma.stanford.edu)