Download Antialiased State Trajectory Neural Networks for Virtual Analog Modeling In recent years, virtual analog modeling with neural networks experienced an increase in interest and popularity. Many different modeling approaches have been developed and successfully applied. In this paper we do not propose a novel model architecture, but rather address the problem of aliasing distortion introduced from nonlinearities of the modeled analog circuit. In particular, we propose to apply the general idea of antiderivative antialiasing to a state-trajectory network (STN). Applying antiderivative antialiasing to a stateful system in general leads to an integral of a multivariate function that can only be solved numerically, which is too costly for real-time application. However, an adapted STN can be trained to approximate the solution while being computationally efficient. It is shown that this approach can decrease aliasing distortion in the audioband significantly while only moderately oversampling the network in training and inference.
Download Analysis and resynthesis of quasi-harmonic sounds: an iterative filterbank approach We employ a hybrid state-space sinusoidal model for general use in analysis-synthesis based audio transformations. This model, which has appeared previously in altered forms (e.g. [5], [8], perhaps others) combines the advantages of a source-filter model with the flexible, time-frequency based transformations of the sinusoidal model. For this paper, we specialize the parameter identification task to a class of “quasi-harmonic” sounds. The latter represent a variety of acoustic sources in which multiple, closely spaced modes cluster about principal harmonics loosely following a harmonic structure (some inharmonicity is allowed.) To estimate the sinusoidal parameters, an iterative filterbank splits the signal into subbands, one per principal harmonic. Each filter is optimally designed by a linear programming approach to be concave in the passband, monotonic in transition regions, and to specifically null out sinusoids in other subband regions. Within each subband, the constant frequencies and exponential decay rates of each mode are estimated by a Steiglitz-McBride approach, then time-varying amplitudes and phases are tracked by a Kalman filter. The instantaneous phase estimate is used to derive an average instantaneous frequency estimate; the latter averaged over all modes in the subband region updates the filter’s center frequency for the next iteration. In this way, the filterbank structure progressively adapts to the specific inharmonicity structure of the source recording. Analysissynthesis applications are demonstrated with standard (time/pitchscaling) transformation protocols, as well as some possibly novel effects facilitated by the “source-filter” aspect.
Download On Restoring Prematurely Truncated Sine Sweep Room Impulse Response Measurements When measuring room impulse responses using swept sinusoids, it often occurs that the sine sweep room response recording is terminated soon after either the sine sweep ends or the long-lasting low-frequency modes fully decay. In the presence of typical acoustic background noise levels, perceivable artifacts can emerge from the process of converting such a prematurely truncated sweep response into an impulse response. In particular, a low-pass noise process with a time-varying cutoff frequency will appear in the measured room impulse response, a result of the frequency-dependent time shift applied to the sweep response to form the impulse response. Here, we detail the artifact, describe methods for restoring the impulse response measurement, and present a case study using measurements from the Berkeley Art Museum shortly before its demolition. We show that while the difficulty may be avoided using circular convolution, nonlinearities typical of loudspeakers will corrupt the room impulse response. This problem can be alleviated by stitching synthesized noise onto the end of the sweep response before converting it into an impulse response. Two noise synthesis methods are described: the first uses a filter bank to estimate the frequency-dependent measurement noise power and then filter synthesized white Gaussian noise. The second uses a linearphase filter formed by smoothing the recorded noise across perceptual bands to filter Gaussian noise. In both cases, we demonstrate that by time-extending the recording with noise similar to the recorded background noise that we can push the problem out in time such that it no longer interferes with the measured room impulse response.
Download Practical Modeling of Bucket-Brigade Device Circuits This paper discusses the sonic characteristics of the bucket-brigade device (BBD) and associated circuitry. BBDs are integrated circuits which produce a time-delayed version of an input signal. In order to reduce aliasing, distortion, and noise, BBDs are typically accompanied by low-pass filters and compander circuitry. Through circuit analysis and measurements, each component of the BBD system can be accurately modeled.
Download Visual representations of digital audio effects and of their control This article gathers some reflections on how the graphical representations of sound and the graphical interfaces can help making and controlling digital audio effects. Time-frequency visual representations can help understand digital audio effects but are also a tool in themselves for these sound transformations. The basic laws for analysistransformations-resynthesis will be recalled. Graphical interfaces help for the control of effects. The choice of a relation between user control parameters and the effective values for the effect show the importance of the mapping and the graphical design. Graphical and sonic editor programs have both in common the use of plug-ins, which use the same kind of interface and deal with the same kind of approach.
Download Gestural exploitation of ecological information in continuous sonic feedback – The case of balancing a rolling ball Continuous sensory–motor loops form a topic dealt with rather rarely in experiments and applications of ecological auditory perception. Experiments with a tangible audio–visual interface around a physics-based sound synthesis core address this aspect. Initially dealing with the evaluation of a specific work of sound and interaction design, they deliver new arguments and notions for non-speech auditory display and are also to be seen in a wider context of psychoacoustic knowledge and methodology.
Download A Pitch Salience Function Derived from Harmonic Frequency Deviations for Polyphonic Music Analysis In this paper, a novel approach for the computation of a pitch salience function is presented. The aim of a pitch (considered here as synonym for fundamental frequency) salience function is to estimate the relevance of the most salient musical pitches that are present in a certain audio excerpt. Such a function is used in numerous Music Information Retrieval (MIR) tasks such as pitch, multiple-pitch estimation, melody extraction and audio features computation (such as chroma or Pitch Class Profiles). In order to compute the salience of a pitch candidate f , the classical approach uses the weighted sum of the energy of the short time spectrum at its integer multiples frequencies hf . In the present work, we propose a different approach which does not rely on energy but only on frequency location. For this, we first estimate the peaks of the short time spectrum. From the frequency location of these peaks, we evaluate the likelihood that each peak is an harmonic of a given fundamental frequency. The specificity of our method is to use as likelihood the deviation of the harmonic frequency locations from the pitch locations of the equal tempered scale. This is used to create a theoretical sequence of deviations which is then compared to an observed one. The proposed method is then evaluated for a task of multiple-pitch estimation using the MAPS test-set.
Download Adaptive Modeling of Synthetic Nonstationary Sinusoids Nonstationary oscillations are ubiquitous in music and speech, ranging from the fast transients in the attack of musical instruments and consonants to amplitude and frequency modulations in expressive variations present in vibrato and prosodic contours. Modeling nonstationary oscillations with sinusoids remains one of the most challenging problems in signal processing because the fit also depends on the nature of the underlying sinusoidal model. For example, frequency modulated sinusoids are more appropriate to model vibrato than fast transitions. In this paper, we propose to model nonstationary oscillations with adaptive sinusoids from the extended adaptive quasi-harmonic model (eaQHM). We generated synthetic nonstationary sinusoids with different amplitude and frequency modulations and compared the modeling performance of adaptive sinusoids estimated with eaQHM, exponentially damped sinusoids estimated with ESPRIT, and log-linear-amplitude quadratic-phase sinusoids estimated with frequency reassignment. The adaptive sinusoids from eaQHM outperformed frequency reassignment for all nonstationary sinusoids tested and presented performance comparable to exponentially damped sinusoids.
Download Taming the Red Llama—Modeling a CMOS-Based Overdrive Circuit The Red Llama guitar overdrive effect pedal differs from most
other overdrive effects because it utilizes CMOS inverters, formed
by two metal-oxide-semiconductor field-effect transistors (MOSFETs), instead of a combination of operational amplifiers and
diodes to obtain nonlinear distortion. This makes it an interesting
subject for virtual analog modeling, obviously requiring a suitable
model for the CMOS inverters. Therefore, in this paper, we extend
a well-known model for MOSFETs by a straight-forward heuristic
approach to achieve a good match between the model and measurement data obtained for the individual MOSFETs. This allows a
faithful digital simulation of the Red Llama.
Download A Minimal Passive Model of the Operational Amplifier: Application to Sallen-Key Analog Filters This papers stems from the fact that, whereas there are passive models of transistors and tubes, a minimal passive model of the operational amplifier does not seem to exist. A new behavioural model is presented that is memoryless, fully described by its interaction ports, with a minimal number of equations, for which a passive power balance can be defined. The proposed model handles saturation, asymmetric power supply, and can be used with nonideal voltage references. To illustrate the model in audio applications, the non-inverting voltage amplifier and a saturating Sallen-Key lowpass filter are considered.