IRCAM - Centre PompidouServeur © IRCAM - CENTRE POMPIDOU 1996-2005.
Tous droits réservés pour tous pays. All rights reserved.

Harmony and Nonharmonic Partials

Max Mathews and John Pierce

Rapport Ircam 28/80, 1980
Copyright © Ircam - Centre Georges-Pompidou 1999


Abstract

We have explored some musical effects of tones with nonharmonic partials. The spacing of partials can be stretched so that each partial frequency FIJ present in tones sounded singly or together is given by

FIJ = A(I/12 + log2J)

Here I is the scale step in half tones, J is the partial number and A is the frequency ratio of a pseudo-octave (A = 2 for a true octave). We find that subjects can match the keys of stretched (A = 2.4) as well as unstretched passages. Stretched cadences (A = 2.4) do not seem final. But, a stretched "cadence" with equally spaced partials that goes from closely-spaced (tonally dissonant) to widely-spaced (tonally consonant) partials does seem final. Our experiments do not decide finally among three views of harmony : that harmony depends on a fundamental bass or periodicity pitch (Rameau), that harmony depends on the spacing of partials (Helmholtz and Plomp) or that harmony is a matter of brainwashing.

Introduction

In this paper we present the results of some experiments involving tones with nonharmonic partials.

All stringed and blown instruments have partials whose frequencies are harmonic or nearly harmonic ; that is, the ratios of the frequencies present in the tone are close to 1, 2, 3, 4, 5, 6, etc. times the frequency of the lowest partial, sometimes called the fundamental. It is commonly held that consonance, dissonance and harmony are associated with this integral relationship among the frequency components which make up musical tones. Indeed, nonharmonic tones, such as those of bells and gongs, do not lend themselves well to harmonic combinations, even though they add a pleasant clangor to the sound of an orchestra.

By using a computer to generate sounds, one can produce tones which include partials of any chosen frequencies.1 This raises an important question : can tones with nonharmonic partials be used in attaining useful musical effects similar to but different from those of conventional harmony ? Our experiments were intended to give a better understanding of the subjective basis of harmony and to explore the musical use of sounds with nonharmonic partials, both sounds with "stretched" partials 2 and sounds with "uniformly spaced" partials. 3

I. Theories of Harmony

In a book first published in 1863, Helmholtz proposed that dissonance arises from unpleasant beats between partials whose frequencies are too close together. 4 The octave is the most consonant of intervals because all of the partials of the upper tone coincide in frequency with partials of the lower tone. The fifth is consonant because the frequencies of the fundamentals (first partials) of the two tones have a simple ratio, 3/2, and because of this the lower partials of the two tones either coincide, or they are considerably separated in frequency and do not beat together objectionably.

Helmholtz's work has been added to by that of others. Particularly, Plomp and Levelt found in 1965 that two (or more) partials that lie within what is called a critical bandwidth produce an unpleasant sensation (unless they differ very, very little in frequency). 5 For frequencies above, say, 500 Hz, a critical bandwidth is about 1/4 octave (a minor third). However, Plomp and Levelt were careful to call the consonance of tones whose partials are separated by more than a critical band a "tonal consonance," and not to imply that this consonance is all there is to musical harmony.

Rameau had another view of harmony. 6 He observed that in a major triad all frequencies present are integer multiples of a basse fundamentale or fundamental bass which, in the root position of the chord (C, E, G) lies two octaves below the root of the chord (C). Thus, if the frequency of the fundamental bass is fo, the frequency of the root (C) is 4fo, the frequency of the third (E) is 5fo, and the frequency of the fifth (G) is 6fo. Because Rameau regarded the octave as essentially an equality, he could identify the fundamental bass of the chord with its root.

Neither Rameau nor Helmholtz knew of the phenomenon of residue pitch or periodicity pitch, which Schouten described in 1938. 7 When we are presented with harmonic partials in the absence of the fundamental, we perceive the pitch as the least common denominator of the frequencies present, that is, as the frequency of the missing fundamental. Thus, when we listen to a major triad we might well hear Rameau's fundamental bass. Terhardt has discussed this 8 and has demonstrated the effect. 9 The experiments we shall describe are relevant to the two views of harmony described above. But, one might hold that musical harmony is merely a matter of brainwashing ; that we accept combinations of tones that we have been taught are correct, and reject those that we have been taught are incorrect. We have some experimental evidence that bears on this.

II. Tones Used and Intent of Experiments

We have used in our experiments two sorts of tones with nonharmonic partials. Chiefly, we have used tones with stretched partials, as Slaymaker did. 2 The frequencies FIJ the partials of such a tone are given by

FIJ = A(I/12 + log2J)  (1)

Here I is the scale step (I = 12 for an octave), J is the overtone number and A is the frequency ratio of the pseudo octave. For a true octave, A = 2 and

FIJ = J2I/12  (2)

we see that FIJ gives the frequencies of harmonics of the notes of an equally tempered scale.

Within the accuracy of the equally tempered scale, major triads made up of notes of the true octave scale satisfy the criterion of Rameau ; the partials are all integer multiples of a fundamental bass. They also satisfy the criterion of Helmholtz. All lower partials either coincide or are well separated. If all the frequencies present in the triad are stretched according to (Eq.1), all the lower partials still coincide or are well separated. So, Helmholtz's criterion will be satisfied in the stretched triad. But, in the stretched triad the partial frequencies are no longer multiples of a fundamental bass frequency. There will no longer be a basis for a periodicity pitch. Rameau's criterion will not be satisfied.

To summarize the intent of our work with such stretched tones :

  1. Harmonic effects which exist in stretched materials are produced by the interactions of stretched partials.
  2. Harmonic effects which disappear in stretched materials are produced either by periodicity pitch or by brainwashing.
  3. It is hard to separate brainwashing effects from other effects.
Besides the tones mentioned above, one experiment was made with tones in which partials are separated by a fixed fraction of an octave, as described by Pierce 3 and used by him in an eight-tone canon. 10

III. The Experiments

Our experiments with stretched partials involved :

III-1. Acoustic Description of the Materials

All the sounds used in the experiments were synthesized on the PDP-10 computer at the Institute for Research and Coordination of Acoustics and Music, Paris, France, using the Music V program. Each sound had seven partials whose frequencies were specified by Eq.(l). For A = 2, these were in the approximate frequency ratios 1, 2, 3, 4, 5, 6, 8 (note the 7th partial is omitted). The exact partial frequencies as specified by Eq.(l) are equal tempered. That is, the partial frequencies coincide exactly with the fundamental of some note in the equal-tempered scale.

The amplitudes of the partials relative to the fundamental diminished at 9dB per factor of 2 in frequency ratio between the partial and the fundamental. The value 9dB per factor of 2 was selected to approximate normal musical instruments which tend to produce a spectrum which decreases faster than 6dB per octave, but not as fast as 12dB per octave.

The envelope of the notes was chosen to give a sustained sound with a moderately fast but not percussive attack, a slight diminuation (6dB) over the duration of the note, and a smooth decay.

The overall timbre can be described as a pleasant, bland, musical sound.

III-2. Key-Sensing Experiments

Three short passages designated X, M, and Mt were synthesized. The scores of X and M are shown in Fig. 1. Both X and M are long enough to clearly establish a key. Both end in a clear cadence. Mt consists of M transposed to a different key. X was synthesized either in the key of M or Mt.

A test tape was prepared containing 24 test sequences. Each test sequence consists of the sequence :

XMXMt

This sequence was selected over the more traditional MXMt test in order to make the test slightly harder. In the MXMt order, the cadence at the end of M is very close to the cadence at the end of X because X is a very short passage.

The 24 tests consisted of six groups :

  1. 4 tests where M and Mt differed by 3 semitones, unstretched (A = 2) ;
  2. 4 tests where M and Mt differed by 3 semitones, stretched (A = 2.4) ;
  3. 4 tests where M and Mt differed by 1 semitone, unstretched (A = 2) ;
  4. 4 tests where M and Mt differed by 1 semitone, stretched (A = 2.4) ;
  5. 4 tests where M and Mt were major and minor of the same key, unstretched (A = 2) ;
  6. 4 tests where M and Mt were major and minor of the same key, stretched (A = 2.4).
After listening to a test, the subject was asked whether X was in the key of M or Mt. The correct response was randomized within each of the six groups, but not between groups.

The test was taken by ten subjects. Five subjects (the non-musicians) had almost no experience as performers and described themselves as having little interest in music. The other five (the musicians) had extensive experience as amateur or semiprofessional musicians.

The results of the experiment are shown in Table I. We draw the following conclusions :

  1. Everyone, musicians and non-musicians alike, performed at better than the chance level (50%) for both stretched and unstretched materials. Thus stretching did not destroy the ability to sense key in this test.
  2. In general the larger the key change, the better was the performance.
  3. Normal materials were easier to judge than stretched materials.
  4. Musicians performed better than non-musicians.
In general, this experiment supports Helmholtz more than Rameau for the stretching removed periodicity pitch and the fundamental bass, but left a substantial key sensing ability.

III-3. Cadence Studies

The results discussed in the next three sections were all obtained from a single experiment. A test tape for this experiment was prepared containing 25 tests, each of which consisted of two chords of equal duration. The specific chords used will be described below. After listening to a test, the subject was asked to rate the chord pair on a 1 to 9 scale according to finality, in other words according to how appropriate the chords would be as the end of a section of music. If the chord pair seemed very final, it was given a high rating, if it seemed very unfinished, it was given a low rating.

All 25 chord pairs discussed in the next three sections were randomized on the test tape. Presumably the subjects used the same criteria in judging all 25.

The test was taken by 13 "musicians" and by 17 "non-musicians" defined according to the above discussed criteria. There were no apparent patterns of differences between the responses of the musicians and the non-musicians, so the results of these two groups were averaged together.

III-4. Finality of Cadences

In this experiment four chord pairs were judged. These consisted of the stretched (A = 2.4) and unstretched (A = 2) forms of the cadence and "anticadence" shown in Fig.2. As shown, the anticadence ends on the penultimate chord of a normal cadence. Thus it should produce a strong impression of nontermination. The use of chord pairs as cadences implies that the subject already knows the tonic chord. The same key was used throughout the 25 tests and the results indicate that they clearly knew the tonic.

Results are shown in Fig.3. It is clear that the unstretched cadence gave a strong sense of finality and the stretched cadence did not. The normal anticadence and the stretched anticadence were equally nonfinal. Thus, stretching seems to destroy the impression of finality in cadences. This supports Rameau rather than Helmholtz.

III-5. Is Finality Associated with Tonal Dissonance ?

Following Helmholtz, we might assume that the finality of a major cadence consisting of a dominant seventh chord followed by a tonic chord would seem final because we go from a dissonant chord, some of whose partials lie within a critical bandwidth, to a consonant chord whose partials either coincide or are more widely separated.

In this experiment we started with a dominant seventh cadence as shown to the right in Fig.4. The horizontal lines at the left represent the tones of the two succeeding chords, the dominant seventh above and the tonic below. The dots on the lines show the position in half-steps of the seven partials that are present in each tone (1, 2, 3, 4, 5, 6, 8).

We see that in the dominant seventh chord there are five pair of partials a half step apart (very dissonant) and three pairs a whole step apart. When the circled dots are deleted, none of the remaining partials is less than a whole tone apart, and the chord sounds less dissonant. When the crossed dots are deleted as well, none of the remaining partials are less than a minor third apart and the chord sounds tonally consonant.

We note also that in the tonic chord, two partials must be deleted in order to make the least interval between partials a major second, and two more must be deleted in order to make the least interval between partials a minor third. Thus, the tonic chord itself has some tonal dissonance.

Subjects were asked to judge the finality of the dominant seventh cadences without deletion of partials, and with deletions to render the dominant seventh less tonally dissonant. The results are shown in Fig.5. All the cadences were given a very high finality rating. The removal of partials makes almost no difference in the ratings.

We should note that a musician identified the chords correctly even when partials had been deleted so as to make the least interval between the partials in the dominant seventh a minor third. We should also note that both the dominant seventh chord and the tonic chord were noticeably less harsh, less tonally dissonant, after this deletion of partials.

This portion of the experiment appears to argue against Helmholtz, that is, against acoustic dissonance as a basis for harmonic effects.

III-6. Cadence With Equally Spaced Partials

In the experiment using a dominant seventh chord we noted that, even in this strongly dissonant chord, relatively few partials lie close together. Perhaps Helmholtz's effects are weak simply because too few partials interact closely. To study this hypothesis we generated a chord pair as shown in Fig.6 using notes with overtones equally spaced along a musical scale. The overtones are separated by a major fourth in this specific example. As a result of this spacing the first chord of the pair is very dissonant, almost all overtones being one half step apart and the second chord is very consonant, almost all overtones being coincident.

Figure 7 shows that this chord pair is given a relatively high finality rating. Furthermore, this rating, as we would expect, is not diminished by stretching (A = 2.3) the material. Thus, if one makes strong enough interactions between overtones, an impression of finality can be conveyed by a transition to an acoustically consonant situation. This would argue for Helmholtz's tonal consonance view of harmony.

IV. Supplementary Observations and Material

Before trying to draw further conclusions from the experimental results described above, it may be well to describe some further observations.

It is our observation that melodies are easily recognized despite stretching. A stretched (A = 2.4) version of the round, "Are You Sleeping, Brother John," was instantly recognized by an audience. The melody of harmonized stretched (A = 2.4) versions of "The Coventry Carol" and "Old Hundred" were recognized, but these had also been played unstretched.

In the harmonized stretched "Old Hundred" it seemed difficult to distinguish the inner voices. In fact, in single tones stretched A = 2.4, one tended to hear the partials as separated sounds rather than as fused into a tone of a single pitch. We believe that such fusion depends in part on the phenomenon of residue or periodicity pitch. 7 This has been noted by Cohen. 11 She has observed further that the degree of fusion of a stretched tone depends on the envelope of the tone, and is greatest for an exponentially decreasing amplitude which gives a "struck" quality. 12

We observe that stretched tones sounded singly tend to fall apart into a group of partials, but when a sequence of such tones is played as a known melody the tones are heard as the individual notes of the melody.

It appears that whether or not a collection of stretched partials is heard as a single tone can depend on both the time evolution of the partial amplitudes and on the context (melodic or otherwise) in which the tones are heard.

V. Summary and Conclusions

The intent of the experiments performed was to try to decide among three explanations of harmonic effects : (1) Rameau's fundamental bass, which can be related to Schouten's residue pitch or periodicity pitch ; (2) the tonal consonance of Helmholtz and Plomp, which depends on the spacings of the partials that are present ; (3) brainwashing, that is, learned expectations and reactions. The experiments did not distinguish clearly among these views.

We found :

  1. Subjects can identify keys of both stretched and unstretched materials in an XMXMt test.
  2. Stretching destroys the perception of finality of cadences.
  3. Removing dissonant overtones does not change the perception of the finality of cadences.
Results (1) above may be a melodic rather than a harmonic effect, and, as we have noted, melody seems more robust under stretching than harmony does.

Result (2) argues for either Rameau or brainwashing.

Result (3) argues somewhat for brainwashing. We are taught that resolution is going from dissonance to consonance and in going from the dominant seventh to the tonic we accept the cadence as correct and final even when the tonal dissonance has been removed. But, cadences went from the dominant to the tonic before the dominant seventh was used.

Nonetheless, by using tones with equally spaced partials, we can get a sense of finality by going from a tonally dissonant chord to a tonally consonant chord. This argues for Helmholtz-Plomp.

We may observe that traditional harmony as we know it is like language, a complex but learnable art that is very difficult to explain.

The fact that under stretching melody is more robust than harmony seems to us salient and important.

Acknowledgment

Most of the sounds generated were produced at IRCAM. We gratefully acknowledge the support of that institution and our indebtedness to its director, Pierre Boulez, and to Gerald Bennett, Jean-Claude Risset, Thorsteinn Hauksson, and many memhers of the IRCAM staff. The subjective experiments were ably performed by Karen T. Marcus for whose excellent work we are much indebted.
TABLE I. Percentage of correct sensing of key in XMXMt tests, using musicians and nonmusicians as subjects.
PERCENT CORRECT IN KEY SENSING TESTS
50% IS CHANCE PERFORMANCE

MUSICIANS NONMUSICIANS EVERYONE
NORMAL STRETCHED NORMAL STRETCHED NORMAL STRETCHED
MAJOR-MINOR 100 80 80 60 90 70
MINOR 2nd TRANSPOSITION 100 100 85 75 92 87
MINOR 3rd TRANSPOSITION 100 95 95 85 97 90
Fig.1. Scores of passages used for key sensing tests.
figure 1
Fig.2. Cadence (dominant to tonic) and anticadence (tonic to dominant).
figure 2
Fig. 3. Finality ratings of stretched and normal cadences and anticadences. With normal (unstretched) partials the cadence is judged as having a great deal of finality and the anticadence as having little finality. With stretched partials, the finalities are essentially equal.
figure 3
Fig. 4. Overtone frequencies of 7th cadence. The dots on the horizontal lines show the frequencies of the partials of a dominant seventh chord (above) and a tonic chord (bellow). The circles show deletions to make the minimum distance between partials a major second, and the crosses show additional deletions to make the minimum distance between partials a minor third.
figure 1
Fig. 5. Judgments of finality of cadence with partials deleted as in Fig.3 to remove tonal dissonance. For comparison, the square point is for a cadence stretched by A = 2.4.
figure 5
Fig. 6. A cadence with uniformly spaced overtones, going from a tonally dissonant to a tonally consonant chord.
figure 6
Fig. 7. Judgments of finality of the cadence of Fig. 6. It is judged as final with or without stretching.
figure 7


References

  1. M. V. Mathews, The Technology of Computer Music, (Cambridge, Mass.: The M.I.T. Press, 1969).
  2. Frank H. Slaymaker, "Chords from Tones Having Stretched Partials," J. Acoust. Soc. Amer. 47, 1469-1571 (1970).
  3. J. R. Pierce, "Attaining Consonance in Arbitrary Scales," J. Acoust. Soc. Amer. 40, 249 (1966).
  4. H. Helmholtz, On the Sensations of Tone, (New York: Dover, 1954), Chap. 10.
  5. R. Plomp and W. J. M. Levelt, "Tonal Consonance and Critical Bandwidth," J. Acoust. Soc Amer. 38, 548-560 (1965).
  6. Jean-Philippe Rameau., Treatise on Harmony, (New York : Dover, 1971).
  7. J. F. Schouten, "The Perception of Subjective Tones," K. ned. Akad. Wet. Proc. 41, 1086-1093 (1938).
  8. Ernst Terhardt, "Pitch, Consonance and Harmony," J. Acoust. Soc. Amer. 55, 1061-1069 (1974).
  9. Ernst Terhardt, Poster Demonstration, Rameau's "Basse Fundamentale," an Auditory Percept, "IRCAM Symposium sur la Psychoacoustique musicale," 11/13 July, 1977.
  10. J. R. Pierce, Eight Tone Canon, Decca record DL 71080, "The Voice of the Computer."
  11. Elizabeth Cohen, "Fusion and Consonance Relations for Tones with Inharmonic Partials," J. Acoust. Soc. Amer. 65, S123 (1970)(abstract).
  12. Elizabeth Cohen, Ph.D. Thesis, Stanford University (1980).

____________________________
Server © IRCAM-CGP, 1996-2008 - file updated on .

____________________________
Serveur © IRCAM-CGP, 1996-2008 - document mis à jour le .