<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="research-article">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Digit. Humanit.</journal-id>
<journal-title>Frontiers in Digital Humanities</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Digit. Humanit.</abbrev-journal-title>
<issn pub-type="epub">2297-2668</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/fdigh.2018.00019</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Digital Humanities</subject>
<subj-group>
<subject>Original Research</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>A Metrical Analysis of Medieval German Poetry Using Supervised Learning</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes">
<name><surname>Hench</surname> <given-names>Christopher</given-names></name>
<xref ref-type="corresp" rid="c001"><sup>&#x0002A;</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/443425/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Estes</surname> <given-names>Alex</given-names></name>
<uri xlink:href="http://loop.frontiersin.org/people/516739/overview"/>
</contrib>
</contrib-group>
<aff><institution>Department of German, University of California, Berkeley</institution>, <addr-line>Berkeley, CA</addr-line>, <country>United States</country></aff>
<author-notes>
<fn fn-type="edited-by"><p>Edited by: Stan Szpakowicz, University of Ottawa, Canada</p></fn>
<fn fn-type="edited-by"><p>Reviewed by: Mark Alan Finlayson, Florida International University, United States; Stefan Evert, Friedrich-Alexander-Universit&#x000E4;t Erlangen-N&#x000FC;rnberg, Germany; Beata Beigman Klebanov, Educational Testing Service, United States</p></fn>
<corresp id="c001">&#x0002A;Correspondence: Christopher Hench <email>chench&#x00040;berkeley.edu</email></corresp>
<fn fn-type="other" id="fn001"><p>This article was submitted to Digital Literary Studies, a section of the journal Frontiers in Digital Humanities</p></fn></author-notes>
<pub-date pub-type="epub">
<day>18</day>
<month>07</month>
<year>2018</year>
</pub-date>
<pub-date pub-type="collection">
<year>2018</year>
</pub-date>
<volume>5</volume>
<elocation-id>19</elocation-id>
<history>
<date date-type="received">
<day>17</day>
<month>08</month>
<year>2017</year>
</date>
<date date-type="accepted">
<day>26</day>
<month>06</month>
<year>2018</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#x000A9; 2018 Hench and Estes.</copyright-statement>
<copyright-year>2018</copyright-year>
<copyright-holder>Hench and Estes</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/"><p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p></license>
</permissions>
<abstract><p>Middle High German (MHG) epic poetry presents a unique solution to the linguistic changes underpinning the transition from classical Latin poetry, based on syllable length, into later vernacular rhythmic poetry, based on phonological stress. The predominating pattern in MHG verse is the alternation between stressed and unstressed syllables, but syllable length also plays a crucial role. There are a total of eight possible metrical values. Single or half mora syllables can carry any one of three types of stress, resulting in six combinations. The seventh value is a double mora, i.e., a long stressed syllable. The eighth value is an elided syllable. We construct a supervised Conditional Random Field (CRF) model to predict the metrical value of syllables, and subsequently investigate medieval German poets&#x00027; use of semantic and sonorous emphasis through meter. The features used are: (1) the syllable&#x00027;s position within the line, (2) the syllable&#x00027;s length in characters, (3) the syllable&#x00027;s characters, (4) elision (last two characters of previous syllable and first two characters of focal syllable), (5) syllable weight, and (6) word boundaries. Additional metrical rules are enforced and marginal probabilities are calculated to yield the most likely legal scansion of a line. The model achieves a weighted average F-score of 0.925 on internal cross-validation and 0.909 on held-out testing data. We determine that trochaic alternation with a one syllable anacrusis and words carrying clear stress assignment are the easiest for the model to scan. Lines with multiple double morae of syllables with few characters are the most difficult. We then rank all the epic poetry in the Mittelhochdeutsche Begriffsdatenbank (MHDBDB) by the difficulty of the meter. Finally, we investigate the double mora, which MHG poets used to draw attention to chosen concepts. We conclude that poets generally chose to use the double mora to emphasize highly sonorant words.</p></abstract>
<kwd-group>
<kwd>poetic meter</kwd>
<kwd>Middle High German</kwd>
<kwd>scansion</kwd>
<kwd>epic poetry</kwd>
<kwd>supervised machine learning</kwd>
<kwd>medieval literature</kwd>
</kwd-group>
<counts>
<fig-count count="2"/>
<table-count count="15"/>
<equation-count count="0"/>
<ref-count count="38"/>
<page-count count="17"/>
<word-count count="13743"/>
</counts>
</article-meta>
</front>
<body>
<sec sec-type="intro" id="s1">
<title>1. Introduction</title>
<p>Poetic meter in the Middle High German (MHG) tradition has always been a contentious and complex subject, as it requires a nuanced knowledge of MHG literature, a strong understanding of MHG linguistics, particularly phonology, and knowledge of the musical practices of the period<xref ref-type="fn" rid="fn0001"><sup>1</sup></xref>. Most work thus far has not been able to master all of these areas<xref ref-type="fn" rid="fn0002"><sup>2</sup></xref>. While this paper does not attempt to fully unite these diverse fields, it does seek to take careful consideration of each in developing a computational model to better understand how medieval German poets crafted their words into meter, and in turn aid us in our own reading of the text. The increased popularity of machine learning algorithms and their application to textual data presents a particularly fruitful opportunity in a domain that has plagued MHG scholarship for years. Instead of a deductive approach, i.e., beginning with the assumption of trochaic alternation as fundamental, supervised learning allows for a large-scale inductive approach, supplying the algorithm with a wealth of specific examples from which general principles can be discerned. Crucially, the goal of any such model is not to establish an absolute truth about a historical language; the goal is to automatically reproduce the annotation decisions of scholars on a large scale. Annotating the entire MHG epic corpus would allow us to better understand any rules that do exist as well as the challenges any particular text poses. Automatic annotation would also support a large scale analysis on how specific metrical values and meter types are invoked in different contexts. Scholars often discuss how changes in meter, metrical values, or specific cadences are triggered in specific scenes, but can we measure this complexity? MHG meter provides for fascinating flexibility in emphasis, but did authors have preferences for different metrical values? Are certain texts or passages intentionally crafted to be more difficult to scan? This paper seeks to answer these questions and others through a large scale analysis of automatically scanned poetry.</p>
<p>While late twentieth century scholarship neglected meter primarily due to theoretical disagreements and a lack of manuscript evidence, Christoph M&#x000E4;rz recently re-framed MHG scholarship on meter in his article &#x0201C;Metrik, eine Wissenschaft zwischen Z&#x000E4;hlen und Schw&#x000E4;rmen,&#x0201D; in which he attempts to revive a meter-based formal perspective (M&#x000E4;rz, <xref ref-type="bibr" rid="B30">1999</xref>). According to M&#x000E4;rz, form has two important functions and opportunities: it <italic>reminds</italic> us, and it allows for <italic>comparison</italic> (M&#x000E4;rz, <xref ref-type="bibr" rid="B30">1999</xref>, p. 325). Both of these observations provide motivation for the following analysis. Poetic meter acts not only to support the memory of a performer or composer, but also affects the audience, prompting this comparative reception. M&#x000E4;rz writes:</p>
<disp-quote><p>I recall the experience that when you try to remember a poem, you often only remember the pattern&#x02014;a few words may come along with that pattern or not. Also, if you forget parts of the text, the threads can be found again in certain passages by humming the rhythm of the verse (M&#x000E4;rz, <xref ref-type="bibr" rid="B30">1999</xref>, p. 325).</p></disp-quote>
<p>This act of remembering serves as an opportunity to identify connections between songs and texts (both formally and semantically), and compare texts, as M&#x000E4;rz would have it. This comparison, when recognized by a performer or audience, can generate and add meaning to a poem or song. Especially in the MHG tradition, a connection between form and content has always been presumed. Yet M&#x000E4;rz is also interested in lower level connections and references within genres. M&#x000E4;rz asks whether these abstracted metrical schemata &#x0201C;transport&#x0201D; specific ideas, and if so, how they are created (M&#x000E4;rz, <xref ref-type="bibr" rid="B30">1999</xref>, p. 325). Klaus Kohrs asked a similar question decades earlier. Kohrs explains in Saussurian terms how meter itself can add signification to language, which it does not inherently carry: &#x0201C;With the metrical, that is even &#x0201C;quasi-musical&#x0201D; formation of language as a symbolic and sonoric phenomenon the side of the signifi&#x000E9; is quasi sublimated, i.e., sensical and semantic references become virulent, which the &#x0201C;natural&#x0201D; language does not have and does not need to have&#x0201D; (Kohrs, <xref ref-type="bibr" rid="B22">1969</xref>, p. 605). Hugo Kuhn presents the idea similarly in relation to music and melody, but emphasizes its &#x0201C;Gebrauchsfunktion&#x0201D; (use function), i.e., the use cases for these artworks, as folksongs, religious uses, for the court, knights, etc. (Kuhn, <xref ref-type="bibr" rid="B23">1969</xref>, p. 38). This point is taken up by Thomas Cramer, questioning what the actual <italic>Gebrauchsfunktion</italic> for these artworks was, and whether our ideas of them are correct according to the sources (Kuhn, <xref ref-type="bibr" rid="B23">1969</xref>, p. 39). But M&#x000E4;rz crucially reshapes this question, instead of asking what meaning or function poetic meter may contain, he notes that meter is always determined relatively (M&#x000E4;rz, <xref ref-type="bibr" rid="B30">1999</xref>, p. 325). As Paul Zumthor and Ferdinand de Saussure have claimed about words and sound, there is no meaning in the base element itself, only in context and pattern. But for both words and poetic meter, this context must be extended beyond the contained object of a line of poetry to the body of referential objects.</p>
<p>The aim of this paper is to disambiguate these relative relationships. This project does not intend to argue that any particular metrical theory is without fault, nor that specific metrical values even exist as such, but rather that implementing <italic>any</italic> framework inevitably teases out relative differences within a corpus. Heusler decries the nineteenth century philologists for altering the text and making a statistical analysis of MHG metrics impossible, and for this reason he gives no statistics in his MHG study of meter (Heusler, <xref ref-type="bibr" rid="B20">1956</xref>, p. 4). Yet the focus here is not concrete, in terms of absolute numbers or statistics, but rather in establishing relative relationships between texts, which, when aggregated over a whole text or corpus, will not drown out clear characteristics<xref ref-type="fn" rid="fn0003"><sup>3</sup></xref>.</p>
</sec>
<sec id="s2">
<title>2. From quantity to quality</title>
<p>The distribution of Latin into distinct regional dialects had profound linguistic and literary implications for all of Europe. One notable consequence was on poetry with quantitative meter. Even before the Middle Ages, the syllable length of classical Latin had been nearly forgotten in the vernacular<xref ref-type="fn" rid="fn0004"><sup>4</sup></xref>. Latin poetry had used quantitative meter, in which syllable length is the organizing principle. Syllable length was a phonologically distinctive feature to Latin speakers. However, the emerging dialects differed from Latin in that stress became a phonologically important feature, and thus so-called qualitative meter (&#x0201C;rhythmic poetry&#x0201D;) predominated in the Romance languages. Reconciling these linguistic differences, MHG meter relied on both stress and syllable length. This hybrid metrical form poses unique challenges to scanning poetry and allowed for a diverse development in genre and style (Heusler, <xref ref-type="bibr" rid="B20">1956</xref>, pp. 74&#x02013;75). Yet this freedom raises one of the main questions and theoretical problems in MHG research on meter: not necessarily Heusler&#x00027;s question of &#x0201C;<italic>How</italic> am I to measure it?,&#x0201D; but rather <italic>what</italic>: in a system of &#x0201C;measured syllable verse with free syllable counts&#x0201D;&#x02014;what is it that we <italic>can</italic> count, or <italic>should</italic> count? (Heusler, <xref ref-type="bibr" rid="B20">1956</xref>, pp. 9, 13) &#x0201C;What is countable in the verse?&#x0201D; (M&#x000E4;rz, <xref ref-type="bibr" rid="B30">1999</xref>, pp. 323&#x02013;324) We could count syllables, but it is not clear if the poets did this naturally themselves, despite what the <italic>Meisters&#x000E4;nger</italic><xref ref-type="fn" rid="fn0005"><sup>5</sup></xref> would like us to believe. Herbert B&#x000F6;gl describes MHG verse in his <italic>Abriss der mittelhochdeutschen Metrik: mit einem &#x000DC;bungsteil</italic>: MHG &#x0201C;presents in an abstract language of symbols the sequence of syllables in a verse and weighs them taking into account their length and stress&#x0201D; (B&#x000F6;gl, <xref ref-type="bibr" rid="B3">2006</xref>, p. 9). It is this &#x0201C;taking into account&#x0201D; that presents a difficult computational problem for analysis MHG meter, in that strict rules for length and stress cannot always be employed.</p>
<p>To illustrate this shift from a quantitative classical meter to a qualitative post-classical vernacular meter, we first consider the quantitative epic poetry of Latin and Greek. Each line consists of six feet, each foot typically a dactyl (a long syllable followed by two short syllables) or spondee (two long syllables). A syllable is considered long if it has a long vowel or diphthong, or ends in two consonants (Hayes, <xref ref-type="bibr" rid="B18">1989</xref>). All other syllables are short. The first line of Virgil&#x00027;s <italic>Aeneid</italic> serves as example:<xref ref-type="fn" rid="fn0006"><sup>6</sup></xref></p>
<p><inline-graphic xlink:href="fdigh-05-00019-i0001.tif"/></p>
<p>A widely cited poem displaying the shift from quantitative to qualitative rhythmic poetry in the Latin tradition is Bishop Auspicius of Toul&#x00027;s late fifth century letter to Arbogast, the Count of Trier, imitating the iambic dimeter<xref ref-type="fn" rid="fn0008"><sup>8</sup></xref> already made famous by Ambrose<xref ref-type="fn" rid="fn0009"><sup>9</sup></xref>. The letter begins:</p>
<list list-type="simple">
<list-item><p>Praecelso exspectabili &#x000A0;&#x000A0;&#x000A0;his Arbogasti comiti</p>
<p>Auspicius qui diligo &#x000A0;&#x000A0;&#x000A0;salutem dico plurimam<xref ref-type="fn" rid="fn0010"><sup>10</sup></xref>.</p></list-item>
</list>
<p>The first hemistich<xref ref-type="fn" rid="fn0011"><sup>11</sup></xref> &#x02014; &#x02323; &#x02323; &#x02014; &#x02323; &#x02014; &#x02323; &#x02323; shows that a quantitative scansion would be ill-fitted to the rest of the verse, and that a strictly iambic scansion is preferred with a paroxytone<xref ref-type="fn" rid="fn0012"><sup>12</sup></xref> in the cadence. Much Latin poetry followed suit, and the medieval <italic>Codex buranus</italic> famously bears witness to the intermingling of Latin and MHG rhythmic verse, clearly demonstrating that they were drawing from the same rhythmical schemata. Germanic verse, on the other hand, did not originally follow the quantitative meter of antiquity, preferring organization according to alliteration and stress. In fact, Heusler calls alliteration the &#x0201C;Hausmarke&#x0201D; (house brand) of the Germanic language family (Heusler, <xref ref-type="bibr" rid="B20">1956</xref>, pp. 92&#x02013;93). In addition to alliteration, a further marker of Germanic verse is the <italic>Langzeile</italic> (long line), traditionally consisting of two <italic>Kurzzeilen</italic> (short lines), an <italic>Anvers</italic> (first half of the line) and <italic>Abvers</italic> (second half of the line) (Heusler, <xref ref-type="bibr" rid="B20">1956</xref>, p. 100). While this tradition began earlier, a classic example of Germanic alliterative verse is the ninth century Bavarian <italic>Muspilli</italic>:</p>
<list list-type="simple">
<list-item><p>&#x02026;sin tac piqueme, &#x000A0;&#x000A0;&#x000A0;daz er touuan scal.</p>
<p>uuanta sar so sih diu sela &#x000A0;&#x000A0;&#x000A0;in den sind arheuit,</p>
<p>enti si den lihhamun &#x000A0;&#x000A0;&#x000A0;likkan lazzit,</p>
<p>so quimit ein heri &#x000A0;&#x000A0;&#x000A0;fona himilzungalon,</p>
<p>daz andar fona pehhe: &#x000A0;&#x000A0;&#x000A0;dar pagant siu umpi.</p>
<p>sorgen mac diu sela, &#x000A0;&#x000A0;&#x000A0;unzi diu suona arget,</p>
<p>za uuederemo herie &#x000A0;&#x000A0;&#x000A0;si gihalot uuerde<xref ref-type="fn" rid="fn0013"><sup>13</sup></xref>.</p>
</list-item>
</list>
<p>This alliterative verse dominated throughout most of OHG and continued strong in the Nordic traditions. Around the same time that the <italic>Muspilli</italic> was written in the southeast, in the west Otfrid von Wei&#x000DF;enburg in Alsace was beginning to incorporate characteristics of Old French poetry into his ninth century Old High German (OHG) verse. Otfrid&#x00027;s decision to incorporate end rhyme (referred to as a strictly Romance language influence by Heusler) is the first attested instance of Germanic poetry&#x00027;s break from the alliterative tradition. Thus Otfrid is generally considered the starting point for a study of modern German verse<xref ref-type="fn" rid="fn0014"><sup>14</sup></xref>. Otfrid&#x00027;s <italic>Evangelienbuch</italic> became the model for this new Germanic verse, though he retained the <italic>Langzeile</italic> from the older Germanic tradition. Otfrid established many of the new metrical possibilities in cadence (monosyllabic full, bisyllabic ringing, and trisyllabic ringing) witnessed in the MHG period (Heusler, <xref ref-type="bibr" rid="B20">1956</xref>, p. 13). Much of the influence on Otfrid&#x00027;s style came from various writings on religion, heroic stories, and charms recorded at the time<xref ref-type="fn" rid="fn0015"><sup>15</sup></xref>. Heusler argues that this freedom in verse came primarily from the church, specifically church songs. Heusler writes: &#x0201C;song more easily takes advantage of the prosodic freedom&#x0201D; (Heusler, <xref ref-type="bibr" rid="B20">1956</xref>, p. 32). Concerning rhyme, for nearly 300 years there was only pair rhyme in the AABB form, occasionally AAA, until around 1150 (Heusler, <xref ref-type="bibr" rid="B20">1956</xref>, p. 12). Otfrid&#x00027;s rhyme began as pure monosyllabic rhyme, and later developed into multi-syllable assonance and other types (Heusler, <xref ref-type="bibr" rid="B20">1956</xref>, p. 20). As the importance of rhyme grew, it became necessary for the rhyming syllable to also carry accent (Heusler, <xref ref-type="bibr" rid="B20">1956</xref>, p. 24,3 1). This new rhyme and accent provided an alternative means to tie verses together, but also ushered in new freedoms of measuring verse, as rhyme required syllables to relate to one another, something emphasized by the contemporary musicologists (Heusler, <xref ref-type="bibr" rid="B20">1956</xref>, p. 9). The form of the Ambrosian hymn is the closest metrically to Otfrid. The greatest difference lies within the construction of the line, where the syllable count is not certain, and divided lifts<xref ref-type="fn" rid="fn0016"><sup>16</sup></xref> are abundant (Heusler, <xref ref-type="bibr" rid="B20">1956</xref>, p. 35).</p>
<p>Otfrid&#x00027;s founding of the Germanic rhythmic verse was what Heusler calls a &#x0201C;Germanicizing&#x0201D; of the Romance iambic verse: free filling of verses with syllables, anacrusis, and more varied cadences (Heusler, <xref ref-type="bibr" rid="B20">1956</xref>, p. 36). Heusler charts out the development of Germanic verse and its influence from the Romance tradition, particularly in that the mixing of alliterative and pair-rhyme verse led to the early Germanic free filling of feet. Yet metrical conventions did exist in Otfrid&#x00027;s verse. The last foot was still strictly monosyllabic and verses could range from four to ten syllables, but were more often somewhere in between (Heusler, <xref ref-type="bibr" rid="B20">1956</xref>, p. 43). OHG verse often had feet with more syllables than MHG because OHG words simply had more medial syllables<xref ref-type="fn" rid="fn0017"><sup>17</sup></xref>. In contrast to MHG verse, OHG verse was more consistent with syllable length and duration (Heusler, <xref ref-type="bibr" rid="B20">1956</xref>, p. 56). In this sense, OHG verse was a &#x0201C;mediator&#x0201D; between Latin and alliterative verse (Heusler, <xref ref-type="bibr" rid="B20">1956</xref>, p. 63). With Otfrid, the German pair-rhyme <italic>Vierheber</italic> (four stresses per line) began to take shape:</p>
<p><inline-graphic xlink:href="fdigh-05-00019-i0002.tif"/></p>
</sec>
<sec id="s3">
<title>3. The middle high German <italic>Vierheber</italic></title>
<p>The most comprehensive and still referenced study of German meter is Andreas Heusler&#x00027;s three volume <italic>Deutsche Versgeschichte</italic>. Heusler&#x00027;s theory has been criticized incessantly over the years, but persists as the accepted theory for MHG meter today. M&#x000E4;rz claims that as reluctant as we are to use Heusler&#x00027;s theories, we use them because there is simply no better alternative (M&#x000E4;rz, <xref ref-type="bibr" rid="B30">1999</xref>, p. 318). While attempts have been made to supplement or critique Heusler&#x00027;s work, especially the existence of the fundamental &#x0201C;Takt&#x0201D; (measure, as in music), it has proven difficult for alternative theories to escape temporal restraints. If there is no &#x0201C;Takt,&#x0201D; is there no foot, or stress alternation? (M&#x000E4;rz, <xref ref-type="bibr" rid="B30">1999</xref>, p. 319) As M&#x000E4;rz observes, many of the alternative theories do not differ significantly from Heusler&#x00027;s, only Franz Saran&#x00027;s &#x0201C;<italic>Schallanalyse</italic>&#x0201D; (acoustic analysis) is suggested by M&#x000E4;rz as a plausible alternative to better incorporate the actual voice of the verse (M&#x000E4;rz, <xref ref-type="bibr" rid="B30">1999</xref>, pp. 321&#x02013;322).</p>
<p>What follows is a description of MHG epic meter in the Heusler tradition, with supplement from other, mostly pedagogical, resources. The Heusler theoretical framework is then employed to construct a supervised machine learning model of scansion<xref ref-type="fn" rid="fn0020"><sup>20</sup></xref>.</p>
<p>The predominating pattern in all MHG verse is an alternation between stressed and unstressed syllables (Tervooren, <xref ref-type="bibr" rid="B38">1979</xref>). MHG epic verse employs trochaic tetrameter: each line has four feet, and each foot is a trochee; this is known as the <italic>Vierheber</italic> for the four lifts (stressed syllables) in a line. Phonologically, a trochee consists of two syllables; the first syllable is stressed, and the second is unstressed. For example, the English word &#x0201C;better&#x0201D; is a trochee, but the word &#x0201C;alive&#x0201D; is not. The famous Longfellow epic poem <italic>The Song of Hiawatha</italic> is written in trochaic tetrameter, and the first line serves to illustrate this rhythm:</p>
<p><inline-graphic xlink:href="fdigh-05-00019-i0003.tif"/></p>
<p>Similarly, the prototypical MHG epic verse foot is two syllables in length, a stressed syllable followed by an unstressed syllable. However, feet can also be filled by one or three syllables (Domanowski et al., <xref ref-type="bibr" rid="B11">2009</xref>). If a foot is filled by one syllable, the syllable must be phonologically heavy (containing a long vowel or ending in a consonant). If the foot is filled by three syllables, either the first two or the last two syllables are often phonologically light<xref ref-type="fn" rid="fn0022"><sup>22</sup></xref>.</p>
<p>It is in these atypical feet that the influence of quantitative meter, where syllable length is a key factor, becomes evident in MHG verse. The foot in a <italic>Vierheber</italic> must be slightly redefined to account for this. Phonologically, syllable length is measured in morae, a unit of time such that a short syllable has one mora and a long syllable has two morae (Fox, <xref ref-type="bibr" rid="B13">2000</xref>)<xref ref-type="fn" rid="fn0023"><sup>23</sup></xref>. A foot in MHG meter is more precisely defined as having two morae, not necessarily two syllables<xref ref-type="fn" rid="fn0024"><sup>24</sup></xref>. Indeed the mora, not the syllable, has been called the fundamental unit of MHG verse, although the mora functions differently in this poetic tradition than in its phonological definition (Tervooren, <xref ref-type="bibr" rid="B38">1979</xref>, p. 1). If a foot has only one syllable, the syllable must be heavy because a heavy syllable is two morae and the MHG foot requires two morae. A light syllable cannot be the only syllable in a foot, since it cannot be two morae. If a foot has three syllables, two are often light because half morae are most often light syllables (the first half mora of a pair must always be light), together forming one mora<xref ref-type="fn" rid="fn0025"><sup>25</sup></xref>. The other syllable is analyzed as one mora, yielding the required two morae in the foot. To summarize, a syllable can have one of three length values: mora, half mora, or double mora. A half mora must be phonologically light, and a double mora must be phonologically heavy. Phonological length is otherwise irrelevant and any syllable can be one mora (Heusler, <xref ref-type="bibr" rid="B20">1956</xref>, p. 111).</p>
<p>In addition to length, as a function of morae, syllables are also assigned stress. There are three stress values: primary, secondary, and unstressed. Primary stress is assigned to the first or only stressed syllable in a word. Secondary stress is assigned to any following stressed syllable(s) in that word. All other syllables are unstressed<xref ref-type="fn" rid="fn0026"><sup>26</sup></xref>.</p>
<p>The final mora of the final foot of a line is omitted by convention<xref ref-type="fn" rid="fn0027"><sup>27</sup></xref>. This is construed as a pause, analogous to a rest in music, and receives its own symbol in the scansion ^, even though there is no corresponding word or syllable<xref ref-type="fn" rid="fn0028"><sup>28</sup></xref>. A short, word-final syllable may also be elided before a word beginning with a vowel. Finally, MHG epic verse permits up to three syllables in anacrusis (or pickup notes, a series of syllables at the beginning of a line that do not count in the meter). Phonologically, these syllables may or may not carry lexical or syntactic stress, but metrically, they are always scanned as unstressed morae.</p>
<p>The above features yield eight possible metrical values for any syllable:</p>
<list list-type="order">
<list-item><p><bold>mora - primary stress</bold> (<inline-formula><mml:math id="M12"><mml:mover accent="true"><mml:mrow><mml:mo>&#x000D7;</mml:mo></mml:mrow><mml:mo>&#x000B4;</mml:mo></mml:mover></mml:math></inline-formula>): a syllable with primary stress</p></list-item>
<list-item><p><bold>mora - secondary stress</bold> (<inline-formula><mml:math id="M13"><mml:mover accent="true"><mml:mrow><mml:mo>&#x000D7;</mml:mo></mml:mrow><mml:mo>&#x00300;</mml:mo></mml:mover></mml:math></inline-formula>): a syllable with secondary stress</p></list-item>
<list-item><p><bold>mora - unstressed</bold> (&#x000D7;): an unstressed syllable</p></list-item>
<list-item><p><bold>half mora - primary stress</bold> (<inline-formula><mml:math id="M14"><mml:mover accent="true"><mml:mrow><mml:mo>&#x02323;</mml:mo></mml:mrow><mml:mo>&#x000B4;</mml:mo></mml:mover></mml:math></inline-formula>): a short syllable with primary stress; according to metrical convention the preceding syllable must be long (Tervooren, <xref ref-type="bibr" rid="B38">1979</xref>, p. 5)</p></list-item>
<list-item><p><bold>half mora - secondary stress</bold> (<inline-formula><mml:math id="M15"><mml:mover accent="true"><mml:mrow><mml:mo>&#x02323;</mml:mo></mml:mrow><mml:mo>&#x00300;</mml:mo></mml:mover></mml:math></inline-formula>): a short syllable with secondary stress</p></list-item>
<list-item><p><bold>half mora - unstressed</bold> (&#x02323;): an unstressed syllable</p></list-item>
<list-item><p><bold>double mora</bold> (&#x02014;): a stressed long syllable; double morae always carry primary stress</p></list-item>
<list-item><p><bold>elision</bold> (&#x01EB9;): an elided syllable</p></list-item>
</list>
<p>Line 1 of Hartmann von Aue&#x00027;s <italic>Der arme Heinrich</italic> is prototypical. Each foot consists of a stressed syllable followed by an unstressed syllable. There is a one-syllable anacrusis:<xref ref-type="fn" rid="fn0029"><sup>29</sup></xref></p>
<p><inline-graphic xlink:href="fdigh-05-00019-i0004.tif"/></p>
<p>Line 6 also begins with one syllable in anacrusis. The second foot has a stressed mora consisting of two syllables, each one a half mora. The third foot has one syllable; a diphthong allows it to be scanned as long. The final foot has a mora with secondary stress, since the preceding syllable is stressed and in the same word:</p>
<p><inline-graphic xlink:href="fdigh-05-00019-i0005.tif"/></p>
<p>Line 34 has no anacrusis, and in the second foot two half mora syllables form the unstressed mora:</p>
<p><inline-graphic xlink:href="fdigh-05-00019-i0006.tif"/></p>
<p>Line 8 shows an elided syllable in the second foot:</p>
<p><inline-graphic xlink:href="fdigh-05-00019-i0007.tif"/></p>
</sec>
<sec id="s4">
<title>4. Computational approaches to meter</title>
<p>There are two prevailing treatments of meter in the literature concerned with computational poetic text analysis. One approach takes a known meter and assigns syllables to stress patterns based on such parameters (Hartman, <xref ref-type="bibr" rid="B16">1996</xref>). The second approach assumes nothing of the meter, and seeks to determine it by marking syllables and identifying patterns (Plamondon, <xref ref-type="bibr" rid="B35">2006</xref>; McAleese, <xref ref-type="bibr" rid="B27">2007</xref>; Greene et al., <xref ref-type="bibr" rid="B15">2010</xref>; Agirrezabal et al., <xref ref-type="bibr" rid="B2">2013</xref>; Navarro, <xref ref-type="bibr" rid="B31">2015</xref>). This project draws more on the latter. Previous scholarship has also focused on relatively simple systems of meter and adopted rule-based, statistical, or unsupervised approaches. The hybrid nature of MHG meter, and other complex systems developing out of classical antiquity, makes it difficult to scan poetry using these methodologies, and thus supervised learning presents itself as an attractive method. After initial results of this project were published in Estes and Hench (<xref ref-type="bibr" rid="B12">2016</xref>), similar studies were undertaken for English in Agirrezabal et al. (<xref ref-type="bibr" rid="B1">2016</xref>), Spanish in Navarro (<xref ref-type="bibr" rid="B32">2017</xref>), and Portuguese in Mittmann (<xref ref-type="bibr" rid="B29">2016</xref>) with the results here serving as the benchmark.</p>
<sec>
<title>4.1. Rule-based approach to middle high German</title>
<p>A strictly rule-based approach to scanning MHG epic meter was undertaken by Friedrich Dimpel in 2004 (Dimpel, <xref ref-type="bibr" rid="B8">2004a</xref>). As Dimpel&#x00027;s work is the only of its kind in this field, it deserves special consideration here. As part of his dissertation and continuing work at the University of Erlangen, Dimpel developed a set of tools named <italic>ErMaStat</italic> (<italic>Erlanger-Mittelalter-Statistik</italic>), crafted specifically for MHG epic poetry (Dimpel, <xref ref-type="bibr" rid="B9">2004b</xref>). Although sure to admit the shortcomings of such an approach, the opening pages of his introduction to <italic>ErMaStat</italic> reveal his stylometric intentions in making such a suite of tools:</p>
<disp-quote><p>Whenever one attempts to approach literary, scholarly questions with quantitative processes, then one must assume that texts from different authors (or different periods of an author&#x00027;s work) demonstrate certain distinct characteristics on a phonological, morphological, lexical, and syntactical level, which allow themselves to be captured quantitatively (Dimpel, <xref ref-type="bibr" rid="B9">2004b</xref>).</p></disp-quote>
<p>Dimpel&#x00027;s list of variables include: (1) syllable, word, and line count, (2) vowel and consonant counts, (3) function words (specific parts of speech), (4) alliteration, assonance, and enjambment, (5) suffixes, (6) word frequencies, (7) prefixes, (8) common words (a finer measurement than word frequency), (9) word combinations (na&#x000EF;ve bigrams), and (10) a metrical analysis. His intention is to model style, or characteristics of style, in order to compare texts and estimate probabilities of works being written by the same author.</p>
<p>Dimpel continues with three examples. In the first example, he takes four of the better known MHG epics: <italic>Parzival, Tristan, Wigalois</italic>, and <italic>Willehalm</italic>. Using the variables above, he calculates and averages significance values, showing that <italic>Parzival</italic> and <italic>Willehalm</italic>, both written by Wolfram von Eschenbach, do in fact have a lower degree of quantified stylistic difference relative to one another than to the works by other authors. Dimpel is also able to determine the contributions from individual variables. Dimpel&#x00027;s second analysis concerns the grouping of Wolfram&#x00027;s <italic>Parzival</italic> into chapters and the thesis proposed by Elisabeth Karg-Gasterst&#x000E4;dt of four different sound types, following the work of Eduard Sievers (Karg-Gasterst&#x000E4;dt, <xref ref-type="bibr" rid="B21">1925</xref>). Dimpel&#x00027;s <italic>ErMaStat</italic> supports Karg-Gasterst&#x000E4;dt&#x00027;s hypothesis as a possibility. His last example considers the date of authorship of Hartmann von Aue&#x00027;s <italic>Iwein</italic> with respect to Hartmann&#x00027;s <italic>Erec</italic>.</p>
<p>Dimpel approaches MHG meter by first programming for alternation and then hierarchically creating rules to account for stress. Though his work must be commended for its accuracy and linguistic engagement, it is a laborious task, inflexible, and extremely language specific. Our intention here is not to duplicate his work, nor dismiss it. Rather, through supervised learning we offer a new approach to an old problem for MHG. It also provides an opportunity for the &#x0201C;drei-stufige&#x0201D; (three-level, i.e., accounting for secondary stress and double morae) scansion Dimpel has not yet attempted, but notes is a great challenge to modeling MHG meter. There are also advantages of particular interest to humanists. A supervised method will learn to scan more in the manner of a human than a strictly rule-based approach would, perhaps remaining truer to the poetic tradition, and giving insight into what poses difficulties for human scanners. It also allows for greater versatility, and a chance to analyze the prosody beyond the epic meter, and perhaps even prose (Dimpel, <xref ref-type="bibr" rid="B9">2004b</xref>, <xref ref-type="bibr" rid="B10">2015</xref>).</p>
</sec>
<sec>
<title>4.2. Supervised learning</title>
<p>The machine learning approach taken in this project is supervised, i.e., the computer is provided with annotated data in the form:</p>
<p>ein/MORA WBY/WBY rit/MORA_HAUPT ter/MORA WBY/WBY s&#x000F4;/MORA_HAUPT WBY/WBY ge/MORA l&#x000EA;/MORA_HAUPT ret/MORA WBY/WBY was/MORA_HAUPT</p>
<p>The algorithm then learns which of the annotated features (described below) are important, and subsequently how to classify any given syllable. In contrast to other automated scansion systems, a supervised approach learns how the human annotators scanned based on a set of provided features and annotated data, as the algorithm identifies which features were deemed important by the humans who annotate them. When working with human productions, such as poetry, this is an attractive advantage. Yet there are both advantages and disadvantages to this method. On the one hand, the resulting model will take contextual and situational factors into account, factors that a strictly rule-based approach may not, due to the multiple layers of rules and probabilities constructed. If a poet attempts a certain stylistic move during a section of the narrative it may be captured (via a combination of feature weights) by the model. On the other hand, because the model learns to scan poetry like the annotators, it necessarily follows the practices of a specific theoretical school, thereby narrowing the limits of interpretation.</p>
</sec>
</sec>
<sec id="s5">
<title>5. Data</title>
<p>Because supervised learning is a novel approach to poetic meter, annotated metrical data do not exist for MHG or most other languages. Following the Heusler scansion system outlined above, syllables of MHG epic poetry were annotated into the eight categories of metrical value. The annotated data consist of 450 lines from Hartmann von Aue&#x00027;s <italic>Der arme Heinrich</italic>, 200 lines from Wolfram von Eschenbach&#x00027;s <italic>Parzival</italic>, and 100 lines from Wirnt von Grafenberg&#x00027;s <italic>Wigalois</italic><xref ref-type="fn" rid="fn0034"><sup>34</sup></xref>. An additional 10% (75 lines of Hartmann von Aue&#x00027;s <italic>Iwein</italic>) was annotated to be held-out for testing, yielding a total of 825 annotated lines. Summary statistics for all annotated data are reproduced in Table <xref ref-type="table" rid="T1">1</xref>.</p>
<table-wrap position="float" id="T1">
<label>Table 1</label>
<caption><p>Summary statistics for annotated dataset.</p></caption>
<table frame="hsides" rules="groups">
<thead><tr>
<th/>
<th valign="top" align="center"><bold>Mean</bold></th>
<th valign="top" align="center"><bold>Std</bold>.</th>
<th valign="top" align="center"><bold>Min</bold>.</th>
<th valign="top" align="center"><bold>Max</bold>.</th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">Char. per line</td>
<td valign="top" align="center">21.34</td>
<td valign="top" align="center">3.39</td>
<td valign="top" align="center">9</td>
<td valign="top" align="center">32</td>
</tr>
<tr>
<td valign="top" align="left">Syll. per line.</td>
<td valign="top" align="center">7.62</td>
<td valign="top" align="center">1.04</td>
<td valign="top" align="center">5</td>
<td valign="top" align="center">11</td>
</tr>
<tr>
<td valign="top" align="left">Words per line</td>
<td valign="top" align="center">5.01</td>
<td valign="top" align="center">1.13</td>
<td valign="top" align="center">1</td>
<td valign="top" align="center">8</td>
</tr>
<tr>
<td valign="top" align="left">Char. per word</td>
<td valign="top" align="center">4.26</td>
<td valign="top" align="center">1.96</td>
<td valign="top" align="center">1</td>
<td valign="top" align="center">17</td>
</tr>
<tr>
<td valign="top" align="left">Syll. per word</td>
<td valign="top" align="center">1.52</td>
<td valign="top" align="center">0.71</td>
<td valign="top" align="center">1</td>
<td valign="top" align="center">7</td>
</tr>
<tr>
<td valign="top" align="left">Char. per syll.</td>
<td valign="top" align="center">2.80</td>
<td valign="top" align="center">0.81</td>
<td valign="top" align="center">1</td>
<td valign="top" align="center">7</td>
</tr>
</tbody>
</table>
</table-wrap>
<p>Syllabification was performed prior to annotation according to the system detailed in Hench (<xref ref-type="bibr" rid="B19">2017</xref>), i.e., following the Sonority Sequencing Principle (SSP) with correction from the Legality Principle (LP). Annotation was carried out by the authors, who are both trained in MHG scansion<xref ref-type="fn" rid="fn0035"><sup>35</sup></xref>. In the case that a line exhibits multiple permissible scansions, priority is given to the scansion that best preserves the alternation of stressed and unstressed syllables. If a decision still cannot be made, then stress is determined according to semantic importance. An additional consideration is the syntactic stress of a particular line. Clearly, such evaluations allow some room for interpretation. Nevertheless, on a sample of 100 lines from the annotated data (739 syllables), the Cohen&#x00027;s kappa coefficient for the inter-annotator agreement is 0.962 (confusion matrix given in Table <xref ref-type="table" rid="T2">2</xref>). The greatest disagreement for the human annotators was among unstressed and stressed morae, and between unstressed morae and unstressed half morae, implying both some stress and some value disagreement.</p>
<table-wrap position="float" id="T2">
<label>Table 2</label>
<caption><p>Inter-annotator agreement confusion matrix.</p></caption>
<table frame="hsides" rules="groups">
<thead><tr>
<th/>
<th/>
<th valign="top" align="center" colspan="8" style="border-bottom: thin solid #000000;"><bold>Annotator 2</bold></th>
</tr>
<tr>
<th/>
</tr>
<tr>
<th/>
<th/>
<th valign="top" align="center">&#x000D7;</th>
<th valign="top" align="center"><inline-formula><mml:math id="M30"><mml:mover accent="true"><mml:mrow><mml:mo>&#x000D7;</mml:mo></mml:mrow><mml:mo>&#x000B4;</mml:mo></mml:mover></mml:math></inline-formula></th>
<th valign="top" align="center"><inline-formula><mml:math id="M31"><mml:mover accent="true"><mml:mrow><mml:mo>&#x000D7;</mml:mo></mml:mrow><mml:mo>&#x00300;</mml:mo></mml:mover></mml:math></inline-formula></th>
<th valign="top" align="center">&#x02014;</th>
<th valign="top" align="center">&#x02323;</th>
<th valign="top" align="center"><inline-formula><mml:math id="M32"><mml:mover accent="true"><mml:mrow><mml:mo>&#x02323;</mml:mo></mml:mrow><mml:mo>&#x000B4;</mml:mo></mml:mover></mml:math></inline-formula></th>
<th valign="top" align="center">&#x01EB9;</th>
<th valign="top" align="center"><inline-formula><mml:math id="M33"><mml:mover accent="true"><mml:mrow><mml:mo>&#x02323;</mml:mo></mml:mrow><mml:mo>&#x00300;</mml:mo></mml:mover></mml:math></inline-formula></th>
</tr>
</thead>
<tbody>
<tr>
<td valign="middle" align="left" rowspan="8">Annotator 1</td>
<td valign="top" align="left">&#x000D7;</td>
<td valign="top" align="center">285</td>
<td valign="top" align="center">4</td>
<td valign="top" align="center">0</td>
<td valign="top" align="center">1</td>
<td valign="top" align="center">3</td>
<td valign="top" align="center">0</td>
<td valign="top" align="center">0</td>
<td valign="top" align="center">0</td>
</tr>
<tr>
<td valign="top" align="left"><inline-formula><mml:math id="M34"><mml:mover accent="true"><mml:mrow><mml:mo>&#x000D7;</mml:mo></mml:mrow><mml:mo>&#x000B4;</mml:mo></mml:mover></mml:math></inline-formula></td>
<td valign="top" align="center">0</td>
<td valign="top" align="center">225</td>
<td valign="top" align="center">1</td>
<td valign="top" align="center">0</td>
<td valign="top" align="center">1</td>
<td valign="top" align="center">0</td>
<td valign="top" align="center">0</td>
<td valign="top" align="center">0</td>
</tr>
<tr>
<td valign="top" align="left"><inline-formula><mml:math id="M35"><mml:mover accent="true"><mml:mrow><mml:mo>&#x000D7;</mml:mo></mml:mrow><mml:mo>&#x00300;</mml:mo></mml:mover></mml:math></inline-formula></td>
<td valign="top" align="center">1</td>
<td valign="top" align="center">2</td>
<td valign="top" align="center">74</td>
<td valign="top" align="center">0</td>
<td valign="top" align="center">2</td>
<td valign="top" align="center">0</td>
<td valign="top" align="center">0</td>
<td valign="top" align="center">0</td>
</tr>
<tr>
<td valign="top" align="left">&#x02014;</td>
<td valign="top" align="center">1</td>
<td valign="top" align="center">2</td>
<td valign="top" align="center">0</td>
<td valign="top" align="center">72</td>
<td valign="top" align="center">0</td>
<td valign="top" align="center">0</td>
<td valign="top" align="center">0</td>
<td valign="top" align="center">0</td>
</tr>
<tr>
<td valign="top" align="left">&#x02323;</td>
<td valign="top" align="center">1</td>
<td valign="top" align="center">0</td>
<td valign="top" align="center">0</td>
<td valign="top" align="center">0</td>
<td valign="top" align="center">36</td>
<td valign="top" align="center">0</td>
<td valign="top" align="center">0</td>
<td valign="top" align="center">0</td>
</tr>
<tr>
<td valign="top" align="left"><inline-formula><mml:math id="M36"><mml:mover accent="true"><mml:mrow><mml:mo>&#x02323;</mml:mo></mml:mrow><mml:mo>&#x000B4;</mml:mo></mml:mover></mml:math></inline-formula></td>
<td valign="top" align="center">0</td>
<td valign="top" align="center">1</td>
<td valign="top" align="center">0</td>
<td valign="top" align="center">0</td>
<td valign="top" align="center">0</td>
<td valign="top" align="center">17</td>
<td valign="top" align="center">0</td>
<td valign="top" align="center">0</td>
</tr>
<tr>
<td valign="top" align="left">&#x01EB9;</td>
<td valign="top" align="center">0</td>
<td valign="top" align="center">0</td>
<td valign="top" align="center">0</td>
<td valign="top" align="center">0</td>
<td valign="top" align="center">0</td>
<td valign="top" align="center">0</td>
<td valign="top" align="center">9</td>
<td valign="top" align="center">0</td>
</tr>
<tr>
<td valign="top" align="left"><inline-formula><mml:math id="M37"><mml:mover accent="true"><mml:mrow><mml:mo>&#x02323;</mml:mo></mml:mrow><mml:mo>&#x00300;</mml:mo></mml:mover></mml:math></inline-formula></td>
<td valign="top" align="center">0</td>
<td valign="top" align="center">0</td>
<td valign="top" align="center">0</td>
<td valign="top" align="center">0</td>
<td valign="top" align="center">0</td>
<td valign="top" align="center">0</td>
<td valign="top" align="center">0</td>
<td valign="top" align="center">1</td>
</tr>
</tbody>
</table>
</table-wrap>
</sec>
<sec id="s6">
<title>6. Workflow</title>
<p>We present a new workflow, illustrated in Figure <xref ref-type="fig" rid="F1">1</xref>, for the automated scansion of poetic meter (MHG and other). The process begins with the syllabification of texts<xref ref-type="fn" rid="fn0036"><sup>36</sup></xref>. Because the syllable is the base unit for many poetic traditions, it is what needs to be annotated. After syllabification is the metrical annotation, requiring experts in scansion and the texts themselves<xref ref-type="fn" rid="fn0037"><sup>37</sup></xref>. After annotation, features must be developed and extracted to help the model understand what part of a verse is important in assigning metrical values. Many of the most important features are phonological. After these features are identified, an algorithm must be developed for obtaining and annotating these features before they, along with the syllables themselves, are sent to the model. After feature identification and extraction, there is a process of development and validating the model, in order to choose the most suitable parameters for the task. The model then makes predictions for each syllable based on the features and parameters supplied. The model also yields marginal probabilities for all predictions for any given syllable, i.e., each syllable comes with a list of probabilities for each of the possible metrical values. Simply taking the most probable sequence for any given line can be very accurate<xref ref-type="fn" rid="fn0038"><sup>38</sup></xref>.</p>
<fig id="F1" position="float">
<label>Figure 1</label>
<caption><p>Flow chart for MHG scansion.</p></caption>
<graphic xlink:href="fdigh-05-00019-g0001.tif"/>
</fig>
<p>For epic poetry, and the model described here, the predictions must be further processed through specific constraints, as the model will not impose strict rules unless instructed to do so<xref ref-type="fn" rid="fn0039"><sup>39</sup></xref>. If the predicted sequence passes each constraint, it is considered the final scansion. If not, the line is sent for further processing. The following tests check for impossible scansions in MHG epic meter:</p>
<list list-type="bullet">
<list-item><p><bold>Four stresses</bold>. The heart of the <italic>Vierheber</italic> is exactly four stresses per line<xref ref-type="fn" rid="fn0040"><sup>40</sup></xref>. Any more or less fails the line.</p></list-item>
<list-item><p><bold>Double morae must be heavy</bold>. Phonologically, to carry the weight of two morae, the syllable <italic>must be heavy</italic>. If a light double mora is identified, the line fails.</p></list-item>
<list-item><p><bold>First syllables of divided lifts must be light</bold>. While divided falls are allowed to be either light or heavy depending on the end syllable (though usually light), the first syllable of a divided lift <italic>must be light</italic>, if not, the line fails (Domanowski et al., <xref ref-type="bibr" rid="B11">2009</xref>).</p></list-item>
<list-item><p><bold>Elided syllables must be light</bold>. An elided syllable must end in a short vowel.</p></list-item>
<list-item><p><bold>Alternation</bold>. Two lifts cannot follow one another unless a lift follows a double mora, otherwise stress alternation is not upheld and the line fails.</p></list-item>
</list>
<p>If the line fails any of the above tests, it is sent for further processing, where, depending on the phonology of the syllables and the rules above, all phonologically possible metrical values as well as the calculated marginal probabilities are combined into every possible sequence for all the syllables in the line. Illegal combinations according to the tests above are ruled out of the set, and the set is then ranked by overall probability. The most probable, legal scansion is then selected. Thus, errors in the model stem primarily from incorrect identification of the language&#x00027;s natural stress, as all certain metrical patterning errors are sorted out. The model itself is intended to account for this natural stress by taking advantage of the information provided to it through the annotated data. The constraints help the model further cut out possibilities that conform to the natural stress, but not the metrical environment (which is relatively weakly learned by the model), yielding an ultimately highly accurate model.</p>
</sec>
<sec id="s7">
<title>7. Models and features</title>
<p>Two baseline models were developed<xref ref-type="fn" rid="fn0041"><sup>41</sup></xref>: an n-gram model<xref ref-type="fn" rid="fn0042"><sup>42</sup></xref> cascading into regular expressions and a Brill transformation-based model on top of the n-gram model, both using syllables as units, though not explicitly accepting features beyond the syllables and tags themselves. The n-gram model consists of cascading trigram, bigram, unigram, and regular expressions models, i.e., first a value is predicted based on the previous two values, if possible; otherwise it is predicted based on the previous one value, and if the first two models fail, it is predicted solely based on the value probability for the syllable itself. If the syllable did not appear in the training data, and it cannot be predicted by the first three models, it resorts to regular expressions. Based on MHG scansion theory and observations while annotating, syllables with long vowels were assigned to double mora, short syllables to unstressed mora, and the remaining syllables to mora with primary stress<xref ref-type="fn" rid="fn0043"><sup>43</sup></xref>. The n-gram model was implemented with default settings, and is a very na&#x000EF;ve most-frequent-tag approach. This model helps to illustrate the variation between appropriate metrical values for the same syllable.</p>
<p>The Brill model<xref ref-type="fn" rid="fn0044"><sup>44</sup></xref>, first assigns the most common label for a given syllable and previous syllable&#x00027;s metrical value from the n-gram model described above and then generates rules to improve the initial estimate of the n-gram model according to the training data. It then iterates over these rules, correcting labels until F-score no longer increases. The Brill model was implemented with a maximum of 200 rules. This approach is very similar to Dimpel&#x00027;s enumeration of hierarchical rules for MHG scansion.</p>
<p>To compare to the baseline, efforts were focused on constructing a Conditional Random Field (CRF) model<xref ref-type="fn" rid="fn0045"><sup>45</sup></xref>. The decision to implement a CRF model was predicated on the interpretability of CRF modeling and understanding the primary features for MHG scansion<xref ref-type="fn" rid="fn0046"><sup>46</sup></xref>. In the model, each syllable contains the features for the syllable itself, but also those of every syllable in the line, marked by index. The features and their motivations are:
<list list-type="bullet">
<list-item><p><bold>Position within line</bold>: the last mora of a line is always stressed (except in masculine bisyllabic cadences), and double morae occur most often in the third foot. If there is anacrusis, these syllables will be unstressed morae.</p></list-item>
<list-item><p><bold>Length of syllable in characters</bold>: longer syllables (in terms of number of characters, serving as a proxy for phonemes) are more likely to be stressed. Unstressed prefixes and suffixes tend to be maximally three characters.</p></list-item>
<list-item><p><bold>Syllable characters</bold>: the characters in a syllable can help identify certain grammatical morphemes that are often unstressed. Slices were taken of the first character, first two characters, last character, and last two characters.</p></list-item>
<list-item><p><bold>Elision</bold>: the last two characters of the previous syllable and the first two characters of the current syllable are identified as one feature to detect conditions for elision.</p></list-item>
<list-item><p><bold>Syllable weight and length</bold>: syllables ending in a vowel or consonant are open or closed respectively. Syllables ending in a short vowel are short; otherwise they are long. Such values are useful in identifying double or half mora syllables, which must be long or short respectively. For example, the syllable &#x0201C;schou&#x0201D; in line 6 of <italic>Der Arme Heinrich</italic> above is a double mora, and is accordingly long.</p></list-item>
<list-item><p><bold>Word boundaries</bold>: MHG is a stress initial language.</p></list-item>
</list></p>
<p>The model was tuned only on the cross-validated development data and the best performing model was chosen. The resulting best model uses an <italic>L1</italic> coefficient of 1.3 and <italic>L2</italic> coefficient of 0.001. No further changes to the model itself were made after the model features and parameters were selected<xref ref-type="fn" rid="fn0047"><sup>47</sup></xref>. However, the additional rules described above were enforced in order to increase the F-score for epic meter specifically.</p>
</sec>
<sec sec-type="results" id="s8">
<title>8. Results</title>
<p>The n-gram model found little success even with additional training data, ending with an F-score of only 0.602 (95% CI [0.583, 0.623]). The transformation-based Brill model improved quickly upon the n-gram model, but plateaued at an F-score of 0.810 (95% CI [0.796, 0.838]). Figure <xref ref-type="fig" rid="F2">2</xref> shows the increase in F-score with an increase in the number of annotated lines for all models, suggesting that marginal returns to annotation begin to diminish significantly after around 400 lines, or, in the case of MHG, about 3,000 syllables. The final results of the CRF model are given in Table <xref ref-type="table" rid="T3">3</xref> in descending order of frequency in the data, along with a final held-out test set of 75 lines from Hartmann von Aue&#x00027;s <italic>Iwein</italic>. The preferred CRF model achieves an F-score of 0.925 (95% CI [0.911, 0.939]) on the cross-validated development data and 0.909 on the held-out testing data<xref ref-type="fn" rid="fn0048"><sup>48</sup></xref>. Supervised learning thus proves to also be an economical option for languages with complex meter.</p>
<fig id="F2" position="float">
<label>Figure 2</label>
<caption><p>Tagging F-score with added input.</p></caption>
<graphic xlink:href="fdigh-05-00019-g0002.tif"/>
</fig>
<table-wrap position="float" id="T3">
<label>Table 3</label>
<caption><p>CRF model F-score for individual metrical values and (weighted) average in development and on held-out data.</p></caption>
<table frame="hsides" rules="groups">
<thead><tr>
<th/>
<th/>
<th/>
<th valign="top" align="center" colspan="2" style="border-bottom: thin solid #000000;"><bold>Held-out</bold></th>
</tr>
<tr>
<th/>
</tr>
<tr>
<th valign="top" align="left"><bold>Metrical value</bold></th>
<th valign="top" align="center"><italic><bold>F</bold></italic></th>
<th valign="top" align="center"><bold>Obs</bold>.</th>
<th valign="top" align="center"><italic><bold>F</bold></italic></th>
<th valign="top" align="center"><bold>Obs</bold>.</th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">mora - unstr.</td>
<td valign="top" align="center">0.938</td>
<td valign="top" align="center">2,405</td>
<td valign="top" align="center">0.937</td>
<td valign="top" align="center">253</td>
</tr>
<tr>
<td valign="top" align="left">mora - prim.<xref ref-type="table-fn" rid="TN1"><sup>&#x0002A;</sup></xref></td>
<td valign="top" align="center">0.949</td>
<td valign="top" align="center">2,463</td>
<td valign="top" align="center">0.951</td>
<td valign="top" align="center">253</td>
</tr>
<tr>
<td valign="top" align="left">double mora</td>
<td valign="top" align="center">0.881</td>
<td valign="top" align="center">424</td>
<td valign="top" align="center">0.928</td>
<td valign="top" align="center">34</td>
</tr>
<tr>
<td valign="top" align="left">half mora - unstr.</td>
<td valign="top" align="center">0.672</td>
<td valign="top" align="center">231</td>
<td valign="top" align="center">0.541</td>
<td valign="top" align="center">41</td>
</tr>
<tr>
<td valign="top" align="left">half mora - prim.</td>
<td valign="top" align="center">0.822</td>
<td valign="top" align="center">107</td>
<td valign="top" align="center">0.667</td>
<td valign="top" align="center">11</td>
</tr>
<tr style="border-bottom: thin solid #000000;">
<td valign="top" align="left">elision</td>
<td valign="top" align="center">0.773</td>
<td valign="top" align="center">65</td>
<td valign="top" align="center">0.667</td>
<td valign="top" align="center">2</td>
</tr> <tr>
<td valign="top" align="left">(Weighted) average</td>
<td valign="top" align="center">0.925</td>
<td/>
<td valign="top" align="center">0.909</td>
<td/>
</tr>
</tbody>
</table>
<table-wrap-foot>
<fn id="TN1">
<label>&#x0002A;</label><p><italic>Morae and half morae with secondary stress were not predicted, rather determined based on word boundaries after prediction</italic>.</p></fn>
</table-wrap-foot>
</table-wrap>
<p>The top ten highest scoring features of the CRF model and rules of the Brill model are given in Table <xref ref-type="table" rid="T4">4</xref>. It is evident that the CRF model takes advantage of the phonological features provided, an advantage over the baseline models. Top CRF features (1) and (5) suggest any heavy syllable is likely stressed, and often a stressed mora. The CRF model also discerned cadence from the line patterning, exhibited in top CRF features (2) and (4), noting that except for the rather uncommon occurence of a cadence with a divided lift in the last foot (masculine bisyllabic cadence), the last syllable is always a stressed mora. Elision appears frequently in the top CRF features (3) and (6). Anacrusis is recognized in top CRF features (7) following the prototypical patterning:</p>
<p><inline-graphic xlink:href="fdigh-05-00019-i0008.tif"/></p>
<table-wrap position="float" id="T4">
<label>Table 4</label>
<caption><p>Top ten CRF features and Brill rules.</p></caption>
<table frame="hsides" rules="groups">
<thead><tr>
<th valign="top" align="left"><bold>CRF</bold></th>
<th valign="top" align="left"><bold>Brill</bold></th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">(1) &#x02014; if heavy syll.</td>
<td valign="top" align="left">(1) <inline-formula><mml:math id="M38"><mml:mover accent="true"><mml:mrow><mml:mo>&#x000D7;</mml:mo></mml:mrow><mml:mo>&#x000B4;</mml:mo></mml:mover></mml:math></inline-formula> &#x02192; &#x000D7; if at word boundary and following syll. is <inline-formula><mml:math id="M39"><mml:mover accent="true"><mml:mrow><mml:mo>&#x000D7;</mml:mo></mml:mrow><mml:mo>&#x000B4;</mml:mo></mml:mover></mml:math></inline-formula></td>
</tr>
<tr>
<td valign="top" align="left">(2) not <inline-formula><mml:math id="M40"><mml:mover accent="true"><mml:mrow><mml:mo>&#x000D7;</mml:mo></mml:mrow><mml:mo>&#x000B4;</mml:mo></mml:mover></mml:math></inline-formula> if next syll. is EOL</td>
<td valign="top" align="left">(2) <inline-formula><mml:math id="M41"><mml:mover accent="true"><mml:mrow><mml:mo>&#x000D7;</mml:mo></mml:mrow><mml:mo>&#x000B4;</mml:mo></mml:mover></mml:math></inline-formula> &#x02192; &#x02014; if followed by <inline-formula><mml:math id="M42"><mml:mover accent="true"><mml:mrow><mml:mo>&#x000D7;</mml:mo></mml:mrow><mml:mo>&#x00300;</mml:mo></mml:mover></mml:math></inline-formula> and word boundary</td>
</tr>
<tr>
<td valign="top" align="left">(3) &#x01EB9; if first char. of next syll. is &#x0201C;e&#x0201D;</td>
<td valign="top" align="left">(3) &#x000D7; &#x02192; <inline-formula><mml:math id="M43"><mml:mover accent="true"><mml:mrow><mml:mo>&#x000D7;</mml:mo></mml:mrow><mml:mo>&#x00300;</mml:mo></mml:mover></mml:math></inline-formula> if end of line</td>
</tr>
<tr>
<td valign="top" align="left">(4) <inline-formula><mml:math id="M44"><mml:mover accent="true"><mml:mrow><mml:mo>&#x000D7;</mml:mo></mml:mrow><mml:mo>&#x000B4;</mml:mo></mml:mover></mml:math></inline-formula> if EOL</td>
<td valign="top" align="left">(4) <inline-formula><mml:math id="M45"><mml:mover accent="true"><mml:mrow><mml:mo>&#x000D7;</mml:mo></mml:mrow><mml:mo>&#x00300;</mml:mo></mml:mover></mml:math></inline-formula>&#x02192;<inline-formula><mml:math id="M46"><mml:mover accent="true"><mml:mrow><mml:mo>&#x000D7;</mml:mo></mml:mrow><mml:mo>&#x000B4;</mml:mo></mml:mover></mml:math></inline-formula> if monosyllabic</td>
</tr>
<tr>
<td valign="top" align="left">(5) <inline-formula><mml:math id="M47"><mml:mover accent="true"><mml:mrow><mml:mo>&#x000D7;</mml:mo></mml:mrow><mml:mo>&#x000B4;</mml:mo></mml:mover></mml:math></inline-formula> if heavy syll.</td>
<td valign="top" align="left">(5) &#x000D7; &#x02192; <inline-formula><mml:math id="M48"><mml:mover accent="true"><mml:mrow><mml:mo>&#x000D7;</mml:mo></mml:mrow><mml:mo>&#x000B4;</mml:mo></mml:mover></mml:math></inline-formula> if following syll. is &#x0201C;ge&#x0201D;</td>
</tr>
<tr>
<td valign="top" align="left">(6) &#x01EB9; if first char. of next syll. is &#x0201C;i&#x0201D;</td>
<td valign="top" align="left">(6) <inline-formula><mml:math id="M49"><mml:mover accent="true"><mml:mrow><mml:mo>&#x000D7;</mml:mo></mml:mrow><mml:mo>&#x000B4;</mml:mo></mml:mover></mml:math></inline-formula> &#x02192; &#x000D7; if &#x0201C;ist&#x0201D; &#x0002B;2 syll.</td>
</tr>
<tr>
<td valign="top" align="left">(7) &#x000D7; if &#x0002B;7 syll. not EOL</td>
<td valign="top" align="left">(7) &#x01EB9; &#x02192; &#x02323; if &#x0201C;der,&#x0201D; &#x0201C;den,&#x0201D; &#x0201C;diu&#x0201D; &#x0002B;2 syll.</td>
</tr>
<tr>
<td valign="top" align="left">(8) &#x02014; if next syll. same word</td>
<td valign="top" align="left">(8) &#x02323; &#x02192; &#x01EB9; if &#x0201C;ein,&#x0201D; &#x0201C;ich,&#x0201D; &#x0201C;er&#x0201D; &#x0002B;2 syll.</td>
</tr>
<tr>
<td valign="top" align="left">(9) &#x02014; if next syll. ends in &#x0201C;en&#x0201D;</td>
<td valign="top" align="left">(9) &#x01EB9; &#x02192; <inline-formula><mml:math id="M50"><mml:mover accent="true"><mml:mrow><mml:mo>&#x000D7;</mml:mo></mml:mrow><mml:mo>&#x00300;</mml:mo></mml:mover></mml:math></inline-formula> if &#x0201C;ge&#x0201D; &#x0002B;2 syll.</td>
</tr>
<tr>
<td valign="top" align="left">(10) not &#x02323; if beg. of word</td>
<td valign="top" align="left">(10) &#x02014; &#x02192; &#x000D7; if &#x0201C;al&#x0201D; -1 syll.</td>
</tr>
</tbody>
</table>
</table-wrap>
<p>Where there are eight syllables, if seven syllables down the line is the last syllable of the line (EOL), and alternation is regular, that focal syllable will be unstressed in anacrusis. Top CRF features (8), (9), and (10) each consider words and word boundaries, specifically that double morae often occur at the beginning of a multi-syllabic word, and often that word is bisyllabic, with the second syllable ending in &#x0201C;en,&#x0201D; such as &#x0201C;mae-ren&#x0201D; or &#x0201C;r&#x000EE;-ten.&#x0201D; Top CRF feature (10) notes that unstressed half morae often occur after the first syllable of multi-syllabic words (half morae are only stressed when beginning a word).</p>
<p>The Brill model adopts a more general rule for alternation in top Brill feature (1). Notably, the Brill model takes greater advantage of word boundaries in (1) and (2), while these features rank lower in the CRF model. The Brill model inevitably also notes the influence of specific words or prefixes. The unstressed prefix &#x0201C;ge&#x0201D; ranks as a top five rule for the Brill model. If &#x0201C;ist&#x0201D; is two syllables down the line, the current syllable&#x00027;s assignment is changed from stressed to unstressed, or if &#x0201C;ein,&#x0201D; &#x0201C;ich,&#x0201D; or &#x0201C;er&#x0201D; is two syllables away, the original half mora assignment is changed to an elision.</p>
<p>The scores from both models confirm extant MHG metrical theory (as it was employed for the annotation), but suggest new methods of approach for students of MHG meter. Instead of first marking stress, as suggested by <italic>Minimalmetrik</italic> (Tervooren, <xref ref-type="bibr" rid="B38">1979</xref>) and the pedagogically oriented website <italic>Mittelhochdeutsche Metrik Online</italic> (Domanowski et al., <xref ref-type="bibr" rid="B11">2009</xref>), it may be useful for students to first determine the cadence and anacrusis by counting the number of syllables in the line, and looking for heavy syllables at the end of the line. Stress can then be marked in the remaining syllables and metrical values can be assigned based on phonological features. This method may be particularly useful for non-native German speakers, who may have less feeling for the natural stress of German. These results and insights support our feature decisions and our implementation of a CRF model.</p>
</sec>
<sec id="s9">
<title>9. Errors and challenges</title>
<p>Investigating the errors and challenges of a supervised model presents the opportunity for the greatest new insights into the field and the advantage over an unsupervised approach. The confusion matrix for the CRF model in Table <xref ref-type="table" rid="T5">5</xref> shows the errors made in the prediction of the held-out data. The model has the most trouble predicting both stressed and unstressed half morae, particularly the latter. This situation is mirrored in the human inter-annotator agreement matrix, demonstrating, as may be expected, that the machine learning model makes similar errors to the human annotators. The unstressed mora and half mora confusion, common in both human and machine annotation, is understandable, as these two are the most phonologically ambiguous metrical values in MHG meter. Double morae, stressed half morae, and elisions all have the phonological restrictions listed above, and stressed morae are evidently less confused with double morae, likely due to clear alternation in the surrounding environment. Unstressed morae and half morae have hardly any restrictions (only that they are likely not heavy syllables). This then generates further stress confusion between unstressed morae and stressed morae seen in both the computer model and human annotation.</p>
<table-wrap position="float" id="T5">
<label>Table 5</label>
<caption><p>CRF confusion matrix.</p></caption>
<table frame="hsides" rules="groups">
<thead><tr>
<th/>
<th/>
<th valign="top" align="center" colspan="6" style="border-bottom: thin solid #000000;"><bold>Predicted</bold></th>
</tr>
<tr>
<th/>
<th/>
<th valign="top" align="center">&#x000D7;</th>
<th valign="top" align="center"><inline-formula><mml:math id="M55"><mml:mover accent="true"><mml:mrow><mml:mo>&#x000D7;</mml:mo></mml:mrow><mml:mo>&#x000B4;</mml:mo></mml:mover></mml:math></inline-formula></th>
<th valign="top" align="center">&#x02323;</th>
<th valign="top" align="center">&#x02014;</th>
<th valign="top" align="center"><inline-formula><mml:math id="M56"><mml:mover accent="true"><mml:mrow><mml:mo>&#x02323;</mml:mo></mml:mrow><mml:mo>&#x000B4;</mml:mo></mml:mover></mml:math></inline-formula></th>
<th valign="top" align="center">&#x01EB9;</th>
</tr>
</thead>
<tbody>
<tr>
<td valign="middle" rowspan="6" align="left">True</td>
<td valign="top" align="left">&#x000D7;</td>
<td valign="top" align="center">239</td>
<td valign="top" align="center">4</td>
<td valign="top" align="center">8</td>
<td valign="top" align="center">2</td>
<td valign="top" align="center">0</td>
<td valign="top" align="center">0</td>
</tr>
<tr>
<td valign="top" align="left"><inline-formula><mml:math id="M57"><mml:mover accent="true"><mml:mrow><mml:mo>&#x000D7;</mml:mo></mml:mrow><mml:mo>&#x000B4;</mml:mo></mml:mover></mml:math></inline-formula></td>
<td valign="top" align="center">6</td>
<td valign="top" align="center">243</td>
<td valign="top" align="center">3</td>
<td valign="top" align="center">0</td>
<td valign="top" align="center">1</td>
<td valign="top" align="center">0</td>
</tr>
<tr>
<td valign="top" align="left">&#x02323;</td>
<td valign="top" align="center">11</td>
<td valign="top" align="center">7</td>
<td valign="top" align="center">20</td>
<td valign="top" align="center">1</td>
<td valign="top" align="center">0</td>
<td valign="top" align="center">2</td>
</tr>
<tr>
<td valign="top" align="left">&#x02014;</td>
<td valign="top" align="center">0</td>
<td valign="top" align="center">1</td>
<td valign="top" align="center">1</td>
<td valign="top" align="center">32</td>
<td valign="top" align="center">0</td>
<td valign="top" align="center">0</td>
</tr>
<tr>
<td valign="top" align="left"><inline-formula><mml:math id="M58"><mml:mover accent="true"><mml:mrow><mml:mo>&#x02323;</mml:mo></mml:mrow><mml:mo>&#x000B4;</mml:mo></mml:mover></mml:math></inline-formula></td>
<td valign="top" align="center">1</td>
<td valign="top" align="center">3</td>
<td valign="top" align="center">1</td>
<td valign="top" align="center">0</td>
<td valign="top" align="center">6</td>
<td valign="top" align="center">0</td>
</tr>
<tr>
<td valign="top" align="left">&#x01EB9;</td>
<td valign="top" align="center">0</td>
<td valign="top" align="center">0</td>
<td valign="top" align="center">0</td>
<td valign="top" align="center">0</td>
<td valign="top" align="center">0</td>
<td valign="top" align="center">2</td>
</tr>
</tbody>
</table>
</table-wrap>
<p>If an algorithm can be trained to scan MHG meter similar to how a human does, it may be interesting to see what is considered difficult for the algorithm. This can be computed by averaging the marginal probabilities calculated by the CRF model. The lower the average probability for a line, the less confident the model is about its provided scansion, and vice versa. With the model, this can be computed for any text (annotated or not), but let us first look at the model text used extensively for annotation and instruction, Hartmann&#x00027;s <italic>Der arme Heinrich</italic>. Unsurprisingly, the easiest lines for the model to scan are lines that hold true to the trochaic tetrameter patterning, inclusive of the common one syllable anacrusis:</p>
<p><inline-graphic xlink:href="fdigh-05-00019-i0009.tif"/></p>
<p>In these examples we also see very distinct prosodic stress patterning. &#x0201C;sus,&#x0201D; &#x0201C;ouch,&#x0201D; &#x0201C;m&#x000EE;n,&#x0201D; &#x0201C;ber,&#x0201D; &#x0201C;ge,&#x0201D; &#x0201C;ten,&#x0201D; &#x0201C;ge,&#x0201D; &#x0201C;dez,&#x0201D; &#x0201C;ein,&#x0201D; &#x0201C;ter,&#x0201D; &#x0201C;ge,&#x0201D; &#x0201C;ret&#x0201D; are all common unstressed MHG syllabes both in poetry and prose, while &#x0201C;trouc,&#x0201D; &#x0201C;mich,&#x0201D; &#x0201C;tum,&#x0201D; &#x0201C;w&#x000E2;n,&#x0201D; &#x0201C;frum,&#x0201D; &#x0201C;s&#x000F4;,&#x0201D; &#x0201C;sun,&#x0201D; &#x0201C;hin,&#x0201D; &#x0201C;rit,&#x0201D; &#x0201C;s&#x000F4;,&#x0201D; &#x0201C;l&#x000EA;r,&#x0201D; &#x0201C;was&#x0201D; are all either semantically significant, or heavy, stressed syllables. Moreover, the stress of all multi-syllabic words is clear: &#x0201C;gefrumten,&#x0201D; &#x0201C;gesundez,&#x0201D; &#x0201C;gel&#x000EA;ret,&#x0201D; and &#x0201C;verschaffen&#x0201D; have unstressed prefixes, while the rest follow the typical word-initial stress. Any MHG scholar would notice the clear trochaic quality of these lines, and few would disagree with the typical trochaic scansion. One must also wonder how the poets understood and wrote these lines. Were they particularly easy to craft? Do they carry less importance in the story? Or are these lines particularly <italic>true</italic> (and just not informative?), because the poet did not need extra effort to fit the truth into a legal line of MHG poetry? Rhyme and rhythm together can be restrictive or prescriptive forces acting on a medieval poet. They can force poets to write a verse slightly different than the original thought in order to fill or fit the meter, or complement the rhyme. Thus the selected words were not only selected for sematic suitability, but for formal effect. They may not communicate the full truth (Mertens, <xref ref-type="bibr" rid="B28">2005</xref>, p. 194) (Cramer, <xref ref-type="bibr" rid="B7">1998</xref>, p. 180).</p>
<p>The computer model has difficulties with foreign words, outlier line lengths, and uncommon prosodic and metrical patternings. Belows are the lines about which the model was least confident, even though it correctly scanned (7), (9), and (10).:</p>
<p><inline-graphic xlink:href="fdigh-05-00019-i0010.tif"/></p>
<p>While the Latin in example 6 does not pose any problem for a human scanner trained as a medievalist, the model cannot identify the long syllable in specu<italic>l&#x00101;</italic>tor, and having learned MHG, it would never presume a stressed syllable on the third syllable of a multi-syllabic word<xref ref-type="fn" rid="fn0061"><sup>61</sup></xref>. The marginal probabilities in Table <xref ref-type="table" rid="T6">6</xref> are striking compared even to the other difficult lines, as the model is unsure about nearly every syllable<xref ref-type="fn" rid="fn0062"><sup>62</sup></xref>. The other troubling cases are more relatable. In example 7, we are confronted with the minimum number of syllables that a MHG epic verse is permitted to contain, one which the model nearly guesses correctly. Adding to the difficulty is that each word is monosyllabic, and as documented above, the model prefers bisyllabic words as double morae. The double morae are also only two characters (or phonemes) in length, an adverb and a preposition. Table <xref ref-type="table" rid="T7">7</xref> shows that the model is not confident about any of the assignments except for the very last syllable, which as a monosyllabic ultima, is likely a stressed mora.</p>
<table-wrap position="float" id="T6">
<label>Table 6</label>
<caption><p>Example (6), average probability 0.247.</p></caption>
<table frame="hsides" rules="groups">
<thead><tr>
<th valign="top" align="left"><bold>Syllable</bold></th>
<th valign="top" align="center"><bold>Value</bold></th>
<th valign="top" align="center"><bold>Marginal prob</bold>.</th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">cor</td>
<td valign="top" align="center">&#x02013;</td>
<td valign="top" align="center">0.124</td>
</tr>
<tr>
<td valign="top" align="left">dis</td>
<td valign="top" align="center"><inline-formula><mml:math id="M107"><mml:mover accent="true"><mml:mrow><mml:mo>&#x000D7;</mml:mo></mml:mrow><mml:mo>&#x00300;</mml:mo></mml:mover></mml:math></inline-formula></td>
<td valign="top" align="center">0.132</td>
</tr>
<tr>
<td valign="top" align="left">spe</td>
<td valign="top" align="center">&#x000D7;</td>
<td valign="top" align="center">0.134</td>
</tr>
<tr>
<td valign="top" align="left">cu</td>
<td valign="top" align="center"><inline-formula><mml:math id="M108"><mml:mover accent="true"><mml:mrow><mml:mo>&#x000D7;</mml:mo></mml:mrow><mml:mo>&#x000B4;</mml:mo></mml:mover></mml:math></inline-formula></td>
<td valign="top" align="center">0.204</td>
</tr>
<tr>
<td valign="top" align="left">la</td>
<td valign="top" align="center">&#x000D7;</td>
<td valign="top" align="center">.342</td>
</tr>
<tr>
<td valign="top" align="left">tor</td>
<td valign="top" align="center"><inline-formula><mml:math id="M109"><mml:mover accent="true"><mml:mrow><mml:mo>&#x000D7;</mml:mo></mml:mrow><mml:mo>&#x00300;</mml:mo></mml:mover></mml:math></inline-formula></td>
<td valign="top" align="center">0.549</td>
</tr>
</tbody>
</table>
</table-wrap>
<table-wrap position="float" id="T7">
<label>Table 7</label>
<caption><p>Example (7), average probability 0.274.</p></caption>
<table frame="hsides" rules="groups">
<thead><tr>
<th valign="top" align="left"><bold>Syllable</bold></th>
<th valign="top" align="center"><bold>Value</bold></th>
<th valign="top" align="center"><bold>Marginal prob</bold>.</th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">d&#x000E2;</td>
<td valign="top" align="center">&#x02014;</td>
<td valign="top" align="center">0.028</td>
</tr>
<tr>
<td valign="top" align="left">hiez</td>
<td valign="top" align="center"><inline-formula><mml:math id="M110"><mml:mover accent="true"><mml:mrow><mml:mo>&#x000D7;</mml:mo></mml:mrow><mml:mo>&#x000B4;</mml:mo></mml:mover></mml:math></inline-formula></td>
<td valign="top" align="center">0.114</td>
</tr>
<tr>
<td valign="top" align="left">s&#x000EE;</td>
<td valign="top" align="center">&#x000D7;</td>
<td valign="top" align="center">0.114</td>
</tr>
<tr>
<td valign="top" align="left">&#x000FB;f</td>
<td valign="top" align="center">&#x02014;</td>
<td valign="top" align="center">0.114</td>
</tr>
<tr>
<td valign="top" align="left">g&#x000E2;n</td>
<td valign="top" align="center"><inline-formula><mml:math id="M111"><mml:mover accent="true"><mml:mrow><mml:mo>&#x000D7;</mml:mo></mml:mrow><mml:mo>&#x000B4;</mml:mo></mml:mover></mml:math></inline-formula></td>
<td valign="top" align="center">0.998</td>
</tr>
</tbody>
</table>
</table-wrap>
<p>Example 8 with it&#x00027;s marginal probabilities in Table <xref ref-type="table" rid="T8">8</xref> appears as classic trochaic tetrameter following the form of an easy prediction for the model, yet the natural stress of the bisyllabic &#x0201C;alle&#x0201D; prevents this scansion, forcing &#x0201C;mir&#x0201D; to be in a stressed position in the preferred scansion. The model is least confident about the three syllables it in fact scans incorrectly, (&#x0201C;mir al-le&#x0201D;) but evidently believes the alternation to be the stronger choice than a midline, monosyllabic double mora followed by a divided lift, which itself is a rare occurrence.</p>
<table-wrap position="float" id="T8">
<label>Table 8</label>
<caption><p>Example (8), average probability 0.496.</p></caption>
<table frame="hsides" rules="groups">
<thead><tr>
<th valign="top" align="left"><bold>Syllable</bold></th>
<th valign="top" align="center"><bold>Value</bold></th>
<th valign="top" align="center"><bold>Marginal prob</bold>.</th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">n&#x000FB;</td>
<td valign="top" align="center">&#x000D7;</td>
<td valign="top" align="center">0.921</td>
</tr>
<tr>
<td valign="top" align="left">r&#x000E2;</td>
<td valign="top" align="center"><inline-formula><mml:math id="M112"><mml:mover accent="true"><mml:mrow><mml:mo>&#x000D7;</mml:mo></mml:mrow><mml:mo>&#x000B4;</mml:mo></mml:mover></mml:math></inline-formula></td>
<td valign="top" align="center">0.644</td>
</tr>
<tr>
<td valign="top" align="left">tet</td>
<td valign="top" align="center">&#x000D7;</td>
<td valign="top" align="center">0.381</td>
</tr>
<tr>
<td valign="top" align="left">mir</td>
<td valign="top" align="center"><inline-formula><mml:math id="M113"><mml:mover accent="true"><mml:mrow><mml:mo>&#x000D7;</mml:mo></mml:mrow><mml:mo>&#x000B4;</mml:mo></mml:mover></mml:math></inline-formula></td>
<td valign="top" align="center">0.151</td>
</tr>
<tr>
<td valign="top" align="left">al</td>
<td valign="top" align="center">&#x000D7;</td>
<td valign="top" align="center">0.137</td>
</tr>
<tr>
<td valign="top" align="left">le</td>
<td valign="top" align="center"><inline-formula><mml:math id="M114"><mml:mover accent="true"><mml:mrow><mml:mo>&#x000D7;</mml:mo></mml:mrow><mml:mo>&#x000B4;</mml:mo></mml:mover></mml:math></inline-formula></td>
<td valign="top" align="center">0.310</td>
</tr>
<tr>
<td valign="top" align="left">durch</td>
<td valign="top" align="center">&#x000D7;</td>
<td valign="top" align="center">0.427</td>
</tr>
<tr>
<td valign="top" align="left">got</td>
<td valign="top" align="center"><inline-formula><mml:math id="M115"><mml:mover accent="true"><mml:mrow><mml:mo>&#x000D7;</mml:mo></mml:mrow><mml:mo>&#x000B4;</mml:mo></mml:mover></mml:math></inline-formula></td>
<td valign="top" align="center">0.999</td>
</tr>
</tbody>
</table>
</table-wrap>
<p>While the model correctly predicts example 9 (see marginal probabilities in Table <xref ref-type="table" rid="T9">9</xref>), it has little confidence in the middle of the line. A two syllable anacrusis is not uncommon, though not frequent, and the two light, open syllables &#x0201C;de&#x0201D; as a stressed syllable and &#x0201C;ne&#x0201D; as a final stressed syllable further add to confusion. Although to give the model the benefit of the doubt, &#x0201C;salerne&#x0201D; is a proper noun.</p>
<table-wrap position="float" id="T9">
<label>Table 9</label>
<caption><p>Example (9), average probability 0.504.</p></caption>
<table frame="hsides" rules="groups">
<thead><tr>
<th valign="top" align="left"><bold>Syllable</bold></th>
<th valign="top" align="center"><bold>Value</bold></th>
<th valign="top" align="center"><bold>Marginal prob</bold>.</th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">ich</td>
<td valign="top" align="center">&#x000D7;</td>
<td valign="top" align="center">0.768</td>
</tr>
<tr>
<td valign="top" align="left">en</td>
<td valign="top" align="center">&#x000D7;</td>
<td valign="top" align="center">0.631</td>
</tr>
<tr>
<td valign="top" align="left">kun</td>
<td valign="top" align="center">&#x02014;</td>
<td valign="top" align="center">0.379</td>
</tr>
<tr>
<td valign="top" align="left">de</td>
<td valign="top" align="center"><inline-formula><mml:math id="M116"><mml:mover accent="true"><mml:mrow><mml:mo>&#x000D7;</mml:mo></mml:mrow><mml:mo>&#x00300;</mml:mo></mml:mover></mml:math></inline-formula></td>
<td valign="top" align="center">0.348</td>
</tr>
<tr>
<td valign="top" align="left">ze</td>
<td valign="top" align="center">&#x000D7;</td>
<td valign="top" align="center">0.263</td>
</tr>
<tr>
<td valign="top" align="left">sa</td>
<td valign="top" align="center"><inline-formula><mml:math id="M117"><mml:mover accent="true"><mml:mrow><mml:mo>&#x000D7;</mml:mo></mml:mrow><mml:mo>&#x000B4;</mml:mo></mml:mover></mml:math></inline-formula></td>
<td valign="top" align="center">0.473</td>
</tr>
<tr>
<td valign="top" align="left">ler</td>
<td valign="top" align="center">&#x000D7;</td>
<td valign="top" align="center">0.505</td>
</tr>
<tr>
<td valign="top" align="left">ne</td>
<td valign="top" align="center"><inline-formula><mml:math id="M118"><mml:mover accent="true"><mml:mrow><mml:mo>&#x000D7;</mml:mo></mml:mrow><mml:mo>&#x000B4;</mml:mo></mml:mover></mml:math></inline-formula></td>
<td valign="top" align="center">0.668</td>
</tr>
</tbody>
</table>
</table-wrap>
<p>The model also correctly predicts example 10 (see it&#x00027;s marginal probabilities in Table <xref ref-type="table" rid="T10">10</xref>), though again MHG prosody would not suggest &#x0201C;dem&#x0201D; or &#x0201C;ouch&#x0201D; as double morae. The duration of the line is typical and the marginal probabilities confirm this. It is particularly striking in this example that the model is very uncertain about the beginning of the line. While &#x0201C;dem&#x0201D; is clearly a rare double mora, in this position it would even be considered a rare stress, and would typically be scanned as part of the anacrusis. In contrast to the beginning of the line, the model has great confidence in the end of the line, where &#x0201C;ze&#x0201D; would commonly be unstressed (often even elided or in a divided lift), and the heavy syllables &#x0201C;niht&#x0201D; and &#x0201C;wol&#x0201D; are assigned the remaining stresses.</p>
<table-wrap position="float" id="T10">
<label>Table 10</label>
<caption><p>Example (10), average probability 0.505.</p></caption>
<table frame="hsides" rules="groups">
<thead><tr>
<th valign="top" align="left"><bold>Syllable</bold></th>
<th valign="top" align="center"><bold>Value</bold></th>
<th valign="top" align="center"><bold>Marginal prob</bold>.</th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">dem</td>
<td valign="top" align="center"><inline-formula><mml:math id="M119"><mml:mover accent="true"><mml:mrow><mml:mo>&#x000D7;</mml:mo></mml:mrow><mml:mo>&#x000B4;</mml:mo></mml:mover></mml:math></inline-formula></td>
<td valign="top" align="center">0.014</td>
</tr>
<tr>
<td valign="top" align="left">ist</td>
<td valign="top" align="center">&#x000D7;</td>
<td valign="top" align="center">0.014</td>
</tr>
<tr>
<td valign="top" align="left">ouch</td>
<td valign="top" align="center">&#x02014;</td>
<td valign="top" align="center">0.013</td>
</tr>
<tr>
<td valign="top" align="left">niht</td>
<td valign="top" align="center"><inline-formula><mml:math id="M120"><mml:mover accent="true"><mml:mrow><mml:mo>&#x000D7;</mml:mo></mml:mrow><mml:mo>&#x000B4;</mml:mo></mml:mover></mml:math></inline-formula></td>
<td valign="top" align="center">0.997</td>
</tr>
<tr>
<td valign="top" align="left">ze</td>
<td valign="top" align="center">&#x000D7;</td>
<td valign="top" align="center">0.997</td>
</tr>
<tr>
<td valign="top" align="left">wol</td>
<td valign="top" align="center"><inline-formula><mml:math id="M121"><mml:mover accent="true"><mml:mrow><mml:mo>&#x000D7;</mml:mo></mml:mrow><mml:mo>&#x000B4;</mml:mo></mml:mover></mml:math></inline-formula></td>
<td valign="top" align="center">0.997</td>
</tr>
</tbody>
</table>
</table-wrap>
<p>Example 11 shows another outlier in terms of line length (10 syllables, see it&#x00027;s marginal probabilities in Table <xref ref-type="table" rid="T11">11</xref>). Whether or not we accept &#x0201C;fremeden&#x0201D; as three syllables or two (&#x0201C;fremden&#x0201D; is attested in manuscript A) the line begins with a two syllable anacrusis (notably, only one word), and ends in a three syllable word, the first syllable of which is unstressed. Once again, the syllables about which the model is least certain are also those incorrectly scanned. Yet the model evidently believes a double mora for &#x0201C;t&#x000F4;t&#x0201D; and a divided lift are less likely than retaining alternation. The masculine bisyllabic cadence, particularly difficult to scan on first read, is correctly identified.</p>
<table-wrap position="float" id="T11">
<label>Table 11</label>
<caption><p>Example (11), average probability 0.516.</p></caption>
<table frame="hsides" rules="groups">
<thead><tr>
<th valign="top" align="left"><bold>Syllable</bold></th>
<th valign="top" align="center"><bold>Value</bold></th>
<th valign="top" align="center"><bold>Marginal prob</bold>.</th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">ei</td>
<td valign="top" align="center">&#x000D7;</td>
<td valign="top" align="center">0.791</td>
</tr>
<tr>
<td valign="top" align="left">nen</td>
<td valign="top" align="center">&#x000D7;</td>
<td valign="top" align="center">0.956</td>
</tr>
<tr>
<td valign="top" align="left">fre</td>
<td valign="top" align="center"><inline-formula><mml:math id="M122"><mml:mover accent="true"><mml:mrow><mml:mo>&#x000D7;</mml:mo></mml:mrow><mml:mo>&#x000B4;</mml:mo></mml:mover></mml:math></inline-formula></td>
<td valign="top" align="center">0.309</td>
</tr>
<tr>
<td valign="top" align="left">me</td>
<td valign="top" align="center">&#x000D7;</td>
<td valign="top" align="center">0.166</td>
</tr>
<tr>
<td valign="top" align="left">den</td>
<td valign="top" align="center"><inline-formula><mml:math id="M123"><mml:mover accent="true"><mml:mrow><mml:mo>&#x000D7;</mml:mo></mml:mrow><mml:mo>&#x00300;</mml:mo></mml:mover></mml:math></inline-formula></td>
<td valign="top" align="center">0.167</td>
</tr>
<tr>
<td valign="top" align="left">t&#x000F4;t</td>
<td valign="top" align="center">&#x000D7;</td>
<td valign="top" align="center">0.233</td>
</tr>
<tr>
<td valign="top" align="left">niht</td>
<td valign="top" align="center"><inline-formula><mml:math id="M124"><mml:mover accent="true"><mml:mrow><mml:mo>&#x000D7;</mml:mo></mml:mrow><mml:mo>&#x000B4;</mml:mo></mml:mover></mml:math></inline-formula></td>
<td valign="top" align="center">0.411</td>
</tr>
<tr>
<td valign="top" align="left">ver</td>
<td valign="top" align="center">&#x000D7;</td>
<td valign="top" align="center">0.420</td>
</tr>
<tr>
<td valign="top" align="left">tra</td>
<td valign="top" align="center"><inline-formula><mml:math id="M125"><mml:mover accent="true"><mml:mrow><mml:mo>&#x02323;</mml:mo></mml:mrow><mml:mo>&#x000B4;</mml:mo></mml:mover></mml:math></inline-formula></td>
<td valign="top" align="center">0.712</td>
</tr>
<tr>
<td valign="top" align="left">gen</td>
<td valign="top" align="center">&#x02323;</td>
<td valign="top" align="center">0.996</td>
</tr>
</tbody>
</table>
</table-wrap>
<p>These marginal probabilities additionally allow us to calculate the difficulty of scanning any given MHG <italic>Vierheber</italic> text as a whole (and even specific sections of any text). Although we are determining difficulty for the model, we have shown above that the model appears to approximate a human annotator. Thus, difficulty for the model may be reasonably inferred to represent difficulty for a human annotator. This can be computed by taking the average of each syllable&#x00027;s maximum marginal probability over the syllables in a line. In this sense, each syllable has a marginal probability for each possible metrical value<xref ref-type="fn" rid="fn0063"><sup>63</sup></xref>. The examples illustrate that the typical trochaic tetrameter causes problems for neither the model nor the human scanner, while unexpected double morae and longer anacrusis are cause to stop and think, particularly when syllables with relatively few phonemes, or monosyllabic words, are properly assigned double mora value. To sort the epic <italic>Vierheber</italic> texts in the Mittelhochdeutsche Begriffsdatenbank (MHDBDB)<xref ref-type="fn" rid="fn0064"><sup>64</sup></xref> corpus by difficulty of the meter, the median and mean marginal probabilities for all lines in each text are calculated (Table <xref ref-type="table" rid="T12">12</xref>). While Konrad von W&#x000FC;rzburg and the anonymous author of Reinfried von Braunschweig utilize the ringing cadence frequently, Ulrich von Liechtenstein does not, yet both do so consistently and in a predictable manner that distinguishes them from the rest of the texts. The major use of simple trochaic tetrameter, or double morae only in the penultimate foot, likely further pushed texts toward the top of the list (evidenced by the model&#x00027;s ease in predicting strictly trochaic verse). An odd mix of texts appear at the bottom of Table <xref ref-type="table" rid="T12">12</xref>. Both Ulrich von T&#x000FC;rlin&#x00027;s <italic>Willehalm</italic>, or <italic>Arabel</italic>, and Wolfram&#x00027;s <italic>Willehalm</italic> evidently employ more difficult metrical schemata, as does Der Stricker&#x00027;s <italic>Daniel von dem bl&#x000FC;henden Tal</italic>, perhaps a consequence of his unique <italic>Strickerkadenz</italic>. Particularly interesting is the difficulty of scanning <italic>Der Welsche Gast</italic>. Because Thomas&#x000EE;n was not writing in his native language, his native language being Italian, perhaps he more often confuses stress in MHG and thus creates difficulties for the model despite a very simple trochaic patterning. While this ranking is interesting for scholars and those teaching MHG meter, it cannot be fully validated as such a measure has not yet been considered in the scholarship. Nevertheless, assuming preference for trochaic tetrameter in easier meters this ranking is roughly accurate.</p>
<table-wrap position="float" id="T12">
<label>Table 12</label>
<caption><p>Model&#x00027;s ease of scanning <italic>Vierheber</italic> texts based on line marginal probabilities.</p></caption>
<table frame="hsides" rules="groups">
<thead><tr>
<th valign="top" align="left"><bold>Text</bold></th>
<th valign="top" align="center"><bold>Median</bold></th>
<th valign="top" align="center"><bold>Mean</bold></th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">Reinfried von Braunschweig</td>
<td valign="top" align="center">0.984907</td>
<td valign="top" align="center">0.952727</td>
</tr>
<tr>
<td valign="top" align="left">Der Schwanritter</td>
<td valign="top" align="center">0.984840</td>
<td valign="top" align="center">0.954346</td>
</tr>
<tr>
<td valign="top" align="left">Das Turnier von Nantes</td>
<td valign="top" align="center">0.984484</td>
<td valign="top" align="center">0.953066</td>
</tr>
<tr>
<td valign="top" align="left">Alexius</td>
<td valign="top" align="center">0.983046</td>
<td valign="top" align="center">0.953657</td>
</tr>
<tr>
<td valign="top" align="left">Herzmaere</td>
<td valign="top" align="center">0.982992</td>
<td valign="top" align="center">0.956888</td>
</tr>
<tr>
<td valign="top" align="left">Heinrich von Kempten</td>
<td valign="top" align="center">0.982073</td>
<td valign="top" align="center">0.948779</td>
</tr>
<tr>
<td valign="top" align="left">Pantaleon</td>
<td valign="top" align="center">0.981337</td>
<td valign="top" align="center">0.944830</td>
</tr>
<tr>
<td valign="top" align="left">Der Trojanische Krieg</td>
<td valign="top" align="center">0.981231</td>
<td valign="top" align="center">0.945008</td>
</tr>
<tr>
<td valign="top" align="left">Engelhard</td>
<td valign="top" align="center">0.980778</td>
<td valign="top" align="center">0.947011</td>
</tr>
<tr>
<td valign="top" align="left">Silvester</td>
<td valign="top" align="center">0.980702</td>
<td valign="top" align="center">0.948039</td>
</tr>
<tr>
<td valign="top" align="left">Der guote G&#x000EA;rhart</td>
<td valign="top" align="center">0.978524</td>
<td valign="top" align="center">0.939438</td>
</tr>
<tr>
<td valign="top" align="left">Frauendienst (Bechst.) (Epik, Bechstein)</td>
<td valign="top" align="center">0.977328</td>
<td valign="top" align="center">0.934517</td>
</tr>
<tr>
<td valign="top" align="left">Herzog Ernst (Hs.D, strophig)</td>
<td valign="top" align="center">0.976312</td>
<td valign="top" align="center">0.926170</td>
</tr>
<tr>
<td valign="top" align="left">Alexander (R. v. E.) (Rudolf von Ems)</td>
<td valign="top" align="center">0.974599</td>
<td valign="top" align="center">0.930398</td>
</tr>
<tr>
<td valign="top" align="left">Barlaam und Josaphat</td>
<td valign="top" align="center">0.969378</td>
<td valign="top" align="center">0.926035</td>
</tr>
<tr>
<td valign="top" align="left">Frauendienst (B&#x000FC;ech.) (B&#x000FC;echl&#x000EE;n, Bechstein)</td>
<td valign="top" align="center">0.966405</td>
<td valign="top" align="center">0.923810</td>
</tr>
<tr>
<td valign="top" align="left">Meleranz</td>
<td valign="top" align="center">0.965263</td>
<td valign="top" align="center">0.915054</td>
</tr>
<tr>
<td valign="top" align="left">Wigalois, der Ritter mit dem Rade</td>
<td valign="top" align="center">0.963911</td>
<td valign="top" align="center">0.919376</td>
</tr>
<tr>
<td valign="top" align="left">Gauriel von Muntabel</td>
<td valign="top" align="center">0.962624</td>
<td valign="top" align="center">0.911146</td>
</tr>
<tr>
<td valign="top" align="left">Biterolf und Dietleib</td>
<td valign="top" align="center">0.962019</td>
<td valign="top" align="center">0.917653</td>
</tr>
<tr>
<td valign="top" align="left">Helmbrecht</td>
<td valign="top" align="center">0.961616</td>
<td valign="top" align="center">0.917587</td>
</tr>
<tr>
<td valign="top" align="left">Tristan (H.v.F.)</td>
<td valign="top" align="center">0.960467</td>
<td valign="top" align="center">0.913434</td>
</tr>
<tr>
<td valign="top" align="left">Tandareis und Flordibel</td>
<td valign="top" align="center">0.958841</td>
<td valign="top" align="center">0.912529</td>
</tr>
<tr>
<td valign="top" align="left">Der arme Heinrich</td>
<td valign="top" align="center">0.956336</td>
<td valign="top" align="center">0.911926</td>
</tr>
<tr>
<td valign="top" align="left">Parzival</td>
<td valign="top" align="center">0.950174</td>
<td valign="top" align="center">0.911735</td>
</tr>
<tr>
<td valign="top" align="left">Dietrich und Wenezlan</td>
<td valign="top" align="center">0.948923</td>
<td valign="top" align="center">0.907889</td>
</tr>
<tr>
<td valign="top" align="left">Gregorius</td>
<td valign="top" align="center">0.948497</td>
<td valign="top" align="center">0.904120</td>
</tr>
<tr>
<td valign="top" align="left">Iwein</td>
<td valign="top" align="center">0.947784</td>
<td valign="top" align="center">0.902092</td>
</tr>
<tr>
<td valign="top" align="left">Lanzelet</td>
<td valign="top" align="center">0.947157</td>
<td valign="top" align="center">0.899856</td>
</tr>
<tr>
<td valign="top" align="left">Herzog Ernst (Hs. B)</td>
<td valign="top" align="center">0.946568</td>
<td valign="top" align="center">0.903171</td>
</tr>
<tr>
<td valign="top" align="left">Alexander (U.v.E) (Ulrich von Eschenbach)</td>
<td valign="top" align="center">0.945071</td>
<td valign="top" align="center">0.903506</td>
</tr>
<tr>
<td valign="top" align="left">Tristan (Ulrich v. T&#x000FC;rheim)</td>
<td valign="top" align="center">0.944975</td>
<td valign="top" align="center">0.899818</td>
</tr>
<tr>
<td valign="top" align="left">Walberan</td>
<td valign="top" align="center">0.943629</td>
<td valign="top" align="center">0.897919</td>
</tr>
<tr>
<td valign="top" align="left">Laurin</td>
<td valign="top" align="center">0.943434</td>
<td valign="top" align="center">0.900584</td>
</tr>
<tr>
<td valign="top" align="left">Dietrichs Flucht</td>
<td valign="top" align="center">0.942704</td>
<td valign="top" align="center">0.898055</td>
</tr>
<tr>
<td valign="top" align="left">Willehalm (Wolfram)</td>
<td valign="top" align="center">0.942339</td>
<td valign="top" align="center">0.904198</td>
</tr>
<tr>
<td valign="top" align="left">Flore und Blanscheflur</td>
<td valign="top" align="center">0.942235</td>
<td valign="top" align="center">0.899201</td>
</tr>
<tr>
<td valign="top" align="left">Eneide</td>
<td valign="top" align="center">0.936819</td>
<td valign="top" align="center">0.889650</td>
</tr>
<tr>
<td valign="top" align="left">Karl der Grosse</td>
<td valign="top" align="center">0.935828</td>
<td valign="top" align="center">0.898457</td>
</tr>
<tr>
<td valign="top" align="left">Der Welsche Gast</td>
<td valign="top" align="center">0.934193</td>
<td valign="top" align="center">0.898327</td>
</tr>
<tr>
<td valign="top" align="left">Der Schlegel</td>
<td valign="top" align="center">0.933589</td>
<td valign="top" align="center">0.899505</td>
</tr>
<tr>
<td valign="top" align="left">Alexander Anhang</td>
<td valign="top" align="center">0.932088</td>
<td valign="top" align="center">0.887358</td>
</tr>
<tr>
<td valign="top" align="left">Erec</td>
<td valign="top" align="center">0.931306</td>
<td valign="top" align="center">0.890927</td>
</tr>
<tr>
<td valign="top" align="left">Daniel von dem bl&#x000FC;henden Tal</td>
<td valign="top" align="center">0.922973</td>
<td valign="top" align="center">0.884164</td>
</tr>
<tr>
<td valign="top" align="left">Willehalm (U.v.T.)</td>
<td valign="top" align="center">0.918577</td>
<td valign="top" align="center">0.893880</td>
</tr>
<tr>
<td valign="top" align="left">Lambrechts Alexander (Strassburger Hs.)</td>
<td valign="top" align="center">0.894552</td>
<td valign="top" align="center">0.864145</td>
</tr>
</tbody>
</table>
</table-wrap>
</sec>
<sec id="s10">
<title>10. Double mora</title>
<p>Both the analysis above and the following analyses assume a high degree of reliability in the model to accurately scan poetry from different authors than those in the train and test sets. This certainly harbors potential bias. The training and testing data authors were chosen for their generality and the degree to which it is believed they were imitated by other authors in the corpus. While additional data from each author were not annotated, these authors all followed the same principles and framework as outlined in Heusler&#x00027;s theory. The features given to the model were decisive for all authors of MHG epic poetry. However, it is certainly possible other authors viewed word stress differently due to geographic or other differences. Future work should validate the model&#x00027;s performance on a variety of MHG epic poetry texts.</p>
<p>Perhaps the most interesting aspect of MHG verse is the <italic>beschwerte Hebung</italic>, or double mora. Double morae allow for a syllable to carry twice the metrical weight (and likely thus twice the duration) of a normal syllable. The use of double morae is often considered to be an important stylistic choice in indicating semantically, or contextually, important words in a verse: &#x0201C;only then did the monosyllabic foot become a &#x0201C;declamatory machinery&#x0201D;; it exhilaratingly disrupted the up and down pacing and increasingly yielded the natural stress of the language&#x0201D; (Heusler, <xref ref-type="bibr" rid="B20">1956</xref>, p. 118). Since a double mora occupies an entire foot, the following syllable is necessarily stressed, since it is the beginning of the next foot. Hence the disruption of the otherwise naturally occuring alternation. Heusler also notes that double morae were quite common in early MHG epics such as Heinrich von Veldeke&#x00027;s <italic>Eneide</italic>, and even had an &#x0201C;altert&#x000FC;mlich&#x0201D; (&#x0201C;antiquated&#x0201D;), effect in later works containing many double morae, such as Hartmann&#x00027;s <italic>Erec</italic> and <italic>Gregorius</italic> (Heusler, <xref ref-type="bibr" rid="B20">1956</xref>, p. 101).</p>
<p>The trend began to move away from this &#x0201C;Germanic&#x0201D; characteristic toward adopting a more strict trochaic style from the French tradition, seen in Rudolf von Ems&#x00027; <italic>Alexander</italic> and nearly eliminated by Ulrich von Liechtenstein and Konrad von W&#x000FC;rzburg, who aim for almost exclusively strict stress alternation (Heusler, <xref ref-type="bibr" rid="B20">1956</xref>, pp. 101, 118). Heusler understands Konrad as the endpoint, after whom German verse began to be written more freely once again. Table <xref ref-type="table" rid="T13">13</xref> confirms most of these observations. Of these texts, the five most common double morae are: &#x0201C;r&#x000EE;che&#x0201D; (&#x0201C;rich,&#x0201D; &#x0201C;powerful&#x0201D;), &#x0201C;waere&#x0201D; (&#x0201C;would be&#x0201D;), &#x0201C;maere&#x0201D; (&#x0201C;story&#x0201D;), &#x0201C;ere&#x0201D; (&#x0201C;honor&#x0201D;), &#x0201C;m&#x000EA;re&#x0201D; (&#x0201C;more&#x0201D;) (closely followed by &#x0201C;s&#x000EA;re&#x0201D; (&#x0201C;very&#x0201D;)). All double morae must be heavy phonologically, but it is interesting that all of the most frequently occurring double morae have <italic>front</italic> vowels, and all but r&#x000EE;che have an open syllable (the velar fricative &#x0201C;ch&#x0201D; is construed as ambisyllabic in MHG). Another phonological similarity among them is that each begins with a <italic>sonorant</italic> consonant (/m/, /n/, /w/, /j/, /l/, /r/)<xref ref-type="fn" rid="fn0065"><sup>65</sup></xref>, and all, except for &#x0201C;r&#x000EE;che,&#x0201D; end in &#x0201C;re.&#x0201D; Sonorant consonants are voiced consonants with continuous airflow faciliated by minimal obstruction in the vocal tract. This is in contrast with obstruent consonants, such as stops (e.g., /p,b/) or fricatives (e.g., /f,v/), in which a greater occlusion in the oral cavity occurs. Furthermore, sonorants are typically louder than obstruents. In preferring sonorant consonants in double mora syllables, MHG poets clearly aimed for the greatest resounding word to place in the double morae position, perhaps pointing to a greater significance of the vocal performance tradition in MHG epic verse than has previously been acknowledged. Since open syllables allow for an unobstructed flow of air from the mouth, they may be preferred for notes of extended length (or melismatic syllables), especially considering the relative dearth of open, heavy syllable words in MHG. Table <xref ref-type="table" rid="T14">14</xref> shows the most common double mora for each text. It is evident that double morae contribute heavily to the characterization of a given text, which can come as no surprise given that double morae would present themselves most prominently in memory. These are also concepts that are often studied for their respective text, such as &#x0201C;ere,&#x0201D; &#x0201C;maere,&#x0201D; and &#x0201C;r&#x000EE;che.&#x0201D;</p>
<table-wrap position="float" id="T13">
<label>Table 13</label>
<caption><p>Ratio of double morae syllables.</p></caption>
<table frame="hsides" rules="groups">
<thead><tr>
<th valign="top" align="left"><bold>Text</bold></th>
<th valign="top" align="center"><bold>% double morae</bold></th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">Lambrechts Alexander (Strassburger Hs.)</td>
<td valign="top" align="center">0.097617</td>
</tr>
<tr>
<td valign="top" align="left">Eneide</td>
<td valign="top" align="center">0.095105</td>
</tr>
<tr>
<td valign="top" align="left">Flore und Blanscheflur</td>
<td valign="top" align="center">0.088926</td>
</tr>
<tr>
<td valign="top" align="left">Erec</td>
<td valign="top" align="center">0.080958</td>
</tr>
<tr>
<td valign="top" align="left">Daniel von dem bl&#x000FC;henden Tal</td>
<td valign="top" align="center">0.079729</td>
</tr>
<tr>
<td valign="top" align="left">Herzog Ernst (Hs. B)</td>
<td valign="top" align="center">0.078354</td>
</tr>
<tr>
<td valign="top" align="left">Gregorius</td>
<td valign="top" align="center">0.077372</td>
</tr>
<tr>
<td valign="top" align="left">Lanzelet</td>
<td valign="top" align="center">0.077010</td>
</tr>
<tr>
<td valign="top" align="left">Helmbrecht</td>
<td valign="top" align="center">0.076015</td>
</tr>
<tr>
<td valign="top" align="left">Karl der Grosse</td>
<td valign="top" align="center">0.074808</td>
</tr>
<tr>
<td valign="top" align="left">Der arme Heinrich</td>
<td valign="top" align="center">0.074564</td>
</tr>
<tr>
<td valign="top" align="left">Alexander Anhang</td>
<td valign="top" align="center">0.072936</td>
</tr>
<tr>
<td valign="top" align="left">Dietrichs Flucht</td>
<td valign="top" align="center">0.071523</td>
</tr>
<tr>
<td valign="top" align="left">Iwein</td>
<td valign="top" align="center">0.070903</td>
</tr>
<tr>
<td valign="top" align="left">Reinfried von Braunschweig</td>
<td valign="top" align="center">0.069159</td>
</tr>
<tr>
<td valign="top" align="left">Gauriel von Muntabel</td>
<td valign="top" align="center">0.068819</td>
</tr>
<tr>
<td valign="top" align="left">Dietrich und Wenezlan</td>
<td valign="top" align="center">0.063602</td>
</tr>
<tr>
<td valign="top" align="left">Das Turnier von Nantes</td>
<td valign="top" align="center">0.063528</td>
</tr>
<tr>
<td valign="top" align="left">Der Schlegel</td>
<td valign="top" align="center">0.062627</td>
</tr>
<tr>
<td valign="top" align="left">Biterolf und Dietleib</td>
<td valign="top" align="center">0.060387</td>
</tr>
<tr>
<td valign="top" align="left">Tristan (Ulrich v. T&#x000FC;rheim)</td>
<td valign="top" align="center">0.060161</td>
</tr>
<tr>
<td valign="top" align="left">Laurin</td>
<td valign="top" align="center">0.058949</td>
</tr>
<tr>
<td valign="top" align="left">Alexander (U.v.E) (Ulrich von Eschenbach)</td>
<td valign="top" align="center">0.057748</td>
</tr>
<tr>
<td valign="top" align="left">Walberan</td>
<td valign="top" align="center">0.056834</td>
</tr>
<tr>
<td valign="top" align="left">Willehalm (Wolfram)</td>
<td valign="top" align="center">0.052707</td>
</tr>
<tr>
<td valign="top" align="left">Alexander (R. v. E.) (Rudolf von Ems)</td>
<td valign="top" align="center">0.051154</td>
</tr>
<tr>
<td valign="top" align="left">Wigalois, der Ritter mit dem Rade</td>
<td valign="top" align="center">0.050662</td>
</tr>
<tr>
<td valign="top" align="left">Der Schwanritter</td>
<td valign="top" align="center">0.049955</td>
</tr>
<tr>
<td valign="top" align="left">Meleranz</td>
<td valign="top" align="center">0.049557</td>
</tr>
<tr>
<td valign="top" align="left">Der Trojanische Krieg</td>
<td valign="top" align="center">0.048831</td>
</tr>
<tr>
<td valign="top" align="left">Engelhard</td>
<td valign="top" align="center">0.048730</td>
</tr>
<tr>
<td valign="top" align="left">Pantaleon</td>
<td valign="top" align="center">0.047476</td>
</tr>
<tr>
<td valign="top" align="left">Parzival</td>
<td valign="top" align="center">0.046408</td>
</tr>
<tr>
<td valign="top" align="left">Tandareis und Flordibel</td>
<td valign="top" align="center">0.045926</td>
</tr>
<tr>
<td valign="top" align="left">Tristan (H.v.F.)</td>
<td valign="top" align="center">0.045665</td>
</tr>
<tr>
<td valign="top" align="left">Silvester</td>
<td valign="top" align="center">0.045198</td>
</tr>
<tr>
<td valign="top" align="left">Barlaam und Josaphat</td>
<td valign="top" align="center">0.043626</td>
</tr>
<tr>
<td valign="top" align="left">Herzmaere</td>
<td valign="top" align="center">0.042582</td>
</tr>
<tr>
<td valign="top" align="left">Herzog Ernst (Hs.D, strophig)</td>
<td valign="top" align="center">0.041741</td>
</tr>
<tr>
<td valign="top" align="left">Willehalm (U.v.T.)</td>
<td valign="top" align="center">0.040853</td>
</tr>
<tr>
<td valign="top" align="left">Frauendienst (B&#x000FC;ech.) (B&#x000FC;echl&#x000EE;n, Bechstein)</td>
<td valign="top" align="center">0.040585</td>
</tr>
<tr>
<td valign="top" align="left">Alexius</td>
<td valign="top" align="center">0.040388</td>
</tr>
<tr>
<td valign="top" align="left">Der guote G&#x000EA;rhart</td>
<td valign="top" align="center">0.040166</td>
</tr>
<tr>
<td valign="top" align="left">Heinrich von Kempten</td>
<td valign="top" align="center">0.038583</td>
</tr>
<tr>
<td valign="top" align="left">Der Welsche Gast</td>
<td valign="top" align="center">0.037997</td>
</tr>
<tr>
<td valign="top" align="left">Frauendienst (Bechst.) (Epik, Bechstein)</td>
<td valign="top" align="center">0.006331</td>
</tr>
</tbody>
</table>
</table-wrap>
<table-wrap position="float" id="T14">
<label>Table 14</label>
<caption><p>Double morae word frequency.</p></caption>
<table frame="hsides" rules="groups">
<thead><tr>
<th valign="top" align="left"><bold>Text</bold></th>
<th valign="top" align="left"><bold>Double morae</bold></th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">Alexander (R. v. E.) (Rudolf von Ems)</td>
<td valign="top" align="left">r&#x000EE;che, pers&#x000EE;, maere, waere, w&#x000EE;gant</td>
</tr>
<tr>
<td valign="top" align="left">Alexander (U.v.E) (Ulrich von Eschenbach)</td>
<td valign="top" align="left">r&#x000EE;che, waere, maere, swaere, daz</td>
</tr>
<tr>
<td valign="top" align="left">Alexander Anhang</td>
<td valign="top" align="left">als&#x000F4;, daz, mit, stat, r&#x000EE;che</td>
</tr>
<tr>
<td valign="top" align="left">Alexius</td>
<td valign="top" align="left">euf&#x000EA;mi&#x000E2;n, ougen, reine, s&#x000EA;re, lougen</td>
</tr>
<tr>
<td valign="top" align="left">Barlaam und Josaphat</td>
<td valign="top" align="left">l&#x000EA;re, r&#x000EE;che, s&#x000EA;re, m&#x000EA;re, arbeit</td>
</tr>
<tr>
<td valign="top" align="left">Biterolf und Dietleib</td>
<td valign="top" align="left">maere, waere, w&#x000EE;gant, r&#x000EE;che, r&#x000EE;chen</td>
</tr>
<tr>
<td valign="top" align="left">Daniel von dem bl&#x000FC;henden Tal</td>
<td valign="top" align="left">waere, niht, daz, s&#x000F4;, alle</td>
</tr>
<tr>
<td valign="top" align="left">Das Turnier von Nantes</td>
<td valign="top" align="left">engellanden, reine, handen, guld&#x000EE;n, gesteine</td>
</tr>
<tr>
<td valign="top" align="left">Der Schlegel</td>
<td valign="top" align="left">alten, behalten, w&#x000E6;re, besunder, ende</td>
</tr>
<tr>
<td valign="top" align="left">Der Schwanritter</td>
<td valign="top" align="left">br&#x000E2;bant, hiute, swaere, beiden, maere</td>
</tr>
<tr>
<td valign="top" align="left">Der Trojanische Krieg</td>
<td valign="top" align="left">waere, r&#x000EE;che, stunden, werden, reine</td>
</tr>
<tr>
<td valign="top" align="left">Der Welsche Gast</td>
<td valign="top" align="left">m&#x000EA;re, solde, w&#x000E2;rheit, niht, sinne</td>
</tr>
<tr>
<td valign="top" align="left">Der arme Heinrich</td>
<td valign="top" align="left">heinrich, herre, w&#x000E6;re, arbeit, g&#x000FC;ete</td>
</tr>
<tr>
<td valign="top" align="left">Der guote G&#x000EA;rhart</td>
<td valign="top" align="left">r&#x000EE;che, g&#x000FC;ete, guote, waere, muote</td>
</tr>
<tr>
<td valign="top" align="left">Dietrich und Wenezlan</td>
<td valign="top" align="left">b&#x000F4;l&#x000E2;n, str&#x000EE;ten, r&#x000EE;ten, berne, z&#x000EE;ten</td>
</tr>
<tr>
<td valign="top" align="left">Dietrichs Flucht</td>
<td valign="top" align="left">maere, dietr&#x000EF;ch, bernaere, berne, gerne</td>
</tr>
<tr>
<td valign="top" align="left">Eneide</td>
<td valign="top" align="left">r&#x000EE;che, w&#x000E2;re, troi&#x000E2;n, m&#x000E2;re, turn&#x000FB;s</td>
</tr>
<tr>
<td valign="top" align="left">Engelhard</td>
<td valign="top" align="left">werden, maere, erden, waere, engelhart</td>
</tr>
<tr>
<td valign="top" align="left">Erec</td>
<td valign="top" align="left">waere, &#x000EA;rec, herre, m&#x000EA;re, &#x000EA;re</td>
</tr>
<tr>
<td valign="top" align="left">Flore und Blanscheflur</td>
<td valign="top" align="left">waere, s&#x000F4;, daz, m&#x000EA;re, swaere</td>
</tr>
<tr>
<td valign="top" align="left">Frauendienst (Bechst.) (Epik, Bechstein)</td>
<td valign="top" align="left">helm, heinr&#x000EE;ch, m&#x000EE;n, als&#x000F4;, s&#x000EE;n</td>
</tr>
<tr>
<td valign="top" align="left">Frauendienst (B&#x000FC;ech.) (B&#x000FC;echl&#x000EE;n, Bechstein)</td>
<td valign="top" align="left">&#x000EA;re, m&#x000EA;re, s&#x000EA;re, swaere, maere</td>
</tr>
<tr>
<td valign="top" align="left">Gauriel von Muntabel</td>
<td valign="top" align="left">waere, maere, walb&#x000E2;n, r&#x000EE;che, g&#x000E2;w&#x000E2;n</td>
</tr>
<tr>
<td valign="top" align="left">Gregorius</td>
<td valign="top" align="left">waere, swaere, guote, herre, maere</td>
</tr>
<tr>
<td valign="top" align="left">Heinrich von Kempten</td>
<td valign="top" align="left">heinrich, truhsaeze, kempten, hende, z&#x000EE;ten</td>
</tr>
<tr>
<td valign="top" align="left">Helmbrecht</td>
<td valign="top" align="left">helmbreht, gotelinde, maere, waere, muoter</td>
</tr>
<tr>
<td valign="top" align="left">Herzmaere</td>
<td valign="top" align="left">cleine, frouwen, sinne, beide, schouwen</td>
</tr>
<tr>
<td valign="top" align="left">Herzog Ernst (Hs. B)</td>
<td valign="top" align="left">r&#x000EE;che, lande, w&#x000EE;gant, maere, waere</td>
</tr>
<tr>
<td valign="top" align="left">Herzog Ernst (Hs.D, strophig)</td>
<td valign="top" align="left">daz, str&#x000EE;ten, maere, liute, swaere</td>
</tr>
<tr>
<td valign="top" align="left">Iwein</td>
<td valign="top" align="left">waere, &#x000EA;re, arbeit, &#x000EE;wein, m&#x000EA;re</td>
</tr>
<tr>
<td valign="top" align="left">Karl der Grosse</td>
<td valign="top" align="left">ruolant, heiden, &#x000EA;re, s&#x000EA;re, r&#x000EE;che</td>
</tr>
<tr>
<td valign="top" align="left">Lambrechts Alexander (Strassburger Hs.)</td>
<td valign="top" align="left">alexander, r&#x000EE;che, w&#x000E2;ren, d&#x000F4;, daz</td>
</tr>
<tr>
<td valign="top" align="left">Lanzelet</td>
<td valign="top" align="left">waere, maere, &#x000EA;re, w&#x000EE;gant, art&#x000FB;s</td>
</tr>
<tr>
<td valign="top" align="left">Laurin</td>
<td valign="top" align="left">laur&#x000EE;n, dietr&#x000EE;ch, w&#x000EE;gant, dietleip, berne</td>
</tr>
<tr>
<td valign="top" align="left">Meleranz</td>
<td valign="top" align="left">r&#x000EE;che, z&#x000EE;ten, w&#x000EE;gant, waere, maere</td>
</tr>
<tr>
<td valign="top" align="left">Pantaleon</td>
<td valign="top" align="left">werden, erden, ougen, heiden, worden</td>
</tr>
<tr>
<td valign="top" align="left">Parzival</td>
<td valign="top" align="left">g&#x000E2;w&#x000E2;n, r&#x000EE;che, maere, waere, minne</td>
</tr>
<tr>
<td valign="top" align="left">Reinfried von Braunschweig</td>
<td valign="top" align="left">sinne, minne, w&#x000E6;re, r&#x000EE;che, m&#x000E6;re</td>
</tr>
<tr>
<td valign="top" align="left">Silvester</td>
<td valign="top" align="left">werden, erden, reine, waere, haete</td>
</tr>
<tr>
<td valign="top" align="left">Tandareis und Flordibel</td>
<td valign="top" align="left">r&#x000EE;che, w&#x000EE;gant, maere, waere, &#x000EA;re</td>
</tr>
<tr>
<td valign="top" align="left">Tristan (H.v.F.)</td>
<td valign="top" align="left">minne, herzen, marke, sinne, k&#x000FC;neginne</td>
</tr>
<tr>
<td valign="top" align="left">Tristan (Ulrich v. T&#x000FC;rheim)</td>
<td valign="top" align="left">maere, waere, &#x000FD;s&#x000F4;t, minne, s&#x000F4;te</td>
</tr>
<tr>
<td valign="top" align="left">Walberan</td>
<td valign="top" align="left">laur&#x000EE;n, gerne, waere, berne, dietr&#x000EE;ch</td>
</tr>
<tr>
<td valign="top" align="left">Wigalois, der Ritter mit dem Rade</td>
<td valign="top" align="left">manheit, waere, kornt&#x000EE;n, r&#x000EE;che, maere</td>
</tr>
<tr>
<td valign="top" align="left">Willehalm (U.v.T.)</td>
<td valign="top" align="left">niht, mark&#x000EE;s, waere, daz, minne</td>
</tr>
<tr>
<td valign="top" align="left">Willehalm (Wolfram)</td>
<td valign="top" align="left">r&#x000EE;che, waere, mark&#x000EE;s, minne, heimr&#x000EE;ch</td>
</tr>
</tbody>
</table>
</table-wrap>
</sec>
<sec id="s11">
<title>11. Diversity in <italic>Versf&#x000FC;llung</italic></title>
<p>Heusler was particularly interested in the variety of ways a foot could be filled with metrical values. To measure Heusler&#x00027;s diversity of &#x0201C;Versf&#x000FC;llung&#x0201D; (filling of the verse) in its entirety, we adopt a popular measure of diversity originally developed in the context of information theory and widely used in environmental science, namely Shannon entropy (Shannon, <xref ref-type="bibr" rid="B36">1948-07</xref>). Shannon entropy fits this application well, considering that Shannon&#x00027;s original problem dealt with string prediction given a set of characters. The entropy measure quantifies the degree of certainty in predicting a random character from a string dataset, given a finite number of characters. Similarly, a useful measure of &#x0201C;Versf&#x000FC;llung&#x0201D; entails the degree of certainty in predicting a specific foot or line. To this end, we calculate the Shannon entropy for a complete foot (excluding anacrusis and the last foot) and for the entire line, sampling 1,000 feet with replacement from each text. The results are shown in Table <xref ref-type="table" rid="T15">15</xref>. The earlier, more &#x0201C;Germanic&#x0201D; texts display a wider diversity in metrical patterning, while Ulrich von Liechtenstein and Konrad von W&#x000FC;rzburg aim toward monotonous trochees. We also see all the works attributed to Hartmann von Aue in the top ten for diversity. Save <italic>Parzival</italic> and <italic>Der Welsche Gast</italic>, the top ten contains the works most often discussed by scholars.</p>
<table-wrap position="float" id="T15">
<label>Table 15</label>
<caption><p>Shannon entropy for 1,000 random line samples.</p></caption>
<table frame="hsides" rules="groups">
<thead><tr>
<th valign="top" align="left"><bold>Text</bold></th>
<th valign="top" align="center"><bold>Foot</bold></th>
<th valign="top" align="center"><bold>Line</bold></th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">Eneide</td>
<td valign="top" align="center">1.252917</td>
<td valign="top" align="center">3.763736</td>
</tr>
<tr>
<td valign="top" align="left">Lambrechts Alexander (Strassburger Hs.)</td>
<td valign="top" align="center">1.194705</td>
<td valign="top" align="center">3.980579</td>
</tr>
<tr>
<td valign="top" align="left">Iwein</td>
<td valign="top" align="center">1.167059</td>
<td valign="top" align="center">3.405163</td>
</tr>
<tr>
<td valign="top" align="left">Daniel von dem bl&#x000FC;henden Tal</td>
<td valign="top" align="center">1.140783</td>
<td valign="top" align="center">3.498383</td>
</tr>
<tr>
<td valign="top" align="left">Helmbrecht</td>
<td valign="top" align="center">1.099641</td>
<td valign="top" align="center">3.039134</td>
</tr>
<tr>
<td valign="top" align="left">Der arme Heinrich</td>
<td valign="top" align="center">1.094388</td>
<td valign="top" align="center">3.217970</td>
</tr>
<tr>
<td valign="top" align="left">Laurin</td>
<td valign="top" align="center">1.030382</td>
<td valign="top" align="center">3.407795</td>
</tr>
<tr>
<td valign="top" align="left">Erec</td>
<td valign="top" align="center">1.005811</td>
<td valign="top" align="center">3.294478</td>
</tr>
<tr>
<td valign="top" align="left">Gregorius</td>
<td valign="top" align="center">0.980259</td>
<td valign="top" align="center">3.133976</td>
</tr>
<tr>
<td valign="top" align="left">Willehalm (Wolfram)</td>
<td valign="top" align="center">0.979950</td>
<td valign="top" align="center">3.159355</td>
</tr>
<tr>
<td valign="top" align="left">Tristan (Ulrich v. T&#x000FC;rheim)</td>
<td valign="top" align="center">0.971779</td>
<td valign="top" align="center">3.185109</td>
</tr>
<tr>
<td valign="top" align="left">Alexander Anhang</td>
<td valign="top" align="center">0.969258</td>
<td valign="top" align="center">3.248891</td>
</tr>
<tr>
<td valign="top" align="left">Karl der Grosse</td>
<td valign="top" align="center">0.968051</td>
<td valign="top" align="center">2.983325</td>
</tr>
<tr>
<td valign="top" align="left">Der Schlegel</td>
<td valign="top" align="center">0.934412</td>
<td valign="top" align="center">3.277041</td>
</tr>
<tr>
<td valign="top" align="left">Meleranz</td>
<td valign="top" align="center">0.922810</td>
<td valign="top" align="center">2.891814</td>
</tr>
<tr>
<td valign="top" align="left">Barlaam und Josaphat</td>
<td valign="top" align="center">0.917566</td>
<td valign="top" align="center">2.968009</td>
</tr>
<tr>
<td valign="top" align="left">Flore und Blanscheflur</td>
<td valign="top" align="center">0.917468</td>
<td valign="top" align="center">3.115846</td>
</tr>
<tr>
<td valign="top" align="left">Herzog Ernst (Hs. B)</td>
<td valign="top" align="center">0.914392</td>
<td valign="top" align="center">3.191947</td>
</tr>
<tr>
<td valign="top" align="left">Gauriel von Muntabel</td>
<td valign="top" align="center">0.906261</td>
<td valign="top" align="center">3.041430</td>
</tr>
<tr>
<td valign="top" align="left">Tristan (H.v.F.)</td>
<td valign="top" align="center">0.903151</td>
<td valign="top" align="center">3.103300</td>
</tr>
<tr>
<td valign="top" align="left">Dietrichs Flucht</td>
<td valign="top" align="center">0.894119</td>
<td valign="top" align="center">3.041568</td>
</tr>
<tr>
<td valign="top" align="left">Walberan</td>
<td valign="top" align="center">0.884103</td>
<td valign="top" align="center">3.246322</td>
</tr>
<tr>
<td valign="top" align="left">Willehalm (U.v.T.)</td>
<td valign="top" align="center">0.881089</td>
<td valign="top" align="center">3.078347</td>
</tr>
<tr>
<td valign="top" align="left">Heinrich von Kempten</td>
<td valign="top" align="center">0.875890</td>
<td valign="top" align="center">2.665526</td>
</tr>
<tr>
<td valign="top" align="left">Parzival</td>
<td valign="top" align="center">0.868807</td>
<td valign="top" align="center">3.217873</td>
</tr>
<tr>
<td valign="top" align="left">Alexander (U.v.E) (Ulrich von Eschenbach)</td>
<td valign="top" align="center">0.867947</td>
<td valign="top" align="center">2.963053</td>
</tr>
<tr>
<td valign="top" align="left">Tandareis und Flordibel</td>
<td valign="top" align="center">0.867046</td>
<td valign="top" align="center">2.642869</td>
</tr>
<tr>
<td valign="top" align="left">Biterolf und Dietleib</td>
<td valign="top" align="center">0.854046</td>
<td valign="top" align="center">2.824735</td>
</tr>
<tr>
<td valign="top" align="left">Dietrich und Wenezlan</td>
<td valign="top" align="center">0.852161</td>
<td valign="top" align="center">2.974738</td>
</tr>
<tr>
<td valign="top" align="left">Pantaleon</td>
<td valign="top" align="center">0.850183</td>
<td valign="top" align="center">2.725092</td>
</tr>
<tr>
<td valign="top" align="left">Lanzelet</td>
<td valign="top" align="center">0.848197</td>
<td valign="top" align="center">3.022754</td>
</tr>
<tr>
<td valign="top" align="left">Alexius</td>
<td valign="top" align="center">0.845937</td>
<td valign="top" align="center">2.837503</td>
</tr>
<tr>
<td valign="top" align="left">Das Turnier von Nantes</td>
<td valign="top" align="center">0.809099</td>
<td valign="top" align="center">2.304515</td>
</tr>
<tr>
<td valign="top" align="left">Der Trojanische Krieg</td>
<td valign="top" align="center">0.803099</td>
<td valign="top" align="center">1.792531</td>
</tr>
<tr>
<td valign="top" align="left">Engelhard</td>
<td valign="top" align="center">0.800056</td>
<td valign="top" align="center">1.944227</td>
</tr>
<tr>
<td valign="top" align="left">Herzmaere</td>
<td valign="top" align="center">0.770970</td>
<td valign="top" align="center">2.488530</td>
</tr>
<tr>
<td valign="top" align="left">Alexander (R. v. E.) (Rudolf von Ems)</td>
<td valign="top" align="center">0.768860</td>
<td valign="top" align="center">2.413441</td>
</tr>
<tr>
<td valign="top" align="left">Der Schwanritter</td>
<td valign="top" align="center">0.761848</td>
<td valign="top" align="center">2.485584</td>
</tr>
<tr>
<td valign="top" align="left">Der Welsche Gast</td>
<td valign="top" align="center">0.710632</td>
<td valign="top" align="center">2.645962</td>
</tr>
<tr>
<td valign="top" align="left">Silvester</td>
<td valign="top" align="center">0.703183</td>
<td valign="top" align="center">2.412775</td>
</tr>
<tr>
<td valign="top" align="left">Frauendienst (B&#x000FC;ech.) (B&#x000FC;echl&#x000EE;n, Bechstein)</td>
<td valign="top" align="center">0.690972</td>
<td valign="top" align="center">2.655543</td>
</tr>
<tr>
<td valign="top" align="left">Herzog Ernst (Hs.D, strophig)</td>
<td valign="top" align="center">0.666231</td>
<td valign="top" align="center">2.460030</td>
</tr>
<tr>
<td valign="top" align="left">Der guote G&#x000EA;rhart</td>
<td valign="top" align="center">0.624613</td>
<td valign="top" align="center">2.388511</td>
</tr>
<tr>
<td valign="top" align="left">Wigalois, der Ritter mit dem Rade</td>
<td valign="top" align="center">0.622915</td>
<td valign="top" align="center">2.714158</td>
</tr>
<tr>
<td valign="top" align="left">Reinfried von Braunschweig</td>
<td valign="top" align="center">0.621006</td>
<td valign="top" align="center">1.908564</td>
</tr>
<tr>
<td valign="top" align="left">Frauendienst (Bechst.) (Epik, Bechstein)</td>
<td valign="top" align="center">0.303572</td>
<td valign="top" align="center">1.881531</td>
</tr>
</tbody>
</table>
</table-wrap>
</sec>
<sec sec-type="conclusions" id="s12">
<title>12. Conclusion</title>
<p>This paper has presented a new approach to a very old problem for medieval German scholarship. Investigating the meter of this tradition poses unique challenges to literary scholars, philologists, and computational linguists alike. By constructing a supervised model of the meter, this paper demonstrates the benefits of a quantitative corpus-wide analysis enabling us to characterize its idiosyncrasies and suggest improvements to the current pedagogical approach. Moreover, this approach has proven generalizable to other traditions, having been taken up by scholars working on other languages with the results presented here as baseline<xref ref-type="fn" rid="fn0066"><sup>66</sup></xref>. A promising extension of this work would be a comparative analysis, particularly in the medieval context, as it is well-known that these traditions were influenced by their contemporaries.</p>
</sec>
<sec id="s13">
<title>Author contributions</title>
<p>All authors listed have made a substantial, direct and intellectual contribution to the work, and approved it for publication.</p>
<sec>
<title>Conflict of interest statement</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
</sec>
</body>
<back>
<ack><p>We would like to thank Digital Humanities at Berkeley for its ongoing support of this project as well as the Mittelhochdeutsche Begriffsdatenbank (MHDBDB) for its help in building the corpus. We would also like to thank David Bamman for his guidance.</p>
</ack>
<ref-list>
<title>References</title>
<ref id="B1">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Agirrezabal</surname> <given-names>M.</given-names></name> <name><surname>Alegria</surname> <given-names>I.</given-names></name> <name><surname>Hulden</surname> <given-names>M.</given-names></name></person-group> (<year>2016</year>). <article-title>Machine learning for metrical analysis of english poetry</article-title>, in <source>Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers</source> (<publisher-loc>Osaka</publisher-loc>), <fpage>772</fpage>&#x02013;<lpage>781</lpage>.</citation></ref>
<ref id="B2">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Agirrezabal</surname> <given-names>M.</given-names></name> <name><surname>Arrieta</surname> <given-names>B.</given-names></name> <name><surname>Astigarraga</surname> <given-names>A.</given-names></name> <name><surname>Hulden</surname> <given-names>M.</given-names></name></person-group> (<year>2013</year>). <article-title>ZeuScansion: a tool for scansion of English poetry</article-title>, in <source>Finite State Methods and Natural Language Processing</source> (<publisher-loc>St Andrews</publisher-loc>), <fpage>18</fpage>.</citation></ref>
<ref id="B3">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>B&#x000F6;gl</surname> <given-names>H.</given-names></name></person-group> (<year>2006</year>). <source>Abriss der Mittelhochdeutschen Metrik: Mit Einem &#x000FC;bungsteil</source>. <publisher-loc>Hildesheim</publisher-loc>: <publisher-name>Georg Olms Verlag</publisher-name>.</citation></ref>
<ref id="B4">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Bird</surname> <given-names>S.</given-names></name> <name><surname>Klein</surname> <given-names>E.</given-names></name> <name><surname>Loper</surname> <given-names>E.</given-names></name></person-group> (<year>2009</year>). <source>Natural Language Processing With Python: Analyzing Text With the Natural Language Toolkit</source>. <publisher-name>O&#x00027;Reilly Media, Inc</publisher-name>.</citation></ref>
<ref id="B5">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Braune</surname> <given-names>W.</given-names></name> <name><surname>Ebbinghaus</surname> <given-names>E. A.</given-names></name></person-group> (<year>1994</year>). <source>Althochdeutsches Lesebuch</source>. <publisher-loc>T&#x000FC;bingen</publisher-loc>: <publisher-name>Niemeyer</publisher-name>.</citation></ref>
<ref id="B6">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Brill</surname> <given-names>E.</given-names></name></person-group> (<year>1995</year>). <article-title>Transformation-based error-driven learning and natural language processing: a case study in part-of-speech tagging</article-title>. <source>Comput. Linguist.</source> <volume>21</volume>, <fpage>543</fpage>&#x02013;<lpage>565</lpage>.</citation></ref>
<ref id="B7">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Cramer</surname> <given-names>T.</given-names></name></person-group> (<year>1998</year>). <source>Waz Hilfet &#x000C2;ne Sinne Kunst?: Lyrik im 13. Jahrhundert: Studien zu Ihrer &#x000C4;sthetik. Vol. 148</source>. <publisher-name>Erich Schmidt Verlag GmbH &#x00026; Co KG</publisher-name>.</citation></ref>
<ref id="B8">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Dimpel</surname> <given-names>F. M.</given-names></name></person-group> (<year>2004a</year>). <source>Computergest&#x000FC;tzte Textstatistische Untersuchungen an Mittelhochdeutschen Texten-Bd. II</source>. Daten und Programme.</citation></ref>
<ref id="B9">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Dimpel</surname> <given-names>F.</given-names></name></person-group> (<year>2004b</year>). <article-title>Textstatistische analysen an mittelhochdeutschen texten</article-title>. <source>Jahrbuch Computerphilol.</source> <volume>6</volume>, <fpage>95</fpage>&#x02013;<lpage>118</lpage>.</citation></ref>
<ref id="B10">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Dimpel</surname> <given-names>F.</given-names></name></person-group> (<year>2015</year>). <article-title>Automatische mittelhochdeutsche metrik 2.0</article-title>. <source>Phil. Netz</source> <volume>73</volume>, <fpage>1</fpage>&#x02013;<lpage>26</lpage>.</citation></ref>
<ref id="B11">
<citation citation-type="web"><person-group person-group-type="author"><name><surname>Domanowski</surname> <given-names>A.</given-names></name> <name><surname>Rauert</surname> <given-names>Y.</given-names></name> <name><surname>R&#x000FC;ther</surname> <given-names>H.</given-names></name> <name><surname>Tomasek</surname> <given-names>T.</given-names></name></person-group> (<year>2009</year>). <source>Mittelhochdeutsche Metrik Online</source>. Available online at: <ext-link ext-link-type="uri" xlink:href="https://www.uni-muenster.de/MhdMetrikOnline/">https://www.uni-muenster.de/MhdMetrikOnline/</ext-link> (Accessed 04 02, 2016).</citation></ref>
<ref id="B12">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Estes</surname> <given-names>A.</given-names></name> <name><surname>Hench</surname> <given-names>C.</given-names></name></person-group> (<year>2016</year>). <article-title>Supervised machine learning for hybrid meter</article-title>, in <source>Proceedings of the Fifth Workshop on Computational Linguistics for Literature</source> (<publisher-loc>San Diego, CA</publisher-loc>), <fpage>1</fpage>&#x02013;<lpage>8</lpage>.</citation></ref>
<ref id="B13">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Fox</surname> <given-names>A.</given-names></name></person-group> (<year>2000</year>). <source>Prosodic Features and Prosodic Structure: The Phonology of Suprasegmentals</source>. <publisher-loc>New York, NY</publisher-loc>: <publisher-name>Oxford University Press</publisher-name>.</citation></ref>
<ref id="B14">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Giegerich</surname> <given-names>H. J.</given-names></name></person-group> (<year>1985</year>). <source>Metrical Phonology and Phonological Structure: German and English</source>. <publisher-loc>Cambridge</publisher-loc>: <publisher-name>Cambridge University Press</publisher-name>, <fpage>1</fpage>-<lpage>301</lpage></citation></ref>
<ref id="B15">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Greene</surname> <given-names>E.</given-names></name> <name><surname>Bodrumlu</surname> <given-names>T.</given-names></name> <name><surname>Knight</surname> <given-names>K.</given-names></name></person-group> (<year>2010</year>). <article-title>Automatic analysis of rhythmic poetry with applications to generation and translation</article-title>, in <source>Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing</source>. <publisher-name>Association for Computational Linguistics</publisher-name> (<publisher-loc>Cambridge, MA</publisher-loc>), <fpage>524</fpage>&#x02013;<lpage>533</lpage>.</citation></ref>
<ref id="B16">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Hartman</surname> <given-names>C. O.</given-names></name></person-group> (<year>1996</year>). <source>Virtual Muse: Experiments in Computer Poetry</source>. <publisher-loc>Hanover, NH</publisher-loc>: <publisher-name>Wesleyan University Press</publisher-name>.</citation></ref>
<ref id="B17">
<citation citation-type="web"><person-group person-group-type="author"><name><surname>Hartmann</surname> <given-names>v. A.</given-names></name> <name><surname>Mertens</surname> <given-names>v. V.</given-names></name></person-group> (<year>2005</year>). <source>Der arme Heinrich. Bibliothek des Mittelalters</source>. <publisher-loc>Cambridge, UK: Ann Arbor, MI</publisher-loc>: <publisher-name>Chadwyck-Healey; ProQuest Information and Learning</publisher-name>. Available online at: <ext-link ext-link-type="uri" xlink:href="http://uclibs.org/PID/108047">http://uclibs.org/PID/108047</ext-link></citation></ref>
<ref id="B18">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hayes</surname> <given-names>B.</given-names></name></person-group> (<year>1989</year>). <article-title>Compensatory lengthening in moraic phonology</article-title>. <source>Linguist. Inq.</source> <volume>20</volume>, <fpage>253</fpage>&#x02013;<lpage>306</lpage>.</citation></ref>
<ref id="B19">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Hench</surname> <given-names>C.</given-names></name></person-group> (<year>2017</year>). <article-title>Phonological soundscapes in medieval poetry</article-title>, in <source>Proceedings of the Joint SIGHUM Workshop on Computational Linguistics for Cultural Heritage, Social Sciences, Humanities and Literature</source>, (<publisher-loc>Berkeley, CA</publisher-loc>), <fpage>46</fpage>&#x02013;<lpage>56</lpage>.</citation></ref>
<ref id="B20">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Heusler</surname> <given-names>A.</given-names></name></person-group> (<year>1956</year>). <source>Deutsche Versgeschichte: Mit Einschluss Des Altenglischen Und Altnordischen Stabreimverses. Grundriss Der Germanischen Philologie 8</source>. <publisher-loc>Berlin</publisher-loc>: <publisher-name>W. De Gruyter</publisher-name>.</citation></ref>
<ref id="B21">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Karg-Gasterst&#x000E4;dt</surname> <given-names>E.</given-names></name></person-group> (<year>1925</year>). <source>Zur Entstehungsgeschichte des Parzival Vol. 2</source>. <publisher-name>M. Niemeyer</publisher-name>.</citation></ref>
<ref id="B22">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kohrs</surname> <given-names>K. H.</given-names></name></person-group> (<year>1969</year>). <article-title>Zum verh&#x000E4;ltnis von sprache und musik in den liedern neidharts von reuental</article-title>. <source>Deutsche Vierteljahrsschrift Literaturwissenschaft Geistesgeschichte</source> <volume>43</volume>:<fpage>604</fpage>.</citation></ref>
<ref id="B23">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kuhn</surname> <given-names>H.</given-names></name></person-group> (<year>1969</year>). <source>Text Und Theorie. His Kleine Schriften, Bd. 2</source>. <publisher-loc>Metzler</publisher-loc>: <publisher-name>Stuttgart</publisher-name>.</citation></ref>
<ref id="B24">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Lafferty</surname> <given-names>J.</given-names></name> <name><surname>McCallum</surname> <given-names>A.</given-names></name> <name><surname>Pereira</surname> <given-names>F. C. N.</given-names></name></person-group> (<year>2001</year>). <article-title>Conditional random fields: probabilistic models for segmenting and labeling sequence data</article-title>, in <source>ICML &#x00027;01 Proceedings of the Eighteenth International Conference on Machine Learning</source>, (<publisher-name>Morgan Kaufmann Publishers Inc</publisher-name>. <publisher-loc>San Francisco, CA</publisher-loc>).</citation></ref>
<ref id="B25">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Longfellow</surname> <given-names>H. W.</given-names></name></person-group> (<year>1932</year>). <source>Poems, Including Evangeline, The Song of Hiawatha, The Courtship of Miles Standish, Tales of a Wayside Inn</source>. No. 56. Modern library.</citation></ref>
<ref id="B26">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Mathisen</surname> <given-names>R. W.</given-names></name></person-group> (<year>2003</year>). <source>People, Personal Expression, and Social Relations in Late Antiquity</source>. <publisher-loc>Ann Arbor, MI</publisher-loc>: <publisher-name>University of Michigan Press</publisher-name>.</citation></ref>
<ref id="B27">
<citation citation-type="thesis"><person-group person-group-type="author"><name><surname>McAleese</surname> <given-names>G.</given-names></name></person-group> (<year>2007</year>). <source>Improving Scansion With Syntax: An Investigation Into the Effectiveness of a Syntactic Analysis of Poetry by Computer Using Phonological Scansion Theory</source>. PhD diss., Ph. D. thesis, <publisher-name>Open University</publisher-name>.</citation></ref>
<ref id="B28">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Mertens</surname> <given-names>V.</given-names></name></person-group> (<year>2005</year>). <article-title>Was ist Rhythmus in Minnesang?</article-title> in <source>Aus dem Takt: Rhythmus in Kunst, Kultur und Natur</source>, (<publisher-loc>Bielefeld</publisher-loc>: <publisher-name>Transcript</publisher-name>), <fpage>175</fpage>&#x02013;<lpage>198</lpage>.</citation></ref>
<ref id="B29">
<citation citation-type="thesis"><person-group person-group-type="author"><name><surname>Mittmann</surname> <given-names>A.</given-names></name></person-group> (<year>2016</year>). <source>Escans&#x000E3;o Autom&#x000E1;tica de Versos em Portugu&#x000EA;s</source>. Ph.D. thesis, <publisher-name>Universidade Federal de Santa Catarina</publisher-name>.</citation></ref>
<ref id="B30">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>M&#x000E4;rz</surname> <given-names>C.</given-names></name></person-group> (<year>1999</year>). <article-title>Metrik, eine wissenschaft zwischen z&#x000E4;hlen und schw&#x000E4;rmen?</article-title>, in <source>Mittelalter: Neue Wege Durch Einen Alten Kontinent</source>, eds <person-group person-group-type="editor"><name><surname>M&#x000FC;ller</surname> <given-names>J.-D.</given-names></name> <name><surname>Wenzel</surname> <given-names>H.</given-names></name></person-group> (<publisher-loc>Hirzel</publisher-loc>: <publisher-name>S. Hirzel Verlag</publisher-name>), <fpage>317</fpage>&#x02013;<lpage>332</lpage>.</citation></ref>
<ref id="B31">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Navarro</surname> <given-names>B.</given-names></name></person-group> (<year>2015</year>). <article-title>A computational linguistic approach to Spanish Golden Age Sonnets: metrical and semantic aspects</article-title>, in <source>Proceedings of the Fourth Workshop on Computational Linguistics for Literature</source>, (<publisher-loc>Alicante</publisher-loc>), <fpage>105</fpage>&#x02013;<lpage>113</lpage>.</citation></ref>
<ref id="B32">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Navarro-Colorado</surname> <given-names>B.</given-names></name></person-group> (<year>2017</year>). <article-title>A metrical scansion system for fixed-metre Spanish poetry</article-title>. <source>Digit. Scholar. Human</source>. <volume>33</volume>, <fpage>112</fpage>&#x02013;<lpage>127</lpage>.</citation></ref>
<ref id="B33">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Norberg</surname> <given-names>D.</given-names></name></person-group> (<year>2004</year>). <source>An Introduction to the Study of Medieval Latin Versification</source>. CUA Press.</citation></ref>
<ref id="B34">
<citation citation-type="web"><person-group person-group-type="author"><name><surname>Okazaki</surname> <given-names>N.</given-names></name></person-group> (<year>2007</year>). <source>CRFsuite: A Fast Implementation of Conditional Random Fields (CRFs)</source>. Available online at: <ext-link ext-link-type="uri" xlink:href="http://www.chokkan.org/software/crfsuite/">http://www.chokkan.org/software/crfsuite/</ext-link></citation></ref>
<ref id="B35">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Plamondon</surname> <given-names>M. R.</given-names></name></person-group> (<year>2006</year>). <article-title>Virtual verse analysis: analysing patterns in poetry</article-title>. <source>Literary Linguist. Comput.</source> <volume>21</volume>, <fpage>127</fpage>&#x02013;<lpage>141</lpage>. <pub-id pub-id-type="doi">10.1093/llc/fql011</pub-id></citation></ref>
<ref id="B36">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Shannon</surname> <given-names>C. E.</given-names></name></person-group> (<year>1948-07</year>). <article-title>A mathematical theory of communication</article-title>. <source>Bell Syst. Tech. J.</source> <volume>27</volume>, <fpage>379</fpage>&#x02013;<lpage>423</lpage>. <pub-id pub-id-type="doi">10.1002/j.1538-7305.1948.tb01338.x</pub-id></citation></ref>
<ref id="B37">
<citation citation-type="web"><person-group person-group-type="author"><name><surname>Springeth</surname> <given-names>M.</given-names></name> <name><surname>Morocutti</surname> <given-names>N.</given-names></name> <name><surname>Schlager</surname> <given-names>D.</given-names></name></person-group> (<year>1992-2017</year>). <italic>Mittelhochdeutsche Begriffsyearnbank (mhdbdb)</italic>. Universit&#x000E4;t salzburg. Available online at: <ext-link ext-link-type="uri" xlink:href="http://www.mhdbdb.sbg.ac.at/">http://www.mhdbdb.sbg.ac.at/</ext-link> (Accessed 10, 01, 2016).</citation></ref>
<ref id="B38">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Tervooren</surname> <given-names>H.</given-names></name></person-group> (<year>1979</year>). <source>Minimalmetrik: zur Arbeit mit Mittelhochdeutschen Texten Vol. 285</source>. K&#x000FC;mmerle.</citation></ref>
</ref-list>
<fn-group>
<fn id="fn0001"><p><sup>1</sup>This article has adapted much of the authors&#x00027; previous work in &#x0201C;Supervised Machine Learning for Hybrid Meter&#x0201D; (Estes and Hench, <xref ref-type="bibr" rid="B12">2016</xref>). Shortly after, Agirrezabal et al. undertook a similar project using the benchmark results set by Hench and Estes (Agirrezabal et al., <xref ref-type="bibr" rid="B1">2016</xref>). It has also been cited by work adapting a scansion model to Spanish and Portuguese (Mittmann, <xref ref-type="bibr" rid="B29">2016</xref>; Navarro, <xref ref-type="bibr" rid="B32">2017</xref>).</p></fn>
<fn id="fn0002"><p><sup>2</sup>Christoph M&#x000E4;rz criticizes recent scholarship as being too linguistic in nature, and forgetting the aesthetic effect meter produces (M&#x000E4;rz, <xref ref-type="bibr" rid="B30">1999</xref>, p. 323).</p></fn>
<fn id="fn0003"><p><sup>3</sup>Admittedly, idiosyncrasies in a specific text will, for this reason, be very difficult, if not impossible, to discern if edited texts are used for analysis.</p></fn>
<fn id="fn0004"><p><sup>4</sup>Augustine writes toward the end of the fourth century that while he recognizes time intervals, he can no longer distinguish between long and short syllables: <italic>syllabarum longarum et brevium cognicionem me non habere&#x02026;</italic> &#x0201C;I cannot recognize long and short syllables&#x02026;&#x0201D; cf. Augustinus, <italic>De musica</italic>, III, 3, 5.</p></fn>
<fn id="fn0005"><p><sup>5</sup>&#x0201C;Master singers&#x0201D; of the following generation.</p></fn>
<fn id="fn0006"><p><sup>6</sup>&#x02014; represents a long syllable and &#x02323; a short syllable.</p></fn>
<fn id="fn0007"><p><sup>7</sup>&#x0201C;I sing of arms and of a man, he was the first [to journey] from the coasts of Troy&#x02026;&#x0201D;</p></fn>
<fn id="fn0008"><p><sup>8</sup>Two feet per line of an unstressed syllable followed by a stressed syllable.</p></fn>
<fn id="fn0009"><p><sup>9</sup>See Norberg and Ziolkowski (<xref ref-type="bibr" rid="B33">2004</xref>, p. 101) and Mathisen (<xref ref-type="bibr" rid="B26">2003</xref>, p. 34).</p></fn>
<fn id="fn0010"><p><sup>10</sup>&#x0201C;The highest Count Abrogast waiting for Auspicius, whom I love and say many greetings.&#x0201D; Text from Norberg and Ziolkowski (<xref ref-type="bibr" rid="B33">2004</xref>, p. 101).</p></fn>
<fn id="fn0011"><p><sup>11</sup>Half of a verse.</p></fn>
<fn id="fn0012"><p><sup>12</sup>Stress on the penultimate syllable.</p></fn>
<fn id="fn0013"><p><sup>13</sup>Text from Braune and Ebbinghaus (<xref ref-type="bibr" rid="B5">1994</xref>) &#x0201C;his day comes, on which he will die. If the soul then quickly makes it way and leaves the body lying there, then one army comes from the stars and another from hell: they fight over it (the soul). The soul may be worried until judgement is made as to which of the armies it will be brought.&#x0201D;</p></fn>
<fn id="fn0014"><p><sup>14</sup>The break with alliteration was much stronger on the continent than in England, as demonstrated by Old English and Old Norse verse (Heusler, <xref ref-type="bibr" rid="B20">1956</xref>, p. 8).</p></fn>
<fn id="fn0015"><p><sup>15</sup>Incantations saw the greatest innovation in a move from older forms of verse to a distinctly Germanic verse (Heusler, <xref ref-type="bibr" rid="B20">1956</xref>, p. 6).</p></fn>
<fn id="fn0016"><p><sup>16</sup>Akin to eighth notes in music.</p></fn>
<fn id="fn0017"><p><sup>17</sup>See Heusler (<xref ref-type="bibr" rid="B20">1956</xref>, pp. 48, 126).</p></fn>
<fn id="fn0018"><p><sup>18</sup>Braune and Ebbinghaus (<xref ref-type="bibr" rid="B5">1994</xref>). &#x0201C;There were many hardworking peoples,&#x0201D;</p></fn>
<fn id="fn0019"><p><sup>19</sup>Braune and Ebbinghaus (<xref ref-type="bibr" rid="B5">1994</xref>). &#x0201C;with such great zeal,&#x0201D;</p></fn>
<fn id="fn0020"><p><sup>20</sup>While Heusler&#x00027;s theory is certainly debatable, it must be reiterated that the intent of this work is not necessarily the absolute, <italic>real</italic> meter of MHG, but once again <italic>relative</italic> differences throughout the corpus, which could be revealed by an array of different theories. Furthermore, Heusler does not note any serious differences in meter between regions of MHG, from Heinrich von Veldeke in the north, to the Austrian southeast, to the Frankish northwest, there was little variation in the general <italic>Vierheber</italic> (four stresses per line) patterning (Heusler, <xref ref-type="bibr" rid="B20">1956</xref>, p. 77).</p></fn>
<fn id="fn0021"><p><sup>21</sup>Longfellow (<xref ref-type="bibr" rid="B25">1932</xref>).</p></fn>
<fn id="fn0022"><p><sup>22</sup>Excepted are several end syllables in divided falls such as &#x0201C;-er,&#x0201D; &#x0201C;-el,&#x0201D; and &#x0201C;ez&#x0201D; (more below) (Domanowski et al., <xref ref-type="bibr" rid="B11">2009</xref>).</p></fn>
<fn id="fn0023"><p><sup>23</sup>For example, the English word &#x0201C;red&#x0201D; has two morae since it ends in a consonant, whereas the first syllable in the English word &#x0201C;reduce&#x0201D; has one mora, since it ends in a short vowel.</p></fn>
<fn id="fn0024"><p><sup>24</sup>It can be helpful to think of MHG meter in the musical sense. Each foot is a measure of 2/4 meter, where one mora is equivalent to one quarter note, a double mora is a half note, and a half mora is an eighth note (B&#x000F6;gl, <xref ref-type="bibr" rid="B3">2006</xref>).</p></fn>
<fn id="fn0025"><p><sup>25</sup>Occasionally very weakly stressed long syllables can also count as a half mora.</p></fn>
<fn id="fn0026"><p><sup>26</sup>The metrical distinction between different degrees of stress is rooted in phonological reality (Giegerich, <xref ref-type="bibr" rid="B14">1985</xref>): in a word with many syllables, one syllable usually has a primary stress, and the others have either secondary or weak stress. For example, many pronounce the English word &#x0201C;anecdotal&#x0201D; with secondary stress on the first syllable, primary stress on the third syllable, and weakest stress on the second and fourth syllables.</p></fn>
<fn id="fn0027"><p><sup>27</sup>There are few exceptions to this in epic meter. The lyrical poetry, however, does break from this convention.</p></fn>
<fn id="fn0028"><p><sup>28</sup>The lyric tradition did allow for a feminine full cadence, which filled the entire last foot. This generally does not appear in the epic tradition.</p></fn>
<fn id="fn0029"><p><sup>29</sup>Text from Hartmann and Mertens (<xref ref-type="bibr" rid="B17">2005</xref>). Note that this notation differs slightly from that which is used for classical verse.</p></fn>
<fn id="fn0030"><p><sup>30</sup>&#x0201C;There was a knight so learned&#x0201D;</p></fn>
<fn id="fn0031"><p><sup>31</sup>&#x0201C;He looked extensively,&#x0201D;</p></fn>
<fn id="fn0032"><p><sup>32</sup>&#x0201C;Which a knight [should have] in his youth.&#x0201D;</p></fn>
<fn id="fn0033"><p><sup>33</sup>&#x0201C;in [these books] he began to search,&#x0201D;</p></fn>
<fn id="fn0034"><p><sup>34</sup>Incorporating different poems from different poets accommodates varying styles of writing, but it also introduces more variability, which will become the foundation of the model.</p></fn>
<fn id="fn0035"><p><sup>35</sup>Although neither author is a native speaker of NHG, the two phases of the language and the metrical traditions are sufficiently different that both native and non-native speakers require training in MHG scansion.</p></fn>
<fn id="fn0036"><p><sup>36</sup>Syllabification was performed following the method introduced in Hench (<xref ref-type="bibr" rid="B19">2017</xref>), which established an accuracy of 99.4% on MHG.</p></fn>
<fn id="fn0037"><p><sup>37</sup>For the presented model, the accuracy will be highest if the text is standardized and includes markers of long vowels because the annotated texts were such, and the extracted features depend upon this. However, the model can still scan any sort of text input with a reduced accuracy.</p></fn>
<fn id="fn0038"><p><sup>38</sup>Considering that there is not yet a constraint to the four stresses in MHG epic meter built in, this preliminary model without additional rules would be very helpful in eventually constructing a model for MHG lyrical poetry, which does not adhere strictly to the <italic>Vierheber</italic> qualities. In a sense, the bare model is a model best suited to predicting stress.</p></fn>
<fn id="fn0039"><p><sup>39</sup>Results for the model without constraints are an F-score of 0.894 on cross-validated data and 0.904 on held-out data (Estes and Hench, <xref ref-type="bibr" rid="B12">2016</xref>).</p></fn>
<fn id="fn0040"><p><sup>40</sup>Generally, this rules out the <italic>stumpf</italic> (blunt) cadence, which carries only three stresses. The <italic>stumpf</italic> cadence is rarely the only possible scansion (often a double mora can be assigned to fill the feet), though as B&#x000F6;gl points out, some lines in <italic>Erec</italic>, for example, leave the <italic>stumpf</italic> cadence as the only possible scansion (B&#x000F6;gl, <xref ref-type="bibr" rid="B3">2006</xref>, p. 26).</p></fn>
<fn id="fn0041"><p><sup>41</sup>The results for all models were internally 10-fold cross-validated and tested on held-out data. All code is available at <ext-link ext-link-type="uri" xlink:href="https://github.com/henchc/FDH-2018">https://github.com/henchc/FDH-2018</ext-link></p></fn>
<fn id="fn0042"><p><sup>42</sup>Implemented with the help of the NLTK n-gram tagger, Chapter 5 (Bird et al., <xref ref-type="bibr" rid="B4">2009</xref>).</p></fn>
<fn id="fn0043"><p><sup>43</sup>This proved important to recognize stress alternation.</p></fn>
<fn id="fn0044"><p><sup>44</sup>See Brill (<xref ref-type="bibr" rid="B6">1995</xref>); implemented with the help of NLTK (Bird et al., <xref ref-type="bibr" rid="B4">2009</xref>).</p></fn>
<fn id="fn0045"><p><sup>45</sup>See Lafferty et al. (<xref ref-type="bibr" rid="B24">2001</xref>); The implementation of the CRF model was expedited with the help of <italic>crfsuite</italic> (Okazaki, <xref ref-type="bibr" rid="B34">2007</xref>).</p></fn>
<fn id="fn0046"><p><sup>46</sup>A CRF model fits the problem of scansion better than a traditional Hidden Markov Model (HMM) because HMMs only consider relationships between each prior state and the observation. A CRF model relaxes the independence assumption and considers both previous and following labels in determining the label for a given syllable. This is especially helpful for scanning MHG meter. For example, if the model can see that there are likely two half morae at the end of a foot, then the beginning of the foot is likely one mora and not a double mora. Future work might consider an alternative in sacrificing interpretability for accuracy utilizing a Bidirectional Long Short Term Memory (BLSTM) neural network, though this is not attempted in this project because the CRF model proves very accurate when considering Cohen&#x00027;s Kappa.</p></fn>
<fn id="fn0047"><p><sup>47</sup>All features are encoded as categorical. The <italic>crfsuite</italic> package binarizes categorical variables.</p></fn>
<fn id="fn0048"><p><sup>48</sup>For reference, on the annotated data the model has a Cohen&#x00027;s Kappa of 0.949 with Annotator 1 and 0.944 with Annotator 2.</p></fn>
<fn id="fn0049"><p><sup>49</sup>&#x0201C;There was a knight so learned&#x0201D; (Hartmann and Mertens, <xref ref-type="bibr" rid="B17">2005</xref>, p. l. 1).</p></fn>
<fn id="fn0050"><p><sup>50</sup>&#x0201C;Thus I was also deceived by my foolish belief,&#x0201D; l. 400. Average marginal probability: 0.9994.</p></fn>
<fn id="fn0051"><p><sup>51</sup>&#x0201C;Beneficially so healthy (their child) in (to death)&#x0201D; l. 1034. Average marginal probability: 0.9991.</p></fn>
<fn id="fn0052"><p><sup>52</sup>&#x0201C;There was a knight so learned,&#x0201D; l. 1. Average marginal probability: 0.9991.</p></fn>
<fn id="fn0053"><p><sup>53</sup>&#x0201C;I know well that he himself confirms,&#x0201D; l. 1162. Average marginal probability: 0.9988.</p></fn>
<fn id="fn0054"><p><sup>54</sup>&#x0201C;He is a very much nonsensical fool,&#x0201D; l. 725. Average marginal probability: 0.9987.</p></fn>
<fn id="fn0055"><p><sup>55</sup>&#x0201C;The one who seeks the heart,&#x0201D; l. 1357. Average marginal probability: 0.247.</p></fn>
<fn id="fn0056"><p><sup>56</sup>&#x0201C;She was ordered to go on top (of the table).&#x0201D; l. 1206. Average marginal probability: 0.274.</p></fn>
<fn id="fn0057"><p><sup>57</sup>&#x0201C;Now give me advice you all through God,&#x0201D; l. 1482. Average marginal probability: 0.496.</p></fn>
<fn id="fn0058"><p><sup>58</sup>&#x0201C;I could not to Salerne.&#x0201D; l. 1018. Average marginal probability: 0.504.</p></fn>
<fn id="fn0059"><p><sup>59</sup>&#x0201C;He is not doing so well.&#x0201D; l. 600. Average marginal probability: 0.505.</p></fn>
<fn id="fn0060"><p><sup>60</sup>&#x0201C;To bear another death?&#x0201D; l. 1329. Average marginal probability: 0.516.</p></fn>
<fn id="fn0061"><p><sup>61</sup>However, were the long &#x00101; marked it may have scanned the line correctly.</p></fn>
<fn id="fn0062"><p><sup>62</sup>In fact, using these probabilities, it is likely a promising task to be able to determine whether a word is MHG or not.</p></fn>
<fn id="fn0063"><p><sup>63</sup><italic>marginal</italic>(<italic>t, s</italic>) is the marginal probability of tag <italic>t</italic> for syllable <italic>s</italic>, and thus <inline-formula><mml:math id="M126"><mml:munder class="msub"><mml:mrow><mml:mo>&#x02211;</mml:mo></mml:mrow><mml:mrow><mml:msup><mml:mrow><mml:mi>t</mml:mi></mml:mrow><mml:mrow><mml:mi>&#x02032;</mml:mi></mml:mrow></mml:msup></mml:mrow></mml:munder><mml:mi>m</mml:mi><mml:mi>a</mml:mi><mml:mi>r</mml:mi><mml:mi>g</mml:mi><mml:mi>i</mml:mi><mml:mi>n</mml:mi><mml:mi>a</mml:mi><mml:mi>l</mml:mi><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:msup><mml:mrow><mml:mi>t</mml:mi></mml:mrow><mml:mrow><mml:mi>&#x02032;</mml:mi></mml:mrow></mml:msup><mml:mo>,</mml:mo><mml:mi>s</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow><mml:mo>=</mml:mo><mml:mn>1</mml:mn></mml:math></inline-formula>. For a line with <italic>N</italic> syllables, the average of each syllable&#x00027;s maximum marginal probability over the syllables in a line is thus <inline-formula><mml:math id="M127"><mml:mfrac><mml:mrow><mml:mn>1</mml:mn></mml:mrow><mml:mrow><mml:mi>N</mml:mi></mml:mrow></mml:mfrac><mml:munderover accentunder="false" accent="false"><mml:mrow><mml:mo>&#x02211;</mml:mo></mml:mrow><mml:mrow><mml:mi>i</mml:mi><mml:mo>=</mml:mo><mml:mn>1</mml:mn></mml:mrow><mml:mrow><mml:mi>N</mml:mi></mml:mrow></mml:munderover><mml:mo class="qopname">arg</mml:mo><mml:munder class="msub"><mml:mrow><mml:mo class="qopname">max</mml:mo></mml:mrow><mml:mrow><mml:mi>t</mml:mi></mml:mrow></mml:munder><mml:mi>m</mml:mi><mml:mi>a</mml:mi><mml:mi>r</mml:mi><mml:mi>g</mml:mi><mml:mi>i</mml:mi><mml:mi>n</mml:mi><mml:mi>a</mml:mi><mml:mi>l</mml:mi><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>t</mml:mi><mml:mo>,</mml:mo><mml:msub><mml:mrow><mml:mi>w</mml:mi></mml:mrow><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:math></inline-formula>.</p></fn>
<fn id="fn0064"><p><sup>64</sup>Springeth et al. (<xref ref-type="bibr" rid="B37">1992-2017</xref>).</p></fn>
<fn id="fn0065"><p><sup>65</sup>Although the pronunciation of MHG &#x0201C;w&#x0201D; is not certain; it may have been a labiovelar glide, phonetically [w], a sonorant, or perhaps the labiodental fricative [v] as it is in NHG, an obstruent consonant.</p></fn>
<fn id="fn0066"><p><sup>66</sup>See Agirrezabal et al. (<xref ref-type="bibr" rid="B1">2016</xref>), Navarro (<xref ref-type="bibr" rid="B32">2017</xref>), and Mittmann (<xref ref-type="bibr" rid="B29">2016</xref>).</p></fn>
</fn-group>
<fn-group>
<fn fn-type="financial-disclosure"><p><bold>Funding.</bold> This research was funded by the Berkeley Institute for Data Science, Digital Humanities at Berkeley, and the Deutsche Akademische Austauschdienst (DAAD).</p>
</fn>
</fn-group>
</back>
</article>