<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0" xmlns:cc="http://cyber.law.harvard.edu/rss/creativeCommonsRssModule.html">
    <channel>
        <title><![CDATA[Stories by Andreas Simons on Medium]]></title>
        <description><![CDATA[Stories by Andreas Simons on Medium]]></description>
        <link>https://medium.com/@andreas_simons?source=rss-8efe888e65d8------2</link>
        <image>
            <url>https://cdn-images-1.medium.com/fit/c/150/150/1*bPwqsop1OCWHW1SOdfKa_Q.png</url>
            <title>Stories by Andreas Simons on Medium</title>
            <link>https://medium.com/@andreas_simons?source=rss-8efe888e65d8------2</link>
        </image>
        <generator>Medium</generator>
        <lastBuildDate>Wed, 18 Nov 2026 18:15:55 GMT</lastBuildDate>
        <atom:link href="https://medium.com/@andreas_simons/feed" rel="self" type="application/rss+xml"/>
        <webMaster><![CDATA[yourfriends@medium.com]]></webMaster>
        <atom:link href="http://medium.superfeedr.com/" rel="hub"/>
        <item>
            <title><![CDATA[The English language is a lot more French than we thought, here’s why]]></title>
            <link>https://medium.com/@andreas_simons/the-english-language-is-a-lot-more-french-than-we-thought-heres-why-4db2db3542b3?source=rss-8efe888e65d8------2</link>
            <guid isPermaLink="false">https://medium.com/p/4db2db3542b3</guid>
            <category><![CDATA[english]]></category>
            <category><![CDATA[french]]></category>
            <category><![CDATA[language]]></category>
            <category><![CDATA[etymology]]></category>
            <category><![CDATA[linguistics]]></category>
            <dc:creator><![CDATA[Andreas Simons]]></dc:creator>
            <pubDate>Thu, 13 Apr 2017 14:53:55 GMT</pubDate>
            <atom:updated>2017-04-28T17:39:51.832Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*AOiX77bFW6YQdDbMsuIt3Q.jpeg" /><figcaption>Scene 51 of the Bayeux tapestry portraying the battle of Hastings, a deciding battle for the future of the English language. Image by <a href="https://commons.wikimedia.org/wiki/User:Myrabella">Myrabella</a> via Wikipedia Commons</figcaption></figure><p><strong>DISCLAIMER: I personally do not have an opinion on the classification of English and that is not what this article is about, I am not a linguist. This article only researches the statistics behind English vocabulary as there is currently no such data available.</strong></p><p>The English language and its origins have been a topic for fierce debate among many linguists. English is classified as a (West) Germanic language, meaning that it is closely related to other Germanic languages such as Swedish, Dutch and German. The other dominant language family in Western Europe is the group of Romance languages: French, Italian, Spanish… all languages that have sprouted from Latin somewhere throughout history.</p><p>Unlike other Germanic languages, English shares a large portion of their vocabulary with French and Latin, often attributed to the period of <a href="https://en.wikipedia.org/wiki/List_of_English_words_of_French_origin">Norman French dominance in England after 1066</a>. The size of this Romance influence on English, along with some other technical aspects such as pronunciation and syntax, has led <strong>some radical linguists to believe that English should in fact not be seen as a Germanic language, but rather as a Romance-Germanic hybrid</strong>. However, the general consensus is that the <a href="https://en.wikipedia.org/wiki/Foreign_language_influences_in_English"><strong>overall</strong> English vocabulary is only a third of Old English origin (so, Germanic) but that the core vocabulary is <strong>entirely Old English</strong></a>. The keyword here is<em> core</em><strong>, </strong>as most linguists claim that French and Latin influence only enters the language through a handful of basic words but a vast majority of academic terms. For many, this seems to be the most important criterion for its classification as a Germanic language.</p><p>I personally don’t care much about these classifications<strong>, </strong>but I was very surprised to discover that in fact no-one recently has actually bothered to research the origins of English vocabulary, let alone the core. The latest research was done in 1975 by Joseph M. Williams, <a href="https://en.wikipedia.org/wiki/Latin_influence_in_English">where he examined the 10,000 most frequently used words in English</a>, based on a rather small sample size of corporate letters. Here are my issues with his research:</p><ul><li>the research carries a bias towards French and Latin, as companies are more likely to use academic language</li><li>proper names were not removed, possibly diluting the results for an etymological composition</li><li>he used the <strong>10 000</strong> most common words in that corpus of letters, not really “core vocabulary”</li></ul><p>And core vocabulary is precisely what this whole debate is all about, so I decided to do my own little research using Python to see how I could provide some statistics behind these claims.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/677/1*OW1PktUCOx7xhMDKL-INKw.png" /><figcaption>Joseph M. Williams’ research visualized (top 10,000 words). Image by by <a href="https://en.wikipedia.org/wiki/User:Murraytheb">Murraytheb</a> via Wikipedia Commons</figcaption></figure><h3>The quest for etymology</h3><h4><strong>Gathering the data</strong></h4><p>The Oxford Dictionary claims that there are roughly <a href="https://en.oxforddictionaries.com/explore/how-many-words-are-there-in-the-english-language"><strong>250 000 </strong>distinct words in English vocabulary</a>. But what share represents the <em>core</em> vocabulary? What does that even mean? The Oxford Dictionary uses the <a href="https://en.oxforddictionaries.com/explore/what-can-corpus-tell-us-about-language">following table</a> with some insight on the relation of the most common words in English to the appearance of words in English sources:</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/884/1*VDd5ld95Ydnwtqy4zORnGw.png" /><figcaption>Using a dataset of 5,000 words would make up roughly 85% of all used words in the Oxford English Corpus. Image via Oxford Dictionaries</figcaption></figure><p>This table shows us a rather large problem: the actual occurrence of words in applied English does not reflect the (core) vocabulary or even the language as a whole.<strong> 50% </strong>of any given text in English will use the exact same linkers/pronouns, even though those <strong>100</strong> words only reflect <strong>0.04%</strong> of distinct English vocabulary. A word such as “the” alone makes up <strong>6%</strong> of any given source in English. <strong>This disproportionate use of extremely basic structural words deceives the reader into thinking that English vocabulary is of an entirely different etymological composition.</strong> This is why to determine the composition of a language, or in my case just the core vocabulary, we have to use frequency lists, and not simply count words in sources. A frequency list, a list with the most commonly used words in a language, lets us accurately determine the core vocabulary of a language.</p><p>Now that I’ve established that I need to find a frequency list, I need to know how large that set of words has to be in order to have the <strong>core vocabulary</strong>. The definition of<strong> core vocabulary </strong>is not strictly defined, but the numbers seem<strong> </strong>to vary from roughly <strong>3,000</strong> to the <strong>5,000</strong> most common words in English, as used by various <a href="http://learnersdictionary.com/3000-words">dictionaries</a>, <a href="http://praacticalaac.org/strategy/join-together-core-fringe-vocabulary/">English learning sites</a> and <a href="https://www.amazon.co.uk/Core-Vocabulary-English-Intermediate-Towards-ebook/dp/B01MFFZB6Z">literature</a>. Based on those estimates, I decided to use a sample size with the <strong>5,000 </strong>most frequently used words in English, representing the top 2% of distinct vocabulary and making up 85% of all words in any English source.</p><p>Acquiring the actual <strong>5,000</strong> words turned out to be a lot harder than initially anticipated; there are almost no clean, unbiased (and uh, <em>free</em>) datasets. On one hand you have large datasets of all<strong> </strong>subtitles ever uploaded on OpenSubtitles.org, and on the other you have sources such as Project Gutenberg. Unfortunately is either the source severely outdated such as Project Gutenberg or is it severely biased, such as the subtitles; when words such as “kill” and “f*ck” are among the top entries, you know that you are not handling reliable data.</p><p>I ended up going with the <a href="http://www.wordfrequency.info/">frequency list</a> made available by Wordfrequency, a dataset that they believe to be the “<a href="http://www.wordfrequency.info/comparison.asp">most accurate</a> frequency data of English”. It is based on the <a href="http://corpus.byu.edu/coca/">Corpus of Contemporary American English</a>, containing <strong>450 million</strong> words sourced from colloquial speech to literature to magazines.</p><h4><strong>Processing the data</strong></h4><p>Next, I had to find a way to automate the process of retrieving the original language (or in other words, the etymology) of each word in my dataset. For this, I had to find reliable online dictionaries. The most obvious source for etymological data is <a href="http://etymonline.com/"><strong>Etymonline</strong></a>, an extremely accurate dictionary that was compiled and verified manually, and therefore used for <strong>80%</strong> of this dataset. The interface looks like this:</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*jTgMzdMSXr_YXz7hkN1YNA.png" /><figcaption>Results for the query “origin” on etymonline.com</figcaption></figure><p>Because the language of origin is mentioned right away, I scrape the first <strong>15</strong> words of each entry using Python’s urllib and BeautifulSoup. The language that is mentioned first is then taken as the language of origin. If there is no language present, it tries the next method.</p><p><em>Note that sometimes a word of Latin origin will return “French” using my method. This is because Etymonline always mentions French before Latin if the word entered English through French and the word changed sufficiently from the root. A word such as “origin” (from “origo”) will therefore return French, whereas a word such as “provide” (from “providere — provideo”) will return Latin.</em></p><p>The second source is <a href="http://www.memidex.com/"><strong>Memidex</strong></a>, an index of online dictionaries. Memidex returns the many possible origins of each word based on its indexed dictionaries.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1014/1*utiD7CJox4OA-o61lGW9xA.png" /><figcaption>Results for the query “origin” on memidex.com. The amount of possible dictionaries returning results can be up to ten.</figcaption></figure><p>I simply scrape the first <strong>8</strong> words after every mention of “Origin:” on the webpage and then return the language of origin that is mentioned the most. During every step of the process, the percentage of each language that makes up English is then logged into a list for later visualization and interpretation.</p><h4><strong>Visualizing the data</strong></h4><p>The following area graph contains the results of my research:</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*8wLe22WY_3-qYCUNStziqA.png" /></figure><p>As you can interpret, <strong>French</strong> and <strong>Latin</strong> enter English vocabulary much earlier and in much greater quantities than previously thought, it only takes the top<strong> 1,627 </strong>words in English for Germanic languages to lose the majority share of vocabulary and at exactly the <strong>1,875 </strong>most commonly used words do French and Latin dominate English vocabulary. It seems that Romance languages enter English at an exponentially fast rate but eventually do solidify at a level that I cannot reliably determine at a sample size of<strong> 5,000</strong> words; it does appear that it eventually reaches the percentages earlier provided by other researchers such as Mr. Williams.</p><p>Interestingly enough are French and Latin not the first foreign languages to enter this composition by frequency. For the first <strong>200</strong> words, <strong>Old Norse</strong> makes up <strong>5–10% </strong>of the vocabulary. Words such as “they”, “big” and “die” all seem to come from Scandinavian sources that entered English<a href="https://en.wikipedia.org/wiki/List_of_English_words_of_Old_Norse_origin"> around the Viking age</a>, a trait that seems to be unique to the English language.</p><p>Furthermore does<strong> Greek</strong> live up exactly to expectations; the share of Greek words in English increases linearly through rather academic words such as “photograph” and “character”.</p><h3><strong>Conclusion</strong></h3><p><strong>French and Latin make up the largest portion of English core vocabulary</strong>. After the <strong>1,875</strong> most frequently used words out of the<strong> 250,000</strong> words in distinct English vocabulary do <strong>French</strong> and <strong>Latin</strong> dominate the English language, achieving a share of<strong> 56%</strong> at the core vocabulary level, <strong>5,000</strong> words. Both languages enter English at an exponentially fast rate whereas <strong>Greek’s share seems to stay limited</strong> to a small linear growth due to its influx consisting of academic words. Furthermore is a considerable share of very <strong>basic English of Old Norse origin</strong>.</p><p>The source code with detailed guidance for every step can be found <a href="https://github.com/TotallyPythonic/EnglishComposition/blob/master/Sorter.py">here on GitHub</a>.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=4db2db3542b3" width="1" height="1" alt="">]]></content:encoded>
        </item>
    </channel>
</rss>