<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0" xmlns:cc="http://cyber.law.harvard.edu/rss/creativeCommonsRssModule.html">
    <channel>
        <title><![CDATA[Stories by Annie L. Lin on Medium]]></title>
        <description><![CDATA[Stories by Annie L. Lin on Medium]]></description>
        <link>https://medium.com/@allrambles?source=rss-adca90d3d453------2</link>
        <image>
            <url>https://cdn-images-1.medium.com/fit/c/150/150/1*67X8kerIb4LSgy1yxuGDZQ.png</url>
            <title>Stories by Annie L. Lin on Medium</title>
            <link>https://medium.com/@allrambles?source=rss-adca90d3d453------2</link>
        </image>
        <generator>Medium</generator>
        <lastBuildDate>Mon, 16 Nov 2026 21:12:10 GMT</lastBuildDate>
        <atom:link href="https://medium.com/@allrambles/feed" rel="self" type="application/rss+xml"/>
        <webMaster><![CDATA[yourfriends@medium.com]]></webMaster>
        <atom:link href="http://medium.superfeedr.com/" rel="hub"/>
        <item>
            <title><![CDATA[Tale in Three Phases: Trends in U.S. Housing Value & Expenses Over the Past Decade]]></title>
            <link>https://allrambles.medium.com/tale-in-three-phases-trends-in-u-s-571b64df3ee3?source=rss-adca90d3d453------2</link>
            <guid isPermaLink="false">https://medium.com/p/571b64df3ee3</guid>
            <category><![CDATA[data-visualization]]></category>
            <category><![CDATA[real-estate]]></category>
            <category><![CDATA[data]]></category>
            <category><![CDATA[data-analysis]]></category>
            <category><![CDATA[housing]]></category>
            <dc:creator><![CDATA[Annie L. Lin]]></dc:creator>
            <pubDate>Thu, 18 Sep 2025 20:33:53 GMT</pubDate>
            <atom:updated>2025-09-18T20:36:45.545Z</atom:updated>
            <content:encoded><![CDATA[<h3>Tale in Three Phases: Trends in U.S. Housing Value &amp; Expenses Over the Past Decade (Before, During, and After COVID)</h3><p>Hi kids! Numbers are fun and housing is even funner. And that’s why, with all that the housing market has been through recently, and with some rare free time on my hands, I decided to do a sequel to my 2016 analysis <a href="https://allrambles.medium.com/you-should-have-bought-that-condo-in-2012-and-you-should-have-bought-it-in-oakland-plus-other-632499f7294a">“You Should Have Bought That Condo in 2012 and You Should Have Bought It in Oakland, Plus Other Findings About U.S. Home Value Over the Past Four Years</a>.” This breaks a four-year hiatus in doing data projects!</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*cc0GXPTLdCFNcY9Tz1IT2Q.jpeg" /><figcaption>Photo by <a href="https://unsplash.com/@ronan18?utm_content=creditCopyText&amp;utm_medium=referral&amp;utm_source=unsplash">Ronan Furuta</a> on <a href="https://unsplash.com/photos/oil-rigs-on-body-of-water-daSq9zhROxY?utm_content=creditCopyText&amp;utm_medium=referral&amp;utm_source=unsplash">Unsplash</a></figcaption></figure><p>In my 2016 analysis, I had included a chart that traced U.S. home value from 2004 to 2016. I had focused on two-bedroom condos only. Here’s that chart, and my commentary on it:</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*wlSqpxkwZE8luRY7uLRecw.png" /></figure><blockquote>The left part of this graph is probably no surprise. The country saw massive increases in home value, hitting a peak in March and April 2007 when the median value was $166,500. It goes haywire from there, pretty much dropping nonstop for five years straight. For everyone who graduated college or owned a home in that period, I’m sorry about bringing back all your bad memories. The housing market hit a low in February 2012, when the median U.S. home value was $116,000 — a 30% decrease from the heydays of spring 2007. Cue <a href="https://www.youtube.com/watch?v=vfpluxxceT0">video clip</a> of Ryan Gosling’s character in <em>The Big Short </em>pulling out Jenga blocks until the tower topples over, as an analogy for the U.S. housing market.</blockquote><blockquote>But the right side of the graph looks promising. Since 2012, the U.S. housing market seems to be on the rise again. In the past four years, the median housing value in the U.S. has gone up about 26%, to $146,800 as of June 2016. That’s just ~$20,000 short of the high peak we reached as a country prior to the bubble bursting in 2007.</blockquote><p>Well, a lot has happened in the nine years since. In general, but also in the realm of U.S. housing. Here’s the same chart, but extended out to now (more specifically: end of July 2025). Also note that while the chart above and the entire 2016 data project looked at just two-bedroom condos, the below chart — and this entire sequel project — looks at <em>all</em> condos/co-ops and single family residences. So the absolute numbers will be a bit different, but the general trends are consistent.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/811/1*NnIMXQ7auEy8QgqE7QQNFA.png" /><figcaption>The vertical line is where the chart had stopped for my 2016 analysis</figcaption></figure><p>I’ve already covered the story from 2004 to 2016. Since 2016, the impressive growth in the U.S. housing market has generally continued. Housing value returned to its pre-2008-recession height at the end of 2016, and then kept going with gusto. In fact, in the full 11-year period represented in the chart above, U.S. housing value more than doubled, increasing ~114%.</p><p>In particular, the growth hit the accelerator hard during the COVID years — but has slowed down after. <em>That </em>story is what this sequel project will concentrate on. I focus on the 2017–now period, which, as I’ll get into more depth on below, really saw three very distinct phases (each spanning three years for consistency) when it comes to housing trends:</p><ul><li>Pre-COVID: 2017–2019</li><li>COVID: 2020–2022</li><li>Post-COVID: 2022–2025</li></ul><figure><img alt="" src="https://cdn-images-1.medium.com/max/809/1*EEvYV3p2rHQDyRz8DhWbtg.png" /></figure><p>Before we go deeper, a few notes of clarification about the data:</p><ul><li>Similar to the previous analysis, all data comes from Zillow, who very helpfully <a href="https://www.zillow.com/research/data/">publishes</a> various cuts of its housing data over time.</li><li>I mentioned this above, but for this project, I’m looking at all condos/co-ops and single family residences.</li><li>I will use the terms “housing value,” “home value,” and “property value” interchangeably. Those numbers are based on the Zillow Home Value Index (ZHVI), which Zillow defines as such: “A measure of the typical home value and market changes across a given region and housing type. It reflects the typical value for homes in the 35th to 65th percentile range.” Notably it is not technically the <em>median </em>housing value, but rather a <em>typical </em>housing value. I’m using the smoothed, seasonally adjusted version. A more detailed explanation of the ZHVI methodology is <a href="https://www.zillow.com/research/methodology-neural-zhvi-32128/">here</a>.</li></ul><p>Later in this analysis, I also look at housing <em>expenses</em> — in particular contrasting how costs have changed for those looking to buy versus those looking to rent. But no spoilers on that just yet!</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*MGv8UqBoDr95fg0thSj-MQ.jpeg" /><figcaption>Photo by <a href="https://unsplash.com/@brenoassis?utm_content=creditCopyText&amp;utm_medium=referral&amp;utm_source=unsplash">Breno Assis</a> on <a href="https://unsplash.com/photos/aerial-photography-of-rural-r3WAWU5Fi5Q?utm_content=creditCopyText&amp;utm_medium=referral&amp;utm_source=unsplash">Unsplash</a></figcaption></figure><h3>Housing value: continued growing impressively, but unevenly — strong growth pre-COVID, insane growth during COVID, much slower growth after COVID</h3><p>If you thought home value was going nuts in my previous housing analysis, wait until you see what it’s done since! In my 2016 analysis, we saw that U.S. housing value increased 26% in the four-year period between mid-2012 and mid-2016, or an average of 6.5% per year. In the eight-and-a-half-year period between 2017 and July 2025, U.S. housing value grew 73%, or an average of 8.5% per year. Pretty great if you were already a homeowner going into this period; pretty sucky if you were trying to get into homeownership during this period.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*NEq3-2DXY6bLpCetBIYVLw.jpeg" /><figcaption>Photo by <a href="https://unsplash.com/@sandym10?utm_content=creditCopyText&amp;utm_medium=referral&amp;utm_source=unsplash">Sandy Millar</a> on <a href="https://unsplash.com/photos/coins-in-clear-glass-jar-with-house-fund-sign-G-Aj03ckq0w?utm_content=creditCopyText&amp;utm_medium=referral&amp;utm_source=unsplash">Unsplash</a></figcaption></figure><p>But this growth has not been evenly distributed. COVID, which was an enormously unique time for so many reasons, was also an enormously unique time for the housing market.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*Ts4FboavAJYAnJBX6eIpqg.png" /><figcaption>Home value grew at very different rates before COVID, during COVID, and since COVID</figcaption></figure><p><strong>Pre-COVID (2017–2019): </strong>The three years leading up to COVID saw strong growth comparable to the already-strong-growth few years before them. U.S. housing value went up 18% in this period, or 9% per year. Impressive!</p><p><strong>COVID (2020–2022): </strong>Housing went absolutely cash-ew nuts during the three COVID years, growing 39%, or 13% per year. This trend holds across the country: of the 894 metro areas Zillow had data for, 94% saw more growth during COVID than pre-COVID. Every state in the U.S. saw higher growth during COVID than pre-COVID, although some growth was much bigger than others. Idaho, Montana, and Florida experienced the biggest gains (almost 60% growth in housing value in the COVID period!), with Montana and Florida seeing increases during COVID that were around 3x what they saw pre-COVID. Louisiana saw the mildest growth rate during COVID, although even then it was 13%, compared to 6% in the three years pre-COVID.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*faxMYuqQS0Q8rAGpE-zdCw.png" /></figure><p><strong>Post-COVID (2023–2025): </strong>Housing growth has slowed significantly since the COVID years, growing just 6%, or 2% per year (2025 data uses actual year-to-date numbers extrapolated to the full year, so that each phase is the same length — three full years). This trend is also national: 97% of the metro areas Zillow had data for saw slower growth post-COVID versus during COVID, with some metro areas seeing a massive slowdown — for example the Punta Gorda, FL and Murray, KY areas both saw about a 90-percentage-point drop in growth rate after COVID. Every single state saw at least a 10-percentage-point drop in growth rate coming out of COVID. Arizona and Florida actually went from growing 55%+ during COVID to <em>negative</em> growth post-COVID. Four other states (Colorado, Hawaii, Louisiana, Texas) plus DC have also experienced a housing value decline post-COVID. The five states growing the <em>most</em> post-COVID are fairly heavily concentrated in the northeast (New Jersey, New Hampshire, Connecticut, Rhode Island, Wisconsin), with Rhode Island leading the pack at 20% growth, although even then that is down from its 36% growth during COVID.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*rCx2MSf9af77txoGo2x-Ig.png" /></figure><p>Growth post-COVID is not only slower compared to the wild COVID years, but also generally slower compared to pre-COVID. Of all the metro areas that Zillow had data for, only 16% saw faster growth post-COVID than pre-COVID. Of all U.S. states, only four (Illinois, New Jersey, North Dakota, West Virginia) saw faster growth post-COVID than pre-COVID, and only two (Delaware and Wyoming) experienced essentially the same growth rate post-COVID vs pre-COVID. Nation-wide, 2023–2025 (post-COVID) has seen housing value grow at about one-third the rate of 2017–2019 (pre-COVID) and one-fifteenth the rate of 2020–2022 (COVID).</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*0bGr3oPToX2YG7Wj8XASZQ.png" /></figure><h4>The tale of three phases holds across select major metro areas</h4><p>How do these trends play out in major U.S. metro areas? I took a deeper look at the areas we had spent time in during our nomadic adventures: San Francisco, Portland, Denver, Minneapolis, Philadelphia, Raleigh, Los Angeles.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/597/1*oFLUemonWDspqh2wpfu9tA.png" /><figcaption>Local NFL team colors for the win</figcaption></figure><p>Generally, the country-wide story holds true for these metro areas: strong growth pre-COVD, b-a-n-a-n-a-s growth during COVID, much slower (even negative) growth post-COVID.</p><p>A few interesting points to note:</p><ul><li>LA housing value was growing much faster than the other metro areas above (and the U.S. as a whole) pre-COVID, but that was no longer the case during COVID.</li><li>In fact during COVID, all metro areas above except Raleigh saw slower growth than the country as a whole, possibly a sign of people moving out of big cities when they no longer need to be in them due to remote work.</li><li>That said, these metros still all saw more growth during COVID than pre-COVID when compared to themselves (reflective of the country as a whole). Portland, Philly, and Raleigh more than doubled their growth rate, and Denver came pretty close to it.</li><li>Similar to the national trend, growth has been significantly slower post-COVID. This is certainly true compared to the COVID years, but also generally true when compared to the pre-COVID era. The only metro area above that has seen faster growth post-COVID than pre-COVID is Philly (16% vs 13% growth). It is in rare company: as mentioned above, only 16% of the metro areas Zillow had data for saw faster growth post-COVID than pre-COVID. Portland and Raleigh have seen about a 0% growth after COVID, and SF and Denver have actually experienced negative growth since COVID.</li></ul><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*xLds2g8eyzioezFiHWKgQA.jpeg" /><figcaption>Photo by <a href="https://unsplash.com/@kevin_butz?utm_content=creditCopyText&amp;utm_medium=referral&amp;utm_source=unsplash">Kevin Butz</a> on <a href="https://unsplash.com/photos/person-in-gray-pants-and-blue-sneakers-xqN3DvAYpz0?utm_content=creditCopyText&amp;utm_medium=referral&amp;utm_source=unsplash">Unsplash</a></figcaption></figure><h3>Housing expenses: costs for those looking to buy have grown much faster vs rent</h3><p>With rising housing value, unevenly split across the three phases, and also increasing inflation and interest rates over the past few years, how have housing <em>expenses</em> played out, and how has that differed between those who buy and those who rent?</p><p>To answer this question, I looked at Zillow’s “Total Monthly Payment” data — which “includes the mortgage payment, homeowner’s insurance, property taxes, and maintenance costs worth 0.5% of the home’s value” — to estimate how much homeowners have to pay. As such, I will be using the term “monthly payment” below to refer to these aggregated monthly costs for those who <em>bought</em> in a given month. For <em>rental</em> costs, I used the Zillow Observed Rent Index (ZORI), which they define as “a smoothed measure of the typical observed market rate rent across a given region.”</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*alBOOG-qjHc2XJDyKQOaNQ.jpeg" /><figcaption>Photo by <a href="https://unsplash.com/@jontyson?utm_content=creditCopyText&amp;utm_medium=referral&amp;utm_source=unsplash">Jon Tyson</a> on <a href="https://unsplash.com/photos/red-and-black-ride-on-toy-car-Hl1eeC7D-Mk?utm_content=creditCopyText&amp;utm_medium=referral&amp;utm_source=unsplash">Unsplash</a></figcaption></figure><p>Two important notes on how to approach this analysis:</p><ul><li>By no means does this paint a complete picture of “whether it’s better to buy or rent.” What the below gets at is one of many factors involved in that question (albeit, a very important factor) — namely, <strong>how much monthly (recurring) costs have changed over time for buying vs renting</strong>. The analysis does not address the many other important factors in the rent-versus-buy equation, including upfront down payment vs security deposit, opportunity cost of money saved (e.g. that one could potentially invest in the stock market), any profits/losses from selling a house one owns, psychological impact of owning vs renting, etc.</li><li>The numbers below largely reflect rates for a <em>new </em>home purchase and <em>new </em>rental in a given month, not necessarily how much someone’s own costs changed month to month if they bought their home or signed a rental at a previous point in time, since mortgage and rental costs tend to stay locked in for some time once the person has officially bought or rented their place.</li></ul><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*vnbkAMug_Qt67Fp-psgAyA.jpeg" /><figcaption>Photo by <a href="https://unsplash.com/@edkills?utm_content=creditCopyText&amp;utm_medium=referral&amp;utm_source=unsplash">Ed Vázquez</a> on <a href="https://unsplash.com/photos/black-metal-patio-set-outdoor-in-front-of-house-iFD-IfR3Q-k?utm_content=creditCopyText&amp;utm_medium=referral&amp;utm_source=unsplash">Unsplash</a></figcaption></figure><h4>Monthly costs for buying have surpassed monthly costs for renting</h4><p>In the U.S. a a whole, monthly cost was higher for renting until around April 2022, when the trend flipped. Since then, it’s been more expensive per month to become an owner, and that gap is significant: if someone in the U.S. bought a typical property at the end of July 2025, their monthly expenses for that property would be about 20% higher than someone who took out a typical rental unit (~$2,500 vs ~$2,100 per month).</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*Y84PsIGhsQ-sH7MH9kgG3w.png" /><figcaption>U.S. as a whole</figcaption></figure><p>Among the metro areas we had spent time in during our nomadic adventures, all of them except Philly already had higher monthly payments than rent even before COVID, but that gap has gotten (way) bigger. In Philly, monthly payment and rent were comparable before COVID, but in early 2022, monthly payment started outstripping rent and that gap has gotten bigger since.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*4HMX0dql73sIVka22ylJag.png" /><figcaption>In the San Francisco metro area, monthly payment was higher than rent even before COVID, but the gap has gotten even bigger</figcaption></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*_PTZs0CQIwI09WIfZkuv_Q.png" /><figcaption>In the Philly metro area, monthly payment was comparable to rent before COVID but started outpacing rent in the late-COVID timeframe and has continued to do so</figcaption></figure><p>As you can see from the charts above, the reason for this is that monthly payments (for those who bought) have increased way faster than rent has between 2017 and now. This was true for every metro area Zillow had data for except one (Bloomington, IL). San Jose, CA saw the biggest difference: there, monthly payments have grown at 4.8x the rate of rent increases. Nationwide, monthly payments grew almost twice as fast as rent (104% vs 54% increase) since 2017.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*poWWmrV2pTbQkEWB_NFTig.png" /><figcaption>Top 10 &amp; bottom 10 metro areas by size (that Zillow had data for): monthly payment has grown much faster than rent between 2017 and 2025</figcaption></figure><p>Across the metro areas we spent time in during our nomadic adventures, this trend was even more pronounced. For example in LA, since 2017, rent has increased 47% while monthly payments have increased 116%.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/860/1*xXdDEpcrvbEspHM5RIqWBg.png" /><figcaption>Buying a home in any of these metro areas was expensive ten years ago, and it’s even more expensive now — not just because housing value has increased, but also because monthly expenses for owning have wayyyy increased</figcaption></figure><p>Of note, monthly payments have also grown much faster than housing <em>value</em>. So even though housing value increased a ton since 2017 as mentioned above, monthly payments increased even more. All in all, since 2017, the later you bought a property, the higher your monthly expenses have been relative to the value of your property: monthly payments have increased 104% since 2017 across the U.S., vs a 73% increase in housing value. People (annoyingly) say that the best time to buy a house was yesterday; well, turns out, this statement has been reaaaally true over the past decade.</p><h4>COVID era drove the vast majority of this trend</h4><p>Similar to the tale of three phases for housing value, the COVID period was also when monthly payments outstripped rent payments the most.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*CqEv0SlNaGcmNailA2scKQ.png" /><figcaption>Growth rate for housing value, monthly payments, and rent across the three phases</figcaption></figure><p>Both pre-COVID and post-COVID, the growth rate for monthly payments vs rent was relatively comparable, with monthly payments overall growing slightly slower pre-COVID and slightly faster post-COVID when compared to rent (12% vs 13% pre-COVID, 11% vs 9% post-COVID).</p><p>During the COVID years, however, monthly payments grew at 2.6x the rate of rent across the U.S. as a whole. This trend applied across all metro areas that were on our nomadic adventures. In the San Francisco Bay Area, monthly payments actually grew at an astounding 13x (!!) the rate of rent (52% vs 4% increase) in the COVID era.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*u2rNrTgh4pdA7GhjV4IQKA.jpeg" /><figcaption>Photo by <a href="https://unsplash.com/@tienvn3012?utm_content=creditCopyText&amp;utm_medium=referral&amp;utm_source=unsplash">Tien Vu Ngoc</a> on <a href="https://unsplash.com/photos/a-woman-wearing-a-face-mask-and-a-flower-in-her-hair-kF2ZOVawr6c?utm_content=creditCopyText&amp;utm_medium=referral&amp;utm_source=unsplash">Unsplash</a></figcaption></figure><p>I mentioned earlier that housing <em>value</em> has not kept up with monthly payments. This also differs by phase: before COVID, property value was actually increasing faster than the increase in monthly expenses (18% vs 12%). During COVID, though, monthly payments grew <em>much</em> faster than property value (67% vs 39%). Post-COVID, until now, the gap has not been as large, but monthly payments have continued to grow faster than property value (11% vs 6%). Areas like SF and Denver that are seeing a post-COVID housing value decline are still seeing their monthly payments go up, which is obviously what every homeowner wants to see. Not.</p><h4>Rising interest rates almost certainly played a role</h4><p>While increasing housing value can contribute to increasing monthly payments, we know that is not the full picture because, as mentioned above, monthly payments have grown much faster than housing value. Do inflation and increased interest rates play a part too? Almost certainly. Beginning in early 2022, the Fed began gradually raising interest rates, going from 0.25% in January 2022 to 5.5% in July 2023. This coincides with when monthly payments started accelerating its growth:</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/810/1*YI-TozNVvgkQqOMHbaJ_3g.png" /><figcaption>Fed interest rate data from <a href="https://tradingeconomics.com/united-states/interest-rate">Trading Economics</a></figcaption></figure><p>We see the same dynamic in the 2017–2019 period: interest rates climbed from 0.75% at the beginning of 2017 to 1.75% at the end of 2019, and we see monthly payments climb (albeit at a much slower rate) as well in the same period. In 2020–2021, interest rates was at the extremely low 0.25%, and we saw monthly payments drop, even as housing <em>value </em>(as we saw earlier) was going gangbusters during this time. Interesting, even though interest rates have dropped a bit again beginning in mid-2024, monthly payments have remained very high — it remains to be seen whether we’ll see payments drop as well soon, or not.</p><p>As expected, as interest rates rose, mortgage also became a bigger % of monthly payments. In January 2022, for properties where the owner put down a 20% down payment, mortgage was in aggregate 71% of monthly payments. By July 2023, it was 78%. This, combined with monthly payments going up in general, means mortgage payment $ amounts have been increasing significantly and quickly since 2022, outpacing other non-mortgage parts of the monthly payments (although costs for those — like home maintenance, insurance, etc — like increased as well with inflation).</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*DLQqVkpiZ_kmUcmWXUyCIw.png" /></figure><p>In fact, since 2017, mortgage<em> </em>payments for those who did a 20% down payment have grown a whopping 128% across the U.S. as a whole. Monthly mortgage amounts for a typical property purchased in late July 2025 was ~$1,900, up from ~$835 at the end of 2016. Again, please note that this increase generally applies to <em>new </em>home<em> </em>purchases, since if someone bought their property some time ago, they likely locked in their mortgage arrangements at that time and are still paying that (lower) mortgage amount now.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*s7W_IJq5ZfqF2K4l7VYsKw.jpeg" /><figcaption>Photo by <a href="https://unsplash.com/@napender?utm_content=creditCopyText&amp;utm_medium=referral&amp;utm_source=unsplash">Napendra Singh</a> on <a href="https://unsplash.com/photos/clear-glass-jar-with-coins-XmvQveCDsQI?utm_content=creditCopyText&amp;utm_medium=referral&amp;utm_source=unsplash">Unsplash</a></figcaption></figure><h3>Takeaways &amp; learnings</h3><p>So, what does it all mean? I won’t try to overly pontificate on a topic as nuanced as the housing market, but here’s what jumped out at me the most from doing this analysis:</p><ul><li>As always, owning a property is a damn privilege. And more and more so. Over the past two decades, if you were able to buy a property before COVID, or even better, in the early 2010s, you’ve likely seen that asset appreciate in value <em>a lot</em>. Since COVID started, it’s become even harder to buy: both housing value and monthly payments have gone up an insane amount, meaning not only is it extra expensive to buy a house in the first place, but your ongoing, recurring costs are way higher.</li><li>This also complicates the math for whether it makes more sense to buy vs rent. I mentioned earlier that this analysis by no means attempts to tackle that multifaceted question holistically, but it does get at one (important) factor of that decision — i.e. monthly expenses. Five years, even ten years, ago, in many parts of the U.S., it was financially a no-brainer to buy instead of rent if you can afford to. Now, with monthly payments for owning having outpaced (or further outpaced) not only rent but also <em>housing value</em>, the picture is more complicated. No one likes a homeowner who complains about how expensive it is to own a home, but these days, especially if they bought their home recently, they might have a point.</li><li>Logistically: Google Sheets can do a lot! I did this entire analysis, and made all the charts above, in Google Sheets. I had used SQL for some earlier projects because of the sheer size and complexity of the raw data involved, but this is a good reminder that there’s no need to overcomplicate your tooling if you don’t have to. Sometimes simpler, free tools — like Google Sheets — will do, if your dataset isn’t humongous, which the data for this analysis wasn’t because the most granular unit I looked at was metro area. If I went into the city or zip code level, or if I felt strongly about making more complicated charts, I probably would have used different tools.</li></ul><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=571b64df3ee3" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[5 Charts That Show Just How Much Our Bay Area Lifestyle Has Changed During the Pandemic]]></title>
            <description><![CDATA[<div class="medium-feed-item"><p class="medium-feed-image"><a href="https://medium.com/the-bold-italic/quantifying-just-how-much-our-lifestyles-have-changed-during-the-pandemic-bay-area-edition-5f8653679344?source=rss-adca90d3d453------2"><img src="https://cdn-images-1.medium.com/max/874/1*23RJT41aoma8AzD69e-C2w.jpeg" width="874"></a></p><p class="medium-feed-snippet">Covid-19 has upended our lifestyle. To show just how much, I dug into mobility data from Google and Apple.</p><p class="medium-feed-link"><a href="https://medium.com/the-bold-italic/quantifying-just-how-much-our-lifestyles-have-changed-during-the-pandemic-bay-area-edition-5f8653679344?source=rss-adca90d3d453------2">Continue reading on The Bold Italic »</a></p></div>]]></description>
            <link>https://medium.com/the-bold-italic/quantifying-just-how-much-our-lifestyles-have-changed-during-the-pandemic-bay-area-edition-5f8653679344?source=rss-adca90d3d453------2</link>
            <guid isPermaLink="false">https://medium.com/p/5f8653679344</guid>
            <category><![CDATA[lifestyle]]></category>
            <category><![CDATA[covid19]]></category>
            <category><![CDATA[data]]></category>
            <category><![CDATA[data-visualization]]></category>
            <category><![CDATA[pandemic]]></category>
            <dc:creator><![CDATA[Annie L. Lin]]></dc:creator>
            <pubDate>Tue, 02 Mar 2021 03:42:31 GMT</pubDate>
            <atom:updated>2021-03-04T20:45:33.495Z</atom:updated>
        </item>
        <item>
            <title><![CDATA[Republicans Like “Tiger King” and Democrats Like “Schitt’s Creek”?]]></title>
            <link>https://medium.com/nightingale/republicans-like-tiger-king-and-democrats-like-schitts-creek-246e38bd51e3?source=rss-adca90d3d453------2</link>
            <guid isPermaLink="false">https://medium.com/p/246e38bd51e3</guid>
            <category><![CDATA[2020-presidential-race]]></category>
            <category><![CDATA[election-2020]]></category>
            <category><![CDATA[politics]]></category>
            <category><![CDATA[data]]></category>
            <category><![CDATA[data-visualization]]></category>
            <dc:creator><![CDATA[Annie L. Lin]]></dc:creator>
            <pubDate>Tue, 16 Feb 2021 14:03:09 GMT</pubDate>
            <atom:updated>2021-02-16T14:03:09.694Z</atom:updated>
            <content:encoded><![CDATA[<h3>Do Republicans Like “Tiger King” and Democrats Like “Schitt’s Creek”?</h3><h4>An exploration of the connections between TV show and presidential candidate preferences</h4><p>Last year, I came across <a href="https://www.nytimes.com/interactive/2016/12/26/upshot/duck-dynasty-vs-modern-family-television-maps.html">this 2016 Upshot article</a> from <em>The New York Times</em>. Besides being an example of beautiful data storytelling, the premise of the content intrigued me. Is there actually a connection between what TV shows people like and how they vote in elections? <em>NYTimes</em> claims so. But as much as I loved the article, I was left wanting more. The article never went into detail on the actual correlations between TV and politics. So I decided to investigate further, through the lens of the most recent U.S. presidential election.</p><figure><img alt="vintage TV" src="https://cdn-images-1.medium.com/max/1024/1*Jame7JjBw8FE0AUQUYPLMg.jpeg" /><figcaption>Photo by <a href="https://unsplash.com/@sveninho?utm_source=unsplash&amp;utm_medium=referral&amp;utm_content=creditCopyText">Sven Scheuermeier</a></figcaption></figure><p><em>The New York Times</em> article used data from Facebook page “likes” for TV shows. I do not have access (or haven’t figured out how to get access) to these data, so I used <a href="https://trends.google.com/">Google Trends</a> as my proxy for show preferences. Google Trends allows users to see how “popular” a particular search term or topic is in a given geography over a given period of time. So if I type in <em>Queen’s Gambit, </em>the relatively new hit Netflix miniseries (by the way what makes something a “miniseries” versus a normal series?), I can see all types of information about the show. Like, for example, how its popularity has evolved over time, as measured by the volume of Google searches:</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*LuaTdZgq0gPiYiSO.png" /></figure><p>The show came out on October 23rd, 2020 — right where that graph peaks in the chart above. We can also see <em>where </em>the show was most “popular” (again, measured via Google searches) over the past year:</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*nuwVZcvATG6TFI-F.png" /></figure><p>It looks like within the U.S., Washington, DC, and Vermont are particularly fond of the show, or at least fond of Googling the show. North Dakota, on the other hand, doesn’t care.</p><p>And here’s the popularity of <em>Queen’s Gambit </em>alongside the popularity of just “chess” as a search term over time. In this case, over the past five years. The blue line is <em>Queen’s Gambit</em>; the red line is “chess.”</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*staC0J6jshyzUsmc.png" /></figure><p>Correlation doesn’t always mean causation in data, but here, it’s pretty clear there’s a connection. <a href="https://www.cnn.com/2020/12/06/us/queens-gambit-chess-popularity-trnd/index.html">CNN</a> reveals that “in the first three weeks after [the show’s] debut, sales of chess sets went up by 87% in the US and sales of books about chess leaped 603%.” Not surprisingly, TV shows and other cultural productions can have a real, tangible influence on behavior. Not necessarily causal, but powerful nonetheless. Hence the topic of this blog post.</p><figure><img alt="Kids playing chess" src="https://cdn-images-1.medium.com/max/1024/1*oEu42VUXbu4yuOnN507q1w.jpeg" /><figcaption>Photo by <a href="https://unsplash.com/@mis_hik?utm_source=unsplash&amp;utm_medium=referral&amp;utm_content=creditCopyText">Michal Vrba</a></figcaption></figure><h4>The data</h4><p>To tackle how TV show preferences and election choices relate to one another, I started by pulling Google Trends data across U.S. locations for each of the top TV shows from 2020.</p><p>My “top TV shows” list is a combination of the <a href="https://trends.google.com/trends/yis/2020/US/">top five most-searched-for shows in 2020</a> according to Google Trends, and the <a href="https://www.nielsen.com/us/en/insights/article/2020/tops-of-2020-television/">top five regularly-scheduled TV programs of 2020</a> (with sports removed) according to the research firm Nielsen. Then I threw in <em>Battlestar Galactica </em>and <em>Schitt’s Creek, </em>too, for schitts and giggles (sorry). (Well, actually because I am a big fan of <em>BSG </em>and because I was surprised that <em>Schitt’s Creek, </em>which won nine<em> </em>Emmy’s awards this year, didn’t make it onto the Top Five lists mentioned above.) This resulted in the following list of 12 shows:</p><ul><li><em>Tiger King</em></li><li><em>Cobra Kai</em></li><li><em>Ozark</em></li><li><em>The Umbrella Academy</em></li><li><em>The Queen’s Gambit</em></li><li><em>NCIS</em></li><li><em>FBI</em></li><li><em>Blue Bloods</em></li><li><em>Chicago PD</em></li><li><em>Young Sheldon</em></li><li><em>Battlestar Galactica</em></li><li><em>Schitt’s Creek</em></li></ul><p><em>** Note: </em>Chicago Fire<em> actually ranked above </em>Chicago PD<em> on Nielsen’s list. I skipped it in my analysis because of oddly-sparse data about the show in Google Trends.</em></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/499/1*2t4IHfeLIBhMHOZOWg7Mbg.jpeg" /><figcaption>Bears, Beets, Battlestar Galactica (<a href="https://www.flickr.com/photos/19417283@N00/2222600576">“Battlestar Galactica’s Last Supper”</a> by <a href="https://www.flickr.com/photos/19417283@N00">brianfling</a>, licensed under <a href="https://creativecommons.org/licenses/by-nc-sa/2.0/?ref=ccsearch&amp;atype=rich">CC BY-NC-SA 2.0</a>)</figcaption></figure><p>From there, I pulled in data on how each county voted in the 2020 U.S. presidential election, scraped from <em>The New York Times</em>, <em>Politico</em>, and <em>Fox News</em> by <a href="https://github.com/tonmcg/US_County_Level_Election_Results_08-20">this helpful person</a>.</p><p>Then, armed with nothing but Tableau (a lot of it), some Google Sheets (for real), and coffee (decaf), I got to work.</p><p><em>Unfortunately Medium doesn’t currently allow for embeds of interactive Tableau charts, so all the visualizations in this blog post are screenshots. However, you can find the original, interactive version of all the charts and maps below </em><a href="https://public.tableau.com/profile/annie.lin4685#!/vizhome/2020ElectionTVShows/tiger_king_map"><em>here</em></a><em>, in case you want to play with them more.</em></p><figure><img alt="Biden vs Trump 2020" src="https://cdn-images-1.medium.com/max/1024/1*D4rMWkBPUpVs7v1pBzr1Sw.jpeg" /><figcaption>Photo by <a href="https://unsplash.com/@markusspiske?utm_source=unsplash&amp;utm_medium=referral&amp;utm_content=creditCopyText">Markus Spiske</a></figcaption></figure><h4>But first, how different parts of the country voted</h4><p>If you paid any attention to the US presidential election we just had, you’ve probably seen some version of the map below. I made this one using the county-level election data I mentioned. Darker red means a higher percentage of that county voted for Trump. Lighter red means the county still went Republican overall (more people voted for Trump than otherwise), but by smaller margins. Same concept goes for the blues, for counties that went for Biden.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/885/0*o_yaC5yHQkLSZwXQ.png" /></figure><p>So much red! Any map like this is, of course, misleading. Lands don’t vote. People vote. Joe Biden won ~51.4% of the popular vote, versus Donald Trump’s ~46.9% — a difference of more than seven million votes. That’s why I like what the web comic <em>xkcd </em>created: an election map oriented around population instead of land.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/740/0*rcBJVEg1X28PTVVy.png" /><figcaption>The caption for this on xkcd is worth quoting in full: “There are more Trump voters in California than Texas, more Biden voters in Texas than New York, more Trump voters in New York than Ohio, more Biden voters in Ohio than Massachusetts, more Trump voters in Massachusetts than Mississippi, and more Biden voters in Mississippi than Vermont.”</figcaption></figure><p>Now, to the question that this project set out to answer: are TV show preferences correlated with voting behavior? It turns out the answer is actually <em>yes</em>, much more so than I ever expected.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*dWZ10tkUztLS1-p-LJl0Vw.jpeg" /></figure><h3>Shows correlated with voting Republican</h3><p>Counties, where the following shows are more popular, are also more likely to have gone Republican in the 2020 presidential election.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/365/0*zV8EzmOU-JxMr5oD.png" /></figure><p>These are in descending order of “slope,” or the difference in show popularity between the most Trump-voting counties and the most Biden-voting counties (on a scale from 0 to 100 due to how Google Trends scores popularity). <em>Young Sheldon </em>wins as the TV show on the list where Republicans and Democrats differ the most — the most heavily Republican counties apparently like this show almost 24% more than the most heavily Democratic counties. And <em>Tiger King </em>is almost 14% more popular among Republican-heavy counties than Democrat-heavy counties.</p><p>As for “p-value”: a p-value of less than 0.05 usually means the correlation between two variables is statistically significant (i.e., unlikely due to just chance). Note that the p-value for every show in the table above is <em>much </em>less than 0.05. In other words, there is highly significant correlation between how much a county likes these shows and which candidate won that county in the 2020 presidential election.</p><p>Below is a show-by-show view. The maps illustrate where in the U.S. a show is most popular (darker shade) vs least popular (lighter shade). The scatterplots — and the trend lines through them — show the relationship between the percentage of votes that went Republican (x-axis) and show popularity according to Google Trends (y-axis). Each dot on the scatterplot represents a county, and the size of the dot reflects the relative population size of the county, approximated using the number of total votes cast in the 2020 presidential election (however, the correlation analysis itself is population agnostic — meaning each county counts equally, regardless of population).</p><figure><img alt="Trump flag" src="https://cdn-images-1.medium.com/max/1024/1*0nhw-lu7jPQMd-EzEiBjHA.jpeg" /><figcaption>Photo by <a href="https://unsplash.com/@crwy___?utm_source=unsplash&amp;utm_medium=referral&amp;utm_content=creditCopyText">Dalton Caraway</a></figcaption></figure><p>Of note:</p><ul><li>You’ll notice that I labeled a small number of counties in the scatterplots below, in order to call out a few reference points in the sea of dots. Many of these are counties I have personal connections to, for example, Alameda County (where Oakland and Berkeley are located) and Cook County (where Chicago is located). Others are there for contrast. These include Macon County (the most liberal county in Alabama, with only 17.67% of votes going to Trump, less than even Los Angeles County, Cook County, or Alameda County), Lassen County (the most conservative county in California, with 74.84% of votes going to Trump), and the three most Republican counties in the whole country (Roberts County, Borden County, and King County — all in Texas and all with 94%+ of votes going to Trump).</li><li>From the scatterplots, it’s clear how much bigger — and fewer — the blue dots are compared to the red dots. It’s further visual representation that there are more Republican-leaning counties overall in the U.S., but the Democrat-leaning counties tend to be much more populous.</li><li>Many Americans, particularly in conservative-leaning places, seem to love cop/detective/crime shows. Of Nielsen’s top five regularly-scheduled TV programs, four are in this genre, and three of those four lean Republican (the fourth one, <em>Chicago PD</em>, doesn’t lean either direction, as I’ll get to later).</li><li>It goes without saying, but the correlations across this blog post are generalizations. As shown in the scatterplots, there are definitely Democrat-leaning counties that love these Republican-correlated shows, and Republican-leaning counties that hate these Republican-correlated shows. There are also most likely plenty of <em>Tiger King </em>lovers within any <em>Tiger King </em>-hating county, plenty of <em>Tiger King </em>lovers who voted for Joe Biden, and so forth. They’re just not as common, but they exist. This analysis is on the aggregate level and there are certainly individual variations within the aggregate.</li></ul><p><em>(Click on images below on enlarge.)</em></p><p><strong><em>Young Sheldon</em></strong></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/876/0*P1jTB0xxVsZwnV8w.png" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*954jXi2R9uLJSrk2.png" /></figure><p><strong><em>NCIS</em></strong></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/868/0*UiYIa1dlMS6k7c-g.png" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*gOkaehZLTQtRlzRo.png" /></figure><p><strong><em>Tiger King</em></strong></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/862/0*11x4cGiswOguJ1yY.png" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*bASPmG2Dc8TLSdtp.png" /></figure><p><strong><em>FBI</em></strong></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/865/0*rA0IlSIZ8uZqJw2_.png" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*zDuA2Pa33Q831yXY.png" /></figure><p><strong><em>Blue Bloods</em></strong></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/864/0*fLdSzA0Kw_LFrdht.png" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*cF86XsXeybRs4d7U.png" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*dWZ10tkUztLS1-p-LJl0Vw.jpeg" /></figure><h3>Shows correlated with voting Democrat</h3><p>On the other side of the aisle, we have these five shows that are all correlated in a statistically significant way with voting for Joe Biden.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/367/0*VW0A2J0Hc2eT2ndp.png" /></figure><p><em>Schitt’s Creek </em>is the TV show that sets Democrats apart the most from Republicans. The Rose family is almost 26% more popular in Biden-dominant counties than Trump-dominant counties. And while <em>Queen’s Gambit </em>has single-handedly boosted the popularity of chess, the show’s fame is not equally distributed: the most Democratic counties like the miniseries almost 18.5% more, compared to their Republican counterparts.</p><p><em>Umbrella Academy </em>and <em>Ozark </em>both lean Dem, too, but not by much. The correlation is statistically significant (again, p-value &lt; 0.05), but there is a mere 2–3% difference in how much Trump voters and Biden voters seem to like these two shows.</p><figure><img alt="Biden-Harris supporter" src="https://cdn-images-1.medium.com/max/1024/1*SutrRO4qiRDJ7rrkyMNqyg.jpeg" /><figcaption>Photo by <a href="https://unsplash.com/@gmalhotra?utm_source=unsplash&amp;utm_medium=referral&amp;utm_content=creditCopyText">Gayatri Malhotra</a></figcaption></figure><p>Here’s the show-by-show view:</p><p><strong><em>Schitt’s Creek</em></strong></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/863/0*4JOxxGqPRy1K7VRV.png" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*Hry5aK1fBkcmzFEJ.png" /></figure><p><strong><em>Queen’s Gambit</em></strong></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/861/0*Cot8EU0CRmpLZcWl.png" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*MRO3HsuJ1JnYi7Ee.png" /></figure><p><strong><em>Battlestar Galactica</em></strong></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/858/0*9_3Gi803PxGCjRlH.png" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*0B6fglMbh6Kxqkhy.png" /></figure><p><strong><em>Umbrella Academy</em></strong></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/860/0*XKqmPm1Jw2Tc2mNG.png" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*nKKGw4-zH_VgNB8B.png" /></figure><p><strong><em>Ozark</em></strong></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/860/0*hdIGiYTX5OvTKdGm.png" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*EAPBxPP7Q8zEej0y.png" /></figure><h3>Shows with no significant correlations</h3><p><em>Cobra Kai </em>and <em>Chicago PD </em>are the only two shows on my list that have no statistically-significant correlations to presidential voting behaviors.</p><p><strong><em>Cobra Kai</em></strong></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/865/0*2Ldyuy8Mvmj6O_Ou.png" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*QvvGaH5gj_SCDdwJ.png" /></figure><p>As seen in the scatterplot, <em>Cobra Kai </em>leans sliiiiiightly Democrat (by 0.89%), but the p-value is 0.3448, a.k.a. not statistically significant (too high that the correlation could be simply due to random chance).</p><p>Also, looking at the map: clearly counties in Southern California and much of the American Southwest love this show. The show’s setting in Los Angeles may have something to do with it.</p><p><strong><em>Chicago PD</em></strong></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/859/0*_fkohL6UoQjpH19S.png" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*Tgfi_6WEW0PEAwaW.png" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*oBu-Q5hFCswRU79N.png" /></figure><p><em>Chicago PD </em>has the distinct honor of being the only cop/detective/crime show on my list that doesn’t clearly swing toward Trump.</p><p><em>Chicago PD </em>is also really, really popular in the state of Illinois. This is utterly unsurprising to me. When I lived in Chicago, I was consistently impressed by how much pride Chicagoans have in their city and, therefore, how much they love anything related to Chicago. To control for this, I made two scatterplots. The first one (middle image above) retains all counties, like all the other scatterplots in this blog post. The second one (right image) removes counties in Illinois. This made a bit of a difference, but not enough to change the story. In both cases, the correlation is not statistically significant (0.9119 with Illinois, 0.4204 without Illinois), and the show popularity difference between Republican and Democratic counties is negligible (0.17% with Illinois and 1.22% without Illinois, leaning Republican).</p><figure><img alt="The real Chicago PD" src="https://cdn-images-1.medium.com/max/1024/1*7QJHw579_kk7TwfVI94Hew.jpeg" /><figcaption>Photo by <a href="https://unsplash.com/@maxwbender?utm_source=unsplash&amp;utm_medium=referral&amp;utm_content=creditCopyText">Max Bender</a></figcaption></figure><h3>Bringin’ it all together</h3><p>I expected TV preferences and political preferences to be related. I did not quite expect the correlations to be <em>this</em> significant or widespread.</p><p>Here’s how our top 12 shows stack together, in descending order of how strongly affiliated it is with presidential preference:</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/365/0*mScIL0SWezyNyri3.png" /></figure><p>So apparently, your choices in TV shows can say a lot about your politics. Next time you want to fly your partisan flag loud and proud, suggest <em>Schitt’s Creek </em>or <em>Young Sheldon </em>as the evening entertainment. If, however, you want to avoid stirring the pot at your Thanksgiving family gathering, put on <em>Chicago PD </em>or <em>Cobra Kai</em>.</p><figure><img alt="“I Voted” stickers" src="https://cdn-images-1.medium.com/max/1024/1*9meZjVfvGg2qDJq3ZD4bzA.jpeg" /><figcaption>Photo by <a href="https://unsplash.com/@element5digital?utm_source=unsplash&amp;utm_medium=referral&amp;utm_content=creditCopyText">Element5 Digital</a></figcaption></figure><p>And of course, if your goal is to maximize looks of bewilderment, you should stream <em>Tiger King. </em>Obviously.</p><figure><img alt="Joe Exotic vs David Rose" src="https://cdn-images-1.medium.com/max/1024/0*2Pr3mawS51CqhBdo.png" /><figcaption>Joe Exotic vs. David Rose</figcaption></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*dWZ10tkUztLS1-p-LJl0Vw.jpeg" /></figure><h3>Meta reflections from this data project</h3><ul><li>I used Tableau more heavily in this project than any other and was reminded of how powerful the software really is.</li><li>I’ve done correlation analyses in previous data projects, but not to the extent of this one. I had to brush up on some foundational statistical and mathematical concepts (like slope and p-value) in the process. Big thanks to my friend <a href="https://medium.com/@soyluiscampos">Luis</a> for all his expert help here.</li><li>Your data creates limits to your analysis. My decision to use Google Trends in this project meant that I had to live with the consequences, so to speak. For example, Google Trends data (at least the public version) only drills down to the metro area level, not the county level. This means that my show popularity data is less precise than my election data, because each metro area usually encompasses multiple counties. This is why the maps in this blog post look a bit “blocky.”</li><li>I did this project on the aggregate level (metro area and county) because my data was on the aggregate level. But this does mean that some individuals’ behaviors are weighted much more than others’ in the results. For example, the TV preferences of rural or smaller areas likely got drowned out in the aggregate results of their larger metro area. And the smaller (less populous) a county is, the more sway each person proportionally has over that county’s election results.</li><li>Because you can use Google Trends to get popularity data for literally anything, the analytical framework of this project is actually applicable to any topic. You can use it to figure out the correlation between anything and p̶r̶e̶s̶i̶d̶e̶n̶t̶i̶a̶l̶ ̶v̶o̶t̶i̶n̶g̶ ̶b̶e̶h̶a̶v̶i̶o̶r̶s̶ anything else with geographic data. For example, hot dogs. Apparently, hot dogs are the food of the liberals. Biden-loving counties like hot dogs 4.3% more than Trump-loving counties. And yes, that correlation is statistically significant (p = 0.0001).</li></ul><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*E6uU2S46KY5RjxYl2VrkpA.jpeg" /><figcaption>Photo by <a href="https://unsplash.com/@phsecan?utm_source=unsplash&amp;utm_medium=referral&amp;utm_content=creditCopyText">Peter Secan</a></figcaption></figure><p>I wanted to come up with a clever wrap-up to this blog post, but honestly, there’s nothing that tops hot dogs. (Except for mustard and ketchup and sometimes relish, if you’re in the mood.) May you entertain yourself this evening with a TV show true to your political self.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*dWZ10tkUztLS1-p-LJl0Vw.jpeg" /></figure><p><a href="https://www.anniellin.com/"><em>Annie L. Lin</em></a><em> is a People Operations and Business Operations leader who thinks in numbers and talks in charts. She tells data stories about business, culture, politics, and everyday life. She’s on a perpetual quest for interesting datasets and cheesy puns.</em></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*qG5wgBbMUJXDs0qfVjMW5Q.jpeg" /></figure><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=246e38bd51e3" width="1" height="1" alt=""><hr><p><a href="https://medium.com/nightingale/republicans-like-tiger-king-and-democrats-like-schitts-creek-246e38bd51e3">Republicans Like “Tiger King” and Democrats Like “Schitt’s Creek”?</a> was originally published in <a href="https://medium.com/nightingale">Nightingale</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[A Guide to Riding BART for People Who Hate Crowds]]></title>
            <link>https://allrambles.medium.com/a-guide-to-riding-bart-for-people-who-hate-crowds-ecdb6df12fa7?source=rss-adca90d3d453------2</link>
            <guid isPermaLink="false">https://medium.com/p/ecdb6df12fa7</guid>
            <category><![CDATA[public-transit]]></category>
            <category><![CDATA[trains]]></category>
            <category><![CDATA[data]]></category>
            <category><![CDATA[san-francisco]]></category>
            <category><![CDATA[commuting]]></category>
            <dc:creator><![CDATA[Annie L. Lin]]></dc:creator>
            <pubDate>Mon, 25 Jun 2018 04:41:21 GMT</pubDate>
            <atom:updated>2021-02-01T00:33:18.510Z</atom:updated>
            <content:encoded><![CDATA[<p>This is Emma. Emma is seen here taking the Bay Area Rapid Transit, or “BART,” the San Francisco Bay Area’s regional public transit system.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*BSDfIXKagYbJ18huaDWdYg.jpeg" /><figcaption>Hang in there Emma!</figcaption></figure><p>Emma is not happy, because this train is too damn crowded. She can barely move her elbow without hitting this poor stranger on the right in the face. She’s so miserable that she’s planted her entire head in her armpit out of exasperation (or maybe because there’s some kind of foul smell on the train, which is pretty likely too). This photo was taken literally seconds after she had just gotten on the BART, and she <em>already </em>looks like this. And this isn’t even one of those stations, like 24th St in the Mission, that you’d expect to be super popular. This is <em>Rockridge</em>, darn it, which ranks 29th out of BART’s 46 stations in 2016 in terms of how busy it gets.</p><p>Actually, I have no idea what this woman’s name is. I snapped this photo immediately before the BART doors shut in front of me. I was still standing on the platform because this train was so crowded that I didn’t even <em>try</em> squeezing in. I took this photo because here was a stranger who, I thought, so perfectly embodied the experience of a BART commuter. If you are a regular BARTer yourself, chances are you can relate to Emma-or-whatever-her-name-is too. As well as to any of the following people:</p><h3>Jessica Christian on Twitter</h3><p>Pro tip: Don&#39;t use other people as back rests while on a crowded #BART train. I promise I&#39;ll elbow you.</p><iframe src="https://cdn.embedly.com/widgets/media.html?type=text%2Fhtml&amp;key=a19fcc184b9711e1b4764040d3dc5c07&amp;schema=instagram&amp;url=https%3A//www.instagram.com/p/hlmjKCE0q1/&amp;image=https%3A//i.embed.ly/1/image%3Furl%3Dhttps%253A%252F%252Fscontent-iad3-1.cdninstagram.com%252Fvp%252F24d36346e01ba065608ced73943774f7%252F5BE9B0E9%252Ft51.2885-15%252Fe15%252F926594_266612456819982_1629747030_n.jpg%26key%3Da19fcc184b9711e1b4764040d3dc5c07" width="640" height="640" frameborder="0" scrolling="no"><a href="https://medium.com/media/b10a6978a300117029fb208ec3e137b8/href">https://medium.com/media/b10a6978a300117029fb208ec3e137b8/href</a></iframe><p>As the Bay Area economy boomed, BART ridership increased steadily. <a href="https://www.sfgate.com/bayarea/article/BART-can-t-keep-pace-with-rising-crush-loads-6192950.php">SF Gate</a> reports that in the five years following 2010, ridership increased by 31%. Each BART car on average seats 60 people, and can comfortably accommodate 47 more standing. But during rush hours, BART cars are often carrying 140 people or more — 33 people more than what is comfortable and 25 more than what the Federal Transit Administration recommends as the train’s maximum capacity. Ridership declined slightly in 2016, but the system still saw over 128 million trips in 2016, or about 351,000 trips per day. New cars with more standing room are slowly being added to the fleet, but at least for now, we remain sardines in a can.</p><p>As someone who likes people but hates crowds, I want to be more like salmon than sardine. I’m not asking to have the entire space to myself, but I want to at least be like those beautifully packaged salmon filets, sitting (I’ll take standing too) side by side with other filets with some basic dignity intact, instead of being piled on top of each other like those poor sardines.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*d3VwyWYcyAx4LJqp.jpg" /><figcaption>This is all I’m asking for</figcaption></figure><p>I guess I should be grateful for BART crowdedness, because this was what jolted me out of my yearlong hiatus in doing personal data projects. After a particularly uncomfortable commute, I asked myself: what strategies can I employ to make my BART rides even a tiny bit less painful?</p><p>Through <a href="http://www.kaggle.com/">Kaggle</a>, I found BART’s raw 2016 ridership data (unfortunately BART has not yet published 2017 or 2018 data to this level of completeness or accessibility). At almost 10 million rows, it is the largest dataset I’ve played with to date. In situations like this, I am doubly grateful for SQL, because this spreadsheet most certainly would have broken my Excel before the file even loaded. The dataset includes information on every trip (every origin-destination pair) that happened in every hour of every day in 2016. So if four people total tapped in at Embarcadero and tapped out at Fremont between 5:00 and 5:59 PM on June 24, 2016, there would be a row in this file that reads something like: Origin: Embarcadero | Destination: Fremont | Throughput: 4| Timestamp: 6/24/2016 17:00. And so on… for 10 million rows. While using data from only 2016 certainly has its limits, I do believe that BART trends from one year can help inform some decisions for future years.</p><p>I embarked on this project mostly because of my selfish desire to be less like a sardine and more like a salmon. But if you, like me, also want to get away from the sardine life, then these tips are for you too. It’s unlikely that all of these recommendations will be feasible for you, but it’s likely that at least one will be.</p><h3>Tip 1: During the week, avoid 7–10 AM and 4–7 PM</h3><p>Perhaps not surprisingly, the vast majority of BART rides happen between Monday and Friday. A regular weekday sees about 424.3K rides, which is about 2.5x what a regular weekend day would see. If you want to experience BART at its most glorious state, Saturday and Sunday are definitely the best.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/600/1*itjaEFQvCRoxtXCcRFmOEQ.png" /><figcaption>Weekday BART = more sardine; weekend BART = less sardine</figcaption></figure><p>But most of us don’t get to be only weekend BART warriors. Most of us have to use the system on weekdays, too. How do we make that experience less miserable?</p><p>Probably not shockingly, what time you get on the train makes a huge difference. Fully half of all BART trips during the week takes place either between 7:00 and 9:59 AM or between 4:00 and 6:59 PM. So if your work allows it, it’s worth adjusting your hours to super early or super late. And if you wrap up work in the early evening, consider meeting up with friends somewhere that doesn’t involve BART, instead of commuting home right away. That way, you get to skip the evening rush <em>and </em>keep your friends!</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/757/1*wtsx5TZcOZEIjApNCkB0Cg.png" /><figcaption>8–9 AM and 5–6 PM are the absolute worst</figcaption></figure><h3>Tip 2: Live in SF and work in the East Bay… or at least live and work on the same side of the bay</h3><p>What if your schedule isn’t flexible enough to let you avoid rush hour? Turns out, the direction of human flow during peak commute time is heavily skewed and you may be able to use that to your advantage.</p><p>During the morning peak hours, significantly more people are riding BART from the East Bay into San Francisco, than from SF into East Bay, within SF, or within East Bay.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/600/1*cdZQYVHKeG5WPsX54ROl3Q.png" /><figcaption>Go west, my friends</figcaption></figure><p>Naturally, the reverse commute happens in the evenings. 46% of all 4–7 PM BART trips are from San Francisco to the East Bay, far more than any other direction.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/600/1*PIXrOaQzpUMbArt55lZk-Q.png" /><figcaption>Go back east, my friends</figcaption></figure><p>Housing costs, job opportunities, and other considerations likely contribute to this trend. But if for some reason you have the money to live in San Francisco and can find a job in the East Bay, you would be setting yourself up for a true salmon-y life. Or even if you can simply live and work on the same side of the bay, you would likely experience far less crowded BART rides than if you lived in the East Bay and commuted into SF everyday, as long as you’re going in the opposite direction as traffic.</p><p>If you do work in SF, give preferential treatment to jobs that are not in downtown (also challenging, I know, because of where most job opportunities are located). During the week, Embarcadero, Montgomery, Powell, and Civic Center are the top four stations that people BART to in the morning and leave from in the evening, so even the BART platforms (and your favorite lunch and happy hour spots) will be crowded, let alone the trains themselves.</p><h3>Tip 3: If you must live in the East Bay and work in SF, avoid the Pittsburg-Bay Point line</h3><p>If you have no choice but to commute from the East Bay to the West Bay during morning peak hours, you’re likely going to keep feeling like a massive sardine, but there are still things you can do to optimize. Living closer to the start of a BART line of course helps with your chances of getting a seat. Another thing you can potentially use to your advantage is knowing that not all BART lines are created equal. The Pittsburg-Bay Point line sees the heaviest traffic from the East Bay to SF during morning rush hour and in the reverse direction during evening rush hour. In fact, it is more than twice as busy as the Richmond route!</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/600/1*MfGMrDmo0B8mlMCEhcE2pQ.png" /><figcaption>Richmond line = sardine; Pittsburg-Bay Point line = extremely sardine</figcaption></figure><p>So if you have to live in the East Bay and work in the city, consider living on the Richmond line if you have the choice. If you’re still not sold, just know that the Richmond line also comes with gems such as <a href="http://www.berkeleybowl.com/">Berkeley Bowl</a> (the best grocery store), <a href="http://www.jupiterbeer.com/">Jupiter</a> (the best outdoor patio with pizza and beer), and <a href="https://www.costco.com/warehouse-locations/richmond-ca-richmond-ca-482.html">Costco</a> (the best place to spend a day). Yum.</p><h3>Tip 4: Work from home in the middle of the week</h3><p>Let’s say you work at one of those tech companies that lets you work from home sometimes. How do you pick your work-from-home day such that you maximize your BART pain reduction?</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/600/1*IckJc5DARWNmtYdZJgVwSQ.png" /><figcaption>WTF is up with people’s WFH schedules</figcaption></figure><p>Tuesday wins as the busiest day of the week for morning rush hour, followed closely by Wednesday and Thursday. If your goal is to avoid the biggest crowds, pick one of these days to work from home.</p><h3>Tip 5: Win the weekend by avoiding downtown SF and the early evening</h3><p>So far I’ve mainly been talking about weekdays, because I assume people reading this are similar to the average BART rider in that we use BART more frequently during the week. But sometimes we find ourselves BARTing on weekends too — and as I mentioned earlier, I would certainly encourage you to, because the person in this photo could be you!</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*L27f0U1Ec177Brh_.jpg" /><figcaption>So many empty seats! So glorious! But be a nice person and don’t put your feet on them!</figcaption></figure><p>What is the BART landscape on the weekend? We know that only 14% of rides happen on weekends. Saturday is a bit busier than Sunday. Ridership climbs steadily from morning, peaking around 5 PM and then declining. For comparison though, the busiest hour on weekends (5–6 PM) is still only 12% as busy as the busiest hour on weekdays (8–9 AM). So next time your friends want you to BART to them, suggest that you meet on the weekend, and ideally not in the early evening.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/758/1*DtYLsjwohSxzfvHjhqo-lQ.png" /><figcaption>Weekends are almost as fun as bar graphs</figcaption></figure><p>Unlike weekdays, there is not much difference in ridership by direction of traffic, so next time you’re bored on a weekend, get on the BART and go <em>anywhere</em>! You’ll likely get a seat and maybe even get to see a new part of the Bay Area.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/600/1*QW6Ci8YVdKzTI5Canvy28g.png" /><figcaption>People are all over the place on weekends</figcaption></figure><p>Except, maybe don’t go to downtown SF. Embarcadero, Montgomery, Powell, and Civic Center are <em>still</em> the most popular stations for people to get on or get off the BART at, even on the weekends. My guess is this is because they’re good places for transferring to the Muni or a Lyft so you can venture into SF neighborhoods that are far from BART lines.</p><p>By the way, North Concord, Oakland Coliseum/Airport, South San Francisco, and South Hayward are the <em>least</em> popular destinations on the weekends. So if you love having as much space as possible on BART, maybe it’s time to plan a Sunday outing to Pixieland, the children’s amusement park in Concord?</p><h3>Tip 6: Go out of town in March, June, or August</h3><p>Finally, usage of BART is actually pretty flat throughout the year, but March, June, and August are slightly higher in ridership than other months. So if you’re planning some kind of BART sabbatical — vacations, Lyft-binging, ferry-adventuring, etc etc.—prioritize those months so that you also skip the most crowded times of the year. And maybe instead of going on out-of-town family trips in December (when BART is at its emptiest), bring your whole family <em>into</em> town and spend the whole holiday season riding around on BART together. Sounds fun to <em>me</em>.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/600/1*je-UQggNLemP6IKciVDJSQ.png" /><figcaption>BART needs friends in the winter</figcaption></figure><p>As a regular BARTer, I’ve often marveled at how different the BART-riding experience is depending on when you do it. It really feels like night and day. Because of those soft cushioned seats, BART can feel like a dream on trips where you get a seat, the car is half empty, the sun shines in and warms your legs, and the train runs on time. Then there are the 8 AM Tuesday trips from the East Bay into downtown San Francisco, when you feel your face turning bright red from crowd-induced overheating and bouts of rage, and you wonder how it is that the tech and innovation hub of the U.S. has what seems like one of the sh*ttiest public transportation systems in the country.</p><p>Public transit, to me, is one of the most prevalent symbols of community living in urban areas. A public transit system that works well reminds me why I love cities, and why pooling resources with neighbors can be good for everyone. As BART is very slowly renovating its infrastructure and introducing more modern cars, my hope with this project is it will help myself and whoever reads this post hate BART just a little bit less, so that, yes, we are more like salmon and less like sardine—but also so that we don’t completely give up on the treasure and dream that public amenities truly are and truly can be.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=ecdb6df12fa7" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[You Should Have Bought That Condo in 2012 and You Should Have Bought It in Oakland, Plus Other…]]></title>
            <link>https://allrambles.medium.com/you-should-have-bought-that-condo-in-2012-and-you-should-have-bought-it-in-oakland-plus-other-632499f7294a?source=rss-adca90d3d453------2</link>
            <guid isPermaLink="false">https://medium.com/p/632499f7294a</guid>
            <category><![CDATA[investment]]></category>
            <category><![CDATA[analytics]]></category>
            <category><![CDATA[real-estate]]></category>
            <category><![CDATA[housing]]></category>
            <category><![CDATA[data]]></category>
            <dc:creator><![CDATA[Annie L. Lin]]></dc:creator>
            <pubDate>Sun, 21 Aug 2016 07:59:25 GMT</pubDate>
            <atom:updated>2021-02-01T00:42:51.663Z</atom:updated>
            <content:encoded><![CDATA[<h3>You Should Have Bought That Condo in 2012 and You Should Have Bought It in Oakland, Plus Other Findings About U.S. Home Value Over the Past Four Years</h3><p>After thinking about buying a small condo in Chicago last year (I didn’t) and then watching <em>The Big Short </em>last month, I became fascinated with the U.S. housing market. There have been a lot of discussions about the housing bubble that mushroomed spectacularly until 2007 and then burst equally spectacularly afterward. There doesn’t seem to be as much analysis, though, into what our housing market has been up to in more recent years. So I decided I’d do a little digging on my own.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*845jDuuSf3P6nWQZ7NgaOQ.jpeg" /></figure><p>This project is made possible by Zillow, which has kindly <a href="http://www.zillow.com/research/data/">opened up its data</a> for public use. I tapped into multiple Zillow datasets, with home value information for every month over the past twenty years, spanning the national, state, city, and neighborhood level. As I’ll describe below in the Learnings section, having access to massive, multidimensional data is both a blessing and a curse. I ended up spending much more time figuring out what questions I wanted to answer with all this data than doing actual analysis.</p><p>To help me focus, I narrowed the scope of my analysis to the following:</p><ul><li>I looked only at 2-bedroom condos. Mostly for selfish reasons. If I were to purchase a place, a 2-bedroom would be the most likely type.</li><li>I concentrated on growth rate instead of the absolute value of housing prices, as for the purposes of this specific project I was primarily interested in how home values have changed<em> </em>over time (and there already seems to be a lot of studies on different cities’ absolute housing values). So for example I’m not digging into how high San Francisco’s housing value is (we already know it’s super high). Instead, I’m interested to know whether San Francisco’s housing value is rising faster or slower than other cities’.</li><li>One limitation here is Zillow doesn’t have data on every single state, city, and neighborhood in the country. For example, it’s missing data on Texas and Louisiana altogether for some reason but includes Washington, D.C. separately. It also has limited information on neighborhoods in Detroit and a few other cities. That said, the datasets are still super thorough overall.</li></ul><figure><img alt="" src="https://cdn-images-1.medium.com/max/624/1*YjJhzMgJCooUebGgnKbYZQ.png" /></figure><p>To get an initial lay of the land, I took a look at how our median national home value has changed in the recent past. (Note that for this exercise and everything following in this post, I’m using “home value” and “housing value” synonymously and they refer to the financial value of 2-bedroom condos only.)</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/993/1*7SUwfGDfO_rAUtkc0XTwiw.png" /></figure><p>The left part of this graph is probably no surprise. The country saw massive increases in home value, hitting a peak in March and April 2007 when the median value was $166,500. It goes haywire from there, pretty much dropping nonstop for five years straight. For everyone who graduated college or owned a home in that period, I’m sorry about bringing back all your bad memories. The housing market hit a low in February 2012, when the median U.S. home value was $116,000 — a 30% decrease from the heydays of spring 2007. Cue <a href="https://www.youtube.com/watch?v=vfpluxxceT0">video clip</a> of Ryan Gosling’s character in <em>The Big Short </em>pulling out Jenga blocks until the tower topples over, as an analogy for the U.S. housing market.</p><p>But the right side of the graph looks promising. Since 2012, the U.S. housing market seems to be on the rise again. In the past four years, the median housing value in the U.S. has gone up about 26%, to $146,800 as of June 2016. That’s just ~$20,000 short of the high peak we reached as a country prior to the bubble bursting in 2007.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/600/1*Xq_lsYoBMGyqY-fxO_B4Zw.png" /></figure><p>Optimists and Barack Obama are cheering the recovery of our economy. Critics are calling it the beginning of another bubble. Either way, you probably should have bought that condo back in 2012 when your parents told you to.</p><p>Based on this graph, I wanted to further explore: how evenly distributed is this 2012–2016 growth across the U.S.? What parts of the country are the biggest winners? Are they the same winners as those from the pre-2007 bubble? What regions are growing most equitably? Let’s take a look. (Note: for the purposes of this project, I’m defining “2012–2016” more specifically as the four-year period from July 2012 through June 2016.)</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/670/1*Gu25jkokbWyDDYJVzHPEUQ.png" /></figure><h3>This growth is not evenly distributed. Florida, Michigan, and the West have benefited the most.</h3><p>The rise in home value over the past four years has benefited some parts of the country a lot more than others. 61% of U.S. states are seeing moderate growth in the 0–20% range, but two states’ housing value is actually declining while 22% of the states are experiencing massive growth over 30%<em>.</em></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/749/1*CJs4ZZs2eLjQ7K-ezV82KA.png" /></figure><p>Who are these big winners and losers? Turns out the western part on the country is experiencing the most dominant growth. Florida and Michigan are also winning big. Nevada leads the nation with an impressive 83% growth in median home value in 2012–2016, followed by Florida (62%), California (60%), Colorado (55%), Michigan (51%), Oregon (45%), and Washington (42%).</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/838/1*W0aGMWIGqD8ylsQKhG7QaA.png" /><figcaption>Growth in housing value across states. Darker green means higher growth rate. <strong>For an interaction version of this chart, see here: </strong><a href="https://public.tableau.com/shared/MGY2B4HRC?:display_count=yes"><strong>https://public.tableau.com/shared/MGY2B4HRC?:display_count=yes</strong></a><strong>.</strong></figcaption></figure><p>The Great Plains area, midwest, and eastern part of the United States are seeing relatively more sluggish growth, with Maine actually declining by 19%. This puts a whopping 102% difference in home value growth rate between our fastest-growing state and slowest-growing state. Choose wisely when you buy, indeed.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/600/1*08O-mhDrbvNzikztM5iPBw.png" /></figure><h3>The biggest winners of 2012–2016 are also the biggest winners of 2003–2007.</h3><p>Interestingly, a similar roster of states seems to have reaped the biggest benefits from both of our most recent periods of growth. States that were growing fast in home value in 2003–2007 also tend to be growing fast now, and states that were growing slower in 2003–2007 tend to be seeing slower growth rates now as well. This correlation is actually statistically significant (for ye statisticians, the p-value is 0.02).</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/747/1*MVLKpzyNEfe6zjXPkQCeYA.png" /><figcaption>Correlation between a state’s home value growth rate in 2012–2016 and its growth rate in 2003–2007. <strong>For an interactive version of this chart, see here: </strong><a href="https://public.tableau.com/views/property_value/2012-2016vs2003-2007growth?:embed=y&amp;:display_count=yes"><strong>https://public.tableau.com/views/property_value/2012-2016vs2003-2007growth?:embed=y&amp;:display_count=yes</strong></a><strong>.</strong></figcaption></figure><p>From this chart we can see that Nevada, Florida, and California are the three biggest victors of both 2012–2016 and 2003–2007. States like Indiana, Ohio, New Mexico, and Maine didn’t fare so well in either period. Most other states followed a similar pattern. Colorado is one of the few exceptions—it’s experiencing the 4th highest growth rate in the U.S. in 2012–2016 but saw a dismal growth rate in 2003–2007.</p><p>The other insight from this chart is that most states experienced more aggressive growth in 2003–2007 than in 2012–2016. Whether or not that’s a good thing is yet to be determined, given that explosive growth in home value doesn’t always mean rainbows and butterflies (as we saw in 2007).</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*wOg9ODPtiEqYMsoH8Jt4Cw.png" /></figure><h3>The faster a state is growing, the more unequal that growth is.</h3><p>It turns out the home value growth rate of a state is also related to how unequal that growth is within the state. In other words, the faster the state’s median growth rate, the bigger the difference between the growth rate of the state’s fastest-growing city and slowest-growing city.</p><p>Let’s take our fastest-growing state Nevada as an example. Median housing value in the Silver State (that’s how Nevada describes itself accordingly to its license plates) is rising at 83%. But that growth is very unequally distributed among Nevada’s cities. There is a difference of 120% between Nevada’s fastest-growing city Fernley (whose median home value is rising at a breathtaking 131%) and its slowest-growing city Laughlin (growing at just 11%). Contrast this to Alaska, whose median growth rate as a state is a humble 9%, but it’s also growing more equitably. The growth rate difference between Alaska’s fastest-growing and slowest-growing city is just 13%. There appears to be a similar trend with other states — the faster a state’s median housing value is rising, the wider the spread in growth rate among the cities in that state. And vice versa.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/729/1*j-B0JgapSwnaH1iFYt_U-g.png" /><figcaption>Correlation between a state’s median home value growth rate and the spread in growth rate among cities in that state. <strong>For an interactive version of this chart, see here: </strong><a href="https://public.tableau.com/views/property_value/stategrowthvsinequality?:embed=y&amp;:display_count=yes"><strong>https://public.tableau.com/views/property_value/stategrowthvsinequality?:embed=y&amp;:display_count=yes</strong></a><strong>.</strong></figcaption></figure><p>The statistical significance of this correlation is even stronger (p-value is &lt; 0.0001). From the chart above, it’s also interesting to see that basically no state falls in that magical lower-right quadrant of “Growing fast as a state while keeping inequality among cities low.” New York and Maine have the distinct honor of stagnating (or declining) in median state housing value while also having high inequality among their cities. California is actually the most unequal state, with a spread of 159% between its fastest-growing city (Vallejo, growing at 158%—located in the Bay Area) and slowest-growing city (Bishop, declining at 1% — located about halfway between Yosemite and Sequoia National Park). Rising tide is definitely not lifting all boats equally; in some cases it’s not lifting certain boats at all.</p><p>It’s probably not shocking to anyone that what city you buy your condo in matters a ton from an investment perspective (and other perspectives). But it was surprising to me just how huge of a difference it could make, even among cities in the same state. Naranja, Florida? Jackpot. 117% rise in value in the past four years. Havana, Florida? Not so much. Your 2-bedroom condo has actually lost 20% in value between 2012 and 2016. Ouch.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/640/1*4V3peYdKQy1O4JtwgnwEYA.png" /></figure><h3>You think San Francisco’s housing market is out of control? Take a look at Oakland.</h3><p>To see how these trends play out on a more micro level, I dug into seven cities in the U.S. that I’ve lived in at some point or gotten to know on a deeper level. I was curious to know what the growth trajectory looks like for these cities and how unequal that growth is among neighborhoods in the same city. Here are the magnificent seven: Los Angeles, CA; Oakland, CA; San Francisco, CA; Chicago, IL; Detroit, MI; Boston, MA; New York, NY.</p><p>Before I show a box-and-whisker plot below about our seven cities, I’ve included an explanation on how box-and-whisker plots work in general for folks who are newer to them. I certainly didn’t know how to read these prior to taking my <a href="https://generalassemb.ly/education/data-analytics">data analytics class</a>. Feel free to skip this explanation below if you’re already a stats expert.</p><blockquote>A box-and-whisker plot usually looks something like this image below. There are five horizontal lines in the chart (they would be vertical lines if the plots are rotated 90 degrees as they sometimes are).</blockquote><figure><img alt="" src="https://cdn-images-1.medium.com/max/297/1*LW_qtNqAl8SlT6jaoOKHwg.png" /></figure><blockquote>The line at the very top represents the maximum value in the dataset. Imagine, for example, that we have a dataset with the current age of the Backstreet Boys — 42 (for Howie), 36 (for Nick), 44 (for Kevin), 41 (for Brian), and 38 (for A.J.). In this example, the maximum value would be 44. Kevin has come a long way from his boy band days. The line at the very bottom represents the minimum value, so that would be 36 in our Backstreet Boys example.</blockquote><blockquote>To figure out the value for the other three lines, we need to rearrange the Boys’ ages in order, so something like 36, 38, 41, 42, 44. Then, the median is the value that’s in the middle or halfway from either end of the dataset (so 41 in this case), the 1st Quartile is the value that’s one-fourth of the way from the smallest item in the dataset (so the 1st Quartile would be 38 in this case), and the 3rd Quartile is the value that’s one-fourth of the way from the largest item in the dataset (so the 3rd Quartile would be 42 in our example).</blockquote><blockquote>So in one chart, you’re able to see the max, min, and median, plus you get a visual sense of the spread between max and min and where most of the items in the dataset fall between max and min. Pretty powerful stuff.</blockquote><blockquote>That’s my attempt to show you the meaning of being box-and-whiskered. But now it’s time to quit playing games with my post and get back to the subject at hand.</blockquote><figure><img alt="" src="https://cdn-images-1.medium.com/max/637/1*8oyjcEhgKG8_KJWIYb-gOg.png" /><figcaption>2012–2016 home value growth rates in seven different cities. <strong>For an interactive version of this chart, please see: </strong><a href="https://public.tableau.com/views/property_value/cities-boxwhisker?:embed=y&amp;:display_count=yes"><strong>https://public.tableau.com/views/property_value/cities-boxwhisker?:embed=y&amp;:display_count=yes</strong></a><strong>.</strong></figcaption></figure><p>Let’s look at just the median growth rates for a second, which are represented by the horizontal line in the middle of the rectangle for each city. That’s what this chart is sorted by in ascending order from left to right. What this shows is that Oakland’s median home value growth rate (taking into account the growth rate of all the neighborhoods within Oakland) is the fastest among these seven cities in 2012–2016. The <a href="https://public.tableau.com/views/property_value/cities-boxwhisker?:embed=y&amp;:display_count=yes">interactive version of this chart</a> goes into more details, but to be precise, Oakland’s median growth rate is 106%, which is almost 2x the median growth rate of San Francisco (61%), 4x the national median growth rate (26% as mentioned near the beginning of this post), and 4.4x the median growth rate of Chicago (23%). Chicago has grown the slowest among these seven cities and is the only one that’s below the national median. One caveat here is that Zillow has very limited data on Detroit, so the Motor City’s results might be skewed.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/960/1*QkqEc9nagQfchrMicOA0YA.png" /></figure><p>The fun (and sometimes confusing) thing about box-and-whisker plots is that they can show a variety of metrics within one chart. Let’s take a look next at the spread between max and min, which represents the growth rate difference between each city’s fastest-growing neighborhood and slowest-growing neighborhood. In other words, it shows how unequal the home value growth has been within each city. Here, Oakland “wins” again. Oakland not only has the highest median growth rate, but it’s also growing most unequally, with a 129% difference between its fastest-growing neighborhood (Harrington—by the Fruitvale BART station) and slowest-growing neighborhood (Lakewide—between Downtown Oakland and Lake Merritt). Financially-speaking, this means that Oakland is a market where your return on investment could vary especially dramatically depending on which part of the city you bought your condo in. The good news is that every neighborhood there has seen at least positive growth in 2012–2016.</p><p>Here’s how the spread between max and min looks in all seven cities:</p><ul><li>Oakland: 129% spread (fastest: Harringon | slowest: Lakewide)</li><li>Los Angeles: 71% spread (fastest: West Adams | slowest: West Hills)</li><li>New York: 68% spread (fastest: Williamsburg | slowest: Great Kills)</li><li>Chicago: 65% spread (fastest: Old Irving Park | slowest: East Hyde Park)</li><li>San Francisco: 59% spread (fastest: Bayview | slowest: Nob Hill)</li><li>Detroit: 44% spread (fastest: Grandale | slowest: Warrendale)</li><li>Boston: 25% spread (fastest: East Boston | slowest: West Roxbury)</li></ul><p>Another thing to note is that San Francisco’s home value growth is actually <em>less </em>unequal than that of Oakland, LA, New York, or Chicago. This was surprising to me, given SF’s reputation for having almost inhumane-level prices. Turns out while San Francisco might have extremely high <em>absolute</em> home values, those home values have actually grown more slowly compared to cities like Oakland, and SF’s growth has actually been distributed more equally among its neighborhoods compared to many other major cities.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/640/1*qCAeuIc0_j4LI1AIGUllvA.jpeg" /></figure><p>Finally, in case you’re wondering: the fastest-growing neighborhood in the whole country (that Zillow has data for) is, in fact, Harrington in Oakland, California, whose housing value has increased 168% in the 2012–2016 period. The U.S. neighborhood that’s grown the slowest is Weston, located in the city of Winston-Salem in North Carolina, which has actually declined by 31%. That’s almost a 200% difference from Harrington!</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/800/1*wop7aafpzFTqw4yWj3DGRw.png" /></figure><h3>Takeaways, recommendations, further exploration, learnings</h3><p>To summarize the biggest takeaways from this analysis:</p><ul><li>U.S. home value has increased a lot over the past four years. That rising tide has lifted most but not all boats, and it’s lifted them very unequally. This is true on every level—national, state, city, and neighborhood.</li><li>The biggest winners in this period of growth have been Florida, Michigan, and the West. Among the seven cities I dived deeper into, Oakland is growing by far the fastest, followed by San Francisco.</li><li>The regions of the country seeing the slowest growth (and sometimes negative growth) in 2012–2016 have been the Great Plains area, the Midwest, and the East. Among the seven cities I dived deeper into, Chicago’s median growth rate has been the most sluggish.</li><li>There is a strong, positive correlation between how fast a state has grown in 2012–2016 and how fast it grew in 2003–2007.</li><li>There is an even stronger, positive correlation between a state’s growth rate in 2012–2016 and how unequal that growth has been within the state (the faster the growth, the wider the difference in growth among cities in that state).</li></ul><figure><img alt="" src="https://cdn-images-1.medium.com/max/675/1*AOajJNpFHvnyklgYAZmARA.png" /></figure><p>Recommendations I’d make based on this project:</p><ul><li>If you’re thinking about buying a home partly for investment purposes, make sure you do research into growth trends on the state, city, and neighborhood level. There could be wide variations on every one of those levels. This is probably not shocking.</li><li>A similar roster of states (e.g. California, Florida, Nevada) have done very well in both periods of recent growth. More longitudinal analysis is needed but this could mean that these are good states to consider investing in especially when we’re about to enter another period of housing market growth.</li></ul><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*YOoxp1Pge2D_-iVWrpJcSg.png" /></figure><p>Further exploration that could add additional color to this analysis:</p><ul><li>Regarding the correlation between a state’s growth rate and the inequality of that growth—does the same trend hold on the city level? In other words, is there also a strong positive correlation between how fast a city’s home value is growing and how big the difference in growth rate is among that city’s neighborhoods?</li><li>Similarly, does the correlation between growth rate in 2012–2016 and growth rate in 2003–2007 also apply on the city level?</li><li>Is there any relationship between how quickly a region is growing in 2012–2016 and how quickly that region declined in the post-2007 recession? Are certain states simply more volatile (win big in times of growth and lose big in times of decline), or have the same states been “winning” (/declining the least) through each period?</li><li>Why I want to learn more data science: I would love to be able to create a model that predicts which states/cities/neighborhoods will grow the most in the future.</li></ul><figure><img alt="" src="https://cdn-images-1.medium.com/max/480/1*_ybqawISVhB10vXQIFI-VA.png" /></figure><p>This has been the most time-consuming data analysis project I’ve done to date. Here are some of my biggest learnings from the process:</p><ul><li>The more data you have, the more disciplined you need to be about defining the focus of your analysis upfront. I spent about 20 hours total on this project, and 10+ of those hours were spent going down analytical rabbit holes, changing my mind about what direction to go in, and then going down more rabbit holes related to the new direction. Over the over and over again. The sheer volume and complexity of the Zillow datasets didn’t help, as they presented a lot of distracting “shiny objects” AKA possible questions I could have answered. I became an analyst without direction, spending a lot of time excavating answers with Excel and SQL before I knew which questions I really wanted to find answers for. A much better process would be for me to (1) get some initial, high-level understanding of my data, (2) decide what questions I most want to answer using my data and limit the number of questions to just a few (this step is usually already done for you if you’re doing data analysis for a company or class), and (3) do the actual analysis to get answers to those targeted questions (which is almost never the hardest part). And reiterate through those steps as the need arises.</li><li>Tools matter. In trying to figure out what regions of the country grew the fastest in 2012–2016, I first attempted to plot growth rates on a map of the United States by hand, using the <a href="https://www.google.com/mymaps">custom Google Maps app</a>. The app is fantastic in so many ways, but Tableau can (and ultimately did) get the job done in one-tenth of the time. Same goes for making scatterplots in Excel versus in Tableau.</li><li>Medium and Tableau are not friends yet. This was the first data project when I used Tableau extensively for my visualizations, for the reasons mentioned above. Tableau visualizations are fast, slick, and interactive. But unfortunately you can’t embed them into Medium posts yet. I ended up having to screenshot my visualizations in order to add them into this post as still graphics. So be sure to take a look <a href="https://public.tableau.com/profile/annie.lin4685#!/vizhome/property_value/national-map">here</a> as well for the original, interactive visualizations!</li></ul><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=632499f7294a" width="1" height="1" alt="">]]></content:encoded>
        </item>
    </channel>
</rss>