<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0" xmlns:cc="http://cyber.law.harvard.edu/rss/creativeCommonsRssModule.html">
    <channel>
        <title><![CDATA[@natashaborders - Medium]]></title>
        <description><![CDATA[Data scientist with passion for supporting creators of all sorts. - Medium]]></description>
        <link>https://medium.com/natashaborders?source=rss----5dc5aab5cafc---4</link>
        <image>
            <url>https://cdn-images-1.medium.com/proxy/1*TGH72Nnw24QL3iV9IOm4VA.png</url>
            <title>@natashaborders - Medium</title>
            <link>https://medium.com/natashaborders?source=rss----5dc5aab5cafc---4</link>
        </image>
        <generator>Medium</generator>
        <lastBuildDate>Tue, 17 Nov 2026 00:25:18 GMT</lastBuildDate>
        <atom:link href="https://medium.com/feed/natashaborders" rel="self" type="application/rss+xml"/>
        <webMaster><![CDATA[yourfriends@medium.com]]></webMaster>
        <atom:link href="http://medium.superfeedr.com/" rel="hub"/>
        <item>
            <title><![CDATA[Does Book Success Translate into Movie Success?]]></title>
            <link>https://medium.com/natashaborders/does-book-success-translate-into-movie-success-e9d36bda8a0f?source=rss----5dc5aab5cafc---4</link>
            <guid isPermaLink="false">https://medium.com/p/e9d36bda8a0f</guid>
            <category><![CDATA[linear-regression]]></category>
            <category><![CDATA[k-means-clustering]]></category>
            <category><![CDATA[natasha-borders]]></category>
            <category><![CDATA[entertainment]]></category>
            <category><![CDATA[data-science]]></category>
            <dc:creator><![CDATA[Natasha Borders]]></dc:creator>
            <pubDate>Sat, 20 Apr 2019 19:38:41 GMT</pubDate>
            <atom:updated>2019-04-20T19:38:40.912Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*494Zt3R4wuX6jGEE93bGyg.jpeg" /><figcaption>Photo by <a href="https://unsplash.com/photos/HH4WBGNyltc?utm_source=unsplash&amp;utm_medium=referral&amp;utm_content=creditCopyText">Jaredd Craig</a> on <a href="https://unsplash.com/search/photos/books?utm_source=unsplash&amp;utm_medium=referral&amp;utm_content=creditCopyText">Unsplash</a></figcaption></figure><p>From the moment I learned about the web scraping techniques at Metis and was told I had to use them in this project, I knew I had to reach for the stars. Web scraping had always seemed to me something akin to magic, the machine coming alive and behaving like a person in order to swiftly and confidently retrieve any information I desired from the most dense of websites. My stars were quite literal — I decided to take a look at the ratings of the books which had become movies and see if I could predict the movie ratings based on the rating of the source book.</p><p>Retrieving the data was an interesting and challenging procedure, introducing me to the intricacies of HTML, and the aforementioned wizardry of <a href="https://pypi.org/project/beautifulsoup4/">Beautiful Soup</a> and <a href="https://www.seleniumhq.org/">Selenium</a>. While Beautiful Soup worked great for the majority of my fellow Metis students, who were perusing the table-heavy government websites and pokemon stats, I was going after the constantly-updated <a href="https://www.goodreads.com/">Goodreads</a> and <a href="https://www.imdb.com/">IMDb</a> listings, the latter full of pop-up trailers and ads. Selenium proved to be more useful for me, and I really enjoyed the functionality of being able to iterate through multiple pages of results and searching for movie titles on the fly. Additionally, I investigated the <a href="https://www.goodreads.com/api">Goodreads API</a>, but found that it was less ideally suited for my project.</p><p>Once the data was collected, cleaned and transformed, I ended up with about 700 books which were made into a movie, with the results lagging by about 1 year as I also had to supplement my scraped data with a readily available <a href="https://www.kaggle.com/rounakbanik/the-movies-dataset">Kaggle</a> dataset featuring the information from MovieLens.</p><p>The initial results were somewhat surprising. Here are the top five rated books and movies:</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*HcobaR_C4u4adjpe1ZyJ_Q.png" /><figcaption>Top 5 highest-rated books</figcaption></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*m_Xaj3yqjdwfgFXdh94HuA.png" /><figcaption>Top 5 highest-rated movies</figcaption></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/540/1*vP3FY7H3qDU1BSyXGIsziw.png" /></figure><p>Digging further into the data, I noticed a curious trend. Top movies are produced from books ranging from adequate to great, whereas the best books produce good enough movies, but not necessarily the best. It seems that some lesser liked books produced into good movies gained traction as cult classics, but the book remained forgotten. When the book itself is a hit, such as Harry Potter series or the Lord of the Rings, the movies are well-received but didn’t seem to stand as well on their own.</p><p>After performing linear and ridge regression analysis, I concluded that the book rating alone explains only about 7 % of variation in movie ratings. Combining the book rating with the rest of the features, the regression models explain only about 25 % of the variation in the movie rating (my adjusted R Square for the Ridge Regression was only ~0.25). Clearly, there is much more to how highly a movie is rated than the few features I examined in my model.</p><p>To challenge myself a little bit, and to test a hunch I got while looking at the data, I ran a K-Means Cluster Analysis on the feature data to see if anything interesting might emerge. The model split the data into two clusters, which I dubbed “The Best” and “The Rest”. The difference between the two clusters was not highly pronounced, but I was slightly happier with the results than those from the regression analysis.</p><p>In conclusion, knowing the information about the book alone was not quite enough to successfully predict the rating of a movie based on said book. Some interesting considerations I would love to look into are the variations between the book editions and the movie remakes, as well as bring the monetary considerations into the picture and address the profitability of a movie based on the sales of the source book. This project definitely indulged my love of books and served as a perfect platform to study linear regression in greater detail.</p><p>Overall this was an amazing learning experience, and I am looking forward to applying everything that I learned to the next project at Metis. You can find the materials for this project over at my <a href="https://github.com/natashaborders/Book_to_Movie_Ratings_Predictions">GitHub repo</a>.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=e9d36bda8a0f" width="1" height="1" alt=""><hr><p><a href="https://medium.com/natashaborders/does-book-success-translate-into-movie-success-e9d36bda8a0f">Does Book Success Translate into Movie Success?</a> was originally published in <a href="https://medium.com/natashaborders">@natashaborders</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[First Week At Metis — NYC Commuter Data Analysis with Python]]></title>
            <link>https://medium.com/natashaborders/first-week-at-metis-nyc-commuter-data-analysis-with-python-9da0aa93d3d5?source=rss----5dc5aab5cafc---4</link>
            <guid isPermaLink="false">https://medium.com/p/9da0aa93d3d5</guid>
            <category><![CDATA[data-science]]></category>
            <category><![CDATA[python]]></category>
            <category><![CDATA[pandas]]></category>
            <category><![CDATA[public-transit]]></category>
            <category><![CDATA[natasha-borders]]></category>
            <dc:creator><![CDATA[Natasha Borders]]></dc:creator>
            <pubDate>Sun, 07 Apr 2019 19:43:59 GMT</pubDate>
            <atom:updated>2019-04-07T19:43:59.576Z</atom:updated>
            <content:encoded><![CDATA[<h3>First Week At Metis — NYC Commuter Data Analysis with Python</h3><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*H4NJOl-yek-cysg_7MvUUA.jpeg" /><figcaption>Photo by <a href="https://unsplash.com/photos/OfYuB4Aby1M?utm_source=unsplash&amp;utm_medium=referral&amp;utm_content=creditCopyText">Asael Peña</a> on <a href="https://unsplash.com/search/photos/nyc-turnstile?utm_source=unsplash&amp;utm_medium=referral&amp;utm_content=creditCopyText">Unsplash</a></figcaption></figure><p>The first week of my data science bootcamp at <a href="https://www.thisismetis.com/">Metis</a> just came to an end, and it seems like my fellow aspiring data scientists and me have been in it together for years. Starting from day one we dove into exploratory data analysis head on, with our instructors not pulling any punches and providing us with a lot of freedom in analyzing our very first dataset.</p><p>This was a challenging proposition for me. When my husband, Casey, cheerfully informed me we were moving to California only a few short months prior, I was busy happily running two businesses, <a href="https://bartandgabriel.com/">Bart &amp; Gabriel Pet Sitting</a> and <a href="https://www.hanginglantern.com/">Hanging Lantern</a>, in Columbus, Ohio. But when Google calls, software developer answers, and so we packed up our life and moved to California. As soon as I determined that data science was going to be my new career, based on my passion for solving problems and endless curiosity, I applied to the data science bootcamp with the most meticulous admission process, learned Python, Pandas, and other required tools, and got accepted to Metis for the Spring 2019 cohort.</p><p>Which brings me back to Metis on week one and our first team project, and how surreal it seemed that on day one we would begin being data scientists in earnest. For this project, our imaginary client, Women Tech Women Yes, tasked us with determining where in New York City would be the best spots for sending the street teams to promote their upcoming summer Gala, with two goals of collecting emails from people for future outreach efforts and to send those interested free tickets to the Gala.</p><h4>Our Approach</h4><p>We decided to focus on two main objectives: finding the busiest locations to generate the highest volume of sign-ups for the breadth of outreach, and targeting the most affluent neighborhoods to find those most likely to donate larger amounts to the Gala when attending.</p><p>For our dataset, we downloaded three months worth of <a href="http://web.mta.info/developers/turnstile.html">MTA</a> commuter data from their website, focusing on March through May, since the Gala would be scheduled for early summer. Our main assumption was that the street teams would only be working during the week so we focused on providing actionable insights on where and when they should be stationed for maximum marketing payoff.</p><h4>Cleaning and Organizing the Data</h4><p>When we got a first glimpse of our data, the terminology did not make much sense to us:</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*E9IpNRHY8Hq5TIiJVKdVdg.png" /><figcaption>Raw data sample from our <a href="http://web.mta.info/developers/turnstile.html">MTA</a> dataset.</figcaption></figure><p>We noticed that ENTRIES and EXITS columns conveyed the cumulative turnstile counts throughout each day and did not accurately portray the traffic flow through the stations. As a result, we took the differences between subsequent entries and exits, and aggregated them into a joint Traffic column, where each data point signified the combined number of entries and exits through that turnstile for the four hour period up to the time listed.</p><p>Then we proceeded to remove any outliers (negative numbers generated through errors in the turnstile operation, and removed top 1% of the Traffic entries which were too high to be feasible and most likely occurred due to the turnstile resetting itself and restarting the count at 0. Using <a href="https://www.python.org/">Python</a>, <a href="https://pandas.pydata.org/">Pandas</a>, <a href="https://matplotlib.org/">Matplotlib</a>, and <a href="https://seaborn.pydata.org/">Seaborn</a> libraries, we examined our data and created some visualizations to help us understand the patterns of the commuter traffic through the city.</p><h4>Exploratory Data Analysis</h4><p>The first result we looked at were the busiest stations in NYC overall:</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/407/1*8bo71OlH2ue5ioPf8rz0Ig.png" /><figcaption>Overall Highest Traffic by Volume (March — May 2018)</figcaption></figure><p>Focusing on the traffic by station throughout the week days, we observed that the traffic was fluctuating slightly for the commuter stations of Grand Central and Penn Station, and higher on Fridays for the tourist-heavy Time Square.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/682/1*O5aKrtbeJN_3HAXFdyCyGA.png" /><figcaption>Cumulative Traffic by Weekday (March — May 2018) for Top Five Stations by Overall Volume</figcaption></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/398/1*qay4TTvyZKUgxbn5FJvBRw.png" /><figcaption>Cumulative Traffic at Penn Station on Tuesdays (March — May 2018)</figcaption></figure><p>After looking in a bit more detail at the Tuesday and Thursday traffic at Grand Central and Penn Station, we recommended the street teams target those stations during the morning and evening commuter hours.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/673/1*Ie1z-4Y92WuD9Jkhg8vJCA.png" /><figcaption>Cumulative Traffic at Times Square on Fridays (March — May 2018)</figcaption></figure><p>Times Square looked a bit busier during the afternoon and evening hours on a Friday, making it a good destination for that period for the street teams.</p><p>After examining the data purely by volume, and recommending Women Tech Women Yes to focus on the commuter traffic on Tuesdays and Thursdays and on the evening leisure and commuter crowd at Times Square on Friday nights, we shifted our focus to take a look at the prospective donors who might be residing in more affluent neighborhoods of New York. Examining the Upper East Side (<a href="https://ny.curbed.com/2017/8/4/16099252/new-york-neighborhood-affordability">cited</a> as one of the highest median income neighborhoods in the city), and focusing on the subway stations in the area, the 86th Street station emerged as the one to visit.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/512/1*jP1WxyqbJL6yr9XpBh0XiQ.png" /><figcaption>Cumulative Traffic by Day of the Week (March — May 2018) for Upper East Side Stations</figcaption></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/625/1*AyrqxUJujVRdbe7ox3Ytbg.png" /></figure><p>Considering we had not yet suggested a Wednesday target, the 86th Street appeared as a good place to be during the commuter hours and perhaps over the lunch hours as well.</p><h4>Conclusions</h4><p>Based on the exploratory data analysis we conducted, it was clear that the highest traffic commuter stations would be best targeted during the morning and evening hours, and the tourist leisure centers would prove productive during the Friday afternoon and evening hours. The wealthier commuters could be found in their neighborhood subway station during the same busy hours.</p><h4>Further Exploration Ideas</h4><p>One short week was definitely not enough for us to dissect all the potential insights that could be collected from this vast dataset. Given more time it would have been interesting to consider the intersections of tech-heavy neighborhoods, population of women in tech and women-owned businesses, and targeting those commuters more directly, as well as looking further into the traffic flow throughout Manhattan and other boroughs.</p><p>Our analysis can be found on <a href="https://github.com/natashaborders/MTA_Data_Analysis">GitHub</a>, and the source data can be found at the <a href="http://web.mta.info/developers/turnstile.html">MTA</a> website.</p><p>Reflecting on everything I learned this week, it is amazing to see how quickly one enters the mindset of a data scientist. I am looking forward to the future projects at Metis and beyond, curious to see what further insights they will bring!</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=9da0aa93d3d5" width="1" height="1" alt=""><hr><p><a href="https://medium.com/natashaborders/first-week-at-metis-nyc-commuter-data-analysis-with-python-9da0aa93d3d5">First Week At Metis — NYC Commuter Data Analysis with Python</a> was originally published in <a href="https://medium.com/natashaborders">@natashaborders</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
    </channel>
</rss>