<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0" xmlns:cc="http://cyber.law.harvard.edu/rss/creativeCommonsRssModule.html">
    <channel>
        <title><![CDATA[DataSCOUT - Medium]]></title>
        <description><![CDATA[A data science enterprise focused in getting insights from any kind of data using concepts of complex systems, statistical learning theory and artificial intelligence - Medium]]></description>
        <link>https://medium.com/datascout?source=rss----49043b7d8339---4</link>
        <image>
            <url>https://cdn-images-1.medium.com/proxy/1*TGH72Nnw24QL3iV9IOm4VA.png</url>
            <title>DataSCOUT - Medium</title>
            <link>https://medium.com/datascout?source=rss----49043b7d8339---4</link>
        </image>
        <generator>Medium</generator>
        <lastBuildDate>Tue, 17 Nov 2026 10:26:04 GMT</lastBuildDate>
        <atom:link href="https://medium.com/feed/datascout" rel="self" type="application/rss+xml"/>
        <webMaster><![CDATA[yourfriends@medium.com]]></webMaster>
        <atom:link href="http://medium.superfeedr.com/" rel="hub"/>
        <item>
            <title><![CDATA[Insights from data visualization]]></title>
            <link>https://medium.com/datascout/insights-from-data-visualization-edf02febfa9e?source=rss----49043b7d8339---4</link>
            <guid isPermaLink="false">https://medium.com/p/edf02febfa9e</guid>
            <category><![CDATA[data-science]]></category>
            <category><![CDATA[maps]]></category>
            <category><![CDATA[animation]]></category>
            <category><![CDATA[data-visualization]]></category>
            <category><![CDATA[r]]></category>
            <dc:creator><![CDATA[Charles Novaes de Santana]]></dc:creator>
            <pubDate>Fri, 21 Jun 2019 23:22:31 GMT</pubDate>
            <atom:updated>2019-03-12T00:52:32.492Z</atom:updated>
            <content:encoded><![CDATA[<p>Data visualization is a great way of getting insights from data. This is particularly true when we consider geo-referenced data. Let me give you a simple example:</p><p>Here I used demographic data from Brazilian UNDP (the UN Development Programme) <a href="https://github.com/abjur/abjData">made available by ABJ</a> (the Jurimetrics Brazilian Association). This dataset contains more than 200 metrics related to quality of life in each of the 5570 cities in Brazil from 1991 to 2010.</p><p>Brazil is such a diverse country! And this diversity can be observed when you see the variability of one of those indexes in space by plotting a map with colours representing the index for example. And with a little bit of “action” we can see how this diversity is also evolving in time.</p><p>Below I show an animation made in R that shows the “% of adults that completed the fundamental education” in each city of the country in each year from 1991 to 2010. The lighter is the colour, the higher is the proportion of adults with fundamental education. In each time step it is possible to see that the cities located more to the North and Northeast regions in Brazil have lower proportion of adults with formal education than the other regions of the country. On the other hand, the animation shows how this proportion is increasing along last years and how the “light of education” is spreading across the country.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/480/1*bPCJjPvyk5P4FAX39zYzjw.gif" /></figure><p>A simple map changing in time, and we can have a glimpse about the evolution of education in Brazil: still in bad conditions, but moving forward “in all directions”.</p><p><a href="https://www.linkedin.com/feed/hashtag/?keywords=%23datavisualization">#datavisualization</a> <a href="https://www.linkedin.com/feed/hashtag/?keywords=%23datascience">#datascience</a></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=edf02febfa9e" width="1" height="1" alt=""><hr><p><a href="https://medium.com/datascout/insights-from-data-visualization-edf02febfa9e">Insights from data visualization</a> was originally published in <a href="https://medium.com/datascout">DataSCOUT</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Insights from social media data mining]]></title>
            <link>https://medium.com/datascout/insights-from-social-media-data-mining-a60cb20bb47f?source=rss----49043b7d8339---4</link>
            <guid isPermaLink="false">https://medium.com/p/a60cb20bb47f</guid>
            <category><![CDATA[data-science]]></category>
            <category><![CDATA[machine-learning]]></category>
            <category><![CDATA[r]]></category>
            <category><![CDATA[data-mining]]></category>
            <category><![CDATA[python]]></category>
            <dc:creator><![CDATA[Charles Novaes de Santana]]></dc:creator>
            <pubDate>Fri, 21 Jun 2019 23:22:05 GMT</pubDate>
            <atom:updated>2019-01-14T19:38:51.726Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*tN-B7QwUrIYhMhauB4xNtw.png" /></figure><p>Social media is a incredible source of data today. Besides the data that is accessible only to the social media companies themselves (data that is key for most of social media companies business models) there is also a lot of data freely available to the general public via APIs (Application Programming Interfaces) implemented in different programming languages. One of the social media I like to gather data the most is Twitter, because in my opinion its API gives access to more interesting data than most of the other social media APIs (like the location of the users, and the IDs of the retweets).</p><p>Below I will describe a simple example in which I use data (text) mining, data preparation, and data visualization to get insights about some topic of interest discussed in Twitter. I used R as my main programming language. I used the <a href="https://cran.r-project.org/web/packages/twitteR/index.html">R implementation of the Twitter API </a>to get the data; I used the R library <a href="https://dplyr.tidyverse.org/">dplyr</a> to manipulate and clean the data; and I used the R library <a href="https://ggplot2.tidyverse.org/">ggplot2</a> to plot the figures.</p><p>I searched for the 1000 most popular posts shared between 01.12.2018 and 13.01.2019 that included in the text the following terms: <em>“job + datascience”, ”job + machinelearning”,”job + datascience + R”,”job + datascience + python”,”job + machinelearning + R”,”job + machinelearning + python&quot;.</em></p><p>My plan was the following: to have an idea about the job offers related to data science, machine learning and the programming languages R and Python shared in Twitter. What are the most shared job offers? Who are the most popular users sharing those tweets? Let’s find it below:</p><p><strong>Most popular users sharing job offers about “data science” with Python and with R</strong></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*yXRy4I7QJgygWo7vf5AcOA.png" /><figcaption>Figure 1. Data Science job announcements in Twitter related to “R” (red) and to “Python” (blue)</figcaption></figure><p><strong>Most popular users sharing job offers about “machine learning” with Python and with R</strong></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*C7k2bLYpziOcgj2Y6HUBHQ.png" /><figcaption>Figure 2. Machine Learning job announcements in Twitter related to “R” (red) and to “Python” (blue)</figcaption></figure><p><strong>Most popular users sharing job offers about “R”</strong></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*An0-G6nvZIuTFZTY3UiitA.png" /><figcaption>Figure 3. R job announcements in Twitter related to “datascience” (red) and to “machinelearning” (blue)</figcaption></figure><p><strong>Most popular users sharing job offers about “Python”</strong></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*QewzrdSZqrGLNZL7mZmzzg.png" /><figcaption>Figure 4. Python job announcements in Twitter related to “datascience” (red) and to “machinelearning” (blue)</figcaption></figure><p><strong>Insights</strong></p><p>The first thing that came to my mind after seeing the figures above was the fact that there were really many more Job advertisements talking about “Python” than ads about “R”, for both, “datascience” and “machinelearning” ads. We can see it clearly in figures 1 and 2 because there are many more blue bars than red ones.</p><p>Another interesting finding is that R appears in more advertisements for data science than for machine learning. We can see it in figure 3, where the red bars are bigger than the blue ones. Although data science and machine learning usually go together in many job offers, there are important differences that explain why R seems to be a “data science niche” language. R was initially created as a programming language for statistical computing. Data Science is about data analysis, so it is natural that R is a popular programming language in this field. Machine learning is about Artificial Intelligence, it is something more than data analysis: it is also about algorithms.</p><p>Python is a general use programming language very popular among computer scientists. It has a diverse number of libraries for many applications, including statistical computing and artificial intelligence. This characteristic explains a bit why in figure 4 the blue bars are as big as the red ones: there are as many data science job offers asking for Python as machine learning ones.</p><p>I know it is not something new, as Python is making a great job in most of the <a href="https://www.zdnet.com/article/programming-language-of-the-year-python-is-standout-in-latest-rankings/">rankings</a> about programming languages popularity, but it is really cool to find this insight also through this tiny twitter data mining experiment.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=a60cb20bb47f" width="1" height="1" alt=""><hr><p><a href="https://medium.com/datascout/insights-from-social-media-data-mining-a60cb20bb47f">Insights from social media data mining</a> was originally published in <a href="https://medium.com/datascout">DataSCOUT</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Data Science]]></title>
            <link>https://medium.com/datascout/data-science-89889dbb5665?source=rss----49043b7d8339---4</link>
            <guid isPermaLink="false">https://medium.com/p/89889dbb5665</guid>
            <category><![CDATA[data-science]]></category>
            <category><![CDATA[careers]]></category>
            <category><![CDATA[statistics]]></category>
            <category><![CDATA[programming]]></category>
            <category><![CDATA[machine-learning]]></category>
            <dc:creator><![CDATA[Charles Novaes de Santana]]></dc:creator>
            <pubDate>Fri, 21 Jun 2019 23:21:43 GMT</pubDate>
            <atom:updated>2019-01-12T17:14:09.017Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*zlt_wRZCGofSbmSqduds9w.png" /></figure><p>Data Science is a field in expansion. Many professionals are changing their careers towards the “sexiest job of the world”. And 10 years ago it was not even a job title. The recent and astonishing availability of data in different businesses asked for an increasing number of professionals with technical skills in areas like Statistics, Computer Programming, Distributed Systems, Datawarehouse, Software Engineering.</p><p>However, a Data Scientist is not only about technical skills. More than just being a professional working with data, a Data Scientist is… a Scientist! And that means a lot!</p><p>A Scientist is a professional that is concerned about methods. The scientific method involves making hypotheses, deriving predictions from them as logical consequences, and then carrying out experiments or empirical observations based on those predictions. In other words: it is about asking questions, answering those questions based on logical inferences, and testing if the putative answer is correct (of if it is false).</p><p>To know the best programming language, the best database, and to have access to the best high performance computing structure is not a guarantee that you are doing Data Science. You need to be a Scientist! To be skeptic, to doubt your own hypothesis, to test before sharing the answer you found, and, ultimately, you need to communicate your findings in a comprehensive way.</p><p>That is the challenge! To get information from the huge amount of data available in different fields by using cutting-edge technology and the appropriate scientific approach. That is our passion!</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=89889dbb5665" width="1" height="1" alt=""><hr><p><a href="https://medium.com/datascout/data-science-89889dbb5665">Data Science</a> was originally published in <a href="https://medium.com/datascout">DataSCOUT</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
    </channel>
</rss>