<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0" xmlns:cc="http://cyber.law.harvard.edu/rss/creativeCommonsRssModule.html">
    <channel>
        <title><![CDATA[Stories by Yugant Hadiyal on Medium]]></title>
        <description><![CDATA[Stories by Yugant Hadiyal on Medium]]></description>
        <link>https://medium.com/@yuganthadiyal?source=rss-a87ec029a373------2</link>
        <image>
            <url>https://cdn-images-1.medium.com/fit/c/150/150/1*zCI-4AoR4SgGN_Y8XgUGfw.jpeg</url>
            <title>Stories by Yugant Hadiyal on Medium</title>
            <link>https://medium.com/@yuganthadiyal?source=rss-a87ec029a373------2</link>
        </image>
        <generator>Medium</generator>
        <lastBuildDate>Mon, 16 Nov 2026 18:54:17 GMT</lastBuildDate>
        <atom:link href="https://medium.com/@yuganthadiyal/feed" rel="self" type="application/rss+xml"/>
        <webMaster><![CDATA[yourfriends@medium.com]]></webMaster>
        <atom:link href="http://medium.superfeedr.com/" rel="hub"/>
        <item>
            <title><![CDATA[Unlocking the Secrets to Achieving Success: Tips and Strategies That Work]]></title>
            <link>https://yuganthadiyal.medium.com/unlocking-the-secrets-to-achieving-success-tips-and-strategies-that-work-b282bf7477f8?source=rss-a87ec029a373------2</link>
            <guid isPermaLink="false">https://medium.com/p/b282bf7477f8</guid>
            <category><![CDATA[money]]></category>
            <category><![CDATA[success]]></category>
            <dc:creator><![CDATA[Yugant Hadiyal]]></dc:creator>
            <pubDate>Wed, 12 Apr 2023 15:13:50 GMT</pubDate>
            <atom:updated>2023-04-12T15:13:50.537Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/360/1*_b4JUTIeS1yx1O79LGrQWg.gif" /></figure><p>As humans, we all have dreams and want to succeed in one way or another, but not everyone knows the secrets to success. Often, people think that success only comes to the talented or the lucky ones, but success is attainable for anyone who follows the right tips and strategies.</p><p>In this article, we’ll speak about how to unlock those secrets of achieving success in your life. Whether you are a student, an entrepreneur, an athlete, or someone looking to improve his/her life, these tips and strategies will surely help you in your journey to success.</p><p>1. Define Your Goals</p><p>The first step in achieving success is to define your goals. Without goals, you’ll be like a ship without a destination. You won’t know where to go, and you won’t get anywhere. You can focus your energies and efforts toward achieving specific, measurable, and achievable goals.</p><p>2. Stay Focused</p><p>Once you have set your goals, the next step is to stay focused. Don’t let distractions get in the way of your goals. Stay disciplined, and avoid procrastination. Keep reminding yourself of your goals and why you started on this journey in the first place.</p><p>3. Take Consistent Action</p><p>Success is not a one-time event; it’s a journey. Therefore, you need to take consistent action toward your goals. Take small steps every day, and keep moving forward toward your goals. Don’t beat yourself up if you stumble a couple of times. Keep going!</p><p>4. Develop a Positive Mindset</p><p>Your attitude determines your altitude. If you have a negative mindset, you’ll never achieve success. Therefore, it’s essential to develop a positive mindset. Stay optimistic, have a can-do attitude, and believe in yourself. Surround yourself with positive people who support your goals and aspirations.</p><p>5. Learn from Failure</p><p>Failure is part of the journey to success. Don’t let failure discourage you. Instead, use it as a learning opportunity. Analyze your failures, identify what went wrong, and learn from your mistakes. Use your failures as stepping stones toward your success.</p><p>6. Keep Learning</p><p>Success is a journey of continuous learning. Therefore, keep educating yourself. Keep reading books, attending seminars, and learning from your mentors. Don’t think that you know it all. Keep an open mind, and be willing to learn.</p><p>7. Be Patient</p><p>Success takes time. Don’t expect to achieve success overnight. Be patient, and keep working towards your goals. If you have a long-term vision, you can weather the ups and downs of the journey toward success.</p><p>8. Celebrate Your Wins</p><p>Finally, celebrate your wins, no matter how big or small. Celebrating your achievements will motivate you to keep going towards your goals.</p><p>In conclusion, achieving success is attainable for anyone who follows the right tips and strategies. The journey to success may not be easy, but it’s definitely worth it. Stay focused, take consistent action, develop a positive mindset, learn from your failures, keep learning, be patient, and celebrate your wins. You got this!</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=b282bf7477f8" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[ChatGPT 4: The Future of Human-AI Interaction?]]></title>
            <link>https://yuganthadiyal.medium.com/chatgpt-4-the-future-of-human-ai-interaction-b15a0bb5dd3?source=rss-a87ec029a373------2</link>
            <guid isPermaLink="false">https://medium.com/p/b15a0bb5dd3</guid>
            <category><![CDATA[ai-revolution]]></category>
            <category><![CDATA[chatgpt4]]></category>
            <category><![CDATA[openai]]></category>
            <dc:creator><![CDATA[Yugant Hadiyal]]></dc:creator>
            <pubDate>Wed, 15 Mar 2023 16:57:52 GMT</pubDate>
            <atom:updated>2023-03-15T16:57:52.868Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/911/1*dmCPP5kZvoERHaWGhpQTTA.jpeg" /></figure><h3><strong>Introduction</strong></h3><p>The landscape of human-AI interaction has continuously evolved over the past few years, with artificial intelligence becoming an integral part of our daily lives. AI has been breaking new ground in various domains, from personal assistants to advanced language models. One such breakthrough is the ChatGPT 4, the latest iteration of OpenAI’s language model, which has taken the world by storm with its remarkable capabilities. In this article, we will delve into the exciting innovations that ChatGPT 4 brings and discuss its implications for the future of human-AI interaction.</p><h3>ChatGPT 4 — What’s New?</h3><iframe src="https://cdn.embedly.com/widgets/media.html?src=https%3A%2F%2Fwww.youtube.com%2Fembed%2FhdhZwyf24mE%3Ffeature%3Doembed&amp;display_name=YouTube&amp;url=https%3A%2F%2Fwww.youtube.com%2Fwatch%3Fv%3DhdhZwyf24mE&amp;image=https%3A%2F%2Fi.ytimg.com%2Fvi%2FhdhZwyf24mE%2Fhqdefault.jpg&amp;key=a19fcc184b9711e1b4764040d3dc5c07&amp;type=text%2Fhtml&amp;schema=youtube" width="854" height="480" frameborder="0" scrolling="no"><a href="https://medium.com/media/a1ff6ff5e917e87a0d7c860651248e6b/href">https://medium.com/media/a1ff6ff5e917e87a0d7c860651248e6b/href</a></iframe><p>ChatGPT 4 builds upon the foundations laid by its predecessor, ChatGPT 3. While maintaining the essential features of the previous version, it introduces key improvements that significantly enhance its usability and performance. Some of the most notable advancements include:</p><ol><li>Enhanced language understanding: ChatGPT 4 boasts a deeper understanding of context and nuance, enabling it to generate more accurate and coherent responses to user queries.</li><li>Better multitask learning: ChatGPT 4 can easily juggle multiple tasks, making it more adept at handling complex problem-solving scenarios.</li><li>Improved customization: The new model allows fine-grained control over its behavior, opening doors for personalized and tailored AI applications.</li><li>Real-time collaboration: ChatGPT 4 is now capable of real-time interaction, making it a powerful tool for various applications, from customer support to content creation.</li></ol><h3>The Many Applications of ChatGPT 4</h3><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*mmYDce8bYhGSukz3FsmRxw.jpeg" /></figure><p>The improvements in ChatGPT 4 have significantly expanded its range of potential applications. Here are a few examples of how this cutting-edge AI technology is being used across various industries:</p><ol><li>Customer support: ChatGPT 4 can handle customer queries efficiently and accurately, reducing response times and easing the burden on human support agents.</li><li>Content creation: Bloggers, writers, and marketers are leveraging ChatGPT 4 to brainstorm ideas, generate content, and even edit their work.</li><li>Education: The advanced language model is an interactive learning tool, providing students with instant feedback and guidance on their work.</li><li>Entertainment: ChatGPT 4 can engage users in interactive storytelling, creating immersive and personalized narratives.</li></ol><h3>The Implications and Challenges of ChatGPT 4</h3><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*YtWSuFjSptDMc6bJaPKtbw.jpeg" /></figure><p>While ChatGPT 4 offers numerous benefits, it also raises some concerns and challenges:</p><ol><li>Job displacement: As AI advances, concerns about job displacement in industries such as customer support and content creation are growing. It is crucial to find ways to strike a balance between AI-driven efficiency and human employment.</li><li>Misinformation and malicious use: Advanced AI language models like ChatGPT 4 can be misused to generate fake news or spread misinformation. Robust measures need to be put in place to prevent malicious use.</li><li>Ethical concerns: As AI technology grows increasingly sophisticated, questions about its ethical implications arise. Addressing these concerns requires collaboration between AI developers, policymakers, and society.</li></ol><h3>Conclusion</h3><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*XBL0YbjQwjc1CAX6LU9fvg.jpeg" /></figure><p>ChatGPT 4 is undoubtedly a game-changer in the realm of human-AI interaction. Its impressive capabilities and wide range of applications demonstrate AI&#39;s immense potential for transforming various aspects of our lives. However, it is essential to recognize and address the challenges and implications of such advancements.</p><p>As we move towards a future where AI plays an increasingly prominent role in our daily lives, the key to unlocking its true potential lies in fostering a responsible and balanced approach. By embracing the benefits of AI technology like ChatGPT 4 and addressing the ethical and societal concerns that arise, we can ensure a harmonious future where humans and AI coexist, complement, and empower each other in ways we can only begin to imagine.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/615/1*fAw-fB5ZofpYhVcjIaRP2A.jpeg" /></figure><p>Follow for more :)</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=b15a0bb5dd3" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Travelling from India to Germany [Covid 19 edition]]]></title>
            <link>https://yuganthadiyal.medium.com/travelling-from-india-to-germany-covid-19-edition-dad7775c59e5?source=rss-a87ec029a373------2</link>
            <guid isPermaLink="false">https://medium.com/p/dad7775c59e5</guid>
            <category><![CDATA[india]]></category>
            <category><![CDATA[germany]]></category>
            <category><![CDATA[traveling]]></category>
            <category><![CDATA[coronavirus]]></category>
            <dc:creator><![CDATA[Yugant Hadiyal]]></dc:creator>
            <pubDate>Mon, 26 Apr 2021 18:21:41 GMT</pubDate>
            <atom:updated>2021-04-26T18:21:41.521Z</atom:updated>
            <content:encoded><![CDATA[<p>First of all, I want to mention that the covid-situation in India is super messed up right now.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/834/1*wQO14M0Ttj-7NSZE2QitTw.jpeg" /></figure><p>At the moment there are different types of coronavirus mutations have found in India and because of that, many countries are implementing tightened travel restrictions regarding the travel from and to India.</p><p>This article will be useful to the people with Residence Permit or German Passport because right now only those are allowed to travel to Germany.</p><p>You need a Covid negative test result with the swab time not exceeding 48 hours before entering in Germany. This can be challenging because right now it is hard to get your test results within 48 hours in some places in India.</p><p><strong>Below are the steps to travel:</strong></p><ul><li>Book the tickets</li><li>Get the corona test results fulfilling the <a href="https://www.auswaertiges-amt.de/en/coronavirus/2317268">travel criteria</a></li><li>Do the digital registration: <a href="https://www.einreiseanmeldung.de/#/">https://www.einreiseanmeldung.de/#/</a></li><li>Board the flight!</li></ul><p>After coming to Germany, 14 days quarantine is mandatory[without any exemptions] because India is declared a ‘virus variant area’.</p><p>I hope this will help. Happy journey :)</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=dad7775c59e5" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Text Data: Preprocessing]]></title>
            <link>https://yuganthadiyal.medium.com/text-data-preprocessing-7773225cbed0?source=rss-a87ec029a373------2</link>
            <guid isPermaLink="false">https://medium.com/p/7773225cbed0</guid>
            <category><![CDATA[text-data]]></category>
            <category><![CDATA[machine-learning]]></category>
            <dc:creator><![CDATA[Yugant Hadiyal]]></dc:creator>
            <pubDate>Fri, 21 Dec 2018 08:50:26 GMT</pubDate>
            <atom:updated>2018-12-21T08:50:26.841Z</atom:updated>
            <content:encoded><![CDATA[<p>Clean it before use it ;)</p><p>Nowadays, we often see chatbot on roughly every popular website. This trend became so mainstream and several tech-giants have released their API to make chatbots. This kind of services mainly includes Speech to Text, Text to Speech, Natural Language Processing and other processes.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*0KK7P-YYIR2Y00H95PnBUw.png" /><figcaption>by Marketeer.co</figcaption></figure><p><strong>The definition of NLP in laymen terms :</strong></p><p><em>“ The branch of computer science where engineers and scientists develop some algorithms or software to make computer able to understand human languages where most used language is English”</em></p><p>Why it is so hard to make it a reality? The answer is ‘computers only understand binary’. Then how these all chatbot things are working? Because after years of research and development, now we have achieved some progress in this field. Now the computers understand emotions, grammar and can even guess what you are going to type.</p><p>That’s not from a sci-fi movie that is today’s reality. We all use Google for anything we are thinking about. We just type in and hit enter and we are surfing. Look at the below image.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/595/1*STw0sH_PkDpsy_Nc4TYSeg.jpeg" /></figure><p>This one is exaggerating but we do make spelling mistakes and google just ask us ‘<strong><em>Did you mean:’</em></strong> and we click on the link or ignore it. But this is the most common use of NLP we are leveraging so far in our day to day life. It also includes autocorrecting in your smartphone’s keyboard. One more example of NLP is <strong>medium</strong> showing us that how much time it would take to read the article properly. I hope now we are clear about NLP. Let’s dive deeper.</p><p>There are numerous things to do before we actually consume the text data to train our ML models. We have to make sure that the data we are giving to the model is not containing misleading information. Even for TF-IDF, we have to make sure that we remove numbers, symbols and stop-words, etc… That will make TF-IDF implementation efficient.</p><p>For a given passage for say 1000 words. There will be so many unnecessary words in it which demand some cleaning. For an instance imagine that you are counting the repetition of each word from the passage and in this case, you might get words with most repetition like ‘a’, ‘this’, ‘the’ and ‘somebody’s name’.</p><p>Therefore we need to remove them. For that, you can use <a href="https://pypi.org/project/textcleaner/">textcleaner</a> python library. This library has a main_cleaner module which can do all the basic operations needed to carry out on the text data. At the result, you will get a clean dataset ready for crunching.</p><p><strong><em>I would like to mention some issues which people in the NLP field faces often:</em></strong></p><ul><li>blank lines in the data</li><li>full stops and new line [‘\n’]</li><li>spelling mistakes</li><li><a href="https://en.wikipedia.org/wiki/Stop_words">stop words</a></li><li>punctuations and numbers</li><li>rare words</li></ul><p><strong><em>Some routine processes:</em></strong></p><ul><li>lowercasing all the data</li><li>counting words</li><li>tokenizing</li><li>stemming and lemmatization</li><li>TF-IDF</li><li>BoW</li><li>Word Embedding</li><li>generating a dictionary</li></ul><p>These all things were so repetitive that a python library was needed to ease it out.</p><p>More advanced preprocessing methods are sentimental analysis, aspect analysis, Word2Vec, Sent2Vec, N-gram, Skip gram and many more. Though the mentioned library does not contain all the methods at this stage, it is able to do some basic operations which can help to reduce the pain.</p><p>Thanks for your time. Visit the <a href="https://github.com/YugantM/textcleaner">repo</a> of library.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=7773225cbed0" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Textcleaner : a data pre-processing library]]></title>
            <link>https://yuganthadiyal.medium.com/textcleaner-a-data-pre-processing-library-1a234eec02dd?source=rss-a87ec029a373------2</link>
            <guid isPermaLink="false">https://medium.com/p/1a234eec02dd</guid>
            <category><![CDATA[data-science]]></category>
            <category><![CDATA[data-cleaning]]></category>
            <category><![CDATA[python]]></category>
            <category><![CDATA[streaming]]></category>
            <category><![CDATA[nlp]]></category>
            <dc:creator><![CDATA[Yugant Hadiyal]]></dc:creator>
            <pubDate>Wed, 19 Dec 2018 11:08:07 GMT</pubDate>
            <atom:updated>2018-12-20T07:37:10.655Z</atom:updated>
            <content:encoded><![CDATA[<h3><a href="https://pypi.org/project/textcleaner/">Textcleaner</a> : a data pre-processing library</h3><p>It is hassle-free and saves time.</p><p>What lead you to this article? Is it NLP or anything related to text data? If the answer is yes then dive in.</p><p>In the field of data science, we often see people discussing that most of the data scientist is only cleaning the data and people think that this is the core part of the whole learning graph. That’s where it hit me like “that’s not true people working hard to achieve something rather than just cleaning data”. But on the contrary, I found that it is not totally wrong. People do waste their time on these things.</p><p>In my free time, I started thinking about some projects which I have done for academic purpose where I was spending a considerable amount of time on these things. Similarly, in my pursuit of being a successful data scientist, I often face this kind of similar issues.</p><p>So this time on my console I was not only cleaning the data but making a library which can serve lots of developers all over the world. I decided to solve these problems and wanted to make it available to everyone.</p><p>Thanks to medium, I found an article on how to do this. I was totally unaware about the process of listing your python module on python index. Have you ever thought about how it feels when you type into your command prompt “pip install &lt;your_module_name&gt;” and it works? Sounds thrilling right!</p><p>Here is this <a href="https://medium.com/@joel.barmettler/how-to-upload-your-python-package-to-pypi-65edc5fe9c56">article</a> which will help you to do so if you are interested.</p><p>Let’s talk about this utility. I have made several functions which you can use to clean your text file. I will recommend you to use the main_cleaner() because it contains all the typical methods to clean data. There are two types of methods available primary and advanced. Primary functions do the work like cleaning blank lines from the text, cleaning numbers, cleaning symbols and alike. Advanced features are like stemming, lemmatization, stop words removal and so on.</p><p>textcleaner contains total 10 methods which are described below :</p><p>Follow this link for usage and installation: <a href="https://github.com/YugantM/textcleaner">link</a></p><p>0. <strong>main_cleaner(&lt;FILE_NAME&gt;,op=&lt;options&gt;)</strong></p><p>Pass a text file to this function and it will return you a list of list of words. This list will be structured as a group of words per sentence. If you just want to get all the words then set ‘<strong><em>op</em></strong>’ to ‘<strong><em>words</em></strong>’ and it will return a flat list. details value of ‘<strong><em>op</em></strong>’ is ‘<strong><em>sents</em></strong>’.</p><h3>Primary</h3><ol><li><strong>clear_balnk_lines(&lt;FILE_NAME&gt;)</strong></li></ol><p>This function accepts a file name as an argument and will return a list of list. Meanwhile, it will also remove unnecessary blank lines from the text.</p><p>2. <strong>strip_all(&lt;list&gt;)</strong></p><p>Strips from the whole text where its default value is ‘.\n’ which means it will remove all the full stop and newline from the end of every line of the passage.</p><p>3. <strong>lower_all(&lt;list&gt;)</strong></p><p>It is important to convert it to lowercase because when you will want to compare words from the data or something it will not work as you though because of the case sensitivity.</p><p>4. <strong>remove_numbers(&lt;list&gt;) , remove_symbols(&lt;list&gt;)</strong></p><p>Removes numbers and punctuations from anywhere of the text it is fed. It uses the regular expression to achieve this.</p><h3>Advanced</h3><p>5. <strong>remove_stopwords(&lt;lsit&gt;)</strong></p><p>When some text data is given to you which is a bit huge, let’s say it is 5 MB. In this case, you definitely don’t want any problem passing the data from one function to another. So you will need to remove words with less meaning.</p><p>For example: “Your dog is a husky” main entities here which will be useful are <em>dog</em> and <em>husky.</em></p><p>For extracting meaningful words from the sentence, it is better to remove stop words like ‘is’, ‘a’, ‘the’, etc… and use the remaining words.</p><p>6. <strong>token_it(&lt;list&gt;)</strong></p><p>It is a basic function but still an important one. token_it is a tokenizer which separates each word and makes a list from a given data. Like dividing the whole text into the small pieces of information.</p><p>7. <strong>stemming(&lt;list&gt;)</strong></p><p>This function converts each word to its stem word. Like dogs to dog.</p><p>8. <strong>lemming(&lt;list&gt;)</strong></p><p>Well, it’s the name of an animal. I named it lemming instead of lemmatization because this one is easy to remember. In the process of lemmatization, all the words get converted to its root word like from ‘<em>done’</em> to ‘<em>do’</em>, ‘<em>these’</em> to ‘<em>this’</em> and alike.</p><p><em>I hope that this will help you. This library is licenced under MIT so you can use it freely.</em></p><p><em>I invite people to contribute to this mini project or for suggestions.</em></p><p><em>Thanks for your time.</em></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=1a234eec02dd" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[The Science of Data Visualization Ep-2]]></title>
            <link>https://yuganthadiyal.medium.com/the-science-of-data-visualization-ep-2-888473c49a5b?source=rss-a87ec029a373------2</link>
            <guid isPermaLink="false">https://medium.com/p/888473c49a5b</guid>
            <category><![CDATA[data]]></category>
            <category><![CDATA[design]]></category>
            <category><![CDATA[graph]]></category>
            <category><![CDATA[data-visualization]]></category>
            <category><![CDATA[data-science]]></category>
            <dc:creator><![CDATA[Yugant Hadiyal]]></dc:creator>
            <pubDate>Mon, 17 Dec 2018 12:49:25 GMT</pubDate>
            <atom:updated>2018-12-17T12:49:25.681Z</atom:updated>
            <content:encoded><![CDATA[<p><strong>WHY VISUALIZE DATA</strong></p><p>Recommended: read the previous article before this one.</p><h4>Methods to generate dynamic visual for the data containing time as one of the features or when storytelling requires time flow in it</h4><p><strong><em>In case of IOT or sensor data stream:</em></strong></p><p>When we are visualizing a dataset with time as one of the feature. It becomes important to plot all the data point with respect to time. For example, if we want to plot a dynamic graph of GDP of different countries or display data of a sensor reading data for a sophisticated IOT set-up.</p><p><strong><em>Scaling the data in the same time frame:</em></strong></p><p>Sometimes in some electronic circuits, different sensors send readings on a particular timestamp with the accuracy of a millisecond. For this problem, we can scale down all the data to the same timescale so we can plot it with one single reference. By this, you can visualize data of many sensors at a one-time frame.</p><h4>Visualization of the live stream of data</h4><p><strong><em>Performance of the system:</em></strong></p><p>The hardware which is being used and its utilization play an important role when it comes to the performance of the system. In this era of cloud computing, this problem is solved but not everyone can afford the cost of the cloud service. In the case of the small-sized businesses, cost efficiency is the key to maximum profit.</p><p>A simple example of this situation is stock prices. It is constantly changing with time and think about what if the system is slow and you are getting the delayed results. It can be a disaster or can make you a fortune. In short, it will not help you with your decisions.</p><p><strong><em>Making user-friendly and customizable visual:</em></strong></p><p>The low severity issue, the ability of customization. Users should be able to change the colour, shape and size of the graph. Moreover, if there is an entity which has different categories or having a hierarchy then drilling must be available to the users. Let’s understand the word drilling by an example, assume that you are looking at the graph of bitcoin price and current scale is set to month but you want to see the price of two years ago from now then you need a functionality called drilling to set the precision of the graph. These graphs also must be available in all possible formats like PDF, HTML, JPEG, etc.</p><p>The first part of the title “user-friendly” is a bit tricky because you have to understand how a human brain perceives the image which is generated by some data. We all have heard that a picture is better than a thousand words. Similarly, the human brain is good with sight than reading through a bunch of data. The brain naturally analyses the graph faster in comparison to the time taken to generate a visual through a piece of code. All thanks to the visual cortex! This topic needs a whole article to describe it properly.</p><p><strong><em>Design aspects of the visuals:</em></strong></p><p>It is a general problem where small utilization takes place like which colour is right for a particular feature representation. For example, if we want to represent that something is going well then the green colour is good for that. However, you can use any colour for that but which one is best is to be decided by the developer cum designer.</p><p>The following image shows the graphical representation of a convolutional neural network for handwritten digit recognition.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*GKwTedf7tpRdAcukiCHHHA.png" /></figure><p>A trained neural network is just a matrix with weights and biases for different neurons. It is not possible to read a matrix to understand the network but when we visualize it separating each layer we can see how it works. Design of this chart is good enough to represent the whole network. It will become harder and harder when the number of layers in the network increases. That’s where the developer needs to think how to implement it properly to get satisfactory results.</p><p>By generalization, people assume that blue colour is liked by most men and pink by the most women. Well, we know that this is not completely true. Still, we use those colours to represent gender. That’s why we often see in a chart where gender categorization is done, the male and female category are represented by blue and pink respectively.</p><p>It was a small one but stay tuned. More on the visual cortex in the next part…</p><p>Apparently, clicking on a button is clapping on medium :)</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=888473c49a5b" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[The Science of Data Visualization Ep-1]]></title>
            <link>https://yuganthadiyal.medium.com/the-science-of-data-visualization-ep-1-64f33394db35?source=rss-a87ec029a373------2</link>
            <guid isPermaLink="false">https://medium.com/p/64f33394db35</guid>
            <category><![CDATA[charts]]></category>
            <category><![CDATA[data-science]]></category>
            <category><![CDATA[graphics]]></category>
            <category><![CDATA[data-visualization]]></category>
            <dc:creator><![CDATA[Yugant Hadiyal]]></dc:creator>
            <pubDate>Mon, 26 Nov 2018 15:43:01 GMT</pubDate>
            <atom:updated>2018-11-26T15:43:01.650Z</atom:updated>
            <content:encoded><![CDATA[<h4>HOW TO VISUALIZE DATA</h4><p>Visualization depends on the dimensions of the data and the nature of its features. The data can contain the time, string, numbers, binary or alike.</p><p><strong><em>Importance of storytelling</em></strong></p><p>It is the most unusual thing to get a problem where you have to plot a single dimension data. You can use a line and put points on it and it will work. Anything can be optimized which is created by nature and even nature itself evolves with time.</p><p>For example, you have only one feature and have a thousand entries for it. When you put a mark on different places to represent the data. It can’t show us redundancy of the data.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/640/1*vMrYko4X7yUtfQbG6ojqCw.jpeg" /></figure><p>By the above examples, we can conclude that there are various ways to represent one type of data. It is necessary to decide which one is better for storytelling.</p><p>There are a whole mathematics and science behind generating such visualizations. One of the well-known examples is the use of the golden ratio. Anything which is found with dimensions in this ratio is said to be beautiful or a golden section. Value of this ratio is 1.618.</p><p>The following image shows its presence in the human body.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/550/0*9j_F-VFyYjCpVEOM" /></figure><p>Moreover, it is also found when the Fibonacci series is visualized. After reaching to higher index in the series the ratio of the chart’s height and width tends to acquire the value of golden ratio with high precision.</p><p>The above-mentioned examples of golden ratio are to get the idea about the science of design, similarly, there is a whole branch in the field of data science which is called data visualization. The major problem of the domain is how to fit a large amount of data in a single chart which can communicate to the humans. You can check out the below list for the problem statements which this field has to offer.</p><ol><li><em>Plotting large amount of data in single visual.</em></li><li><em>Methods to visualize multidimensional data.</em></li><li><em>Methods to generate dynamic visual for the data containing time as one of the features or when storytelling requires time flow in it.</em></li><li><em>Visualization of the live stream of data.</em></li><li><em>Making user-friendly and customizable visual.</em></li><li><em>Design aspects of the visuals.</em></li></ol><p>Each challenge has their own sub-problems. Lots of them are yet to solve. It is the field of research, innovation and design. All the problems are described in this series further.</p><p><strong>Plotting large amount of data in single visual</strong></p><p><strong>Handling of huge data:</strong></p><p>Normally, we choose to use minimum data in the process of analytics because of its fast transferable ability and low data requirement.</p><p>For this problem, we have cloud servers running 24x7 with run-time scalability. The biggest giant AWS is already serving lots of companies and developers around the globe. Other service providers are Google Cloud, MS Azure, Alibaba Cloud, IBM Cloud, Salesforce, Oracle Cloud and many more. Live Data Streaming can be seen as a less used service in some parts of the world.</p><p><strong>Fit the data in the single visual :</strong></p><p>It is crucial to select a perfect chart-type or mode of media to present the insights of the collected data</p><p>The solution to this problem is normalization. Normalization is the process to scale down the data to fit in the chart range. This process seems like a compression of the data and fits it on the chart. Though normalization can affect the results. One might not get the precision but will definitely get the overall data in one sight.</p><p><strong>Methods to visualize multidimensional data</strong></p><p><strong>Relative positions of multiple axes:</strong></p><p>We use a 2D screen. So we have to render all the data in a 2D plane. Now imagine plotting a simple bar chart in your MS Excel. That’s the example of classical plotting method which is used more often. You must be thinking that we can plot in 3D on our computer screen. That is right thought but how will you render the data when the dimensions of the data increases.</p><p>The problem is faced because our coordinate system has all the axis perpendicular to each other. Data scientist came up with the idea of parallel dimensions where they try to fit more number of axis.</p><p>The following image shows one of the methods to implement a parallel coordinate system.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/899/0*c15YZMNgS_jRDnZF" /></figure><p>Another example of the parallel coordinate system.</p><p><strong>Circular parallel coordinates</strong></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/640/0*cIVGFi667poKMzNw" /></figure><p><strong>Rendering the features:</strong></p><p>Different features have different data-types which can be anything from numbers, boolean, character to a string or categories.</p><p>For an example, the below image shows the bubble plot. It’s each point has two more features like size of the triangle and different colours can show different categories. So it is already plotting 5-dimensional data in single sight.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/800/0*iMzP7Ea-UPpWFJfL" /></figure><p>That’s all for now. Publishing the second episode soon!</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=64f33394db35" width="1" height="1" alt="">]]></content:encoded>
        </item>
    </channel>
</rss>