<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0" xmlns:cc="http://cyber.law.harvard.edu/rss/creativeCommonsRssModule.html">
    <channel>
        <title><![CDATA[Stories by Pradip Chaurel on Medium]]></title>
        <description><![CDATA[Stories by Pradip Chaurel on Medium]]></description>
        <link>https://medium.com/@chaurelpradip?source=rss-dcff307fa7ac------2</link>
        <image>
            <url>https://cdn-images-1.medium.com/fit/c/150/150/1*Tinb0qS_vJxThzrsxaI5Qg.png</url>
            <title>Stories by Pradip Chaurel on Medium</title>
            <link>https://medium.com/@chaurelpradip?source=rss-dcff307fa7ac------2</link>
        </image>
        <generator>Medium</generator>
        <lastBuildDate>Fri, 20 Nov 2026 07:37:18 GMT</lastBuildDate>
        <atom:link href="https://medium.com/@chaurelpradip/feed" rel="self" type="application/rss+xml"/>
        <webMaster><![CDATA[yourfriends@medium.com]]></webMaster>
        <atom:link href="http://medium.superfeedr.com/" rel="hub"/>
        <item>
            <title><![CDATA[From Student to Professional: My Software Engineering Journey]]></title>
            <link>https://medium.com/illumination/from-student-to-professional-my-software-engineering-journey-66ddec2ca645?source=rss-dcff307fa7ac------2</link>
            <guid isPermaLink="false">https://medium.com/p/66ddec2ca645</guid>
            <category><![CDATA[journey]]></category>
            <category><![CDATA[technology]]></category>
            <category><![CDATA[software-engineering]]></category>
            <category><![CDATA[experience]]></category>
            <dc:creator><![CDATA[Pradip Chaurel]]></dc:creator>
            <pubDate>Sun, 07 Jun 2026 23:30:12 GMT</pubDate>
            <atom:updated>2026-06-07T23:30:12.913Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*zEeM_ozdfa8mu8sf" /><figcaption>Photo by <a href="https://unsplash.com/@clemensvanlay?utm_source=medium&amp;utm_medium=referral">Clemens van Lay</a> on <a href="https://unsplash.com/?utm_source=medium&amp;utm_medium=referral">Unsplash</a></figcaption></figure><h4>Introduction</h4><p>If someone had told me at my young age that I would one day work in the tech industry, I probably wouldn’t have believed it.</p><p>Like many students, I started without a clear roadmap. My journey has been filled with curiosity, challenges, learning, failures, and continuous growth. In this article, I want to share how I went from a school student with zero knowledge of technology to working in the software industry today.</p><h4>The Early Days</h4><p>During my school years, when technology was starting to grow, the word &quot;technology&quot; really inspired me because my sister used to tell me, “<em>You have to study computer science; it&#39;s really a good field to study &amp; to get a better job.&quot;</em> At that time, no smartphone, no laptop, just imagination. I had zero exposure to programming; I never heard about programming languages until high school. Computers felt like magical machines, and I was always curious about how software and websites worked behind the scenes.</p><p>At that time, I had no idea that software engineering would eventually become my career.</p><h4>Choosing Technology as a Career</h4><p>As I progressed in my education (during high school), I became more interested in computers and problem-solving. This interest led me toward studying a computer engineering degree and exploring programming.</p><p>My first experience with coding was frustrating. Writing simple programs felt like solving puzzles, but debugging errors often tested my patience. After lots of practice, it will get easier and more familiar.</p><h4>Learning to Code</h4><p>Like many beginners, I faced challenges:</p><ul><li>Understanding programming concepts</li><li>Fixing bugs</li><li>Learning new technologies</li><li>Managing self-doubt</li></ul><p>However, every small success gave me confidence to keep going.</p><p>I spent lots of hours practicing, building small projects, reading tutorials, and learning from mistakes.</p><blockquote>There is no shortcut; choose one field and start exploring what needs to be learned to get a job in that field. Once it confirms, start building the foundation—do not aim for pro at the start. You will slowly become a pro in that field; fundamental concepts are the most important.</blockquote><h4>Entering the Professional World</h4><p>The transition from student to professional was a major milestone.</p><p>Working as a software engineer taught me lessons that no classroom could:</p><ul><li>Importance of writing maintainable code</li><li>Collaborating with teams</li><li>Communicating effectively</li><li>Solving real-world business problems</li><li>Continuously adapting to new technologies</li></ul><p>I realized that software engineering is not just about coding — it’s about creating solutions that help people and organizations.</p><h4>My Current Journey</h4><p>Today, I work as a software engineer while continuously expanding my skills in the following:</p><ul><li>Python</li><li>SQL</li><li>Data Analytics</li><li>Machine Learning</li><li>Problem Solving</li></ul><p>The learning journey never stops, and that’s one of the things I love most about this field.</p><h4>Lessons I’ve Learned</h4><ol><li>Failure is part of learning.</li><li>Consistency beats talent.</li><li>Little progress every day compounds over time.</li><li>Building projects teaches more than consuming tutorials.</li><li>Curiosity is one of the most valuable skills in technology.</li></ol><h4>What’s Next?</h4><p>It’s not ended here; my journey is still in its early chapters.</p><p>Through this article, I plan to share my experience, lessons learned, technical insights, career growth, and everything I discover along the way. Thank you for being part of this journey.</p><p>I would love to hear about your own path into your field in the comments.</p><p>📍If you like this article, don’t forget to follow and subscribe. 🔔🔔</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=66ddec2ca645" width="1" height="1" alt=""><hr><p><a href="https://medium.com/illumination/from-student-to-professional-my-software-engineering-journey-66ddec2ca645">From Student to Professional: My Software Engineering Journey</a> was originally published in <a href="https://medium.com/illumination">ILLUMINATION</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Artificial Intelligence, Machine Learning, Deep Learning]]></title>
            <link>https://medium.com/illumination/artificial-intelligence-machine-learning-deep-learning-780ce4a171f9?source=rss-dcff307fa7ac------2</link>
            <guid isPermaLink="false">https://medium.com/p/780ce4a171f9</guid>
            <category><![CDATA[data-science]]></category>
            <category><![CDATA[machine-learning]]></category>
            <category><![CDATA[deep-learning]]></category>
            <category><![CDATA[artificial-intelligence]]></category>
            <dc:creator><![CDATA[Pradip Chaurel]]></dc:creator>
            <pubDate>Sun, 22 Jun 2025 16:03:36 GMT</pubDate>
            <atom:updated>2025-06-22T16:03:36.713Z</atom:updated>
            <content:encoded><![CDATA[<p>Hi, welcome to another blog post, where ideas come to life through words. Today, I am discussing one of the most crucial topics in today’s world.</p><p>Have you wondered how your phone unlocks with your face? Or how does YouTube know what video you will watch next? That’s the magic, isn’t it? No, it’s not magic, but that’s the magic of AI, ML, and DL. But what do these terms mean and how they are connected, I will explain each term in detail with examples in a simple and understandable way so that even if you are really a beginner, you can understand it.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/636/1*JNaRv5wL5f8zBi1Ri9aZMw.png" /></figure><ol><li><strong>Artificial Intelligence (AI)</strong></li></ol><p>The name Artificial Intelligence (AI) itself says that it is something made by humans and has intelligence like a human brain. It can think and work like humans. AI is a broader field. Robotics, Machine learning, deep learning, computer vision, etc., lie within the AI field.</p><p>For example: Voice assistant, Recommendation system, spam filtration, etc.</p><p><strong>2. Machine Learning (ML)</strong></p><p>Machine Learning is a subset of Artificial Intelligence. Means it’s one of the branches in AI that deals with developing, designing, and optimizing ML. Algorithm.</p><p>As the name itself says, Machine learning means making machines learn from data. Once we train a model with a large set of data, it will then learn the pattern and nature of the data and make predictions.</p><p>There are two types of machine learning:</p><p>a. Supervised Machine Learning</p><p>b. Unsupervised Machine Learning</p><p>For example: House price prediction based on location, area, number of rooms, fraud detection, etc.</p><p>There are different types of machine learning algorithms that are used to perform tasks, which I will discuss in a future post, as this is just to make the basics clear.</p><p><strong>3. Deep Learning (DL)</strong></p><p>Deep Learning is a subfield of Machine Learning that utilizes artificial neural networks with multiple layers to analyze data and learn complex patterns.</p><p>Deep learning = Computer learning by looking at examples again and again, like a smart baby.</p><p>For Example, Face Recognition, self-driving cars, etc, are examples of DL.</p><p>The below image makes it clear what the exact difference between them.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/420/1*ptSdQeYSgga84IkfyJYvNQ.png" /><figcaption>AI vs. ML vs. DL</figcaption></figure><p>I hope you get a basic idea of how AI, ML, and DL differ from each other.</p><p>If you like this post, don&#39;t forget to follow. Stay safe, Stay learn📈📈.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=780ce4a171f9" width="1" height="1" alt=""><hr><p><a href="https://medium.com/illumination/artificial-intelligence-machine-learning-deep-learning-780ce4a171f9">Artificial Intelligence, Machine Learning, Deep Learning</a> was originally published in <a href="https://medium.com/illumination">ILLUMINATION</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Want to become a data Analyst in 2024? | Learn these skills]]></title>
            <link>https://medium.com/illumination/want-to-become-a-data-analyst-in-2024-learn-these-skills-cbcc525a7cf5?source=rss-dcff307fa7ac------2</link>
            <guid isPermaLink="false">https://medium.com/p/cbcc525a7cf5</guid>
            <category><![CDATA[data-science]]></category>
            <category><![CDATA[data-analytics]]></category>
            <category><![CDATA[technology]]></category>
            <category><![CDATA[data-analysis]]></category>
            <dc:creator><![CDATA[Pradip Chaurel]]></dc:creator>
            <pubDate>Sun, 09 Jun 2024 11:02:07 GMT</pubDate>
            <atom:updated>2024-07-04T22:31:43.114Z</atom:updated>
            <content:encoded><![CDATA[<h4>Who is a data analyst?</h4><p>Data analysts are those who are responsible for collecting data, processing that data, and performing analysis on that data.</p><p><em>Their goal is to find insights from large datasets to improve business and solve problems for organizations.</em></p><blockquote><em>Before jumping into the topics, you should know the roles and responsibilities of a data analyst.</em></blockquote><ol><li>Data Collection and management</li><li>Analyze those data</li><li>Prepare Report</li><li>Providing Insights</li></ol><h4>Let’s jump into the technical skills that are required.</h4><h4>1. Learning Statistics</h4><p><em>No statistics, no insights.</em></p><p>Statistics is one of the major parts of data analytics. Building a strong foundation in statistics is crucial for a data analyst. Having a good knowledge of high school mathematics is enough to start as a data analyst.</p><p>Areas that should be covered</p><ul><li><strong>Fundamentals of statistics: </strong>Probability, descriptive statistics, etc.</li><li><strong>Hypothesis testing</strong></li></ul><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*mQSYiQ8JLb3DTgVQ" /><figcaption>Photo by <a href="https://unsplash.com/@edge2edgemedia?utm_source=medium&amp;utm_medium=referral">Edge2Edge Media</a> on <a href="https://unsplash.com/?utm_source=medium&amp;utm_medium=referral">Unsplash</a></figcaption></figure><blockquote>Learning resource: <a href="https://www.w3schools.com/statistics/">Statistics Tutorial</a></blockquote><blockquote><strong>Learn form YouTube videos and take some courses to get better ideas.</strong></blockquote><h4>2. Excel</h4><p>Excel is an essential tool for a data analyst. Whether a company is a startup or a large one, they use Excel for everyday work.</p><p>You need to master certain things, not everything:</p><ul><li><em>Basic Understanding of Excel.</em></li><li><em>Formulas</em></li><li><em>Formatting</em></li><li><em>Pivot table</em></li><li><em>Power Query</em></li><li><em>Basic visualization</em></li><li><em>VLookUP, HLookUP, etc.</em></li></ul><blockquote>Learning Resource : <a href="https://www.w3schools.com/EXCEL/index.php">Excel from W3Schools</a></blockquote><blockquote>For practice: <a href="https://excel-practice-online.com/">Excel-practice-online</a></blockquote><p>I recommend <strong>W3Schools</strong> for learning purposes as a beginner.</p><p><strong>and, of course, YouTube videos.</strong></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*lwg2wgdRFWBIYGcB" /><figcaption>Photo by <a href="https://unsplash.com/@campaign_creators?utm_source=medium&amp;utm_medium=referral">Campaign Creators</a> on <a href="https://unsplash.com/?utm_source=medium&amp;utm_medium=referral">Unsplash</a></figcaption></figure><h4>3. SQL</h4><p>I don’t need to explain how important SQL is for the data profession. Most of the time, they are working with SQL queries to analyze data.</p><p>SQL is the <strong>key</strong> for data professionals.</p><p>Having said that, you don’t need to master everything. Nobody knows everything in SQL, but we should have a basic understanding of SQL and be able to solve problems.</p><blockquote><em>20% of SQL can be useful for 80% of your work. If you know 20% of the SQL, you can solve 80% of the SQL problems.</em></blockquote><p>You should have an understanding of</p><ul><li><em>SELECT</em></li><li><em>FROM</em></li><li><em>WHERE</em></li><li><em>GROUP BY</em></li><li><em>HAVING</em></li><li><em>ORDER BY</em></li><li><em>AND, OR, NOT</em></li><li><em>Joins in SQL</em></li><li><em>Aggregate functions (SUM, AVG, COUNT, MIN, MAX)</em></li><li><em>Window functions</em></li><li><em>CTE (Common Table Expression)</em></li><li><em>CREATE, ALTER, UPDATE, DELETE</em></li></ul><p>Once you have gone through these topics, you will be able to solve SQL questions, and<em> </em><strong><em>the more you solve, the more you get.</em></strong></p><blockquote>Learning Resource:<strong> </strong><a href="https://www.w3schools.com/sql/">SQL W3Schools</a> and YouTube Tutorials</blockquote><blockquote>Practice : <a href="https://leetcode.com/problemset/database/">SQL problems leetcode</a> &amp; <a href="https://www.hackerrank.com/domains/sql">HackerRank SQL problems</a></blockquote><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*LAO0_dSspE6WdX2b" /><figcaption>Photo by <a href="https://unsplash.com/@casparrubin?utm_source=medium&amp;utm_medium=referral">Caspar Camille Rubin</a> on <a href="https://unsplash.com/?utm_source=medium&amp;utm_medium=referral">Unsplash</a></figcaption></figure><h4>4. Power BI/Tableau</h4><p>Power BI and Tableau are the data visualization tools. With the help of these tools, we can create beautiful interactive dashboards.</p><p><em>Tableau performs better when the dataset is large, and PowerBI is faster when the data set is limited.</em></p><p><strong>So, as a beginner, starting with Power BI is better than starting with Tableau.</strong></p><ul><li><em>Understanding of Power BI and Its Components</em></li><li><em>Data Insertion (Diff. ways)</em></li><li><em>Data Modeling</em></li><li><em>DAX functions</em></li><li><em>Dashboard Creation</em></li></ul><p>When we work on projects, we will get a better understanding.</p><blockquote>Learning Resource : <a href="https://www.tutorialspoint.com/power_bi/index.htm">Power BI Tutorial</a> &amp; YouTube Videos</blockquote><blockquote>Practice : Practice with YouTube videos and Built Projects</blockquote><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*OozPyR6ictn0qB-9" /><figcaption>Photo by <a href="https://unsplash.com/@lukechesser?utm_source=medium&amp;utm_medium=referral">Luke Chesser</a> on <a href="https://unsplash.com/?utm_source=medium&amp;utm_medium=referral">Unsplash</a></figcaption></figure><h4>5. Python / R</h4><p>Having a good understanding of Python will help you get into data analytics.</p><p>You don’t need to be a master of Python.</p><p>The basics of Python and some<em> libraries</em> are enough to go.</p><p><strong><em>Things that you should know:</em></strong></p><ul><li>Basic python syntax</li><li>Variables and data types</li><li>Conditional statement</li><li>Loop</li><li>Functions</li><li>List, Tuple, Set, and Dictionary</li></ul><p><strong><em>Python Library for Data Analysts:</em></strong></p><ul><li>NumPy</li><li>Pandas</li><li>Matplotlib</li><li>Seaborn</li><li>Scikit-learn</li></ul><blockquote>Learning resource: <a href="https://www.w3schools.com/python/">Python Tutorials</a></blockquote><blockquote>Practice : <a href="https://www.hackerrank.com/domains/python">HackerRank</a></blockquote><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*U942V4EVANzPRWIB" /><figcaption>Photo by <a href="https://unsplash.com/@rubaitulazad?utm_source=medium&amp;utm_medium=referral">Rubaitul Azad</a> on <a href="https://unsplash.com/?utm_source=medium&amp;utm_medium=referral">Unsplash</a></figcaption></figure><p>Nice! We are gaining a lot of skills from the above list.</p><p><em>The market is competitive, and competition is too high. So, you need to have extra skills to prove them.</em></p><p>Technical skills are not enough for data analysts. You should have some non-technical skills to stand out from others.</p><ul><li>Communication Skills</li><li>Problem-Solving</li><li>Critical Thinking</li><li>Team Work</li><li>Analytical Power</li></ul><p>Hope this will help you to understand the skills needed for data analyst in 2024. If you like this article please <strong>follow me</strong> and don’t forget to <strong>subscribe 🔔🔔 </strong>so that you will get my new articles in the mail.</p><blockquote>Feel free to give suggestion in the comment section. 💬💬💬💬💬</blockquote><blockquote>Connect with me :</blockquote><blockquote>LinkedIn: <a href="https://www.linkedin.com/in/pradip-chaurel-6a68b321b/">Click here to connect</a></blockquote><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=cbcc525a7cf5" width="1" height="1" alt=""><hr><p><a href="https://medium.com/illumination/want-to-become-a-data-analyst-in-2024-learn-these-skills-cbcc525a7cf5">Want to become a data Analyst in 2024? | Learn these skills</a> was originally published in <a href="https://medium.com/illumination">ILLUMINATION</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Nth Highest Salary | SQL Problem]]></title>
            <link>https://medium.com/@chaurelpradip/nth-highest-salary-sql-problem-d8d1eaf29bce?source=rss-dcff307fa7ac------2</link>
            <guid isPermaLink="false">https://medium.com/p/d8d1eaf29bce</guid>
            <category><![CDATA[window-functions]]></category>
            <category><![CDATA[mysql]]></category>
            <category><![CDATA[sql]]></category>
            <category><![CDATA[sql-server]]></category>
            <dc:creator><![CDATA[Pradip Chaurel]]></dc:creator>
            <pubDate>Mon, 27 May 2024 17:14:37 GMT</pubDate>
            <atom:updated>2024-05-27T17:14:37.680Z</atom:updated>
            <content:encoded><![CDATA[<p>Finding the<strong> Nth highest salary </strong>from the employee table is a famous question in SQL interviews. We could have multiple solutions for one problem. There are many ways to solve this question. But in this article, I am going to give you two methods that are easy to understand.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*uVukBnSpyLH7hca59rVgrg.jpeg" /></figure><h3><strong><em>Method 1: Using the LIMIT keyword (MySQL, PostgreSQL, and SQLite):</em></strong></h3><p>The<strong> LIMIT</strong> keyword is used to limit the row numbers in MySQL, PostgreSQL, and SQLite databases.</p><h4>Step 1:</h4><p>Create a database, and inside that database, create a table called employee.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/516/1*IKHaKbvLmonClgrnligXPQ.png" /></figure><p>and now the employee table:</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/940/1*h9XQJjYOD5H4SQOq-7AZSg.png" /></figure><h4>Step 2:</h4><p>Let’s insert some values in the employee table.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/592/1*xbEPSflI5lq3ehsLdKEZ-w.png" /></figure><h4>Step 3:</h4><p>Now we have the database and table ready with some values. Next is a SQL query. The SQL query with the LIMIT keyword is as below:</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/448/1*VyVbdMrHEGbVhwI93go2kQ.png" /></figure><p>As you can see from the above query 4th highest salary is 350. In this query, I used <strong>limit 3,1 </strong>which means after ordering the salary in descending order, it will skip the first 3 rows and 1 indicates that prints the next 1 rows. So, we will get 4th row as a result.</p><h3>Method 2: Using Row_Number() function and CTE (Common Table Expression) [MsSQL Server]</h3><p>Row_Number is a window function that gives us numbering for each row based on the condition we provide. We can give numbering based on category in the same table.</p><p><em>Syntax:</em></p><p><em>Row_Number () OVER (Partition By [column name] Order By [column name])</em></p><h4>Steps 1 &amp; 2 :</h4><p>Same as the above method.</p><h4>Step 3:</h4><figure><img alt="" src="https://cdn-images-1.medium.com/max/709/1*DZrZFsPZdD_5NnfHoDOUaQ.png" /></figure><p>we can see in the above query, WITH clause is used to create a temporary result set called employee_detail. It stores the name, salary, and row number for each row. Now, to find the 4th highest salary, we will select that row which has row number 4.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/730/1*qBIqqOJHcHrcYRzf8vW-aQ.png" /></figure><p>From both methods, we will get Lucas salary which is 350.</p><p>I hope this article will help you to understand the LIMIT clause, CTE, Row_Number (), and many more. If you have any suggestions or doubts, feel free to ask in the comment section.</p><blockquote>If you like this article or want more articles in the future please don&#39;t forget to</blockquote><figure><img alt="" src="https://cdn-images-1.medium.com/max/498/1*SXIGhaF84SUONcTjmn2pzQ.gif" /></figure><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=d8d1eaf29bce" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Mastering Excel Pivot Table | A Comprehensive Guide]]></title>
            <link>https://medium.com/@chaurelpradip/mastering-excel-pivot-table-a-comprehensive-guide-d5a377311f04?source=rss-dcff307fa7ac------2</link>
            <guid isPermaLink="false">https://medium.com/p/d5a377311f04</guid>
            <category><![CDATA[excel]]></category>
            <category><![CDATA[pivot-tables]]></category>
            <category><![CDATA[data-analysis]]></category>
            <dc:creator><![CDATA[Pradip Chaurel]]></dc:creator>
            <pubDate>Fri, 17 May 2024 09:29:06 GMT</pubDate>
            <atom:updated>2024-05-17T09:35:21.075Z</atom:updated>
            <content:encoded><![CDATA[<h4><strong>What is a pivot table?</strong></h4><p>Pivot Table is a <strong>data summarization tool</strong> in Excel that is used in the context of data analysis, data summarization, and data calculation. <em>Basically, it is a tool for quickly generating insights from large datasets.</em></p><h4><strong>Purpose of Pivot Tables:</strong></h4><ul><li><strong>Data Summarization:</strong> It is used to quickly summarize large datasets to understand the big picture.</li><li><strong>Trend Analysis</strong>: Once we create pivot tables, we can easily understand the trend without modifying the original data.</li><li><strong>Dashboard: </strong>Once the pivot table has been created, we can create charts easily. As a result, dashboard creation will be easy.</li><li><strong>Efficiency:</strong> It will save time with automated calculations.</li></ul><h3>Getting Started with Pivot Tables</h3><h4><strong>Step 1: Prepare Data</strong></h4><p>Before creating a Pivot table, we must have data that is well organized.</p><ul><li>Each column should have a heading.</li><li>Avoid blank rows and columns. (It means that before creating a pivot table, we must clean our data.)</li></ul><p>We can insert a pivot table on the same sheet, but for ease and manageable looks, we will add another sheet for the pivot table.</p><h4>Step 2: Insert a Pivot Table</h4><ul><li>Go to the ‘<strong>Insert</strong>’ tab on the ribbon, and click <strong>‘PivotTable’</strong>.</li><li>A dialog box will appear.</li><li>In the dialog box, select the data range if necessary; otherwise, it will select the range automatically.</li></ul><h4>Step 3: Build Pivot Table</h4><ul><li>Click anywhere in the pivot table, and the pivot table field will appear, showing all the columns from the dataset. We have to drag and drop those columns into four areas: Filters, Columns, Rows, and Values.</li></ul><ol><li><strong>Filters:</strong> This area is used to filter data if necessary.</li><li><strong>Columns:</strong> Any fields placed here will appear as columns in the pivot table.</li><li><strong>Rows:</strong> Any fields placed here will appear as rows in the pivot table.</li><li><strong>Values: </strong>Fields placed here will be summarized (e.g., sum, average, count) in the pivot table. <em>If column data can be calculated, then these fields should be placed in the Values field as per necessity.</em></li></ol><p>Once we create a pivot table successfully, we will easily create charts (bar, pie, column chart, area chart) from that table.</p><blockquote>For Example:</blockquote><p>I have taken a sample dataset that has Name, Gender, Age, Class, …… , and Final Test as columns.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/981/1*qnqY5o7IHKmr6ayT582RlA.png" /></figure><p>I will try to explain the pivot table with a simple example. Let’s ask a simple question.</p><p><strong>Q. What is the average final test score for males and females house-wise?</strong></p><p>If I have to answer this question without using a pivot table, firstly I have to apply the filter in the gender column, group by house, and then average the final test score. It looks lengthy, right? Let&#39;s solve this problem with a pivot table.</p><ul><li>Insert pivot table</li></ul><figure><img alt="" src="https://cdn-images-1.medium.com/max/352/1*3pvCwuQq5j9QpySw0cuxhA.png" /></figure><p>Now, let&#39;s look at the pivot table fields.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/517/1*R-nCLlqAeW6PeMZMJ3b0qg.png" /></figure><p>There are four fields and columns. We drag and drop those columns into these fields based on requirements. In our case, we have to calculate the average final score, so we will drag the final test column into the Values field. We want to display gender in rows, so we will put the gender column in the rows section, and the house column will be dragged into the rows column.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/508/1*cEr5kFg7cypo_rZmEky3tA.png" /></figure><p>And now it is time to answer our question with a pivot table.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/342/1*my2gVW2Hhqtn7gHneDmHyA.png" /></figure><p>We can see the average score house-wise. Now we can create a chart from this pivot table. Let’s try this.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/717/1*eu5wdu5GPvasZXxQ8-FT8w.png" /></figure><p>It’s easier to understand looking at a column chart. Likewise, we can answer complex business questions easily using the pivot table.</p><p>I hope you get the idea of the pivot table. If you have any questions or any feedback, please write it in the comment section or directly email me. I am always open to answering. Thank you! Have a nice day👍👍👍</p><blockquote>Don’t forget to <strong>follow </strong>and if you like my article, please press <strong>Subscribe </strong>🔔🔔</blockquote><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=d5a377311f04" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Electronic Store Sales Analysis: A Data Analysis Project]]></title>
            <link>https://medium.com/@chaurelpradip/electronic-store-sales-analysis-a-data-analysis-project-1756901afbb3?source=rss-dcff307fa7ac------2</link>
            <guid isPermaLink="false">https://medium.com/p/1756901afbb3</guid>
            <category><![CDATA[data-science]]></category>
            <category><![CDATA[matplotlib]]></category>
            <category><![CDATA[data-analysis]]></category>
            <category><![CDATA[pandas]]></category>
            <dc:creator><![CDATA[Pradip Chaurel]]></dc:creator>
            <pubDate>Sun, 05 May 2024 08:48:22 GMT</pubDate>
            <atom:updated>2024-05-17T09:47:58.935Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/760/1*L-e8SZwzt8ZguKf3fP5AwQ.jpeg" /></figure><p>In this project, I use Python Pandas &amp; Matplotlib to analyze and answer business questions about 12 months&#39; sales data. The data contains hundreds of thousands of electronics store purchases broken down by month, product type, cost, purchase address, etc.</p><blockquote><strong>Data Source: </strong><a href="https://github.com/pradipchaurel/Electronic-Store-Sales-Analysis-In-Python/tree/main/Sales_Data">https://github.com/pradipchaurel/Electronic-Store-Sales-Analysis-In-Python/tree/main/Sales_Data</a></blockquote><blockquote><strong>Tools:</strong> Python (Pandas &amp; Matplotlib), Jupyter Notebook</blockquote><h4><strong>Step 1: Import the necessary library</strong></h4><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*oUX-9GERqYwStte7Ht3z0w.png" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*SKi1DZn6GsN6Az4E54nR7Q.png" /></figure><ul><li>Pandas library is used to clean, and analyze data while matplotlib is used to plot bar char and other visualization purposes.</li><li>OS module provides functionality to interact with an operating system. I used this module because I have a sales data folder and inside that I have separate CSV files for each month. So I can merge all the csv files using this module into one csv file.</li></ul><h4>Step 2: Merge all CSV files into one CSV file</h4><p>My second step will be merging all CSV files into one and reading the updated dataset.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*hBedSduOUeTbAZCz88tIKw.png" /></figure><p>Now it will generate one CSV file named “all_data.csv”.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*Y3yhbeGqUEo786kFRl-pqQ.png" /></figure><p>Using “read_csv” we can read that particular dataset. Here, the Head() function shows us only the first five rows. if we want more rows to be shown we can mention by Head(1,2,3,……..).</p><h4>Step 3: Data Cleaning</h4><p>In this project, I did 3 data-cleaning processes. it should be done based on requirements.</p><ol><li><strong>Remove NAN:</strong></li></ol><ul><li>In pandas, the “dropna()” function is used to remove all the null values in the dataset.</li></ul><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*2eHE-TfYQR8XWG3pYC08SA.png" /></figure><p>2. <strong>Find ‘Or’ and delete it</strong></p><p>In my case, it was showing that somewhere in the order date, ‘Or’ is present. So, I decided to delete it as well.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*vUWdCHV-asecCgo_cyz7gw.png" /></figure><p>3. <strong>Converting Columns into the correct data type</strong></p><p>In this dataset ‘Quantity Ordered’ &amp; ‘Price Each’ columns are not integers so, I will change their data type. I did this because using these two rows, I need to calculate total sales later.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*-0BigVYoZ4cNncip_pmJNw.png" /></figure><h4>Step 4: Augment data with additional columns</h4><p>It is part of data cleaning but in this step, we will extract some parts from columns and add them in new columns.</p><ol><li><strong>ADD month column</strong></li></ol><ul><li>I can extract Months from the “order date” column.</li></ul><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*04j2CHmc2VvjBCtBr4ZEyg.png" /></figure><p><strong>2. ADD a Sales column</strong></p><ul><li>The sales column is calculated by multiplying “Quantity Ordered” &amp; “Price Each”.</li></ul><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*RYtGSlCGAx4C2qMaXijAvA.png" /></figure><p><strong>3. ADD a City column</strong></p><p>The city column is extracted from the “Purchase Address” column.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*MwAYKTqEXQ631kN5e3aDRA.png" /></figure><p>Now it&#39;s turn to answer business questions one by one.</p><h3>Question 1: What was the best month for sales? How much was earned that month?</h3><p>We can group by months and calculate total sales using the SUM() function.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*4q0bLgvdI5yaPvzCtI6IUg.png" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/826/1*wddde1LiqpYfp6oVSEip8g.png" /></figure><p>We can clearly see which month has the highest sales and the lowest sales. Month number 12 means December has the highest sales.</p><h3>Question 2: What city had the highest number of sales?</h3><p>This is the same as the previous, we can group by city and use the Sum function to calculate total sales city-wise.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*FOvz3PXIDa9L7uYHIzDu_A.png" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/738/1*PmaJQTiHeurj8ww4GWJA9g.png" /></figure><p>From the above bar chart, we can say San Francisco (CA) has the highest consumer of electronics.</p><h3>Question 3: What time should we display advertisements to maximize the likelihood of customers buying products?</h3><p>For this, we need to extract Hours and minutes from the order date. After extracting an hour and a minute. we can group by hour and for counting the total products we use the COUNT() function.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*PcgdDlBJQZ79iczG4HaY3w.png" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/721/1*blk2VIy5jIfgOeP7s_lxwA.png" /></figure><p>From the graph, we can see 11–12 AM and 7 PM have the maximum numbers of orders sold. So that it is the best time to advertise.</p><h3>Question 4: What product sold the most? why do you think it sold the most?</h3><p>For this question, we group by product and sum the quantity ordered. and plot a bar chart.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*IIjO0AjZYSfv0X-gicj54g.png" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/835/1*ZHPUFnfNmezFQX9wuLDn5A.png" /></figure><p>We can see, AAA Batteries (4-pack) sold the most. it is because of the price. If we look price for this particular product, it is less compared to others.</p><blockquote>Summery:</blockquote><ul><li><em>Concatenating multiple csvs together to create a new DataFrame (pd.concat)</em></li><li><em>Adding columns</em></li><li><em>Parsing cells as strings to make new columns (.str)</em></li><li><em>Using the .apply() method</em></li><li><em>Using group by to perform aggregate analysis</em></li><li><em>Plotting bar charts and line graphs to visualize our results</em></li><li><em>Labeling our graphs</em></li></ul><blockquote><strong>Full Project</strong> : <a href="https://pradipchaurel.github.io/">https://pradipchaurel.github.io/</a></blockquote><blockquote><strong>LinkedIn</strong>: <a href="https://www.linkedin.com/in/pradip-chaurel-6a68b321b/">https://www.linkedin.com/in/pradip-chaurel-6a68b321b/</a></blockquote><p>This way I have answered some business questions using a large dataset. I hope it will help you and if you find this article useful <strong>consider subscribing 👍👍🔔</strong><em>. Stay safe, stay blessed, and have fun 🎈</em></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=1756901afbb3" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Data Analytics: What is it and how does it work?]]></title>
            <link>https://medium.com/@chaurelpradip/data-analytics-what-is-it-and-how-does-it-work-72aca0010162?source=rss-dcff307fa7ac------2</link>
            <guid isPermaLink="false">https://medium.com/p/72aca0010162</guid>
            <category><![CDATA[data-analysis]]></category>
            <category><![CDATA[data-science]]></category>
            <category><![CDATA[data]]></category>
            <dc:creator><![CDATA[Pradip Chaurel]]></dc:creator>
            <pubDate>Thu, 04 Apr 2024 15:47:53 GMT</pubDate>
            <atom:updated>2024-05-17T09:42:08.959Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/693/1*uuz4zO9viRjBaysRDDJm2Q.png" /><figcaption>Data Analytics</figcaption></figure><h4><strong>What is data analytics?</strong></h4><p>Data analytics refers to the science of analyzing raw data to make conclusions from it or simply to find useful insights from the data. Data analytics can be used in different fields, such as businesses, to optimize their performance and maximize their profits. All the processes included in data analytics are done by using software and other tools to gather and analyze raw data.</p><blockquote><em>KEY TAKEAWAYS</em></blockquote><ul><li>Data analytics is the science of analyzing raw data to find useful insights.</li><li>Data analytics help a business optimize its performance.</li><li>Data analytics relies on a variety of software tools, such as spreadsheets, data visualization, reporting tools, and open-source languages.</li></ul><h4><strong>Steps in Data Analysis</strong></h4><p>The process involved in data analysis involves several steps:</p><ol><li>Determine the data requirements or how the data is grouped.</li><li>Data collection. This can be done through various resources, such as computers, online sources, cameras, etc.</li><li>Organize the collected data so it can be analyzed. This may take place on a spreadsheet or another form of software that can take statistical data.</li><li>Clean up the data before it is analyzed. This includes the removal of duplicates, null values, and other errors.</li></ol><h4><strong>Types of Data Analytics</strong></h4><p>Data analytics is broken down into 4 basic types:</p><ol><li><strong>Descriptive analytics: </strong>This describes what has happened over a given period of time.</li><li><strong>Diagnostic analytics:</strong> This focuses more on why something happened.</li><li><strong>Predictive analytics:</strong> This focuses more on what is going to happen in the near term.</li><li><strong>Prescriptive analytics:</strong> This suggests a course of action. This analysis focuses on giving suggestions to improve business outcomes.</li></ol><h4><strong>Data Analytics Tools</strong></h4><p>Some of the data analytics tools and programming languages that most of the data analysts use are given below:</p><ol><li>Spreadsheets and Microsoft <a href="https://en.wikipedia.org/wiki/Microsoft_Excel">Excel</a></li><li>SQL (Structures Query Language)</li><li>Tableau or <a href="https://learn.microsoft.com/en-us/power-bi/fundamentals/power-bi-overview">Power BI</a></li><li>Python</li></ol><h4><strong>Importance and Uses of Data Analytics</strong></h4><p>Data analytics provide a critical component of a business’s probability of success. Gathering, sorting, analyzing, and presenting information can significantly benefit society, mainly in fields such as healthcare and crime prevention. However, the use of data analytics can be equally beneficial for small enterprises and startups.</p><p>I try to explain in detail about data analytics, how it works, and its importance in simple language. If you like this article, consider subscribing 🔔🔔🔔🔔🔔🔔……</p><p>Stay tuned, and keep learning……….📖📖📖📖📖</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=72aca0010162" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Skills Required To Start a Career As a Data Engineer]]></title>
            <link>https://medium.com/@chaurelpradip/skills-required-to-start-a-career-as-a-data-engineer-beb1e538ada4?source=rss-dcff307fa7ac------2</link>
            <guid isPermaLink="false">https://medium.com/p/beb1e538ada4</guid>
            <category><![CDATA[olap]]></category>
            <category><![CDATA[sql]]></category>
            <category><![CDATA[oltp]]></category>
            <category><![CDATA[data-engineer]]></category>
            <category><![CDATA[data-engineering]]></category>
            <dc:creator><![CDATA[Pradip Chaurel]]></dc:creator>
            <pubDate>Wed, 16 Aug 2023 16:50:15 GMT</pubDate>
            <atom:updated>2026-06-10T15:16:15.111Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*3zSgoDcmvyKeJYYLK2dusQ.jpeg" /></figure><p>A data engineer is a professional who is responsible for building systems for collecting, storing, and analyzing data. Organizations can collect massive amounts of data day by day, and they need the right people to use that data to analyze and find meaningful insights for their business.</p><p>Data Engineers work in various systems that can collect, manage, and convert raw data into a usable format. Their main goal is to make data accessible so that organizations can use it for further work.</p><p>Here is the Key skill that everyone must know to enter the data engineering field:</p><ol><li><strong>SQL (Structured Query Language):</strong> SQL is a fundamental tool for data engineering tasks. It’s commonly used for managing, querying, and manipulating data in relational databases. If you don&#39;t know SQL, then you cannot go into this field because most of the time you have to work with SQL. In interviews, you have asked a lot of SQL-related questions, and the SQL round is conducted separately.</li><li><strong>Any One Programming Language (Python, Java, Scala):</strong> Programming languages play a crucial role in the field of data engineering. It is used to design, build, and maintain complex data pipelines and systems. If you are interested in working in the data field, one programming language and problem-solving skills are required. If you already know any programming language, then go with that; otherwise, I suggest starting with Python because it is easy to learn for beginners, and it supports a lot of libraries that make work easy.</li><li><strong>Any Cloud Platform:</strong> If you want to become a data engineer, then learning any cloud platform is helpful. Cloud platforms have become essential for modern data engineering, offering scalable infrastructure, managed services, and the ability to process and store large volumes of data. You can learn Google Cloud, AWS, Microsoft Azure, etc.</li><li><strong>Knowledge of ETL Processes:</strong> ETL(Extract, Transform, Load) is the process of extracting data from the source, converting the raw data into a usable format, and loading it into warehouses. The basic concept of ETL is essential to get into the data engineering field.</li><li><strong>OLTP and OLAP:</strong> Basic concept of OLTP and OLAP helps to get into a data engineering job.</li></ol><p>I hope this will help you to understand the key skills that are required to get into the data engineering field. If you have any suggestions, you can comment or email me.</p><p>If you like this article, consider subscribing 🔔</p><p>Stay tuned, and keep learning……</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=beb1e538ada4" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[SQL Fundamental for Beginner || Structured Query Language]]></title>
            <link>https://medium.com/illumination/sql-fundamental-for-beginner-structured-query-language-9a6a92a36ad5?source=rss-dcff307fa7ac------2</link>
            <guid isPermaLink="false">https://medium.com/p/9a6a92a36ad5</guid>
            <category><![CDATA[ddl]]></category>
            <category><![CDATA[dml]]></category>
            <category><![CDATA[dcl]]></category>
            <category><![CDATA[dql]]></category>
            <category><![CDATA[sql]]></category>
            <dc:creator><![CDATA[Pradip Chaurel]]></dc:creator>
            <pubDate>Tue, 15 Aug 2023 09:49:57 GMT</pubDate>
            <atom:updated>2024-07-04T22:32:05.246Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*A6Uq4pDgRvx0sPGDl1UCjg.png" /><figcaption>Image created by the author</figcaption></figure><p>SQL stands for <strong>Structured Query Language </strong>and is a programming language used for managing and manipulating relational databases. It plays the role of primary communication between software applications and databases.</p><p>SQL is an essential tool for data management, retrieval, and modification. It is widely used across various industries.</p><p>Here is the key component of SQL:</p><ol><li><strong>Data Definition Language (DDL): </strong>This component is used to define and manage database structures like creating databases, tables, indexes, and constraints.</li></ol><p><strong>CREATE: </strong>Used to create a database, table, index, etc.</p><p><strong>ALTER:</strong> Modify the structure of existing objects such as adding and dropping columns.</p><p><strong>DROP:</strong> Delete database objects like tables, indexes, and views.</p><p><strong>TRUNCATE:</strong> Removes all the records from the table but not the table structure.</p><p>2. <strong>Data Manipulation Language (DML):</strong> DML is used to manipulate the data within the tables.</p><p><strong>SELECT:</strong> Used to retrieve data from the table.</p><p><strong>INSERT: </strong>Used to add new records into a table.</p><p><strong>UPDATE:</strong> Used to modify existing records in a table.</p><p><strong>DELETE:</strong> Used to remove records from a table.</p><p>3.<strong> Data Control Language (DCL):</strong> DCL command is used to manage user access and permissions within the databases.</p><p><strong>GRANT:</strong> Assigns specific privileges to users, allowing them to perform certain actions on the database.</p><p><strong>REVOKE: </strong>Removes previously granted privileges from users.</p><p>4. <strong>Data Query Language (DQL):</strong> DQL mainly focuses on querying and retrieving data from databases. The primary DQL command is the <strong>SELECT </strong>statement.</p><p>Here are the basic commands that you can practice in order to learn SQL.</p><ol><li>SELECT — To retrieve data.</li><li>WHERE — Used to filter the data.</li><li>ORDER BY — Order output data in ascending or descending order.</li><li>GROUP BY — Used to group the rows.</li><li>HAVING — Filter grouped data</li><li>AND, OR, NOT — Combine conditions in where clause</li><li>INSERT INTO — Add new records into a table.</li><li>UPDATE — Modify the existing record.</li><li>DELETE — Remove records from a table</li><li>Aggregate Function — SUM(), COUNT(), AVG(), MIN(), MAX()</li><li>Joins — INNER JOIN, LEFT JOIN, RIGHT JOIN, and FULL JOIN</li></ol><p>I hope this article helps understand the basics of SQL and commands. I am open to suggestions from readers so if you have anything to say you can comment or you can email me.</p><p>Stay tuned, Stay focused, and keep learning….🚀🚀</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=9a6a92a36ad5" width="1" height="1" alt=""><hr><p><a href="https://medium.com/illumination/sql-fundamental-for-beginner-structured-query-language-9a6a92a36ad5">SQL Fundamental for Beginner || Structured Query Language</a> was originally published in <a href="https://medium.com/illumination">ILLUMINATION</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Difference between Data Science, Data Analyst, and Data Engineer]]></title>
            <link>https://medium.com/illumination/difference-between-data-science-data-analyst-and-data-engineer-b5a66e0e6be5?source=rss-dcff307fa7ac------2</link>
            <guid isPermaLink="false">https://medium.com/p/b5a66e0e6be5</guid>
            <category><![CDATA[data-analyst]]></category>
            <category><![CDATA[data-engineering]]></category>
            <category><![CDATA[data-science]]></category>
            <dc:creator><![CDATA[Pradip Chaurel]]></dc:creator>
            <pubDate>Mon, 14 Aug 2023 16:45:13 GMT</pubDate>
            <atom:updated>2024-07-04T22:32:23.825Z</atom:updated>
            <content:encoded><![CDATA[<p>The data field is about collecting, understanding, and making decisions using information. With so much data available from computers, phones, and sensors, experts in this field analyze the data to find patterns and valuable insights. This helped businesses and scientists to solve problems and make predictions.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*3zxH7aXJMr_0yDlFq2usSQ.png" /><figcaption>Image created by the author</figcaption></figure><p>Talking about job roles like data science, data analysis, and data engineering. These roles look the same and many of us don’t know what they actually do. In this blog, I am going to differentiate these three different job roles in the data field and try to give a clear idea of them.</p><h3><strong>Data Engineer</strong></h3><p>A data engineer is a professional who is responsible for designing, building, and maintaining the systems and infrastructure needed to collect, store and process large amounts of data. They play a crucial role in the data field by creating a foundation so that data scientist and data analyst can perform their work effectively.</p><p>Here are some key aspects of a data engineer’s role:</p><ol><li><strong>Data Collection and Ingestion:</strong> Data engineers set up processes to gather data from various sources such as databases, applications, websites, sensors, etc.</li><li><strong>Data Storage and Management: </strong>They design and implement databases and data warehouses to securely store and organize the collected data.</li><li><strong>Data Processing: </strong>Data engineers work on transforming raw data into a usable format so that they may perform tasks like data cleaning, normalization, and transformation.</li><li><strong>ETL(Extract, Transform, Load):</strong> ETL processes involve extracting data from the source, transforming it into a desired format, and loading it into data warehouses or another storage system.</li><li><strong>Big Data Technology: </strong>As the volume of data grows, data engineers often use big data technology like Hadoop, and Spark to process and analyze data in parallel.</li><li><strong>Data Pipeline Development:</strong> Data engineers build automated pipelines that move data from source to destination by applying necessary transformations.</li></ol><h3>Data Analyst</h3><p>A data analyst is a professional who is responsible for interpreting and drawing insights from data to help organizations make informed decisions. They use data prepared by data engineers to find insights for organizations or businesses. They play a great role in the data field by using large datasets and identifying trends, patterns, and relationships.</p><p>Here are some aspects of a data analyst’s role:</p><ol><li>Data Exploration</li><li>Data Cleaning and Preprocessing</li><li>Statistical Analysis</li><li>Data Visualization</li><li>Pattern Recognition</li><li>Business Insights</li><li>Reporting etc.</li></ol><h3>Data Science</h3><p>Data science is a multidisciplinary field that combines various techniques, methodologies, and tools to extract valuable insights and knowledge from data. It includes a range of activities like data collection, cleaning, analysis, interpretation, and visualization. The goal of data scientists is to make informed decisions and predict future trends by using large amounts of data.</p><p>Data engineers and Data Analysts are part of data science so they can work to help data scientists.</p><p>Here are some aspects of data science:</p><ol><li>Data Collection</li><li>Data Cleaning and Preprocessing</li><li>Data Analysis</li><li>Feature Engineering</li><li>Machine Learning</li><li>Predictive Analytics</li><li>Data Visualization etc.</li></ol><p>I hope this will help you to understand these three fields in detail. I am open to suggestions from readers. If you want me to improve any part of this article you can comment, or email me.</p><p>Stay tuned, and keep learning…….</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=b5a66e0e6be5" width="1" height="1" alt=""><hr><p><a href="https://medium.com/illumination/difference-between-data-science-data-analyst-and-data-engineer-b5a66e0e6be5">Difference between Data Science, Data Analyst, and Data Engineer</a> was originally published in <a href="https://medium.com/illumination">ILLUMINATION</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
    </channel>
</rss>