<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0" xmlns:cc="http://cyber.law.harvard.edu/rss/creativeCommonsRssModule.html">
    <channel>
        <title><![CDATA[Stories by Aastha Mehra on Medium]]></title>
        <description><![CDATA[Stories by Aastha Mehra on Medium]]></description>
        <link>https://medium.com/@gyansetu?source=rss-fb8537dc5192------2</link>
        <image>
            <url>https://cdn-images-1.medium.com/fit/c/150/150/1*ZcJJLyWB49CI9rVKs1EYQQ.jpeg</url>
            <title>Stories by Aastha Mehra on Medium</title>
            <link>https://medium.com/@gyansetu?source=rss-fb8537dc5192------2</link>
        </image>
        <generator>Medium</generator>
        <lastBuildDate>Mon, 16 Nov 2026 23:38:56 GMT</lastBuildDate>
        <atom:link href="https://medium.com/@gyansetu/feed" rel="self" type="application/rss+xml"/>
        <webMaster><![CDATA[yourfriends@medium.com]]></webMaster>
        <atom:link href="http://medium.superfeedr.com/" rel="hub"/>
        <item>
            <title><![CDATA[Data Science Course in Gurgaon: Complete Fee, Syllabus & Placement Guide]]></title>
            <description><![CDATA[<div class="medium-feed-item"><p class="medium-feed-snippet">There is a moment most career changers recognise &#x2014; sitting at their desk, doing the same work they have done for years, wondering if there&#x2026;</p><p class="medium-feed-link"><a href="https://medium.com/@gyansetu/data-science-course-in-gurgaon-complete-fee-syllabus-placement-guide-73112404aaac?source=rss-fb8537dc5192------2">Continue reading on Medium »</a></p></div>]]></description>
            <link>https://medium.com/@gyansetu/data-science-course-in-gurgaon-complete-fee-syllabus-placement-guide-73112404aaac?source=rss-fb8537dc5192------2</link>
            <guid isPermaLink="false">https://medium.com/p/73112404aaac</guid>
            <dc:creator><![CDATA[Aastha Mehra]]></dc:creator>
            <pubDate>Sat, 14 Mar 2026 08:08:49 GMT</pubDate>
            <atom:updated>2026-03-14T08:08:49.084Z</atom:updated>
        </item>
        <item>
            <title><![CDATA[Vlookup Function in Excel explained in Easiest way | Learn Excel for Free]]></title>
            <link>https://medium.com/gyansetu/vlookup-function-in-excel-explained-in-easiest-way-learn-excel-for-free-594baf6fc249?source=rss-fb8537dc5192------2</link>
            <guid isPermaLink="false">https://medium.com/p/594baf6fc249</guid>
            <category><![CDATA[vlookup]]></category>
            <category><![CDATA[function]]></category>
            <category><![CDATA[tutorial]]></category>
            <category><![CDATA[advanced-excel]]></category>
            <category><![CDATA[excel]]></category>
            <dc:creator><![CDATA[Aastha Mehra]]></dc:creator>
            <pubDate>Wed, 19 May 2021 05:23:16 GMT</pubDate>
            <atom:updated>2021-05-19T05:23:16.693Z</atom:updated>
            <content:encoded><![CDATA[<p>MS Excel — Vlookup in Excel Video Tutorial Vlookup is used to look up something in a table. Vlookup is Vertical Search Function(in the column only). Learn how to use the VLOOKUP function in Microsoft Excel. This tutorial demonstrates how to use Excel VLOOKUP with an easy-to-follow example and takes you step-by-step through the different options when entering your formula.</p><p><a href="https://youtu.be/nVSTRGFXpEQ">https://youtu.be/nVSTRGFXpEQ</a></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=594baf6fc249" width="1" height="1" alt=""><hr><p><a href="https://medium.com/gyansetu/vlookup-function-in-excel-explained-in-easiest-way-learn-excel-for-free-594baf6fc249">Vlookup Function in Excel explained in Easiest way | Learn Excel for Free</a> was originally published in <a href="https://medium.com/gyansetu">Gyansetu</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Introduction to HIVE for Beginners | Hive Architecture]]></title>
            <link>https://medium.com/gyansetu/introduction-to-hive-for-beginners-hive-architecture-afd3f6f3a020?source=rss-fb8537dc5192------2</link>
            <guid isPermaLink="false">https://medium.com/p/afd3f6f3a020</guid>
            <category><![CDATA[hdfs]]></category>
            <category><![CDATA[big-data]]></category>
            <category><![CDATA[apache]]></category>
            <category><![CDATA[hive]]></category>
            <category><![CDATA[architecture]]></category>
            <dc:creator><![CDATA[Aastha Mehra]]></dc:creator>
            <pubDate>Mon, 17 May 2021 06:06:52 GMT</pubDate>
            <atom:updated>2021-05-17T06:06:52.251Z</atom:updated>
            <content:encoded><![CDATA[<p>Apache Hive is a data warehouse framework for querying and analysis of data stored in HDFS.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1000/1*5Du8LMjKXQGSY5qVsCCZeQ.png" /></figure><p>It is developed on top of Hadoop. In this Hive tutorial, we will introduce you to Hive Architecture.</p><p>Hive is a database present in the Hadoop ecosystem that performs DDL and DML operations, and it provides flexible query language such as HQL for better querying and processing of data.</p><p>Hive allows users to read, write, and manage petabytes of data using SQL. Hive is designed for querying and managing only structured data stored in tables. Hive is scalable, fast, and uses familiar concepts.</p><iframe src="https://cdn.embedly.com/widgets/media.html?src=https%3A%2F%2Fwww.youtube.com%2Fembed%2F5DMP7s8dS6k%3Fstart%3D26%26feature%3Doembed%26start%3D26&amp;display_name=YouTube&amp;url=https%3A%2F%2Fwww.youtube.com%2Fwatch%3Fv%3D5DMP7s8dS6k&amp;image=https%3A%2F%2Fi.ytimg.com%2Fvi%2F5DMP7s8dS6k%2Fhqdefault.jpg&amp;key=a19fcc184b9711e1b4764040d3dc5c07&amp;type=text%2Fhtml&amp;schema=youtube" width="854" height="480" frameborder="0" scrolling="no"><a href="https://medium.com/media/f29f71f7e0fa8a24957f2614cfbc1674/href">https://medium.com/media/f29f71f7e0fa8a24957f2614cfbc1674/href</a></iframe><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=afd3f6f3a020" width="1" height="1" alt=""><hr><p><a href="https://medium.com/gyansetu/introduction-to-hive-for-beginners-hive-architecture-afd3f6f3a020">Introduction to HIVE for Beginners | Hive Architecture</a> was originally published in <a href="https://medium.com/gyansetu">Gyansetu</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[BEST PYTHON TUTORIAL FOR BEGINNERS: BASIC DATA TYPES]]></title>
            <link>https://medium.com/gyansetu/best-python-tutorial-for-beginners-basic-data-types-351d9a1315a6?source=rss-fb8537dc5192------2</link>
            <guid isPermaLink="false">https://medium.com/p/351d9a1315a6</guid>
            <category><![CDATA[programming]]></category>
            <category><![CDATA[data-types-in-python]]></category>
            <category><![CDATA[python]]></category>
            <category><![CDATA[data-type]]></category>
            <category><![CDATA[beginner]]></category>
            <dc:creator><![CDATA[Aastha Mehra]]></dc:creator>
            <pubDate>Fri, 08 Jan 2021 10:01:46 GMT</pubDate>
            <atom:updated>2021-01-08T10:04:48.932Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*S6AGWm5Z8zNHu7n3nhpscA.jpeg" /></figure><h4><a href="https://www.gyansetu.in/basic-data-types-in-python/"><strong>Data Types in Python</strong></a></h4><p>Every value in python has a data type. There are the following data types in python:</p><ol><li><strong>Numbers</strong> — Integers, floating-point numbers, and complex numbers are considered as Python Numbers. They are defined as int, float, and complex class.</li><li><strong>String</strong> — List is the flexible and common data type in python. A list can contain variables of different data types but it is an ordered sequence of items.</li><li><strong>List</strong> — The tuple is the same as the list but tuples are immutable. Tuple once created cannot be modified dynamically. Tuples are designed to write-protect data.</li><li><strong>Tuple</strong> — The string is the set of Unicode characters. It can be represented through single quotes or double-quotes. Multi-line strings can be defined using ″ or ′</li><li><strong>Dictionary</strong> — Dictionary is a set of key-value pairs. It is used to store huge amount of data. We can retrieve the data using the key.</li><li><strong>Sets</strong> — Set is the unordered collection of items that are separated by a comma inside braces.</li></ol><h3>Numbers in Python</h3><p>There are 3 types of Numbers in Python :</p><ul><li><strong>Integer(int)</strong> : Integer is a non decimal number formed by the combination of 0–9 digits.</li><li><strong>Float(float)</strong> : Float is a decimal number that can be represented on the number line.</li><li><strong>Complex(complex)</strong> : They are the numbers consist of an imaginary number and real number.</li></ul><h4>Online Python Complier –&gt; <a href="https://www.onlinegdb.com/online_python_compiler">https://www.onlinegdb.com/online_python_compiler</a></h4><h3>Write your First Program in Python with Answer</h3><h4>Example 1:</h4><p>Write your First Python program to add 2 nos</p><blockquote><strong><em>x =10</em></strong></blockquote><blockquote><strong><em>y =20</em></strong></blockquote><blockquote><strong><em>z = x + y</em></strong></blockquote><blockquote><strong><em>print(x)</em></strong></blockquote><blockquote><strong><em>print(y)</em></strong></blockquote><blockquote><strong><em>print(z)</em></strong></blockquote><h4>Output:</h4><p>10</p><p>20</p><p>30</p><h4>Example 2:</h4><p>In previous example, we directly assigned x to 10. Here we use input function to manually assign value to a variable, say x. Run the code to see the result.</p><blockquote><strong><em>x =int(input(“enter any no: “))</em></strong></blockquote><blockquote><strong><em>y =int(input(“enter any no: “))</em></strong></blockquote><blockquote><strong><em>z =int(input(“enter any no: “))</em></strong></blockquote><blockquote><strong><em>p = x * y * z</em></strong></blockquote><blockquote><strong><em>print(p)</em></strong></blockquote><p>While copying and pasting the code in compiler, there may be error because of double inverted commas ” “. Remove and re-write in complier.</p><h4>Output:</h4><p>Enter any number : 3<br>Enter any number : 4<br>Enter any number : 6<br>72</p><blockquote><a href="https://www.gyansetu.in/courses/learn-python-machine-learning-deep-learning-training-gurgaon-delhi/"><strong><em>Learn Python</em></strong></a></blockquote><h4>Example 3:</h4><p>Write a program to convert Celsius to Fahrenheit</p><blockquote><strong><em>Celsius = 37.5</em></strong><em><br></em><strong><em>Fahrenheit = (Celsius * 1.8) + 32</em></strong><em><br></em><strong><em>print(‘%0.1f degree Celsius is equal to %0.1f degree Fahrenheit’ %(Celsius,Fahrenheit))</em></strong></blockquote><h4>Output:</h4><p>37.5 degree Celsius is equal to 99.5 degree Fahrenheit</p><h3>Solve the Python Problems</h3><p><strong>Problem — 1:</strong></p><blockquote><strong><em>x=float(input(“X : “))</em></strong></blockquote><blockquote><strong><em>y=float(input(“Y : “))</em></strong></blockquote><blockquote><strong><em>print(“X = “,x)</em></strong></blockquote><blockquote><strong><em>print(“Type(x) = “,type(x))</em></strong></blockquote><blockquote><strong><em>print(“Y = “,y)</em></strong></blockquote><blockquote><strong><em>print(“Type(y) = “,type(y))</em></strong></blockquote><p><strong>Problem — 2:</strong></p><p><strong>x=3+5j<em>#here 3 is real and 5 is imaginary known as iota</em></strong></p><p><strong>print(print(“Type of X : “,type(x)))</strong></p><p><strong><em>#The output of inner print function is the input of outer print function</em></strong></p><p><strong><em># So The overall output is “none” </em>print(“Value of X : “,x)</strong></p><p><strong>Problem — 3:</strong></p><blockquote><strong><em>x=7489231752389582589023580265786238589275890237472895789237892374899734</em></strong></blockquote><blockquote><strong><em>print(x)</em></strong></blockquote><blockquote><strong><em>x.bit_length()</em></strong></blockquote><blockquote><strong><em>x.__sizeof__()</em></strong></blockquote><h3>String in Python</h3><p>A string in Python consists of a series or sequence of characters — letters, numbers, and special characters. Strings can be indexed — often synonymously called subscripted as well. Similar to C, the first character of a string has the index 0.</p><h4>Example — 1:</h4><blockquote><strong><em>s1=’hello world’</em></strong></blockquote><blockquote><strong><em>s2=”Hello World”</em></strong></blockquote><blockquote><strong><em>s3=”””</em></strong></blockquote><blockquote><strong><em>Hi this is Strings in python.</em></strong></blockquote><blockquote><strong><em>Python is an awesome language.</em></strong></blockquote><blockquote><strong><em>“””</em></strong></blockquote><blockquote><strong><em>print(s1)</em></strong></blockquote><blockquote><strong><em>print(s2)</em></strong></blockquote><blockquote><strong><em>print(s3)</em></strong></blockquote><h4>Output:</h4><p>hello world<br>Hello World</p><p>Hi this is Strings in python.<br>Python is an awesome language.</p><h3>Properties of String</h3><ol><li>Indexing # starts from 0 to n — 1 where n is the length of string use []</li><li>Slicing # used to make sub-strings from strings used with start,end and step variable</li></ol><h4>Example — 1:</h4><blockquote><strong><em>s=”Python”</em></strong></blockquote><blockquote><strong>#indexing in strings</strong></blockquote><blockquote><strong><em>print(s[3])</em></strong></blockquote><blockquote><strong><em>print(s[-3])</em></strong></blockquote><h4>Output:</h4><p>h</p><p>h</p><h4>Example — 2:</h4><blockquote><strong>#-12–11–10–9–8–7–6–5–4–3–2–1 (reverse indexing)</strong></blockquote><blockquote><strong><em>s=”Hello World!”</em></strong></blockquote><blockquote><strong># 01234567891011</strong></blockquote><blockquote><strong>#s[start:end:step] always starts with start end end string in end-1 character</strong></blockquote><blockquote><strong><em>x=s[3:11]</em></strong></blockquote><blockquote><strong><em>y=s[:]</em></strong></blockquote><blockquote><strong><em>z=s[:6]</em></strong></blockquote><blockquote><strong><em>p=s[6:]</em></strong></blockquote><blockquote><strong><em>print(x)</em></strong></blockquote><blockquote><strong><em>print(y)</em></strong></blockquote><blockquote><strong><em>print(z)</em></strong></blockquote><blockquote><strong><em>print(p)</em></strong></blockquote><blockquote><strong><em>print(s)</em></strong></blockquote><h4>Output:</h4><p>lo World</p><p>Hello World!</p><p>Hello</p><p>World!</p><p>Hello World!</p><h4>Example — 3:</h4><blockquote><strong><em>s=”Hello World!”</em></strong></blockquote><blockquote><strong><em>print(s[::-1])</em></strong></blockquote><blockquote><strong><em>print(s[:-1])</em></strong></blockquote><blockquote><strong><em>print(s[10:13:-1])</em></strong></blockquote><blockquote><strong><em>print(s[-12:-6])</em></strong></blockquote><blockquote><strong><em>print(s[-1:-13:-1])</em></strong></blockquote><blockquote><strong><em>print(s[::2])</em></strong></blockquote><blockquote><strong><em>print(s[::-2])</em></strong></blockquote><h4>Output:</h4><p>!dlroWolleH</p><p>Hello World</p><p>Hello</p><p>!dlroWolleH</p><p>HloWrd</p><p>!lo le</p><h3>Some Basic Functions of String</h3><h3>Swapcase</h3><p>The Swapcase function is used to convert every single characters of string from lower case to upper case and from upper case to lower case. If the input string contains a mix of upper case and lower case then it swaps lower case characters to upper case and upper-case characters to lower case characters.</p><p><strong>Syntax:- </strong>Swapcase( string)</p><blockquote><strong><em>s=input(“Enter a String : “)</em></strong><em><br></em><strong><em>print(s)</em></strong></blockquote><blockquote><strong><em>#swapcase used to change uppercase letters into lowercase letters and vice versa.</em></strong><em><br></em><strong><em>print(“Swapcase : “,s.swapcase())</em></strong></blockquote><h3>Upper</h3><p>The Upper() is a Python String Method which is used to convert every character of the given string to upper case letters.</p><blockquote><strong><em>s=input(“Enter a String : “)</em></strong><em><br></em><strong><em>print(s)</em></strong></blockquote><blockquote><strong><em>#change all letters into uppercase and return the string</em></strong><em><br></em><strong><em>print(“Upper : “,s.upper())</em></strong></blockquote><h3>Lower</h3><p>The lower is a python string method which is used to convert every character of the given string to lower case characters. If the input string has no uppercase characters, it returns the original string.</p><blockquote><strong><em>s=input(“Enter a String : “)</em></strong><em><br></em><strong><em>print(s)</em></strong></blockquote><blockquote><strong><em>#change all letters into lowercase and return the string</em></strong><em><br></em><strong><em>print(“Lower : “,s.lower())</em></strong></blockquote><h3>Strip, Lstrip, Rstrip</h3><p>These method removes characters from both the left and right side based on the argument.</p><p><strong>Syntax : </strong>string.strip([chars])</p><ul><li>lstrip()- removes the leading characters/whitespaces.</li><li>rstrip() — removes the trailing characters/whitespaces</li></ul><blockquote><strong><em>s=input(“Enter a String : “)</em></strong><em><br></em><strong><em>print(s)</em></strong></blockquote><blockquote><strong><em>#strip is used to remove all leading and trailing spaces from string</em></strong><em><br></em><strong><em>print(“Strip : “,s.strip())</em></strong></blockquote><blockquote><strong><em>#lstrip is used to remove left space</em></strong><em><br></em><strong><em>print(“LStrip : “,s.lstrip())</em></strong></blockquote><blockquote><em>#</em><strong><em>rstrip is used to remove rightspace</em></strong><em><br></em><strong><em>print(“RStrip : “,s.rstrip())</em></strong></blockquote><h3>Find</h3><p>The Find method is used to find the given substring based on the index value. If find() method found the value, it will return the lowest index of the substring else it will return -1.</p><p><strong>Syntax :- </strong>str.find(sub[, start[, end]] )</p><blockquote><strong><em>p=input(“Enter pattern to search : “).strip().lower()</em></strong><em><br></em><strong><em>print(“Find Result : “,s.find(p))</em></strong></blockquote><h3>Format</h3><p>Format method is one of the string method, which takes any number of parameter and returns the formatted string.</p><p><strong>Syntax</strong>: Str.format()</p><blockquote><strong><em>print(“String : {}\nPattern : {} “.format(s,p))#{} is replaced with the parameters passed in format() function</em></strong></blockquote><h3>Center</h3><p>The center method returns a string which is padded with some specified characters. It takes two parameters.</p><blockquote><strong><em>print(s.center(1000,’*’))</em></strong></blockquote><h3>Output:</h3><p>Enter a String : ALL Dogs ARE Not cats<br>ALL Dogs ARE Not cats<br><strong>Swapcase</strong> : all dOGS are nOT CATS<br><strong>Upper</strong> : ALL DOGS ARE NOT CATS<br><strong>Lower</strong> : all dogs are not cats<br><strong>Strip</strong> : ALL Dogs ARE Not cats<br><strong>LStrip</strong> : ALL Dogs ARE Not cats<br><strong>RStrip</strong> : ALL Dogs ARE Not cats<br>Enter pattern to search : cats<br>Find Result : 21<br>String : ALL Dogs ARE Not cats<br>Pattern : cats<br>******************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************* ALL Dogs ARE Not cats********************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************</p><h3>Replace Function</h3><p>replace() is an inbuilt function in Python programming language that returns a copy of the string where all occurrences of a substring is replaced with another substring.</p><ol><li>replace(old, new, count) #syntax</li><li>old — old substring you want to replace.</li><li>new — new substring which would replace the old substring.</li><li>count — the number of times you want to replace the old substring with the new substring. (Optional)</li></ol><h4>Example — 1:</h4><blockquote><strong><em>string=”HI hello HI hello hi hello hi hello”</em></strong></blockquote><blockquote><strong><em># Prints the string by replacing hi by HI</em></strong><em><br></em><strong><em>print(string.replace(“hi”,”HI”))</em></strong></blockquote><blockquote><strong><em># Prints the string by replacing only first 3 occurence of hello</em></strong><em><br></em><strong><em>print(string.replace(“hello”,”HELLO”,3))</em></strong></blockquote><h4>Output:</h4><p>HI hello HI hello HI hello HI hello<br>HI HELLO HI HELLO hi HELLO hi hello</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=351d9a1315a6" width="1" height="1" alt=""><hr><p><a href="https://medium.com/gyansetu/best-python-tutorial-for-beginners-basic-data-types-351d9a1315a6">BEST PYTHON TUTORIAL FOR BEGINNERS: BASIC DATA TYPES</a> was originally published in <a href="https://medium.com/gyansetu">Gyansetu</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Best 10 uses of MS Excel in our daily lives]]></title>
            <link>https://medium.com/gyansetu/best-10-uses-of-ms-excel-in-our-daily-lives-30bb73f53bac?source=rss-fb8537dc5192------2</link>
            <guid isPermaLink="false">https://medium.com/p/30bb73f53bac</guid>
            <category><![CDATA[uses-of-excel]]></category>
            <category><![CDATA[ms-excel-use]]></category>
            <category><![CDATA[excel-in-daily-life]]></category>
            <dc:creator><![CDATA[Aastha Mehra]]></dc:creator>
            <pubDate>Tue, 15 Dec 2020 08:33:38 GMT</pubDate>
            <atom:updated>2020-12-15T08:33:38.815Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/810/1*S9PZXLBIcdbkiYSurur-QA.png" /></figure><p>In the quick &amp; progressing lifestyle of people, there is utmost demand for shortcuts &amp; advanced methods to understand and resolve the daily problems.</p><p>Moreover, there are multiple tasks that we do in our daily lives such as calculating monthly expenses, budgeting &amp; goal setting, students tacking their syllabus, and various other things that most people do in casual ways rather than following simple tools that provide concrete shapes.</p><h3><a href="https://www.gyansetu.in/best-10-uses-of-ms-excel-in-daily-life/">Best 10 uses of MS Excel in our daily lives</a></h3><h3>MS Excel for Students &amp; Teachers:</h3><p>Teachers can make the best use of table styles, charts, shapes, data tools, and various formulas to educate students in the classrooms.</p><p>Whereas students can enhance their learning skills to solve basic and logical statistical &amp; mathematical problems in excel.</p><h3>Uses of Excel: Goal Setting &amp; Planning</h3><p>Goal setting &amp; planning are the kinds of repeated tasks carried on each day.</p><p>From business owners to students to housekeepers each individual is involved with the process of goal setting and planning.</p><p>The goal-setting and planning process involves white paper, time, and the immense pressure of calculations, but with the use of MS Excel, this process has become efficient, quick, easy, and environmentally friendly.</p><h3>Uses of Excel: Entrepreneurs &amp; Business Owners:</h3><p>A large chunk of the millennial population across the world is aspiring to become an entrepreneur which requires not only efficient planning but also analysis of team performance, work progress, business progress &amp; payout detail.</p><p>Whether a new business or an established business, each can derive benefits from using excel.</p><p>The data can be stored, analyzed and sophisticated presented on excel sheets using multiple tables, pivot tables, data highlighters, sorters, sheets, and cell organizers among others.</p><h3>Uses of Excel for Housewives:</h3><p>Housewives are known to be the best keepers of monthly expenses &amp; saving money.</p><p>And thus excel can assist housewives to manage their daily house expenses which can track down the spending habits of each member of the house.</p><p>Furthermore, housewives using Excel can be beneficial for them to make their kids learn basic excel skills.</p><h3>Uses of Excel: Career Development:</h3><p>Career Development revolves around career management.</p><p>The tasks such as learning management, time management, work, and life management, and goal-focused habits are important which can be effectively practiced on MS excel.</p><h3>Uses of Excel: Monthly Expenses Report:</h3><p>Based on monthly expense data entered in the excel sheet, the user can create a comprehensive monthly expenses report which can highlight the top expenditure segments and study the pattern of expenditure &amp; required savings pattern to be followed to reach the desired goal.</p><h3>Uses of Excel: Online Access:</h3><p>Another important use of MS Excel is that the files can be accessed online from any part of the world anytime and anywhere.</p><p>It provides the convenience of accessing the excel files over mobile phones even if there is the unavailability of laptops &amp; lets you exercise the work easily without any problem.</p><h3>Uses of Excel: Developing Future Strategies:</h3><p>The data related to future strategies such as investments and major expenses anticipated at future date can be entered in the form of charts and graphs so it can lead to identify the trends and compare each possibility.</p><p>Using MS Excel, the trend lines can be expressed through graphs and charts to forecast the future value of money invested.</p><h3>Uses of Excel: Create a Calendar or Schedule:</h3><p>Whether it is family-based planning for a weekly, monthly, or yearly calendar or a personal appointment daily planner or a schedule for managing bill payments, homework, favorite sports team’s games, and many more, the excel can make it easy to compile, filter, search, organize and simplify large amounts of data.</p><h3>Uses of Excel: Event &amp; Project Planning:</h3><p>MS Excel is being widely used in the planning of a large work project or holiday or wedding party, where it can keep track of different tasks, efforts, and deadlines, and to analyze the schedules of collaborators in the planning of the event with other participants and make use of excel sheet as a central database of all relevant information required by all members to execute the project or event.</p><p>The more a person gets deeper in learning the wide benefits of excel, the more they tend to develop smarter ways to implement excel in daily life.</p><p>It is better to provide some time on learning &amp; getting hands-on excel rather than doing things through unnecessary and less productive ways.</p><p>Other than the above-mentioned benefits, various other uses of excel can be developed as per the individual requirements.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=30bb73f53bac" width="1" height="1" alt=""><hr><p><a href="https://medium.com/gyansetu/best-10-uses-of-ms-excel-in-our-daily-lives-30bb73f53bac">Best 10 uses of MS Excel in our daily lives</a> was originally published in <a href="https://medium.com/gyansetu">Gyansetu</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[WHAT IS NATURAL LANGUAGE PROCESSING? INTRO TO NLP]]></title>
            <link>https://medium.com/gyansetu/what-is-natural-language-processing-intro-to-nlp-bc91f42dfc9b?source=rss-fb8537dc5192------2</link>
            <guid isPermaLink="false">https://medium.com/p/bc91f42dfc9b</guid>
            <category><![CDATA[machine-learning]]></category>
            <category><![CDATA[artificial-intelligence]]></category>
            <category><![CDATA[ai]]></category>
            <category><![CDATA[nlp]]></category>
            <dc:creator><![CDATA[Aastha Mehra]]></dc:creator>
            <pubDate>Tue, 08 Dec 2020 12:16:42 GMT</pubDate>
            <atom:updated>2020-12-08T12:16:42.220Z</atom:updated>
            <content:encoded><![CDATA[<p>Natural Language Processing (NLP) is to make <strong>computers learn, process, and manipulate</strong> natural languages.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/900/1*wPdc7HkAdTG3azezLRTB7Q.png" /></figure><h3>What is Natural Language Processing (NLP)?</h3><p>NLP is a part of machine learning that deals with understanding, analyzing, and generating the languages that humans use naturally or communicate in order to interface with computers instead of machine language.</p><h3>Applications of NLP</h3><ul><li>Machine Translation — Google translate, etc.</li><li>Language generation</li><li>Sentiment Analysis</li><li>Chatbots</li><li>Web search</li><li>Personal Assistants like Siri, Cortana, and Alexa, etc.</li><li>Auto-complete: In search engines (e.g. Google, Bing).</li><li>Spell-checking — Grammarly is a very good example of it.</li><li>Many more….</li></ul><h3>NLP Pipeline</h3><figure><img alt="" src="https://cdn-images-1.medium.com/max/800/0*vtTw9CZ48EZEuybh.png" /></figure><p><strong>There are 3 stages of an NLP pipeline</strong>:</p><ol><li><strong>Text Processin</strong>g:- Take raw text as input, clean it, normalize it, tokenize it, remove stop words, etc. and convert it into a form that is best for feature extraction</li><li><strong>Feature Extraction</strong>:- Extract features that are appropriate for an NLP task you are trying to accomplish and the model you are trying to use.</li><li><strong>Modeling</strong>:- Design a machine learning model, fit its parameters to the training data, and then use it to make predictions on unseen data.</li></ol><p>This process/pipeline isn’t always linear and may require additional steps.</p><p><strong>Read also:- </strong><a href="https://www.gyansetu.in/regression-vs-classification-in-machine-learning/"><strong>Regression vs classification in Machine Learning</strong></a></p><h3>Why do we need to process text?</h3><p>To make our raw input text free from any constructs that are not required for the task.</p><ul><li><strong>Extracting plain text </strong>— Extract plain text from pdf, documents, web, speech, scans, etc.</li><li><strong>Reducing complexity </strong>— Things like capitalization, punctuation, common words/stop words, etc. do not add much meaning to the text. Sometimes it’s best to remove that to reduce the complexity of the model you want to apply later.</li></ul><h3>Text Processing</h3><h3>Data Cleaning</h3><p>Here we remove special characters, HTML tags, etc. from the raw text as they do not contain any info for the model to learn and are irrelevant or noisy data.</p><pre>import urllib.request<br>url = &#39;https://en.wikipedia.org/wiki/ISO_3166-1_alpha-2&#39;<br>req = urllib.request.urlopen(url)<br>article = req.read().decode()<br>with open(&#39;ISO_3166-1_alpha-2.html&#39;, &#39;w&#39;) as fo:<br>fo.write(article)</pre><pre><strong>from bs4 import BeautifulSoup  </strong><br><br><br><br><strong> # Load article, turn into soup and get the &lt;table&gt;s.</strong><br><br><strong> article = open(&#39;ISO_3166-1_alpha-2.html&#39;).read()</strong><br><br><strong> soup = BeautifulSoup(article, &#39;html.parser&#39;)</strong><br><br><strong>tables = soup.find_all(&#39;table&#39;, class_=&#39;sortable&#39;)</strong><br><br><strong>   </strong><br><br><strong> # Search through the tables for the one with the headings we want.</strong><br><br><strong> for table in tables:</strong><br><br><strong> ths = table.find_all(&#39;th&#39;)</strong><br><br><strong> headings = [th.text.strip() for th in this]</strong><br><br><strong> if headings[:5] == [&#39;Code&#39;, &#39;Country name&#39;, &#39;Year&#39;, &#39;ccTLD&#39;, &#39;ISO 3166-2&#39;]:</strong><br><br><strong> break</strong><br><br><br><br><strong># Extract the columns we want and write to a semicolon-delimited text file.</strong><br><br><strong>with open(&#39;iso_3166-1_alpha-2_codes.txt&#39;, &#39;w&#39;) as fo:</strong><br><br><strong>for tr in table.find_all(&#39;tr&#39;):</strong><br><br><strong>tds = tr.find_all(&#39;td&#39;)</strong><br><br><strong>if not tds:</strong><br><br><strong>continue</strong><br><br><strong>code, country, year, ccTLD = [td.text.strip() for td in tds[:4]]</strong><br><br><strong> # Wikipedia does something funny with country names containing</strong><br><br><strong> # accented characters: extract the correct string form.</strong><br><br><strong> if &#39;!&#39; in country:</strong><br><br><strong>  country = country[country.index(&#39;!&#39;)+1:]</strong><br><br><strong> print(&#39;; &#39;.join([code, country, year, ccTLD]), file=fo)</strong></pre><h3>Data Normalization</h3><p>Data normalization involves steps such as case normalization, punctuation removal, etc. so that the text is in a single format for the machine to learn.</p><h3>Case Normalization</h3><p><strong>Car, car, CAR -&gt; they all mean the same thing.</strong></p><p>So, convert all capitalization to lower to bring to a common case.</p><pre>1.  # Convert text to lower case</pre><pre>2.  text = text.lower()</pre><pre>3.  print(text)</pre><h3>Punctuation Removal</h3><p>Replace punctuation with space.</p><pre>1.  import re</pre><pre>2.</pre><pre>3.  # Remove punctuation characters</pre><pre>4.  text = re.sub(r&quot;[^a-zA-Z0-9]&quot;, &quot; &quot;, text)</pre><pre>5.  print(text)</pre><h3>Tokenization</h3><p>Tokenization is the process of breaking up text documents into individual words called tokens.</p><pre>1.  # Split text into tokens (words)</pre><pre>2.  # Splits based on whitespace</pre><pre>3.  words = text.split()</pre><pre>4.  print(words)</pre><p>So, far we have been using python inbuilt functions for this task.</p><h3>Tokenization using NLTK</h3><pre>1.  import nltk</pre><pre>2.  nltk.download(&#39;punkt&#39;) # required for tokenizer</pre><pre>3.</pre><pre>4.  from nltk.tokenize import word_tokenize, sent_tokenize</pre><pre>5.</pre><pre>6.  # Split text into words using NLTK</pre><pre>7.  text = &quot;Mr. Gyansetu graduated from IIT-Delhi. He later started an analytics firm called Lux, which catered to enterprise customers.&quot;</pre><pre>8.  words = word.tokenize(text)</pre><pre>9.  print(words)</pre><pre>10.</pre><pre>11.## Output</pre><pre>12.## [&#39;Mr.&#39;, &#39;Gyansetu&#39;, &#39;graduated&#39;, &#39;from&#39;, &#39;IIT-Delhi&#39;, &#39;.&#39;, &#39;He&#39;, &#39;later&#39;, &#39;started&#39;, &#39;an&#39;, &#39;analytics&#39;, &#39;firm&#39;, &#39;called&#39;, &#39;Lux&#39;, &#39;,&#39;, &#39;which&#39;, &#39;catered&#39;, &#39;to&#39;, &#39;enterprise&#39;, &#39;customers&#39;, &#39;.&#39;]</pre><pre>13.</pre><pre>14.</pre><pre>15.# Split text into sentences</pre><pre>16.text = &quot;Mr. Gyansetu graduated from IIT-Delhi. He later started an analytics firm called Lux, which catered to enterprise customers.&quot;</pre><pre>17.sentences = sent_tokenize(text)</pre><pre>18.print(sentences)</pre><pre>19.</pre><pre>20.## Output</pre><pre>21.## [&#39;Mr. Gyansetu graduated from IIT-Delhi.&#39;, &#39;He later started an analytics firm called Lux, which catered to enterprise customers.&#39;]</pre><h3>Stop Word Removal</h3><p>Stop word removal means the removal of non-important words like ‘a’, ‘is’, ‘the’, ‘and’, ‘an’, ‘are’, “me”, “i”, etc.</p><p>There is an in-built stopword list in NLTK which we can use to remove stop words from text documents. However this is not the standard stopwords list for every problem, we can also define our own set of stop words based on the domain.</p><pre>1.  import nltk</pre><pre>2.  nltk.download(&#39;stopwords&#39;) #corpora of stopwords (required for stopwords)</pre><pre>3.  # List of stop words</pre><pre>4.  from nltk.corpus import stopwords</pre><pre>5.  print(stopwords.words(&quot;english&quot;))</pre><pre>6.</pre><pre>7.  ## Output</pre><pre>8.  ## [&#39;i&#39;, &#39;me&#39;, &#39;my&#39;, &#39;myself&#39;, &#39;we&#39;, &#39;our&#39;, &#39;ours&#39;, &#39;ourselves&#39;, &#39;you&#39;, &quot;you&#39;re&quot;, &quot;you&#39;ve&quot;, &quot;you&#39;ll&quot;, &quot;you&#39;d&quot;, &#39;your&#39;, &#39;yours&#39;, &#39;yourself&#39;, &#39;yourselves&#39;, &#39;he&#39;, &#39;him&#39;, &#39;his&#39;, &#39;himself&#39;, &#39;she&#39;, &quot;she&#39;s&quot;, &#39;her&#39;, &#39;hers&#39;, &#39;herself&#39;, &#39;it&#39;, &quot;it&#39;s&quot;, &#39;its&#39;, &#39;itself&#39;, &#39;they&#39;, &#39;them&#39;, &#39;their&#39;, &#39;theirs&#39;, &#39;themselves&#39;, &#39;what&#39;, &#39;which&#39;, &#39;who&#39;, &#39;whom&#39;, &#39;this&#39;, &#39;that&#39;, &quot;that&#39;ll&quot;, &#39;these&#39;, &#39;those&#39;, &#39;am&#39;, &#39;is&#39;, &#39;are&#39;, &#39;was&#39;, &#39;were&#39;, &#39;be&#39;, &#39;been&#39;, &#39;being&#39;, &#39;have&#39;, &#39;has&#39;, &#39;had&#39;, &#39;having&#39;, &#39;do&#39;, &#39;does&#39;, &#39;did&#39;, &#39;doing&#39;, &#39;a&#39;, &#39;an&#39;, &#39;the&#39;, &#39;and&#39;, &#39;but&#39;, &#39;if&#39;, &#39;or&#39;, &#39;because&#39;, &#39;as&#39;, &#39;until&#39;, &#39;while&#39;, &#39;of&#39;, &#39;at&#39;, &#39;by&#39;, &#39;for&#39;, &#39;with&#39;, &#39;about&#39;, &#39;against&#39;, &#39;between&#39;, &#39;into&#39;, &#39;through&#39;, &#39;during&#39;, &#39;before&#39;, &#39;after&#39;, &#39;above&#39;, &#39;below&#39;, &#39;to&#39;, &#39;from&#39;, &#39;up&#39;, &#39;down&#39;, &#39;in&#39;, &#39;out&#39;, &#39;on&#39;, &#39;off&#39;, &#39;over&#39;, &#39;under&#39;, &#39;again&#39;, &#39;further&#39;, &#39;then&#39;, &#39;once&#39;, &#39;here&#39;, &#39;there&#39;, &#39;when&#39;, &#39;where&#39;, &#39;why&#39;, &#39;how&#39;, &#39;all&#39;, &#39;any&#39;, &#39;both&#39;, &#39;each&#39;, &#39;few&#39;, &#39;more&#39;, &#39;most&#39;, &#39;other&#39;, &#39;some&#39;, &#39;such&#39;, &#39;no&#39;, &#39;nor&#39;, &#39;not&#39;, &#39;only&#39;, &#39;own&#39;, &#39;same&#39;, &#39;so&#39;, &#39;than&#39;, &#39;too&#39;, &#39;very&#39;, &#39;s&#39;, &#39;t&#39;, &#39;can&#39;, &#39;will&#39;, &#39;just&#39;, &#39;don&#39;, &quot;don&#39;t&quot;, &#39;should&#39;, &quot;should&#39;ve&quot;, &#39;now&#39;, &#39;d&#39;, &#39;ll&#39;, &#39;m&#39;, &#39;o&#39;, &#39;re&#39;, &#39;ve&#39;, &#39;y&#39;, &#39;ain&#39;, &#39;aren&#39;, &quot;aren&#39;t&quot;, &#39;couldn&#39;, &quot;couldn&#39;t&quot;, &#39;didn&#39;, &quot;didn&#39;t&quot;, &#39;doesn&#39;, &quot;doesn&#39;t&quot;, &#39;hadn&#39;, &quot;hadn&#39;t&quot;, &#39;hasn&#39;, &quot;hasn&#39;t&quot;, &#39;haven&#39;, &quot;haven&#39;t&quot;, &#39;isn&#39;, &quot;isn&#39;t&quot;, &#39;ma&#39;, &#39;mightn&#39;, &quot;mightn&#39;t&quot;, &#39;mustn&#39;, &quot;mustn&#39;t&quot;, &#39;needn&#39;, &quot;needn&#39;t&quot;, &#39;shan&#39;, &quot;shan&#39;t&quot;, &#39;shouldn&#39;, &quot;shouldn&#39;t&quot;, &#39;wasn&#39;, &quot;wasn&#39;t&quot;, &#39;weren&#39;, &quot;weren&#39;t&quot;, &#39;won&#39;, &quot;won&#39;t&quot;, &#39;wouldn&#39;, &quot;wouldn&#39;t&quot;]</pre><pre>9.</pre><pre>10. # Remove stop words</pre><pre>11. words = [w for w in words if w not in stopwords.words(&quot;english&quot;)]</pre><pre>12. print(words)</pre><pre>13.</pre><pre>14. ## Output</pre><pre>15. ## [&#39;Mr.&#39;, &#39;Gyansetu&#39;, &#39;graduated&#39;, &#39;IIT-Delhi&#39;, &#39;.&#39;, &#39;He&#39;, &#39;later&#39;, &#39;started&#39;, &#39;analytics&#39;, &#39;firm&#39;, &#39;called&#39;, &#39;Lux&#39;, &#39;,&#39;, &#39;catered&#39;, &#39;enterprise&#39;, &#39;customers&#39;, &#39;.&#39;]</pre><h3>Parts of Speech (POS) Tagging</h3><p>Given a sentence, determine POS tags for each word (<em>e.g.,</em> NOUN, VERB, ADV, ADJ).</p><p>You can use an inbuilt part of speech tagger provided in NLTK. There are other more advanced forms of POS tagging that can learn sentence structures and tags from given data, including Hidden Markov Models (HMMs) and Recurrent Neural Networks (RNNs).</p><pre>1.  import nltk</pre><pre>2.  nltk.download(&#39;averaged_perceptron_tagger&#39;)</pre><pre>3.</pre><pre>4.  from nltk import pos_tag</pre><pre>5.</pre><pre>6.  # Tag parts of speech (PoS)</pre><pre>7.  sentence = word_tokenize(&quot;I always lie down to tell a lie.&quot;)</pre><pre>8.  pos_tag(sentence)</pre><pre>9.</pre><pre>10. ## Output</pre><pre>11. &quot;&quot;&quot;</pre><pre>12. [(&#39;I&#39;, &#39;PRP&#39;),</pre><pre>13. (&#39;always&#39;, &#39;RB&#39;),</pre><pre>14. (&#39;lie&#39;, &#39;VBP&#39;),</pre><pre>15. (&#39;down&#39;, &#39;RP&#39;),</pre><pre>16. (&#39;to&#39;, &#39;TO&#39;),</pre><pre>17. (&#39;tell&#39;, &#39;VB&#39;),</pre><pre>18. (&#39;a&#39;, &#39;DT&#39;),</pre><pre>19. (&#39;lie&#39;, &#39;NN&#39;),</pre><pre>20. (&#39;.&#39;, &#39;.&#39;)]</pre><pre>21. &quot;&quot;&quot;</pre><h3>Named Entity Recognition</h3><p>In information extraction, a <strong><em>named entity</em></strong> is a real-world object, such as persons, locations, organizations, products, etc., that can be denoted with a proper <strong><em>name</em></strong>.</p><pre>1.  import nltk</pre><pre>2.  nltk.download(&#39;maxent_ne_chunker&#39;)</pre><pre>3.  nltk.download(&#39;words&#39;)</pre><pre>4.</pre><pre>5.  from nltk import pos_tag, ne_chunk</pre><pre>6.  from nltk.tokenize import word_tokenize</pre><pre>7.</pre><pre>8.  # Recognize named entities in a tagged sentence</pre><pre>9.  out = ne_chunk(pos_tag(word_tokenize(&quot;Shalki joined Gyansetu Ltd. in Gurgaon.&quot;)))</pre><pre>10. print(out.__repr__())</pre><pre>11.</pre><pre>12. ## Output</pre><pre>13. ## Tree(&#39;S&#39;, [Tree(&#39;PERSON&#39;, [(&#39;Shalki&#39;, &#39;NNP&#39;)]), (&#39;joined&#39;, &#39;VBD&#39;), Tree(&#39;PERSON&#39;, [(&#39;Gyansetu&#39;, &#39;NNP&#39;)]), (&#39;Ltd.&#39;, &#39;NNP&#39;), (&#39;in&#39;, &#39;IN&#39;), Tree(&#39;GPE&#39;, [(&#39;Gurgaon&#39;, &#39;NNP&#39;)]), (&#39;.&#39;, &#39;.&#39;)])</pre><h3>Stemming</h3><p><strong>Stemming </strong>is a process of reducing a word to its root form.</p><p>branching, branched, branches can all be reduced to branch.</p><p>‌</p><p>Caching, caches, cached can all be reduced to the cache.</p><pre>1.  from nltk.stem.porter import PorterStemmer</pre><pre>2.</pre><pre>3.  # Reduce words to their stemmer</pre><pre>4.  stemmed = [PorterStemmer().stem(w) for w in words]</pre><pre>5.  print(stemmed)</pre><pre>6.</pre><pre>7.  ## Output</pre><pre>8.  ## [&#39;mr.&#39;, &#39;gyansetu&#39;, &#39;graduat&#39;, &#39;iit-delhi&#39;, &#39;.&#39;, &#39;He&#39;, &#39;later&#39;, &#39;start&#39;, &#39;analyt&#39;, &#39;firm&#39;, &#39;call&#39;, &#39;lux&#39;, &#39;,&#39;, &#39;cater&#39;, &#39;enterpris&#39;, &#39;custom&#39;, &#39;.&#39;]</pre><h3>Lemmatization</h3><p><strong>Lemmatization</strong> is another technique for reducing words to it’s normalized form. But in this case, the transformation actually uses a dictionary to map words to their actual form.</p><pre>1.  import nltk</pre><pre>2.  nltk.download(&#39;wordnet&#39;)</pre><pre>3.</pre><pre>4.  from nltk.stem.wordnet import WordNetLemmatizer</pre><pre>5.</pre><pre>6.  # Reduce words to their root form</pre><pre>7.  lemmed = [WordNetLemmatizer().lemmatize(w) for w in words]</pre><pre>8.  print(lemmed)</pre><pre>9.</pre><pre>10. ## Output</pre><pre>11. ## [&#39;Mr.&#39;, &#39;Gyansetu&#39;, &#39;graduated&#39;, &#39;IIT-Delhi&#39;, &#39;.&#39;, &#39;He&#39;, &#39;later&#39;, &#39;started&#39;, &#39;analytics&#39;, &#39;firm&#39;, &#39;called&#39;, &#39;Lux&#39;, &#39;,&#39;, &#39;catered&#39;, &#39;enterprise&#39;, &#39;customer&#39;, &#39;.&#39;]</pre><pre>12.</pre><pre>13. # Reduce words to their root form</pre><pre>14. # default it will lemmatize noun forms, you can specify to lemmatize any other parts-of-speech</pre><pre>15. lemmed = [WordNetLemmatizer().lemmatize(w, pos=&#39;v&#39;) for w in words]</pre><pre>16. print(lemmed)</pre><pre>17.</pre><pre>18. ## Output</pre><pre>19. ## [&#39;Mr.&#39;, &#39;Gyansetu&#39;, &#39;graduate&#39;, &#39;IIT-Delhi&#39;, &#39;.&#39;, &#39;He&#39;, &#39;later&#39;, &#39;start&#39;, &#39;analytics&#39;, &#39;firm&#39;, &#39;call&#39;, &#39;Lux&#39;, &#39;,&#39;, &#39;cater&#39;, &#39;enterprise&#39;, &#39;customers&#39;, &#39;.&#39;]</pre><p>change, changing, changes, changed, changer is transformed to change in Stemmed from (stemming does not confirm the root word is also a full actual word), but this is transformed to change in Lemmatized form (lemmatization will have the root word also as an actual meaningful word).</p><h3>Feature Extraction</h3><p>Feature Extraction is a way of extracting feature vectors from the text after the text processing step so that it can be used in the machine learning model as input. This extracted feature from the text can be wordnet of the graph of nodes, a vector representing words (doc2vec, word2vec, sent2vec, glove, etc.)</p><p>Word Embedding is one such technique where we can represent the text using vectors. The more popular forms of word embeddings are:</p><ol><li>BoW, which stands for Bag of Words</li><li>TF-IDF, which stands for Term Frequency-Inverse Document Frequency</li></ol><h3>Bag-of-Words Model</h3><p>Bag of words model, or BoW for short, is a way of extracting features from the text for use in modeling, such as machine learning algorithms. It treats each document as a collection/bag of words.</p><p>A bag-of-words is a representation of text that describes the occurrence of words within a document. It involves two things:</p><p>- A vocabulary of known words in the corpus/set of documents.</p><p>- A measure of the presence of known words.</p><p>The intuition is that documents are similar if they have similar content. Further, from the content alone we can learn something about the meaning of the document.</p><p><strong>Example:-</strong></p><p>- If you want to compare essays submitted by students for plagiarism, there each essay will be considered as a document.</p><p>- If you want to analyze the sentiments submitted in the tweets, then there each tweet will be considered as a document.</p><p><strong>Corpus</strong> is a set of documents.</p><h3>TF-IDF</h3><p>Let’s first put a formal definition around TF-IDF. Here’s how Wikipedia puts it:</p><p>“Term frequency-inverse document frequency, is a numerical statistic that is intended to reflect how important a word is to a document in a collection or corpus.”</p><h3>Term Frequency</h3><p>Let’s first understand Term Frequent (TF). It is a measure of how frequently a term, t, appears in a document, d</p><p>Here, in the numerator, n is the number of times the term “t” appears in the document “d”. Thus, each document and term would have its own TF value.</p><h3>Inverse Document Frequency (IDF)</h3><p>IDF is a measure of how important a term is. We need the IDF because computing just the TF alone is not sufficient to understand the importance of words.</p><h3>Modeling</h3><p>The final stage of the NLP pipeline is <strong>modeling</strong>, which includes designing a statistical or machine learning model, fitting its parameters to training data, using an optimization procedure, and then using it to make predictions about unseen data.</p><p>The nice thing about working with numerical features is that it allows you to choose from all machine learning models or even a combination of them.</p><p>Some of the machine learning algorithms used here are:-</p><p>1. Linear Regression</p><p>2. Logistic Regression</p><p>3. Decision Trees</p><p>4. Random Forest Classifier</p><p>5. Naive Bayes Classifier</p><p>6. Support Vector Machines (SVM)</p><p>7. Neural Networks (RNN, LSTM, Bi-LSTM)</p><p>8. Ensemble Methods — Adaboost, XGBoost, Gradient Boost</p><p>9. Gradient Boosting Machine</p><p>10. Nearest Neighbors (K-Nearest Neighbors, Approximate Nearest Neighbors, etc.)</p><p>11. Clustering (K-means, Hierarchical, DBSCAN, Gaussian Mixture Models, etc.)</p><p>12. Many more….</p><p>Once you have a working model, you can deploy it as a web app, mobile app, or integrate it with other products and services. The possibilities are endless!</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=bc91f42dfc9b" width="1" height="1" alt=""><hr><p><a href="https://medium.com/gyansetu/what-is-natural-language-processing-intro-to-nlp-bc91f42dfc9b">WHAT IS NATURAL LANGUAGE PROCESSING? INTRO TO NLP</a> was originally published in <a href="https://medium.com/gyansetu">Gyansetu</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[THESE PROGRAMMING LANGUAGES CAN SAVE YOUR JOB IN 2020]]></title>
            <link>https://medium.com/gyansetu/these-programming-languages-can-save-your-job-in-2020-5f4d4325a018?source=rss-fb8537dc5192------2</link>
            <guid isPermaLink="false">https://medium.com/p/5f4d4325a018</guid>
            <category><![CDATA[javascript]]></category>
            <category><![CDATA[programming]]></category>
            <category><![CDATA[coding]]></category>
            <category><![CDATA[python]]></category>
            <category><![CDATA[software-development]]></category>
            <dc:creator><![CDATA[Aastha Mehra]]></dc:creator>
            <pubDate>Fri, 27 Dec 2019 13:20:17 GMT</pubDate>
            <atom:updated>2019-12-27T13:21:39.351Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*gRmUD4C3g-YMEN1Fq1werg.jpeg" /></figure><p>In 2020, we need a programming language and its support to run even the most basic function of our lives. Technology is running the roost and it is time to embrace them fully. However, it is also high time to forego outdated languages and acquire new skills.</p><p>Programming languages are the backbone of software development and they control the way an application turns out in terms of performance, look and functionality. Due to improved technology, we are introduced to new features in programming every year and some languages even become obsolete.</p><p>As a prudent software developer, we must keep a track of what are the trending programming languages and how can we update ourselves with them.</p><p>In this article, we will discuss about the <strong>6 most</strong> <strong>trending programming languages in 2020</strong> to give you an overview.</p><p>Programming is an ever-changing field with updates, changes and new versions coming up every year. A good developer keeps up with changing technology because of the following reason.</p><p>Every year <a href="https://stackoverflow.com/">Stack Overflow</a> carries out a survey specifying the most sough-after languages for the upcoming year. The results for 2020 are a follows –</p><h3>6 must learn Programming languages in 2020 –</h3><p><a href="https://www.gyansetu.in/6-must-learn-programming-languages-in-2020-to-secure-your-job/#C1"><strong>Python</strong></a><br><a href="https://www.gyansetu.in/6-must-learn-programming-languages-in-2020-to-secure-your-job/#C2"><strong>R Programming Language</strong></a><br><a href="https://www.gyansetu.in/6-must-learn-programming-languages-in-2020-to-secure-your-job/#C3"><strong>C/C++ Programming Language</strong></a><br><a href="https://www.gyansetu.in/6-must-learn-programming-languages-in-2020-to-secure-your-job/#C4"><strong>Java Script</strong></a><br><a href="https://www.gyansetu.in/6-must-learn-programming-languages-in-2020-to-secure-your-job/#C5"><strong>GO or GOLANG</strong></a><br><a href="https://www.gyansetu.in/6-must-learn-programming-languages-in-2020-to-secure-your-job/#C6"><strong>TypeScript</strong></a></p><h3><strong>PYTHON</strong></h3><p>Python remains as popular in 2020 as it was in the beginning of the decade. Due to its easy readability and simple syntax, it still remains the favorite of beginners in coding. Especially after the influx of AI and data science, python has become even more relevant.</p><p><strong>Some of the reasons why Python is the top-most language in 2020 are –</strong></p><ul><li><strong>PREFERRED BY DATA SCIENTISTS</strong>: It is considered the holy grail of data science. It has been the most use cases of artificial intelligence and makes data analysis easy with its simplicity.</li><li><strong>OPEN-SOURCE AND RICH LIBRARY</strong>: It is the oldest open-source programming language and has a mature library. There isn’t a query which hasn’t already been solved in Python (well, almost).</li><li><strong>SUPPORT OF COMMUNITY AND BIG-WIGS</strong>: Python has the support of a worldwide collaborative community. You can get all your queries answered on many forum and pages. It is also backed by Google which is where data literally began. This fact makes it even more reliable for big data.</li><li><strong>EASY TO LEARN:</strong> Python makes coding simpler. It reduces redundancy in steps and the number of loops. It is as good as reading and simplifies programming for a beginner. These features make it ideal for beginner and for complex data science algorithms.</li></ul><blockquote><a href="https://www.gyansetu.in/courses/learn-python-machine-learning-deep-learning-training-gurgaon-delhi/"><strong><em>Learn Python</em></strong></a></blockquote><h3><strong>R Programming Language:</strong></h3><p>R is the most popular language for data science. Originally designed by statisticians, it makes simplification of big data easier. If you’re looking for a career in 2020, R is a must-learn.</p><p><strong>Here’s a look at why R will remain a top language in 2020.</strong></p><ul><li><strong>IMPORTANT FOR DATA SCIENCE</strong>: R is a hot cake in the field of data science. It runs without a compiler and can carry out calculations with the help of vector. These features make it indispensable for the growth of big data.</li><li><strong>OPEN-SOURCE:</strong> It is open source and can be distributed to the users with any kind of modification. It I great for visualization and is in great demand by developer for the same reasons.</li><li><strong>CROSS-PLATFORM COMPATIBLE</strong>: You can use R to run on various platforms and software/hardware. It helps in reducing development time and cost.</li><li><strong>LUCRATOVE CAREER OPTION</strong>: With the advent in data science, R is a great assurance for a great career.</li></ul><blockquote><a href="https://www.gyansetu.in/courses/best-data-analytics-with-sas-r-certification-training/"><strong><em>Learn R Programming</em></strong></a></blockquote><h3><strong>C/C++</strong></h3><p>C/C++ have been the foundation programming language of most first-generation coders. Due to its versatility and power, it still remains a top language in 2020. If you’re proficient at C/C++, you will never run out of employment opportunities.</p><p><strong>Why learning C/C++ is a great idea even in 2020-</strong></p><ul><li><strong>GREAT LIBRARY SUPPORT</strong>: C/C++ has STL (Standard Template Library) which has components regarding algorithm, containers, iterators and functions. Due to its library support, one can write codes in a compact and quick manner.</li><li><strong>LARGE COMMUNITY: </strong>C/C++ is a mature language and is nurtured by experienced mentorship of a large and supportive community. As a beginner, you will find an answer to all of your queries at any online forum, tutorial, book or videos</li><li><strong>HIGHLY SCALABLE</strong>: If your dream is to work in graphic and gaming oriented apps, it is important for you to learn C/C++. It is known to be scalable and is ideal for resource heavy apps.</li></ul><blockquote><a href="https://www.gyansetu.in/courses/best-c-programming-certification-training-in-gurgaon/"><strong><em>Learn C/C++</em></strong></a></blockquote><h3><strong>JavaScript:</strong></h3><p>JavaScript is everywhere, literally. From your mobile phone to your web browser, everything you depend on is built on JavaScript. It is one of the first front-end or client-side language and has led the development of other languages like AngularJS, Node.js etc.</p><p>It promises great career opportunities in the years to come.</p><p><strong>Here are few more reasons why you should learn JavaScript in 2020-</strong></p><ul><li><strong>EASY TO SETUP</strong>: Unlike other programming languages, JavaScript requires almost no setup. It works on your browser, so if you want to begin learning it right now, you can. You don’t need any other installation; just your internet browser and program editor is enough.</li><li><strong>FUN TO LEARN</strong>: It’s primarily a front-end language. You won’t have to deal with a string of characters on a blue screen all the time. You can dabble with animation, graphic and interactive UIs as you learn JavaScript.</li><li><strong>EASY TO DEBUG</strong>: Bugs are the spoilsport in any programming language. In JavaScript, you have a fairly simple feedback loop which helps you debug your code easily. You can run your code on the browser and get instant results. Thus, debugging is simpler and faster.</li><li><strong>BACKED BY GIANTS</strong>: Netflix, PayPal, LinkedIn — these are just some of the names that have JavaScript embedded in their code. Their performance vouches for its efficiency as well the job opportunities this field offers.</li></ul><h3><strong>GO OR GOLANG:</strong></h3><p>Go is the lovechild of C and Python. It is a general purpose programming language developed by Google which follows complied languages like C++ and it’s easy to read with a syntax like that of Python.</p><p>This combination makes it user-friendly and power-packed.</p><ul><li><strong>MODERN LANGUAGE</strong>: Golang is one of the latest programming languages and is built keeping in mind the challenges faced by coders. It supports cloud computing which is the future of technology and simplifies complex tasks with simple syntax.</li><li><strong>IT IS CONCURRENT</strong>: It helps developers reduce coding time as it supports concurrent processes. It has built-in concurrency with the presence of goroutines and principal support is provided by garbage collector.</li><li><strong>GREAT FOR CROSS-PLATFORM DEVELOPMENT</strong>: Cross-platform development is the need of the hour. Go was built with the aim of making it usable across many platforms. It has in-built features that simplify cross-platform development and has many tutorials and documents dedicated to this cause.</li><li><strong>RAPIDLY GROWING COMUNTIY</strong>: Despite it being new in the coding world, it has created a network of knowledgeable and reliable community. There is a lot of material available on GitHub, various online forums and tutorials. You can easily pick the language on Go Tour.</li></ul><h3><strong>TYPESCRIPT:</strong></h3><p>Typescript is a superset of JavaScript and was developed by Microsoft. It is loved by programmers because it makes bugs almost negligible with its in-build debuggers. It has made its place in the front-end developing world and around 80% of the developers already want to learn Typescript next.</p><p><strong>Here’s why you should also learn TypeScript it in 2020-</strong></p><ul><li><strong>SIMPLER ALTERNATIVE TO JAVASCRIPT</strong>: JavaScript was an ideal solution when the internet ran on a web browser. With the introduction of IoT, we need our languages to be simple and dynamic. TypeScript helps in coding dynamic and responsive application with simplicity and ease.</li><li><strong>LESSER BUGS:</strong> As we have already discussed, it has in-built debug tools and extensions which makes debugging a simpler. As a result, you can have a lot of time of your time which was earlier spent on debugging.</li><li><strong>OPEN-SOURCE</strong>: It is open-source and you can always get the help you need. Their team released frequent official documentation which can help you get your queries checked.</li></ul><p><strong>THE VERDICT:</strong></p><p>2020 will be the year of D<strong>ata Science, Artificial Intelligence</strong>, simple syntax and interactive UIs. .</p><p>Coding language like <strong>Python and R</strong> will continue to rule the roost and the job market.</p><p>Mobile application development is also a field which would require job applicants to know cross-platform languages like Android, Golang, flutter etc.</p><p>Besides these, a job seeker must be fully aware of algorithms, UIs and the type of updates coming in the market. If you would like to learn more about such languages.</p><p>Until then, happy coding.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=5f4d4325a018" width="1" height="1" alt=""><hr><p><a href="https://medium.com/gyansetu/these-programming-languages-can-save-your-job-in-2020-5f4d4325a018">THESE PROGRAMMING LANGUAGES CAN SAVE YOUR JOB IN 2020</a> was originally published in <a href="https://medium.com/gyansetu">Gyansetu</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[When people say “learn algorithms and data structures”, what exactly do they mean we should learn…]]></title>
            <link>https://medium.com/@gyansetu/when-people-say-learn-algorithms-and-data-structures-what-exactly-do-they-mean-we-should-learn-4a95e786308f?source=rss-fb8537dc5192------2</link>
            <guid isPermaLink="false">https://medium.com/p/4a95e786308f</guid>
            <category><![CDATA[programming]]></category>
            <category><![CDATA[computer-science]]></category>
            <category><![CDATA[coding]]></category>
            <category><![CDATA[algorithms]]></category>
            <dc:creator><![CDATA[Aastha Mehra]]></dc:creator>
            <pubDate>Sat, 14 Sep 2019 06:24:15 GMT</pubDate>
            <atom:updated>2019-09-14T06:24:15.291Z</atom:updated>
            <content:encoded><![CDATA[<h3><a href="https://www.quora.com/When-people-say-learn-algorithms-and-data-structures-what-exactly-do-they-mean-we-should-learn-about-them"><strong>When people say “learn algorithms and data structures”, what exactly do they mean we should learn about them?</strong></a></h3><p>One of the most useful and practical any experienced coder would tell you is to get your knowledge of data structures and algorithms right.</p><p>When people ask you to learn them, they basically want you to know how to store, manage and extract data optimally.</p><p>Top product based companies like Directi, Adobe, Microsoft, Google, Amazon recruit candidates primarily on the in-depth knowledge of Data Structures.</p><p>However, what I notice is that the young coders see no point in learning about data structures and algorithms in an age where they will be using 90% of library functions in coding.</p><p>They consider learning about their implementation and execution an unnecessary task.</p><p>In order to handle the product development cycle properly, companies require quality developers with strong concepts in Data Structure and, yes the starting pay scale of these developers in India is around <strong>12–20 Lacs per annum</strong>.</p><p>While developers knowing just programming language, and not that great in data structures usually get packages around <strong>3.5–7 Lacs per annum</strong>.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/456/0*X0ND9pH7ZcxkfDwh" /></figure><p><strong>Now it’s important to know what exactly should we learn in algorithms and data structures.</strong></p><p><strong>Some basic uses and application of most commonly used data structure are as follows –</strong></p><p><strong>1.</strong> <strong>Arrays :-</strong></p><p>The most basic of them all — it helps in bringing together similar elements at one place. It is mostly used in library management system.</p><p><strong>2. Linked List :-</strong></p><p>A collection of nodes which form a sequence. While browsing the internet, we all click the “back” button multiple times. Web browsers create a linked list of pages visited sequentially and with every click, previous data is fetched.</p><p><strong>3.</strong> <strong>Stacks :-</strong></p><p>It is similar to the physical stack of goods. It is a stack of elements where new elements can be added or removed on LIFO basis. It enables the “undo” function on word processors.</p><p><strong>4. Queue :-</strong></p><p>Similar to stacks but is open at both ends, i.e., one end inserts data (enqueue) and other removes data (dequeue). It is useful in CPU scheduling, disk scheduling etc.</p><p><strong>5. Tree :-</strong></p><p>Quite similar to the hierarchy structure, a tree consists of a root value and subtrees. All HTML texts and attributes are saved in the form of tree structure. A linux file system is also a tree.</p><p><strong>Similarly, various algorithms too play an extremely essential role in programming.</strong></p><p><strong>Some of them are –</strong></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/557/0*ulirJx9P9dwMW_XN" /></figure><p><strong>1.</strong> <strong>Sort Algorithm </strong>:</p><p>Everyone has heard about it and it forms the basis of everything. Sorting helps arrange a list of items in a particular order. There’re many types to it like merge sort, bubble sort, quick sort etc.</p><p>Even finding a file from your drive is an example. Sorting items on the basis of price or type in an e-commerce is an example.</p><p><strong>2. Search Algorithm </strong>:</p><p>It takes a sorted dataset and divides it into sub portions until the option are narrowed down to find one suitable result.</p><p>It is commonly used in web crawling, building bots etc.</p><p><strong>3.</strong> <strong>Hash Algorithm </strong>:</p><p>One of the most popular function, it generates an address for a given key. An example is a router.</p><p><strong>Note : It’s important to know why having a knowledge of data structures and algorithms can help you be a better developer-</strong></p><p><strong>1.</strong> Even if lower-level problems in coding are taken care by abstraction in today’s time, it is always better to understand the implementation behind these abstraction to understand the logic. This helps in better application.</p><p><strong>2.</strong> Algorithms are built to overcome certain problems. Knowing and understanding them will help you in better optimization and application and also assist you in day-to-day working.</p><p><strong>3.</strong> You can manage to reach up to a level without proper knowledge of data structure and algorithm but in order to execute and implement higher-level of coding, you need to have a thorough knowledge of these.</p><p>We all have seen codes written by those who didn’t know anything about data structure and algorithm and none of us want to be that guy.</p><p><strong>4.</strong> Each of these data structure and algorithm have a detailed explanation and contain multiple application and uses.</p><p>Their knowledge and expertise empowers a coder.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=4a95e786308f" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[What are the top 10 algorithms every software engineer should know by heart?]]></title>
            <link>https://medium.com/@gyansetu/what-are-the-top-10-algorithms-every-software-engineer-should-know-by-heart-c07a415271a6?source=rss-fb8537dc5192------2</link>
            <guid isPermaLink="false">https://medium.com/p/c07a415271a6</guid>
            <category><![CDATA[software-engineering]]></category>
            <category><![CDATA[algorithms]]></category>
            <category><![CDATA[programming]]></category>
            <dc:creator><![CDATA[Aastha Mehra]]></dc:creator>
            <pubDate>Fri, 02 Aug 2019 11:50:02 GMT</pubDate>
            <atom:updated>2019-08-02T12:39:29.288Z</atom:updated>
            <content:encoded><![CDATA[<p>When you write a code, you basically provide a solution in the form of a program. Algorithms help in reaching a right decision or providing a right solution.</p><p>Knowledge and intuition regarding algorithms can greatly help you in coding.</p><p>Even though, every problem is unique but there’re certain algorithms that you can rely on in most cases.</p><p>Let me list them down for you –</p><p>- <strong>HASHING</strong>: Hashing helps in retrieving the items in a complex database easily by simple indexing rather than through original value which takes a lot of time.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/388/0*hWKQ-AJa1sBtgYIA" /></figure><p>- <strong>STRING MATCHING ALGORITHM</strong>: It can help you in finding a pattern or a string in a larger string or text.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/352/0*47SgYk9a7R_vZO00" /></figure><p>- <strong>KNAPSACK PROBLEM</strong>: It is basically a combination optimization problem. It helps in determining the number of items that can be included based on an item’s weight and value in a way that the total weight is less than or equal to a limit and as large as possible in value.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/409/0*zJnVGGFXSGmVBBSx" /></figure><p>- <strong>SEARCH TREE ALGORITHM</strong>: With the help of tree algorithms, one can find an item in a reasonable balanced time.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/490/0*RiQ5xQ9LzQwBxKYU" /></figure><p>- <strong>LINKED LIST OPERATIONS</strong>: A linked list is extremely useful as it is able to shrink and grow in size when needed unlike array. Creation of new objects for the list can also be done easily.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/372/0*FzxyF83nu5trfiTx" /></figure><p>- <strong>SHORTEST PATH</strong>: One of the biggest advantage this offers is multiple solutions — distance of one particular point to other, one particular point to all other points and each point to other points.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/401/0*7FsXP6jvyRuUI9p8" /></figure><p>- <strong>TRAVELLING SALESMAN</strong> — Optimization is the key to success. This helps in solving a problem thought he quickest, most efficient and cheapest possible solution.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/326/0*-hJHPaGvmRxAd8pY" /></figure><p>- <strong>Sieve of Eratosthenes</strong>: It is the simplest and ancient algorithm used to find the prime numbers up to any given limit.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/384/0*jaQRCjnR73vjsNW0" /></figure><p>- <strong>SORTING ALGORITHM: </strong>You must brush up your basic concepts with bubble sort, selection sort and also quick sort.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/450/0*4N2kY-zHS0VcUNVF" /></figure><p>- <strong>SEARCHING ALGORITHM:</strong> Binary search comes in handy but liner search can also help in some cases.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/365/0*Gxy85fOtUTdQWiP-" /></figure><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=c07a415271a6" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[How to Deploy Spark Application on Kubernetes (Spark on Kubernetes)]]></title>
            <link>https://medium.com/@gyansetu/how-to-deploy-spark-application-on-kubernetes-spark-on-kubernetes-5c93be1b2d42?source=rss-fb8537dc5192------2</link>
            <guid isPermaLink="false">https://medium.com/p/5c93be1b2d42</guid>
            <category><![CDATA[kubernetes]]></category>
            <category><![CDATA[spark]]></category>
            <dc:creator><![CDATA[Aastha Mehra]]></dc:creator>
            <pubDate>Tue, 25 Jun 2019 13:46:20 GMT</pubDate>
            <atom:updated>2019-06-25T13:46:20.842Z</atom:updated>
            <content:encoded><![CDATA[<p>There are two ways to deploy Spark Applications in Kubernetes cluster :</p><p><strong>a) kubectl</strong></p><p><strong>b) sparkctl</strong></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/761/1*d3X409CWJMqHpWgXYX2XAw.png" /></figure><p>‌<strong>Kubernetes Operator(kubectl &amp; Spark Operator (sparkctl) :</strong></p><p>‌</p><p>‌create test.yml &amp; mention <strong>kind: SparkApplication &amp; deploy it to Kubernetes cluster using :</strong></p><p>‌<strong>kubectl apply -f spark-pi.yaml</strong></p><p>‌</p><p><strong>OR</strong></p><p><strong>sparkctl create spark-pi.yaml</strong></p><p>apiVersion: “<a href="http://sparkoperator.k8s.io/v1beta1">sparkoperator.k8s.io/v1beta1</a>”<br>kind: SparkApplication<br>metadata:<br> name: spark-pi<br> namespace: default<br>spec:<br> type: Scala<br> mode: cluster<br> image: “lightbend/spark:2.0.1-OpenShift-2.4.0-rh”<br> imagePullPolicy: Always<br> mainClass: org.apache.spark.examples.SparkPi<br> mainApplicationFile: “local:///usr/local/DesktopBackUp/HadoopProjects/SparkProjectss/sparkhbase/resources1/target/scala-2.12/resources1_2.12–0.1.0-SNAPSHOT.jar”<br> restartPolicy:<br> type: Never<br> volumes:<br> — name: config-vol<br> configMap:<br> name: my-cm<br> driver:<br> cores: 0.1<br> coreLimit: “200m”<br> memory: “512m”<br> labels:<br> version: 2.4.0<br> serviceAccount: eyewitness-orangutan-spark<br> volumeMounts:<br> — name: config-vol<br> mountPath: /opt/spark<br> executor:<br> cores: 1<br> instances: 1<br> memory: “512m”<br> labels:<br> version: 2.4.0<br> volumeMounts:<br> — name: config-vol<br> mountPath: /opt/spark</p><p><strong>b) </strong>./spark-submit — master k8s://https://</p><p>— deploy-mode cluster \ — name spark-pi \ — class org.apache.spark.examples.SparkPi \ — conf spark.kubernetes.namespace=spark \ — conf spark.kubernetes.authenticate.driver.serviceAccountName=spark-sa \ — conf spark.executor.instances=2 \ — conf spark.kubernetes.container.image.pullPolicy=Always \ — conf spark.kubernetes.container.image=lightbend/spark:2.0.1-OpenShift-2.4.0-rh \</p><p>local:///opt/spark/examples/jars/spark-examples_2.11–2.4.0.jar</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*e9OrjUxOBmCMjBLwoA-tDw.png" /></figure><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=5c93be1b2d42" width="1" height="1" alt="">]]></content:encoded>
        </item>
    </channel>
</rss>