<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0" xmlns:cc="http://cyber.law.harvard.edu/rss/creativeCommonsRssModule.html">
    <channel>
        <title><![CDATA[Stories by Seda Atalay on Medium]]></title>
        <description><![CDATA[Stories by Seda Atalay on Medium]]></description>
        <link>https://medium.com/@sedaatalay?source=rss-822a8f2c47f8------2</link>
        <image>
            <url>https://cdn-images-1.medium.com/fit/c/150/150/1*zOfmr6pf1Zf8uKccNVF1Hg.jpeg</url>
            <title>Stories by Seda Atalay on Medium</title>
            <link>https://medium.com/@sedaatalay?source=rss-822a8f2c47f8------2</link>
        </image>
        <generator>Medium</generator>
        <lastBuildDate>Sat, 21 Nov 2026 16:36:02 GMT</lastBuildDate>
        <atom:link href="https://medium.com/@sedaatalay/feed" rel="self" type="application/rss+xml"/>
        <webMaster><![CDATA[yourfriends@medium.com]]></webMaster>
        <atom:link href="http://medium.superfeedr.com/" rel="hub"/>
        <item>
            <title><![CDATA[Customer Segmentation Analysis using RFM (Recency,Frequency,Monetary) with Python]]></title>
            <link>https://medium.com/@sedaatalay/customer-segmentation-analysis-using-rfm-recency-frequency-monetary-with-python-1f633860a5db?source=rss-822a8f2c47f8------2</link>
            <guid isPermaLink="false">https://medium.com/p/1f633860a5db</guid>
            <category><![CDATA[rfm-analysis]]></category>
            <category><![CDATA[segmentation]]></category>
            <category><![CDATA[python]]></category>
            <category><![CDATA[customer]]></category>
            <dc:creator><![CDATA[Seda Atalay]]></dc:creator>
            <pubDate>Thu, 03 Nov 2022 19:47:11 GMT</pubDate>
            <atom:updated>2022-11-03T19:49:09.825Z</atom:updated>
            <content:encoded><![CDATA[<p>In this chapter, we will work how to segment using RFM Analysis over customer data of MIGROS Market. This means that over time, we can understand which customer is truly royal and which customer is a promising customer.</p><h4>What is Customer Segmentation?</h4><p>Customer segmentation is a method of dividing customers into groups or clusters based on common characteristics. The market researcher can segment customers into the B2C model using various demographic characteristics of customers such as occupation, gender, age, location, and marital status. Psychographic features such as social class, lifestyle and personality traits, and behavioral traits such as spending, consumption habits, product/service use, and pre-purchased items. The B2B model uses various company characteristics such as company size, industry type and location.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*sz0KrQPUfU7PN1UY.png" /></figure><h4>Types of Segmentation</h4><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*F8uQEn1EykFCunh6.png" /></figure><h4>Customer Segmentation using RFM analysis</h4><p>RFM (Recency,Frequency,Monetary) analysis is a behavior-based approach by segmenting customers. It groups customers according to their previous purchases. How recently, how often, and how much a customer bought. RFM divides customers into various groups for better service. It helps managers identify potential customers to do more profitable business. For example:</p><ul><li>Ability to optimize every touchpoint in customers’ moments to generate more revenue and active users,</li><li>Which customer is really our customer,</li><li>How to understand our promising customers,</li><li>When a campaign is going to be organized, we have the data to be used in this campaign without any noise,</li><li>Determining the buying and selling cycle, we can say that we aim to reach a certain goal at points like above.</li></ul><p>It also helps managers run an effective promotional campaign for personalized service.</p><p><strong>¬ Calculate the Recency, Frequency, Monetary values for each customer.</strong></p><p><strong>¬ Add segment bin values to RFM table using quartile.</strong></p><p><strong>¬ Sort the customer RFM score in ascending order.</strong></p><ul><li>For Recency: Who have purchased recently? Number of days since last purchase (least recency) Calculate the number of days between present date and date of last purchase each customer.</li><li>For Frequency: Who has purchased frequently? It means the total number of purchases. (high frequency) Calculate the number of orders for each customer.</li><li>For Monetary: Who have high purchase amount? It means the total money customer spent (high monetary value) Calculate sum of purchase price for each customer.</li></ul><p><strong>1. Calculate the Recency, Frequency, Monetary values for each customer.</strong></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/482/0*UCEzbMT7aiUPRrsa.png" /></figure><p><strong>2. Add segment bin values to RFM table using quartile.</strong></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/844/0*I-O7i_5loqvzQCJv.png" /></figure><p><strong>3. Sort the customer RFM score in ascending order.</strong></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/972/0*a64O_fHI60lJaI9W.png" /></figure><h4>Identify Potential Customer Segments using RFM in Python</h4><p><strong>• Data Definition</strong></p><p>Introduction of tables and columns in the database</p><p>🔸 Tables:</p><p>The table that we use is Migros Marketing Customer Data taken from Migros</p><p>🔸 Columns</p><p>¬ Customer No: Unique custom value assigned to each customer</p><p>¬ Age: Age information of customers</p><p>¬ Gender: Gender information of customers</p><p>¬ Day of Purchase: Day-indexed purchase information</p><p>¬ Product Category: Product category</p><p>¬ Indexed Turnover: Customer indexed turnover</p><p>¬ Indexed Transaction: Transaction indexed to the customer</p><p>¬ Price: Product prices</p><p>¬ InvoiceNo: Helps you to count the number of time transaction performed(frequency)</p><p>¬ InvoiceDate: Help you calculate recency of purchase</p><p>¬ Quantity: Purchased in each transaction</p><p>¬ UnitPrice of each unit purchased by the customer: Will help you to calculate the total purchased amount</p><p><strong>• Importing Required Library</strong></p><pre>import pandas as pd<br>import numpy as np<br>import matplotlib.pyplot as plt</pre><p><strong>• Loading Dataset</strong></p><pre>df = pd.read_excel(&#39;RFM-Migros.xlsx&#39;)<br>df.set_index(&#39;Customer No&#39;)<br>df[&#39;Day of Purchase&#39;] = pd.to_datetime(df[&#39;Day of Purchase&#39;])</pre><figure><img alt="" src="https://cdn-images-1.medium.com/max/382/0*NxkqUIymKG-Reh8Q.png" /></figure><p><strong>• Filter required Columns</strong></p><pre>df = pd.read_excel(&#39;RFM-Migros.xlsx&#39;)<br>df.set_index(&#39;Customer No&#39;)<br>df[&#39;Day of Purchase&#39;] = pd.to_datetime(df[&#39;Day of Purchase&#39;])</pre><p>🔸 InvoiceDate</p><ul><li>👉🏽 Help you calculate recency of purchase</li></ul><p>🔸 InvoiceNo</p><ul><li>👉🏽 Helps you to count the number of time transaction performed(frequency)</li></ul><p>🔸 Quantity</p><ul><li>👉🏽 Purchased in each transaction</li></ul><p>🔸 UnitPrice of each unit purchased by the customer</p><ul><li>👉🏽 Will help you to calculate the total purchased amount</li></ul><pre>df_total = df.groupby(&#39;Product Category&#39;).sum()[[&#39;Price&#39;]]<br>df_total</pre><figure><img alt="" src="https://cdn-images-1.medium.com/max/326/0*nFqSdOqkxtG0xDqp.png" /></figure><pre>df[&#39;Day of Purchase&#39;] = pd.to_datetime(df[&#39;Day of Purchase&#39;])</pre><pre>import pandas as pd<br>import numpy as np<br>import matplotlib.pyplot as plt</pre><p><strong>• RFM Analysis</strong></p><p>🔸 For Recency, Calculate the number of days between present date and date of last purchase each customer.</p><p>🔸 For Frequency, Calculate the number of orders for each customer.</p><p>🔸 For Monetary, Calculate sum of purchase price for each customer.</p><pre>rfm= df.groupby(df.index).agg({&#39;Day of Purchase&#39;: lambda date: (present - date.max()).days,<br>&#39;InvoiceNo&#39;: lambda num: len(num),<br>&#39;Price&#39;: lambda price: price.sum()})</pre><pre>rfm.columns = [&#39;recency&#39;,&#39;frequency&#39;,&#39;monetary&#39;]</pre><pre>rfm.head(5)</pre><figure><img alt="" src="https://cdn-images-1.medium.com/max/482/0*iTNPRckPY6NSueL8.png" /></figure><pre>rfm[&#39;r_quartile&#39;] = pd.qcut(rfm[&#39;recency&#39;], 4, [&#39;1&#39;,&#39;2&#39;,&#39;3&#39;,&#39;4&#39;])<br>rfm[&#39;f_quartile&#39;] = pd.qcut(rfm[&#39;frequency&#39;], 4, [&#39;4&#39;,&#39;3&#39;,&#39;2&#39;,&#39;1&#39;])<br>rfm[&#39;m_quartile&#39;] = pd.qcut(rfm[&#39;monetary&#39;], 4, [&#39;4&#39;,&#39;3&#39;,&#39;2&#39;,&#39;1&#39;])</pre><pre>rfm.head(5)</pre><figure><img alt="" src="https://cdn-images-1.medium.com/max/844/0*nexjw9iHVS06SHSV.png" /></figure><pre>rfm[&#39;RFM_Score&#39;] = rfm.r_quartile.astype(str)+ rfm.f_quartile.astype(str) + rfm.m_quartile.astype(str)</pre><pre>rfm.head(5)</pre><figure><img alt="" src="https://cdn-images-1.medium.com/max/972/0*6cwx_q5F1-SBWFvz.png" /></figure><p><strong>• RFM Result Interpretation</strong></p><p>Filter out Top/Best customers</p><pre>rfm.sort_values(&#39;RFM_Score&#39;, ascending=False).head(15)</pre><figure><img alt="" src="https://cdn-images-1.medium.com/max/988/0*hsMfj4bPm4xFi4ll.png" /></figure><p><strong>📋 When a campaign is organized, we can say that the RFM Score can reveal the type of customer on which the campaign is most effective, the customer satisfaction accordingly, and the promising customer portfolio that may occur in the future.</strong></p><h3>Conclusion</h3><p>In this analysis we do behavior-based approach grouping customers into segments. We did groups the customers on the basis of their previous purchase transactions.</p><p>This analysis filters customers into various groups for the purpose of better service. It helps managers to identify potential customers to do more profitable business.</p><p>Recency (R): Who have purchased recently? Number of days since last purchase (least recency)</p><p>Frequency (F): Who has purchased frequently? It means the total number of purchases. (high frequency)</p><p>Monetary Value(M): Who have high purchase amount? It means the total money customer spent (high monetary value)</p><p>Also the details:</p><ul><li>How recently, how often, and how much did a customer buy product?</li><li>A top-spending customer segment and if they only bought the products once, or how recently?</li><li>Do they often purchase our product?</li></ul><p>As find answers to this questions with also we seen helps managers to run an effective promotional campaign for personalized service.</p><p>In this project, we covered a lot of details about Customer Segmentation. We have experienced what the customer segmentation is, need of customer segmentation, types of segmentation, RFM analysis doing implementation of RFM.</p><p>Also, we covered some basic concepts of such as handling duplicates, group by, based on sample quantiles.</p><p>Thanks for your time :)</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=1f633860a5db" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Deploying large python packages on AWS Lambda using EFS + Serverless REST API with API Gateway]]></title>
            <link>https://medium.com/@sedaatalay/deploying-large-python-packages-on-aws-lambda-using-efs-serverless-rest-api-using-api-gateway-71cdca072dd4?source=rss-822a8f2c47f8------2</link>
            <guid isPermaLink="false">https://medium.com/p/71cdca072dd4</guid>
            <category><![CDATA[serverless]]></category>
            <category><![CDATA[rest-api]]></category>
            <category><![CDATA[lambda]]></category>
            <category><![CDATA[aws-api-gateway]]></category>
            <category><![CDATA[api-gateway]]></category>
            <dc:creator><![CDATA[Seda Atalay]]></dc:creator>
            <pubDate>Mon, 27 Jun 2022 12:16:56 GMT</pubDate>
            <atom:updated>2022-06-27T16:05:12.095Z</atom:updated>
            <content:encoded><![CDATA[<p><strong>In our previous lesson, we made a simple example on Lambda via EFS.</strong></p><p>To continue from the previous article:</p><ul><li><a href="https://medium.com/@sedaatalay/deploying-python-packages-on-aws-lambda-using-efs-885df8ba7510"><em>https://medium.com/@sedaatalay/deploying-python-packages-on-aws-lambda-using-efs-885df8ba7510</em></a><em> 🔙</em></li></ul><p>Now let’s see how we can use it with API Gateway by adding more different libraries.</p><h4>What is API Gateway?</h4><p>Amazon API Gateway is an AWS service for creating REST, HTTP, and WebSocket APIs at any scale. API Gateway acts as the HTTPS endpoint URL when Amazon API Gateway, along with AWS Lambda, is used to build APIs.</p><p>Amazon API Gateway endpoints have this format:</p><p><em>👉🏽 </em><a href="https://{restapi_id}.execute-api.{region}.amazonaws.com/%7Bstage_name%7D/"><em>https://{restapi_id}.execute-api.{region}.amazonaws.com/{stage_name}/</em></a></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/500/0*5fsVxJ3BnYoHyYbB.png" /></figure><p><strong>1. Lambda Function with example libraries from EFS</strong></p><p>🔸 Install the Python libraries in my access folder. We can use these libraries in the example we will do with the help of API Gateway.</p><pre>pip3 install --upgrade --target mnt/access/ pandas<br>pip3 install --upgrade --target mnt/access/ scikit-learn==1.0.2</pre><p>🔸 Let’s go back to the Lambda. Deploy the example code.</p><pre>#normal imports<br>import json<br>import os<br>import sys<br>#new library import<br>sys.path.append(&#39;/mnt/access&#39;)<br>import pickle<br>import numpy as np<br>#import sklearn<br># connecting to the folder with the libraries</pre><pre>def lambda_handler(event, context):<br>    loaded_model = pickle.load(open(&quot;finalized_model.pkl&quot;,&quot;rb&quot;))<br>    print(&#39;Done1&#39;)<br>    pred = loaded_model.predict([event[&#39;X&#39;]])<br>    <br>    return {<br>        &#39;statusCode&#39;: 200,<br>        &#39;pred&#39;:pred[0]<br>    }</pre><figure><img alt="" src="https://cdn-images-1.medium.com/max/968/0*Sv6fqESVNVKg9-_k.png" /></figure><p><strong>2. Create API Gateway</strong></p><p>Search and select API Gateway. Go to the REST API card and click build.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*6UPB9-56CEHXWQs_.png" /></figure><p>Provide all the required information as shown in the image below and click Create API.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*8lG80pWax5Xejb6f.png" /></figure><p>In the steps above we created an API. But an API usually has endpoint(s). An endpoint usually specifies a path and the HTTP method it supports. For example GET /get-user. Here, we call the path resource, and the HTTP verb tied to a path a method. Thus, resource + method = REST endpoint.</p><p>From the “Action” dropdown select “Create Method”. Choose “Get Function”. Provide all the other info shown in the image below and click save. Lambda function is the name of the function we create in one of the previous chapter.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*ZJlhcOXx9ljLLovv.png" /></figure><p>Great! API has been created.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*f2Hyg8gCaSnBeSNX.png" /></figure><p><strong>3. Deploy the API</strong></p><p>🔸 In the Actions drop-down list, select Deploy API.</p><p>🔸 Select [New Stage] in the Deployment stage drop-down list.</p><p>🔸 You can fill in the other parts as you wish.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/958/0*4Sb8WYNwrqKO8f0D.png" /></figure><p>🔸 Stages has been ready. Note the invoke URL is your API’s base URL. Append the path to your endpoint to the end of the invoke URL like: <a href="https://wrl34unbe0.execute-api.eu-central-1.amazonaws.com/%7Bstage">https://wrl34unbe0.execute-api.eu-central-1.amazonaws.com/{stage</a> name}/paraphrase. And of course the request method should be GET.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*IIez0vQ-6mHS68lt.png" /></figure><p><strong>4. API Gateway test example</strong></p><p>Run the request through VS Code to get the result of our sample code that we have uploaded to Lambda.</p><p>Let’s take the Invoke URL in the API Gateway stage section that was just created and write it in the base section here.</p><pre>import requests<br>import json<br>import pandas as pd<br>from pprint import pprint<br>import warnings<br>warnings.filterwarnings(&#39;ignore&#39;)</pre><pre>#http://ec2-3-66-191-179.eu-central-1.compute.amazonaws.com:5000/</pre><pre>BASE = &#39;https://2hkpt557s6.execute-api.eu-central-1.amazonaws.com/lambda-efs-deploy/&#39;<br>request_list = [0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.,<br>                0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.,<br>                0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.,<br>                0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 1., 1., 1., 0.,<br>                0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.,<br>                0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.,<br>                0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.,<br>                0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 1.]<br>response = requests.get(BASE , data = json.dumps({&#39;X&#39;: request_list}))<br>pprint(response.json())</pre><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*yTh6areFbvP9fZK8.png" /></figure><p>That’s it. Your response is here!</p><p>Thanks for timing :)</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=71cdca072dd4" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Deploying python packages on AWS Lambda with EFS]]></title>
            <link>https://medium.com/@sedaatalay/deploying-python-packages-on-aws-lambda-using-efs-885df8ba7510?source=rss-822a8f2c47f8------2</link>
            <guid isPermaLink="false">https://medium.com/p/885df8ba7510</guid>
            <category><![CDATA[aws-lambda]]></category>
            <category><![CDATA[python]]></category>
            <category><![CDATA[data-science]]></category>
            <category><![CDATA[lambda]]></category>
            <dc:creator><![CDATA[Seda Atalay]]></dc:creator>
            <pubDate>Mon, 27 Jun 2022 12:10:13 GMT</pubDate>
            <atom:updated>2022-06-28T05:14:02.608Z</atom:updated>
            <content:encoded><![CDATA[<h4>In this chapter, we will work a few of the many different services that AWS provides and how it provides us with many different tools to be able to deploy our work.</h4><h4>What is lambda?</h4><p>AWS Lambda is an AWS service that lets you run code without provisioning or managing servers. So it’s serverless. This means that the user is only interacting with the function as an entity, not with anything related to the server they are running. This simplifies some operations and costs as AWS only charges for the time the function uses.</p><p>However, there may be some restrictions in the working model of lambda, such as the time the code could be running, memory, and such. These constraints may enable us to use lambda with different solutions.</p><p>Now let’s consider python libraries.</p><ul><li>What can we do if we want to run libraries that do not come with the basic python installation, plus a library on memory that exceeds the limits of the Lambda?</li></ul><p>We can install these libraries on an EFS and connect the EFS to the Lambda function.</p><h4>What is EFS?</h4><p>EFS stands for Elastic File System and is a file system located inside a VPC (Virtual private cloud) that allows you to store or access data. Having the libraries in EFS and having the Lambda function we will use use these libraries.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/641/1*dmxcFHpG9866-4BXI8eAkw.png" /><figcaption>exemplary architecture</figcaption></figure><h4>Let’s do it :)</h4><h4>1. VPC (Virtual Private Cloud)</h4><p>Everything happens in a VPC context. That’s why we need to create a VPC or use a prebuilt VPC first.</p><p>Next, you choose to create a simple VPC with a public network and we can give it a name.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*DG9ivDgaX7r-7xkj.png" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*BLOl_E7SpTAhEAHb.png" /></figure><p>Then we have our newly created VPC.</p><h4>2. Create Security Group</h4><p>AWS is the arrangement of many interactions of different components to ensure security. For most of these interactions, we use what is called a “security group”, which contains sets of rules that allow an entity to connect to the outside (outbound rules) or allow something to connect to it from outside the entity (inbound rules).</p><ul><li>“Create security group” and then add an inbound rule for NFS. For this exercise, we’ll arrenged that.</li></ul><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*Gkqel3ynlfzP7S-k.png" /></figure><h4>3. Create and configure EFS</h4><p>Go to console and look for EFS. Then click in “create file system” and then give a name and choose the VPC that the EFS would be connected to.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/850/0*rXENfVqkWy-NDGaY.png" /></figure><p><strong>🔸 Network</strong></p><p>Select the EFS that you created and click the network area</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*W-A-nrIROlU2_Jjy.png" /></figure><p>Then click a button that says “Manage”. Now we will add security group that we created before in addition you can add default security group.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*kHfObHG29b_8TWfs.png" /></figure><p><strong>🔸 Access Point</strong></p><p>Select the EFS that you created and click on Access points. Then click on “Create access point”.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*OZL8i9IBH8f6aWDV.png" /></figure><p>The important part is the directory name at the end. This folder is where we’ll have the libraries that the Lambda Function will be able to connect to.</p><p>The rest is optional. I filled in the optional parts as in the appendix.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*PinsjLd8Kx6RZ3i3.png" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*PM5Yw8oYy91mPzOm.png" /></figure><h4>4. Test that the EFS is working</h4><p>Now we’ll test that EFS works like a proper file system and that we can interact with it. Before we create a lambda function, we need to define the privileges of the IAM role we will use.</p><p><strong>🔸 IAM (Identity and access management) Role</strong></p><p>You can access the IAM role via the AWS console. Create role and add to policies that we need.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/850/0*s6yUvHk5o24MCHW2.png" /></figure><h4>5. Create Lambda Function</h4><p>Again, we will create Lambda over the AWS console. I used Python 3.8 for this work, but you could choose a different version or language.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*_BmXSzQoPxgNyCQ7.png" /></figure><p>🔸<strong> In the permission section, we proceed by selecting the IAM role we created.</strong></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*-aAaKh9Oi2cRmHan.png" /></figure><p>🔸 <strong>Lambda function has been created. Now, go inside Lambda functions click on “Configuration”.</strong></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*xY0-gFhxZU_vNyfN.png" /></figure><p>🔸 <strong>From here we select the VPC area Choose the subnet and add a VPC and Security Group we created earlier here.</strong></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*xsMLFCTspyNnZmiD.png" /></figure><p>🔸 <strong>From Configuration we click on “File System” area and add a EFS we created earlier here.</strong></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*0SP_AmDNJEPKZfrn.png" /></figure><p>Here choose the EFS we created before, add the Access point and the path where we are going to mount the EFS.</p><h4>6. Test connection between Lambda and EFS</h4><p>Here we will test whether the connection between EFS and Lambda works with a small example.</p><p>Go to the “Code” part of your Lambda. Copy the following example code.</p><pre>import json<br>import os<br>import sys<br>sys.path.append(&#39;/mnt/access&#39;)<br>def lambda_handler(event, context):<br>   <br>    <br>    print(&#39;Before: &#39;,os.listdir(&#39;/mnt/access&#39;))<br>    <br>    with open(&#39;/mnt/access/somefile.txt&#39;,&#39;w&#39;) as file:<br>        file.write(&#39;hello world&#39;)<br>    <br>    <br>    print(&#39;After: &#39;,os.listdir(&#39;/mnt/access&#39;))</pre><p>These codes print the files and folders in “/mnt/access” before and after the creation of a simple file that says “hello world”. Then you have to click on ‘Deploy’, ‘Test’ and finally you will get a printout.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*bIT35VcyHeOb96p4.png" /></figure><p>Congratulations! We have the EFS already connected with our simple Lambda Function.</p><p>Now what we can create our test sample with our EFS through an EC2 instance, this will make easier install files on our /mnt/access folder.</p><h4>7. Create an EC2 instance</h4><p>EC2 stands for Elastic cloud computing. It allows you to create a server. We’ll just create a simple and free kind of EC2 instance and then we’ll mount the EFS that we created on this instance.</p><p>🔸 <strong>I have progressed through Ubuntu 20.04, but you can proceed as you wish, except for the “configure instance” and “configure security group” fields, except this part, other parts are optional.</strong></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*B4eP6E9qRi1mkO2p.png" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*VtvzKf_eY7txNFGf.png" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*7jQajCsLWOsLJ6Gi.png" /></figure><p><strong>🔸 Create new key pair</strong></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/850/0*tnwuf2fGK1cSSVX4.png" /></figure><p><strong>🔸 Getting your connect instance information.</strong></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*y36chDTND1z67fAL.png" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*5Lfw1Lm3dv7MkQOt.png" /></figure><p>🔸<strong> Example Installations</strong></p><p><em>👉🏽 NFS Configurations</em></p><pre>sudo apt-get update<br>sudo apt-get install nfs-common<br>mkdir mnt</pre><p>After doing that let’s go to the EFS we created and click the attach part in the upper right. Copy the NFS client command paste that but without the “efs” at the end.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*b4PM7t3CpUCQJgcp.png" /></figure><p>For me:</p><pre>sudo mount -t nfs4 -o nfsvers=4.1,rsize=1048576,wsize=1048576,hard,timeo=600,retrans=2,noresvport fs-095de34f07883e4b0.efs.eu-central-1.amazonaws.com:/ mnt</pre><p><em>👉🏽 Python Installations</em></p><pre>sudo apt-get install python3.8<br>sudo apt-get install python3-pip<br>sudo update-alternatives --config python3</pre><p>Now I will install the Python libraries in my access folder.</p><pre>pip3 install --upgrade --target mnt/access/ numpy</pre><h4>8. Lambda Function with example libraries from EFS</h4><p>Let’s go back to the Lambda. Deploy the example code.</p><pre>import json<br>import os<br>import sys<br>import numpy as np</pre><pre># connecting to the folder with the libraries<br>sys.path.append(&#39;/mnt/access&#39;)</pre><pre>def lambda_handler(event, context):<br>    print(np.ones(3))</pre><figure><img alt="" src="https://cdn-images-1.medium.com/max/736/0*avz54k-WAlEphiAh.png" /></figure><p>Great! We connected our EFS to our lambda function and we are using the libraries that we installed there in our EC2!</p><h4>📋 Next Lecturer we will do different example with more libraries using Serverless API and API Gateway</h4><ul><li>To reach : <a href="https://medium.com/@sedaatalay/deploying-large-python-packages-on-aws-lambda-using-efs-serverless-rest-api-using-api-gateway-71cdca072dd4"><em>https://medium.com/@sedaatalay/deploying-large-python-packages-on-aws-lambda-using-efs-serverless-rest-api-using-api-gateway-71cdca072dd4</em></a></li></ul><blockquote>Thanks for your time :)</blockquote><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=885df8ba7510" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Automatic Deploying with Jenkins on an AWS EC2 Instance (Includes GitHub-Docker-Git)]]></title>
            <link>https://medium.com/@sedaatalay/automatic-deploying-with-jenkins-on-an-aws-ec2-instance-includes-github-docker-git-f052aab308d4?source=rss-822a8f2c47f8------2</link>
            <guid isPermaLink="false">https://medium.com/p/f052aab308d4</guid>
            <category><![CDATA[devops]]></category>
            <category><![CDATA[github]]></category>
            <category><![CDATA[aws]]></category>
            <category><![CDATA[docker]]></category>
            <category><![CDATA[jenkins]]></category>
            <dc:creator><![CDATA[Seda Atalay]]></dc:creator>
            <pubDate>Sat, 04 Jun 2022 10:04:56 GMT</pubDate>
            <atom:updated>2022-06-04T10:07:27.608Z</atom:updated>
            <content:encoded><![CDATA[<p>To deploying model we try to best model accuracy. And after tuning some of the parameters and adding some more data, you expect had better accuracy than the previous model built. That’ s mean you plan to deploy this model and you have to go through the trouble of building, testing and deploying the model to production again which is a lot of work.</p><p>You can tedious to manually run tests weekly, or even daily, which is where a CI/CD or Continuous Integration/ Continuous Deployment Pipeline like Jenkins comes in. Jenkins allows us to automatically run tests weekly, daily, hourly, or even on commit to a repository. In this article, I will show you how we can use a powerful tool called Jenkins to automate this process.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/467/0*LyJ0n1esYtx63BIx.png" /></figure><h3>What is Jenkins?</h3><p>In addition to automating other routine development tasks, Jenkins provides a simple way to set up a continuous integration or continuous delivery (CI/CD) environment for virtually any language and source code repository combination that uses pipelines. While Jenkins doesn’t eliminate the need to create scripts for individual steps, it does offer a faster and more robust way to integrate your entire chain of build, test, and deployment tools than you can easily build yourself.</p><p>For example, you can set up Jenkins to automatically detect code commit in a repository and automatically trigger commands either creating a Flask application using Docker building a Docker image from a Dockerfile, running unit tests or push an image to a container registry or deploy it to the production server without manually doing anything. Let’s look basic concept we need to know in order to perform some automation in our project.</p><h3>Jenkins features</h3><p>Jenkins has some features that really sell it as a CI/CD tool. These are some of them:</p><ul><li>Plug-ins</li><li>Easy to set up</li><li>Supports most environments</li><li>Open-source</li><li>Easy distribution</li></ul><h3>Before the practical side, there are some important terms need to know.</h3><h3>- Jenkins Job</h3><p>Jobs are the heart of Jenkins’ build process. In Jenkins, a job can be thought of as a specific task to achieve a necessary purpose. We can also create and build these jobs to test our app or project. Jenkins provides the following types of build jobs that a user can create based on need. Creating Job is very easy in Jenkins but in a software environment, you may not build a single job but instead, you’ll be doing what is referred to as a pipeline.</p><h3>- Jenkins Pipeline</h3><p>In simple words, a pipeline is a set of interconnected tasks executed in a specific order. Additionally, Jenkins Pipeline is a plugin package that helps users implement and integrate continuous delivery pipelines into Jenkins. You can also use Pipeline to create complex or simple deployment pipelines as code through the Pipeline domain-specific language (DSL) syntax. Then, the following states represent a continuous delivery Line.</p><p>Types of Jenkins Pipeline:</p><ul><li>Declarative pipeline: This is a feature that supports the pipeline as a code concept. It makes the pipeline code easier to read and write. This code is written in a Jenkinsfile which can be checked into a source control management system such as Git.</li><li>Scripted pipeline: This is one of the old ways of writing the code. Using this method, the pipeline code is written on the Jenkins User Interface instance instead of writing it in a file. Though both these pipelines perform the same function and they use the same scripting language(Groovy).</li></ul><figure><img alt="" src="https://cdn-images-1.medium.com/max/567/0*hh30d7HJHW9UPC90.png" /></figure><p>In this example, we create a trained Machine Learning model that assisting the doctor’s decision-making process on disease prediction by detecting disease symptoms who coming from the patient, I deployed as an API using Flask . I structured my Jenkins pipeline to:</p><p>Pull changes from the repository when a commit is made &gt;&gt;&gt; Build Docker Image &gt;&gt;&gt; Built the model.</p><h3>Steps</h3><h4>Installation</h4><p>Install Jenkins, Git and Docker in your instance. Startup a Jenkins server and install Git, Docker, Pipeline and build plugins.</p><p>This is part 2 of my series on deploying Jenkins to create an efficient CI/CD Pipeline. In part one, I covered installing and launching Jenkins, Git, Docker, Plugins on a AWS EC2 instance. You can find part one link below:</p><ul><li><a href="https://medium.com/@sedaatalay/how-to-install-jenkins-git-docker-on-amazon-ec2-instance-9a100108df7f">https://medium.com/@sedaatalay/how-to-install-jenkins-git-docker-on-amazon-ec2-instance-9a100108df7f</a></li></ul><p>Push the code to a repository, in this article I used Github. You can find the code for this article here.</p><ul><li><a href="https://github.com/sedaatalay/jenk_deneme">https://github.com/sedaatalay/jenk_deneme</a></li></ul><p>My working directory:<br>.<br>├── app.py<br>├── Dockerfile<br>├── Jenkinsfile<br>├── ML_model<br>│ └── first_model.sav<br>└── requirements.txt</p><ul><li>Next, we have to tell Jenkins to start building the pipeline whenever a change is made to the code repository. To do this, you need to add the Jenkins webhook to the GitHub repository for Github to contact Jenkins if there is a change in the code. Click on settings in your code repository:</li></ul><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*nKvnt0U-rsSRXM-N.png" /></figure><ul><li>Click the webhooks panel and click on Add Webhook</li><li>Then use the public DNS or public IP of your Jenkins server and add “/github-webhook/” at the end, then select application/json as the content type. In the “Which events would you like to trigger this webhook?”, select the individual events and select pushes only and click on add webhook.</li></ul><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*cbDQtD5oeVk_Irg_.png" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*eThcDzG6yau-7put.png" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*-t0Sno8CgE0izT8P.png" /></figure><ul><li>Now, head over to Jenkins and click on New Item</li></ul><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*NHO5zXyPh2nzBZm6.png" /></figure><ul><li>Enter an Item name, Select Pipeline and click OK</li></ul><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*S6SUoRT48BD_jzOw.png" /></figure><ul><li>Scroll down from General to Build Triggers and select Github hook trigger for GitScm polling. What that simply does is that helps us build our pipeline whenever there’s a commit in our code.</li></ul><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*snAbSMmxcM3ju0mw.png" /></figure><ul><li>Then Scroll to Pipeline and in the Definition select Pipeline script from SCM from the dropdown. In the SCM(Source Code Management) select Git and put in the Repository URL, if your repo is private you need to create a credential using your username and password. If it is not private yo do not need to. In the Branch Specifier, you can select master or any branch your code repository is in and the Script Path select Jenkinsfile, the Jenkinsfile is where I wrote my pipeline for the project. Then select Save.</li></ul><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*sTnUeROu5M2dTEnB.png" /></figure><h3>Building Docker Image using Jenkins Pipeline</h3><p>Add docker plugin to Jenkins</p><ul><li>Go to the Jenkins Dashboard &gt;&gt; Manage Jenkins &gt;&gt; Manage plugin then tap on the available and type Docker, you need to install docker as well as docker pipeline plugin. Also you can install the requirements for your project.</li></ul><figure><img alt="" src="https://cdn-images-1.medium.com/max/846/0*U-xS8XKiFy3tM0v_.png" /></figure><h3>Jenkins Building Docker Image and Sending to Registry</h3><p>You can build this image to github jenkins_file</p><h4>Pipeline Explanation :</h4><ul><li>The job will have one step. It will run the docker build and use the jenkins build number in docker tag. With build number turn easeful to deploy or rollback based in jenkins.</li></ul><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*ESB0dRzlStI1Zwp6.png" /></figure><ul><li>Now let’s build the pipeline…</li></ul><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*1At_lrN8UW6fBiLf.png" /></figure><ul><li>It ran through all the stages and you should see a successful run of the job.</li></ul><p>If you get an error in this “Build Docker Image” section, don’t forget to add the following to the command line.</p><pre>sudo chmod 666 /var/run/docker.sock</pre><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*huxxDirlUNFtHjSG.png" /></figure><p>When you do little change in your code repository and push. If you go back to Jenkins you’ll see that it has already detected the changes made already and it automatically triggers another build.</p><h4>And that’s how you can use Jenkins to automate these processes.</h4><h4>Thank you :)</h4><p><em>Originally published at </em><a href="https://github.com/sedaatalay/Automatic-Deploying-with-Jenkins-on-an-AWS-EC2-instance-Includes-GitHub-Docker-Git-"><em>https://github.com</em></a><em>.</em></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=f052aab308d4" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[How to Install Jenkins-Git-Docker on Amazon EC2 Instance]]></title>
            <link>https://medium.com/@sedaatalay/how-to-install-jenkins-git-docker-on-amazon-ec2-instance-9a100108df7f?source=rss-822a8f2c47f8------2</link>
            <guid isPermaLink="false">https://medium.com/p/9a100108df7f</guid>
            <category><![CDATA[docker]]></category>
            <category><![CDATA[git]]></category>
            <category><![CDATA[aws]]></category>
            <category><![CDATA[jenkins]]></category>
            <category><![CDATA[ec2]]></category>
            <dc:creator><![CDATA[Seda Atalay]]></dc:creator>
            <pubDate>Sat, 04 Jun 2022 09:45:47 GMT</pubDate>
            <atom:updated>2022-06-04T09:45:47.009Z</atom:updated>
            <content:encoded><![CDATA[<p>In this part, I will show how to install and launch Jenkins,Git,Docker on a AWS EC2 instance.</p><p>Let’s get start with Jenkins</p><h3>Installing Jenkins</h3><ul><li>Create Ubuntu 18.04 EC2 Instance. Once you logged in to your AWS account and accessed your Ubuntu Server 18.04 LTS instance you can follow the below steps to install Jenkins.</li><li>Update Ubuntu Server Before installing Jenkins you have to update software packages on Ubuntu server for that use below commands.</li></ul><pre>wget -q -O - https://pkg.jenkins.io/debian-stable/jenkins.io.key | sudo apt-key add -</pre><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*49z3_M8Aozepmgex.png" /></figure><ul><li>Add Package Repository</li></ul><pre>sudo sh -c &#39;echo deb http://pkg.jenkins.io/debian-stable binary/ &gt; /etc/apt/sources.list.d/jenkins.list&#39;</pre><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*-5MBgtFvvs2EO5Y6.png" /></figure><ul><li>Now, to update the server</li></ul><pre>sudo apt update</pre><ul><li>Install Jenkins Dependencies We first have to install java</li></ul><pre>sudo apt install default-jre -y</pre><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*JoFUDI8lrKK0YbI6.png" /></figure><pre>sudo apt install jenkins -y</pre><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*3Qdd_2jxnhGVecbZ.png" /></figure><p>And Jenkins installation completed you have to start Jenkins service</p><pre>sudo systemctl start jenkins<br>sudo systemctl status jenkins</pre><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*ATg5tA2ttvSVCFbg.png" /></figure><ul><li>Allow Jenkins Port On Ubuntu Firewall By default Ubuntu server has firewall installed and we have to allow Jenkins port 8080 from firewall so that we can access Jenkins.</li></ul><pre>sudo ufw allow 8080</pre><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*-4jzSr1HpEn23-G6.png" /></figure><p>If the Ubuntu machine firewall is not enabled, you can use the commands below to check it.</p><pre>sudo ufw status</pre><p>If your Ubuntu firewall is inactive use</p><pre>sudo ufw allow OpenSSH sudo ufw enable<br>sudo ufw enable<br>sudo ufw status</pre><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*ieY4KFG9xcCf_YS7.png" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*xxC4-1Dr4th3Zqss.png" /></figure><ul><li>Setting Up Your Jenkins Now to access Jenkins from web browser you must also allow Jenkins port 8080 in AWS security group and after that you will be able to access Jenkins. So go to your AWS account-Security group and add port 8080.</li><li>As a last part, pen web browser and type your AWS Ec2 Ubuntu instance public IP address with 8080 port.</li></ul><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*8FMtk6vs1Ju38Vl5.png" /></figure><ul><li>As per the instructions in the screenshot above, you need to get the default admin password from the given path, so on your Ubuntu machine you would issue the following command to get it.</li></ul><pre>sudo cat /var/lib/jenkins/secrets/initialAdminPassword</pre><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*FabdDADWZWmBw8Jy.png" /></figure><ul><li>You will get the following output and this is the default admin password to login to Jenkins copy this and use it in web browser for Jenkins login.</li><li>When you login to Jenkins with default admin password, it will present two options and this is recommended plugins and choose plugins to install. We recommend clicking on the suggested plugins and jenkins will take care of the plugin installations.</li></ul><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*YE8Gbe2mANeszOy0.png" /></figure><ul><li>The plugins will take some time to install and once all plugins are installed Jenkins will ask you to create your Admin user account. Next, fill in your desired admin user details and set Jenkins admin credentials.</li></ul><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*NpdYKoDYJu3ZAM5J.png" /></figure><ul><li>Click Save and Finish after setting your Jenkins access url and other information. Finally you will get a confirmation page and it will be “Jenkins Ready”.</li></ul><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*HZCg-VWyykIRQ4C5.png" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*_RJefZSST3FPGIte.png" /></figure><h3>Installing Git</h3><ul><li>Update Ubuntu Server Before installing Git you have to update software packages on Ubuntu server for that use below commands.</li></ul><pre>sudo apt-get update -y</pre><ul><li>Install Jenkins Dependencies</li></ul><pre>sudo apt install git -y<br>git --version</pre><figure><img alt="" src="https://cdn-images-1.medium.com/max/958/0*uAiyQ85Rc4a-Qb3T.png" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/710/0*ezLCk72F5B1p3oys.png" /></figure><h3>What’s Docker?</h3><p>Docker is an open platform for developers and sysadmins to build, ship, and run distributed applications.</p><h3>Installing Docker</h3><p>Running Docker on AWS provides administrators and developers a highly reliable, cost-effective way to build, ship, and run distributed applications. Docker can be installed on many different operating systems, including Linux distributions like Ubuntu and even Mac OSX and Windows.</p><pre>sudo apt-get update<br>sudo apt install docker.io</pre><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*SPrtwACB1N7lQhF8.png" /></figure><pre>service docker.io start<br>service docker.io status</pre><ul><li>Basic Commands for Docker</li></ul><pre>sudo docker info</pre><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*RPzqqASRjAYwBzRz.png" /></figure><pre>sudo docker images<br>sudo docker ps</pre><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*uQYehmFQUM84b6Vp.png" /></figure><ul><li>Run Docker Image: By default, docker pulls the images from a Docker registry called Docker Hub managed by Docker company. To confirm whether you can download the images from Docker Hub:</li></ul><pre>sudo docker run hello-world</pre><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*s4ryhMwJP_He45Zu.png" /></figure><p>Thank you :))</p><p><em>Originally published at </em><a href="https://github.com/sedaatalay/How-to-Install-Jenkins-Git-Docker-on-Amazon-EC2-Instance"><em>https://github.com</em></a><em>.</em></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=9a100108df7f" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Sample Data Analysis Techniques with PySpark]]></title>
            <link>https://medium.com/@sedaatalay/sample-data-analysis-techniques-with-pyspark-41590da43c6e?source=rss-822a8f2c47f8------2</link>
            <guid isPermaLink="false">https://medium.com/p/41590da43c6e</guid>
            <category><![CDATA[pyspark]]></category>
            <category><![CDATA[apache-spark]]></category>
            <category><![CDATA[amazon]]></category>
            <category><![CDATA[spark]]></category>
            <category><![CDATA[aws]]></category>
            <dc:creator><![CDATA[Seda Atalay]]></dc:creator>
            <pubDate>Tue, 24 May 2022 20:23:23 GMT</pubDate>
            <atom:updated>2022-05-24T20:23:45.825Z</atom:updated>
            <content:encoded><![CDATA[<h3>What is Apache Spark?</h3><p>Apache Spark is a fast, in-memory data processing engine with elegant and impressive development APIs that enable data workers to efficiently execute streaming, machine learning or SQL workloads that require fast iterative access to datasets. Spark was originally developed at UC Berkeley at the AMP Lab. Later, its code base was open sourced and eventually donated to the Apache Software Foundation; hence its current name, Apache Spark.</p><h3>Setup</h3><p>For this tutorial, we will be loading Apache Spark on Jupyter Notebook. There are many tutorials on how to install Apache Spark, and they are easy to follow along. To setup jupyter notebook on EC2 Server, check the link below :</p><p><a href="https://github.com/sedaatalay/Running-Jupyter-Notebook-on-AWS-EC2-Server">https://github.com/sedaatalay/Running-Jupyter-Notebook-on-AWS-EC2-Server</a></p><h3>Creating an sample in Jupyter Notebook</h3><pre>import findspark<br>findspark.init()<br>import pyspark<br>from pyspark import SparkConf, SparkContext<br>from pyspark.sql import SparkSession<br>from pyspark.sql.functions import *<br>from random import randint, choice<br>import string</pre><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*CmjIQWHw-OhLhvoM.png" /></figure><h4>Spark Context</h4><p>To run Spark, we need to initialize a Spark context. A Spark context is the entry point to Spark that is needed to deal. We can initialize one simply as follows:</p><pre>conf = SparkConf().setMaster(&quot;local&quot;).setAppName(&quot;app&quot;)<br>sc = SparkContext.getOrCreate()<br>spark = SparkSession.builder.getOrCreate()</pre><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*3tS3tVX0XhO3GuUW.png" /></figure><h4>Create random generated samples (has 50 dimensions)</h4><pre>def randCol():<br>  return rand(seed=randint(0,1000)).alias(choice(string.ascii_letters))</pre><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*wmOfHbewG4YutbEC.png" /></figure><h4>or</h4><pre>import pandas as pd<br>import<br>numpy as np<br>df= pd.DataFrame np.random.randint (0,100,size=(1000000, 51)), np.arange (<br>df</pre><pre>df.to_csv(&#39;data.csv&#39;,index =None)</pre><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*TIO0l69irzoL1GY8.png" /></figure><h4>SQLContext</h4><p>SqlContext is the entry point to SparkSQL which is a Spark module for structured data processing. Once SQLContext is initialised, the user can then use it in order to perform various “sql-like” operations over Datasets and Dataframes.</p><pre>df = sqlContext.range(0, 50).select(&quot;id&quot;, randCol(),randCol(),randCol())<br>df.show(5)</pre><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*mUFvbNGyJELuXpGa.png" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*TKA3-tCCC82xCz3S.png" /></figure><h4>Mean, Min, Max</h4><p>Mean</p><pre>df.select([mean(df.schema.names[1]), mean(df.schema.names[2]), mean(df.schema.names[3])]).show()</pre><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*ZIlPIU-OtaCIqwXD.png" /></figure><p>Min</p><pre>df.select([min(df.schema.names[1]), min(df.schema.names[2]), min(df.schema.names[3])]).show()</pre><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*doHQ8AjG1mMAnwjE.png" /></figure><p>Max</p><pre>df.select([max(df.schema.names[1]), max(df.schema.names[2]), max(df.schema.names[3])]).show()</pre><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*v3wblBiWcrhWzWMD.png" /></figure><h4>Variance, Covariance</h4><p>Variance</p><pre>df.agg({df.schema.names[1]: &#39;variance&#39;}).collect()</pre><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*byAHk8c4_bj3VrrZ.png" /></figure><p>Covariance</p><pre>df.stat.cov(df.schema.names[1], df.schema.names[2])</pre><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*wAKO-FaPdm6kzOLF.png" /></figure><h4>FreqItems</h4><pre>df.stat.freqItems(df.schema.names, 0.3).collect()</pre><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*dB3OuGSRRCAMIE74.png" /></figure><h4>Math Functions</h4><pre>df.select(df.schema.names[1],<br>  (pow(sin(df[df.schema.names[1]]), 4) * sin(df[df.schema.names[1]])).alias(&quot;Sinus Equeation&quot;),<br>  toDegrees(df.schema.names[1]),).show()</pre><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*6t2AOpMNJMEw6aCP.png" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*zk0juTN6Es9vJP01.png" /></figure><h4>ColStats</h4><pre>df.summary().show()</pre><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*s6fjVMPuMX2XFoId.png" /></figure><h4>Describe</h4><pre>df.describe().show()</pre><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*IzH0dcsCdH2Eozzh.png" /></figure><h4>Crosstab</h4><pre>companies = [&quot;IBM&quot;, &quot;Google&quot;, &quot;Huawei&quot;,&quot;Netflix&quot;,&quot;Meta&quot;,&quot;Tesla&quot;]<br>positions = [&quot;Software Engineer&quot;, &quot;Big Data Analyst&quot;, &quot;MLOps Specialist&quot;, &quot;Data Scientist&quot;, &quot;Machine Learning Engineer&quot;<br>compy_df = sqlContext.createDataFrame([(companies[i % len(companies)], positions[i % len(positions)]) for i in range<br>compy_df.show()</pre><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*AwFGxa3JT3SNBXqv.png" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*Vgr1Oh2PxGSM-6JL.png" /></figure><pre>compy_df.stat.crosstab(&quot;Companies&quot;, &quot;Positions&quot;).show()</pre><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*K3kOv4DnCykCogTw.png" /></figure><p>Thank you :))</p><p><em>Originally published at </em><a href="https://github.com/sedaatalay/Sample-Data-Analysis-Techniques-with-PySpark"><em>https://github.com</em></a><em>.</em></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=41590da43c6e" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Use Jumbo Frames — MTU to Improve AWS EC2 Performance]]></title>
            <link>https://medium.com/@sedaatalay/use-jumbo-frames-mtu-to-improve-aws-ec2-performance-f7992c69a8f4?source=rss-822a8f2c47f8------2</link>
            <guid isPermaLink="false">https://medium.com/p/f7992c69a8f4</guid>
            <category><![CDATA[aws]]></category>
            <category><![CDATA[aws-ec2]]></category>
            <category><![CDATA[framework]]></category>
            <category><![CDATA[ec2]]></category>
            <dc:creator><![CDATA[Seda Atalay]]></dc:creator>
            <pubDate>Thu, 19 May 2022 19:24:44 GMT</pubDate>
            <atom:updated>2022-05-19T19:24:44.460Z</atom:updated>
            <content:encoded><![CDATA[<h3>Use Jumbo Frames — MTU to Improve AWS EC2 Performance</h3><p>The maximum transmission unit (MTU) of a network connection is the size, in bytes, of the largest allowed packet that can be passed over the link. The larger the MTU of a link, the more data can be transmitted in a single packet. Ethernet packets consist of the frame, or the actual data you’re sending, and the network overhead information surrounding it.</p><p>To take advantage of this feature and improve your application performance, you can configure your applications to use larger frameworks. All Amazon EC2 instance types support 1500 MTUs, and many existing instance sizes support 9001 MTU or jumbo frames.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*aiepACJijxV_H07O.png" /></figure><p>How can we test if our new 9000-byte MTU is actually working, and do we take advantage of a larger packet size? We can use tracepath to determine the maximum MTU between two endpoints.</p><pre>[ssh -i h_pair.pem ubuntu@52.29.193.171 -L localhost:8037:localhost:8080]$ tracepath google.com<br>1?: [LOCALHOST]                                         pmtu 9001<br>1:  ip-10-13-0-1.ec2.internal                             0.226ms pmtu 1500<br>1:  no reply<br>:<br>5:  no reply<br>6:  100.65.14.17                                          0.807ms asymm  7 <br>7:  52.93.29.63                                          31.645ms asymm  8 <br>8:  100.100.2.36                                          0.738ms asymm 12 <br>9:  99.82.181.25                                          0.845ms asymm 16 <br>10:  no reply<br>:<br>30:  no reply<br>    Too many hops: pmtu 1500<br>    Resume: pmtu 1500</pre><p>In the above route(to the internet) the maximum MTU was 1500, While i do the same with EC2 instances in the same subnet, i am able to achieve a maximum of MTU of 9001</p><pre>[ssh -i h_pair.pem ubuntu@52.29.193.171 -L localhost:8037:localhost:8080]$ tracepath 10.13.0.126<br>1?: [LOCALHOST]                                         pmtu 9001<br>:<br>30:  no reply<br>    Too many hops: pmtu 9001<br>    Resume: pmtu 9001</pre><p><strong>Can we really use this in a real-world scenario?</strong></p><p>Let us assume two high I/O intensive EC2 workloads are there in the same subnet. They are processing huge files (~10GBs) between them. We will copy the files between the instances and count how many the <em>Incoming Packets</em> are sent when MTU 1500 is used and how many are needed when MTU 9001 is set.</p><h3>Check the MTU Size</h3><p>Lets check the current MTU</p><pre># Set it to to 1500<br>sudo ip link set dev eth0 mtu 1500<br>ip link show eth0</pre><h3>Create a huge file</h3><pre># Assuming you have 20GB free space<br>fallocate -l 20G /home/ubuntu/test.img</pre><h3>Send some data</h3><p>You can use scp or rsync to copy the data. I have already copied the private pem(h_pair.pem) to allow me to securely copy the data between the machines</p><pre>pcksFile=&quot;/sys/class/net/eth0/statistics/rx_packets&quot;<br>nbPcks=`cat $pcksFile`<br># scp -i h_pair.pem ubuntu@52.29.193.171 -L localhost:8037:localhost:8080:/home/ubuntu/test.img /home/ubuntu/<br>rsync -a --info=progress2 \<br>   -e &quot;ssh -i h_pair.pem&quot; \<br>   ec2-user@10.13.0.126:/home/ubuntu/test.img \<br>   /home/ubuntu/<br>echo $(expr `cat $pcksFile` - $nbPcks)</pre><p><em>Repeat previous step with mtu set to </em><em>9001</em></p><pre>sudo ip link set dev eth0 mtu 9001<br>ip link show eth0<br>pcksFile=&quot;/sys/class/net/eth0/statistics/rx_packets&quot;<br>nbPcks=`cat $pcksFile`<br># scp -i h_pair.pem ubuntu@52.29.193.171 -L localhost:8037:localhost:8080:/home/ec2-user/test.img /home/ubuntu/<br>rsync -a --info=progress2 \<br>   -e &quot;ssh -i h_pair.pem&quot; \<br>   ubuntu@52.29.193.171 -L localhost:8037:localhost:8080:/home/ubuntu/test.img \<br>   /home/ubuntu/<br>echo &#39;Total Incoming Packets: $(expr `cat $pcksFile` - $nbPcks)&#39;</pre><p><em>Output</em>: My experiments with a 20GB file show that, it take about 14860928packets with MTU 1500 and 2418970packets with MTU 9001. That is close to 6x improvement.</p><h3>Conclusion</h3><p>As you can see, you can get almost 6x performance improvements if you configure your applications to make use of the higher MTU offered to by AWS and get more out of your EC2 instances.</p><p>Thank you :)</p><p><em>Originally published at </em><a href="https://github.com/sedaatalay/Improve-AWS-EC2-Performance"><em>https://github.com</em></a><em>.</em></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=f7992c69a8f4" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Add an Emoji  to Your LinkedIn Profile with a Simple ✂ Copy and  Paste]]></title>
            <link>https://medium.com/@sedaatalay/add-an-emoji-to-your-linkedin-profile-with-a-simple-copy-and-paste-d362d429dab2?source=rss-822a8f2c47f8------2</link>
            <guid isPermaLink="false">https://medium.com/p/d362d429dab2</guid>
            <category><![CDATA[linkedin]]></category>
            <category><![CDATA[emoji]]></category>
            <dc:creator><![CDATA[Seda Atalay]]></dc:creator>
            <pubDate>Fri, 13 May 2022 16:37:35 GMT</pubDate>
            <atom:updated>2022-05-13T16:39:01.012Z</atom:updated>
            <content:encoded><![CDATA[<p>Sometimes we express and support what we write better with emojis. It can also be very helpful in using what we write or express on a professional site like LinkedIn. 😊</p><p>Below you can find all the emojis seen on the keyboard.<br>Hopefully it benefits your business!</p><p>⌚️ 📱 📲 💻 ⌨ 💽 💾 💿 📀 📼 📷 📹 🎥 📞 ☎️ 📟 📠 📺 📻 ⏰ ⏳ ⌛️ 📡 🔋 🔌 💡 🔦 💸 💵 💴 💶 💷 💰 💳 💎 🔧 🔨🔩🔪 ⚔ 🚬 ⚰ ⚱ 🔮 💈 🔭 🔬 💊 💉 🔖 🚽 🚿 🛁 🔑 🚪🗿🎈 🎏 🎀 🎁 🎊 🎉 🎎 🎐 🎌 🏮 ✉️ 📩 📨 📧 💌 📮 📪 📫 📬 📭 📦 📯 📥 📤 📜 📃 📑 📊 📈 📉 📄 📅 📆 📇 📋 📁 📂 📰 📓 📕 📗 📘 📙 📔 📒 📚 📖 🔗 📎 ✂️ 📐 📏 📌 📍 🚩 🔐 🔒 🔓 🔏 ✒️ 📝 ✏️ 🔍 🔎 💬 💭🗣</p><h3>😀 😬 😁 😂 😃 😄 😅 😆 😇 😉 😊 😋 😌 😍 😘 😗 😙 😚 😜 😝 😛 😎 😏 😶 😐 😑 😒 😳 😞 😟 😠 😡 😔 😕 😣 😖 😫 😩 😤 😮 😱 😨 😰 😯 😦 😧 😢 😥 😪 😓 😭 😵 😲 😷 😴 💤 💩 😈 👿 👹 👺 💀 👻 👽 😺 😸 😹 😻 😼 😽 🙀 😿 😾 🙌 👏 👋 👍 👊 ✊ ✌️ 👌 ✋ 💪 🙏 ☝️ 👆 👇 👈 👉 🖖 💅 👄 👅 👂 👃 👀 👤 👶 👦 👧 👨 👩 👱 👴 👵 👲 👳 👮 👷 💂 🎅 👼 👸 👰 🚶 🏃 💃 👯 👫 👬 👭 🙇 💁 🙅 🙆 🙋 🙎 🙍 💇 💆 💑 👩‍❤️‍👩 👨‍❤️‍👨 💏 👩‍❤️‍💋‍👩 👨‍❤️‍💋‍👨 👪 👨‍👩‍👧 👨‍👩‍👧‍👦 👨‍👩‍👦‍👦 👨‍👩‍👧‍👧 👩‍👩‍👦 👩‍👩‍👧 👩‍👩‍👧‍👦 👩‍👩‍👦‍👦 👩‍👩‍👧‍👧 👨‍👨‍👦 👨‍👨‍👧 👨‍👨‍👧‍👦 👨‍👨‍👦‍👦 👨‍👨‍👧‍👧 👚 👕 👖 👔 👗 👙 👘 💄 💋 👣 👠 👡 👢 👞 👟 👒 🎩 🎓 👑 🎒 👝 👛 👜 💼 👓 💍 🌂</h3><h3>👦🏻 👧🏻 👨🏻 👩🏻 👴🏻 👵🏻 👶🏻 👱🏻 👮🏻 👲🏻 👳🏻 👷🏻 👸🏻 💂🏻 🎅🏻 👼🏻 💆🏻 💇🏻 👰🏻 🙍🏻 🙎🏻 🙅🏻 🙆🏻 💁🏻 🙋🏻 🙇🏻 🙌🏻 🙏🏻 🚶🏻 🏃🏻 💃🏻 💪🏻 👈🏻 👉🏻 ☝️🏻 👆🏻👇🏻 ✌️🏻 🖖🏻 ✊🏻 ✋🏻 👊🏻 👌🏻 👍🏻 👎🏻 👋🏻 👏🏻 👐🏻 💅🏻 👂🏻 👃🏻 🚣🏻 🛀🏻 🏄🏻 🏇🏻 🏊🏻 🚴🏻 🚵🏻</h3><h3>👦🏼 👧🏼 👨🏼 👩🏼 👴🏼 👵🏼 👶🏼 👱🏼 👮🏼 👲🏼 👳🏼 👷🏼 👸🏼 💂🏼 🎅🏼 👼🏼 💆🏼 💇🏼 👰🏼 🙍🏼 🙎🏼 🙅🏼 🙆🏼 💁🏼 🙋🏼 🙇🏼 🙌🏼 🙏🏼 🚶🏼 🏃🏼 💃🏼 💪🏼 👈🏼 👉🏼 ☝️🏼 👆🏼👇🏼 ✌️🏼 🖖🏼 ✊🏼 ✋🏼 👊🏼 👌🏼 👍🏼 👎🏼 👋🏼 👏🏼 👐🏼 💅🏼 👂🏼 👃🏼 🚣🏼 🛀🏼 🏄🏼 🏇🏼 🏊🏼 🚴🏼 🚵🏼</h3><h3>👦🏽 👧🏽 👨🏽 👩🏽 👴🏽 👵🏽 👶🏽 👱🏽 👮🏽 👲🏽 👳🏽 👷🏽 👸🏽 💂🏽 🎅🏽 👼🏽 💆🏽 💇🏽 👰🏽 🙍🏽 🙎🏽 🙅🏽 🙆🏽 💁🏽 🙋🏽 🙇🏽 🙌🏽 🙏🏽 🚶🏽 🏃🏽 💃🏽 💪🏽 👈🏽 👉🏽 ☝️🏽 👆🏽 👇🏽 ✌️🏽 🖖🏽 ✊🏽 ✋🏽 👊🏽 👌🏽 👍🏽 👎🏽 👋🏽 👏🏽 👐🏽 💅🏽 👂🏽 👃🏽 🚣🏽 🛀🏽 🏄🏽 🏇🏽 🏊🏽 🚴🏽 🚵🏽</h3><h3>👦🏾 👧🏾 👨🏾 👩🏾 👴🏾 👵🏾 👶🏾 👱🏾 👮🏾 👲🏾 👳🏾 👷🏾 👸🏾 💂🏾 🎅🏾 👼🏾 💆🏾 💇🏾 👰🏾 🙍🏾 🙎🏾 🙅🏾 🙆🏾 💁🏾 🙋🏾 🙇🏾 🙌🏾 🙏🏾 🚶🏾 🏃🏾 💃🏾 💪🏾 👈🏾 👉🏾 ☝️🏾 👆🏾👇🏾 ✌️🏾 🖖🏾 ✊🏾 ✋🏾 👊🏾 👌🏾 👍🏾 👎🏾 👋🏾 👏🏾 👐🏾 💅🏾 👂🏾 👃🏾 🚣🏾 🛀🏾 🏄🏾 🏇🏾 🏊🏾 🚴🏾 🚵🏾</h3><p>👦🏿 👧🏿 👨🏿 👩🏿 👴🏿 👵🏿 👶🏿 👱🏿 👮🏿 👲🏿 👳🏿 👷🏿 👸🏿 💂🏿 🎅🏿 👼🏿 💆🏿 💇🏿 👰🏿 🙍🏿 🙎🏿 🙅🏿 🙆🏿 💁🏿 🙋🏿 🙇🏿 🙌🏿 🙏🏿 🚶🏿 🏃🏿 💃🏿 💪🏿 👈🏿 👉🏿 ☝️🏿👆🏿👇🏿✌️🏿🖖🏿 ✊🏿 ✋🏿 👊🏿 👌🏿 👍🏿 👎🏿 👋🏿 👏🏿 👐🏿 💅🏿 👂🏿 👃🏿 🚣🏿 🛀🏿 🏄🏿 🏇🏿 🏊🏿 🚴🏿 🚵🏿</p><p>🐶 🐱 🐭 🐹 🐰 🐻 🐼 🐨 🐯 🐮 🐷 🐽 🐸 🐙 🐵 🙈 🙉 🙊 🐒 🐔 🐧 🐦 🐤 🐣 🐥 🐺 🐗 🐴 🐝 🐛 🐌 🐞 🐜 🐍 🐢 🐠 🐟 🐡 🐬 🐳 🐋 🐊 🐆 🐅 🐃 🐂 🐄 🐪 🐫 🐘 🐐 🐏 🐑 🐎 🐖 🐀 🐁 🐓 🐕 🐩 🐈 🐇 🐾 🐉 🐲 🌵 🎄 🌲 🌳 🌴 🌱 🌿 ☘ 🍀 🎍 🎋 🍃 🍂 🍁 🌾 🌺 🌻 🌹 🌷 🌼 🌸 💐 🍄 🌰 🎃 🐚 🌎 🌍 🌏 🌕 🌖 🌗 🌘 🌑 🌒 🌓 🌔 🌚 🌝 🌛 🌜 🌞 🌙 ⭐️ 🌟 💫 ✨ ☀️ ⛅️ ☁️ ⚡️ 🔥 💥 ❄️ 🔥 💥 ❄️ ⛄️ 💨 ☔️ 💧 💦 🌊</p><p>🍏 🍎 🍐 🍊 🍋 🍌 🍉 🍇 🍓 🍈 🍒 🍑 🍍 🍅 🍆 🌽 🍠 🍯 🍞 🍗 🍖 🍤 🍳 🍔 🍟 🍕 🍝 🍜 🍲 🍥 🍣 🍱 🍛 🍙 🍚 🍘 🍢 🍡 🍧 🍨 🍦 🍰 🎂 🍮 🍬 🍭 🍫 🍩 🍪 🍺 🍻 🍷 🍸 🍹 🍶 🍵 ☕️ 🍼 🍴</p><p>⚽️ 🏀 🏈 ⚾️ 🎾 🏉 🎱 ⛳️ 🎿 🏂 🎣 🚣 🏊 🏄 🛀 🚴 🚵 🏇 🏆 🎽 🎫 🎭 🎨 🎪 🎤 🎧 🎼 🎹 🎷 🎺 🎸 🎻 🎬 🎮 👾 🎯 🎲 🎰 🎳</p><p>🚗 🚕 🚙 🚌 🚎 🚓 🚑 🚒 🚐 🚚 🚛 🚜 🚲 🚨 🚔 🚍 🚘 🚖 🚡 🚠 🚟 🚃 🚋 🚝 🚄 🚅 🚈 🚞 🚂 🚆 🚇 🚊 🚉 🚁 ✈️ ⛵️ 🚤 🚀 💺 ⚓️ 🚧 ⛽️ 🚏 🚦 🚥 🏁 🚢 🎡 🎢 🎠 🌁 🗼 🏭 ⛲️ 🎑 🗻 🌋 🗾 ⛺️ 🌅 🌄 🌇 🌆 🌃 🌉 🌌 🌠 🎇 🎆 🌈 🏰 🏯 🗽 🏠 🏡 🏢 🏬 🏣 🏤 🏥 🏦 🏨 🏪 🏫 🏩 💒 ⛪️</p><p>❤️ 💛 💙 💜 💔 💕 💞 💓 💗 💖 💘 💝 💟 🔯 ⛎ ♈️ ♉️ ♊️ ♋️ ♌️ ♍️ ♎️ ♏️ ♐️ ♑️ ♒️ ♓️ 🆔 🈳 🈹 📴 📳 🈶 🈚️ 🈸 🈺 🈷️ ✴️ 🆚 🉑 💮 🉐 ㊙️ ㊗️ 🈴 🈵 🈲 🅰️ 🅱️ 🆎 🆑 🅾️ 🆘 ⛔️ 📛 🚫 ❌ ⭕️ 💢 ♨️ 🚷 🚯 🚳 🚱 🔞 📵 ❗️ ❕ ❓ ❔ ‼️ ⁉️ 💯 🔅 🔆 🔱 ⚜ 〽️ ⚠️ 🚸 🔰 ♻️ 🈯️ 💹 ❇️ ✳️ ❎ ✅ 💠 🌀 ➿ 🌐 Ⓜ️ 🏧 🈂️ 🛂 🛃 🛄 🛅 ♿️ 🚭 🚾 🅿️ 🚰 🚹 🚺 🚼 🚻 🚮 🎦 📶 🈁 🆖 🆗 🆙 🆒 🆕 🆓 🔟 🔢 ▶️ ⏩ ⏪ 🔀 🔁 🔂 ◀️ 🔼 🔽 ⏫ ⏬ ➡️ ⬅️ ⬆️ ⬇️ ↗️ ↘️ ↙️ ↖️ ↕️ ↔️ 🔄 ↪️ ↩️ ⤴️ ⤵️ ℹ️ 🔤 🔡 🔠 🔣 🎵 🎶 〰️ ➰ ✔️ 🔃 ➕ ➖ ➗ ✖️ 💲 💱 ©️ ®️ ™️ 🔚 🔙 🔛 🔝 🔜 ☑️ 🔘 ⚪️ ⚫️ 🔴 🔵 🔸 🔹 🔶 🔷 🔺 ▪️ ▫️ ⬛️ ⬜️ 🔻 ◼️ ◻️ ◾️ ◽️ 🔲 🔳 🔈 🔉 🔊 🔇 📣 📢 🔔 🔕 🃏 🀄️ ♠️ ♣️ ♥️ ♦️ 🎴 🕐 🕑 🕒 🕓 🕔 🕕 🕖 🕗 🕘 🕙 🕚 🕛 🕜 🕝 🕞 🕟 🕠 🕡 🕢 🕣 🕤 🕥 🕦 🕧</p><p>🇦🇫 🇦🇱 🇩🇿 🇦🇸 🇦🇩 🇦🇴 🇦🇮 🇦🇬 🇦🇷 🇦🇲 🇦🇼 🇦🇺 🇦🇹 🇦🇿 🇧🇸 🇧🇭 🇧🇩 🇧🇧 🇧🇾 🇧🇪 🇧🇿 🇧🇯 🇧🇲 🇧🇹 🇧🇴 🇧🇦 🇧🇼 🇧🇷 🇻🇬 🇧🇳 🇧🇬 🇧🇫 🇧🇮 🇨🇻 🇰🇭 🇨🇲 🇨🇦 🇰🇾 🇨🇫 🇨🇱 🇨🇳 🇨🇴 🇰🇲 🇨🇬 🇨🇩 🇨🇰 🇨🇷 🇭🇷 🇨🇺 🇨🇼 🇨🇾 🇨🇿 🇩🇰 🇩🇯 🇩🇲 🇩🇴 🇪🇨 🇪🇬 🇸🇻 🇬🇶 🇪🇷 🇪🇪 🇪🇹 🇫🇴 🇫🇯 🇫🇮 🇫🇷 🇬🇫 🇹🇫 🇬🇦 🇬🇲 🇬🇪 🇩🇪 🇬🇭 🇬🇮 🇬🇷 🇬🇩 🇬🇵 🇬🇺 🇬🇹 🇬🇳 🇬🇼 🇬🇾 🇭🇹 🇭🇳 🇭🇰 🇭🇺 🇮🇸 🇮🇳 🇮🇩 🇮🇷 🇮🇶 🇮🇪 🇮🇱 🇮🇹 🇨🇮 🇯🇲 🇯🇵 🇯🇴 🇰🇿 🇰🇪 🇰🇮 🇰🇼 🇰🇬 🇱🇦 🇱🇻 🇱🇧 🇱🇸 🇱🇷 🇱🇾 🇱🇮 🇱🇹 🇱🇺 🇲🇴 🇲🇰 🇲🇬 🇲🇼 🇲🇾 🇲🇻 🇲🇱 🇲🇹 🇲🇶 🇲🇷 🇲🇽 🇲🇩 🇲🇳 🇲🇪 🇲🇸 🇲🇦 🇲🇿 🇲🇲 🇳🇦 🇳🇵 🇳🇱 🇳🇨 🇳🇿 🇳🇮 🇳🇪 🇳🇬 🇳🇺 🇲🇵 🇰🇵 🇳🇴 🇴🇲 🇵🇰 🇵🇼 🇵🇸 🇵🇦 🇵🇬 🇵🇾 🇵🇪 🇵🇭 🇵🇱 🇵🇹 🇵🇷 🇶🇦 🇷🇪 🇷🇴 🇷🇺 🇷🇼 🇰🇳 🇱🇨 🇻🇨 🇼🇸 🇸🇲 🇸🇹 🇸🇦 🇸🇳 🇷🇸 🇸🇨 🇸🇱 🇸🇬 🇸🇽 🇸🇰 🇸🇮 🇸🇧 🇸🇴 🇿🇦 🇰🇷 🇸🇸 🇪🇸 🇱🇰 🇸🇩 🇸🇷 🇸🇿 🇸🇪 🇨🇭 🇸🇾 🇹🇯 🇹🇿 🇹🇭 🇹🇱 🇹🇬 🇹🇴 🇹🇹 🇹🇳 🇹🇷 🇹🇲 🇹🇨 🇹🇻 🇺🇬 🇺🇦 🇦🇪 🇬🇧 🇺🇸 🇻🇮 🇺🇾 🇺🇿 🇻🇺 🇻🇪 🇻🇳 🇾🇪 🇿🇲 🇿🇼</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=d362d429dab2" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[How Much Do Data Scientists Need to Know about Statistics?]]></title>
            <link>https://medium.com/@sedaatalay/how-much-do-data-scientists-need-to-know-about-statistics-1c6ca0774e1d?source=rss-822a8f2c47f8------2</link>
            <guid isPermaLink="false">https://medium.com/p/1c6ca0774e1d</guid>
            <category><![CDATA[statistics]]></category>
            <category><![CDATA[data]]></category>
            <category><![CDATA[data-science]]></category>
            <dc:creator><![CDATA[Seda Atalay]]></dc:creator>
            <pubDate>Sun, 24 Apr 2022 20:37:44 GMT</pubDate>
            <atom:updated>2022-04-24T20:55:15.094Z</atom:updated>
            <content:encoded><![CDATA[<p>Statistical analysis and probability affect our lives on a daily basis. Statistics are used to forecast the weather, restock retail shelves, forecast the state of the economy and much more. Used in a variety of professional fields, statistics has the power to gain valuable insights and solve complex problems in business, science and society. Without exact science, decision making is based on emotions and instinctive reactions. Statistics and data override intuition, inform decisions, and minimize risk and uncertainty.</p><p>In data science, statistics are at the center of complex machine learning algorithms that capture data patterns and turn them into actionable evidence. Data scientists use statistics to collect, review, analyze and draw conclusions from data and also apply quantified mathematical models to appropriate variables. Data scientists work as programmers, researchers, business managers and more. However, what all these fields have in common is the basis of statistics. Therefore, statistics in data science are as necessary as understanding programming languages.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/794/1*BCKrYB_y2afFsWFCj9dsXA.jpeg" /></figure><p>In summary, it can be stated that Data science and statistics are indistinguishable and closely linked. It is clear that statistics is a tool or method for data science, while data science is a broad field where statistical method is an important component. Data science and statistics will continue to exist and there is a great deal of overlap between these two disciplines. It’s also worth noting that not all statisticians can be data scientists and vice versa. Data science has evolved with big data lately and will continue to grow in the years to come as data growth looks like it will never end.</p><p>Here is the <strong>Online Statistics Education</strong>, which can help you get an idea about statistics and help you learn.</p><p><a href="https://onlinestatbook.com/2/index.html"><strong>https://onlinestatbook.com/2/index.html</strong></a></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=1c6ca0774e1d" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Get Free AWS Training and Certification Voucher for women!]]></title>
            <link>https://medium.com/@sedaatalay/get-free-aws-training-and-certification-voucher-for-women-467cfe66628b?source=rss-822a8f2c47f8------2</link>
            <guid isPermaLink="false">https://medium.com/p/467cfe66628b</guid>
            <dc:creator><![CDATA[Seda Atalay]]></dc:creator>
            <pubDate>Sun, 17 Apr 2022 16:15:42 GMT</pubDate>
            <atom:updated>2022-04-18T10:43:54.049Z</atom:updated>
            <content:encoded><![CDATA[<p><strong>Applications are open for the AWS She Builds Cloud Practitioner program and Solution Architect Associate.</strong></p><p>Let’s get going!</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/301/1*Jzh_pDYqv3FFlsh8avlFmA.png" /></figure><p>AWS She Builds presents AWS CloudUp — a flexible, community-based learning program for women, providing AWS training delivered on your terms. f you’re a student thinking about a career in tech, or a professional looking to re-skill, cross skill, or simply cloud curious or if you’ve already got your technical foundations and a looking to fast track your career in tech then this programs are for you!</p><p>𝐇𝐨𝐰?</p><p>For more information and registration links are below. AWS CloudUp Program spaces are limited so apply now:</p><p><a href="https://awsshebuildscloudupcpe.splashthat.com/">https://awsshebuildscloudupcpe.splashthat.com/</a></p><p><a href="https://awsshebuildscloudupsaa.splashthat.com/">https://awsshebuildscloudupsaa.splashthat.com/</a></p><p><strong>Share this limited free opportunity with your friend!<br></strong>Let’s set women up for success and help them achieve the globally recognized AWS Training and Certification!</p><p>Thanks to <a href="https://www.linkedin.com/in/ACoAAAPdFqMBwGoTV2pfXfYdMaSPW7lFy_FwPOk"><strong>Donna Edwards</strong></a><strong> </strong>for driving this amazing initiative.</p><p><a href="https://www.linkedin.com/feed/hashtag/?keywords=aws&amp;highlightedUpdateUrns=urn%3Ali%3Aactivity%3A6892615124709179392">#aws</a> <a href="https://www.linkedin.com/feed/hashtag/?keywords=womenintech&amp;highlightedUpdateUrns=urn%3Ali%3Aactivity%3A6892615124709179392">#womenintech</a> <a href="https://www.linkedin.com/feed/hashtag/?keywords=cloudcomputing&amp;highlightedUpdateUrns=urn%3Ali%3Aactivity%3A6892615124709179392">#cloudcomputing</a> <a href="https://www.linkedin.com/feed/hashtag/?keywords=womenintechnology&amp;highlightedUpdateUrns=urn%3Ali%3Aactivity%3A6892615124709179392">#womenintechnology</a></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=467cfe66628b" width="1" height="1" alt="">]]></content:encoded>
        </item>
    </channel>
</rss>