<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0" xmlns:cc="http://cyber.law.harvard.edu/rss/creativeCommonsRssModule.html">
    <channel>
        <title><![CDATA[Stories by Astry Citrasari on Medium]]></title>
        <description><![CDATA[Stories by Astry Citrasari on Medium]]></description>
        <link>https://medium.com/@astrycitrasari?source=rss-1274825ba247------2</link>
        <image>
            <url>https://cdn-images-1.medium.com/fit/c/150/150/1*0V2PdbXewnTCCwqaE-hAWw@2x.jpeg</url>
            <title>Stories by Astry Citrasari on Medium</title>
            <link>https://medium.com/@astrycitrasari?source=rss-1274825ba247------2</link>
        </image>
        <generator>Medium</generator>
        <lastBuildDate>Sat, 21 Nov 2026 06:08:46 GMT</lastBuildDate>
        <atom:link href="https://medium.com/@astrycitrasari/feed" rel="self" type="application/rss+xml"/>
        <webMaster><![CDATA[yourfriends@medium.com]]></webMaster>
        <atom:link href="http://medium.superfeedr.com/" rel="hub"/>
        <item>
            <title><![CDATA[Python CSV UnicodeDecodeError Explained: Invalid Continuation Byte Fix.]]></title>
            <description><![CDATA[<div class="medium-feed-item"><p class="medium-feed-image"><a href="https://blog.stackademic.com/python-csv-unicodedecodeerror-explained-invalid-continuation-byte-fix-e6abbfff55f7?source=rss-1274825ba247------2"><img src="https://cdn-images-1.medium.com/max/2600/0*C2O1DUGrTcq_NeIq" width="5472"></a></p><p class="medium-feed-snippet">Link for non medium member: Click Here</p><p class="medium-feed-link"><a href="https://blog.stackademic.com/python-csv-unicodedecodeerror-explained-invalid-continuation-byte-fix-e6abbfff55f7?source=rss-1274825ba247------2">Continue reading on Stackademic »</a></p></div>]]></description>
            <link>https://blog.stackademic.com/python-csv-unicodedecodeerror-explained-invalid-continuation-byte-fix-e6abbfff55f7?source=rss-1274825ba247------2</link>
            <guid isPermaLink="false">https://medium.com/p/e6abbfff55f7</guid>
            <category><![CDATA[python]]></category>
            <category><![CDATA[unicodedecodeerror]]></category>
            <category><![CDATA[python-programming]]></category>
            <category><![CDATA[chardet]]></category>
            <dc:creator><![CDATA[Astry Citrasari]]></dc:creator>
            <pubDate>Mon, 22 Sep 2025 05:48:19 GMT</pubDate>
            <atom:updated>2026-05-05T03:48:01.559Z</atom:updated>
        </item>
        <item>
            <title><![CDATA[Step-by-Step: Connecting Python to a Database and Azure Storage with VS Code]]></title>
            <description><![CDATA[<div class="medium-feed-item"><p class="medium-feed-image"><a href="https://blog.stackademic.com/step-by-step-connecting-python-to-a-database-and-azure-storage-with-vs-code-27d3757f534f?source=rss-1274825ba247------2"><img src="https://cdn-images-1.medium.com/max/2600/0*nWSmk_rnlBP5mtOG" width="5766"></a></p><p class="medium-feed-snippet">Link for non member : Click here</p><p class="medium-feed-link"><a href="https://blog.stackademic.com/step-by-step-connecting-python-to-a-database-and-azure-storage-with-vs-code-27d3757f534f?source=rss-1274825ba247------2">Continue reading on Stackademic »</a></p></div>]]></description>
            <link>https://blog.stackademic.com/step-by-step-connecting-python-to-a-database-and-azure-storage-with-vs-code-27d3757f534f?source=rss-1274825ba247------2</link>
            <guid isPermaLink="false">https://medium.com/p/27d3757f534f</guid>
            <category><![CDATA[connection]]></category>
            <category><![CDATA[vscode]]></category>
            <category><![CDATA[database]]></category>
            <category><![CDATA[azure]]></category>
            <category><![CDATA[python]]></category>
            <dc:creator><![CDATA[Astry Citrasari]]></dc:creator>
            <pubDate>Fri, 22 Aug 2025 03:08:18 GMT</pubDate>
            <atom:updated>2026-05-05T03:48:59.255Z</atom:updated>
        </item>
        <item>
            <title><![CDATA[5 Python Codes That Are Surprisingly Just English Sentences]]></title>
            <description><![CDATA[<div class="medium-feed-item"><p class="medium-feed-image"><a href="https://blog.stackademic.com/5-python-codes-that-are-surprisingly-just-english-sentences-24d28ad3ac60?source=rss-1274825ba247------2"><img src="https://cdn-images-1.medium.com/max/2600/0*QVKzkVHQ7VJiGqzQ" width="14467"></a></p><p class="medium-feed-snippet">Link for non medium member: Click here</p><p class="medium-feed-link"><a href="https://blog.stackademic.com/5-python-codes-that-are-surprisingly-just-english-sentences-24d28ad3ac60?source=rss-1274825ba247------2">Continue reading on Stackademic »</a></p></div>]]></description>
            <link>https://blog.stackademic.com/5-python-codes-that-are-surprisingly-just-english-sentences-24d28ad3ac60?source=rss-1274825ba247------2</link>
            <guid isPermaLink="false">https://medium.com/p/24d28ad3ac60</guid>
            <category><![CDATA[python]]></category>
            <category><![CDATA[programming]]></category>
            <category><![CDATA[syntax]]></category>
            <category><![CDATA[english]]></category>
            <dc:creator><![CDATA[Astry Citrasari]]></dc:creator>
            <pubDate>Thu, 21 Aug 2025 07:02:49 GMT</pubDate>
            <atom:updated>2026-05-05T03:49:48.333Z</atom:updated>
        </item>
        <item>
            <title><![CDATA[Alteryx Dynamic Excel Reading Using Batch Macro]]></title>
            <link>https://medium.com/@astrycitrasari/alteryx-dynamic-excel-reading-using-batch-macro-819512d2a175?source=rss-1274825ba247------2</link>
            <guid isPermaLink="false">https://medium.com/p/819512d2a175</guid>
            <category><![CDATA[user-interface]]></category>
            <category><![CDATA[batch-processing]]></category>
            <category><![CDATA[macro]]></category>
            <category><![CDATA[alteryx]]></category>
            <category><![CDATA[automation]]></category>
            <dc:creator><![CDATA[Astry Citrasari]]></dc:creator>
            <pubDate>Fri, 13 Dec 2024 10:12:59 GMT</pubDate>
            <atom:updated>2024-12-13T10:12:59.872Z</atom:updated>
            <content:encoded><![CDATA[<p>Alteryx provides an easy way to digest data from several data source. The Input Data Tools and Dynamic Input Tools are reliable for ingest data into Alteryx. However, after facing various kind of data source, I find there are some limitation of these 2 tools. It force me to explore more for creating batch macro for my business cases.</p><h4><strong>Input Data Tools and Dynamic Input Limitation</strong></h4><p>Before explaining my batch macro, I would like to elaborate more limitation of the tools. In my business case, I highly use Ms Excel with several worksheet as an input. Below is the limitation</p><ol><li>Handling Different Template Across Worksheet in one Excel Files</li></ol><p>Dynamic input tool is able to read every worksheet in one Excel Files. Then we can create batch macro to iterate every excel file. <strong>Unfortunately, the Dynamic Input Tool only able to handle data with the same number of column in every worksheet. </strong>Meanwhile, every worksheet might have different number of column.</p><p>As seen in below picture, I upload one excel file with 3 different template worksheets. In the result picture, the last 2 worksheets is skipped because the number of column is not the same as the first worksheet.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/957/1*x1Y3b_BAfvvxKsMbsS85HA.png" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*uU3KvTdsIKbA2sWO0A5TCQ.png" /></figure><p>2. Standalone Data Input Tool Always Demand Data Template</p><p>Alteryx Data Input Tool is very rigid and will throw error once the data source is not the same as the data input during development. Start from the column name or worksheet name (If we configure it with the specific worksheet name).</p><p>In my recent business case, I need to make input become very flexible in term of Excel Files, Worksheet data and Worksheet Name.</p><h4><strong>Batch Macro to Input Varied Excel File</strong></h4><ol><li>Using Batch Macro to Handle Different Template Across Worksheet in one Excel Files</li></ol><p>As Dynamic Input Tool alone is not able to handle different template, it is good to create macro which contain Dynamic Input Tool, this tool will read the each worksheet then send it as output <strong>before</strong> processing the next worksheet name.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/485/1*7LJCdjmzC7_FlZnKN_3EtA.png" /></figure><p>Macro input is stated as below, it will be changed/iterate based on the main workflow</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*v0m7sCWlbBoiqhxL5NIhXQ.png" /><figcaption>Macro Input</figcaption></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/793/1*7Csct-1wtTfvQvpdkYFh4w.png" /><figcaption>Adding Sheetname in Append Tools</figcaption></figure><p>The append tools works a mark of each row to inform this row coming from which worksheet name.</p><p>Another key takeaway here is the properties of the output. <strong>We can find it in Interface Designer — Settings, then Click “Auto Configure by Position”. This will let any kind of template pass to the output macro.</strong></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/681/1*Eris3JtpcN5PxfMDFFjDmA.png" /></figure><p>2. Using Interface Inside Batch Macro</p><p>Lets call the macro from point #1 as “ReadEachSheetName” Macro. This macro need another workflow to start iterate the worksheet name. I create another batch macro name Excel File Dynamic Input with input as a File Browser and it will feed filename and sheet name into ReadEachSheetName below.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/855/1*TaBa8ieD0m3nZDw0KhcaHA.png" /><figcaption>Interface UI as an input</figcaption></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*LkHdW6Sskrxo-CfAoONi-Q.png" /><figcaption>Input for ReadEachSheetName Macro</figcaption></figure><p>The key here is make the input as dynamic as possible started from the template, then the worksheet name. This way it will take whatever data feed via Interface UI.</p><p>In the main workflow, we can select dynamic file to be fed to Excel File Dynamic Input Macro. So if we have another input need to feed it, it will be easily to add (this one I will explain in another article, and also the reason why I created the “Excel File Dynamic Input” Macro that way</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/482/1*ZWbtG2ToSP4k0Rf0j6V6LA.png" /><figcaption>Main Workflow</figcaption></figure><p>Hopes this dynamic input helps to make your input more flexible</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=819512d2a175" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Run Javascript from Webpage — Power Automate Desktop]]></title>
            <link>https://blog.stackademic.com/run-javascript-from-webpage-power-automate-desktop-3144a731027f?source=rss-1274825ba247------2</link>
            <guid isPermaLink="false">https://medium.com/p/3144a731027f</guid>
            <category><![CDATA[rpa-solutions]]></category>
            <category><![CDATA[javascript]]></category>
            <category><![CDATA[rpa-tools]]></category>
            <category><![CDATA[power-automate-desktop]]></category>
            <category><![CDATA[css]]></category>
            <dc:creator><![CDATA[Astry Citrasari]]></dc:creator>
            <pubDate>Sat, 10 Aug 2024 08:56:54 GMT</pubDate>
            <atom:updated>2024-11-01T07:35:20.597Z</atom:updated>
            <content:encoded><![CDATA[<h3>Run Javascript from Webpage — Power Automate Desktop</h3><p>Power Automate Desktop (PAD) has been widely used for RPA in current industry. Providing RPA with various connector and easily connect with all Microsoft product (ex : Sharepoint, Outlook, etc).</p><p>Browser automation is one of the most task benefitted from PAD. This automation consist of Web Data Extraction and Web Form Filling. In the beginning, I questioned about Web Data Extraction in PAD,</p><p><em>“Why we need such fancy tools like PAD for Web Data Extraction, we can just use Selenium in Python. It’s open source and easy to operate”</em></p><p>That’s until I worked upon website which has Dynamic UI element and the complicated one. I worked with SAP Business ByDesign and I can tell you, I have no idea how complicated the UI element of it. Using recorder menu of PAD alone is not enough, in some extent I need to use “Run Javascript from Webpage”</p><p>I will use example website from RPAchallenge.com . This website is widely use for RPA learning. Below is the main page of website.</p><p><a href="https://rpachallenge.com/">Rpa Challenge</a></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*dnvdt2p9AoO4Z3uvVyDbTw.png" /></figure><p>At this example, I will use actions from Web Form Filling menu in PAD and write down step by step in point.</p><h3><strong>1. Inspect the element of “Company Name” field</strong></h3><p>Inspect element is the most important thing. A knowledge on basic HTML is required to read the UI element.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*VzKECDysiNjJlDrtxr94bQ.png" /></figure><p>on the right pane, we can see &lt;label&gt; and &lt;input&gt; element. At &lt;label&gt; we can see those text name which define what is the field for and at &lt;input&gt; we can identified which field id and name to fill in the Company Name.</p><p>In this website, &lt;input&gt; id and name will be changed every time the webpage is refresh. Thus, I can’t just put the id and name as it is shown now. Below is the element stored in PAD and I need to change the selector there by using Text Editor pane and activating it from the right upper switch.</p><h3><strong>2. Using PAD UI Element selectors</strong></h3><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*bLfHuDIyO5g65baO37C8Nw.png" /></figure><p>from the UI element inspection, we can see that &lt;label&gt; and &lt;input&gt; is fall under the same &lt;div&gt;. Then there is a name that is directly referring to Company Name which is [ng-reflect-name]. This one is then a simple one, we just need to change the selector as below :</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*Mqgr5MijuENCk2a48ho5oA.png" /></figure><pre>input[ng-reflect-name=&quot;labelCompanyName&quot;]</pre><p>If you’re not really sure whether your selector already pointing to the correct element, you can click test on the above pane.</p><p>Action “Populate text field on web page” is used to populate company name fill in to form, for example I will key in “RPA Group” as Company Name</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/778/1*5Mld2G3jbgTc2_zbwe1pZw.png" /></figure><h3><strong>3. Using “Run Javascript function for Webpage” in PAD</strong></h3><p>As we already get the correct UI element and we want to develop more robust fill in form, you can use action “Run Javascript function for Webpage”. I suggest added enter value and unfocus text box to add finishing touch on the action.</p><pre>function ExecuteScript() {<br>    // Adjust the selector to target within a specific parent container if needed<br>    let input =document.querySelector(&#39;input[ng-reflect-name=&quot;labelCompanyName&quot;]&#39;);<br>    if (input) {<br>        input.value = &quot;RPA Group&quot;;<br>        input.dispatchEvent(new Event(&#39;input&#39;, { bubbles: true }));<br>        input.dispatchEvent(new Event(&#39;change&#39;, { bubbles: true }));<br><br>        // Dispatch &#39;Enter&#39; key event<br>        let enterEvent = new KeyboardEvent(&#39;keydown&#39;, {<br>            bubbles: true,<br>            cancelable: true,<br>            key: &#39;Enter&#39;,<br>            code: &#39;Enter&#39;,<br>            keyCode: 13,<br>            which: 13<br>        });<br>        input.dispatchEvent(enterEvent);<br><br>        // Unfocus the text box<br>        input.blur();<br>    } else {<br>        console.log(&quot;The input field was not found&quot;);<br>    }<br>}</pre><figure><img alt="" src="https://cdn-images-1.medium.com/max/765/1*r1e8X-T-9fBLraG14Q-v5w.png" /></figure><p>Key in the correct UI element into variable “input” and key in the company name value in “input.value” variable. This is telling the PAD to search for the element and fill in “RPA Group” in the website field.</p><h3>4. Overall looks on PAD</h3><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*DUc-dGl-FEWLFtyl_I0utg.png" /></figure><p>Above picture is the steps of fill in company name in the RPA Challenge website. You can use either one of the action as it is enough for the fill in one field. You can use the same action and change the UI element for other field in the website.</p><h3>5. Example on Advanced Dynamic UI Element</h3><p>Example on point 1–4 is quite simple. I will create dummy Dynamic UI Element as below</p><pre>&lt;rpa1-field _ngcontent-c1=&quot;&quot; _nghost-c2=&quot;&quot; ng-reflect-id=&quot;KkXiF&quot; ng-reflect-dictionary-value=&quot;Company Name&quot; ng-reflect-label=&quot;labelCompanyName&quot; ng-reflect-parent-form-group=&quot;[object Object]&quot;&gt;<br>&lt;div class=&quot;ng-invalid cluster01&quot;&gt;<br>  &lt;div _ngcontent-c2=&quot;&quot; ng-reflect-form=&quot;[object Object]&quot; class=&quot;ng-invalid ng-touched ng-dirty&quot;&gt;<br>    &lt;label _ngcontent-c2=&quot;&quot;&gt;Company Name&lt;/label&gt;<br>  &lt;/div&gt;<br>  &lt;div _ngcontent-c2=&quot;&quot; ng-reflect-form=&quot;[object Object]&quot; class=&quot;ng-invalid ng-touched ng-textwrapper&quot;&gt;<br>    &lt;input _ngcontent-c2=&quot;&quot; ng-reflect-name=&quot;text&quot; id=&quot;KkXiF&quot; name=&quot;KkXiF&quot; class=&quot;ng-touched ng-dirty ng-valid&quot; style=&quot;background-image: url(https://medium.com/&amp;quot;data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAABAAAAAQCAYAAAAf8/9hAAABHklEQVQ4EaVTO26DQBD1ohQWaS2lg9JybZ+AK7hNwx2oIoVf4UPQ0Lj1FdKktevIpel8AKNUkDcWMxpgSaIEaTVv3sx7uztiTdu2s/98DywOw3Dued4Who/M2aIx5lZV1aEsy0+qiwHELyi+Ytl0PQ69SxAxkWIA4RMRTdNsKE59juMcuZd6xIAFeZ6fGCdJ8kY4y7KAuTRNGd7jyEBXsdOPE3a0QGPsniOnnYMO67LgSQN9T41F2QGrQRRFCwyzoIF2qyBuKKbcOgPXdVeY9rMWgNsjf9ccYesJhk3f5dYT1HX9gR0LLQR30TnjkUEcx2uIuS4RnI+aj6sJR0AM8AaumPaM/rRehyWhXqbFAA9kh3/8/NvHxAYGAsZ/il8IalkCLBfNVAAAAABJRU5ErkJggg==&amp;quot;); background-repeat: no-repeat; background-attachment: scroll; background-size: 16px 18px; background-position: 98% 50%; cursor: auto;&quot;&gt;<br>  &lt;/div&gt;<br> &lt;/div&gt;<br>&lt;/rpa1-field&gt;</pre><p>above example, &lt;label&gt; and &lt;input&gt; have different &lt;div&gt; but have same parent &lt;div class=”ng-invalid cluster01&quot;&gt; and [ng-reflect-name] is not specifically mentioned Company Name label.</p><p>at this point the Selector and Javasript in PAD need a little more adjustment</p><pre>div:has(label:contains(&quot;Company Name&quot;))[class=&quot;ng-invalid cluster01&quot;] div[class=&quot;ng-invalid ng-touched ng-textwrapper&quot;] input[ng-reflect-name=&quot;text&quot;]</pre><p>We need to find label contains field name, in this case “Company Name” then searching above the HTML for parent &lt;div&gt; which is [class=”ng-invalid cluster01&quot;]. Afterwards, searching down again until the &lt;div&gt; class where the &lt;input&gt; located.</p><pre>function ExecuteScript() {<br>    // Adjust the selector to target within a specific parent container if needed<br>    let input =document.querySelectorAll(&#39;input[ng-reflect-name=&quot;text&quot;]&#39;);<br>    if (input) {<br>        input[0].value = &quot;RPA Group&quot;;<br>        input[0].dispatchEvent(new Event(&#39;input&#39;, { bubbles: true }));<br>        input[0].dispatchEvent(new Event(&#39;change&#39;, { bubbles: true }));<br><br>        // Dispatch &#39;Enter&#39; key event<br>        let enterEvent = new KeyboardEvent(&#39;keydown&#39;, {<br>            bubbles: true,<br>            cancelable: true,<br>            key: &#39;Enter&#39;,<br>            code: &#39;Enter&#39;,<br>            keyCode: 13,<br>            which: 13<br>        });<br>        input[0].dispatchEvent(enterEvent);<br><br>        // Unfocus the text box<br>        input[0].blur();<br>    } else {<br>        console.log(&quot;The input field was not found&quot;);<br>    }<br>}</pre><p>If you want to keep using Javascript, adding number after the input ( input[0].value = “RPA Group” ;). For the context, let’s make Company Name field in the first sequence so we put [0] as it is the first sequence in HTML.</p><p>Useful Youtube channel for learning more about selector</p><iframe src="https://cdn.embedly.com/widgets/media.html?src=https%3A%2F%2Fwww.youtube.com%2Fembed%2FcgK_BH1gBzc%3Fstart%3D5280%26feature%3Doembed%26start%3D5280&amp;display_name=YouTube&amp;url=https%3A%2F%2Fwww.youtube.com%2Fwatch%3Fv%3DcgK_BH1gBzc&amp;image=https%3A%2F%2Fi.ytimg.com%2Fvi%2FcgK_BH1gBzc%2Fhqdefault.jpg&amp;key=a19fcc184b9711e1b4764040d3dc5c07&amp;type=text%2Fhtml&amp;schema=youtube" width="854" height="480" frameborder="0" scrolling="no"><a href="https://medium.com/media/983b24cccdcd4398b91d675badda5057/href">https://medium.com/media/983b24cccdcd4398b91d675badda5057/href</a></iframe><iframe src="https://cdn.embedly.com/widgets/media.html?src=https%3A%2F%2Fwww.youtube.com%2Fembed%2FD7sNpAiNMQM%3Fstart%3D293%26feature%3Doembed%26start%3D293&amp;display_name=YouTube&amp;url=https%3A%2F%2Fwww.youtube.com%2Fwatch%3Fv%3DD7sNpAiNMQM&amp;image=https%3A%2F%2Fi.ytimg.com%2Fvi%2FD7sNpAiNMQM%2Fhqdefault.jpg&amp;key=a19fcc184b9711e1b4764040d3dc5c07&amp;type=text%2Fhtml&amp;schema=youtube" width="854" height="480" frameborder="0" scrolling="no"><a href="https://medium.com/media/85ab3f3ddaeb2e718bd5d64f4a0208a5/href">https://medium.com/media/85ab3f3ddaeb2e718bd5d64f4a0208a5/href</a></iframe><h3>Stackademic 🎓</h3><p>Thank you for reading until the end. Before you go:</p><ul><li>Please consider <strong>clapping</strong> and <strong>following</strong> the writer! 👏</li><li>Follow us <a href="https://twitter.com/stackademichq"><strong>X</strong></a> | <a href="https://www.linkedin.com/company/stackademic"><strong>LinkedIn</strong></a> | <a href="https://www.youtube.com/c/stackademic"><strong>YouTube</strong></a> | <a href="https://discord.gg/in-plain-english-709094664682340443"><strong>Discord</strong></a></li><li>Visit our other platforms: <a href="https://plainenglish.io/"><strong>In Plain English</strong></a> | <a href="https://cofeed.app/"><strong>CoFeed</strong></a> | <a href="https://differ.blog/"><strong>Differ</strong></a></li><li>More content at <a href="https://stackademic.com/"><strong>Stackademic.com</strong></a></li></ul><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=3144a731027f" width="1" height="1" alt=""><hr><p><a href="https://blog.stackademic.com/run-javascript-from-webpage-power-automate-desktop-3144a731027f">Run Javascript from Webpage — Power Automate Desktop</a> was originally published in <a href="https://blog.stackademic.com/">Stackademic</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Chat GPT tells story about : Conventional Automation vs. Intelligent Automation]]></title>
            <link>https://blog.stackademic.com/chat-gpt-tells-story-about-conventional-automation-vs-intelligent-automation-332566412516?source=rss-1274825ba247------2</link>
            <guid isPermaLink="false">https://medium.com/p/332566412516</guid>
            <category><![CDATA[data-automation]]></category>
            <category><![CDATA[chatgpt]]></category>
            <category><![CDATA[automation]]></category>
            <dc:creator><![CDATA[Astry Citrasari]]></dc:creator>
            <pubDate>Wed, 26 Jun 2024 06:31:41 GMT</pubDate>
            <atom:updated>2024-08-12T00:36:28.096Z</atom:updated>
            <content:encoded><![CDATA[<h3>Chat GPT tells the story about <strong>Conventional Automation vs. Intelligent Automation</strong></h3><p>Automation has become an integral part of modern business operations, helping to improve efficiency, reduce errors, and cut costs. There are two primary types of automation: conventional automation and intelligent automation. While both aim to streamline processes, they differ significantly in their capabilities, applications, and underlying technologies.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*DKzyYFUu-j5EBKJC" /><figcaption>Photo by <a href="https://unsplash.com/@homaappliances?utm_source=medium&amp;utm_medium=referral">Homa Appliances</a> on <a href="https://unsplash.com/?utm_source=medium&amp;utm_medium=referral">Unsplash</a></figcaption></figure><p><strong>1. Definition and Scope</strong></p><p><strong>a. Conventional Automation</strong></p><p>Conventional automation, often referred to as traditional or rule-based automation, involves the use of predefined rules and scripts to automate repetitive, routine tasks. It typically relies on structured data and deterministic processes.</p><ul><li><strong>Technologies Used</strong>: Robotic Process Automation (RPA), macros, scripting languages (e.g., Python, VBA).</li><li><strong>Applications</strong>: Data entry, transaction processing, report generation, simple workflow automation.</li></ul><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*9B60hRm2-xJ9xP1g" /><figcaption>Photo by <a href="https://unsplash.com/@possessedphotography?utm_source=medium&amp;utm_medium=referral">Possessed Photography</a> on <a href="https://unsplash.com/?utm_source=medium&amp;utm_medium=referral">Unsplash</a></figcaption></figure><p><strong>b. Intelligent Automation</strong></p><p>Intelligent automation, also known as cognitive automation or hyper-automation, combines traditional RPA with advanced technologies such as artificial intelligence (AI), machine learning (ML), natural language processing (NLP), and cognitive computing. This enables the automation of more complex, decision-based tasks.</p><ul><li><strong>Technologies Used</strong>: AI, ML, NLP, computer vision, chatbots, advanced analytics.</li><li><strong>Applications</strong>: Customer service (chatbots), fraud detection, predictive maintenance, sentiment analysis, complex decision-making processes.</li></ul><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*g9Z04CX_Xm7CZgEF" /><figcaption>Photo by <a href="https://unsplash.com/@owenbeard?utm_source=medium&amp;utm_medium=referral">Owen Beard</a> on <a href="https://unsplash.com/?utm_source=medium&amp;utm_medium=referral">Unsplash</a></figcaption></figure><p><strong>2. Capabilities and Features</strong></p><p><strong>a. Conventional Automation</strong></p><ul><li><strong>Rule-Based Processing</strong>: Executes tasks based on predefined rules and conditions.</li><li><strong>Structured Data</strong>: Works effectively with structured data formats (e.g., databases, spreadsheets).</li><li><strong>Repetitive Tasks</strong>: Ideal for repetitive, high-volume tasks with little variation.</li><li><strong>Limited Adaptability</strong>: Cannot handle exceptions or changes in process without manual intervention.</li></ul><p><strong>b. Intelligent Automation</strong></p><ul><li><strong>Decision-Making</strong>: Uses AI and ML to make decisions based on data analysis and patterns.</li><li><strong>Unstructured Data</strong>: Can process unstructured data such as text, images, and audio.</li><li><strong>Learning and Adaptation</strong>: Continuously learns from data and adapts to new scenarios and changes.</li><li><strong>Complex Processes</strong>: Capable of automating complex, end-to-end business processes that involve judgment and variability.</li></ul><p><strong>3. Implementation and Integration</strong></p><p><strong>a. Conventional Automation</strong></p><ul><li><strong>Implementation Time</strong>: Generally quicker to implement due to its rule-based nature.</li><li><strong>Integration</strong>: Easier to integrate with existing systems and workflows.</li><li><strong>Maintenance</strong>: Requires regular updates and maintenance to handle changes in the underlying processes.</li></ul><p><strong>b. Intelligent Automation</strong></p><ul><li><strong>Implementation Time</strong>: Longer implementation time due to the need for training AI models and setting up advanced systems.</li><li><strong>Integration</strong>: More complex integration, often requiring changes to existing IT infrastructure.</li><li><strong>Maintenance</strong>: Needs continuous monitoring and updating of AI models to ensure accuracy and relevance.</li></ul><p><strong>4. Benefits and Challenges</strong></p><p><strong>a. Conventional Automation</strong></p><ul><li><strong>Benefits</strong>:</li><li>Increases efficiency and reduces manual effort for repetitive tasks.</li><li>Decreases error rates and improves accuracy.</li><li>Provides quick return on investment (ROI).</li><li><strong>Challenges</strong>:</li><li>Limited to rule-based tasks.</li><li>Inflexible in handling process variations or exceptions.</li><li>Requires significant effort to update and maintain scripts.</li></ul><p><strong>b. Intelligent Automation</strong></p><ul><li><strong>Benefits</strong>:</li><li>Automates complex tasks involving decision-making and unstructured data.</li><li>Enhances operational efficiency and effectiveness.</li><li>Improves customer experience through personalized interactions and faster service.</li><li><strong>Challenges</strong>:</li><li>Higher initial investment and longer implementation time.</li><li>Requires specialized skills for AI and ML model development.</li><li>Continuous monitoring and model updating are essential to maintain performance.</li></ul><p><strong>5. Use Cases</strong></p><p><strong>a. Conventional Automation</strong></p><ul><li><strong>Data Entry and Migration</strong>: Automating data transfer between systems or updating databases.</li><li><strong>Invoice Processing</strong>: Automating the extraction and entry of invoice data into accounting systems.</li><li><strong>Payroll Processing</strong>: Automating the calculation and distribution of employee salaries.</li></ul><p><strong>b. Intelligent Automation</strong></p><ul><li><strong>Customer Support</strong>: Using chatbots to handle customer inquiries and provide support.</li><li><strong>Fraud Detection</strong>: Analyzing transaction patterns to detect and prevent fraudulent activities.</li><li><strong>Predictive Maintenance</strong>: Using IoT data and predictive analytics to schedule maintenance before failures occur.</li><li><strong>Document Processing</strong>: Automating the extraction, classification, and processing of information from unstructured documents.</li></ul><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*a7RQMXI-aBrDrZ4N" /><figcaption>Photo by <a href="https://unsplash.com/@firmbee?utm_source=medium&amp;utm_medium=referral">Firmbee.com</a> on <a href="https://unsplash.com/?utm_source=medium&amp;utm_medium=referral">Unsplash</a></figcaption></figure><p><strong>Conclusion</strong></p><p>Conventional automation and intelligent automation serve different purposes and are suitable for different types of tasks. While conventional automation is excellent for automating repetitive, rule-based tasks, intelligent automation is designed to handle more complex processes that require decision-making and the ability to process unstructured data. Organizations can benefit from leveraging both types of automation, depending on their specific needs and the complexity of their processes.</p><p>— — — — — — —</p><h3>Stackademic 🎓</h3><p>Thank you for reading until the end. Before you go:</p><ul><li>Please consider <strong>clapping</strong> and <strong>following</strong> the writer! 👏</li><li>Follow us <a href="https://twitter.com/stackademichq"><strong>X</strong></a> | <a href="https://www.linkedin.com/company/stackademic"><strong>LinkedIn</strong></a> | <a href="https://www.youtube.com/c/stackademic"><strong>YouTube</strong></a> | <a href="https://discord.gg/in-plain-english-709094664682340443"><strong>Discord</strong></a></li><li>Visit our other platforms: <a href="https://plainenglish.io/"><strong>In Plain English</strong></a> | <a href="https://cofeed.app/"><strong>CoFeed</strong></a> | <a href="https://differ.blog/"><strong>Differ</strong></a></li><li>More content at <a href="https://stackademic.com/"><strong>Stackademic.com</strong></a></li></ul><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=332566412516" width="1" height="1" alt=""><hr><p><a href="https://blog.stackademic.com/chat-gpt-tells-story-about-conventional-automation-vs-intelligent-automation-332566412516">Chat GPT tells story about : Conventional Automation vs. Intelligent Automation</a> was originally published in <a href="https://blog.stackademic.com/">Stackademic</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Choose The Perfect Python PDF Library for Your Business Case]]></title>
            <link>https://blog.stackademic.com/choose-the-perfect-python-pdf-library-for-your-business-case-6116941bf01e?source=rss-1274825ba247------2</link>
            <guid isPermaLink="false">https://medium.com/p/6116941bf01e</guid>
            <category><![CDATA[python]]></category>
            <category><![CDATA[ocr]]></category>
            <category><![CDATA[alteryx]]></category>
            <category><![CDATA[image-processing]]></category>
            <category><![CDATA[pymupdf]]></category>
            <dc:creator><![CDATA[Astry Citrasari]]></dc:creator>
            <pubDate>Mon, 12 Feb 2024 03:44:16 GMT</pubDate>
            <atom:updated>2024-02-13T02:01:25.251Z</atom:updated>
            <content:encoded><![CDATA[<p>As we know, Python provides several libraries to work with PDF. Determining a suitable Python PDF library for your business case is important to minimize our effort in data cleaning.</p><p>I have worked with 2 PDF libraries with 3 unique purposes. First, PyMuPDF has a lot of capabilities. I used this library for extracting text data and extracting pictures from PDFs. Second, Tabula which is perfect for extracting table format data.</p><h4>Business Case 1: Extracting Plain Text from PDF</h4><p>Extracting text data from PDF is a common practice to get information such as Address, Bank Account Number, Product Item List, etc. This practice can be done manually by copy paste the information one by one from PDF to our end (it can be in Ms. Word/Ms. Excel). With the help of PyMuPDF Library, this task can be done in more efficient way.</p><p>PyMuPDF library comes with a lot of capabilities, for details capabilities, it is stated in PyMuPDF Documentation in the link below.</p><p><a href="https://pymupdf.readthedocs.io/en/latest/">PyMuPDF 1.26.3 documentation</a></p><p>This article will explore the PDF Reader and read into Alteryx:</p><pre>#import library<br>from ayx import Alteryx<br><br>import win32com.client as win32<br>import pandas as pd<br>import numpy as np<br>import os<br>import sys, pathlib<br><br>#this library for PyMuPDF<br>import fitz</pre><p>reading PDF filename:</p><pre>#manually put PDF Filename<br>filename = r&quot;C:\Letter02.pdf&quot;<br>filename</pre><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*U6-kRkvd1jTlEHD3z9fIFA.png" /><figcaption>PDF File to Extract</figcaption></figure><p>reading text data from PDF:</p><pre>doc = fitz.open(filename)<br>doc</pre><pre>fname = sys.argv[1]  # get document filename<br><br>with fitz.open(filename) as doc:  # open document<br>    text = chr(12).join([page.get_text() for page in doc])<br></pre><p>We store the data into a “text” string variable, we can check the data and data type below:</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/882/1*BcMkpJx3kTd98FfaxslJ1Q.png" /></figure><p>Before exporting the data into Alteryx, Data needs to be converted into Pandas Dataframe. Meanwhile, our data type now is in string type, we can’t directly put the string into Dataframe. Thus, we need to change the type into Series as below and then create a Dataframe.</p><pre>#change data type<br>text = pd.Series(text)<br>filename = pd.Series(filename)<br><br>#create dataframe<br>d3 = {&#39;filename&#39;:filename, &#39;PDF_Text&#39;:text}<br>df_out3 = pd.DataFrame(d3)<br><br>df_out3<br>Alteryx.write(df_out3,2)</pre><figure><img alt="" src="https://cdn-images-1.medium.com/max/698/1*SzJAF2beIYzs2Lr5RUfIZA.png" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/810/1*dHMHghjKZUjjK9YAIrx0zQ.png" /><figcaption>Clean Result in Alteryx</figcaption></figure><h4>Business Case 2: Extracting Tabular Text from PDF</h4><p>We found PDF with tabular data in the PDF, in this case, Tabula library is the most suitable library to work with. I have explained this library in my other article below</p><p><a href="https://medium.com/@astryeka/alteryx-python-tools-to-extract-text-from-searchable-pdf-8a8b6751b666">Alteryx Python Tools to Extract Text from Searchable PDF</a></p><p>Please kindly elaborate on the article if you need to solve such cases</p><h4>Business Case 3: Getting Picture from PDF</h4><p>There is a drawback when we try to extract text from PDF, it is only applicable for searchable PDF or PDF which can be copied and pasted manually. In some cases, we found PDFs with scanned images. It will OCR (Optical Character Recognition) to extract the text. If we still using open-source OCR such as Open-CV, then we clearly need to convert PDF into an image first.</p><p>The code is not really complicated, once we have the doc stored in Python, we can run the below code</p><pre>for page in doc:  # iterate through the pages<br>    pix = page.get_pixmap()  # render page to an image<br>    pix.save(r&quot;save_from_PyMuPDF.png&quot;)  # store image as a PNG</pre><figure><img alt="" src="https://cdn-images-1.medium.com/max/612/1*r_jVqKCrtG8rfjrHmoWZmA.png" /><figcaption>Image Result from PyMuPDF</figcaption></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/706/1*GVqLg7ntpVNPXpcniKlKuw.png" /><figcaption>Image Saved from PyMuPDF</figcaption></figure><p>Now, our data is ready for OCR using Open CV</p><p>These are several business cases that can be done to help you become more efficient in data mining from PDF.</p><h3>Stackademic</h3><p>Thank you for reading until the end. Before you go:</p><ul><li>Please consider <strong>clapping</strong> and <strong>following</strong> the writer! 👏</li><li>Follow us <a href="https://twitter.com/stackademichq"><strong>X</strong></a><strong> | </strong><a href="https://www.linkedin.com/company/stackademic"><strong>LinkedIn</strong></a><strong> | </strong><a href="https://www.youtube.com/c/stackademic"><strong>YouTube</strong></a><strong> | </strong><a href="https://discord.gg/in-plain-english-709094664682340443"><strong>Discord</strong></a></li><li>Visit our other platforms: <a href="https://plainenglish.io/"><strong>In Plain English</strong></a><strong> | </strong><a href="https://cofeed.app/"><strong>CoFeed</strong></a><strong> | </strong><a href="https://venturemagazine.net/"><strong>Venture</strong></a></li></ul><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=6116941bf01e" width="1" height="1" alt=""><hr><p><a href="https://blog.stackademic.com/choose-the-perfect-python-pdf-library-for-your-business-case-6116941bf01e">Choose The Perfect Python PDF Library for Your Business Case</a> was originally published in <a href="https://blog.stackademic.com/">Stackademic</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Are You A Data Analyst Or A Data Helpdesk ?]]></title>
            <link>https://medium.com/@astrycitrasari/are-you-a-data-analyst-or-a-data-helpdesk-af5e178ef370?source=rss-1274825ba247------2</link>
            <guid isPermaLink="false">https://medium.com/p/af5e178ef370</guid>
            <category><![CDATA[data-analyst]]></category>
            <category><![CDATA[manager]]></category>
            <category><![CDATA[data-processing]]></category>
            <category><![CDATA[system]]></category>
            <category><![CDATA[work-culture]]></category>
            <dc:creator><![CDATA[Astry Citrasari]]></dc:creator>
            <pubDate>Thu, 01 Feb 2024 09:46:41 GMT</pubDate>
            <atom:updated>2024-02-01T09:46:41.293Z</atom:updated>
            <content:encoded><![CDATA[<h3>Are You A Data Analyst Or A Data Helpdesk ?</h3><h3>A bitter pill I had to swallow as a person handling data and have access to data warehouse in a company.</h3><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*Coq21herh7AlTMk6" /><figcaption>Photo by <a href="https://unsplash.com/@mjessier?utm_source=medium&amp;utm_medium=referral">Myriam Jessier</a> on <a href="https://unsplash.com/?utm_source=medium&amp;utm_medium=referral">Unsplash</a></figcaption></figure><p>As of now, I have been worked for 3 previous company. My current company is my 4th company, the last but not least. From my 3 previous company before, 2 of it were similar to Data Analyst. Yes, I was handling data before it’s too hype.</p><p>The Job Vacation of Data Analyst are all around now, yet only some company hire Data Analyst to really do analysis. Well, no blame on company, as the definition itself is really general.</p><p>Based on my subjectivity experience, I am able to tell which culture that utilize their data team as Data Analyst and Data Helpdesk. <strong><em>I believe no company has intention to make their data team become Data Helpdesk</em></strong>, but some cases appear and suddenly turn Data Analyst into Data Helpdesk. This topic also come out when I read certain posting on LinkedIn, then I realize this is not only my case, this is also somebody’s case.</p><p>Here I will explore which culture that belong to Data Analyst and Data Helpdesk, so that you can be able to change the culture or at least make your job less Data Helpdesk and more to Data Analyst.</p><h4>1. User Interface to Access Data</h4><p>User Interface is important for end-user, so they will become independent in term of getting their own data. Examples for User Interface are Ms. Power BI, Tableau, SAP, or (Maybe) your in-house company Reporting Application. If the User Interface is clear and understandable, End user is able to do self-service for fetching their data.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*6dZFI1-QrYUW9JZv" /><figcaption>Photo by <a href="https://unsplash.com/@claybanks?utm_source=medium&amp;utm_medium=referral">Clay Banks</a> on <a href="https://unsplash.com/?utm_source=medium&amp;utm_medium=referral">Unsplash</a></figcaption></figure><p><em>What Data Analyst Do ?</em></p><p>Data Analyst is the one who developed those reporting, defining KPI needed clearly by business, determining refresh schedule for reporting and put the data into those applications. The development will be based on project recorded nicely in a system. User Acceptance Test must be conducted and User sign off must be documented. In the future, If user would like to add more data/there is issue on the data, they must log change request/incident to make the amendment.</p><p>In addition, Data Analyst also the person who helped translate the meaning of their data presented in User Interface. Giving end-user an insight, clarify any misunderstanding and help business to answer their questions with data.</p><p><em>What Data Helpdesk Do ?</em></p><p>When there is no clear User Interface in company, End user would be overwhelmed. Once that happened, they will likely to reach (of course) Data Team. <strong><em>They will ask any doubt they have and probably will ask you to create report urgently (because you are the one having access to data warehouse, right?)</em></strong>. This is not supposed to be your case, working with data can’t be done urgently. Every single thing must be define clearly, such as the formula, the category and the purpose of each data presented.</p><p>If such cases happened mostly in your majority time of your role. Then, it’s the time to change, make the clear definition for your roles. In addition, this changes will not happen if it’s only you that wants changes. Every part of the company must follow the clear definition of <strong><em>what is Data Team doing in the company ?</em></strong></p><h4>2. Data Source Availability and Data Refresh/Report Updating Process</h4><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*K3lQlAibWtro3sMs" /><figcaption>Photo by <a href="https://unsplash.com/@markusspiske?utm_source=medium&amp;utm_medium=referral">Markus Spiske</a> on <a href="https://unsplash.com/?utm_source=medium&amp;utm_medium=referral">Unsplash</a></figcaption></figure><p>Knowing where your data source located is the important thing to develop User Interface. It will impact on how you transfer the data to your end to be processed and how you are going to create job/task to refresh and updating the data.</p><p><em>How Data Analyst Do?</em></p><p>The perfect source for Data Analyst is Database. However, with so many business case, Database is not always established and it is totally fine. Data Analyst can get data from any source ex: Sharepoint Files, XML/Json Files, ODBC, SAP or even traditional Excel Files. <strong><em>The point is those data sources must be able to automated</em></strong> because you need to develop application that is able to run without your interference on daily basis.</p><p>It is related to data refresh and updating process, Data Analyst need to create stored procedure/function inside database or script to run the job using python, etc. This job will run the data refresh and updating process automatically on schedule. Then, you just need to take action if error happened and the job is not running.</p><p><em>How Data Helpdesk Do ?</em></p><p>Data source location that is not accessible by general system is the one that can be faced by Data Helpdesk. Because of lacking transparency of data source, it is only stored on private folder of employee. Then, Data Helpdesk must request to the person every time report need to updated (this is exhausting to do). The best practice of data should not be depend on one person/employee.</p><p>To avoid this case, we can create one shared folder that is limited access only for those who needed. I believe some data is very confidential that it can’t be stored in public place (such as Salary, Bonus, Private Information of Employee, etc). However, to run the reporting smoothly, the data must be stored somewhere public.</p><h4>3. Reporting Development — Tools for Data Processing</h4><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*IcsJdRyxw4FzfX9j" /><figcaption>Photo by <a href="https://unsplash.com/@homajob?utm_source=medium&amp;utm_medium=referral">Scott Graham</a> on <a href="https://unsplash.com/?utm_source=medium&amp;utm_medium=referral">Unsplash</a></figcaption></figure><p>Let’s try googling “Data Analyst Tools”, the result will be a lot and varied. We can refer to point 1 about the tools of Data Analyst. The common tools are Ms. Power BI and Tableau. Some advanced company build their own in-house reporting tools using advanced programming language such as C#. C++ and Java.</p><p>But tools are just tools, It doesn’t have to be fancy tools. As long as it can fulfill business requirement then it is the perfect tools.</p><p><em>What Tools Data Analyst Use ?</em></p><p>The answer is on the last 2 paragraph. The goals of Data Analyst is established report which accessible by end-user, updating on schedule automatically and reliable data point. If your role already doing this, congratulations, you are on the track.</p><p><em>What Tools Data Helpdesk Use ?</em></p><p>No hate in this part, Ms. Excel is the sole application used by Data Helpdesk. Ms. Excel is really great for preparing report. However, it doesn’t serve the purpose. The practice of Ms. Excel will depend on person/employee to do it frequently on their daily task. Data Helpdesk will be busy to prepare Ms. Excel like this and have no time for analyzing. In addition, Ms. Excel report doesn’t visibility to end-user. The report preparer must send out the data. (<em>Guess who will send out the email? yes, Data Helpdesk</em>)</p><p>Ms. Excel have capabilities such as Macro and ODBC (Open Database Connectivity) to make it more automatic. If your majority time still use Ms. Excel to process the data, exploring these 2 topics will be an advantage.</p><h4>4. Number of Data Team Personnel in the Company</h4><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*XDnLW3uB6-b5Y3Q_" /><figcaption>Photo by <a href="https://unsplash.com/@austindistel?utm_source=medium&amp;utm_medium=referral">Austin Distel</a> on <a href="https://unsplash.com/?utm_source=medium&amp;utm_medium=referral">Unsplash</a></figcaption></figure><p>This one is not only apply to Data Analyst. The knowledge you possess in the company must have a backup. In case of emergency in your personal life, your teammates will be able to back you up and make all task running as usual.</p><p>It is easier to back up Data Analyst job instead of Data Helpdesk job because everything is more automated way. So, let’s prepare your role for such cases.</p><h4>5. Manager Direction</h4><p>Again, all above topics must be directed by manager. If you feel your job more on Data Helpdesk than Data Analyst. It’s time so speak up to your manager/team leader. There is no shame to bring/suggest new culture. The company will thank you if all your great suggestions are implemented.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*2lU8bgw__PFt0rzx" /><figcaption>Photo by <a href="https://unsplash.com/@microsoft365?utm_source=medium&amp;utm_medium=referral">Microsoft 365</a> on <a href="https://unsplash.com/?utm_source=medium&amp;utm_medium=referral">Unsplash</a></figcaption></figure><p>The drawback to keep doing Data Helpdesk is, in the end of the day, you achieve nothing. Because you are doing more in operation thing rather than building strategies on data. Then, <strong><em>people in company starts asking, what is data team impact in company ?</em></strong></p><p>If the answer for above question is because data team help business prepare report in Ms. Excel, then it is wrong. Company must look back why they hire data team in the first place. Mostly in Data Analyst case. As I mentioned in the beginning, Data Analyst definition is general. I believe some older employee will think Data Analysts are the one helping them preparing report for their meeting. It’s not how it supposed to be. <strong><em>Employee must be able to get their own data through reporting tools that have been developed by Data Analyst</em></strong>. Then it is a perfect world for Data Analyst.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*zmkFpMxWqQPeQjnB" /><figcaption>Photo by <a href="https://unsplash.com/@cdc?utm_source=medium&amp;utm_medium=referral">CDC</a> on <a href="https://unsplash.com/?utm_source=medium&amp;utm_medium=referral">Unsplash</a></figcaption></figure><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=af5e178ef370" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Mandatory Simple Knowledge to Survive Data Analyst Roles — Part 2]]></title>
            <link>https://medium.com/@astrycitrasari/mandatory-simple-knowledge-to-survive-data-analyst-roles-part-2-2071b3f4127f?source=rss-1274825ba247------2</link>
            <guid isPermaLink="false">https://medium.com/p/2071b3f4127f</guid>
            <category><![CDATA[integration]]></category>
            <category><![CDATA[data-analyst]]></category>
            <category><![CDATA[knowledge]]></category>
            <category><![CDATA[database]]></category>
            <category><![CDATA[api]]></category>
            <dc:creator><![CDATA[Astry Citrasari]]></dc:creator>
            <pubDate>Fri, 26 Jan 2024 07:53:05 GMT</pubDate>
            <atom:updated>2024-01-26T08:17:11.120Z</atom:updated>
            <content:encoded><![CDATA[<h3>Mandatory Simple Knowledge to Survive Data Analyst Roles — Part 2</h3><h3>Everyone can be a Data Analyst but surviving the role is different story.</h3><p><a href="https://medium.com/@astryeka/mandatory-simple-knowledge-to-survive-data-analyst-roles-part-1-fc096e5e0802">Mandatory Simple Knowledge to Survive Data Analyst Roles — Part 1</a></p><p>If you haven’t checked the Part 1 of this article, please click link above. For this part, I will continue explain No 3 until 5 about the simple knowledge to survive as Data Analyst.</p><ol><li>Network Shared Folder</li><li>Basic Server Management</li><li>Database Configuration</li><li>Integration and Automation Tool</li><li>(Optional) API — Application Programming Interface</li></ol><h3>Brief Explanation</h3><p>This article will explain the surface information of those knowledge. If you would like to understand more about the skills, you must find credible online course (ex : Coursera, Udemy, etc) to learn more.</p><h4>3. Database Configuration</h4><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*L4m-yzzrF1YP2wSh" /><figcaption>Photo by <a href="https://unsplash.com/@jankolar?utm_source=medium&amp;utm_medium=referral">Jan Antonin Kolar</a> on <a href="https://unsplash.com/?utm_source=medium&amp;utm_medium=referral">Unsplash</a></figcaption></figure><p>Most tech and non-tech company starts using database server for storing their data. From this point, they start hire employee to be their Data Team. In early stage of building database, company need a person who is familiar with database architecture. A person who understand the fundamental of Relational Database Management System (RDBMS). In addition, after database has been built, Database Administrator team will handle the database operation.</p><p><strong><em>why is this important for Data Analyst ?</em></strong></p><p>But, don’t worry, the last paragraph is not what Data Analyst do. Data Analyst only need to pay attention how to get themselves into the Databases. As my experience using on-premises Database, there are some ways of authentication mode before we log in to Database and it also depend on which Database provider the company used.</p><p>For On-premises Oracle Database, Database schema is the first information we need to know first before we request to IT Team for access. In a company, there will be dozens of schema and only employee who authorize to see the data will be granted access. After your access request approved, you will be given <strong><em>username and password</em></strong> along with <strong><em>service name</em></strong> and <em>s</em><strong><em>erver name/host</em></strong> where the database is located. (Please see Basic Server Management knowledge in part 1).</p><p>For application tool, there are 2 common tools to access Oracle : Oracle SQL Developer and PL/SQL Developer. Here is the Sign in/Log in UI for both tools.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/661/1*XRR2nawWTrKVqWAJS0MVFA.png" /><figcaption>Oracle SQL Developer. source : <a href="https://stackoverflow.com/questions/34234166/oracle-can-log-into-sqlplus-using-hr-account-but-unable-to-log-in-using-sql-deve">https://stackoverflow.com/questions/34234166/oracle-can-log-into-sqlplus-using-hr-account-but-unable-to-log-in-using-sql-deve</a></figcaption></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/777/1*Ykn5N3sVvHk7pXtMP3uzqw.png" /><figcaption>PL/SQL Developer. Source : <a href="https://incorporatedsapje.weebly.com/pl-sql-developer-oracle-logon.html">https://incorporatedsapje.weebly.com/pl-sql-developer-oracle-logon.html</a></figcaption></figure><p>There is some cases where your devices is not ready to connect to database, even though you already have all information ready to key in. You will still not be able to log in if TNSNAMES.ora file is missing from your config system. Please make sure this .ora file is available in the config folder where your oracle tools is installed. For more clear explanation about TNSNAMES.ora, please check below link :</p><p><a href="https://www.databasestar.com/tnsnames-ora-file/#What_Is_TNSNAMESORA">TNSNAMES.ORA File - The Complete Guide</a></p><p>For On-premises SQL Server Database, Database Server name is the first information you need to have. SQL Server Database is one of Microsoft product, basically the authentication mode can be set into our windows account.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/658/1*bWHjDXMW1HBF8Ikj5KtJMg.png" /><figcaption>SQL Server Log in with Windows Authentication. <a href="https://windows-hexerror.linestarve.com/q/so45940406-logging-into-local-sql-server-instance-with-windows-auth">https://windows-hexerror.linestarve.com/q/so45940406-logging-into-local-sql-server-instance-with-windows-auth</a></figcaption></figure><p>Another authentication for SQL Server is SQL Server Authentication. IT Team will give username and password for you for this type of authentication.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/660/1*XdI9-3z9fUz_GbEOetlCMA.png" /><figcaption>SQL Server Log in with SQL Server Authentication. <a href="https://stackoverflow.com/questions/48094052/sql-server-login-with">https://windows-hexerror.linestarve.com/q/so45940406-logging-into-local-sql-server-instance-with-windows-auth</a></figcaption></figure><h4>4. Integration and Automation Tool</h4><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*VjOTsofOVpgAgPju" /><figcaption>Photo by <a href="https://unsplash.com/@hharritt?utm_source=medium&amp;utm_medium=referral">Hunter Harritt</a> on <a href="https://unsplash.com/?utm_source=medium&amp;utm_medium=referral">Unsplash</a></figcaption></figure><p>Integration and automation is needed to synchronize or transfer data from one data point to another data point which known as Data Integration. Before Data Analyst processing data, data is collecting from several sources. Data sources can be varied and it need integration system to collect it into 1 storage and those task must be automated by system.</p><p>Data Integration and Automation should not be responsible of Data Analyst, Data Engineer team will build and maintain the integration which also called ETL (Extraction, Transformation, and Load).</p><p><strong><em>why is this important for Data Analyst ?</em></strong></p><p>Data Analyst must have understanding</p><ul><li>Source data and destination of data flow (Upstream and downstream data flow)</li><li>Type of data processing (Batch process or real time)</li><li>Frequency of the processing data from source (if it run batch processing)</li></ul><p>I take example of website application in which people will do bank transaction. This application have online database which directly connect to application and storing all transaction data from customer. We call this database as OLTP — Online Transaction Processing. OLTP Database can’t be done and only less employee able to access that. If a lot of employee access the OLTP database, it will affect the performance and make the application slow. Data Analyst will not have access to this database because its function is not for reporting/business intelligence.</p><p>Once data from app is stored in OLTP Database, raw data is transferred into ODS (Operational Data Store) Database. The integration method to synchronize OLTP and ODS is varied and it usually happened in batch processing. It means there will be job/procedure to update data in ODS frequently (ex : every 15 minutes, hourly, 3-hourly). Some reporting can get the data from ODS Database. However, Data Analyst need to deal with complex processing as data in ODS Database is raw and sometimes is not human readable.</p><p>ETL processing usually happened between ODS and the next database that we call DWH — Data Warehouse. Complex processing, cleaning and formatting data is applied to the raw data from ODS and it creates to serve purpose of every end user (Finance, Supply Chain, or Production). The ETL will run lesser than data transfer from OLTP to ODS because it will load big amount of data and calculation. DWH usually run once or twice a day. DWH is the playground of Data Analyst. Data Analyst must fully understood how their DWH works in terms of explaining data behavior in the reporting to the end user. In addition, inconsistency or data loss also can be prevented once Data Analyst understand the bigger picture of data flow.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/947/1*NMvtSil3rkXC5LMN4PM6Dw.png" /><figcaption>Data Integration Flow. <a href="https://streamsets.com/learn/data-integration/">https://streamsets.com/learn/data-integration/</a></figcaption></figure><h4>5. API — Application Programming Interface</h4><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*gZdRODJggkld_4I0" /><figcaption>Photo by <a href="https://unsplash.com/@tamas_tuzeskatai?utm_source=medium&amp;utm_medium=referral">Tamas Tuzes-Katai</a> on <a href="https://unsplash.com/?utm_source=medium&amp;utm_medium=referral">Unsplash</a></figcaption></figure><p>Integration is defines the data move from which data point to destination data point, API is rules how the data move from one to another data point. API is commonly used when application need third party source. For example, data is obtained from external organizations/outside company. API also help to secure the data flow because it can be added into firewall.</p><p><strong><em>why is this important for Data Analyst ?</em></strong></p><p>Data Analyst doesn’t always get data from internal sources. If the analysis getting deeper and larger, dataset from external is needed. For instance, when analysis include the worldwide location, then you must connect into openstreet map API. Another example, extracting data from website, which known as Web Scrapping. API will help Data Analyst to get wider data source.</p><p>API doesn’t always free of use, there is cost for advanced API if we’re going to use it. Company Policy also contributes for the usage of API, some company prohibited external API use for security reason. So, Data Analyst must consult with IT security team for external API usage policy.</p><p>Common API used for data analysis</p><p><a href="https://www.springboard.com/blog/data-science/top-apis-for-data-scientists/">https://www.springboard.com/blog/data-science/top-apis-for-data-scientists/</a></p><p>Those are the additional knowledge to help you survive and grow your role as Data Analyst. Data field have large task and responsibility that is not be able to bear with only 1 single employee to run it all. The best practice for company is to have their Data Engineer and Data Analyst separately, then a whole different IT Infrastructure team to support all the requirement needed from Data team.</p><p>Hopes this help all your journey through become a data expert.</p><p>source :</p><p><a href="https://incorporatedsapje.weebly.com/pl-sql-developer-oracle-logon.html"><em>https://incorporatedsapje.weebly.com/pl-sql-developer-oracle-logon.html</em></a><em><br></em><a href="https://streamsets.com/learn/data-integration/"><em>https://streamsets.com/learn/data-integration/</em></a><em><br></em><a href="https://www.springboard.com/blog/data-science/top-apis-for-data-scientists/"><em>https://www.springboard.com/blog/data-science/top-apis-for-data-scientists/</em></a></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=2071b3f4127f" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Mandatory Simple Knowledge to Survive Data Analyst Roles — Part 1]]></title>
            <link>https://medium.com/@astrycitrasari/mandatory-simple-knowledge-to-survive-data-analyst-roles-part-1-fc096e5e0802?source=rss-1274825ba247------2</link>
            <guid isPermaLink="false">https://medium.com/p/fc096e5e0802</guid>
            <category><![CDATA[shared-folders]]></category>
            <category><![CDATA[information-technology]]></category>
            <category><![CDATA[data]]></category>
            <category><![CDATA[data-analyst]]></category>
            <category><![CDATA[servers]]></category>
            <dc:creator><![CDATA[Astry Citrasari]]></dc:creator>
            <pubDate>Thu, 25 Jan 2024 10:50:28 GMT</pubDate>
            <atom:updated>2024-01-26T08:01:23.348Z</atom:updated>
            <content:encoded><![CDATA[<h3>Mandatory Simple Knowledge to Survive Data Analyst Roles — Part 1</h3><h3>Everyone can be a Data Analyst but surviving the role is different story.</h3><p>Here’s the 5 additional knowledge that help you survive the roles.</p><ol><li>Network Shared Folder</li><li>Basic Server Management</li><li>Database Configuration</li><li>Integration and Automation Tool</li><li>(Optional) API — Application Programming Interface</li></ol><h3>Brief Explanation</h3><p>This article will explain the surface information of those knowledge. If you would like to understand more about the skills, you must find credible online course (ex : Coursera, Udemy, etc) to learn more.</p><p>Before working in data field, I worked as Business Application Support for 7 years. This job helped me learn all of the knowledge but I am not the expert on all the 5 skills. As Application Support, I had to troubleshoot any error from several point of view to get the root cause. Here’s where I acquire those knowledge on surface level.</p><h4>1. Network Shared Folder</h4><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*YohjHhmpQ1ryuaKD" /><figcaption>Photo by <a href="https://unsplash.com/@theshubhamdhage?utm_source=medium&amp;utm_medium=referral">Shubham Dhage</a> on <a href="https://unsplash.com/?utm_source=medium&amp;utm_medium=referral">Unsplash</a></figcaption></figure><p>Before cloud system like One Drive, Sharepoint and AWS File Storage, we have Network File Sharing. The configuration was managed by IT Infrastructure team.</p><p>This kind of storage is not accessible if your device is not connected to Company’s Intranet (VPN). Folder path naming is slightly different to Local Folder path. In local folder, we are familiar with naming “C:\” or “D:\”. For Network Shared Folder usually have alias such as company name, then following with the subfolder.</p><p>Example of Network shared folder naming.</p><pre>Network Folder Name : \\IDBTH03\\fsapac\ <br>Alias Name : \\mycompany.com\\fsapac\</pre><p>End User usually only have access in the specific subfolder and it also can be mapping into your file explorer window. IT Team, sometimes, do the mapping before they handed the device to end user. Once the Network shared folder is mapping into local drive, the path will be similar to local folder path. For below picture, the result path of mapping will be</p><pre>E:\</pre><figure><img alt="" src="https://cdn-images-1.medium.com/max/700/1*LH2xCjID95QrBn1sACNXgQ.png" /></figure><p><strong><em>why is this important for Data Analyst ?</em></strong></p><p>Folder path is where the file is stored, It’s like the address of the file. Data Analyst sometimes need to get the file from either local or network shared folder, mostly from shared folder. Everything will be fine if you run the program/script locally but when it’s running in the server, the script will fail to fetch the file if you don’t specify the address or if you put mapping shared folder address. Using the full path of shared folder is encourage to fetch any file located in it.</p><p>Besides, fetching the file, Data Analyst need to generate output file of finished data processing (most probably in excel file). If your company haven’t using database system, generating output file is necessary. Determining the output file path also important, full path of shared folder is encourage. So, you won’t be mistaken when you don’t find the output in your expected shared folder path. It’s not the processing issue, it’s the output location is not right.</p><p>Some tools like Alteryx or any IDE tools (Pycharm, Visual Studio) are also producing an output after processing the data. Fetching and generating file will be easier with one trick putting “.\” before the file name. This “.\” means the file to fetch/generate is located in the same file as the IDE Tools/Alteryx file located.</p><p>For example is formula for dynamic output FilePath in Alteryx. I put <em>“.\Sales Reconciliation.xlsx”</em> so it means I will generate the files in the current folder I work on the Alteryx. This also help to prevent error once I upload the Alteryx file to the server. The output file will just follow the current location of Alteryx.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/678/1*pHs4l02XGYBGuE5-IT18lg.png" /></figure><h4>2. Basic Server Management</h4><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*-WjIqK7kx1cv0CGX" /><figcaption>Photo by <a href="https://unsplash.com/@imgix?utm_source=medium&amp;utm_medium=referral">imgix</a> on <a href="https://unsplash.com/?utm_source=medium&amp;utm_medium=referral">Unsplash</a></figcaption></figure><p>Server is a hardware that expected to be run 24/7 with minimum disturbance. IT Team have their own team just for maintaining server. Windows and Linux server are the common server used by enterprise company.</p><p>Best practice IT Infrastructure must have 2 server with the same function as the backup. This is goes to run the application which critical for business and can’t be down for even just 1 minutes. For application development wise, there will be Production Server and Testing Server, even the bigger company will also have Development only Server. All this case is the best practice and Server’s price is not cheap, sometimes the smaller company can’t afford those luxury. But, the least is company must have production and testing server separately.</p><p>To login into server, we must have service account dedicated for each server. This service account will run any program/script deployed in the server.</p><p><strong><em>why is this important for Data Analyst?</em></strong></p><p>After finishing your script that you created in local device (your laptop or computer), the script will use widely by end user. We can’t rely on your device only to run the program every now and then, we have to rely on server.</p><p>Server run 24/7 hours to execute any program/script real time as you configured it. Once you run program/script in the server, it’s not your account anymore that is execute program/script, it’s the service account. Therefore, before deployed program/script, we must first grant access the services account to run the program.</p><p>For example, back to the network shared folder, we would like fetch or generate output to shared folder from the server. If the service account doesn’t have access to those particular shared folder, the program/script will fail. Thus, access to the shared folder must be granted to the service account.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*fGTCk-MBGbYLvZVA" /><figcaption>Photo by <a href="https://unsplash.com/@superadmins?utm_source=medium&amp;utm_medium=referral">Sammyayot254</a> on <a href="https://unsplash.com/?utm_source=medium&amp;utm_medium=referral">Unsplash</a></figcaption></figure><p>Above picture is not how we access server, jokes aside. We have remote desktop to access it, or even now we can access it via website for cloud server.</p><p>I will stop the part 1 here, Please find the Part 2 in below link</p><p><a href="https://medium.com/@astryeka/mandatory-simple-knowledge-to-survive-data-analyst-roles-part-2-2071b3f4127f">Mandatory Simple Knowledge to Survive Data Analyst Roles — Part 2</a></p><p>Happy reading.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=fc096e5e0802" width="1" height="1" alt="">]]></content:encoded>
        </item>
    </channel>
</rss>