<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0" xmlns:cc="http://cyber.law.harvard.edu/rss/creativeCommonsRssModule.html">
    <channel>
        <title><![CDATA[IBM DCPE Group - Medium]]></title>
        <description><![CDATA[The views expressed in this publication represent those of the author and not of IBM. - Medium]]></description>
        <link>https://medium.com/ibm-dcpe-group?source=rss----ca16dfbb69a2---4</link>
        <image>
            <url>https://cdn-images-1.medium.com/proxy/1*TGH72Nnw24QL3iV9IOm4VA.png</url>
            <title>IBM DCPE Group - Medium</title>
            <link>https://medium.com/ibm-dcpe-group?source=rss----ca16dfbb69a2---4</link>
        </image>
        <generator>Medium</generator>
        <lastBuildDate>Sat, 21 Nov 2026 12:09:20 GMT</lastBuildDate>
        <atom:link href="https://medium.com/feed/ibm-dcpe-group" rel="self" type="application/rss+xml"/>
        <webMaster><![CDATA[yourfriends@medium.com]]></webMaster>
        <atom:link href="http://medium.superfeedr.com/" rel="hub"/>
        <item>
            <title><![CDATA[IBM | Publication Retirement]]></title>
            <link>https://medium.com/ibm-dcpe-group/ibm-publication-retirement-26d84c6e039c?source=rss----ca16dfbb69a2---4</link>
            <guid isPermaLink="false">https://medium.com/p/26d84c6e039c</guid>
            <dc:creator><![CDATA[Kiefer Hackney]]></dc:creator>
            <pubDate>Tue, 02 Mar 2021 22:14:23 GMT</pubDate>
            <atom:updated>2021-03-02T22:14:23.322Z</atom:updated>
            <content:encoded><![CDATA[<p>Thank you for following the IBM DCPE Group Medium publication. In an effort to bring together IBM technical content for data, data science, AI development, and AI related products, we have migrated the content and writers from IBM DCPE Group to <a href="https://medium.com/ibm-data-ai"><strong>IBM Data and AI</strong></a>. We hope you will follow us there for more great content from your peers and innovators at IBM.</p><p>Follow <a href="https://medium.com/ibm-data-ai"><strong>IBM Data and AI</strong></a> on Medium.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=26d84c6e039c" width="1" height="1" alt=""><hr><p><a href="https://medium.com/ibm-dcpe-group/ibm-publication-retirement-26d84c6e039c">IBM | Publication Retirement</a> was originally published in <a href="https://medium.com/ibm-dcpe-group">IBM DCPE Group</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Build an AI Personal Trainer with IBM Watson Assistant - Part 1]]></title>
            <link>https://medium.com/ibm-dcpe-group/build-an-ai-personal-trainer-with-ibm-watson-assistant-part-1-5bd42c789ae0?source=rss----ca16dfbb69a2---4</link>
            <guid isPermaLink="false">https://medium.com/p/5bd42c789ae0</guid>
            <category><![CDATA[technology]]></category>
            <category><![CDATA[fitness]]></category>
            <category><![CDATA[artificial-intelligence]]></category>
            <category><![CDATA[software-development]]></category>
            <category><![CDATA[self-improvement]]></category>
            <dc:creator><![CDATA[Parker Merritt]]></dc:creator>
            <pubDate>Wed, 29 Jul 2020 19:52:06 GMT</pubDate>
            <atom:updated>2020-07-29T19:52:06.201Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*VWXQLugLUtygOIKzukCGlA.png" /></figure><h4>Quarantine got you feeling the gym rat blues? Get motivated at home by creating a virtual workout advisor with IBM’s flagship conversational AI platform.</h4><p>Staying healthy and fit is a critical habit to build (especially in the midst of a global pandemic). Unfortunately, without the amenities of our everyday fitness routines— lavish community gyms, expert personal trainers, even that one buddy who spends <em>way</em> too much time working out— staying in shape can be a struggle for many.</p><p>But what if you could have 24/7 access to expert-level, on-demand personal training advice, as quickly and easily as sending a text message? Thanks to increasingly sophisticated conversational AI technologies, it’s now possible to build your very own virtual workout advisor in just minutes (even if you have <em>no clue</em> how to code).</p><p>In this tutorial, we’re going to walk through the process of creating an AI personal trainer using IBM’s <strong>Watson Assistant</strong>. With a graphical user interface and intuitive mechanisms for mapping dialogue flows, Watson Assistant is one of the most accessible conversational AI platforms on the market, whether you’re a tech-savvy programmer or an ordinary gym-goer.</p><p>To ensure our bot only gives its users high-quality exercise tips, we’re going to be leveraging the expertise of my friend Stephon Moise, a Florida-based doctor of physical therapy at the helm of <a href="http://www.wise.fitness/"><strong>WISE Fitness</strong></a>. Stephon has created a repository of home workout advice that will serve as the basis for our bot’s Q&amp;A dialogue flow.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/750/1*xRQyYs6Ew905p0QkuuWPAA.gif" /><figcaption>For more WISE Fitness content, check out Stephon’s <a href="https://www.youtube.com/channel/UCqdbkyE9NSx9W8sRTZvtLJA">YouTube channel</a>.</figcaption></figure><h3>Let the training begin!</h3><h4>1. Create an IBM Cloud account.</h4><p>Watson Assistant is one of the many services available on IBM’s <a href="https://www.ibm.com/cloud">public cloud platform</a>, so the first step in creating our chatbot is to sign up and log in.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1000/1*gOARJNB7Ru9JdGrTtOZdtQ.gif" /></figure><h4>2. Check out the Resource List page.</h4><p>This tab will eventually show us the various cloud services we’ve provisioned (including Watson Assistant). Click <em>Create Resource</em> in the upper-right corner.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/900/1*mnzfjXGQVWFK0YboUJTqug.gif" /></figure><blockquote><strong><em>IBM Cloud </em></strong><em>boasts</em><strong><em> </em></strong><em>170+ products &amp; services, with dozens of data management, AI, and analytics applications, so be sure to check out everything the platform has to offer.</em></blockquote><h4>3. Provision a Watson Assistant instance.</h4><p>Search the IBM Cloud Catalog for Watson Assistant, and create an instance free-of-charge with the <em>Lite</em> plan.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/900/1*i1ssHxu8YY2gF2dxV_IcJA.gif" /></figure><h4>4. Create your first assistant.</h4><p>You have the ability to create several assistants within a single instance. After creating your first assistant, provide it with a name and an optional description. Finally, click <em>Create Assistant</em>.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/900/1*kEwp6JBw44-4ptY9rh9vWQ.gif" /></figure><h4>5. Add a Dialog skill.</h4><p>Assistants interact with users through a collection of behaviors called <strong>Skills. </strong>Watson Assistant comes with a library of pre-configured skills for a variety of common enterprise uses cases (customer care, for example). In this tutorial, however, we’ll be creating our own.</p><p>To begin designing our bot’s conversational abilities, click <em>Add dialog skill</em>.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/900/1*VHZGiMZ_2u__LbO3qy4lAw.gif" /></figure><blockquote><strong><em>Watson Assistant’s dialog skill is comprised of 3 main components:</em></strong></blockquote><blockquote><strong><em>#Intents: </em></strong><em>An intent is a collection of similar statements expressed by users, typically representing a desired goal or function. For a retail bot, for example, a customer might be seeking #product-info.</em></blockquote><blockquote><strong><em>@Entities: </em></strong><em>An entity represents a more specific piece of information in a user request, providing detail and context to the overarching intent (perhaps a particular @product in the retail bot example).</em></blockquote><blockquote><strong><em>Dialog: </em></strong><em>The dialog element provides a graphical outline of how intents and entities interact, mapping each combination to a customized, automated response.</em></blockquote><h4>6. Create your first Intent.</h4><p>Most users will begin interacting with your bot the same way they would interact with a human— by greeting them! Click <em>Create intent</em> and give it the name <em>#Greetings</em>.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/900/1*lZsjsUIPxGZPUbHalB3l1w.gif" /></figure><h4>7. Provide Watson some example greetings.</h4><p>To help our bot recognize what a typical greeting might look like, we’ll give Watson some examples to train on. Provide at least 5 to 7 variations of common greetings.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/900/1*wbm4i_hTv_zHsd_wYlezfg.gif" /></figure><p>After analyzing these examples, our bot will not only be able to recognize those specific phrases as <em>#Greetings</em> — thanks to Watson’s core <a href="https://medium.com/ibm-watson/natural-language-processing-explained-76feb28dc16c">Natural Language Processing</a> capabilities, it will also be able to more readily identify other variations we haven’t trained on.</p><h4>8. Construct your first Dialog node.</h4><p>Now that we’ve created our first Intent, let’s integrate it into our bot’s conversational flow by creating a dialog node. Click <em>Dialog</em> on the menu, then click <em>Add Node</em>. Name the node “Greetings,” and under the subheading “If assistant recognizes,” select your <em>#Greetings</em> Intent.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/900/1*skxs3jcyMhzWdi3KKAP1Tw.gif" /></figure><p>Under the “Assistant responds” subheading, script some replies to be triggered whenever your bot detects a greeting. It could seem a little too robotic if your workout assistant responded the same way every time, so give your bot a few different greetings to cycle through!</p><h4>9. Try out your bot.</h4><p>Your customized dialogue updates in real-time, and we can continuously test out our assistant’s conversational capabilities by clicking the <em>Try it</em> button in the upper-right corner. Open up the chat window and say hello!</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/900/1*uwry3jqRRv0KqtWg3rbO1w.gif" /></figure><p>You’ll notice that, below your chat entries, Watson displays the <em>#Greetings</em> classification. If Watson does not recognize your greeting’s Intent<em>, </em>however, the entry will be marked as “Irrelevant.”</p><p>Luckily, we can train Watson to recognize these unfamiliar greetings right here in the chat window. Try entering a greeting that you did not include in your initial list of examples. If Watson fails to correctly classify it, simply click to open up the classification’s drop-down menu in the chat, and select the <em>#Greetings</em> Intent. Watson will now recognize this phrase in future instances!</p><blockquote>Note that after some changes, Watson will need time to train. Watson is still training if the following purple message appears at the top of the chat window. Once this message disappears, the dialog results will reflect your latest edits.</blockquote><figure><img alt="" src="https://cdn-images-1.medium.com/max/834/1*bbHI67R2SaqBhrvZQaeLTA.png" /></figure><h4>10. Add some workout-related Intents.</h4><p>Now that we’re familiar with how Intents and Dialog nodes work, let’s teach our assistant about fitness! Navigate back to the Intents window, then click <em>Create intent</em>.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/900/1*Dk_IaCSYevLzbAS4Rr3r0w.gif" /></figure><p>Choose a common exercise topic that users might want to ask your bot about (for example, “How long should I rest between sets?”). As was the case with our #<em>Greetings</em> Intent, you’ll also need to provide Watson with 3–5 examples of how this type of question might vary. Our example question, with a few variations, might look something like this:</p><blockquote><strong><em>How long should I rest between sets?</em></strong></blockquote><blockquote><em>Should I rest before doing another execise?</em></blockquote><blockquote><em>Rest period?</em></blockquote><blockquote><em>Do I need to rest between each set?</em></blockquote><p>Once you’re finished building out your first Intent, go ahead and add a few more (check out the <a href="https://wise.fitness/FAQ.html">WISE Fitness FAQ Page</a> for a full list of ideas). The more Intents and topics your Workout Advisor is able to recognize, the more useful it will be for your users!</p><h4>11. Create a Dialog node for each new Intent.</h4><p>After you’ve created a collection of new workout-related Intents for your bot to advise users on, return to the Dialog page to integrate them into your conversational flow. Follow the same process from when you creating your Greetings dialog— selecting <em>Add node</em>, identifying the desired Intent, and providing a scripted response.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/900/1*mYJYG3zxg825QcHfFsLV9Q.gif" /></figure><p>Feel free to pull answers from the <a href="https://wise.fitness/FAQ.html">WISE Fitness FAQ</a>, or do a bit of research and customize your own answers. The more details your assistant can provide, the better! As you build out each node, continue to test and experiment with your bot in the <em>Try it </em>window, double-checking to ensure that your Q&amp;A’s are working as expected.</p><h4>12. Organize your new Intents in a folder.</h4><p>By now, your Exercise Advisor is capable of fielding quite a few questions, but your Dialog map is probably looking pretty crowded. As the number of Intents grows, it can become difficult to visualize how a conversation with your bot might flow. Let’s clean things up a bit!</p><p>Click<em> </em>the<em> Add folder</em> button at the top of the Dialog page.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/900/1*fFXMVjSHDrJa13RBs3EJUg.gif" /></figure><p>After creating the folder and giving it a name (i.e. “General Workout Questions”), move each of your new exercise-related Dialog nodes by clicking the <em>Actions</em> icon (⋮) and selecting <em>Move</em>. Then, click on your folder and select the <em>To Folder </em>option<em> </em>to place your Dialog node inside.</p><p>Now you can easily reveal/hide this group of Intents by clicking on the folder icon. Much better!</p><h4>13. Create a workout recommendations Intent.</h4><p>So far, we’ve learned how to create basic Q&amp;A dialog flows using some pretty straightforward Intents. But what if our conversation gets a little more complex?</p><p>Let’s say our user is looking for some personalized workout recommendations. Inherently, this kind of request can’t be answered with a simple Q&amp;A structure. There’s more <strong>context </strong>that<strong> </strong>you need to understand— what kind of equipment do they have available? What muscle group are they targeting? Without getting a little more background, your bot won’t be able to offer a high-quality response.</p><blockquote><em>This is where </em><strong><em>context variables</em></strong><em> come in. Watson uses context variables to store this kind of situational input (provided by either the user or an external plugin) in order to create a more specific, customized response.</em></blockquote><p>Before we create our context variables, however, we’ll need to build out the corresponding Intent and Entities. Begin by creating a “workout recommendations” Intent (i.e. <em>#WorkoutRecs</em>). Follow the same process as before, and include a few variations with alternative phrasings.</p><p>Sample <em>utterances</em> of this Intent might include:</p><blockquote><strong><em>Can you recommend some exercises?</em></strong></blockquote><blockquote><em>What workouts can I do?</em></blockquote><blockquote><em>Any exercise recommendations for a home workout?</em></blockquote><blockquote><em>I need recommendations for my workouts!</em></blockquote><figure><img alt="" src="https://cdn-images-1.medium.com/max/850/1*6BMPutIA-DLhSJobtDhs6A.gif" /></figure><h4>14. Create an Entity for muscle groups.</h4><p>Next, we’ll add an <em>Entity</em> to help further specify the context of our workout recommendations. In this case, we’ll categorize each exercise by the targeted muscle group. For the sake of simplicity, in this tutorial, we’ll only define 2 broad muscle groups (upper and lower body). Feel free to return to this step later on to create additional muscle groups (and other contextual categories like equipment) to help fine-tune your bot’s recommendation engine.</p><p>To begin, click <em>Create entity</em> and provide it with the name <em>@musclegroup</em>.</p><p>Then, name your first <em>@musclegroup</em> value “upper body.” Under the synonyms field, list a series of muscles that would fall into the upper body category (arms, chest, shoulders, etc.). Also include alternative ways that users might phrase the “upper body” category (upper, torso, top half).</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/850/1*Dxzjt3Ul2EreDk4RtYW6dQ.gif" /></figure><p>Once you’re finished listing possible ways a user might request workout recommendations for the “upper body” category, click <em>Add value</em>. Then, repeat this process for the “lower body” value. Provide both muscle names (quads, glutes, calves) and alternative category names (lower, legs, bottom half).</p><h4>15. Add your workout recommendations dialog node.</h4><p>Navigate back to the Dialog page and click <em>Add node</em>. Under “If assistant recognizes,” select your <em>#WorkoutRecs</em> Intent.</p><p>Because we want to differentiate our recommendations based on the desired muscle group, we’ll need to customize this node a little further. Click <em>Customize</em> in the upper right corner of the node, then turn on the <em>Slots</em> and <em>Multiple conditioned responses</em> options.</p><blockquote><strong><em>Slots</em></strong><em> give your bot the ability to collect and store user input. In this case, our slot will store our target muscle group.</em></blockquote><blockquote><strong><em>Multiple conditioned responses </em></strong><em>will</em><strong><em> </em></strong><em>allow you to use the input you’ve captured in your slots to offer different responses, depending on the context.</em></blockquote><figure><img alt="" src="https://cdn-images-1.medium.com/max/850/1*oXegNklyF5SncHMg58pygQ.gif" /></figure><h4>16. Store the user’s muscle group as a context variable.</h4><p>Remember <strong>context variables?</strong> We’re now going to use our slot to capture the user’s muscle group input (in the form of an <em>Entity</em>) and store it in one of these variables<strong>. </strong>Context variables are denoted with the <strong>$</strong> prefix.</p><p>Under the <em>Then check for </em>section, fill out the text fields as follows:</p><blockquote><strong><em>Check for: </em></strong><em>@musclegroup</em></blockquote><blockquote><strong><em>Save it as: </em></strong><em>$musclegroup</em></blockquote><blockquote><strong><em>If not present, ask: </em></strong><em>What muscle group would you like to work out?</em></blockquote><figure><img alt="" src="https://cdn-images-1.medium.com/max/850/1*y3l2dfW_9Hz5CRTNhfN2kQ.gif" /></figure><p>Now, the bot should be able to prompt the user for a target muscle group (if not initially provided), then store this information as a context variable for later use in the conversation.</p><p>You can see your context variable in action by clicking the <em>Try it </em>window and chatting with your bot. After requesting a workout recommendation for “arms,” click <em>Manage Context </em>in the upper right corner. Your bot has stored this input as $musclegroup = upper body!</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/850/1*NCq_QmLNGc3ys1EFK0m1mg.gif" /></figure><h4>17. Provide conditioned responses for each muscle group.</h4><figure><img alt="" src="https://cdn-images-1.medium.com/max/850/1*7FW4OzCpQQhng2qrma6fkA.gif" /></figure><p>It’s finally time to script exercise recommendations! Scroll down to the <em>Assistant Responds</em> section of your node and click <em>Add response</em> to bring the total number of potential responses to 2. Then, fill out each field as follows:</p><blockquote><strong><em>If assistant recognizes: </em></strong><em>$musclegroup:(upper body)</em></blockquote><blockquote><strong><em>Respond with: </em></strong><em>For upper body exercises at home, here are a few options you can try: &lt;br/&gt;- Push-Ups (Chest) &lt;br/&gt;- Dips (Triceps) &lt;br/&gt;- Planks (Shoulders)</em></blockquote><p>AND</p><blockquote><strong><em>If assistant recognizes: </em></strong><em>$musclegroup:(lower body)</em></blockquote><blockquote><strong><em>Respond with:</em></strong><em> For lower body exercises at home, here are a few options you can try: &lt;br/&gt; - Body Weight Squat (Hamstrings/Quads) &lt;br/&gt; - Lunges (Hamstrings/Quads) &lt;br/&gt; - Toe Raises (Calves)</em></blockquote><p>The &lt;br/&gt; symbol included in the two examples above is what is known as a “break” element in HTML. This particular element allows you to separate your text into sequential lines. There are many other ways you can format your bot’s responses using HTML tags, for example:</p><ul><li><strong>&lt;b&gt;Text Here&lt;/b&gt;</strong> to make your text bold.</li><li><strong>&lt;i&gt;Text Here&lt;/i&gt; </strong>to make your text italic.</li><li><strong>&lt;a href=“Link Here”&gt;Text Here&lt;/a&gt;</strong> to insert a hyperlink.</li></ul><p>Feel free to get creative with the look and feel of your bot’s responses— unique formatting can be a great way of injecting a little more personality into the conversation!</p><h4>18. Create a node to clear our context.</h4><p>While testing your bot, one thing you may notice is that context variables are stored for the entire conversation, by default. This can present some issues. For example, if your user asks for upper body workout recommendations, then follows up to ask about recommendations for a different muscle group, your bot will assume they’re still requesting information from the upper body category.</p><blockquote><strong><em>Bot:</em></strong><em> Hello. How can I help you?</em></blockquote><blockquote><strong><em>User:</em></strong><em> Can you provide me with some workout recommendations?</em></blockquote><blockquote><strong><em>Bot: </em></strong><em>What muscle group would you like to work out?</em></blockquote><blockquote><strong><em>User:</em></strong><em> Upper body.</em></blockquote><blockquote><strong><em>Bot: </em></strong><em>For upper body exercises at home, here are a few options you can try…</em></blockquote><blockquote><strong><em>User:</em></strong><em> Any recommended exercises for other muscle groups?</em></blockquote><blockquote><strong><em>Bot: </em></strong><em>For upper body exercises at home, here are a few options you can try…</em></blockquote><p>What the bot <em>should</em> do is make another request for a target muscle group. Because the “upper body” context variable is still being stored, however, the bot is unable to recognize the new scope of this question.</p><p>To address this concern, we’ll construct a <em>Child node</em> to clear our conversation’s context after exercise recommendations are provided.</p><p>Click the <em>Actions </em>icon (⋮) on your “Workout Recommendations” node, then click<em> Add child node</em>. Name this new node “Clear Context.” Under “If assistant recognizes,” select your<em> $musclegroup</em> context variable. Then, click the <em>Actions</em> icon (⋮) next to the “Assistant responds” section, and open up the <em>Context Editor</em>.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/850/1*lgnD7F095l6G8X9rUbAJuw.gif" /></figure><p>After the Context Editor is opened, enter the following values into the fields:</p><blockquote><strong><em>Variable: </em></strong><em>musclegroup</em></blockquote><blockquote><strong><em>Value: </em></strong><em>null</em></blockquote><p>This will clear the <em>$musclegroup </em>variable of any stored values once the node is activated.</p><p>Finally, under “Assistant responds,” add a friendly follow-up message (“Let me know if you have any other questions!”), inviting the user to make additional queries.</p><h4>19. Connect our Workout Recommendations node to the child node.</h4><p>In order to trigger our “Clear Context” actions, we’ll have to connect it to our “Workout Recommendations” node.</p><p>Click back over to the “Workout Recommendations” node, and scroll down to the bottom. Underneath the “Then assistant should” section, select <em>Jump to</em> from the dropdown menu. Finally, click the “Clear Context” node, and select <em>Respond</em>.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/850/1*f8IJAoyvPdO7Ey_4vUZKeQ.gif" /></figure><p>Your bot’s workout recommendation capabilities should be ready to do some heavy lifting! But one last thing…</p><h4>20. Customize your bot’s Welcome message.</h4><p>The most important rule in building a chatbot? Make sure people know they’re interacting with one. From the very beginning of the conversation, users should know there’s not a human on the other end of the line. This sets reasonable expectations for what sort of questions your bot can answer, and helps users feel you’re being transparent about your use of an automated system.</p><p>Click the <em>Welcome</em> node to begin editing your intro message. Here’s a sample greeting to get you started:</p><blockquote><em>Hi there! My name is </em><strong><em>Flex. </em></strong><em>I’m a chatbot, and</em><strong><em> </em></strong><em>your very own personal workout assistant! I can help answer basic questions about fitness and provide exercise recommendations. What can I do for you today?</em></blockquote><figure><img alt="" src="https://cdn-images-1.medium.com/max/850/1*nzIQHyA20iEJ2EPlBSonKA.gif" /></figure><h3>Ready to Rumble!</h3><p>Congrats— your virtual workout advisor should now be ready for the big leagues! Navigate back to the <em>Assistants</em> page to access your bot’s preview link, and give it a spin. The preview URL is publicly accessible, so be sure to share with your most fitness-savvy friends!</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/850/1*L4Jpgj0Oxq2KDtqCJSuzrA.gif" /></figure><h3>Going the Extra Mile</h3><p>We’ve added a lot of cool features today, but don’t stop now! There’s plenty of ways you can continue strengthening your bot’s training capabilities. Now that you’ve got a grip on the basics, here are a few ideas for improvements:</p><ul><li>Add an Intent that allows your bot to give motivational tips, and get users pumped to workout!</li><li>Create more muscle group Entities and provide your users with more targeted workouts.</li><li>Enable your bot to suggest common household objects that can be used for equipment while working out at home.</li><li>Expand the scope of your workout suggestions to include cardio exercises, yoga poses, and more!</li><li>Build out an Intent to help advise users on their nutritional habits, depending on their fitness goals.</li></ul><blockquote><em>Get creative with personalizing your virtual workout advisor, and stay tuned for </em><strong><em>Part 2</em></strong><em> of the tutorial, where we’ll integrate our chatbot with </em><a href="https://www.ibm.com/cloud/watson-discovery"><em>Watson Discovery</em></a><em> to extract exercise instructions from the </em><a href="https://wise.fitness/"><em>WISE Fitness</em></a><em> training manual!</em></blockquote><figure><img alt="" src="https://cdn-images-1.medium.com/max/850/1*1M50OACNqJWWcfbguWxKEg.gif" /><figcaption>A special thanks to Stephon Moise at <a href="https://wise.fitness/">WISE Fitness</a> for sharing his fitness insights and expertise.</figcaption></figure><p><em>Enjoy this tutorial? Learn more about Watson Assistant by checking out our collection of </em><a href="https://www.ibm.com/demos/collection/Watson-Assistant/?lc=en"><em>Demos</em></a>,<em> engaging with us on our </em><a href="https://developer.ibm.com/components/watson-assistant/"><em>developer community</em></a>, <em>or messaging me directly at parker.merritt@ibm.com.</em></p><p><em>Feel free to connect with me on </em><a href="https://twitter.com/ParkerMerritt"><em>Twitter</em></a><em> and </em><a href="https://www.linkedin.com/in/parker-merritt/"><em>LinkedIn</em></a><em>, and be sure to check out other AI-focused articles I’ve written:</em></p><ul><li><a href="https://medium.com/swlh/artificial-intelligence-will-catalyze-a-remote-work-revolution-9d46c2319f52">Artificial Intelligence Will Catalyze a Remote Work Revolution</a></li><li><a href="https://medium.com/ibm-dcpe-group/building-automated-ai-pipelines-with-multi-cloud-data-581424dfd31">Automating AI Pipelines with Multi-Cloud Data</a></li><li><a href="https://medium.com/dataseries/behind-the-scenes-ai-is-hollywoods-rising-star-40e97e1c054a">Behind the Scenes, AI is Hollywood’s Rising Star</a></li></ul><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=5bd42c789ae0" width="1" height="1" alt=""><hr><p><a href="https://medium.com/ibm-dcpe-group/build-an-ai-personal-trainer-with-ibm-watson-assistant-part-1-5bd42c789ae0">Build an AI Personal Trainer with IBM Watson Assistant - Part 1</a> was originally published in <a href="https://medium.com/ibm-dcpe-group">IBM DCPE Group</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Facing the Roadblocks of Machine Learning with AutoAI]]></title>
            <link>https://medium.com/ibm-dcpe-group/facing-the-roadblocks-of-machine-learning-with-autoai-248a1615f224?source=rss----ca16dfbb69a2---4</link>
            <guid isPermaLink="false">https://medium.com/p/248a1615f224</guid>
            <category><![CDATA[ibm]]></category>
            <category><![CDATA[watson]]></category>
            <category><![CDATA[machine-learning]]></category>
            <category><![CDATA[watson-studio]]></category>
            <category><![CDATA[auto-ai]]></category>
            <dc:creator><![CDATA[Ahmed Abdellatif]]></dc:creator>
            <pubDate>Wed, 24 Jun 2020 21:05:55 GMT</pubDate>
            <atom:updated>2020-06-24T21:05:55.582Z</atom:updated>
            <content:encoded><![CDATA[<p>Over my years of working with clients, it’s become more common to hear “AI”, “innovate”, and “understand our data” in the same discussion; often in the same sentence! It’s important to figure out why: the amount of data that organizations collect is constantly growing, and the more it grows, the more unwieldy it becomes. Humans are fantastic at understanding patterns, but we’ve never been tasked to grasp this much information in such a short amount of time.</p><p>Therefore, the natural conclusion that many have is to leverage AI &amp; machine learning to make sense of it. From predictive maintenance and IoT, to customer segmentation and fraud detection, there are many areas to leverage AI and tremendous value to gain.</p><h3><strong>The roadblock?</strong></h3><p>At the heart of AI and machine learning is data science. To keep it straightforward, a useful and successful machine learning model necessitates the steps of the “data science/AI lifecycle”.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/485/1*VlmXzHXwXBElkHElx5yoiw.png" /><figcaption>Figure 1: Steps of the AI lifecycle</figcaption></figure><p>You may see other versions of this lifecycle, such as <a href="https://en.wikipedia.org/wiki/Cross-industry_standard_process_for_data_mining">CRISP-DM</a>. Any version of this lifecycle will essentially contain the following steps: business &amp; data understanding, data preparation, model (or multiple models/ensemble) training, validation &amp; evaluation, and deployment. This lifecycle is not necessarily linear, either. For example, when data is prepared and cleansed, there is a possibility that the use case doesn’t align with the data that’s available — so the use case must be tweaked.</p><p>After formulating the use case and gathering the appropriate data, the challenge appears:</p><ul><li>What tools do we use to make sense of the data and to build models?</li><li>What if I don’t have experience with leveraging languages such as Python and R?</li><li>How do I make sure I’m doing all the data prep I need?</li><li>How do I know I’m using the appropriate algorithm for my data?</li><li>How do I deploy and integrate this model into my current application or business process?</li></ul><p>These are all extremely valid and important questions to ask, which understandably cause a lot of hesitation for organizations to begin leveraging AI/machine learning. The understanding of the data and the business are there — do we have to leverage a full data science team who knows Python from the get-go just to start getting any benefit?</p><p>Not necessarily. Let’s discuss IBM AutoAI.</p><h3><strong>AutoAI: Leveraging best practices with automation</strong></h3><p>AutoAI bridges the gap, end-to-end, between data selection and model deployment. Once you have the historical data used to build a model, simply feed it into AutoAI and tell it what you want to predict. From there, AutoAI does the heavy lifting.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/695/1*DUTTCcKRmIgk13izgUCAeg.png" /><figcaption>Figure 2: Steps of an AutoAI experiment</figcaption></figure><p><a href="https://dataplatform.cloud.ibm.com/docs/content/wsj/analyze-data/autoai-overview.html">What does AutoAI automatically do?</a> Again, it’s intended to automate the lifecycle:</p><ul><li>Data preparation (missing value imputation, feature encoding, feature scaling, etc.)</li><li>Model selection (testing and ranking candidate algorithms)</li><li>Feature engineering (feature combinations to best represent the problem)</li><li>Hyperparameter optimization (refining the best performing model pipelines, converging to a better solution)</li></ul><p>Sound familiar? These steps are crucial to the AI lifecycle (shown in Figure 1). If you and your team are able to tackle varying use cases and build models using an automated platform, while knowing it adheres to best practices of data science, then imagine the possibilities! And with our <a href="https://dataplatform.cloud.ibm.com/docs/content/wsj/analyze-data/ml-deploy_new.html?audience=wdp">Watson Machine Learning</a> component, any of these models can be deployed and put into production very quickly.</p><p>By automating tasks that typically take days to weeks (assuming an already-established data science team), what would that mean to your organization? What use cases are you thinking of tackling? What data sparks in your mind as a good candidate to begin model-building? With AutoAI, these curious questions can be answered and validated in an efficient (minutes vs. months) way.</p><h3><strong>An example: Detecting occupancy</strong></h3><p>Suppose we are an organization in the HVAC industry that is looking to leverage data coming from various sensors to better cool or heat office rooms. High energy consumption, and related bills, can occur by running air conditioning or heating unnecessarily, especially if people aren’t in the room in the first place! How can an organization better tackle this?</p><p>A first step would perhaps be to understand and predict the likelihood of occupancy in a room using sensor data. This can drive how often a HVAC unit should be running. We may already have some historical sensor data where we know whether or not there was occupancy in the room. For this example, I’ll be pulling from the <a href="https://archive.ics.uci.edu/ml/index.php">UCI Machine Learning Repository</a>¹, specifically the <a href="https://archive.ics.uci.edu/ml/datasets/Occupancy+Detection+">Occupancy Detection Data Set</a>².</p><p>We now have this data — what do we do with it? Leveraging AutoAI, we’ll be able to build a model and deploy it, all in an automated fashion.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*YXXh9hf0g166d7FHIWf5tw.png" /><figcaption>Figure 3: Preview of occupancy data</figcaption></figure><p>Taking a look at the historical data we’ll use here (Figure 3), we can see the various sensor data inputs (such as temperature, humidity), as well as occupancy (a value of “1” meaning people were in the room, and “0” meaning it was empty). Data gathering is the extent of our human work in this example, as AutoAI will take it from here!</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*VLpt3vq4pxlwYBU0VlqhCw.png" /><figcaption>Figure 4: AutoAI experiment configuration</figcaption></figure><p>Configuring the AutoAI experiment is very straightforward. Figure 4 highlights the steps — we select our dataset, choose what we want a machine learning model to predict (occupancy in this case), and AutoAI will automatically select the appropriate settings and metric to focus on. You can of course configure these settings if you wish.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*0pIWqM2CNHAOEEjPokCazA.png" /><figcaption>Figure 5: AutoAI experiment summary</figcaption></figure><p>The fun and insights really begin here! The relationship map in Figure 5 provides an overview of the many model pipelines that are automatically built, which consist of any feature transformations to the data, the top performing algorithms, and any sort of feature engineering/hyperparameter optimization needed. AutoAI then ranks the pipelines in an easily consumable format. In Figure 5, it appears that Pipeline 7 ranks the highest on the leaderboard. Let’s take a closer look.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*XWvWJ7ddEkLp11FGzvkwCA.png" /><figcaption>Figure 6: Model information for AutoAI pipelines</figcaption></figure><p>There are a few pieces of information to take in from the model evaluation in Figure 6, but high level, this is a pretty accurate model. We can also view information such as confusion matrices, precision-recall curve, model details, the specific feature transformations, and feature importance. These details are vital to business analysts and data scientists alike!</p><p>Suppose we feel comfortable in leveraging this model pipeline for a future application. What can we do with it? There are two interesting ways to proceed.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*j2YCuIfblAe2JKYraNhSvQ.png" /><figcaption>Figure 7: Saving a model or converting to a notebook</figcaption></figure><p>We can either save this pipeline as a model, which we can then deploy, or save it as a notebook to obtain the source code. Data scientists may find the second option quite interesting — while AutoAI is speeding up the process to model creation, it is built on open source. This is revealed through this option!</p><p>For this example, we’ll go for the first option. In the platform, we can then easily save and deploy this model as an online web service to which we can make an API call.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*jZ0rUQQXQnOaYfHwB_NkcA.png" /><figcaption>Figure 8: Calling a deployed model</figcaption></figure><p>The above figure showcases a deployed model. Given these particular inputs (which may be coming from sensors in the room every few minutes), the room is predicted to be occupied with a probability of 99%.</p><p>In a matter of minutes, we were able to take historical data, run it through AutoAI, and deploy a model for future use! We can certainly build on this with more data points and other use cases.</p><h3><strong>In conclusion…</strong></h3><p>AI and machine learning can seem intimidating, and there are typically roadblocks around skill sets and best practices in data science to navigate. With IBM AutoAI, you are able to automate and adhere to the AI lifecycle of data preparation, model selection &amp; development, and deployment. All while keeping it explainable to both business users and data scientists.</p><p>Let me know if there are use cases you can think of testing with AutoAI! I’m always interested to hear about how others are using it.</p><h4><em>Want to start?</em></h4><p>AutoAI is within our <a href="https://www.ibm.com/cloud/watson-studio">Watson Studio</a> platform. <a href="https://dataplatform.cloud.ibm.com/registration/stepone?context=wdp&amp;apps=all">Start on IBM Cloud for free</a>.</p><p>Contact: <a href="https://www.linkedin.com/in/ahmedmabdell/">Ahmed Abdellatif</a></p><p>[1] Dua, D. and Graff, C. (2019). UCI Machine Learning Repository [http://archive.ics.uci.edu/ml]. Irvine, CA: University of California, School of Information and Computer Science.</p><p>[2] Accurate occupancy detection of an office room from light, temperature, humidity and CO2 measurements using statistical learning models. Luis M. Candanedo, VÃ©ronique Feldheim. Energy and Buildings. Volume 112, 15 January 2016, Pages 28–39.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=248a1615f224" width="1" height="1" alt=""><hr><p><a href="https://medium.com/ibm-dcpe-group/facing-the-roadblocks-of-machine-learning-with-autoai-248a1615f224">Facing the Roadblocks of Machine Learning with AutoAI</a> was originally published in <a href="https://medium.com/ibm-dcpe-group">IBM DCPE Group</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[5 Emerging Technologies]]></title>
            <link>https://medium.com/ibm-dcpe-group/cloud-containers-kubernetes-101-3198bab0860b?source=rss----ca16dfbb69a2---4</link>
            <guid isPermaLink="false">https://medium.com/p/3198bab0860b</guid>
            <category><![CDATA[microservices]]></category>
            <category><![CDATA[virtual-machine]]></category>
            <category><![CDATA[containers]]></category>
            <category><![CDATA[cloud]]></category>
            <category><![CDATA[kubernetes]]></category>
            <dc:creator><![CDATA[Vincent Cheng]]></dc:creator>
            <pubDate>Wed, 06 May 2020 15:59:51 GMT</pubDate>
            <atom:updated>2020-05-12T01:21:20.684Z</atom:updated>
            <content:encoded><![CDATA[<h3>5 Emerging Technologies — a 101 to Cloud, Microservices, &amp; more</h3><figure><img alt="" src="https://cdn-images-1.medium.com/max/916/1*Ityp8yILVI2yiOF6xgkCWA.png" /></figure><p>While the rate of businesses adopting cloud technology has continually increased in the last decade — virtual machines, containers, and Kubernetes are all leading edge technologies that surround cloud computing, and consequently increase our need for understanding these terms.</p><p>As a budding technologist in the field of technical sales, I needed to quickly grasp these concepts to keep up in the conversation, let alone add value to my team and clients. To reinforce my own learning, I have <em>simplified </em>these five key concepts: <strong>cloud computing, microservices, virtual machines (VM), containers, and Kubernetes</strong>. Every explanation and example I use are — at best — a high level overview on my understanding of these technologies and what the importance is. Whether you are an early career professional like me in the world of tech, or an established long-time business guru looking for simplified definitions, I hope my ideas can help you feel comfortable to incorporate some of these concepts into your daily conversations.</p><h3>What is Cloud computing?</h3><p><strong>Cloud computing</strong>, or the <strong>cloud</strong>, is the on-demand delivery of computing resources via the internet.</p><blockquote>It’s like giving your IT department thermostats that they can turn on, up, down, or off based on their needs. Need extra processing power to cover your peak period? Crank it up — and then turn it down when you’re finished.</blockquote><p>To understand why cloud is such a big deal, I want you to think about how businesses operate for a moment.</p><p>Today, most large enterprises still own and maintain hardware systems, mainframes, data centers, applications in their own location or facility, also known as <strong>on-premises </strong>(or on-prem<strong>). </strong>With an on-prem model, on-site<strong> </strong>operation teams need to maintain how much core processing units (CPUs), RAM, and disk space are needed to run day-to-day operations in their data centers. This can be quite expensive when there are many servers to manage. For that reason, the option to move to a cloud environment: either public cloud or private cloud is more appealing. At the end of the day, cutting down on costs using a cloud environment will save more money for businesses.</p><blockquote><a href="https://www.ibm.com/cloud/learn/public-cloud">Public cloud</a> is a type of cloud computing in which a third-party service provides computing resources.</blockquote><blockquote><a href="https://www.ibm.com/cloud/learn/introduction-to-private-cloud">Private cloud</a> is a cloud computing environment in which all hardware and software resources are dedicated exclusively to a single customer.</blockquote><p>One advantage of utilizing cloud computing is the option to pay-as-you go. This can save businesses money because instead of spending on capital expenses and maintenance, they can use a subscription model to offload the resources needed to run and maintain their environment. Not only do businesses save money with a pay-as-you go service using a cloud, it is much faster and efficient to build an application. When an internal IT development team is asked to build an application and they don’t have enough resources, they would need to buy those servers, install them, and configure them — which all takes a lot of time. Therefore, moving and migrating to a cloud is advantageous as it can provide the necessary configurations, maintenance, and implementation.</p><p>At the same time, not all businesses are going to want to move to the cloud for security purposes. And not every business should move to full cloud.</p><blockquote><strong>And that’s why at IBM, there is </strong><a href="https://www.ibm.com/cloud/learn/hybrid-cloud#toc-what-is-hy-jMcgxP8H"><strong>a hybrid cloud</strong></a><strong> mentality.</strong></blockquote><p>A hybrid cloud is a mixture of a public cloud and a private cloud, allowing data and applications to be moved, developed, and shared between the two clouds. You can read more <a href="https://www.ibm.com/cloud/learn/hybrid-cloud#toc-what-is-hy-jMcgxP8H">here</a>.</p><h3>What are Microservices?</h3><p>Now, once a business has decided to move to a private, public or hybrid cloud, they have to be able to move their application(s) over to the new cloud environment. But there might be some problems doing this.</p><p>Up until recently, applications have been developed as a single unit, constructed using custom technologies. As you can imagine, the more features and code you add to the application, the more complex it becomes. As a result, a <strong>monolithic application </strong>or a very large, single unit application is born. This makes it hard to update and scale across an entire business because when one feature of the application is changed, there is a ripple effect across the entire application. To change a feature, the entire application needs to be first taken down, halting business operations, then re-deployed back into the environment — causing a lot of downtime and frustration for workers.</p><p>Let’s discuss how microservices can fix some of those problems. Microservices can break apart a monolithic model into small, separated and independent processes — speeding up the development and deployment times for software developers. It helps to frame microservices with another technology that disrupted the way people work: The invention of the assembly line.</p><blockquote>In the early 1900s, single team of workers were required to manually assemble an automobile from start to finish. Workers were responsible for all the tasks at once: building the parts, putting together the parts, and constantly switching without any specialized focus to build one automobile. It was time-consuming, labor intensive and there were no standardization to any process. As a result, Henry Ford struggled to keep up with the automotive demand using this method.</blockquote><blockquote>In 1913, Henry Ford strategized and pioneered the invention of the <a href="https://www.history.com/this-day-in-history/fords-assembly-line-starts-rolling"><strong>assembly line</strong></a> for cars to be assembled more efficiently. His assembly line innovation reduced the time it took to build a car from more than 12 hours to 2.5 hours. Not only was the company able to satisfy the demand but they were able to figure out a way to build cars faster than ever before, disrupting the entire automotive industry.</blockquote><p>Just like what the assembly line did for car parts, a microservice model offers standardized, modularized blocks of code for individual processes that can be plugged in for a cleaner and more efficient build. Microservices take a monolithic application and break it down into services and components. For example, a banking application can consist of a deposit money feature, loan application feature, checking account feature, etc. which are all independent of one another, using APIs (or application programming interface) to talk to each other.</p><p>What is the benefit of doing this? If you want to update a feature, you can now make changes to that one feature without it rippling across the entire banking application. As technology becomes more ingrained into businesses, there needs to be a smart way to simplify, standardized and scale applications which is what microservices allows you to do.</p><h3><strong>What are Virtual Machines and Containers?</strong></h3><p>Virtual machines (VMs) and containers are both commonly used for developers to develop applications. A virtual machine is an emulation of a computer, i.e using a Windows operating system (OS) on a Mac.</p><p>Imagine a teammate who still uses Windows 10 operating system and you are a developer using Mac. You have two options: one, install Windows 10 on your Mac computer (which would be a disaster) or two, download a virtual machine software. You decide option two and install a VM on your Mac computer, which will create buckets for you to install the Windows 10. Now you run both operating systems and can use Windows 10 on your Mac. Why would you want to do this? So that you can have precisely configured, operating systems for testing and development purposes.</p><blockquote><a href="https://www.freecodecamp.org/news/a-beginner-friendly-introduction-to-containers-vms-and-docker-79a9e3e119b/">Containers and VMs </a>are similar in their goals: to isolate an application and its dependencies into a self-contained unit that can run anywhere. Both remove the need for physical hardware, allowing for more efficient use of computing resources, in terms of energy consumption and cost effectiveness.</blockquote><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*OheItlwzk2oyoHSl.png" /></figure><p>A lot people that were using virtual machines before are now moving to containers because it is much easier to use and takes up less space. Similar to a virtual machine, a container is the smallest unit of an application of software. They are “lightweight” since it does not include a guest OS, saving more disk space.</p><p>Let’s use an iPhone as an example. If you’re like me, you probably have more than one app on your iPhone. If you wanted to download more applications in a virtual machine setting, it would be hard because there is not enough compute capacity — i.e. you wanted four iPhone apps, well you would need four separate iPhones for those apps. What containers allow developers to do is to simulate an operating system and scale those applications, allowing you to put all four applications all into one single container. Containers also have the bare minimum of what that application needs to run — so you save more money on compute capacity.</p><p>Should everyone use containers? No, containers (while super powerful) become more important as the project becomes bigger and scales more. When this happens, there also needs to be a way to manage all of the containers created in an application — which brings us to Kubernetes.</p><h3>What is Kubernetes?</h3><p>As more applications and containers are being developed, Kubernetes was created to manage containers in an microservices environment.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/902/1*Yuo8GHt_bpybkMRu5BBKmg.png" /></figure><p>Kubernetes is an open source project, meaning anybody is free to use, study, modify, and distribute it for any purpose.</p><blockquote><a href="https://kubernetes.io/docs/concepts/overview/what-is-kubernetes/">Kubernetes</a> is a portable, extensible, open-source platform for managing containerized workloads and services, that facilitates both declarative configuration and automation. It has a large, rapidly growing ecosystem. Kubernetes services, support, and tools are widely available.</blockquote><p>Openshift is a product built by Red Hat (the world’s leading provider of enterprise open source solutions) who enhanced the Kubernetes project by adding features to support large enterprises — essentially enterprise support for an open source platform. With enterprise support, you can get guidance on how to better manage your IT ecosystem and have the right experts resolve technical roadblocks, instead of having to fix those issues yourself. An example of enterprise Kubernetes support would be <a href="https://www.openshift.com/learn/topics/kubernetes/">Redhat Openshift</a>.</p><h3><strong>Why does this matter?</strong></h3><p>Let’s put all the concepts together in an example. Say you work at a bank and you need an application for customers to handle all their banking needs whether on a phone or computer.</p><ol><li>You develop an application using a <a href="https://www.ibm.com/cloud/learn/public-cloud"><strong>cloud </strong></a>environment; <em>why do this? </em>You don’t have to manage the infrastructure, you don’t have to pay the overhead to host the servers, so you will be able to add more features without having to buy a computer for more capacity, saving you money and time.</li><li>You build the application using a <a href="https://www.ibm.com/cloud/learn/microservices"><strong>microservices</strong> </a>architecture which consists of different features: a user interface, a deposit function , and so on — every feature or function will be its own microservice; <em>why do this? </em>if one feature is used more frequently and has a lot more demand than another feature, you can scale it up dynamically and not waste resources.</li><li>You deploy these microservices with <a href="https://www.ibm.com/cloud/learn/containers"><strong>containers</strong></a>; <em>why do this</em>? Because it’s easy, it’s simple, and scalable as you have more customers using the application. Now you want to be able to manage your containers with <a href="https://www.ibm.com/cloud/learn/kubernetes"><strong>Kubernetes</strong></a> so you can scale as you need to.</li><li>You manage your containers using an enterprise ready Kubernetes; <em>why do this</em>? When an application, feature, or function breaks, you can get an enterprise support team (i.e <a href="https://www.ibm.com/cloud/openshift"><strong>Redhat Openshift</strong></a><strong>)</strong> to fix it, instead of you having to fix the bug/code yourself — saving you frustration and time.</li></ol><blockquote>IBM is helping enterprises use these fundamental technologies in their modernization journey through products and services like: <a href="https://www.ibm.com/cloud/paks/">Cloud Paks</a>, <a href="https://www.ibm.com/case-studies/ibm-global-technology-services">Global Technology Services</a>, <a href="https://www.ibm.com/services">Global Business Services</a> and <a href="https://www.ibm.com/cloud/openshift">Redhat Openshift</a>.</blockquote><p>Thank you for reading, I welcome any feedback, questions, or discussions over in the comment section below! You may also reach me at vincent.cheng@ibm.com.</p><p>— — — —</p><p>Editor(s) — <a href="https://www.linkedin.com/in/rclawson1/">Robin (Lawson) Dewberry,</a> <a href="https://www.linkedin.com/in/leslierodriguez1/">Leslie Rodriguez</a></p><p><em>Disclaimer: All content is based on personal views, thoughts, and opinions expressed and not necessarily to my employer, organization, committee or other groups. All hyperlinks to third party sites are solely for informational purposes and not in anyway affiliate advertisements.</em></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=3198bab0860b" width="1" height="1" alt=""><hr><p><a href="https://medium.com/ibm-dcpe-group/cloud-containers-kubernetes-101-3198bab0860b">5 Emerging Technologies</a> was originally published in <a href="https://medium.com/ibm-dcpe-group">IBM DCPE Group</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Automating AI Pipelines with Multi-Cloud Data]]></title>
            <link>https://medium.com/ibm-dcpe-group/building-automated-ai-pipelines-with-multi-cloud-data-581424dfd31?source=rss----ca16dfbb69a2---4</link>
            <guid isPermaLink="false">https://medium.com/p/581424dfd31</guid>
            <category><![CDATA[technology]]></category>
            <category><![CDATA[startup]]></category>
            <category><![CDATA[devops]]></category>
            <category><![CDATA[artificial-intelligence]]></category>
            <category><![CDATA[data-science]]></category>
            <dc:creator><![CDATA[Parker Merritt]]></dc:creator>
            <pubDate>Fri, 24 Apr 2020 02:13:56 GMT</pubDate>
            <atom:updated>2020-04-24T13:50:22.670Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*GLcpbcr07vC2I3D_dz4cJQ.png" /></figure><h4><em>IBM Cloud Pak for Data is a holistic, container-based enterprise analytics platform, purpose-built for collaboration. With this platform, business users can easily automate and accelerate the operationalization of their data science projects.</em></h4><p>Data is the fuel that powers modern enterprise. With cutting-edge AI and analytics applications, it’s now easier than ever for business users to generate meaningful insights from their data, increasing productivity, efficiency, and innovation.</p><p>Still, a major challenge remains: your data is useless if you can’t trust it or access it. For many businesses, mission-critical applications span multiple clouds, and users may struggle to foster collaboration across disparate data sources.</p><p>With <strong>IBM Cloud Pak for Data</strong>, however, enterprises can easily connect to their data, govern it, and use it for analysis, no matter where their applications are located. With modern tools that facilitate analytics and remove barriers to collaboration, users can spend less time finding data and more time using it effectively.</p><blockquote><em>In this tutorial, we’ll learn how to connect IBM Cloud Pak for Data to an </em><strong><em>Amazon Web Services S3</em></strong><em> data source, clean and prepare the data for analysis, and generate an automated AI pipeline — all within 15 minutes, without writing a single line of code.</em></blockquote><h4><strong><em>For the visual learners out there, this tutorial is also </em></strong><a href="https://www.youtube.com/watch?v=_L6Is2Ecm6E"><strong><em>available as a video</em></strong></a><strong><em> on YouTube.</em></strong></h4><p><strong>1. </strong>First, sign into the <strong>Cloud Pak for Data</strong> web client.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*QxDCoRVU774hd2pFGeWTDg.gif" /><figcaption><em>Don’t currently have access to a Cloud Pak for Data instance? Request a free trial environment with </em><a href="https://www.ibm.com/cloud/paks/experiences/cloud-pak-for-data"><em>Cloud Pak Experiences.</em></a></figcaption></figure><p><strong>2. </strong>Once you’re signed in, take a moment to explore the main dashboard. Here, users can configure a custom interface with various metrics related to the number of data assets, governance rules, business terms, and more.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/864/1*5Rzpvl7f5YConBB7_cLWEg.gif" /><figcaption>For a closer look at these dynamic images, simply <strong>click to expand.</strong></figcaption></figure><p><strong>3. </strong>Once you’re finished exploring the main dashboard, click on the menu icon in the top-left corner. Then, click the <strong>Projects </strong>tab.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*hgl_zUxWqZz_zCwJ52qWaQ.gif" /><figcaption>Projects are how Cloud Pak users organize their resources when working with data.</figcaption></figure><p><strong>4. </strong>Next, click <strong>New Project,</strong> then <strong>Create an empty project,</strong> which will contain all of your data source connections and assets.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*4EiTbJkx-bd08QHi1S__Hg.gif" /><figcaption><em>When you create a project, you have the </em><strong><em>Admin</em></strong><em> role and full control over the project. If you have the </em><strong><em>Editor </em></strong><em>role, you can add assets and collaborators to a project.</em></figcaption></figure><p><strong>5. </strong>Give your new project a name and description. Note that you also have the option of integrating your project with <strong>Git</strong> for <a href="https://git-scm.com/book/en/v2/Getting-Started-About-Version-Control">version control</a>, allowing your team to track any changes made. When you’re finished, click create.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*2TWq4qXVxGMi_-sKcfhIcQ.gif" /></figure><blockquote><em>Integrating with Git allows you to sync your project with a remote repository (for example, Github) which is useful in a number of ways. From supporting collaboration with the broader data science community, to helping you more easily back up and share your projects assets, Git integration is a great feature for supporting a variety of developer needs.</em></blockquote><p><strong>6. </strong>After your project is created, you’ll see the project <strong>Overview</strong> page, where you can find a high-level summary of the project’s assets and collaborators.</p><p><strong>7. </strong>Click over to your project’s <strong>Assets</strong> tab. This page will display all of your project’s data source connections, notebooks, dashboards, and other relevant data assets.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*cm-0aJQF2-1Z_CAEEBq0cA.gif" /></figure><p><strong>8. </strong>Near the top of the page, click the <strong>Add to Project </strong>button. Then, select <strong>Connection.</strong></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*ulpnRWQgUBn7d40jLtgolw.gif" /></figure><p><strong>9. </strong>Here you’ll see a catalog of the various data sources and platforms you can connect to with Cloud Pak for Data. Under third-party services, click the <strong>Amazon S3 </strong>option.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*8wEjPlHnNNJqOcHGEYGUFg.gif" /></figure><blockquote><em>According to a survey by the IBM Institute for Business Value, </em><strong><em>85 percent </em></strong><em>of organizations already operate in a multi-cloud environment. Enabling connectivity across these clouds is essential for enterprise analytics.</em></blockquote><p><strong>10. </strong>Next you’ll be required to enter a name and description for your connection. Also enter the name<em> </em>of the S3 Bucket containing your data asset. Be sure that the bucket name is entered <em>exactly</em> how it appears on AWS.</p><p><strong>11. </strong>In a separate browser window, switch over to your AWS Management Console. At the top of the page, click your username, then select <strong>My Security Credentials</strong> from the drop-down menu.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*cb4PxMAGtz8JS3MZrTC0gw.gif" /></figure><p><strong>12. </strong>Under the Access Keys section, click <strong>Create New Access Key. </strong>Save both the Secret Access Key and the Access Key ID in a note.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*iMcPFmVJ0rvPxmNp7DQw1g.gif" /></figure><p><strong>13. </strong>Switch back over to Cloud Pak for Data and enter your AWS access credentials into the corresponding fields. Finally, <strong>Test</strong> your connection, then click <strong>Create</strong>.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*fx_ovtG7FFNlcs_UvqcyeQ.gif" /></figure><p><strong>14. </strong>Navigate back to your <strong>Assets</strong> tab. Notice that your Amazon S3 Connection now appears on the Data Assets list.</p><p><strong>15. </strong>Now that we’ve created a connection to Amazon S3, we’ll create a Data Asset and import the connected data for our machine learning model. Near the top of the page, click the <strong>Add to Project </strong>button. Then, select <strong>Connected Data.</strong></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*sqNG-sv4YpapibiAEdvQlA.gif" /></figure><blockquote><em>In this tutorial, we use a concrete compressive strength dataset from the </em><a href="http://archive.ics.uci.edu/ml/datasets/concrete+compressive+strength"><em>UCI Machine Learning Repository</em></a><em>. However, your S3 bucket can contain any CSV file you’d like to build a predictive model with.</em></blockquote><p><strong>16. </strong>Here you’ll be prompted to select the source of your data asset, in addition to providing it with a name and description. Click <strong>Select source.</strong></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*HE-oLErC9-liUw0X5tezbg.gif" /></figure><p><strong>17. </strong>After selecting Amazon S3 as your connection source, all of the files contained in your S3 bucket will be listed. Click the CSV you’ll use to train your AI model, then click <strong>Select </strong>at the bottom-right corner.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*PyXoxYfujjERPSIgTV74aA.gif" /></figure><p><strong>18. </strong>Once you’ve selected a data source and provided the asset with a name and description, click <strong>Create.</strong></p><p><strong>19. </strong>Now you’ve added the CSV data asset to your project, but the data still needs to be cleaned and prepared for use in your AI model. Hover over the <strong>Actions</strong> icon next to your data asset, then click <strong>Refine.</strong></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*PUm8bVjg40TUfh2605r63A.gif" /></figure><blockquote><em>For many data scientists, </em><strong><em>80 percent </em></strong><em>of their time is spent finding, cleaning, and reorganizing data in order to prepare it for analysis. The Data Refinery tool in Cloud Pak for Data helps streamline and accelerate this process.</em></blockquote><p><strong>20. </strong>Let’s quickly explore some of the main features of the Data Refinery tool. By clicking on <strong>Steps </strong>at the top-right corner, we’re able to see the order of the data transformation operations performed on our dataset.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*z2bL3KfvBkRBkaDxGo7NXQ.gif" /></figure><p><strong>21. </strong>Clicking on the <strong>Profile</strong> tab at the top-left corner, we’re able to see some basic statistics concerning our data set. However, these metrics are limited by the fact that our data columns currently have the type <em>String</em>, rather than <em>Decimal </em>or <em>Integer</em>.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*g7Kcm4rbh3fjYA_5lhq_OA.gif" /></figure><blockquote><em>The Profile and Visualization tabs in Data Refinery allow users to quickly perform an exploratory analysis of their dataset, a critical first step in any data science project.</em></blockquote><p><strong>22. </strong>Let’s convert our columns to the correct data type. Click to open the <strong>Operations </strong>menu in the top-left corner. Select the <strong>Convert column type </strong>option.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*E2Etgn9pPowvkfhQrLVsvw.gif" /></figure><p><strong>23. </strong>Select the first column, then select the <em>Decimal</em> data type.</p><p><strong>24. </strong>Click <strong>Select Column</strong> again and repeat this type conversion process for the remaining columns. Be sure to correctly apply the <em>Decimal</em> and <em>Integer</em> labels to the corresponding columns. Then, click <strong>Apply.</strong></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*PAc71uKx-M9q84evPZ5l1w.gif" /></figure><p><strong>25. </strong>Double check each column to ensure your data types have been converted correctly. Note that your conversion operations now appear under the <strong>Steps</strong> tab.</p><p><strong>26. </strong>The final step in the refinery process is to save and run your refinery flow. Click the clock icon, then <strong>Save and create a job.</strong></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*3OtcK8MGGePsSvzZpSz1FQ.gif" /></figure><p><strong>27. </strong>Give your refinery flow job a name and description, then click <strong>Create and Run.</strong></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*uTjaXdfq2CKo9Bwmm2usoQ.gif" /></figure><p><strong>28. </strong>After running for a few moments, the job status will change to <em>Completed</em>.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*1cNIz1oaXWAxfVNPm7cP-Q.gif" /></figure><blockquote><em>In just a few steps — without writing a single line of code — you’ve prepared a clean dataset, ready for use in any enterprise analytics project.</em></blockquote><p><strong>29. </strong>Return to your project’s <strong>Assets </strong>page. Note that, in addition to the saved refinery flow, you’ll also see the refined CSV file under your <strong>Data assets</strong> list.</p><p><strong>30. </strong>Now that our data is cleaned and prepared for analysis, we’re ready to create our automated AI pipeline. Once again, click the <strong>Add to project </strong>button, then add an <strong>AutoAI experiment.</strong></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*0YwfR9WuPssFYYIuyb68TA.gif" /></figure><blockquote><em>The </em><strong><em>AutoAI</em></strong><em> graphical tool in Cloud Pak for Data automatically analyzes your data and generates candidate model pipelines customized for your predictive modeling problem. These model pipelines are created iteratively as AutoAI analyzes your dataset and discovers data transformations, algorithms, &amp; parameter settings that work best for your problem setting.</em></blockquote><p><strong>31. </strong>Give your AutoAI experiment a name and a description, then click <strong>Create.</strong></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*GFJaxNb_sDedtwPCqbC-4g.gif" /></figure><p><strong>32. </strong>Next, add your refined data source to the AutoAI experiment by clicking <strong>Select from project, </strong>choosing the shaped CSV file, and clicking <strong>Select asset.</strong></p><p><strong>33. </strong>Now select the target variable to predict with your AI model. In this example, we select the ‘Concrete compressive strength’ column. You also have the option to reconfigure the prediction type and the optimized metric under <strong>Experiment settings.</strong> Then, click <strong>Run experiment.</strong></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*7fvYrDbiPukRIZhhWI6T_A.gif" /></figure><p><strong>34. </strong>Next, you’ll see the experiment automatically progress through various stages in a typical data science pipeline.</p><blockquote><strong><em>To help simplify AI lifecycle management, AutoAI automates:</em></strong></blockquote><blockquote>· <em>Data preparation</em></blockquote><blockquote>· <em>Model development</em></blockquote><blockquote>· <em>Feature engineering</em></blockquote><blockquote>· <em>Hyper-parameter optimization</em></blockquote><p>Over the course of a few minutes, AutoAI will evaluate a variety of model configurations, ranking each according to your chosen optimization metric.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*kbpuvXTLjawjSGVgxVwleg.gif" /></figure><blockquote><em>Bypassing the complexity of manually coding an AI pipeline allows citizen data scientists to quickly get started, and helps expert data scientists speed experimentation time from weeks and months to minutes and hours.</em></blockquote><p><strong>35. </strong>Once your AutoAI experiment has finished running, scroll down to the <strong>Pipeline leaderboard</strong> to view a comparative analysis of various model configurations.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*maJNQU99Fe8_s8mx0XLk5g.gif" /></figure><blockquote><em>AutoAI uses a novel approach that enables testing and ranking candidate algorithms against small subsets of the data, gradually increasing the size of the subset for the most promising algorithms to arrive at the best match. This approach saves time without sacrificing performance.</em></blockquote><p><strong>36. </strong>Select the best-ranking pipeline on the leaderboard and click <strong>Save as model. </strong>Give your model a name and description, then click <strong>Save.</strong></p><p><strong>37. </strong>After clicking save, you’ll see a success notification, indicating your machine learning model will now appear in your project’s <strong>Assets</strong> page. Click <strong>view in project</strong> to view more details.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*qtLj2vfciKV04BYiEp8jvA.gif" /></figure><p><strong>38. </strong>Here you’ll see details about how your model was generated, including the data types contained in the model’s training set. To make your model publicly available to developers within your organization, click <strong>Promote to deployment space.</strong></p><p><strong>39. </strong>If you haven’t yet created a Deployment Space for your project, you won’t be able to promote the asset. Click <strong>Associate Deployment Space.</strong></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*oOkjwjT5sE1uOXIS6eiyTQ.gif" /></figure><p><strong>40. </strong>Give your Deployment Space a name and description, then click <strong>Associate.</strong></p><p><strong>41. </strong>Click again on<strong> Promote to Deployment Space. </strong>After the model is promoted to your project’s deployment space, a success notification will pop up near the top of your dashboard. Navigate to your deployment space via the link in the notification. Alternatively, there is also a link in your project’s <strong>Overview</strong> page.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*vxBWNFJYm5AGBGLQcLwK6g.gif" /></figure><p><strong>42. </strong>Upon navigating to the deployment space, you’ll see your AI model asset, staged and ready for deployment. Click the asset’s Actions icon then <strong>Deploy.</strong></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*a62BmUjQrjx_eY5_Y1-3jg.gif" /></figure><p><strong>43. </strong>Give your deployment a name and description, then click <strong>Create.</strong></p><p><strong>44. </strong>Wait for your deployment’s status to change from <em>In-Progress</em> to <em>Deployed</em>. Then, click on the deployment name to view more details.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*qnBGgXGeg9TEFFI9lDTHVw.gif" /></figure><blockquote><em>By streamlining the deployment process, Cloud Pak for Data allows developers and business users within your organization to easily leverage data science projects, ensuring AI models quickly move from experiment to production.</em></blockquote><p><strong>45. </strong>Your deployment’s <strong>API reference</strong> tab provides a RESTful API endpoint for developers, as well as example code snippets for interacting with the model in a variety of popular programming languages.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*YXS8lNvlDIrcamiLi38aQg.gif" /></figure><p><strong>46. </strong>Clicking over to the <strong>Test</strong> tab, Cloud Pak for Data provides an interface for testing the API endpoint. Referring to your original CSV data source, pick a set of test values to evaluate the accuracy of your model.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*S1by5hddcvCdO7FNO6OmZw.gif" /><figcaption>In addition to entering your test values into the form interface, users can also format their test request in JSON.</figcaption></figure><h3><strong>Congratulations!</strong></h3><p>In this lab, you’ve successfully built and deployed an automated AI prediction model using multi-cloud data assets.</p><p>As organizations accelerate their digital transformations to better predict and shape future outcomes, empower higher value work, and automate experiences, the need to embrace AI is growing ever more critical. But to implement AI successfully, companies need to overcome three major challenges: data complexity, skills and trust. This process starts with good, clean and secure data — data that is readily deployable to generate insights and set the foundation of AI-driven business.</p><p>IBM Cloud Pak for Data delivers a prescriptive, cost-effective approach to climb the AI ladder.</p><h4><strong>Single, unified platform.</strong></h4><p>Speed time to value with a single platform that integrates data management, data governance and analysis for greater efficiency and improved use of resources. Help enable self-service collaboration across teams.</p><h4><strong>Extensible APIs and ecosystem.</strong></h4><p>Use best practices to your advantage to accelerate implementations and deliver significant business value. Benefit from built-in models and accelerators for various industries including finance, insurance, healthcare, energy, utilities and more.</p><h4><strong>Continuous intelligence.</strong></h4><p>Develop real-time streaming applications and deliver continuous intelligence across your business. With IBM Streams on IBM Cloud Pak for Data, you can enable continuous and rapid analysis of massive volumes of data in motion or at rest. This can help you gain business insights faster and make more-informed decisions.</p><p>Accelerate your journey to AI to transform how your business operates with an open, extensible data and AI platform that runs on any cloud.</p><iframe src="https://cdn.embedly.com/widgets/media.html?src=https%3A%2F%2Fwww.youtube.com%2Fembed%2F_L6Is2Ecm6E%3Ffeature%3Doembed&amp;display_name=YouTube&amp;url=https%3A%2F%2Fwww.youtube.com%2Fwatch%3Fv%3D_L6Is2Ecm6E&amp;image=https%3A%2F%2Fi.ytimg.com%2Fvi%2F_L6Is2Ecm6E%2Fhqdefault.jpg&amp;key=a19fcc184b9711e1b4764040d3dc5c07&amp;type=text%2Fhtml&amp;schema=youtube" width="640" height="480" frameborder="0" scrolling="no"><a href="https://medium.com/media/582f86ba9cfac13694cf4fdbc0f8ee81/href">https://medium.com/media/582f86ba9cfac13694cf4fdbc0f8ee81/href</a></iframe><h4>This tutorial is also available in video format on YouTube.</h4><p><a href="https://youtu.be/_L6Is2Ecm6E?t=67">1:07</a> — Creating a project</p><p><a href="https://youtu.be/_L6Is2Ecm6E?t=132">2:12</a> — Connecting to AWS</p><p><a href="https://youtu.be/_L6Is2Ecm6E?t=272">4:32</a> — Clean in Data Refinery</p><p><a href="https://youtu.be/_L6Is2Ecm6E?t=391">6:31</a> — Automating AI pipeline</p><p><a href="https://youtu.be/_L6Is2Ecm6E?t=538">8:58</a> — Deploying your model</p><p><em>Enjoy this tutorial? Learn more about IBM Cloud Pak for Data by checking out our collection of </em><a href="https://www.ibm.com/demos/collection/IBM-Cloud-Pak-for-Data/?lc=en"><em>Demos</em></a>,<em> trying out the platform yourself at </em><a href="https://www.ibm.com/cloud/paks/experiences/cloud-pak-for-data"><em>Cloud Pak Experiences</em></a>,<em> engaging with us on our</em><a href="https://community.ibm.com/community/user/cloudpakfordata/home"><em> Community</em></a>, <em>or emailing me directly at parker.merritt@ibm.com.</em></p><p><em>Feel free to connect with me on </em><a href="https://twitter.com/ParkerMerritt"><em>Twitter</em></a><em> and </em><a href="https://www.linkedin.com/in/parker-merritt/"><em>LinkedIn</em></a><em>, and be sure to check out a few other tech-focused pieces I’ve written:</em></p><ul><li><a href="https://medium.com/swlh/artificial-intelligence-will-catalyze-a-remote-work-revolution-9d46c2319f52">Artificial Intelligence Will Catalyze a Remote Work Revolution</a></li><li><a href="https://medium.com/@parkermerritt/gatsby-is-great-develop-a-beautiful-responsive-portfolio-site-in-just-3-steps-63694d393d7c">Gatsby is Great: Develop a Beautiful, Responsive Portfolio Site in Just 3 Steps</a></li></ul><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=581424dfd31" width="1" height="1" alt=""><hr><p><a href="https://medium.com/ibm-dcpe-group/building-automated-ai-pipelines-with-multi-cloud-data-581424dfd31">Automating AI Pipelines with Multi-Cloud Data</a> was originally published in <a href="https://medium.com/ibm-dcpe-group">IBM DCPE Group</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Weekly Round Up]]></title>
            <link>https://medium.com/ibm-dcpe-group/weekly-round-up-a27cf7c83e5d?source=rss----ca16dfbb69a2---4</link>
            <guid isPermaLink="false">https://medium.com/p/a27cf7c83e5d</guid>
            <category><![CDATA[ibm-resources]]></category>
            <category><![CDATA[weekly-roundup]]></category>
            <category><![CDATA[emily-rechan]]></category>
            <dc:creator><![CDATA[Emily Rechan]]></dc:creator>
            <pubDate>Fri, 07 Feb 2020 19:08:16 GMT</pubDate>
            <atom:updated>2020-02-07T19:40:49.023Z</atom:updated>
            <content:encoded><![CDATA[<h3><strong>Weekly Roundup</strong></h3><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*icX9H3ANRAXfa3ZRhyRcRg.png" /></figure><p>Hi Everyone, I am starting a new series!</p><p>I will be sharing my top finds from the week, including different resources to help you stay in the know on all things Data &amp; AI. If you’re interested in similar topics give this page a follow!</p><h3><strong>Read</strong></h3><p>Learn about IBM’s new Chief Executive Officer, Arvind Krishna, on <a href="https://newsroom.ibm.com/2020-01-30-Arvind-Krishna-Elected-IBM-Chief-Executive-Officer?lnk=ushpv18nf&amp;utm_medium=OSocial&amp;utm_source=Linkedin&amp;utm_content=000033TP&amp;cm_mmc=OSocial_Linkedin-_-IBM+Master+Brand_Communications-_-WW_WW&amp;cm_mmca1=000033TP&amp;social_post=3085257002&amp;linkId=81490358"><strong>IBM News</strong></a>!</p><p>Are you a current Cognos Analytics user? Interested in what the upgrade process entails? <a href="https://www.ibm.com/support/knowledgecenter/SSEP7J_11.1.0/com.ibm.swg.ba.cognos.inst_cr_winux.doc/c_upgradingtocognos8.html#UpgradingtoCognos8"><strong>IBM Knowledge Catalog</strong></a><strong> </strong>has specifics for you. (It’s also a great resource to learn about specific features)</p><p>Do you want to know about the new/changed features of the Cognos Analytics and Planning Analytics releases? IBM shares details into both!</p><p><a href="https://www.ibm.com/support/knowledgecenter/SSEP7J_11.1.0/com.ibm.swg.ba.cognos.ca_new.doc/c_ca_nf_11_1_x.html"><strong>Cognos Analytics</strong></a><strong> | </strong><a href="https://www.ibm.com/support/knowledgecenter/SSD29G_2.0.0/com.ibm.swg.ba.cognos.tm1_prism_gs.2.0.0.doc/c_new_features_paw.html"><strong>Planning Analytics</strong></a></p><p>Stay tuned — I will be releasing a post on the Cognos Analytics R5 release, soon! It will have insight into my favorite features, with screenshots from my demo environment.</p><h3>Join</h3><p>Participate in the <strong>‘Shaping the Future of Data Preparation and Modeling with Cognos Analytics’ </strong>event held on Feb 27 @ 11am ET.</p><p>This will help anyone looking to gain more insight into how to clean and shape data in Cognos Analytics. I will be joining and would love to discuss after with you! Please feel free to reach out and set up time to chat.</p><p><a href="https://community.ibm.com/community/user/businessanalytics/events/event-description?CalendarEventKey=7d6a19fd-daa2-4c4b-aae0-ad7df2a32fa0&amp;CommunityKey=6b10df83-0b3c-4f92-8b1f-1fd80d0e7e58&amp;Home=%2fcommunity%2fuser%2fbusinessanalytics%2fcommunities%2fcommunity-home">Shaping the Future of Data Preparation and Modeling with Cognos Analytics</a></p><p>Remember to stay up to date on all <a href="https://community.ibm.com/community/user/businessanalytics/events/upcomingevents"><strong>IBM Business Analytics Community Events</strong></a>!</p><h3><strong>Watch</strong></h3><p><strong>Planning Analytics and Cognos Analytics</strong> are much more powerful when used together. Below, the IBM DTE Team has shared a new video demonstrating the value these platforms can have in improving cash position.</p><iframe src="https://cdn.embedly.com/widgets/media.html?src=https%3A%2F%2Fwww.youtube.com%2Fembed%2FRuZGsBXkS_0%3Fstart%3D1%26feature%3Doembed%26start%3D1&amp;display_name=YouTube&amp;url=https%3A%2F%2Fwww.youtube.com%2Fwatch%3Fv%3DRuZGsBXkS_0&amp;image=https%3A%2F%2Fi.ytimg.com%2Fvi%2FRuZGsBXkS_0%2Fhqdefault.jpg&amp;key=a19fcc184b9711e1b4764040d3dc5c07&amp;type=text%2Fhtml&amp;schema=youtube" width="854" height="480" frameborder="0" scrolling="no"><a href="https://medium.com/media/4fce1f5946d83f85fae36e7386235fa8/href">https://medium.com/media/4fce1f5946d83f85fae36e7386235fa8/href</a></iframe><p>If you find the above video helpful, I recommended checking out more on the <a href="https://www.youtube.com/channel/UCrVRMfpe968pW8vBU_hzplA"><strong>DTE YouTube Channel</strong></a>.There are videos on IBM Cloud Platform, Data Science and Business Analytics, Digital Business Automation, Watson AI and more!</p><h3>Connect</h3><p>Please feel free to reach out to schedule 1:1 discussions. I am happy to answer questions and strategize with you!</p><p><strong>E-mail —</strong> Emily.Rechan@ibm.com</p><p><strong>LinkedIn —</strong></p><p><a href="https://www.linkedin.com/in/erechan/">Emily Rechan - IBM Data &amp;amp; AI Experienced Technical Specialist - IBM | LinkedIn</a></p><p><strong>Remember to comment below with any feedback or topics you’d like our team to cover. Have a great weekend!</strong></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=a27cf7c83e5d" width="1" height="1" alt=""><hr><p><a href="https://medium.com/ibm-dcpe-group/weekly-round-up-a27cf7c83e5d">Weekly Round Up</a> was originally published in <a href="https://medium.com/ibm-dcpe-group">IBM DCPE Group</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[AI, Machine Learning and Deep Learning: Explained in 5 minutes]]></title>
            <link>https://medium.com/ibm-dcpe-group/ai-machine-learning-and-deep-learning-explained-in-5-minutes-8fc0318f5c6a?source=rss----ca16dfbb69a2---4</link>
            <guid isPermaLink="false">https://medium.com/p/8fc0318f5c6a</guid>
            <category><![CDATA[watson-studio]]></category>
            <category><![CDATA[machine-learning]]></category>
            <category><![CDATA[ai]]></category>
            <category><![CDATA[deep-learning]]></category>
            <category><![CDATA[blog]]></category>
            <dc:creator><![CDATA[Jacques Guillaume]]></dc:creator>
            <pubDate>Thu, 30 Jan 2020 16:53:36 GMT</pubDate>
            <atom:updated>2020-01-30T18:46:35.541Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/400/1*GVMaLLci5o3LGa6j08C6Lw.png" /></figure><p>AI, Machine Learning and Deep Learning, we have all heard of these terms in some capacity; however, if you find yourself to be one who is overwhelmed by the water hose of information, you are not alone.</p><p>As a Data &amp; AI Technical Seller, I am here to help guide you towards a clearer understanding of these concepts. The journey into data science is exciting and my goal is to break it down into bite-sized pieces for you.</p><p><strong>The story?</strong></p><p>The best way to learn something and make it memorable is to first understand where it came from.</p><p>Here is a brief history lesson — In 1959 while at IBM, Arthur Samuel, an American pioneer in the field of computer gaming and Artificial Intelligence, introduced “Machine Learning”. According to Wikipedia, the Samuel Checkers-playing Program was among the world’s first successful self-learning programs and an early demonstration of <a href="https://en.wikipedia.org/wiki/Artificial_intelligence">artificial intelligence</a> (AI).</p><p>An example of early AI deployment was in the entertainment industry with TIVO, a system that learned your preferences based on tv shows and movies that you watched. This system would then recommend a list of similar categories that may interest you. The more TV shows and movies you watched, the more defined and accurate the recommendations would be. Does this sound familiar? Netflix similarly uses this type of model.</p><p>As we can see, Machine Learning and AI are intertwined and sometimes it can be difficult to differentiate between the two, so, let’s define them.</p><p><strong>AI or ‘Artificial Intelligence’</strong> is a branch of computer science that studies and researches how to emulate human beings (more specifically, how to think) through reasoning. AI enables systems to understand human language with Natural Language Processing (NLP), Machine Learning and planning.</p><p><strong>Machine Learning</strong> is a subset of AI that focuses on using algorithms to provide the ability to learn without being explicitly programmed.</p><p>To get even more detailed, Machine Learning has three methods:</p><p><em>· </em><strong><em>Supervised machine learning</em></strong></p><p>The method or system that uses some past, or labeled, data. Supervised Machine Learning is used when we know the output of the data. It conducts an iterative process of analyzing data without human intervention. The methods used are regression and classification.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/192/1*-jweSF6qNn_x-Q0NRY5iqQ.png" /></figure><p>As an example, any weather application uses the supervised method to provide a forecast. It uses regression analysis by taking into account known historic weather patterns and combining those with current conditions to predict the weather.</p><p>·<em> </em><strong><em>Unsupervised Machine learning</em></strong></p><p>This type of machine learning uses a method of clustering to work with the data. This is process is based on the similarity of the data ingested and then grouping that data.</p><p>Yes, you’ve likely seen this process at work with Twitter, Facebook, Snapchat, and more.</p><p>Unsupervised Machine Learning works to study and understand the meaning behind unlabeled data and then classifies it through algorithms; therefore, a sequence of successful decisions will result in the process being “reinforced” because it best solves the problem at hand. Unsupervised learning can determine the outcome when there is a massive amount of data. In this case, the developer doesn’t know the context of the data being analyzed, so labeling isn’t possible.</p><p>Unsupervised learning can be used as step one, before passing the data to a supervised learning process.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/237/1*3db5pCA83atMj3IC7qRhqQ.png" /></figure><p>IBM Watson uses this form of Machine Learning in healthcare by collecting a large amount of data about a specific disease. This provides doctors the ability to gain insights into patterns of symptoms and attempt to predict the outcomes for a given patient.</p><p>· <strong><em>Reinforcement Learning or semi-supervised Machine Learning</em></strong></p><p>In this system, some parts will be labeled, and some will not. The way it works is based on <em>past</em> data acquired, which then allows the machine learning model to make sense of any <em>new</em> data ingested.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/281/1*XVQOy2K-PwzWCj5n_tcdwA.png" /></figure><p>One way to think of this is as a behavioral learning model, meaning this system learns through trial and error. For example, Elon Musk’s Teslas embody this type of machine learning. As you can imagine training a self-driving car is no small feat, and the margin for error needs to be at an all-time low since this is literally a matter of life or death. However, over time “with enough trial and error”, and after acquiring more data, the algorithm (likely) will be optimized to a point where we may see full-fledged automated vehicles in our day to day commute.</p><p><strong>Deep Learning</strong></p><p>We can’t talk about machine learning and AI without mentioning deep learning, and deep learning was pretty much born through the booming explosion in data, specifically with unstructured data like digital pictures, streaming data (audio and video), social media feeds, MRI, and IOT (Internet of Things). In essence, this is a huge part of Machine Learning that incorporates Neural Networks dedicated to mimic the human brain through a series of algorithms that allow computers to be trained to deal with high levels of complex and ambiguous problems.</p><p>Now that we have explored these concepts, my hope is that you feel more familiar with the terms, have a clear understanding of how they are connected to each other and can identify the value each has on our lives and futures.</p><p>Stay tuned for my next post as I dig a little deeper, talk about IBM Watson Studio and how I have seen IBM shaping the world as a leader in Data Science and Machine Learning offerings.</p><p>With the power of AI, Machine Learning and Deep learning IBM is helping to transform business processes and modernize operations through IBM Watson Studio, have a glimpse:</p><p><a href="https://www.ibm.com/cloud/watson-studio">https://www.ibm.com/cloud/watson-studio</a></p><p><strong>Written by:</strong></p><p>Jacques Guillaume, IBM</p><p>Editor :</p><p>Emily Rechan, Linda Snow</p><p><a href="https://medium.com/ibm-dcpe-group?source=post_sidebar--------------------------post_sidebar-">Data &amp; AI @ IBM</a></p><p><em>Disclaimer: The views expressed in this publication represent those of the author and not of IBM.</em></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=8fc0318f5c6a" width="1" height="1" alt=""><hr><p><a href="https://medium.com/ibm-dcpe-group/ai-machine-learning-and-deep-learning-explained-in-5-minutes-8fc0318f5c6a">AI, Machine Learning and Deep Learning: Explained in 5 minutes</a> was originally published in <a href="https://medium.com/ibm-dcpe-group">IBM DCPE Group</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
    </channel>
</rss>