<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0" xmlns:cc="http://cyber.law.harvard.edu/rss/creativeCommonsRssModule.html">
    <channel>
        <title><![CDATA[Stories by Roland Harvey on Medium]]></title>
        <description><![CDATA[Stories by Roland Harvey on Medium]]></description>
        <link>https://medium.com/@rolymo?source=rss-8c02b13ad30b------2</link>
        <image>
            <url>https://cdn-images-1.medium.com/fit/c/150/150/1*uGzWdW8NsY6fVRabuBiBNQ.jpeg</url>
            <title>Stories by Roland Harvey on Medium</title>
            <link>https://medium.com/@rolymo?source=rss-8c02b13ad30b------2</link>
        </image>
        <generator>Medium</generator>
        <lastBuildDate>Fri, 20 Nov 2026 06:12:07 GMT</lastBuildDate>
        <atom:link href="https://medium.com/@rolymo/feed" rel="self" type="application/rss+xml"/>
        <webMaster><![CDATA[yourfriends@medium.com]]></webMaster>
        <atom:link href="http://medium.superfeedr.com/" rel="hub"/>
        <item>
            <title><![CDATA[Business becomes data and data becomes the business]]></title>
            <link>https://medium.com/@rolymo/business-becomes-data-and-data-becomes-the-business-b803a9833652?source=rss-8c02b13ad30b------2</link>
            <guid isPermaLink="false">https://medium.com/p/b803a9833652</guid>
            <category><![CDATA[digital-transformation]]></category>
            <dc:creator><![CDATA[Roland Harvey]]></dc:creator>
            <pubDate>Thu, 17 Aug 2017 10:10:55 GMT</pubDate>
            <atom:updated>2017-08-17T10:10:55.152Z</atom:updated>
            <content:encoded><![CDATA[<h4>Digital Experience Management requires a new twist on user focused application analytics.</h4><p>Author — <a href="https://www.ca.com/en/blog-highlight/author/vikipaige">Viki Paige</a></p><p>Just about every enterprise today is going through some sort of digital transformation. For most customers, it’s about surviving, but for many, it’s also about disrupting and leading. Software and customer experience are the new competitive edge. Managing availability and performance is now a key measure of business success or failure. Digital transformation guarantees two things: more change and more data.</p><p>As the sea of real-time operational data is growing exponentially, there is an even greater need to turn this data into answers to safeguard an uninterrupted digital experience for customers. To ensure availability and performance of every user, every app, everywhere, enterprises today typically own 10–25 different tools to monitor their production stack of apps, network and infrastructure.</p><p>Given the hyper-complexity of today’s application environments and the tech stacks they run on, an all-in-one monitoring and cross-tier analytics approach known as <a href="https://www.ca.com/us/collateral/industry-analyst-report/ca-digital-experience-insights-a-new-twist-on-user-focused-application-analytics-and-management.html">Digital Experience Management</a> has emerged as a new requirement. It’s no longer humanly possible to drill into multiple dashboards, research a variety of alerts and search through thousands of log files to discover root cause in the few minutes you have between initial degradation and severe user impact.</p><p>EMA’s latest research on Digital Experience Management has this to say about the topic: “Digital Experience Management (DEM) shines a spotlight on both the expanded relevance of IT and the pressure on the IT organization to justify itself and perform efficiently in what is now popularly called the digital age.”1</p><p>In this new digital age, the business becomes data and data becomes the business. Information on customer experience becomes the most important corporate asset. The only thing that matters is the ability to create, capture and harness value from information with a new class of digital experience management tools. To learn more about Digital Experience Management, read EMA Research’s recent brief: <a href="https://www.ca.com/us/collateral/industry-analyst-report/ca-digital-experience-insights-a-new-twist-on-user-focused-application-analytics-and-management.html">CA Digital Experience Insights: A New Twist on User-Focused Application Analytics and Management.</a></p><p><em>1 EMA, “User, Customer, and Digital Experience: Where Service and Business Performance Come Together,” February 2017.</em></p><p><em>Originally published at </em><a href="https://www.ca.com/en/blog-highlight/business-becomes-data.html"><em>www.ca.com</em></a><em>.</em></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=b803a9833652" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[MiFID II: The clock is ticking for Financial Services]]></title>
            <link>https://medium.com/@rolymo/mifid-ii-the-clock-is-ticking-for-financial-services-55c2253bbbd4?source=rss-8c02b13ad30b------2</link>
            <guid isPermaLink="false">https://medium.com/p/55c2253bbbd4</guid>
            <category><![CDATA[high-frequency-trading]]></category>
            <category><![CDATA[bitcoin]]></category>
            <category><![CDATA[mifid-ii]]></category>
            <category><![CDATA[splunk]]></category>
            <category><![CDATA[financial-services]]></category>
            <dc:creator><![CDATA[Roland Harvey]]></dc:creator>
            <pubDate>Tue, 01 Aug 2017 00:00:00 GMT</pubDate>
            <atom:updated>2017-08-08T13:49:39.953Z</atom:updated>
            <content:encoded><![CDATA[<p>Author — <a href="https://www.splunk.com/blog/author/halseaidy.html">Haider Al-Seaidy</a></p><p>As the deadline for <a href="https://www.esma.europa.eu/policy-rules/mifid-ii-and-mifir">MiFID II</a> nears, financial institutions and trading venues are ramping up their efforts to put in place the technology, processes and procedures required to be compliant on 3rd January 2018.</p><p>Many have left it very late, partly due to the lack of clarity in the regulation. As one large financial services organisation told us the other day, it’s like a moving target.</p><p>Transparency, reporting and traceability underpin many of <a href="https://www.esma.europa.eu/sites/default/files/library/2015/11/2015-esma-1464_annex_i_-_draft_rts_and_its_on_mifid_ii_and_mifir.pdf">MiFID II’s Regulatory Technical Standards</a> (RTS). Including, requiring an accurate record trail of events for audit and compliance.</p><p>Accurate timestamping on financial transactions and messages involved in a trade life-cycle is a must, because this is essential for conducting cross-venue monitoring of orders, and detecting instances of market abuse. It also allows for a clearer comparison between the transaction and market conditions prevailing at the time of execution.</p><p>RTS 25 stipulates the following:</p><p>Operators of trading venues, and their members or participants, shall establish a system of traceability of their business clocks to UTC.</p><p>Operators of trading venues, and their members or participants, shall be able to provide evidence that their systems meet the requirements.</p><p>The allowable tolerances of time drift of the business clocks stipulated by MiFID II is tight, and due to clocks being synced to a central time source over a network, there will always be network fluctuations causing clock drift. Depending on the transaction type, granularity of the timestamp will differ, as well as the maximum allowable divergence from UTC as follows:</p><ul><li>High Frequency Trading Operations</li><li>100 microsecond maximum divergence from UTC</li><li>1 microsecond granularity</li><li>General Automated Trading Operations</li><li>1 millisecond maximum divergence from UTC</li><li>1 millisecond granularity</li></ul><figure><img alt="" src="https://cdn-images-1.medium.com/max/622/0*GwbQHe0Hc_yCJhoI.png" /></figure><p>Reportable events, such as servers with clock drift beyond the tolerable thresholds and impacted trades, must be made available to regulators either continuously or on-demand with a five year history. Using established protocols such as NTP and PTP, point monitoring solutions can be leveraged to report on clock drift across the infrastructure. However, identifying trades that have potentially been impacted with inaccurate timestamps is more difficult.</p><p>A Global Swiss investment bank, aware of the challenges associated with becoming MiFID II compliant, was able to quickly prototype a solution to address the various reporting and monitoring requirements with Splunk in days instead of weeks. Ofni Thomas, in charge of Global Monitoring within the Low Latency Organization, stated that “Building a bespoke solution integrating disparate data sources to address the regulatory reporting requirements of the different MiFID II RTS’s would take months of dedicated resource time to develop, which could be easily achievable in days or weeks with Splunk”</p><p>As a platform that is able to ingest and visualise all types of machine-generated data, Splunk is well placed to report on clock drift across the trading infrastructure. Offering capabilities to correlate PTP and NTP time sources with trade messages (e.g. FIX), this gives trading venues and regulators a consolidated view of their compliance posture. Clock jitter can be visualised and alerts automatically raised in real-time when drift exceeds allowable limits.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*eErf3ksyhlDthy4X.png" /></figure><p>The screenshot above shows how it’s possible to quickly isolate trades (yellow) that may have inaccurate timestamps due to excessive clock drift (blue), for further investigation and reporting to the regulators. The dashboard also highlights trades that have a different price from the Market National Best Bid and Offer (NBBO, or EBBO for the European market), due to inaccurate clocks.</p><p>Check out a full demo which is based on a real example with a large trading firm here:</p><p>Ingesting trade messages and clock drift data into Splunk to become compliant with RTS 25 can open many other unintended areas of optimisation. Banks often struggle to troubleshoot failed trades due to complex workflows and disparate systems. Troubleshooting the why and where a trade failed can take a significant amount of manual effort and time to rectify. Splunk can reduce the time to investigate failed trades down to minutes, ensuring fewer failed transactions. Check out the <a href="https://www.splunk.com/blog/2017/02/06/data-driven-insights-into-performance-availability-and-compliancy-of-a-fx-service.html">ITSI workshop we ran in London</a> late last year for providing visibility into compliance, performance and availability of an FX trading application.</p><p>If you’re interested in hearing how we can help you with MIFID II compliance (not just RTS 25 but also others), you can Ask An Expert: <a href="https://www.splunk.com/en_us/ask-an-expert.html">https://www.splunk.com/en_us/ask-an-expert.html</a></p><p>To see what else you can do with FIX data and Splunk, checkout this great demo, <a href="https://www.splunk.com/en_us/resources/video.B5aWlqOTE63appHXCn-are8WzE1aEH6j.html?utm_campaign=mifidblog&amp;utm_source=mifidblog&amp;utm_medium=organic">here</a>. Or view Duncan’s presentation on processing FIX data <a href="https://conf.splunk.com/sessions/2016-sessions.html#search=fix&amp;">here</a>.</p><p>Thanks for reading.</p><p><em>Originally published at </em><a href="https://www.splunk.com/blog/2017/08/01/mifid-ii-the-clock-is-ticking-for-financial-services.html"><em>www.splunk.com</em></a><em> on August 1, 2017. Want more help with data analytics visit </em><a href="http://www.cssdelivers.com/"><em>www.cssdelivers.com</em></a></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=55c2253bbbd4" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Splunking Microsoft Cloud Data: Part 1]]></title>
            <link>https://medium.com/@rolymo/splunking-microsoft-cloud-data-part-1-a9febebf88a9?source=rss-8c02b13ad30b------2</link>
            <guid isPermaLink="false">https://medium.com/p/a9febebf88a9</guid>
            <category><![CDATA[azure]]></category>
            <category><![CDATA[data-analytics]]></category>
            <category><![CDATA[cloud-services]]></category>
            <category><![CDATA[nodejs]]></category>
            <category><![CDATA[microsoft]]></category>
            <dc:creator><![CDATA[Roland Harvey]]></dc:creator>
            <pubDate>Thu, 27 Jul 2017 00:00:00 GMT</pubDate>
            <atom:updated>2017-07-28T09:13:32.115Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*YJaTRz8oDF_Poer4bnWlig.png" /></figure><p>Author — <a href="https://www.splunk.com/blog/author/rlait.html">Ryan Lait</a></p><p>So, you’ve got Office365, Azure, EOP, EOL and a shopping trolley full of Microsoft Cloud Services. What now?</p><p>This is <strong>Part 1</strong>, in a series of step-by-step guides for accessing, configuring and retrieving all the valuable intel from Microsoft Cloud Services. Microsoft are finally coming to the party and opening up more and more API endpoints for their cloud services. We’ll start with some of the common sources that are easily configurable using the Splunk Add-on for Microsoft Cloud Services, and in later posts we’ll cover some other sources including mail logs, EOP reports, threat intel and billing data.</p><h4>Part 1: Office365 Management Logs and Azure Audit Logs</h4><p>Some things required along the way:</p><p><strong>Splunk Add-on for Microsoft Cloud Services</strong></p><ul><li>Redirect URL</li><li>Certificate (Auto-generated or Self-signed)</li></ul><p><strong>Azure AD Application</strong></p><ul><li>Application ID (Client ID)</li><li>API Key</li><li>Tenant ID</li><li>Subscription ID</li></ul><p>1) Install the Splunk Add-on for Microsoft Cloud Services</p><p><a href="https://splunkbase.splunk.com/app/3110/">https://splunkbase.splunk.com/app/3110/</a></p><p>2) Inside the Add-on, open the <strong>Configuration</strong> tab, then click <strong>Add Account</strong></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/969/0*ZxqON_uOetjzjhuz.png" /></figure><p>3) Copy the <strong>Redirect URL</strong>. — We’ll need this shortly!</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/374/0*TXhhbL7i8-RMtM_q.png" /></figure><p>If your data collection node does not have a Splunk Web UI, use</p><pre><strong>http://&lt;host:port&gt;/enUS/app/Splunk_TA_microsoft-cloudservices/redirect</strong></pre><p><strong>Create an Azure Active Directory Application</strong></p><p>An Azure Active Directory application is required to allow Splunk to read information from Azure. The application provides permissions and API access to data for your subscription.</p><p>Log in to your Azure Account through the <a href="https://portal.azure.com/">Azure portal</a>.</p><p><a href="https://portal.azure.com/">https://portal.azure.com/</a></p><p>4) Select <strong>Azure Active Directory</strong>.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/193/0*jM6cKeVSw_d5-mP6.png" /></figure><p>5) Select <strong>App Registrations</strong></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/214/0*1saQEIuVZauIJShw.png" /></figure><p>6) Select <strong>New Application Registration</strong></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/649/0*9D41n5U7BJhAihYn.png" /></figure><p>7) Enter a <strong>Name</strong>, Select <strong>Web app / API</strong> and enter a <strong>Sign-on URL. </strong>Select <strong>Create</strong></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/280/0*2ws49l1gNQ3_IajB.png" /></figure><p><strong>Note: </strong>Sign-on URL does <strong>NOT </strong>have to be an active URL. The App registration requires the field populated with a value.</p><p>8) Select the application you just created</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/969/0*qtWvt2zrVx1y1cwT.png" /></figure><p>9) Select <strong>Reply URLs</strong>, insert your <strong>redirect URL</strong> from step 3. Select <strong>Save</strong></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/969/0*af6xZhajScH2Rwdy.png" /></figure><p>10) Copy<strong> Application ID</strong> (Client ID) — We’ll need this shortly!</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/969/0*nWT3gfI52KLtUEpP.png" /></figure><p>11) Select <strong>Keys, </strong>Enter <strong>Description </strong>and <strong>Duration</strong>. Select <strong>Save</strong>. Once saved, Copy<strong> key</strong> value. — We’ll need this shortly too!</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/969/0*t_R5zepGPjhVQXKn.png" /></figure><p>12) In Azure Active Directory, Select <strong>Properties</strong>. Copy<strong> Directory ID </strong>(Tenant ID) — We’ll need this shortly!</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/969/0*FnUOZDtuj6JhTTXI.png" /></figure><p><strong>Assign Application to Subscription Role</strong></p><p>13) Select <strong>Subscriptions</strong> from the side menu</p><p>14) Select your <strong>Subscription</strong>, Select <strong>Access Control (IAM)</strong>, Select <strong>Add</strong>, Select <strong>Reader Role</strong>, search for <strong>Application Name</strong>, Select <strong>Application</strong></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/969/0*bYnOOi4cagDxqM9L.png" /></figure><p><strong>Add permissions to your Active Directory Application</strong></p><p>The application you created needs permissions to read information the Add-on is configured to retrieve. This includes reading activity reports, activity data and service health information for the specified subscription.</p><p>15) Select your application from <strong>Azure Active Directory </strong>&gt;<strong> App Registrations</strong></p><p>16) Select <strong>Required Permissions</strong>, then select <strong>Add</strong></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/969/0*8W4jJ06gIzWWeQ6t.png" /></figure><p>17) <strong>Select an API</strong>, Select <strong>Windows Azure Service Management API</strong>. Press <strong>Select</strong></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/486/0*Qmnnxp_R86D4zuQA.png" /></figure><p>18) <strong>Select Permissions</strong>, Select <strong>Access Azure Service Management as organisation users</strong> under Delegated Permissions. Press <strong>Select</strong></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/727/0*7KGYkuMy5_mUUFDJ.png" /></figure><p>19) <strong>Select an API</strong>, Select <strong>Office 365 Management APIs</strong>. Press <strong>Select</strong></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/581/0*bnNoCF_4-5D5cEvX.png" /></figure><p>20) <strong>Select Permissions</strong>, For <strong>BOTH </strong>Application and Delegated Permissions, <strong>Select</strong></p><p>· Read activity reports for your organisation</p><p>· Read activity data for your organisation</p><p>· Read service health information for your organisation</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/581/0*LoxfvmMQXCqN-FJm.png" /></figure><p>21) Ensure permissions have been saved correctly</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/969/0*mLrzJfdP-WZUXdUY.png" /></figure><p><strong>Connect accounts using Splunk Web</strong></p><p>With Azure configured, we can now add an account that will be used by the inputs.</p><p>22) Open a new browser, or a private browsing session. Existing sessions or cached data could cause O365 sign-on issues.</p><p>23) In the add-on, then Select <strong>Configuration</strong> &gt; <strong>O365 Account &gt;</strong> <strong>Add Account</strong>.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/969/0*GuAOAnTZYCfeAXkd.png" /></figure><p>24) Enter <strong>Friendly Name</strong>, <strong>Client ID </strong>(Step 11), <strong>API Key </strong>(Step 12). Select <strong>Add</strong></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/969/0*FQP5W-E7abuBrZ4j.png" /></figure><p>25) A Microsoft Sign-in page should appear. Enter your <strong>Azure Credentials</strong>.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/524/0*gj7AzAqzkeSn20cc.png" /></figure><p>26) If the Azure configuration has been done correctly, you should see this page. Select <strong>Accept</strong></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/461/0*d2kwdpqGO1VGolOF.png" /></figure><p>If successful, the account will be added to the configuration</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/999/0*Mh8bwKJGYJPckrx8.png" /></figure><p><strong>Add Azure App Account</strong></p><p>27) In the add-on, then Select <strong>Configuration</strong> &gt; <strong>O365 Account &gt;</strong> <strong>Add Account</strong>.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/969/0*VQmdf9ijMP6IFOZy.png" /></figure><p>28) Enter <strong>Friendly Name</strong>, <strong>Client ID </strong>(Step 11), <strong>API Key </strong>(Step 12), <strong>Tenant ID</strong> (Step 13), Select <strong>Add</strong></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/969/0*uh9yC7jeb775EPqN.png" /></figure><p>If successful, the account will be added to the configuration</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/969/0*bXj3rv8rDqpJ8-qQ.png" /></figure><p><strong>Configure Certificate</strong></p><p>The certificate is used to enable service-to-service calls, which allow you to avoid reconfiguring authorization tokens if they expire. You can either use an auto-generated certificate or a self-signed certificate.</p><p>29) In the Add-on, Select <strong>Configuration</strong>, <strong>Certificate</strong>, Select <strong>Generate</strong> under <strong>Option 2</strong></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/837/0*QPDscrvQL3fTPOoX.png" /></figure><p>30) Copy<strong> </strong>the <strong>credentials</strong> to your clipboard. We’ll need this shortly!</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/678/0*Z89L4VlOXhe8ivvH.png" /></figure><p>31) Navigate to your Registered App in Azure. <strong>Azure AD &gt; App Registration &gt; App</strong>. Select <strong>Manifest</strong></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/629/0*7kl8XATetuNRzlP6.png" /></figure><p>32) Locate the <strong>keyCredentials </strong>stanza. Paste<strong> certificate</strong> <strong>BETWEEN </strong>square brackets.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/656/0*hRejlgt8LrZAD6o6.png" /></figure><p>33) Delete <strong>duplicate</strong> code( <strong>“keyCredentials”: [</strong></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/769/0*ZVDGA3V0G7IoCiGT.png" /></figure><p>34) <strong>Delete </strong>duplicate “]” from the end</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/248/0*E9sg8ba7gfULb-rB.png" /></figure><p>Should look similar to this:</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/969/0*sMaDQYZxpp368YjM.png" /></figure><p>35) If configured correctly, the <strong>O365 Troubleshooting </strong>page will show the following:</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/969/0*C-T9nLsx0g1q-qH3.png" /></figure><p>If errors are detected or the status shows as invalid, restart Splunk.</p><p><strong>Configure the Inputs</strong></p><p>Now that we’ve created our AD app and have working credentials, we can configure the inputs.</p><p>36) Select <strong>Inputs</strong> <strong>&gt; Create New Input &gt; Azure Audit</strong></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/968/0*CtYBmXyrtGiVgPak.png" /></figure><p>37) Enter <strong>Name</strong>, specify <strong>Account</strong>, <strong>Subscription ID</strong> and <strong>Index</strong>. If required, modify the start time and interval. Select <strong>Add</strong>.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/678/0*IW-YUvNjUjHfaTPE.png" /></figure><p>38) Repeat <strong>Step 37 </strong>and select <strong>Office 365 Management APIs</strong>. Enter <strong>Name</strong>, specify <strong>Account</strong> and <strong>Index</strong>. If required, modify the data source intervals. Select <strong>Add</strong>.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/678/0*JVRdr6Bk-SOPeOFB.png" /></figure><p>39) Once inputs are configured, data should be populated in the <strong>mscs:azure:audit</strong> and <strong>ms:o365:management</strong> sourcetypes.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/678/0*cGGxdjKHG9hhe9_I.png" /></figure><p>Now we’ve got the data coming in, check out some examples of what we can use it for:</p><p>Office365 Service Status:</p><pre>sourcetype=&quot;ms:o365:management&quot; StatusDisplayName=* | stats first(FeatureStatus{}.FeatureServiceStatusDisplayName) AS Status by WorkloadDisplayName | rename WorkloadDisplayName AS Workload</pre><figure><img alt="" src="https://cdn-images-1.medium.com/max/969/0*mfu-STvYsCiL3y5u.png" /></figure><p>OneDrive Operations:</p><pre>sourcetype=&quot;ms:o365:management&quot; Workload=OneDrive | stats count by UserId, Operation</pre><figure><img alt="" src="https://cdn-images-1.medium.com/max/969/0*BRwblLb3ceorbIYv.png" /></figure><p>File Activity Investigation:</p><pre>sourcetype=&quot;ms:o365:management&quot; Workload=* | dedup file_name, user, file_path, ClientIP | table _time file_name user EventSource file_path ClientIP action | rename user AS User EventSource AS App file_path AS &quot;File Path&quot; ClientIP AS &quot;Client IP&quot; action AS Action</pre><figure><img alt="" src="https://cdn-images-1.medium.com/max/969/0*ZT6Ge4qy5K0zZUT2.png" /></figure><p>Stay tuned for <strong>Part 2</strong>!</p><p><em>Originally published at </em><a href="https://www.splunk.com/blog/2017/07/27/splunking-microsoft-cloud-data-part-1.html"><em>www.splunk.com</em></a><em> on July 27, 2017.</em></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=a9febebf88a9" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[MSP’s. Stop with the “Break Fix” model]]></title>
            <link>https://medium.com/@rolymo/msps-stop-with-break-fix-model-154b573c8649?source=rss-8c02b13ad30b------2</link>
            <guid isPermaLink="false">https://medium.com/p/154b573c8649</guid>
            <category><![CDATA[apm]]></category>
            <category><![CDATA[data-analytics]]></category>
            <category><![CDATA[saas]]></category>
            <category><![CDATA[infrastructure]]></category>
            <category><![CDATA[msp]]></category>
            <dc:creator><![CDATA[Roland Harvey]]></dc:creator>
            <pubDate>Wed, 19 Jul 2017 11:35:38 GMT</pubDate>
            <atom:updated>2017-07-19T11:52:10.421Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*Qw-HrIXBxw9nqav7pXxtOQ.jpeg" /></figure><h4>MSP’s and customers need to grow up.</h4><p>In the age of collaboration, MSP’s and customers need to grow up.</p><p>Wait, before I get flamed, I will point out, that there are some very modern progressive Managed Service Providers in the world who provide amazing services to their customers. And likewise, some customers realise the limits of their employee’s IT knowledge and partner with MSP to help them achieve their business goals, more efficiently.</p><p>But honestly, if you are an MSP and are reliant on a “break fix” model you have a limited life span and a limited universe to operate within.</p><h4>Problem with Break Fix</h4><p>While you will make some money, your <strong>margins</strong> will be forever <strong>diminishing</strong>, as customers <strong>squeeze</strong> the contract value and thus your margin because break fix is a commodity. There are lots of companies offering it.</p><p>Break fix is highly <strong>competitive</strong>. There is always someone who will do it better and cheaper for your customers, thus reducing your margins and in the end forcing you deliver a less than stellar experience which ultimately makes you customers leave. So why focus on break fix.</p><p>Customers are rarely after just “break fix”. And if they say they are, they either don’t have much money or don’t understand how IT can help them achieve their business goals. They see IT as a cost centre rather than helping achieve business value. The other reason could be that you’re selling the value all wrong. Break fix is just one element.</p><p>Move on and spend your time with customers who want more than Break fix. Strive to understand their business, understand how you can help them be more competitive in their market. Then work with them to help them deliver a <strong>better service</strong>, the <strong>best customer experience</strong>, by harnessing technology. Providing solutions that are different to the norm, ensures customers are more <strong>sticky</strong> and give rise to <strong>multi year contracts</strong>, increased profit margins.</p><p>Customers, these days live in a SaaS world, whether they use SaaS solutions or not, they expect their technology stacks just to work. Platforms to be stood up and torn down in seconds. Infrastructure is seen as a commodity. Companies scale up or down as the business requires. Look at Google or Amazon. Their compute power just scales according to customer demand. That’s why it’s so popular. It’s just too easy.</p><p>And here’s the crunch. Its all about the <strong>business service</strong> that sits on top of the infrastructure.</p><p>If that business service degrades, the preverbal hits the fan. Why? Because it’s seen as directly impacting the bottom line. So MSP’s need to step up and provide that controlled commoditised compute power/datacentre as a given and focus more on managing the business service and ensuring that is meeting SLA’s.</p><p>Customers are far more willing to <strong>pay money</strong> against uptime and guaranteed <strong>performance of their business service</strong> than anti virus updates, backup monitoring and RMM and the utilisation of servers.</p><p>I have been to numerous monthly and quarterly service reviews showing the performance of servers, memory, network availability, and it’s all dull and meaningless. Managers eyes glaze over as I show how many closed tickets you managed this month.</p><p>Talk about the performance of their legal case management system and how you could decrease the wait time for operators by 50% and managers are all ears. It’s an impact to a major business service used across by the customer.</p><p>Also, customers are willing to <strong>pay</strong> for <strong>insight</strong> into their services. To see the overall <strong>health</strong> and <strong>performance</strong> and being able to drill down, seeing elements of the business service is crucial to line-of-business (LoB) owners. As an MSP, you can offer that value add service on a monthly basis. Using data analytics helps hugely in this area.</p><h4>It’s all about the business outcome</h4><p>It’s is all about the <strong>business outcome</strong>. Challenge yourself. Can you, in partnership with your customer provide a win win valuable service that helps your customer improve their business, <strong>NOT</strong> can you make sure their IT is working (yawn) and make a few bucks at the same time.</p><p>For more info on how you can make your MSP business more valuable to your customers visit <a href="http://www.cssdelivers.com/">www.cssdelivers.com</a>.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=154b573c8649" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Analytics and Evolving Landscape of Machine Learning for Intelligent Applications]]></title>
            <link>https://medium.com/@rolymo/analytics-and-evolving-landscape-of-machine-learning-for-intelligent-applications-7653ad35f222?source=rss-8c02b13ad30b------2</link>
            <guid isPermaLink="false">https://medium.com/p/7653ad35f222</guid>
            <category><![CDATA[agile]]></category>
            <category><![CDATA[machine-learning]]></category>
            <category><![CDATA[data-analytics]]></category>
            <dc:creator><![CDATA[Roland Harvey]]></dc:creator>
            <pubDate>Tue, 11 Jul 2017 00:00:00 GMT</pubDate>
            <atom:updated>2017-07-14T09:18:17.358Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/960/1*pSMlHsV2lPs0Dl6nyzsbPg.jpeg" /></figure><h4>The goal of embedding intelligence into an application is to help users make better decisions faster, especially in times of crisis.</h4><p>How do you quantify benefits when designing the “best” experience? How can you measure and drive maximum engagement and value? Interesting proposition! One measurement of success is to track the amount of time a user spends using an application. Applications are built with the hope that users log in every day — multiple times per day — and spend a significant portion of their time using it. Because we all know if users aren’t using that ‘killer app’, it’s because it provides no value with regard to time, cost or efficiency.</p><p>Our operational intelligence agile scrum development team recently discussed what “using” means: a) do we build an application with great visualization, many bells, whistles and configuration options that encourage users to remain on the app or; b) do we build a low touch, intelligent application where users are not expected to spend significant time within the application. What would drive higher customer satisfaction and NPS scores?</p><p><strong>Machine Learning and Operational Intelligence</strong></p><p>The goal of embedding intelligence into an application is to help users make better decisions faster, especially in times of crisis. A well implemented intelligent application helps focus the user on preventing a critical event, and if a problem occurs, enabling it to be resolved quickly — reducing both MTTD (Mean Time to Detect) and MTTR (Mean Time to Resolve). Embedded <a href="https://www.ca.com/us/products/mainframe-operations-intelligence.html">operational intelligence</a> can also provide significant value even if users never log in. They would simply receive email notifications when problems are resolved or when operations are steering out of norm and what to do about it to restore normalcy. Even better, what if that resolution guidance was ‘automagically’ executed?</p><p>In his blog titled <a href="http://hbr.org/2013/12/analytics-30">Analytics 3.0</a>, Thomas Davenport does a great job explaining the evolution of Analytics over the last couple of decades. We have truly arrived in the age of machine learning and problem prediction. A good real world example of this evolution is the navigation systems we use. Prior to a world where every device is connected, learning every minute and GPS enabled; printed paper maps helped people navigate to their destination. In order to improve the user experience, maps were designed to highlight places of interest, and create dedicated maps for high interest areas. However, most of these maps were intended for expert users who knew what they were looking for, where they were going and most importantly had significant experience reading maps.</p><p>Then came the electronic GPS. GPS applications took all the geo location data that had already been collected, combined with the power of GPS to provide near real time feedback on progress and traffic. The application was now intelligent enough to provide analysis on-demand on the best route to a destination and in times of any event, the best alternate route. The focus on user experience was around ease of data entry and the speed of response to events on the road. The users still required some level of expertise in knowing what to look for and where they were headed.</p><p>In todays connected world, expecting users to know what they are looking for before an event seems a big stretch. Now every phone is a portable GPS device and combined with software on the phone that utilizes map data, real time traffic streams from others in the community, the devices even suggests routes based on the user’s calendar or daily routine. The device had become low touch and usable by anyone who can speak to it with no other skills required. Real expert systems! It is almost certain that these intelligence navigation apps will be utilized by fully automated self driven cars that can take a person from point A to point B without any input from the user. Machine learning at its best!</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*vldj-YhYO3GrXnMC.png" /></figure><p><strong>Bringing Machine Learning to Mainframe</strong></p><p>As it relates to the intelligent app mentioned at the beginning of this blog, CA Technologies has delivered the next generation intelligence platform focused on enterprise systems and database performance monitoring from mobile to mainframe. We are designing solutions that address the needs of users, ranging from domain experts to recent grads, with an intelligence platform that supports users of enterprise mission critical applications to make better decisions faster. These solutions guide users through a similar evolution cycle where <em>experts</em> utilize easily accessible reports to understand what just happened, <em>specialists</em> are provided simple data discovery tools to also identify why it happened, and <em>junior staff</em> are guided to a resolution — the entire system is designed to facilitate easy collaboration across the entire operations team. We believe the ideal end state is to support zero touch applications where performance monitors are intelligent enough to respond to most events. Just like self-driven cars the path to such intelligent applications lies in every organization embracing analytics and evolving their plans to deploy “low touch” self sustaining solutions. We think its possible to make identifying the root cause of an active issue as easy as the notification from your phone informing you that if you don’t get on the road now your going to miss that dinner appointment!</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/780/0*z-nS_FY-goIpEZyu.jpg" /></figure><p>What do you think? What’s your opinion? I’d love if you would join the conversation!</p><p>To learn more, <a href="https://www.ca.com/us/company/events/webcasts/mainframe.html">watch this webcast</a> on Machine Learning for the Modern Software Factory.</p><p><em>Originally published at </em><a href="http://blogs.ca.com/2017/07/11/analytics-and-evolving-landscape-of-machine-learning-for-intelligent-applications/"><em>blogs.ca.com</em></a><em> on July 11, 2017. For more information on how data analytics can help you deliver real world business impacting business outcomes visit </em><a href="http://www.cssdelivers.com/"><em>www.cssdelivers.com</em></a></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=7653ad35f222" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[5 Data Sources That Turn APM Data Into Application Performance Analytics]]></title>
            <link>https://medium.com/@rolymo/5-data-sources-that-turn-apm-data-into-application-performance-analytics-d61b2e899475?source=rss-8c02b13ad30b------2</link>
            <guid isPermaLink="false">https://medium.com/p/d61b2e899475</guid>
            <category><![CDATA[data-analytics]]></category>
            <category><![CDATA[apm]]></category>
            <category><![CDATA[machine-data]]></category>
            <category><![CDATA[devops]]></category>
            <dc:creator><![CDATA[Roland Harvey]]></dc:creator>
            <pubDate>Wed, 28 Jun 2017 00:00:00 GMT</pubDate>
            <atom:updated>2017-07-13T11:55:39.590Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*ZlVXlyaHFjahj16w.jpg" /></figure><p>Author — <a href="https://www.splunk.com/blog/author/wemmett.html">Bill Emmett</a></p><p>Applications are critical to the success of any organization. But are you doing everything you can to optimize them? Here are five data sources that can help you deliver better applications in less time. Check out the <a href="https://www.splunk.com/en_us/form/essential-guide-to-machine-data-user-and-application-data.html">Essential Guide to Machine Data: User and Application Machine Data</a> for even more.</p><h4>APM Tool Logs</h4><p><em>Examples: Logs from Dynatrace, New Relic, AppDynamics, Pulseway, LogicMonitor, Stackify, Boomerang.js, Jmeter, CA Technologies, Idera, Ipswitch</em></p><p>If you already have an APM tool, you can get great insights into end user monitoring, byte code instrumentation and on-page errors. These logs can show infrastructure problems and bottlenecks that aren’t visible when looking at each system individually, such as slow DNS resolution, causing a complex web app to bog down as it tries to access content and modules on many different systems. And when you monitor these logs, you can get early warnings to application problems so you can remediate issues before users experience them.</p><h4>Custom App and Debug Logs</h4><p><em>Example: Custom applications</em></p><p>For developers, these are often the most sought-after data sources because they provide minute details of application state, variables and error conditions or exceptions. Analysis of these logs can help expose the cause of application crashes, memory leaks, performance degradation and security holes. With custom applications, the exact type of sources differ depending on the app.</p><h4>CRM, ERP and Other Business Applications</h4><p><em>Examples: SAP, SFDC, Oracle, Microsoft Exchange, Microsoft Dynamics</em></p><p>Many of your applications integrate with Messaging CRM and ERP platforms, so getting insights into the use and performance of these solutions may give you insights into your critical applications as well. CRM can provide a complete record of information and events leading up to a customer escalation. When combined with other data sources, CRM can provide indicators of deeper issues. Like other application records, ERP logs are needed when debugging performance and reliability problems due to the complex interactions between many systems in an ERP implementation. They’re also useful in capacity planning.</p><h4>Automation, Configuration, Deployment Tools (Platform)</h4><p><em>Examples: Puppet Enterprise, Ansible Tower, Chef, SaltStack, Rundeck, machine data ingested through APIs, webhooks or run logs</em></p><p>These data sources are key because automation tools help you understand when new releases are brought into production. Monitoring, analyzing and managing this data gives you the ability to compare before/after performance of an application update, and usage and availability for a particular release.</p><h3>Test Coverage Tools</h3><p><em>Examples: Static Analysis &amp; Unit Testing logs (SonarQube, Tox, PyTest, RubyGem MiniTest, Bacon, Go Testing), build server logs and performance metrics</em></p><p>Test coverage data monitoring can help you understand:</p><ul><li>How much technical debt and issues are being resolved</li><li>How ready is your next release</li><li>How many unit tests were performed per hour and which tests are being run</li></ul><p>If test coverage data is combined with build data, you can start monitoring build and release performance and start understanding the release quality. You can understand the trends in error percentage and make decisions on whether the build is ready for production. Understanding code quality can also help support teams get prepared for any additional volume of calls or any particular issues that may arise. For example, CSAA uses the data from production information to determine which user responses they want to provide to perform the most in-depth testing.</p><p>There are more data sources that can help you improve your APM. Get the <a href="https://www.splunk.com/en_us/form/essential-guide-to-machine-data-user-and-application-data.html">Essential Guide to Machine Data: User and Application Machine Data</a> for more recommendations.</p><p><em>Originally published at </em><a href="https://www.splunk.com/blog/2017/06/28/5-data-sources-that-turn-apm-data-into-application-performance-analytics.html"><em>www.splunk.com</em></a><em> on June 28, 2017.</em></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=d61b2e899475" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[John Lewis: Guaranteeing amazing customer service with Splunk]]></title>
            <link>https://medium.com/@rolymo/john-lewis-guaranteeing-amazing-customer-service-with-splunk-e05dcf4e20ee?source=rss-8c02b13ad30b------2</link>
            <guid isPermaLink="false">https://medium.com/p/e05dcf4e20ee</guid>
            <category><![CDATA[marketing]]></category>
            <category><![CDATA[data-analytics]]></category>
            <category><![CDATA[splunk]]></category>
            <category><![CDATA[kpi]]></category>
            <category><![CDATA[retail]]></category>
            <dc:creator><![CDATA[Roland Harvey]]></dc:creator>
            <pubDate>Fri, 23 Jun 2017 00:00:00 GMT</pubDate>
            <atom:updated>2017-07-20T11:04:37.941Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*K4PQizveXrNSmSZBAGl0PA.png" /></figure><p>Author — <a href="https://www.splunk.com/blog/author/gayme.html">Guillaume Ayme</a></p><p>Imagine you’re in a department store. You’ve roamed the aisles and filled your basket, and after queuing to reach the till, your transaction can’t be completed. The cashier is having a bad day so tells you go back to the end of the queue, and try again later. Let’s be kind and say they allowed you to keep the contents of your basket, but after queuing again, the same thing happens. Before you know it, you’re dizzy and ready to leave the goods behind.</p><p>Of course, this would be unlikely in real life. The duty manager would look over the balcony and quickly spot a brewing commotion. But machines can have bad days too. How does this translate in the virtual world of retail? No humans. No duty managers. No balconies. The cashier is just code running as a series of micro services; running on docker containers; running on a virtual machine; running on a hypervisor situated in all corners of the earth; overlooked by an anonymous somebody.</p><p>Let’s take a look at how one of the UK’s largest department store, John Lewis deals with it, and how it uses Splunk to watch over that cyber balcony.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*79H1RM65zHt8oVBZ.png" /></figure><p>Paul Adams has been in IT Ops for a long time. He’s part of the consultancy company <a href="https://www.octamis.com/">Octamis</a> but spends the vast majority of his time helping John Lewis in its operations. I’ve known him for over five years at John Lewis, and can vouch that he’s the poster child of a new generation of data-thirsty operations gurus.</p><p>He recently presented at <a href="http://www.gartner.com/events/emea/infrastructure-operations-management">Gartner IT Infrastructure &amp; Operations Management</a> in Berlin on behalf of John Lewis, on why machine data is so critical to how the organisation approaches its IT operations. Why? Because only with this data can great customer service be guaranteed.</p><p>Splunk is central to analysing John Lewis’ data. Across the many different applications and components that make up John Lewis, Splunk is what ensures the machines avoid having bad days, and guarantees that every single customer has a seamless experience online. Paul calls Splunk his “macroscope” over all the other monitoring tools they have.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*oTg7hpRPqCxdZMpb.png" /></figure><p>“Sometimes the system errors with a smile on its face”, which is Paul’s way of saying there isn’t always an error generated. You have to analyse data constantly, just like a duty manager walking the aisles in a physical store. At the Gartner event, he gave the example of how John Lewis created a checkout flow process using <a href="http://splunk.com/itsi">Splunk ITSI</a>. It holds KPIs of every single customer going through the different steps of a checkout process. It’s a notoriously complex process, as a lot can go wrong. Some of it can be in the control of the retailer, and some dependent on third-parties. Error or no error, issues cannot elude Paul — he can see everything customers are doing.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*I2yQ4YSvVMlnF_HI.png" /></figure><p>Before you question if constantly asking questions is feasible, with Splunk ITSI it is! It allows easy mapping of the different components that make up John Lewis’ service, and quickly creates KPIs based on raw data. Then, ITSI does the hard work by applying adaptive thresholds using machine learning algorithms, baselining what looks good and bad at specific times of the day, based on past trends. Splunk ITSI helps find performance anomalies within those KPIs, and provides dashboards similar to Powerpoint presentations thanks to <a href="https://docs.splunk.com/Documentation/ITSI/2.6.0/User/BuildGlassTable">Glasstables</a>. This takes more workload off of Paul, allowing him to concentrate on improving the service and customer experience further, which includes looking beyond the web and into fulfilment and business optimisation.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*ShoMlHGuoi7KNdUo.png" /></figure><p>This data-centric approach to customer service is why John Lewis is cherished within the retail market, and are able to maintain such a great brand in 2017 as they did in 1867.</p><p>If you want to discover out how to do this for your own organisation, register for our webinar on June 29th, “<a href="https://www.splunk.com/en_us/form/business-table-with-splunk-itsi.html">Earn a Seat at the Business Table with Splunk ITSI</a>”. You can also view the full presentation from Gartner IOM 2017 below:</p><p><em>Originally published at </em><a href="https://www.splunk.com/blog/2017/06/23/john-lewis-guaranteeing-amazing-customer-service-with-splunk.html"><em>www.splunk.com</em></a><em> on June 23, 2017. For more information on how Data Analytics could help you visit </em><a href="http://www.cssdelivers.com/"><em>www.cssdelivers.com</em></a><em> </em><a href="http://www.twitter.com/cssdata"><em>#cssdata</em></a></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=e05dcf4e20ee" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Machine learning for IT operations]]></title>
            <link>https://medium.com/@rolymo/machine-learning-for-it-operations-cf56d80c868f?source=rss-8c02b13ad30b------2</link>
            <guid isPermaLink="false">https://medium.com/p/cf56d80c868f</guid>
            <category><![CDATA[outage]]></category>
            <category><![CDATA[it-infrastructure]]></category>
            <category><![CDATA[machine-learning]]></category>
            <category><![CDATA[data-analytics]]></category>
            <dc:creator><![CDATA[Roland Harvey]]></dc:creator>
            <pubDate>Thu, 22 Jun 2017 00:00:00 GMT</pubDate>
            <atom:updated>2017-06-22T15:23:25.186Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*5Ee6Q_8J7xmIWcnuKztrKw.jpeg" /></figure><h4>Let’s tackle IT data complexity</h4><p>Author — <a href="http://blogs.ca.com/author/vikassinha/">Vikhas Sinha</a></p><p>How is your IT infrastructure performing? Is it delivering the customer experience, uptime, and near-instantaneous response time you are looking for? Are you able to avoid outages — and repair issues with minimal time and impact? Machine Learning is coming to the rescue.</p><p>The reality is that IT systems have become so interconnected, so complex, and so massive that people — even the most talented infrastructure and engineering teams — can’t keep up. Witness the recent <a href="http://metro.co.uk/2017/06/02/british-airways-global-system-failure-due-to-it-engineer-turning-off-power-supply-6679281/">British Airways outage</a>. A simple human error resulted in a power surge that crashed airline computers and caused major damage to critical servers containing passenger and flight data. Who could know all the ramifications of a single action?</p><p>Similar problems plague businesses worldwide every day. However, these problems are not due to a lack of information or data. There is just too much data. It is becoming humanly impossible to access and apply all the domain knowledge needed. Machine learning is swiftly becoming a necessity.</p><p>Here are three of the top reasons why IT pros are looking for some friendly help from the machines they work with:</p><h4>Customization</h4><p>The beauty of machine learning is that it can be customized through unsupervised learning to meet the needs of a company’s unique business environment. This is done by employing algorithms that identify consistent, coherent, and recurrent patterns in data — patterns that can then be applied to real-world business events, challenges, and opportunities.</p><p>The benefits of unsupervised learning are many:</p><ul><li>Rather than IT experts programming a machine to deliver a <em>specific</em> output, the machine is able to identify patterns in data to deliver the <em>optimal</em></li><li>Rather than the machine knowing how to respond in a <em>defined set</em> of circumstances, the machine becomes capable of responding to an <em>infinite variety</em> of situations.</li><li>Rather than generating <em>generic</em> insights or outcomes, machine learning generates <em>personalized</em> insights and outcomes.</li></ul><p>For example, suppose there are two insurance companies. The companies happen to use the same data center infrastructure and software tools. However, each has their own workload patterns, consumer profiles, business rules, and scoring methodologies. Both employ machine learning. Even though they are in the same industry and use the same technology, machine learning will produce completely customized outputs for each company based on the unique factors in the two business environments.</p><h4>Efficiency</h4><p>Companies today have massive amounts of data at their fingertips — but it is largely unused and unusable — and is perhaps rapidly changing. Even an army of analysts could not hope to stay on top of this data; it is too vast to manage.</p><p>With machine learning, the benefits of big data can be efficiently achieved by embedding <a href="https://www.ca.com/us/products/mainframe-operations-intelligence.html">operational intelligence</a> into existing performance management tools. For example, assume that a major department store uses machine learning to analyze sales transactions. Machine learning can easily assess and draw actionable insights from billions of transactions as well as the metadata that surrounds those transactions (e.g., Where and when did the transaction originate? How did the website perform its functionality? What implications do the transactions have for revenue, marketing, inventory, etc.?). These insights can be fed into existing tools to help the store refine its internal operations and enhance the end-to-end customer experience.</p><h4>Continuity</h4><p>Machine learning can also help fill the gap that is left exposed when IT operation experts retire or leave a company. For example, the new generation of IT experts are not always trained in <a href="https://www.ca.com/us/why-ca/mainframe.html">mainframe</a> technology, which many leading businesses and governments rely on to execute some of their most mission essential applications. This lack of domain expertise to optimize mainframe performance and troubleshoot issues can be alleviated by embedding intelligence and applying machine learning techniques which assimilates the skills and knowledge of the mainframe experts to reduce risk and enable continuous and scalable operations for an organization.</p><p>Machine learning is the key to optimizing infrastructure performance, business growth, customer experience, knowledge management, and a wealth of other possibilities. The next step is to make it your own.</p><p><em>Originally published at </em><a href="http://blogs.ca.com/2017/06/22/3-reasons-machine-learning-is-the-secret-to-solving-it-operations-challenges/"><em>blogs.ca.com</em></a><em> on June 22, 2017. </em><a href="http://www.cssdelivers.com/"><em>www.cssdelivers.com</em></a></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=cf56d80c868f" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[How APIs are at the core of the European Union data economy]]></title>
            <link>https://medium.com/@rolymo/how-apis-are-at-the-core-of-the-european-union-data-economy-a8c7d17d9800?source=rss-8c02b13ad30b------2</link>
            <guid isPermaLink="false">https://medium.com/p/a8c7d17d9800</guid>
            <category><![CDATA[api-management]]></category>
            <category><![CDATA[api]]></category>
            <category><![CDATA[european-union]]></category>
            <dc:creator><![CDATA[Roland Harvey]]></dc:creator>
            <pubDate>Tue, 06 Jun 2017 00:00:00 GMT</pubDate>
            <atom:updated>2017-06-13T08:16:08.396Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/444/1*-Cky6Uc5nN7rgEkz4IQ61Q.jpeg" /></figure><h4>Highlighting the challenges and suggesting next steps for boosting API uptake in the European Digital Single Market.</h4><p>Author — <a href="http://blogs.ca.com/author/ianclark/">Ian Clark</a></p><p>Proposed two years ago by the European Commission’s Vice President Ansip, the European Commission <a href="https://ec.europa.eu/commission/priorities/digital-single-market_en">Digital Single Market (DSM</a>) strategy aims to remove obstacles to ensure a vibrant European digital market. One aspect is to focus on a European data economy and specifically the role of Application Programming Interfaces (APIs) in opening more opportunities.</p><h4>Central nervous system of the data economy</h4><p>APIs are not a new technology. But in today’s app economy, they have become vital to almost every aspect of business success. Succeeding in today’s digital world means connecting products to customer needs, customers to experiences, apps to devices, and organizations to partner eco-systems.</p><p>And it means connecting systems to other systems, software to other software, and data to just about everything. At the same time, these connections must be made quickly, accurately, securely, and at scale.</p><p>All of these connections create tremendous complexity — which is where application programming interfaces (APIs) come in.</p><h4>Challenges and solutions: Four recommendations to boost API uptake in the DSM</h4><p>A recent <a href="https://ec.europa.eu/digital-single-market/en/news/summary-report-public-consultation-building-european-data-economy">European Commission consultation on the data economy,</a> posed specific questions around APIs. It was positive to see that 68% of respondents clearly support the increased use of APIs.</p><p>We want to further highlight what we see as challenges and suggest next steps.</p><p><em>First, security.</em> In <a href="https://www.ca.com/us/rewrite/articles/api-management/apis-building-a-connected-business-in-the-app-economy.html">a recent study commissioned by CA Technologies</a>, respondents indicated security was one of the highest concerns when thinking about opening up their data through APIs.</p><ul><li>A continued focus on the need for security across various sectors needs to be integral in any policy initiative.</li><li>Organizations need to demonstrate a strong <em>“security by design”</em> approach when developing products and services. We believe that such an approach will allow for increased confidence and trust in an API driven economy.</li></ul><p><em>Second, a voluntary labelling or certification scheme for secure, developer-friendly APIs.</em> Such a scheme should enable transparency as it would allow developers to quickly assess the readiness of an organization’s (government and private sector) API strategy. Some questions that could be looked at are: technical documentation, security, etc. It could note whether the APIs align with international, industry driven standards. Future labelling systems could note whether entities incorporate secure development processes in the development of applications and APIs, based on international, industry-driven standards.</p><p><em>Third, skills.</em> In the same CA study, respondents indicated that a big hurdle in API adoption is a lack of skilled resources. This reflects how businesses are taking on broader — and more external — use of APIs in the digital era. This requires new and different skillsets. We call on the European Commission to continue their efforts in promoting the need for new skills, like in the Digital Skills and Jobs Coalition which <a href="http://pledgeviewer.eu/pledges/ca-technologies-13.html">CA Technologies is supporting</a>.</p><p>Finally, we recommend that the EU focus on promoting the <em>high-level best practices</em> in API development, leveraging public data sets as an example. The upcoming review of the Public Sector Information (PSI) Directive will be an opportunity to further do so. To that extent, we call for a clear Digital by Default principle in addition to an API first policy.</p><h4>Moving forward</h4><p>We believe that government can partner with industry to develop API policies and promote best practices. We will work with governments in the EU on how to further bolster their role around these four recommendations. To that extent, we are looking forward to speaking at the European Commission’s workshop on June 8thin Brussels on data access and the role of APIs.</p><p><em>Originally published at </em><a href="http://blogs.ca.com/2017/06/06/how-apis-are-at-the-core-of-the-eu-data-economy/"><em>blogs.ca.com</em></a><em> on June 6, 2017. </em><a href="http://www.cssdelivers.com/"><em>www.cssdelivers.com</em></a></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=a8c7d17d9800" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Recent hacks and breaches show users and applications are primary attack vectors]]></title>
            <link>https://medium.com/@rolymo/recent-hacks-and-breaches-show-users-and-applications-are-primary-attack-vectors-3e8041f3052c?source=rss-8c02b13ad30b------2</link>
            <guid isPermaLink="false">https://medium.com/p/3e8041f3052c</guid>
            <category><![CDATA[aws]]></category>
            <category><![CDATA[security]]></category>
            <category><![CDATA[api]]></category>
            <category><![CDATA[hacks]]></category>
            <category><![CDATA[api-management]]></category>
            <dc:creator><![CDATA[Roland Harvey]]></dc:creator>
            <pubDate>Fri, 02 Jun 2017 00:00:00 GMT</pubDate>
            <atom:updated>2017-06-13T08:20:41.507Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/724/1*bVKmspMpBntUoRwf6OD1qA.jpeg" /></figure><h4>This week’s attack on OneLogin indicates privileged user accounts may have been misused</h4><p>Author —<a href="http://blogs.ca.com/author/johnhawley/"> John Hawley</a></p><p>While details about OneLogin’s latest breach are still being uncovered and shared, we know from the <a href="https://www.onelogin.com/blog/may-31-2017-security-incident">OneLogin blog</a> and <a href="https://krebsonsecurity.com/2017/06/onelogin-breach-exposed-ability-to-decrypt-data/">Krebs on Security</a> that “a threat actor obtained access to a set of AWS keys and used them to access the AWS API from an intermediate host with another, smaller service provider in the U.S.”</p><p>This indicates it’s likely the access was gained through a highly privileged user account — such as that of an IT administrator. Privileged accounts can be turned on an organization when compromised by an attacker. If undetected for even a short time, this level of access can result in a catastrophic breach.</p><h4>Hackers are smart; we need smarter security to keep pace</h4><p>Hackers salivate at the idea of having administrator level access inside their targets environment. It is well worth their time to hone in on individuals in these roles and their user accounts.</p><p>Getting started is pretty easy. A quick Google or LinkedIn search can uncover a list of all the IT administrators at a company. Browsing the technical profile of each administrator will probably then provide some good insight on which ones are managing the technology the hacker wants to exploit, such as an AWS environment.</p><p>The obvious approach here is to protect every user account with multi-factor authentication since most password credentials are either compromised or easily figured out. But in the case of IT administrators we need to go further.</p><p>Sensitive IT access needs to be controlled more granularly with <a href="https://www.ca.com/us/products/privileged-access-management.html">privileged access management </a>and administrative type activity (often performed thru APIs) needs to be closely monitored.</p><p>Applying analytics, machine learning and automation to privileged user activity makes security smarter. It adds intelligence to the systems that control the activity of those users with unfettered access to a company’s most sensitive systems and data. Whether it’s a privileged admin, automated script, overseas developer or <a href="https://www.ca.com/us/collateral/white-papers/closing-network-backdoors.html">external partner</a>, the business must have control to authorize, limit, audit and record access.</p><h4>Security automation for rapid response</h4><p>While it is helpful to know days or hours after a malicious activity, when privileged access has been gained by an attacker, the security solution needs to respond within seconds.</p><p>Analytics and machine learning help detect malicious behavior and trigger automated mitigations instantly when risk is detected, such as activating session recording, forcing re-authentication, generating alerts to admins and other systems, or stopping a session completely.</p><p>The system essentially compiles an electronic dossier for each user, device, and resource that includes the activity and events correlated with the entity.</p><p>We also know that much of the administrative activity today is done via scripts and APIs. We need to begin applying the same analytics and control principles at the <a href="http://blogs.ca.com/2017/02/23/five-simple-strategies-for-securing-apis/">API level</a> if we are to survive in the fast paced DevOps world.</p><h4>Recent hacks and breaches highlight the most common attack vectors</h4><p>The <a href="http://www.veracode.com/blog/security-news/wannacry-ransomware-attack-symptom-bigger-problem">WannaCry attack</a> and this breach at OneLogin show that companies must rethink the way they do security — with a maniacal focus on user access and applications.</p><p>Here’s why: 10 years ago, the attack surface could be defined by the number of entry points to the network; today the attack surface is calculated by the number of applications or API’s multiplied by the number of users who have access to the applications. That number is astronomical and provides a target-rich environment for bad actors.</p><p>Access is what bad actors need to succeed with any data breach, and they get that access through compromised credentials. The <a href="http://www.verizonenterprise.com/verizon-insights-lab/dbir/2017/">2017 Verizon Data Breach Investigation Report</a> shows that 81 percent of all hacking-related breaches are caused by compromised password credentials.</p><p>The Software Engineering Institute cited that <a href="https://www.us-cert.gov/sites/default/files/publications/infosheet_SoftwareAssurance.pdf">90 percent of all data breaches exploit application vulnerabilities</a>. Bringing security into the development, test and deployment process is critical to delivering secure applications from the start.</p><p>The companies that get security right by refocusing on applications and user identity, elevate the experience of the users and reap great rewards not just in security but business outcome.</p><p>No CIO or CISO wants to be surprised by a system breach, particularly one that could have been avoided or mitigated by having the right access controls and analytics in place.</p><p><em>Originally published at </em><a href="http://blogs.ca.com/2017/06/02/onelogin-breach-shows-users-and-applications-are-primary-attack-vectors/"><em>blogs.ca.com</em></a><em> on June 2, 2017.</em></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=3e8041f3052c" width="1" height="1" alt="">]]></content:encoded>
        </item>
    </channel>
</rss>