<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0" xmlns:cc="http://cyber.law.harvard.edu/rss/creativeCommonsRssModule.html">
    <channel>
        <title><![CDATA[Stories by Gaston MARTIN on Medium]]></title>
        <description><![CDATA[Stories by Gaston MARTIN on Medium]]></description>
        <link>https://medium.com/@7rm1ef8?source=rss-d9513b09c7f9------2</link>
        <image>
            <url>https://cdn-images-1.medium.com/fit/c/150/150/1*6CSkTR1gXAkKZr_p8JAJZg.png</url>
            <title>Stories by Gaston MARTIN on Medium</title>
            <link>https://medium.com/@7rm1ef8?source=rss-d9513b09c7f9------2</link>
        </image>
        <generator>Medium</generator>
        <lastBuildDate>Fri, 20 Nov 2026 10:13:30 GMT</lastBuildDate>
        <atom:link href="https://medium.com/@7rm1ef8/feed" rel="self" type="application/rss+xml"/>
        <webMaster><![CDATA[yourfriends@medium.com]]></webMaster>
        <atom:link href="http://medium.superfeedr.com/" rel="hub"/>
        <item>
            <title><![CDATA[A SOC-MSSP guide (4 of 4)]]></title>
            <link>https://medium.com/@7rm1ef8/a-soc-mssp-guide-4-of-4-a78779d830dd?source=rss-d9513b09c7f9------2</link>
            <guid isPermaLink="false">https://medium.com/p/a78779d830dd</guid>
            <category><![CDATA[mssp]]></category>
            <category><![CDATA[cybersecurity]]></category>
            <category><![CDATA[soc]]></category>
            <dc:creator><![CDATA[Gaston MARTIN]]></dc:creator>
            <pubDate>Sun, 03 Dec 2023 09:57:57 GMT</pubDate>
            <atom:updated>2023-12-03T17:03:39.890Z</atom:updated>
            <cc:license>http://creativecommons.org/licenses/by/4.0/</cc:license>
            <content:encoded><![CDATA[<blockquote>From reporting malicious activity to catching it as it happens</blockquote><p>Part 1: <a href="https://medium.com/@7rm1ef8/a-soc-mssp-guide-1-of-4-3f5450638a98">https://medium.com/@7rm1ef8/a-soc-mssp-guide-1-of-4-3f5450638a98</a><br>Part 2: <a href="https://medium.com/@7rm1ef8/a-soc-mssp-guide-2-of-4-f4fb93be2422">https://medium.com/@7rm1ef8/a-soc-mssp-guide-2-of-4-f4fb93be2422</a><br>Part 3: <a href="https://medium.com/@7rm1ef8/a-soc-mssp-guide-3-of-4-658e0cf99745">https://medium.com/@7rm1ef8/a-soc-mssp-guide-3-of-4-658e0cf99745</a></p><p><strong>Summary<br></strong><a href="#3dc3">5. Technical aspects</a><br><a href="#e1b1">5.1. Knowledge management</a><br><a href="#6ba2">5.2. SOC/MSSP environment</a><br><a href="#6399">5.3. Logs and logging</a><br><a href="#79d9">5.4. Main SOC Tools</a><br><a href="#6a86">5.5. SOC Use Case</a><br><a href="#30af">5.6. Conclusion</a><br><a href="#ae86">6. Conclusion</a></p><h3><strong>5. Technical aspects</strong></h3><p>This chapter is the most technical of this document and although it tries to stay high level to be read and understood by everyone as this is <em>the </em>goal, there are some dives into finer points as some crucial details can influence the whole architecture.<br>It drills down into the tools used by a SOC and MSSP, what they aim to do, their strengths and weaknesses and gives pointers on how to use them properly. It also addresses the oh so frequent mistake of fiddling with a tool to make it do something it wasn’t built to do, i.e. don’t use a hammer when you need a screwdriver.</p><p>That being said, this chapter should be as editor-agnostic as possible because choosing and using the correct tool is far more important than the actual brand of the tool used, although there are of course differences between editors that need to be considered.<br>Consequently, the terminology used shouldn’t be tied to one editor or another, but mistakes can happen.</p><h4><strong>5.1. Knowledge management</strong></h4><p>This (tiny) subchapter is mainly meant to underline the importance of knowledge management as previously discussed but also to give a few bullet points on what knowledge to create and how to create it.<br>Ideally, everything that needs to be remembered must be documented and that means everything:</p><ul><li>Processes and procedures — these are two different things and simply put, a process describes what to do and a procedure is the breakdown of the process to describe how to do it.</li><li>Any piece of code and configuration file.</li><li>Tools guides, usage and best practices.</li><li>Detection use cases and incidents.</li><li>Customer and partner information (context, points of contact…).</li><li>Successful and failed Proof of Concept (PoC) conducted.</li><li>For an MSSP, the services available, marketing strategy, contracts, etc.</li></ul><p>This list is clearly not exhaustive but the keywords are “ideally, everything”.</p><p>Also, the knowledge must have a target when it is created so that it is clear to any reader <em>why </em>it exists. That target is defined by a purpose and an intended audience; consequently, the level of (technical) details will vary accordingly.<br>For example, a document explaining the context of a customer will not contain the same information if it is intended for the SOC analyst that needs to respond to an alert on that environment or for the sales team representative who handles payment or contract renewal.</p><h4><strong>5.2. SOC/MSSP environment</strong></h4><p>The environment in which a SOC operates is complex, as basically anything that uses electricity and integrates some sort of “intelligence” (i.e. decision making) will have security needs for prevention, detection and response.<br>As if this isn’t vast and diverse enough, an MSSP has to deal with that complex environment multiplied by the number of customers it has and of course every environment is unique so there’s no simple copy-pasting possible on the technical level.</p><p>Fortunately, some similarities exist between environments and these have to be correctly understood and built upon in order to properly automate and industrialize whatever tasks and jobs a robot can perform faster and better, i.e. with a constant and predictable output, than a human ever could.<br>The first place to start is with an overview of the workflow of the data — mostly logs and other relevant artifacts for a SOC — from its creation all the way to the security incident report and improvements made from detecting an anomaly in that data.</p><p><strong>5.2.1. Overview</strong></p><figure><img alt="Example of a SOC workflow overview" src="https://cdn-images-1.medium.com/max/1024/1*Sh7aTOYR6VLUMFqkfEFVhw.png" /><figcaption>Example of a SOC workflow overview</figcaption></figure><p>The diagram above shows a generic example of the different steps the data (here environment logs) go through to be processed and used.<br>The shades of gray represent the (single) environment within which a SOC operates and the colors add the depth of an MSSP.<br>The steps may be grouped together to illustrate in which tool they belong and the border between some tools may be dotted instead of full to represent the fact that, depending on the technology chosen, these tools might all be seamlessly merged into that particular technology.<br>A team is responsible for each step and some steps can have two teams working on it, where one leads and the other one either helps or performs the required technical actions alone. The number and/or missions of these teams have been simplified to lighten the diagram but actual teams should represent the tasks and jobs that are needed, as discussed before.</p><p>Some steps have industrialization options which are improvements that can be made to free up humans from tasks for which a robot is more suited.<br>Details of the suggested industrialization options follow, where each option has been broken down in a series of steps.<br>Some of these steps will be discussed further in this chapter as although the idea may seem obvious and easy to understand, the technical implementation is a lot harder. The rest should be self-explanatory or a bit too technical to describe in this guide.</p><p><strong>5.2.2. Logging industrialization</strong></p><figure><img alt="Logging industrialization options" src="https://cdn-images-1.medium.com/max/842/0*rC_0VVd_ePpNIQ3x" /><figcaption>Logging industrialization options</figcaption></figure><p>The industrialization options are numbered so that they can be easily referenced later on but these numbers are not sorted and most if not all options can be implemented simultaneously.<br>This industrialization option has multiple steps — it is of course recommended that these steps be implemented in that order as they are sorted by added value for detection and response and by return on time and resource investment while also taking into account prerequisites for the steps.</p><p><strong>5.2.3. SIEM industrialization</strong></p><figure><img alt="SIEM industrialization options" src="https://cdn-images-1.medium.com/max/1024/1*VWmUv_H_yP_oYLBcQtRjUQ.png" /><figcaption>SIEM industrialization options</figcaption></figure><p><strong>5.2.4. SIRP industrialization</strong></p><figure><img alt="SIRP industrialization options" src="https://cdn-images-1.medium.com/max/932/0*AObcOkdOJO5GWpX6" /><figcaption>SIRP industrialization options</figcaption></figure><p><strong>5.2.5. SOAR industrialization</strong></p><figure><img alt="SOAR industrialization options" src="https://cdn-images-1.medium.com/max/1024/1*Ys1q418JTA2S_s0tpi2i8A.png" /><figcaption>SOAR industrialization options</figcaption></figure><h4><strong>5.3. Logs and logging</strong></h4><p>Logs are the input of detection rules, without logs there is no detection, it’s that simple. Also, the detection can only be as good as the data — logs — available, if these are not enough, do not contain relevant data, the data is partial or otherwise inconsistent, the detection will inevitably suffer the same fate.</p><p>To build a robust and consistent detection the nature and format of the data ingested must also be consistent and adequate. This is achieved in roughly four steps by having a consistent logging policy, using a data model suited for the SOC, checking that logs are parsed correctly with regard to the data model and monitoring the raw and processed data to ensure the input for detention stays consistent.</p><p><strong>5.3.1. Logging policy</strong></p><p>The logging policy is part of the industrialization options for logging. The goal is very straightforward but the implementation much more complex, directly depending on the variety of sensors monitored by the SOC or MSSP.</p><p>A logging policy is a per sensor configuration that enables said sensor to produce the logs — both in contents and format — expected. Also a recommended retention period should be associated with each log type but this may be a configuration for the tool storing the logs after collection and not the sensor itself.<br>This can be very quickly very hard to have for complex sensors and/or to maintain across sensor updates but it is the only way to ensure some consistency and have the default be that of the SOC and not that of the sensor.<br>Furthermore, the policy might change depending on the role of the sensor: e.g. the interests of the SOC in Windows event logs may not be the same on a workstation, on a filer and say on a Domain Controller.</p><p>Finally, the verbosity of each log and the quantity of logs of that nature should be recorded to estimate an average per day volume of data to process with such or such configuration. Most of the time, there will be a cost issue with the amount of data to process (for the SIEM) one way or the other. At that point, it is better to be prepared by knowing what the priorities for the SOC for each type of log on that sensor are and how much it would impact the infrastructure to create, process and store these.</p><p><strong>5.3.2. Data model</strong></p><p>The logs are now consistent and both the nature and format of data produced by all sensors is known in advance, which is a big step.<br>However, there are dozens and hundreds of sensors that could be monitored by the SOC and while it is tedious for a detection specialist to find the default labeling for such or such data needed for the detection rule he or she is building, it is simply impossible for a response specialist to remember by heart the labels of the data they need for their investigation.<br>This is an even bigger issue for MSSPs as they have multiple customers, each with a unique environment consisting of multiple sensors. Of course some sensors will be similar from one customer to another but it is nevertheless unrealistic to have analysts chase after labels at scale.</p><p>The solution to this problem, mentioned in the industrialization option number 3 for an MSSP in the previous diagram is for the SOC to implement a data model (DM) suited for its usage.<br>The actual definition of data model can easily be found on the web but simply put, for a SOC, the data model is a mapping of a label to a type of data. <strong>There can only be one label for one type of data and there can only be one type of data corresponding to a specific label</strong>.</p><p>For example, the SOC could decide to associate the data “<em>Full process’s executable file path, name and command line used for execution</em>” to the label “<em>process</em>”. Then, whatever the sensor, whatever the context, if there exists a label “<em>process</em>” then the data associated with it will be “<em>Full process’s executable file path, name and command line used for execution</em>”.</p><p>The application of the data model is maybe the most powerful industrialization option for a SOC and especially an MSSP as <em>it creates an abstraction layer between the sensors and the usage of their logs</em>:</p><ul><li>The detection specialist needs only to search the anomalous behavior they want to detect by referring to the label. Since the label always corresponds to the same type of data and the logs are consistent (thanks to the logging policy), then the detection rule becomes generic, in the sense that it can be applied to multiple sensors of the same nature. Because that detection rule is generic, it can be run against multiple sensors across multiple customers without any change to its code.</li><li>The response specialist doesn’t need to know the editor and version of a firewall, for example, to use its logs for their investigation. They can search whatever label contains the data they are after and they will get the results they need.</li><li>The threat hunter can just copy and paste their queries from one customer to the next and trust that it will work as intended.</li></ul><p>The hard part, of course, is to create a data model that is suited for the SOC’s usage. There are many SIEM or XDR editors, for example, who propose their own data model, and if any matches the needs of the SOC or MSSP then go for it. Otherwise, it is always possible to take the closest there is to the needs and build on it.</p><p>There are a few recommended points to follow in order to achieve a good data model for a SOC:</p><ul><li>Establish a strong hierarchical nomenclature for the labels, i.e. there surely will be “sublabels” relating to data that is to be grouped under one parent label, then maybe something like <em>&lt;root&gt;&lt;boundary_character&gt;&lt;level_one&gt;&lt;boundary_character&gt;&lt;level_two&gt;</em>… can do.</li><li>By definition <strong>there can only be one label for one type of data and there can only be one type of data corresponding to a specific label</strong>, make sure that is and stays true — check and enforce it.</li><li>Test it against multiple sensors of different natures to make sure it is viable before using it in production because it will be painful to modify it — that is, modify an existing label or data definition, adding is OK — afterwards.</li></ul><p><strong>5.3.3. Parsing</strong></p><p>The definition of parsing here is the mapping of data contained in logs to labels. Parsing is therefore the application of the SOC’s data model onto logs whose content and format are expected as per the logging policy. Parsing is also the link between the raw logs coming from the sensors and the tool in which they are used, e.g. a SIEM.</p><p>Configuration of parsing will then depend on the format of the raw log — depending on the sensor type, editor and sometimes version — and the tool that will use it.<br>Another point in the industrialization option number 3 for an MSSP in the previous diagram is for the SOC to store parsing configuration for each variation of sensor/editor/version/target tool.<br>This is yet another step which is hard and tedious to achieve, but at this point chances are that the SOC logging policy will not be the default one for the sensors and the SOC data model will not match existing default parsers in the SIEMs used… Consequently some parsing configuration must be done before the data is usable, hence it is best not to fight the inevitable, but capitalize on it by storing the configuration.<br>This way, parsing is done exactly once and is then reusable for every customer.</p><p>By the way, the last point in the industrialization option number 3 for an MSSP is to automate the deployment of parsing configuration to the tools… At that point it is only a matter of copying and pasting configuration, so why let an error prone and slow human do it when a robot could do it all faster and better — and let the human use his time to create parsing configuration, which is a task that a brainless robot could not do.</p><p><strong>5.3.4. Monitoring</strong></p><p>The consistent logs of expected nature and format are now correctly parsed according to the SOC data model. It’s a paradise on earth for all SOC analysts and now they won’t leave for any other SOC because they don’t want to go back to wasting their time on idiotic issues.</p><p>The final step is to keep things that way and to do that, close monitoring of the data is required.<br>Here is a checklist of things to monitor to ensure the detection input, which is the logs parsed according to the SOC DM:</p><ul><li>Logs overall per time unit volume — the volume for a specific sensor with a specific logging policy is expected to remain more or less the same.</li><li>Raw logs consistency — once the policy is applied, the raw logs should always have the same format.</li><li>Parsed logs consistency — once the parsing configuration is applied, the parsed logs should always be broken up into the same labels.</li><li>SOC data model application — each label should refer to one type of data only across all sensors and all customers, a misconfiguration in the parsing can happen and will result in partial detection.</li><li>Logs sources and volume — a source suddenly sending any, more, fewer or no logs anymore unexpectedly is abnormal.</li><li>Logs retention periods — make sure logs are not deleted before the end of their retention period because of storage issues, for example.</li><li>Logs collection tools health — logs should be collected in almost real time for immediate use by the tools (e.g. SIEM), logs arriving in the tool hours or days after they have been created by the sensor is an abnormal event.</li></ul><p>Depending on the infrastructure and technological choices, there may be other points to monitor but the gist is to make sure that logs’ production, collection and ingestion runs as smoothly as when it was first put into production.<br>There is nothing worse than to believe that the SOC detection is working and the coverage is in a certain state when the reality is far from it, all because there was a change in some firewall rule and all logs forwarded to the SIEM since have been dropped and irrevocably lost.</p><h4><strong>5.4. Main SOC Tools</strong></h4><p>There are a few main tools used by any SOC or MSSP and it is best to have an overview of recommendations and common mistakes in order to get the most out of each.</p><p>One recommendation can be applied to all of those tools and is really a general best practice. Be sure to perform continuous automated, if possible, health checks for every and all tools used. These are meant to ensure that the tools are operational, running as usual, that the SOC is running smoothly and that the analysts can work under normal conditions.</p><p><strong>5.4.1. SIEM</strong></p><p>The Security Information and Event Management (SIEM) is the main and most important tool for many SOC and MSSPs.<br>Its goal is to centralize artifacts, such as sensors’ event logs, in order to be able to run detection rules against them and fire alerts if anomalies have been detected. Also, the analysts can use it for their investigations by querying it for the artifacts it contains.</p><p><em>5.4.1.1. Generic detection rules</em></p><p>A detection rule is a SIEM (or other tool) query that runs on a schedule and aims to detect the anomalies for which it was created in event logs or other artifacts.<br>The detection rule mentions the artifacts it queries, the labels referring to the data it needs and can include a list of patterns to match, a list of patterns it should not match (called WhiteList or WL) and other thresholds used to determine whether there is an anomaly. Therefore the query for the detection rule has “static parts” (i.e. invariable for the same tool with regard to the environment) such as the detection logic and “dynamic parts” (i.e. variable with regard to the environment) like the labels, the patterns, etc.<br>Under normal circumstances, because a detection rule has dynamic parts, it must be rewritten or at the very least modified and adapted for each new deployment on another tool — SIEM of the same editor but in a different environment. This is very inefficient because there are a number of different versions of the same detection rule (logic) deployed in multiple environments, meaning that with every update to the logic, there must be adaptation to all deployments. This is very hard to track to keep every rule up to date and very time consuming to do.</p><p>Fortunately, as pointed out by the industrialization option number 4 for an MSSP in the previous diagram, there are options to build generic detection rules that can exist in one centralized place and be (automatically) deployed or updated to every environment at once.<br>The prerequisites for this to work are as follows:</p><ul><li>One centralized place to store all generic rules — preferably a DevOps platform.</li><li>Writing the rules’ queries such as the dynamic parts are stored somewhere else and queried at run time. The solution for this strongly depends on the SIEM used but for example, instead of having a hardcoded WL in the query, there could be a subquery of sorts for a CSV file stored elsewhere containing the WL. Then the maintenance of the WL is deported onto that file and the dynamic patterns list becomes a static subquery. The point is that the dynamic parts must not be embarked in static queries.</li></ul><p>Writing detection rules such as this may be a huge change in how things are done, but the work is done only once and reused everywhere, instead of being redone every time and adapted for each environment.</p><p>If there is a SOC data model and it has been correctly enforced, then things can be taken one step further. Since the detection rules can rely on the DM and do not have to match the parsing and content of such or such sensor, they can be applied to all sensors that produce logs containing the data used by them.<br>In other words, where there was one detection rule per firewall editor for the same detection logic, there can be one detection rule that applies to all editors.<br>Even better, where there were three detection rules looking for IP addresses flagged as Indicators of Compromise (IoCs), one covering WAF logs, another one web server logs and the third one firewall logs, there can be one detection rule that applies to all three, because the data will be under the same label across all sensors. That one rule will, of course, work against all editors of these sensor types across all environments of all customers.</p><p>To put things in numbers, let’s say there are 5 customers each with 1 sensor of each WAF, web server and firewall. Between them they have 3 WAF, 4 web servers and 2 firewalls in common, the rest being from different editors. This means that there are 3 different WAF technologies, 2 web server technologies and 4 firewall technologies:</p><ul><li>With “classic” detection rules, there would be 5 * (1 + 1 + 1) = 15 rules to maintain.</li><li>With generic detection rules, there would be 3 (WAF) + 2 (web servers) + 4 (firewalls) = 9 rules to maintain.</li><li>With generic detection rules + an enforced SOC DM, there is… <em>1 rule to maintain</em>.</li></ul><p><em>5.4.1.2. SIEM-abstract detection rules</em></p><p>Detection rules build can be taken one ultimate step further, as advertised in industrialization option number 4 for an MSSP in the previous diagram.<br>An MSSP has to deal with a number of different SIEM editors, depending on the commercial choices made by the company.</p><p>In that scenario, each detection rule mentioned earlier also has to be written and maintained across SIEM technology and query language.<br>The issue is of lesser importance because it is easier to maintain 5 flavors of the same detection rule, each flavor corresponding to a different SIEM query language, than it is to maintain 15 rules for the same SIEM. Nevertheless the nature of the issue is the same.</p><p>A best practice would then be to store each detection rule’s logic in a generic format, having nothing to do with a particular SIEM query language. This will not always be possible, depending on the generic format and the complexity of the queries, but it makes for easier updates because the translation is from the generic format to specific SIEM query languages and not from one query language to others.</p><p>Finally, maybe the hardest feature to achieve would be to automate the translation of the generic format rules to each SIEM specific query language. There are many such “translators” that exist, but they rarely correctly optimize the queries, when they even correctly translate the logic at all. Furthermore, none implements the more important points discussed before, such as subqueries for dynamic parts and use of the SOC DM.</p><p><em>5.4.1.3. Pre-production instance</em></p><p>The “integration”, “development”, “validation”, “pre-production” or other such SIEM instance is used to properly test everything before applying it to production.<br>This instance is a must have to allow enough tests on deliveries, as described in the detection lifecycle. It is used to test all releases before deploying them to customers’ production instances.<br>It is also used for rules design and development as all logs resulting from the tests are stored there and everyone working on rules development has the same data.</p><p>This instance is better the closer it mirrors to the production instance, especially for performance tests that aim to measure resource usage.</p><p><strong>5.4.2. SIRP</strong></p><p>The Security Incident Response Platform (SIRP) is the memory of the SOC’s detection and response.<br>It hosts every ticket that has been created as a result of an alert, whatever its source, along with the detection qualification, status and notes.</p><p>This tool is central for the response specialists, as it is the one they will monitor to know on what they should work (alerts and priorities) and it is also the one on which they will report all the work they have done during the response phase.<br><strong>It is imperative that this tool is as ergonomic as possible for the analysts</strong> because it will directly impact the time they spend handling tickets. For example, if the tool has a low responsiveness, is hard to search, doesn’t display the data needed properly and clearly, or is simply bugged, then the analysts will have to compensate by spending more time and energy to understand the work they have been assigned and report their actions.<br>Nobody likes a laggy, buggy tool that disables people instead of enabling them. Well, SOC analysts are people, too.</p><p>Like any other commercial product, vendors tend to bait clients into buying their tools by advertising that it does everything better than the others, and then some. The current trend is about automation, therefore vendors push hard on this aspect, and include some SIRP features in their product to be able to say that yes, their product is also an SIRP. However, the SIRP is the cornerstone of the SOC and needs to be considered as such, and not just as a feature of something else.<br>If you are reading this and are in charge of making the decision of what tool to use or buy, <strong><em>please, please, please ask your SOC analysts for their opinions and strongly consider their position</em></strong>, as this will be their main tool. There are of course multiple criteria to consider, like the cost, how well the tool integrates in the existing environment, the KPIs it can produce, etc, and it is very likely that no tool will be perfect, and that some tweaks will be required. It boils down to a matter of cost, but the hidden and indirect costs must be <strong>carefully </strong>considered in the equation, as the overhead for analysts can rapidly add up in time spent, and the negative impact on working conditions will have a long term human cost.<br>It is very rare that tools correctly perform multiple very different tasks well, <em>especially when it comes to SIRPs</em>. On the other hand, it is sadly too frequent that once the existing top of the line expensive as possible do-it-all new tool is here, it becomes clear that it doesn’t perform close to what it should with regard to SIRP features. So countless developers are tasked with fiddling with the tool to make a mediocre SIRP because “it costs so much it must perform well”.</p><p><strong>5.4.3. SOAR</strong></p><p>Speaking of fiddling with <em>tools to make them do what they are not meant for</em>, the Security Orchestration, Automation and Response (SOAR) platform is basically a toolbox that holds scripts used together to <em>orchestrate and automate </em><strong><em>response</em></strong>.</p><p>The key takeaways here are that a <strong><em>SOAR is not an SIRP</em></strong> and that the SOA<strong><em>R</em></strong> is used for <strong><em>Response</em></strong>.<br>When it comes to SOARs, there are a few DOs and a few DON’Ts. The DON’Ts have been slightly hinted at above:</p><ul><li><strong>DO NOT</strong> try to use a SOAR as an SIRP — unless the consensus amongst SOC analysts, after they could test it, is that it is good enough as an SIRP.</li><li><strong>DO NOT</strong> use a SOAR for something else than response. In particular, as shown in the incident lifecycle earlier, the detection phase comes before the response phase. Therefore the SOAR must wait its time in the response phase to be put to use <strong>and not</strong> be tasked with things such as recurrent artifacts collection or running SIEM queries for detection purposes.</li></ul><p>Most of the DOs depend on the technology chosen but some are more generic:</p><ul><li><strong>DO</strong> break up playbooks in small unitary actions so that they can easily be assembled like blocks to build bigger and more complex playbooks. This also makes for easier maintenance if some action needs to be updated or fixed.</li><li><strong>DO </strong>divide the creation of playbooks between developers and response specialists. The response specialists should express their needs of unitary actions to developers who will script them accordingly. Then the response specialists can build all the playbooks they like using the set of blocks they have been given.</li></ul><p>Always remember that a SOAR is “just” a platform for storing and executing pipelines of scripts at the right time with correct parameters. Everything else is some sort of wrapper.</p><p><strong>5.4.4. DevOps platform</strong></p><p>As with other tools, there are many DevOps platforms that are available for use (free or otherwise), with a few that are a bit more popular.<br>To put it simply: there is no realistic way around a DevOps platform to implement the industrialization options related to automation. If there is no automation then there is no real scaling, including for advanced detection capabilities.<br>The DevOps platform enables CI/CD/CD (Continuous Improvement/Continuous Delivery/Continuous Deployment) which can be summed up by automations that let the platform test, package and send to production any and/or every bit of modification made, depending on the configuration.<br>Also, modifications are versioned and stored so that it is easy to find who modified what when and to perform a rollback to a previous version, if needed.</p><p>A good “IT guy” (m/f) is a lazy IT guy, the lazier the better. It is just preposterous to work with or around computers and not use them for their greatest strength, which is the automation of tasks that do not require a human brain.<br>It is not acceptable to have people copy and paste whatever, over and over again. So lazy up and think very hard whether you can perform the task you need to do just once and have the computer take over for the rest of time. If it’s possible, then automate it and if not then it must require some thinking, which is the greatest strength of humans.</p><p><em>5.4.4.1. Repositories</em></p><p>The DevOps platform hosts repositories which hold the files uploaded onto it, very much like folders.<br>The structure of the repositories must be well thought out and correctly implemented from the start as it is often quite a pain to refactor already working repositories if the architecture is flawed. This structure is important as it will help ease the development, configuration and access control for authorized users.</p><p>The architecture will vary depending on the needs, constraints and possible mid to long term evolutions, but a good way to approach it is to think in terms of groups of features. These groups are composed of features that are close enough in terms of need covered and people using them.<br>An architecture for an MSSP could look as follows:</p><ul><li><strong>Tools: </strong>Contains all the scripts that do not achieve any feature by themselves but are called and used by scripts from the other repositories to build the features.</li><li><strong>Infrastructure: </strong>Contains all scripts and configuration files that deal with the automation of infrastructure deployment, either for initial deployment or for MRO/upgrades.</li><li><strong>Datamodel: </strong>Contains the SOC’s data model and the parsing configuration for all sensors on all tools used by the SOC.</li><li><strong>Production: </strong>Contains all scripts and configuration files that deal with the usage of the SOC/MSSP tools and their deployment to its customers. This repository tends to the “front end” (parsing, detection rules configuration, WL, etc) while the <em>Infrastructure</em> one tends to the back end.</li><li><strong>Detection: </strong>Contains all generic detection use cases the SOC has — more details on this soon.</li><li><strong>Packages:</strong> Depending on the tools used by the SOC, such as SIEMs, there may be some package, bundle or other wrapper needed to hold all configuration that will be pushed onto the tool. This repository contains these product and editor specific packages used by the SOC.</li></ul><p>Each of these repositories also contain the necessary scripts and configuration required to perform all the tests needed to validate modifications. The user privileges would be set, as always, on a need to have basis: every read, write and execute right must be given only to those who need it to perform their jobs.<br>Also, DevOps best practices are advisable, as always, for every repository.</p><p><em>5.4.4.2. Pipelines</em></p><p>Pipelines are basically a series of automations launched one after another with configuration options such as dependencies of the downstream jobs on the upstream ones. These automations are scripts given some arguments to perform some actions.<br>Pipelines are therefore a key component of the DevOps platform and can have different purposes:</p><ul><li>Building pipelines which generate files, packages and what not with each new modification of the source files.</li><li>Testing pipelines for modified files and built components. These will perform, for example, the “unit tests” mentioned in the detection lifecycle.</li><li>Deploying pipelines for built components. These will automatically with every modification, on a schedule or semi-automatically with a push of a button deploy the components to the target(s).</li></ul><p>It is recommended that only the jobs needed with regard to the modifications processed be displayed to the user and launched by the server in order to avoid confusion, misclicks and resource waste.</p><h4><strong>5.5. SOC Use Case</strong></h4><p>SOC Use Cases exist to answer a specific need of detection and protection of the intelligent systems — IT, OT, cloud… — of an entity. They form the core of the SOC and as such they are its most critical assets. They absolutely need to be well thought, defined, tested and maintained.</p><p>A SOC Use Case has multiple components but depending on choices made, these components may not be all stored in the same place. The important thing is that the components reference one another so that it is (easily) possible to get the full picture of the use case. Any missing component will prevent someone at some point from doing their job properly.<br>These components are:</p><ul><li>Risks covered</li><li>Knowledge</li><li>Detection rule</li><li>Response procedure</li><li>Control logs — stored logs from simulations or generated logs containing anomalies that the detection rule should and should not detect.</li><li>Simulation scenario — either in plain text for manual simulation or a script to automate it.</li></ul><p><strong>5.5.1. Risks</strong></p><p>There is no way for a SOC to defend against all possible threats for different reasons such as technical limitations, human limitations, knowledge limitations, etc.<br>Therefore, the defense must be oriented using specific criteria and one way to achieve this is to use a risk based approach.</p><p>The risk that needs to be addressed for the entity the SOC protects is a business risk such as “Factory production stops” or “Intellectual property theft”. The first step is to clearly identify these risks.<br>Then, the business risk needs to be translated into a cyber-security risk which could be for example, respectively for the cases mentioned before “(Distributed) Denial of Service on factory devices” and “Data exfiltration from critical projects servers”.<br>Finally, the cyber-security risks must be decomposed into attack scenarios that can be, in turn, decomposed in unitary steps the attacker would take. The detection rules will be based on these steps.<br>Depending on whether it is a SOC having only one environment to monitor or an MSSP with multiple customers and environments, the risks that can be associated with the SOC Use Case will vary. In the case of a SOC, all the risks up to the business risk can be associated with the SOC Use Case right away. In the case of an MSSP, only the unitary steps or the attack scenarios could be linked directly in the SOC Use Case, while the rest of the risk mapping should be done on a per customer/per environment basis.</p><p>It is strongly recommended that the categorization and description of the attack scenarios and unitary steps are based on already existing and widely known frameworks, such as the MITRE ATT&amp;CK matrices for example.<br>Always keep in mind that frameworks such as these <strong><em>only reference known, already observed attack patterns</em></strong> and are therefore in <strong><em>no way an exhaustive list of possibilities</em></strong>.<br>Also, multiple entities have published lots of recommendations for prevention and protection. These recommendations can be used both for risk and attack scenarios definition.</p><p><strong>5.5.2. Knowledge</strong></p><p>The following is a list of items that must be thoroughly documented in order to be able to maintain and upgrade the SOC Use Case so that everyone using it can correctly do their job.</p><ul><li>Names of the people involved in the ordering, creation and upgrade of the Use Case — these should answer the question “<em>Who </em>has created the Use Case?”</li><li>Limitations and blind spots of the Use Case and references to all relevant materials used to create it — “<em>What </em>is the technical scope of the Use Case?”</li><li>The virtual scope of coverage of the Use Case in terms of type of logs, devices, users, etc — “<em>Where </em>is the Use Case applicable?”</li><li>Timestamped statuses of all tests performed on the Use Case — “<em>When</em> has this Use Case been cleared for production?”</li><li>Detection rule, response procedure, control logs and simulation scenario — “<em>How </em>should the Use Case work and be used?”</li><li>Business risk, cyber-security risk and the attack scenarios mitigated — “<em>Why </em>does the Use Case exist?”</li></ul><p><strong>5.5.3. Detection</strong></p><p>The detection rule is the most obvious part of the SOC Use Case as the main goal of creating one is to detect anomalies in the environment.<br>There are however a few attention points to follow in order to ensure that the detection rule is pertinent, usable and maintainable.</p><p>The first one is about the inputs for the detection: the data, in the form of logs. <em>It is crucial that the logs are complete and correctly parsed</em>. In the end, this is about trust: the customer (internal for a SOC or external for an MSSP) trusts its SOC for protection, the SOC trusts its Use Cases for detection and therefore the whole trust chain relies on the availability and integrity of the logs fed to the Use Cases through the SIEM.</p><p>The second attention point concerns the dynamic nature of the detection rule. The rule must be coded in a way that enables dynamic — i.e. not hardcoded — tuning.<br>It is highly recommended that every detection rule embarks one WhiteList — per rule — for tuning. In any case it is mandatory that the WL, pattern list and threshold(s), if applicable, can be edited directly in the tool and that those modifications have an <em>immediate impact on the detection rule</em>.<br>Although the normal workflow could be that the changes in WhiteList, pattern list and thresholds be done through CI/CD, a technical issue or delay in the CI/CD chain must be anticipated. Therefore the possibility of dynamic editing must exist to ensure the best effectiveness and resilience possible of the tool and the SOC analysts in charge of the response. As this should be rare and an emergency, a break-glass account could be just the solution — of course, the use of this account would be monitored.</p><p>The third attention point deals with the actual code of the rule, the one that will be interpreted by the tool. The code can either be editor specific, meaning that the detection rule is written specifically for such or such SIEM for example or it could be an editor generic rule that is translated into specific code at some point in the CI/CD pipeline.<br>Whatever the case, the actual editor specific code needs to follow the best practices for that tool and be as optimized as possible in terms of resources that the tool will spend on that rule. The goal of the detection rule is to detect and the first action after an alert is created is to triage it; this means that the rule must create an alert that has just the right amount of information — one that is too verbose or not enough will negatively impact the analysis.</p><p>The last attention point is about the building of detection rule logic. The detection rule goal — what it is meant to detect — is based on the work done with the risks and attack scenarios definition.<br>Hence each detection rule must be tested in multiple ways as described in the detection lifecycle to ensure that the rule actually works and detects what it is supposed to detect.</p><p><strong>5.5.4. Response procedure</strong></p><p>The response comprises the investigation of the alert created by the detection rule and the remediation, if need be.<br>As the investigation is based on an alert created by a well-defined detection rule, it can — more or less easily — be standardized and broken down into unitary steps. Also, since the majority of the alerts raised by the tool (e.g. SIEM) do not end up being actual widespread attacks, most of the remediation can be standardized as well. It is recommended that these be standardized as it brings many benefits: shorter training time for the SOC analysts, better understanding of the scope of the SOC for the analysts, increase in efficiency and reliability of the response specialists team as a whole.<br>It is best that <em>these standardized procedures take the form of simple diagrams which are easily accessible by the SOC analysts</em>. Of course, depending on the maturity of the SOC, the investigation and remediation can be partially or completely automated, for example with the use of a SOAR.</p><p>In order to maximize efficiency and maintainability, it is best to build generic, basic “diagram blocks” and then assemble them to create the diagram that will be used by the SOC analysts in the end. This way, if part of an investigation or remediation changes for whatever reason, it is quite simple to update all the diagrams at once by updating the corresponding block.<br>The diagrams and the <em>basic blocks must be as basic as they can be</em> — the goal being that there is no misunderstanding and the actions done by the analysts are always the same, improving the overall reliability of the SOC. The other advantage is that if and when a SOAR comes into play, it will require basic, step by step instruction to be able to automate once manual work — the translation from a basic step by step human readable diagram into instructions for the SOAR should be an easy one.</p><p><strong>5.5.5. Alerts correlation</strong></p><p>Oftentimes, there are a number of detection rules that tend to detect compliance issues, misbehavior from users or specific usage of an account for example. These rules can be seen as “hygiene” rules from a security perspective.</p><p>Hygiene rules, together with some basic detection rules which are investigated unitarily, tend to yield a high percentage of False Positives and/or True Positives that are legitimate actions. Moreover, investigations on these alerts are more often than not quite boring for SOC analysts, especially if they make the better part of all the alerts to handle.<br>Although they are necessary because they can provide context and a nice trail of clues as to what the attacker did in case of an actual incident, it is highly unlikely that advanced actors are detected by the SOC using these rules in a unitary fashion.</p><p>In order to both detect advanced threat actors and limit the number of pointless — from a cybersecurity point of view — investigations for the analysts, it is recommended to create and use “advanced detection” or “alerts correlation” rules. These rules are based on the alerts generated by all the classic detection rules and correlate these anomalies over an extended period of time and across the attack killchain.<br>In doing so, not only the unitary alerts from hygiene rules can be ignored but these rules become quite pertinent as they can bring more pieces to the “attack puzzle”. It is then possible and advisable to have more detection rules that detect less pertinent unitary anomalies and only use them for alerts correlation.<br>More importantly, this correlation enables the SOC or MSSP and its analysts to take a step back from all the alerts generated and actually see the big picture of past or even ongoing attacks.</p><p>All in all, alerts correlation is a gigantic step towards improving the SOC capabilities to detect complex attacks but they require many prerequisites — all of which have been discussed before.</p><h4><strong>5.6. Conclusion</strong></h4><p>The main takeaway from this chapter is that tools have to be configured and customized to an extent in order to extract their full potential. If they are used with default settings and the users — here SOC or MSSP personnel — do not understand their purpose, how they work and how to use them then they are just a waste of time and money for the SOC as an entity and for every user as well.</p><p>On the other hand, customization should be limited to that: customization. Using a commercial or open source tool and then sinking countless days of development in it to make it do what you wanted is not the way to go in most cases — it would be a lot better to switch to another tool that corresponds to the needs or use an additional one in complement.</p><p>If you buy a car, you may want to change the paint, add electric windows or get heating seats but you wouldn’t go and try to add wings to it in the hopes it would fly. It’s not because an application is more abstract than a physical object that your thought process should be any different.</p><h3><strong>6. Conclusion</strong></h3><p>A lot of current SOCs and MSSPs do not seem to perform as well as their customers — internal or external — would expect and can be seen as an overpriced check in a todo list from an external point of view. Internally, the jobs can be short term exciting — especially for the building phase and for the management — but do not end up being fulfilling or even interesting long term for most of the analysts population.<br>This state of things is due to multiple factors:</p><ul><li>The majority of the people attracted by these kinds of jobs may not be understood as well as they should be, especially when it comes to their motivations, needs and expectations.</li><li>The priorities for the money spent may not be the right ones: money might be wasted on short term temporary fixes when it should be invested in mid to long term evolution.</li><li>The tools and methodologies may not be as well thought out, implemented or industrialized as they could be.</li><li>The internal structure and processes of the SOC/MSSP teams may not be as optimized as they could be.</li><li>Maybe the most neglected, but nevertheless crucial point of external (to the SOC or MSSP) communication may need some improvement.</li></ul><p>They are of course possible solutions to all these issues:</p><ul><li>Understanding that people are the key element to a SOC or MSSP and modeling the work environment for the type of profiles that are recruited.</li><li>Including technical people in financial discussions, explaining to them the financial objectives and listening to the compromises they propose to balance short and long term gains within the financial objectives.</li><li>Reviewing the tools and methodologies and having the courage to make a change even if it means going through a short term transitional hit for the mid and long term benefits.</li><li>Questioning the structure and processes and aligning them with the goals set for the SOC/MSSP to achieve.</li><li>Explaining to every member of the SOC/MSSP (management included) that explicitly communicating on the work they are doing is key and helping them find the correct metrics that reflect the actual work they do and that can be understood by their customer(s) and the executives.</li></ul><p>When the issues described above are resolved and the SOC or MSSP is correctly industrialized (in all its aspects), its actual potential shows by itself, even to non technical people.<br>Then and only then the journey that will shift SOC and MSSP paradigm from “reporting past malicious activity” to “catching malicious activity as it happens” can truly start and safely continue until it ends.<br>This means that the majority of the SOC’s/MSSP’s resources can be used for actual improvement in detection and in response leading to more detections, increased pertinence, quicker detection and response time, existence of and better remediation…</p><p>At last, this will achieve the goal of reducing or even eliminating the overall frustration around SOCs and MSSPs, hopefully for good.</p><h3>Acknowledgements</h3><p>I am always cautious of putting any Personally Identifiable Information (PII) publicly accessible on the internet and even more so on the web, so I will not name anyone here.<br>However, I sincerely thank the people who agreed and took the time to read, discuss, advise and proofread my work, because I strongly think that the present version is incomparably better than the first one I showed them, thinking it was ready.</p><p><strong>Summary<br></strong><a href="#3dc3">5. Technical aspects</a><br><a href="#e1b1">5.1. Knowledge management</a><br><a href="#6ba2">5.2. SOC/MSSP environment</a><br><a href="#6399">5.3. Logs and logging</a><br><a href="#79d9">5.4. Main SOC Tools</a><br><a href="#6a86">5.5. SOC Use Case</a><br><a href="#30af">5.6. Conclusion</a><br><a href="#ae86">6. Conclusion</a></p><p>Part 1: <a href="https://medium.com/@7rm1ef8/a-soc-mssp-guide-1-of-4-3f5450638a98">https://medium.com/@7rm1ef8/a-soc-mssp-guide-1-of-4-3f5450638a98</a><br>Part 2: <a href="https://medium.com/@7rm1ef8/a-soc-mssp-guide-2-of-4-f4fb93be2422">https://medium.com/@7rm1ef8/a-soc-mssp-guide-2-of-4-f4fb93be2422</a><br>Part 3: <a href="https://medium.com/@7rm1ef8/a-soc-mssp-guide-3-of-4-658e0cf99745">https://medium.com/@7rm1ef8/a-soc-mssp-guide-3-of-4-658e0cf99745</a></p><p>A PDF for all four parts is available on my <a href="https://github.com/7rM1EF8/docs/tree/main/a_soc-mssp_guide">GitHub repository</a>.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=a78779d830dd" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[A SOC-MSSP guide (3 of 4)]]></title>
            <link>https://medium.com/@7rm1ef8/a-soc-mssp-guide-3-of-4-658e0cf99745?source=rss-d9513b09c7f9------2</link>
            <guid isPermaLink="false">https://medium.com/p/658e0cf99745</guid>
            <category><![CDATA[soc]]></category>
            <category><![CDATA[cybersecurity]]></category>
            <category><![CDATA[mssp]]></category>
            <dc:creator><![CDATA[Gaston MARTIN]]></dc:creator>
            <pubDate>Sun, 26 Nov 2023 11:52:30 GMT</pubDate>
            <atom:updated>2023-12-03T10:11:31.943Z</atom:updated>
            <cc:license>http://creativecommons.org/licenses/by/4.0/</cc:license>
            <content:encoded><![CDATA[<blockquote>From reporting malicious activity to catching it as it happens</blockquote><p>Part 1: <a href="https://medium.com/@7rm1ef8/a-soc-mssp-guide-1-of-4-3f5450638a98">https://medium.com/@7rm1ef8/a-soc-mssp-guide-1-of-4-3f5450638a98</a><br>Part 2: <a href="https://medium.com/@7rm1ef8/a-soc-mssp-guide-2-of-4-f4fb93be2422">https://medium.com/@7rm1ef8/a-soc-mssp-guide-2-of-4-f4fb93be2422</a><br>Part 4: <a href="https://medium.com/@7rm1ef8/a-soc-mssp-guide-4-of-4-a78779d830dd">https://medium.com/@7rm1ef8/a-soc-mssp-guide-4-of-4-a78779d830dd</a></p><p><strong>Summary</strong><br><a href="#d852">4. Operational aspects</a><br><a href="#a923">4.1. Knowledge management</a><br><a href="#2d28">4.2. Infrastructure lifecycle</a><br><a href="#91f9">4.3. Detection lifecycle</a><br><a href="#00df">4.4. Incident lifecycle</a><br><a href="#1ce2">4.5. Training and monitoring</a><br><a href="#c8d0">4.6. Customer service</a><br><a href="#5623">4.7. Conclusion</a></p><h3><strong>4. Operational aspects</strong></h3><p>This chapter goes over the main operational points to address in a SOC or MSSP. Some of them are easily overlooked and sometimes pushed back again and again until “there is time, because we are too busy at the moment”.<br>The truth is that as long as the time available for people who could work to improve the SOC is spent on quick fixing bugs, getting quick wins or rushing urgent — or more likely already late — projects to production, there will never be any improvements made. It is even worse in the case of an MSSP because the current customers will likely continue to expand their monitored environment and new customers will come in, resulting in even less available time for improvement and automation and more bug fixing, quick wins and late projects.</p><p>Therefore, the time for improving operations has to be made available to the right people to get improvements going. This will hurt operations for a bit, because it will take some time to improve and to see the return on investment come in, but it is the only realistic way — without a budget increase that could translate into recruitments — to transition from a vicious circle to a virtuous circle.</p><p>The subchapters in this chapter are not ordered by any kind of to-do priority: they should all be addressed at one point, but the priority depends on the current state of the SOC and from what would give the maximum return on investment.</p><h4><strong>4.1. Knowledge management</strong></h4><p>Knowledge management is an actual job that requires specific skills and no amount of good intention or advice can replace that. It is strongly recommended to hire someone for this job either for the whole company or just the SOC, depending on the size and needs.<br>However, as this tragically falls into the “what is this job, did you make it up?” / “why do we need to pay someone just for this, can’t you handle it?” category, it was important to say a few words about what can be done in this chapter, and a few more about how it can be done in the next.</p><p>As a disclaimer, please note that the pointers about knowledge management given in this document do not come from a professional knowledge manager and should not be regarded as best practices but rather as a small buoy on which you can cling desperately to try and not drown into the infinite ocean of knowledge.<br>That was a bit dramatic indeed but sadly not that much of an overstatement. As previously mentioned, a SOC is a complex entity and the mass of purely job related knowledge needed is too much on its own, but to that is added the contextual knowledge of the environment to monitor, multiplied by the number of customers when it comes to an MSSP.<br>There is simply, humanly no way that any one person can know everything he or she needs to work in a SOC by heart, without looking up or checking documentation multiple times per hour. If someone pretends otherwise, they’re either lying outright to try and brag or a complete idiot that actually does not understand a thing they are doing. In both cases, it would be advisable to avoid having such people in a SOC or MSSP.</p><p>There are two main points to address when it comes to knowledge management and operations: creating and maintaining the knowledge and having and keeping the knowledge base actionable.</p><p><strong>4.1.1. Knowledge creation</strong></p><p>Knowledge, may it be documentation, processes, procedures, reports, etc. is key in many fields so that things can evolve and move forward instead of repeating themselves. That is true for a SOC and even more so for an MSSP.<br>Knowledge is perhaps the most worthy investment for the future, but writing documentation, for example, can be very tedious and therefore those who actually enjoy working on it are few, while most do it because it’s just “that part of the job that you have to do” and some try to avoid it at all cost. However, it is imperative that everything is fully and accurately documented, because everyone should be expendable in the way that there is no Single Point Of Failure (SPOF). If anyone were to suddenly disappear, there should be some time to recover, but the recovery must be full without any loss of knowledge.</p><p>Therefore, since this is a crucial task and no one really wants to do it, everything must be done to encourage, enable and facilitate knowledge creation. For example, some of the following could be done:</p><ul><li>Explain and then demand that processes and procedures be followed and enforce it.</li><li>If there is an issue with a process or procedure, quickly react to correct it and/or propose that everyone contributes — the person pointing out that there is an issue proposes a correction.</li><li>In every task and mission, plan and allocate time for knowledge creation and insist that the task is not complete until knowledge has been created.</li><li>Educate everyone to always refer to the knowledge base for everything.</li></ul><p>There are many other creative ways to make everyone participate in knowledge creation but the best advice may be to try and show everyone that the knowledge they’re creating has value. There is always value in knowledge but it shows only when it is used and showing that knowledge creation is meaningful and has value is oftentimes enough to convince people to participate.</p><p>Unfortunately, creating knowledge isn’t the end of it, because it’s alive. Granted there are some things that are immutable but the vast majority needs to be updated to stay relevant. Therefore, each piece of knowledge should be in one of the following states:</p><ul><li>Up to date and used</li><li>Being created or updated</li><li>Outdated and being archived (optionally before a later deletion)</li></ul><p>This is an ever ongoing effort that must persist and be encouraged to prevent any loss of information over the long run. The cost of losing knowledge will always be, at best, the time and resources used to create it in the first place and at worst a net loss plus whatever it costs to find another way to achieve the same goal.</p><p><strong>4.1.2. Knowledge organization</strong></p><p>For the knowledge to have a real value, it must be used and in order to be used, it has to be organized, accessible and easily searchable.<br>This is the hard part when there is no one tasked with knowledge management, because there can either be multiple authorities or none at all when it comes to organizing. If no one has been designated by upper management, then at least someone should be designated within the SOC as a decision maker when it comes to knowledge and it should be made clear to everyone inside (and outside) the SOC that this person and only this person can make decisions about organizing knowledge within the SOC. This would ideally be someone that understands the needs of every team and has some experience — as a witness if nothing else — with successes and failures in knowledge management.</p><p>At this point it would be best to limit as much as possible the number of solutions hosting knowledge because it would most likely be far easier to search one source of knowledge than many sources. If there has to be more than one source of knowledge then it should be very explicit and clear to everyone what knowledge can be found where — preferably have each source host specific types or perimeters so that there is no overlap and all the knowledge on a single subject is in a single place.<br>In any case, the following should be observed:</p><ul><li>There are regular communications about what knowledge can be found where — or one document explaining that and regular reminders about its existence — so that newcomers get the correct information right away and other staff members are kept updated.</li><li>Everyone must be able to access every solution hosting knowledge described in the previous point.</li><li>There must exist an explanation on what knowledge to expect and more importantly on how to use every solution hosting knowledge. That explanation should of course be the landing page when accessing the solution.</li><li>Processes for creation, modification and deletion of knowledge must exist and be enforced. These should include a validation step from another entity (either a person or a bot).</li><li>Other quality assurance items, such as taxonomy, nomenclature, templates, etc. must also exist and be enforced.</li></ul><p>Knowledge organization is indeed hard because once everyone understands the value of knowledge and keeping it up to date and starts creating and modifying things all around, it can very quickly become a huge mess.<br>Since it’s not possible for everyone to know by heart how the knowledge is sorted, there must be rules, validations and templates to guide them through the process and make it easier. Keep in mind that creating knowledge is not a sexy task in the first place and now that people start doing it seriously, they should not be slowed or spooked… too much.<br>That balance is the hardest thing to grasp: how little is not enough and how much is too much? Not enough management and there will thrive duplicates, outdated knowledge or even misinformation; too much and people will give up, not wanting to have to jump through hoops to do a task they didn’t want to do in the first place.</p><h4><strong>4.2. Infrastructure lifecycle</strong></h4><p>In a SOC and especially an MSSP, there are three main lifecycles that should be defined, enforced and monitored to ensure the continuity of operations.<br>The first one is about the infrastructure used by the SOC, because it is the foundation on which detection and response are built and if it fails, there is not much the SOC can do.</p><p>Every SOC and MSSP needs to define its own lifecycle because it will depend on a number of things such as choices made, services available, SOC jobs definition, SOC teams composition… The lifecycle may or may not vary depending on the hardware and software but if it does, every possibility needs to be defined, enforced and monitored.<br>In order to help with this, there are a few pointers to come, for the two main phases of said lifecycle. As stated before, these pointers will not be tied to a specific editor or even tool and could be applied for a SIEM, a SOAR…</p><p><strong>4.2.1. Infrastructure architecture and deployment</strong></p><p>The first phase is about the architecture and deployment of the infrastructure: its “birth”.</p><p>The actual architecture design will of course vary with the goals, the tool and the editor, but there are some things that might be regarded as obvious or even dumb that should be double-checked to avoid surprises and complications down the line:</p><ul><li>If possible, try to use the same specs of hardware/OS across tools and customers as it will limit surprises and make MRO easier — this could then be templatized to automate deployment.</li><li>Carefully design and test different “standard architectures” so that when a new customer comes in, there is no or only little time spent on the design step — only for some specific needs and customizations. This allows for a simpler deployment as it would mostly be copy/pasting something that already works elsewhere.</li><li>Always test — if possible with production load and data — before going into production, especially if there is a need for collocation of multiple tools or roles on the same server.</li><li>Make sure secrets are unique, strong enough and… stay secret — especially for anything with some admin privileges.</li><li>Use secure network protocols everywhere, meaning both for the tool’s internal and external traffic.</li></ul><p>The last two points sure do seem obviously dumb in a document about SOC and MSSP, but they very sadly need to be mentioned.<br>Keep in mind that without its tools, a SOC is just a bunch of people taking guesses and rolling dice to figure out what may have happened or is still happening — and more and more attackers are figuring this out as well.</p><p>As much as possible, use best practices for that tool/editor both for the back end and front end configuration and when you don’t, make sure that there is an actual reason and document it. This will always make maintenance and future evolution easier as it makes the configuration standard and recommended by the editor.<br>The best practices also often help a lot in resource optimization, which is easily overlooked when building up a new infrastructure because there is no need for it. However, resource optimization becomes key for a long term exploitation and it is much easier (and cheaper) if it’s part of the design and documented than if some or all the work has to be done again later on when freeing up resources is a must have.<br>For this to be possible, the people working on the architecture and deployment must be sufficiently trained to know best practices in the first place and when not to apply them might yield better results. Moreover, people that are already trained tend to be less eager to “use that project to test stuff” because they already know the results or know how to build a lab environment when they are unsure, thanks to said training. There is simply no way to overstate how bad it is when the production environment ends up working somewhat but “it was built years ago by that guy who liked to fiddle, but isn’t there anymore”.</p><p><strong>4.2.2. Maintenance, Repair and Operations</strong></p><p>The second phase is about the main part of the life of the infrastructure, after it first comes online for production purposes until it is decommissioned.</p><p>The single most important point here is that the only way to guarantee the availability of all the tools used by the SOC is to have people dedicated to MRO duties. “Dedicated” means that these people should <strong><em>always</em></strong> have at least priority for MRO and especially fixing whatever is down as <em>without these tools, the SOC analysts find themselves unable to do their job</em>.<br>The organizational particulars as in which team the people dedicated to MRO belong do not matter much in fine as long as these MRO people are dedicated to that job and are accountable to the SOC with some sort of SLAs. Of course, this does not have to be that formal, especially if they are part of a SOC team but there absolutely cannot, ever, be a time when something is down and it’s either no one’s job in particular to fix or it’s someone’s job but that person cannot do it because he or she has other priorities.</p><p>Of course MRO tasks do not add up only to fixing downed servers or services and the most time consuming part is often keeping everything up to date. In order to achieve this in a graceful manner, there are a few attention points:</p><ul><li>Having a precise inventory of what to maintain (hardware and software) and where (if multiple environments in case of an MSSP for example).</li><li>Robust processes and procedures to ensure that there is very little room to fail even if the person assigned is missing part of the context or is light on some skill.</li><li>A well established planning that is shared with other SOC teams (and the customers) to limit production issues and avoid panic. This point implies that scenarios and decisions must be established on how to go about upgrading and updating (i.e. by tool? by editor? by customer? …) and continued communication with every stakeholder exists. Here it is especially important to keep in mind that the tools are what make the SOC operate and although upgrades and updates have to be done, they should be done in the least impactful manner possible for the SOC.</li><li>Skills and knowledge of the person assigned to the task versus what needs to be done. It may or may not be preferable to wait for the right person if it means postponing the job, but this kind of decision is better made in advance as a plan B scenario.</li></ul><p>Planned MRO activities as described above are implied to be manual as it is often the case. However, it can be very hard to do properly in larger environments or multiple environments (e.g. MSSPs), especially if the MRO team is undersized.<br>That’s where a DevOps approach should be considered to automate as much as possible and save a lot of time. DevOps always requires an investment (resources and time) but is simply a must have for MSSPs as manual upgrades and updates are too time consuming and prone to errors, which require troubleshooting, which consumes some more time… This is made easier if the infrastructures deployed in the first place are standardized or even templatized and follow best practices.<br>Again with DevOps, it does not matter to which team these people belong but they absolutely need a good understanding and close working relations with all of the SOC teams to correctly understand their needs and implement them.</p><h4><strong>4.3. Detection lifecycle</strong></h4><p>The second main lifecycle is the detection lifecycle and it is probably the most important since the goal of a SOC is to detect anomalies.</p><p>This lifecycle defines the steps through which to go to build and improve detection use cases and the teams involved at each step. At any time, the state of any detection use case should be clear to everyone in the SOC or MSSP and who is responsible for the current step.</p><p><strong>4.3.1. Detection engineering workflow</strong></p><p>The engineering workflow will of course vary from one SOC or MSSP to another because it depends on a variety of factors, but the steps should more or less always follow the same pattern as shown in the diagram below.</p><figure><img alt="Diagram of an example of detection engineering workflow" src="https://cdn-images-1.medium.com/max/821/1*23nBoRhwU0AqqzBN2S1hXQ.png" /><figcaption>Diagram of an example of detection engineering workflow</figcaption></figure><p>The light purple steps represented in the detection engineering workflow diagram are not actual detection engineering steps because they deal with the initial idea or interacting with a production SIEM for example.<br>Every other step can and it is <strong><em>strongly</em></strong> recommended that they should be performed by the same team/people: the “detection specialists” mentioned earlier who could work together in a “purple team”.</p><p>The details of the contents of a detection use case will be discussed later on but the workflow for its engineering should always start with an idea followed by research and simulation and end with a permanent monitoring of whether it works.<br>If and when it doesn’t anymore, either improve it if possible or retire it, because it is worse to have a malfunctioning detection rule in production than none at all: with the latter it is clear to everyone that there is a miscoverage.</p><p><strong>4.3.2. Workflow tests</strong></p><p>There are 6 tests represented in the detection engineering workflow, all of which are mandatory to ensure that the detection use case works as intended.<br>It is strongly recommended that these tests be automated and the results only reviewed by a human in case of failure. More on the tools, including automation, in the next chapter.</p><p><strong>Unit test<br></strong>The unit tests imply that the detection engineering is done using a DevOps platform to help manage versions, automate testing, collaborate, etc. — this will be discussed in more detail later on.<br>Using a DevOps platform, unit tests are tests that are run with each commit — a commit is any file modification pushed to the server. These tests aim to check all modifications to control configuration integrity such as common mistakes and incoherence between files, ensure minimum requirements are met and ultimately prevent the deployment of any misconfiguration.</p><p><strong>Pertinence test<br></strong>A pertinence test checks that the detection rule is working as intended, i.e. it triggers when expected and only then and the alert it creates contains useful data.<br>This can be achieved by (re)playing a scenario, through scripts in a lab environment to have the devices create logs and submit them to the SIEM, through generated events made with an event generator or by reusing the logs stored from the initial behavior simulation.<br>Then, the detection rule should correctly detect every anomaly it was meant to detect and ignore the rest of the events. At this point, it is recommended to test the detection rule against more logs than only those which contain the anomaly to detect to ensure that there are no False Positives.</p><p><strong>Regression test<br></strong>Regression test aims to confirm that the new version of the detection rule does not introduce any breaking change. A breaking change is a major modification which breaks compatibility with older versions. In the case of a detection rule, this translates into the newer version of the rule not detecting anomalies that it previously detected, effectively breaking (part of) the detection.<br>Sometimes a breaking change is wanted and expected after a complete overhaul of a malfunctioning detection rule for example. In that case the regression test would fail but the failure would be converted into a pass once the reason has been reviewed.<br>Since reducing the number of False Negatives is a higher priority for the SOC than reducing the number of False Positives, the regression test will guarantee that the newer version of detection rule detects as much as older versions. There are two checks to perform to conduct a regression test:</p><ul><li>Run the detection rule using at least the same set of events or logs from the previous versions of the detection rule — meaning that there can be more logs if the rule now detects other anomalies, but the same set as before must be present. The same number of alerts must be triggered over the same logs set, proving that the newer version detects at least as much as the previous one.</li><li>The alerts triggered by the newer version must contain at least the same data in nature and labeling as older versions.</li></ul><p>If either check fails then the regression test fails and it must be reviewed to understand the reason. If it was expected, then the failure is converted into a pass, otherwise there is some fixing to do.</p><p><strong>Performance test<br></strong>This test’s goal is to determine the resource usage of the detection rule as the SIEM resources are limited and the impact of deploying the rule must be known in advance to determine whether it is worth it in a resource constrained environment.<br>The relevant indicators to measure vary depending on the SIEM editor but the impact of the rule on resources must be known and a threshold should exist for this test which, if breached, fails the test. In that case, a review must be done to either optimize the resources used by the detection rule or document why the high resource consumption of the rule is acceptable.</p><p><strong>Validation test<br></strong>The validation test is the last step before declaring a detection use case ready for production. This test consists in simulating in the environment the behavior the detection rule should detect and checking in the SIEM that an alert has actually been fired by that detection rule proving that the logging, the collection, the parsing and the detection rule are all correctly configured.<br>This final test determines whether the detection rule delivered lives up to expectations.</p><p><strong>Working detection test<br></strong>The so-called working detection test pays in quality assurance what it lacks in originality. It is basically the same thing as the validation test but repeated (randomly) over time to ensure the system keeps working as expected.<br>This can be achieved by automating the previous validation test, which would be the better way, but it can also be done by injecting logs into the SIEM and checking that an alert is fired by the detection rule. The former is better because it also tests logging and collection but is not always possible; the latter “only” tests parsing and detection, but is easier to build.<br>Of course, if any working detection test fails, the matter must be addressed at once, because it means that that detection rule is out of order.</p><p><strong>4.3.3. Purple team</strong></p><p>Since the goal of a SOC is to detect anomalies in the environment in order to respond to them afterwards, detection is the key for a SOC or MSSP to be relevant.<br>There have been and are more and more instances where purple teams are assembled to simulate attacks and improve detection (and prevention), which is the only way to be sure that the detection rules in place are not theoretical, but actually work. These purple teams are usually temporary, lasting the predefined amount of time assigned to the mission. Moreover, they are made by plucking some people with offensive skills to simulate attacks, some others with detection know how to create and improve detection rules and maybe a few more with incident response experience to make sure that the response process for the use case is correct.<br>The purple teams described above are simply wrong on so many levels:</p><ul><li>Detection is the most important part of a SOC or MSSP, the only way to ensure that the detection rules are not theoretical is to simulate the behavior and yet the purple team is temporary. <em>The team in charge of quality assurance for the most important aspect of the MSSP is not a permanent team</em>.</li><li>The people participating in the temporary team are yanked from their jobs with little to no training on the skills and context they miss (i.e. offensive, detection, incident response and even how a SOC works) and have to learn to communicate to the others and to produce something that is usable by the others as they go. <em>The members of the team working on the most important part of the MSSP have issues understanding each other</em>.<br>This is sadly not an understatement: the SOC is a complex environment with a very specific workflow and that workflow is actually so different from other teams (i.e. pentest teams or CERT) that it is <em>really hard</em> to communicate properly without previous experience of the other jobs. To sum up this particular, crucial issue, one could say that pentest teams and CERT mostly work with a micro view of operational security — i.e. they work directly with systems, from system to system on a perimeter delimited by the engagement rules for the former and the attack for the latter — whereas a SOC works with a macro view, having to cover the whole environment. Because of this, SOC and MSSPs had to adapt to scale up, having to find workarounds to perform detection and investigation at scale that would be straightforward on a single system.</li><li>It gets worse as this temporary team composed of people having a hard time communicating to each other is not homogenous: each person has one particular set of skills and cannot be replaced or helped in their tasks. Depending on the size of the team, <em>each role or each member of the most important team is in itself a Single Point Of Failure (SPOF)</em>.</li><li>The worst part is that after all is said and done and the mission finishes, if someone in the SOC realizes that a mistake has been made on a detection rule improvement and the documentation, timeline, report or whatever is incomplete on that matter, there is no way for the SOC to fix it properly on its own. The only thing left is to hope that the person from whichever other team remembers or wrote down something that didn’t go into the report — let’s not even mention that there could be a do-over of the purple team for that issue because this is not happening, ever. <em>Once the most important job for the SOC is done, the team splits and the SOC can only pray that everything is alright</em>.</li><li>Finally, these purple teams often lack proper hierarchical attachment to any department. The direct consequence of this is that the product of the team, the detection use cases, may or may not be used in the production environment by the SOC or MSSP in the end and they surely escape any kind of controls or detection engineering workflow. <em>The most important deliverables for the SOC may stay unused or be discarded entirely</em>.</li></ul><p>All of this could be comical if it were made up, alas, it’s not.</p><p>Knowing where classic purple teams fail, it is easy to imagine one that could be beneficial for the MSSP and lives up to its name. <strong>A purple team worth its money should</strong>:</p><ul><li>Be permanent.</li><li>Have its members be willing to work with <em>both a blueteam and a redteam approach</em> and/or have some kind of experience on both sides.</li><li>Be made up of SOC/CERT <em>skills </em>and pentest/redteam <em>skills</em>.</li><li>Be part of the SOC or MSSP as everything it produces is for the SOC.</li><li>Work for the SOC or MSSP to improve the overall detection capabilities.</li><li>Have <strong><em>each of its members have the skills’ “mix” blue/red to maximize efficiency and synergy</em></strong>.</li></ul><p>The purple team must have access to a controlled environment, such as a lab, that it can start up at any time, in order to properly perform its R&amp;D without limitations or risks for production. Ideally, to validate the findings, the scenarios should be played in the company’s or MSSP’s own pre-production or production environment with the same rules of engagement, and precautions, as a pentest or red team exercise.<br>The purple team can and should be given all missions pertaining to detection and some new missions to get the most benefits possible from the offensive skills:</p><ul><li>Detection rules conception — from ideas to research and behavior simulation.</li><li>Detection rules implementation — from a bunch of logs and artifacts gathered from the simulation to an actual detection rule.</li><li>Detection rules testing — pertinence, regression, performance and validation tests either manually with offensive tooling or preferably with some automation.</li><li>Detection rules tuning, updates and upgrades — with regard to the evolution of detection and offensive capabilities.</li><li>Logging configuration best practices can be added here, since the purple team had to go through that to make the best detection rule possible.</li><li>Subjects related to the SOC data model (see next chapter) and even logs parsing.</li><li>Live detection and response testing — simulate attacks to test the SOC’s response capability and reliability and give actionable feedback to response specialists.</li></ul><p>However, in order to stay relevant, the purple team needs to know precisely how the SOC response specialists (the job described in a previous table) team and the redteam or pentest team work:</p><ul><li>It stays updated on offensive TTPs by interacting with the redteam as this guarantees the pertinence of the simulated offensive behavior and therefore the detection use cases.</li><li>It takes into account all feedback from the SOC response specialists to maximize detection efficiency and optimize response procedures with every new or improved detection use case.</li></ul><p>Another, complementary way to achieve this last point is to have core, permanent positions in the purple team, and some temporary positions. These temporary positions would be filled with people from other teams like CERT, redteam, SOC response specialists, etc, who would join the purple team for a few months. That way, the core members of the purple team would have their knowledge refreshed, and the team as a whole would stay up to date, with an interesting, beneficial mix of ideas and perspectives.</p><h4><strong>4.4. Incident lifecycle</strong></h4><p>The third main lifecycle that absolutely needs to be defined in a SOC or MSSP is the incident lifecycle. It is key especially in an MSSP to have any chance at having a stable homogeneous response across customers and time.</p><p>The incident lifecycle defines the response phases used by the SOC, the statuses an incident can have, the possible qualifications for an incident along with the conditions to meet to get there and the stakeholders involved at each step.</p><p><strong>4.4.1. Detection result</strong></p><p>There is a crucial point to discuss about incident qualification: <strong><em>the qualification always refers to the result of the detection</em></strong>.<br>Yes, this was purposefully put in bold and italic because it is the key to understanding incident qualification by a SOC and it is very, <strong><em>very</em></strong> commonly misinterpreted.<br>The reason for misinterpretation is that when presented with an incident once the investigation is done or even later once the remediation is done, it is only logical to want to qualify it with regard to the consequences: there was a malicious activity with some impact so it must be a True Positive or on the contrary the actions were those of an administrator so it is of course a False Positive. It could not be more wrong in both cases.</p><p>Represented below is a confusion matrix applied to a SOC. The columns represent the results of detection, i.e. if an alert is fired then it is a “Positive” and if not, it is a “Negative”. The rows represent the expected result of detection, i.e. if there is an anomalous event or events it is “Positive” or “Negative” otherwise.</p><figure><img alt="Confusion matrix applied to a SOC" src="https://cdn-images-1.medium.com/max/344/0*R38pbBtYNTWlvwgt" /><figcaption>Confusion matrix applied to a SOC</figcaption></figure><p>There are 4 cells in the table, one for each of the possible results:</p><ul><li>A True Positive (TP) is the qualification given to detection if an alert was created when there was indeed an anomaly to detect. This is what SOCs and MSSPs want to maximize because there is a security issue awaiting response.</li><li>A False Negative (FN) is the qualification given to detection that did not fire any alert even though there was an anomaly to detect. This is what SOCs and MSSPs fear the most and want to avoid at (almost) all cost, as it means there is a security issue awaiting response going undetected.</li><li>A False Positive (FP) is the qualification given to detection that fired an alert although there was no anomaly in the environment. This is not a real issue in itself but it generates a waste of time for the analyst performing the therefore needless response.<br>However, if there are numerous FPs either in absolute or relative numbers to the TPs, serious issues can arise.<br>High absolute numbers of FPs means that there are a lot of resources wasted, translating in a direct cost for the SOC or MSSP — that is if there are enough analysts staffed, otherwise they are also overworked.<br>High relative numbers of FPs can be even worse because it cannot be solved by throwing money at the issue: it creates alert fatigue for the analysts which translates into increased frustration and lowered morale for them, as they spend lots of time chasing ghosts. The worst part of alert fatigue is that it greatly increases the chance of even a senior, experienced and skilled analyst missing an actual anomaly during response, because he or she simply is used to not ever finding any anomaly.</li><li>A True Negative (TN) is the qualification given to detection that did not produce an alert when there was no anomaly. This would be the most common qualification if it were used.</li></ul><p>In practice, a SOC or MSSP can hardly ever qualify detection as TN or FN. Although FNs would become widespread incidents or even a crisis that ends up in the news, the FN qualification can only be given after the incident response when realizing that some detection rule should have detected such or such an event and didn’t. At that time, if the SOC still exists, nobody actually bothers to create an incident in the SIRP and qualify it as an FN, if that qualification even exists at all.</p><p>The SOC detects anomalies which can take the form of an alert from a SIEM and the triage step of the response phase is an investigation that determines the result of detection: if the detection worked as expected, then the alert is a TP and can be transformed into an incident, otherwise the detection did not work as expected and so the alert is an FP. This is precisely why <strong><em>the qualification always refers to the result of the detection</em></strong>.<br>To circle back to the previous examples of misinterpretation:</p><ul><li>“There was a malicious activity with some impact so it must be a True Positive”, without knowledge of whether a detection picked up the anomaly in the first place, this scenario could as easily be an FN. Of course someone or something ended up alerting the SOC or CERT to respond but a call from an employee saying “Hello, all the computers on the floor went dark and none will boot up anymore” is not a detection but a mere acknowledgement of catastrophic failure.</li><li>“The actions were those of an administrator so it is of course a False Positive” is a statement that is wrong in all but a few very rare and specific cases. Either the detection did not fire any alert for this anomaly so it cannot be a “Positive”, period, or the detection did fire an alert because there was an anomaly so it worked and is therefore a TP. The fact that after investigation it comes to light that it was a legitimate action from an administrator does not change anything to the result of detection.</li></ul><p>When explained, it becomes more logical to view qualifications this way: they are very often used to measure SOC or MSSP detection efficiency as they should. Now imagine that the qualifications were referring to the result of the investigation and the SOC were monitoring an environment with very few or no malicious activity, it could only ever have “bad grades” regarding qualifications.<br>Since the environment monitored should not impact the detection efficiency of the SOC, the qualifications must always refer to the result of detection for these metrics to be effective.</p><p><strong>4.4.2. Incident evolution</strong></p><p>The timeline below represents an example of the phases that could be defined and applied for a SOC or MSSP. The most important point is that it exists and is used as reference whenever needed.</p><figure><img alt="Example of timeline of “SOC actions” vs tools" src="https://cdn-images-1.medium.com/max/1024/0*6otWe12oob3ghMAZ" /><figcaption>Example of timeline of “SOC actions” vs tools</figcaption></figure><p>In this example, the timeline in the middle marks when the key events occurred while the top part shows the “SOC actions” for a lack of better expression, which are the phases mentioned earlier, and the bottom part is a reminder of when some generic tools used by SOCs and MSSPs are relevant.</p><p>A few remarks on the timeline:</p><ul><li>The first (and main) point addressed by a SOC is detection, which lasts from the time an event or anomaly happens until some tool (here a SIEM) fires an alert for it.</li><li>The response phase represented is a modified version of the SANS Incident Response Cycle that divide the response between two stages:<br>&gt; Investigation, comprised of a Triage step in which the analyst performs a primary investigation to determine whether the detection worked and is therefore a True Positive, in which case the alert becomes an incident, or didn’t work and is a False Positive, and an Identification (as per the SANS Incident Response Cycle terminology) or secondary investigation step to assess the compromised perimeter. This stage could be fully achieved without any active action in the environment if the investigation is performed with passively collected artifacts.<br>&gt; Remediation, regrouping the four steps left in the SANS Incident Response Cycle. At this stage, active actions are performed in the environment to remedy the incident.</li><li>The sensor’s main use from a SOC point of view is to generate logs for the events it observes.</li><li>The SIEM is shown to be relevant from “Log created” because it is implied that the SIEM’s infrastructure is also used to collect and centralize the logs, but depending on the technological choices made, there could be other tool(s) involved.</li></ul><p><strong>4.4.3. Ticket status</strong></p><p>In this subchapter, “ticket” is used to refer to “alert” or “incident” independently from the qualification.</p><figure><img alt="Example of a ticket lifecycle diagram" src="https://cdn-images-1.medium.com/max/771/0*F2y013dSbflZU7MZ" /><figcaption>Example of a ticket lifecycle diagram</figcaption></figure><p>The previous diagram is an example of a ticket lifecycle with the different statuses it can have. It is specifically intended for an MSSP as it mentions an interaction with the customer.</p><p>The detection is either qualified as a False Positive or a True Positive:</p><ul><li>If it is an FP then something must be improved by adding a WhiteList (WL) entry or reviewing the detection rule in order to not get another unwanted detection such as this one.</li><li>If it is a TP then two things can happen:<br>&gt; After investigation, there was actually nothing malicious about the activity. It was a legitimate action and so the status could be updated to “True Positive Legitimate” (TPL) which basically means that this time there was nothing wrong and there may or may not be a way to determine it at detection time. If there is, a WL entry could be added but this should be done with caution as it can be hard to know for sure, without behavior analysis, that it is actually legitimate.<br>&gt; After investigation, malicious activity has been confirmed. The status could then be updated to “True Positive Malicious” (TPM) before moving on to incident response, starting with the Identification or secondary investigation step. This update only aims to make statuses clearer at a glance because TP / TPL only could create some doubts as to “what is a TP”.</li></ul><p>The example diagram is a bit less straightforward than it could be because it takes into account misinterpretation of “TP” by the customer and analyst error.</p><h4><strong>4.5. Training and monitoring</strong></h4><p>It is important to keep SOC or MSSP teams trained as a whole and ready for the worst because when the worst comes, SOC members will not have time to think and elaborate big plans. There will be panic and confusion: this is extremely important and it cannot be overstated, there is nothing short of experience that can really prepare someone for this.<br>However, having trained teams in which everyone knows their jobs and what they are supposed to do when, and not if, trouble comes around is the best that can be achieved to enable fast, accurate reactions.</p><p>Also on a brighter note, there are ways to monitor the SOC environment and the user experiences associated with it in order to preemptively affect resources to stabilizing or fixing instabilities before breakdown occurs or, on the contrary, if every indicator is green, to divert resources to expanding or developing new features.</p><p><strong>4.5.1. Incident simulation</strong></p><p>An incident here is defined as a severe security issue that requires immediate response from the SOC or MSSP, e.g. an ongoing attack caught early in which the adversary has yet to spread too much.<br>Typically an incident could involve a few response specialists and their team leader, depending on the severity.</p><p>Each analyst needs to be individually trained so they are skilled enough to perform their jobs correctly but more importantly in this case they also need to know how to work together as a team, which is a whole other story.<br>Even with technical training, processes, procedures, diagrams, a good knowledge base and what not, without proper training specifically on coordination, a bunch of analysts put together won’t amount to a proper teamwork. This is in fact much like sports teams.</p><p>Teamwork is therefore also a skill to train properly and this can be achieved by simulating incidents. The majority of simulations should be prepared and advertised in advance with a clear objective to improve teamwork in an emergency situation. However, once the team performs well on these exercises, it is advisable to throw in an unexpected simulation to check how the team reacts in what is for them a real scenario.<br>The “only” difference between both is psychological but this is what will actually matter when it comes down to it. If they think it is real then their reaction will be genuine and the simulation can create an experience for them, although it was but another exercise.</p><p>These simulations are of course technical but should also include any communication that would occur in a real scenario and especially any panic and/or pressure added by the customer (in case of an MSSP) or the management (for a SOC), if possible.</p><p><strong>4.5.2. Crisis simulation</strong></p><p>A crisis is defined here as a critical, widespread security incident already impacting production. For an MSSP, it could be either one customer victim of such an incident, multiple customers having (for the moment) a less impactful incident such as what can happen when a 0 day on a common product is exploited and there is no patch, or that the company of the MSSP itself has been compromised.<br>What is described above is where the real fun starts, isn’t it?</p><p>This can clearly be a do or die situation for many companies, as reported too often in the news. There will be panic everywhere, the pressure on any stakeholder involved in the resolution (the SOC being one) will suddenly peak and stay at that level until the crisis ends, one way or the other.<br>If a SOC or MSSP goes through this without previous preparation or training, well… Let’s say the good news is that there are plenty of open jobs for SOC analysts so they won’t stay jobless for long.</p><p>The incident described before involved a few response specialists and their team leader when a crisis such as this will involve the whole SOC — every single member — and then more, especially in the upper management.<br>The incident is simulated at the analysts’ level with some help of SOC or MSSP management and from a technical perspective, a crisis is actually almost only different in what’s at stake. Therefore, the simulation for the technical incident part could be more or less the same, with higher stakes.<br>The real difference is in the panic of the management, customers or other employees and in this, especially the former, must be trained. The most important part is that upper management understands their jobs in a situation like this: how and what to communicate to whom, who will be their (only) contact on the response side that will report to them the state of things and what they can do to enable the best response possible.<br>At upper management levels, it is not realistic to simulate an unexpected crisis, therefore advertised ones will have to do. It is especially important to identify backups for such or such key people in the management chain in case they are not available when the time comes.</p><p><strong>4.5.3. Site Reliability Engineering</strong></p><p>Site Reliability Engineering (SRE) is a concept that originated at Google in 2003 and has kept evolving since. The reference and most of the best resources can be found on the website <a href="https://sre.google/">https://sre.google/</a>.<br>SRE aims to maintain critical operations running whatever happens by relying on targeted prevention to minimize impacts, therefore reducing the overall direct and indirect costs.<br>The logic is that everything that is built is made for direct or indirect human usage and any trouble or discontent the human component has in using it will result in added cost in some way for the builder. Therefore, it is more cost-efficient to measure and monitor the level of contentment and take corrective actions when it falls down to a certain point than to wait for an SLA breach to try and fix things as there may be indirect cost of losing the user or the customer on top of the direct cost of the breach.</p><p>To achieve this, Service Level Indicators (SLIs) need to be put in place: these indicators are a quantifiable way to measure the reliability. There is real work to be done here, as most of the time, the reliability of a service is more of a qualitative feeling for its users than directly quantifiable and usable data.<br>Once the SLIs are defined, the Service Level Objectives (SLOs) can be set: if the SLIs fall down to the level of the SLOs, then corrective actions must be taken.<br>Finally, the monitoring of the SLIs with regard to the SLOs enables active and optimized resource and budget affectation: more development and new features if the SLIs are OK or more stability and fixing if the SLIs are dropping.</p><p>Applying the SRE concept to a SOC or even an MSSP can be very complex but is well worth it in the end, especially for an MSSP. That being said, the SOC or MSSP must already be very mature for an implementation to be possible and for it to make sense.<br>As this is very technical, more of a case by case basis and explained infinitely better on the website mentioned above than it ever could be here, it won’t be discussed any further in this document.</p><h4><strong>4.6. Customer service</strong></h4><p>Customer service is an important subject for an MSSP but also for a SOC. Customer service is defined here as all relations a SOC has with external parties to which it answers. These parties, may they be customers (in the MSSP sense) or upper management of the company owning the SOC, will always fund the SOC. Therefore it is for the least advisable to work with them to understand their needs and to make them understand the SOC’s constraints and issues.</p><figure><img alt="Example of timeline of “SOC actions” vs time indicators" src="https://cdn-images-1.medium.com/max/1024/0*Y5GaLpQT4OySWLHF" /><figcaption>Example of timeline of “SOC actions” vs time indicators</figcaption></figure><p>The diagram above is a modified version of the one used to talk about incident evolution; this one shows the most important time metrics for a SOC or MSSP and its customers. The total time spent represents the time spent by SOC analysts on the response and is actually a SOC internal metric.<br>However, the dwell time, TTI, TTN and TTR are important indicators for the SOC to measure its own performance but also for its customers — some of which are usually under SLAs. These indicators should always be (graphically) explained to the customer, what they represent and how they are calculated to make for easier communication.</p><p>There should be communication templates for emails, incidents and other regular committees — each of which needs to be presented and explained in detail to the customer to make sure everyone is on the same page and that there are no misunderstandings.<br>All templates should be standardized so that they are as much the same as possible from one customer to another for an MSSP. They can then be automatically generated for the most part, e.g. Key Performance Indicators (KPIs), performance graphics and other task lists. The time spent by people working on these would then be on the SOC or MSSP added value, such as governance and security advice.</p><p>In any case, communication with customers about what the SOC is doing is important, especially if “nothing is happening”, because a SOC is a complex environment almost opaque from the outside. Also, by nature the SOC is reactive so without active communication on the work being done, it is quite easy to conclude, when everything is fine, that there is no actual added value in a SOC or MSSP when it actually costs a lot — in other words that it is a bad investment.</p><h4><strong>4.7. Conclusion</strong></h4><p>There are many items that should be implemented, monitored and that can be improved for a SOC and even more for an MSSP. Their importance will vary depending on the current context of the SOC and its planned evolution, as will the priority of implementation.<br>However, they are all necessary to have and keep a pertinent, stable, efficient, reliable and robust SOC, which is what every SOC should try to be to consistently detect and/or thwart attacks.</p><p>Please <em>do not</em> underestimate the importance of items that are not directly related to the SOC’s missions and objectives, such as knowledge management or customer service: the former, acting as the SOC’s memory, participates in ensuring pertinence and the latter is the one that will keep the budget from getting lower.</p><p><strong>Summary</strong><br><a href="#d852">4. Operational aspects</a><br><a href="#a923">4.1. Knowledge management</a><br><a href="#2d28">4.2. Infrastructure lifecycle</a><br><a href="#91f9">4.3. Detection lifecycle</a><br><a href="#00df">4.4. Incident lifecycle</a><br><a href="#1ce2">4.5. Training and monitoring</a><br><a href="#c8d0">4.6. Customer service</a><br><a href="#5623">4.7. Conclusion</a></p><p>Part 1: <a href="https://medium.com/@7rm1ef8/a-soc-mssp-guide-1-of-4-3f5450638a98">https://medium.com/@7rm1ef8/a-soc-mssp-guide-1-of-4-3f5450638a98</a><br>Part 2: <a href="https://medium.com/@7rm1ef8/a-soc-mssp-guide-2-of-4-f4fb93be2422">https://medium.com/@7rm1ef8/a-soc-mssp-guide-2-of-4-f4fb93be2422</a><br>Part 4: <a href="https://medium.com/@7rm1ef8/a-soc-mssp-guide-4-of-4-a78779d830dd">https://medium.com/@7rm1ef8/a-soc-mssp-guide-4-of-4-a78779d830dd</a></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=658e0cf99745" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[A SOC-MSSP guide (2 of 4)]]></title>
            <link>https://medium.com/@7rm1ef8/a-soc-mssp-guide-2-of-4-f4fb93be2422?source=rss-d9513b09c7f9------2</link>
            <guid isPermaLink="false">https://medium.com/p/f4fb93be2422</guid>
            <category><![CDATA[cybersecurity]]></category>
            <category><![CDATA[soc]]></category>
            <category><![CDATA[mssp]]></category>
            <dc:creator><![CDATA[Gaston MARTIN]]></dc:creator>
            <pubDate>Sun, 19 Nov 2023 12:27:05 GMT</pubDate>
            <atom:updated>2023-12-03T10:12:06.086Z</atom:updated>
            <cc:license>http://creativecommons.org/licenses/by/4.0/</cc:license>
            <content:encoded><![CDATA[<blockquote>From reporting malicious activity to catching it as it happens</blockquote><p>Part 1: <a href="https://medium.com/@7rm1ef8/a-soc-mssp-guide-1-of-4-3f5450638a98">https://medium.com/@7rm1ef8/a-soc-mssp-guide-1-of-4-3f5450638a98</a><br>Part 3: <a href="https://medium.com/@7rm1ef8/a-soc-mssp-guide-3-of-4-658e0cf99745">https://medium.com/@7rm1ef8/a-soc-mssp-guide-3-of-4-658e0cf99745</a><br>Part 4: <a href="https://medium.com/@7rm1ef8/a-soc-mssp-guide-4-of-4-a78779d830dd">https://medium.com/@7rm1ef8/a-soc-mssp-guide-4-of-4-a78779d830dd</a></p><p><strong>Summary<br></strong><a href="#9f20">3. Financial aspects</a><br><a href="#2253">3.1. Balance</a><br><a href="#c571">3.2. Hidden costs and optimizations</a><br><a href="#4797">3.3. Conclusion</a></p><h3><strong>3. Financial aspects</strong></h3><p>This chapter covers what may well be the hardest part of managing a SOC: making good decisions on where to spend the money. Both SOC and MSSP have limited budgets, in one case it is limited by whatever has been allocated to it and in the other case by its sales revenue and the margin objectives that have been set.</p><p>The hard part isn’t to manage to stay within the budget — although it can be challenging at times — the hard part is to carefully plan the spending so that the SOC is actually relevant in its missions long term, mainly when it comes to detecting attacks early to prevent damage. This is hard because it takes a combination of skills and knowledge that are rarely held by one individual:</p><ul><li>A strong understanding of the needs and expectations of the executives and/or customers and good communication to explain to them the choices made.</li><li>A detailed knowledge of how the SOC in its current state operates, both internally and with other entities — especially its strengths and weaknesses.</li><li>A clear vision of what skills and levels each job needs and the actual skills and levels the people holding these jobs have.</li><li>A precise knowledge of what profile each member of the SOC has, what they can and can’t do, what they could or couldn’t do and what they would or wouldn’t do.</li><li>A deep technical understanding of the mid/long term impact of any decision made, whether that decision regards people, tools, training, or interaction with other entities</li></ul><p>In practice, most of the time, the decisions are made by executives with the information at their disposal, which is mostly hearsay about what others do and/or what the customers want. Oftentimes the decisions end up being about buying/using a new tool or adding some junior staff (or firing senior staff in hard times) and that seems logical, because when you spend your time handling money and projecting costs and revenues, the solutions you come up with are money related.<br>However, these decisions rarely solve anything and often add to the issues: even a very expensive tool will never be used to its full potential/worth its cost with its default configuration, and very good junior staff still misses the experience of senior staff, because experience isn’t something you can learn in books, it’s something you gain with practice.</p><p>As seen in the previous chapter, a SOC or MSSP is a complex entity because of its highly technical environment and the human relations it requires to operate properly. Therefore, its actual worth resides within its crew and only by exploiting this wealth — and/or working to grow it — can it be and stay relevant long term. One way to do just that is through industrialization by focusing the knowledge and experience of the senior staff into normalization, standardization and automatization of the processes and tools used by junior staff.</p><h4><strong>3.1. Balance</strong></h4><p>In order to establish the best course of action to meet the short term objectives while building for the long term, one can start by thoroughly examining the balance of expenses vs revenue for the SOC or MSSP.<br>For this exercise to be meaningful and yield actionable results, the different items must be meticulously detailed, especially when it comes to time spent on activities and missions because the goal is to determine what could and should be industrialized and with what priority.</p><p><strong>3.1.1. Expenses</strong></p><p>The tables below show an example of expenses that are often overlooked in an MSSP environment, but end up costing more the bigger the MSSP is. The list of items gives an idea of what to look for, but is not exhaustive in any way, and although it has been made with an MSSP environment in mind, many items are still relevant for a SOC.</p><p>To populate the “average cost of one unit” column, it is preferable to include the workforce cost, the cost of the infrastructure needed to perform the item and the cost of any tools and other licenses needed. The goal here is to get a representation of the actual cost of production for one unit of that item.</p><p>It could be obvious, but in case it isn’t: it is good to have approximations for each column of each item, but it is better to have actual metrics and it is best to get those metrics per month to be able to monitor and project evolutions.</p><p>Keep in mind that this is not a theoretical exercise and that it has to be done carefully as having a precise view of expenses leads to pinpointing the wastes and minimizing the wastes is a crucial step in a long term plan.</p><p>The first table represents immediate and recurrent expenses depending directly on how the SOC/MSSP is structured, the choices of tools and technologies made, the workforce and the contracts with its customers.</p><figure><img alt="Examples of SOC/MSSP immediate and recurrent expenses" src="https://cdn-images-1.medium.com/max/684/1*zBeYE-7MZ_-xKXKtEjP9Pg.png" /><figcaption>Examples of SOC/MSSP immediate and recurrent expenses</figcaption></figure><p>The second table lists delayed or indirect costs that should never happen in a perfect world. These are harder to measure in terms of actual cost, but they tend to be way higher when they happen.<br>This is especially true long term with items like repercussions on the SOC (and company) reputation due to customer dissatisfaction or even more so due to error, incompetence or negligence.</p><figure><img alt="Examples of SOC/MSSP delayed or indirect costs" src="https://cdn-images-1.medium.com/max/684/1*-KSqeyK_e4X3zvrlFVrWKg.png" /><figcaption>Examples of SOC/MSSP delayed or indirect costs</figcaption></figure><p>The tables listing expenses shown above are not exhaustive and are merely pointers to how one should list expenses of one’s SOC or MSSP. Ideally, every task performed by every person in the SOC should have its own entry and be measured as it is the best way to lead to questions like “Why are we doing this?”, “Why is this task taking so much time?” but also “Why are we not doing that?”.<br>These questions and their corresponding answers should by themselves go a long way towards prioritizing the resources allocated to internal projects and give a clear and precise view of what and where the issues are.</p><p><strong>3.1.2. Revenue</strong></p><p>The list of revenues for a SOC is often limited to the budget it is allocated by the company.<br>However, the list for an MSSP can be a bit longer, although its customers’ service subscriptions should make up the bulk of it. Let’s explore a few ideas that could add to the revenue.</p><p>The most obvious one depends on the type of subscription or contract the MSSP has with its customers. One-time projects such as adding a new sensor to monitor, creating new detection rules / use cases or upgrading the already existing detection rules and use cases could be sold on top of the subscription. These could also lead to higher subscription revenue because of the extended perimeter monitored. Again, depending on the contracts, things like a complete response (and not just the investigation part) or advanced investigation (e.g. with forensics) could be in the service catalog.</p><p>Other ideas that could expand revenue is leasing a dedicated resource to a customer for an agreed upon amount of time, performing external (to the SOC/MSSP or even the company) training or any other creative way to directly sell the skills of the SOC personnel and bettering the SOC or company reputation.</p><p>Since most of the revenue for a SOC or MSSP is not controlled by it, in the sense that the SOC isn’t the entity that negotiates the prices with the customers, it is very hard to optimize anything in terms of revenue beyond suggesting new kinds of services like those mentioned above.<br>However, expenses optimization is a real option to consider in order to create breathing room in the budget.</p><h4><strong>3.2. Hidden costs and optimizations</strong></h4><p>Like in most entities, there are costs in a SOC or MSSP that are somewhat hidden and there are some ways to optimize these expenses.<br>The following points are not specific to a SOC and can be applied to other entities. They do not constitute an exhaustive list either and such items should be carefully considered by establishing a strategy for each, because they have a long term impact on production costs and quality.</p><ul><li>Evaluate precisely the cost of training a new recruit for each position in the SOC. This way when someone is asking for a training, a raise or wants another position, it will be very easy to balance the potential loss of this person — individual skills, performances, mindset, internal working knowledge on top of which the cost of recruiting someone new and training him or her — versus the cost of meeting the demands.<br>In many cases, it is actually far cheaper to negotiate and lean towards the demands than it is to take the loss and hire someone else. This is work, so it boils down to the math of the position’s worth, both for the company and the employee and there shouldn’t be any emotions, hurt feelings or letting things get personal here.<br>This circles back to the previous chapter about knowing the people working in the SOC and their profiles, with an added cost/benefit approach that could very well be explained to the person at risk: “From what you have been doing over the past <em>N</em> months, we calculated that your work is worth <em>X</em> to us, therefore we can go up to that point, but not over to meet the <em>Y</em> for which you asked”.</li><li>Analyze the costs of security solutions and their actual added benefit as-is — i.e. with the current skills and tasks assignments of the SOC analysts — and compare that with what could be achieved towards the SOC priorities if the budget for the overpriced/underused solutions were redirected on other (internal) investments. Of course, the Return On Investment (ROI) should be taken into account for this comparison, both for the security solution and the other (internal) project.<br>The goal here is to stop paying for things that are barely used or with little added value, if that budget item could be better allocated to some other project that would enhance the SOC production, either by increasing its quantity or quality or by reducing wasted expenses.</li><li>Compare the cost of having teams (mainly those in charge of response and MRO) 24/7 available in shifts versus that of having some members of these teams doing on-call duty. There are a lot of variables to take into account here and not just flat costs: the employees may be more productive, happier and on a better mindset if they are working, even in rotations, than if they get called regularly at night during their on-call duty and then have to work their regular shift the next day.<br>A department that is available 24/7 would also be able to answer in case a customer has made an on-call duty subscription — and even faster than with regular on-call duty — and they also could work on any alert or incident that happened outside of regular working hours, therefore lightening the workload for the regular day shift. Of course in that case, if the customer hasn’t subscribed to a 24/7 monitoring, the notifications would be (automatically) postponed to the start of the day shift.</li><li>Build a table that lists every task of every job in the SOC, the number of units to produce every week (or day or month), the average time it takes to complete, the total time needed, the cost per hour and total cost all depending on experience (junior, full or senior) as per the example below:</li></ul><figure><img alt="Examples of SOC/MSSP tasks, time taken and cost depending on employee’s experience" src="https://cdn-images-1.medium.com/max/742/1*6S7uYK8sjrdnrBCQVdpjqg.png" /><figcaption>Examples of SOC/MSSP tasks, time taken and cost depending on employee’s experience</figcaption></figure><p>This is the baseline on which to build simulations of staff needed by level of experience. Some tasks will be limited to full and senior or senior only and some others would rather have junior or full handle them as the cost would be lower. Therefore, it will help simulate how many people with what level of experience would be the best for a particular team/job in the SOC to optimize cost efficiency (adding other columns like FTE, revenue generated by task, etc would come in handy for that matter).<br>However make no mistake, these are actual people behind the numbers and those people have preferences in jobs and tasks, wishes in terms of career evolution, life goals, etc.Therefore, the ratios (FTEs per experience level) simulated will always be unattainable goals and should be treated as such: a direction rather than an objective. This circles back to a previous point comparing the cost of losing a person and recruiting a new one versus that of meeting the demands.</p><p>All of these tables and graphs take a lot of work to build, especially if the data doesn’t exist at first and has to be created. Also that work may be tedious, but it is well worth it.<br>Firstly, it paints an accurate picture of the state of the SOC and gives a lot of vision, if not control, to the SOC manager about the health of his or her SOC.<br>Secondly, it translates technical and operational feelings of what works well and what does not work in the SOC into actual, factual numbers and costs that are very well understood as-is by executives. Instead of expecting executives to spare the time to learn and understand the technical and operational aspects of the SOC, it is up to the SOC manager to speak their language in order to be heard and understood. This is one way to do just that.</p><p>Since a SOC has limited options to generate more revenues, most of the effort regarding financial optimization should be on reducing expenses. Therefore, the first step is to understand where the highest expenditures for the SOC or MSSP are, and this is precisely where all the suggested tables and graphs come in.<br>Usually, the two top items are the salaries of the personnel and the tools (licenses) used by the SOC.<br>The licenses for the tools could be negotiated with the vendors, and a regular review of tools’ usage should take place to ascertain that they are the correct tools to answer the needs, and that there isn’t another (cheaper) tool that could be more suited. There can be some gain there, but ultimately, people need proper tools to do a proper job.<br>On the other hand, from a purely economic point of view, it would be great to have the experience and know-how of senior staff at the price of a junior one. Obviously, this isn’t happening, but what can happen is using the time of senior staff more wisely to enable junior staff to approach the work they do in terms of quality and quantity. In other words, senior staff can be tasked to create documentation, processes and procedures, all kinds of task automatization, and finally monitor the work done by other less experienced personnel. This would set standards and enable everyone to achieve them by using the knowledge and methods produced by experienced people. This way it requires fewer people with less experience to achieve the same quality and quantity of work. Therefore, depending on the situation — SOC or MSSP, expected growth or not — fewer people are needed for the same perimeter to monitor or the same people could monitor a larger perimeter.</p><h4><strong>3.3. Conclusion</strong></h4><p>The best way for a SOC and especially an MSSP to improve production stability, resiliency, quality and efficiency is to invest in industrialization. This mainly means identifying the key people who are able to do that job and making sure to keep them until the goal in level of industrialization is reached.<br>The tools are important, but having the right people on the right jobs with the right level of skills matters more: in case of attacks or other cybersecurity crises, skilled analysts with lesser tools will manage way better than poorly trained and inexperienced analysts with top of the shelf tools.</p><p>All in all, the best decisions in terms of spending are most of the time about enabling the SOC to accomplish its missions better, faster and more reliably by investing in its production capabilities rather than acquiring an overpriced underused tool or adding new members to the overflowing pool of juniors.</p><p><strong>Summary<br></strong><a href="#9f20">3. Financial aspects</a><br><a href="#2253">3.1. Balance</a><br><a href="#c571">3.2. Hidden costs and optimizations</a><br><a href="#4797">3.3. Conclusion</a></p><p>Part 1: <a href="https://medium.com/@7rm1ef8/a-soc-mssp-guide-1-of-4-3f5450638a98">https://medium.com/@7rm1ef8/a-soc-mssp-guide-1-of-4-3f5450638a98</a><br>Part 3: <a href="https://medium.com/@7rm1ef8/a-soc-mssp-guide-3-of-4-658e0cf99745">https://medium.com/@7rm1ef8/a-soc-mssp-guide-3-of-4-658e0cf99745</a><br>Part 4: <a href="https://medium.com/@7rm1ef8/a-soc-mssp-guide-4-of-4-a78779d830dd">https://medium.com/@7rm1ef8/a-soc-mssp-guide-4-of-4-a78779d830dd</a></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=f4fb93be2422" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[A SOC-MSSP guide (1 of 4)]]></title>
            <link>https://medium.com/@7rm1ef8/a-soc-mssp-guide-1-of-4-3f5450638a98?source=rss-d9513b09c7f9------2</link>
            <guid isPermaLink="false">https://medium.com/p/3f5450638a98</guid>
            <category><![CDATA[mssp]]></category>
            <category><![CDATA[cybersecurity]]></category>
            <category><![CDATA[soc]]></category>
            <dc:creator><![CDATA[Gaston MARTIN]]></dc:creator>
            <pubDate>Sun, 12 Nov 2023 13:07:23 GMT</pubDate>
            <atom:updated>2023-12-03T10:12:35.173Z</atom:updated>
            <cc:license>http://creativecommons.org/licenses/by/4.0/</cc:license>
            <content:encoded><![CDATA[<blockquote>From reporting malicious activity to catching it as it happens</blockquote><p>Part 2: <a href="https://medium.com/@7rm1ef8/a-soc-mssp-guide-2-of-4-f4fb93be2422">https://medium.com/@7rm1ef8/a-soc-mssp-guide-2-of-4-f4fb93be2422</a><br>Part 3: <a href="https://medium.com/@7rm1ef8/a-soc-mssp-guide-3-of-4-658e0cf99745">https://medium.com/@7rm1ef8/a-soc-mssp-guide-3-of-4-658e0cf99745</a><br>Part 4: <a href="https://medium.com/@7rm1ef8/a-soc-mssp-guide-4-of-4-a78779d830dd">https://medium.com/@7rm1ef8/a-soc-mssp-guide-4-of-4-a78779d830dd</a></p><p><strong>Summary<br></strong><a href="#c8a9">1. Introduction</a><br><a href="#d5d4">1.1. Definitions</a><br><a href="#f0c0">1.2. SOC/MSSP vs CERT/CSIRT</a><br><a href="#61c9">2. Human aspects</a><br><a href="#5ae5">2.1. Managing a SOC</a><br><a href="#3e23">2.2. SOC analysts’ jobs</a><br><a href="#2038">2.3. SOC analysts’ needs</a><br><a href="#c270">2.4. Understanding the profiles</a><br><a href="#f6a1">2.5. Conclusion</a></p><h3><strong>1. Introduction</strong></h3><p>The idea for this guide came out of the deep frustration of knowing what a SOC could do while witnessing what SOCs and MSSPs actually do, seeing what they claim to do — internally or to their customers, respectively — and hearing the ideas for improvement actually approved by the management.<br>When its needs are met and all the aspects of the SOC are correctly built, the SOC is an incredibly powerful defensive entity that can identify and stop — directly or indirectly — internal and external threats from damaging the environment.<br>However, if these needs are not met or if the SOC is poorly built in some way, then it can appear to be very ineffective and a waste of money from an external — executive, for example — point of view.<br>From an internal point of view, this leads to high frustration for the staff because they know that and how they could do better, but they are limited doing unattractive work. Most of the time they would try hard until they give up and go for a more attractive job, like in a CERT or CSIRT — where if someone talks to them, something actually happens, so they feel valued.</p><p>Many SOCs and MSSPs as they are currently built focus only on the time constraint for detection and response. This is indeed the most important one, because the more time passes as an attack goes undetected, the more damage will come to the company. However, these SOCs were built based on other SOCs from a time with fewer security needs, or at least concerns, and to stay competitive in a market with an economic model from that time. Times have changed, technologies and people as well, and now these SOCs and MSSPs struggle to stay relevant from a security point of view. Even more concerning, they have a hard time hiring people, and an even harder time keeping skilled analysts, as the way they are built creates unattractive work. Some of them try to distract analysts with task rotation, or some interesting project in parallel to their main missions. This isn’t helping the analysts, who can only stand it for so long, and isn’t helping these SOCs or MSSPs either, because they are stuck in a model belonging to the past.</p><p>Most of the current guides for building SOCs explain what to do and what not to do to achieve a SOC or MSSP as they exist today and while they usually cover a lot of the aspects — especially for the bigger guides out there — they fail to address all of them with sufficient details to actually build something that will have a strong enough base to go all the way.</p><p>One of the main goals of this guide is to explain in a simple — i.e. not deeply technical — way to executives what a SOC actually does and how to improve it so that all — executives, management and SOC staff — can benefit from it.<br>In the faint hope of general improvement and at least for another reference to which Blue Team members could point, this guide was born.</p><p>This guide explains the following:</p><ul><li>The differences between a SOC and a MSSP across human, financial, operational and technical aspects</li><li>The goals, needs, strengths and weaknesses of the current models of MSSP</li><li>What is needed to build a SOC or MSSP that can scale up in time</li><li>What to improve to maximize a SOC efficiency to detect and capacity to respond to threats</li></ul><h4><strong>1.1. Definitions</strong></h4><p>As the security landscape is constantly evolving, new teams, jobs, services and tools are created and the definitions change, sometimes to the point where differences become almost philosophical.<br>Therefore, writing some definitions at the beginning of this document will make it easier to understand as it won’t be anchored in time.</p><p><strong>1.1.1. SOC</strong></p><p>A Security Operations Center (SOC) is a combination of people, skills, tools and processes that monitors an environment for cybersecurity threats.</p><p>Its main goal is to detect anomalies occurring in the environment in order to respond to them in the proper way. The response comprises:</p><ul><li>an investigation to determine whether the anomaly was a threat and its extent if it were</li><li>a remediation, if there were indeed a threat and if this task had been attributed to the SOC</li></ul><p>The SOC needs to know and understand the environment it monitors well in order to correctly detect anomalies and to respond to them.<br>This knowledge and understanding includes everything from the buildings in which a device is connected to the environment, to the people in IT teams, and to the actual business of the company.</p><p>In order to detect anomalies, the SOC uses artifacts produced by the different devices in the environment it monitors. The majority of these artifacts are logs created every time an event happens by the applications running on the devices.<br>Every source generating artifacts useful for the SOC is called a sensor. Therefore, a sensor can represent a piece of hardware, such as a physical firewall filtering network traffic, or a piece of software, such as a web server hosting websites.<br>In order to speed up and facilitate the detection of anomalies, the logs created by the sensors should be gathered and centralized into a SOC’s most powerful tool: a SIEM. The SIEM is, in a way, a database storing the logs, on which specific queries are run to single out anomalies.<br>When an anomaly is detected, the SIEM creates an alert, and the SOC’s response starts. An analyst investigates the anomaly to determine whether there is a security incident, and if the actions are malicious. The analyst logs all the findings in the SIRP for traceability.<br>The SIEM and the SIRP are the two main tools of a SOC, and have been for quite some time. Once these tools are in place, the next step is to use a DevOps platform, and then a SOAR. The former focuses on infrastructure and detection improvements, while the latter enables automated response.</p><p>The tools and the inner workings of a SOC are discussed at length later in the document.</p><p><strong>1.1.2. MSSP</strong></p><p>A Managed Security Services Provider (MSSP) is an entity that sells different security services to its customers — as per Gartner’s definition — usually a SOC is included in these services.<br>Now, Gartner’s definition of MSS uses the customer’s point of view, whereas this document presents the MSSP from the provider’s point of view — while of course taking into account the customers’ needs.</p><p>Focusing on the SOC service — which is the biggest part in all aspects — of an MSSP, the goals, needs, strengths and weaknesses of the MSSP are more or less the same as those of a SOC, multiplied by the number of customers to which the MSSP provides services.</p><p>The main goal of the MSSP is — like a SOC — to detect anomalies occurring in the environment, but most of the time the MSSP will not have any means of remediation in its customers’ environments.<br>Therefore its response will be limited to communicating to its customers an incident ticket that comprises:</p><ul><li>a context — i.e. how and why the anomaly was detected in the first place</li><li>an investigation with facts, analysis and conclusion</li><li>remediation recommendations — where an internal SOC would be able to remedy on its own</li><li>impacts explanations — to help the customer understand the risks and prioritize their actions</li></ul><p>The needs of an MSSP are the same as those of a SOC in terms of understanding the environments it monitors but to minimize cost and maximize efficiency, the MSSP tries to mutualize as much as it can across its customers (people, hardware, software, templates, etc).<br>Of course, this is quite a lot harder to achieve as an MSSP because a strong knowledge management is mandatory. Indeed, poor knowledge management will result in an amount of time loss growing at a larger rate than the number of customers — i.e. the difficulty to find a specific information grows at a larger rate than the volume of data if the data is unstructured.<br>This time loss will, in turn, impact the efficiency of the analysts and this will result either in a loss of productivity or quality of the work done, or even both — not to mention the mental impacts on these analysts.<br>Finally, this will show up in the finances one way or the other: less margins because the ratio of analyst-to-customer grows faster than the number of customers for the same quantity/quality level, customer loss due to dissatisfactions on quantity, quality or price paid for the level of service, etc.</p><p>The “bad news” on the needs of an MSSP are met by equally — arguably greater — “good news” on its strengths. Where a correctly built SOC is a powerful defensive entity, a correctly built MSSP can simply be the best defensive entity, period.<br>From a detection perspective, having multiple, different environments with different sensor types and editors is a gold mine for detection use cases ideas and implementation: when built correctly, any upgrade on detection made by the MSSP can instantly be applied to all its customers, therefore mutualizing all the R&amp;D efforts — which leads to better skilled analysts, reduction in overall R&amp;D costs, customers satisfaction, etc.<br>From an investigation perspective, a higher number of environments is also beneficial. The R&amp;D mentioned above will translate into better tuned detection rules which will fire fewer alerts that end up being False Positives (FP, i.e. alerts that shouldn’t have been fired in the first place). This directly lessens the time spent on “pointless” investigations, so the analysts work on more pertinent ones, increasing their skills and motivation- this also means that the analyst-to-customer ratio goes down as there are fewer alerts per customer.</p><p>If these needs are not met or if the MSSP is poorly built, then, the cost for the MSSP would be higher and the attractiveness for its analysts lower, to the point where it would be more cost efficient for the MSSP to maintain one SOC per customer and just be, in fine, a juxtaposition of SOCs. This juxtaposition of SOCs is the complete opposite of the mutualization wanted by an MSSP.<br>In this worst case scenario, the MSSP would appear ineffective and a waste of money internally, but also for its customers. Its skilled analysts, like in a SOC, would eventually give up to find a more attractive job in a CERT or CSIRT.</p><h4><strong>1.2. SOC/MSSP vs CERT/CSIRT</strong></h4><p>While today’s SOC and MSSP are mostly focused on detection and investigation — with sometimes means of remediation — the incident response is the main job of a Computer Emergency Response Team (CERT) or a Computer Security Incident Response Team (CSIRT).</p><p>Because of the struggles of today’s SOC and MSSP — briefly mentioned before — the attractiveness of a SOC analyst job is less that than of a CERT analyst: from a technical perspective, it is both more challenging and rewarding to work on an actual incident caused by a malicious actor than to chase False Positive alerts from misconfigured detection rules.<br>Moreover, CERT analysts have a real sense of purpose in their job as, again, they work on actual, tangible issues where SOC analysts perform repetitive tasks without much hope for improvement.<br>Adding up all of this to the fact that the mindset and skills needed for a SOC or CERT analyst are very similar results in the creation of a vicious circle:</p><ul><li>A CERT is more attractive to analysts than a SOC job-wise, so higher skilled analysts tend to end up in a CERT.</li><li>Higher skilled analysts leave SOCs, therefore lowering the overall SOCs skills, hence their overall capacity to properly perform their tasks.</li><li>SOCs do not perform as well as executives had hoped, so a highly skilled CERT is needed as “last resort” when — and not if — the SOC does not detect and react in time and a crisis arises.</li><li>Security funds are put into the tools, training/certifications and salaries of CERT analysts to make sure they are up to the task when it comes.</li><li>Since the funds allocated to security are finite and prioritized towards the CERT, the SOC budget is that much smaller, therefore the tools, training/certifications and/or salaries of its analysts are lower than what they could be.</li><li>A lower-budget SOC means a less mature SOC, directly translating into less attractive tasks for its analysts, which, at last, deepens the attractiveness gap between SOC and CERT.</li></ul><p>From this observation, the — somewhat controversial — statement that good CERTs exist and are needed only because bad SOCs and MSSPs exist could be made.<br>It could therefore be argued — and more or less is in this guide — that a good SOC or MSSP would not only reduce the need of a good CERT, but also minimize the consequences of actual incidents as the earlier they are caught and dealt with, the less they directly and indirectly damage the environment, hence the company.</p><p>In order to avoid any misunderstandings: there always will be a need for security detection and for incident response, but it would be better for everyone if the entities tasked with defensive security could be more proactive and not only post-mortem reactive.<br>It has long been clear that it is better for everyone to detect, catch and manage the fires as they start rather than waiting until they have burned everything to the ground to investigate the cause and rebuild everything.<br>Why not do the same with security incidents?</p><h3><strong>2. Human aspects</strong></h3><p>This chapter tries and explains as simply and clearly as possible the tasks of SOC analysts, the skills required — both hard and soft, their needs and the most common mindset this particular population has.</p><p>In order for the SOC to consistently attain the goals set by the executives and since the actual intelligence and effectiveness of the SOC is defined by its crew, understanding the humans behind the job titles or employee numbers is of utmost importance.<br>Doing so at all times, whether it be when recruiting, managing or planning mid/long term strategies is the only reliable way to ensure the best efficiency possible.</p><h4><strong>2.1. Managing a SOC</strong></h4><p>Every company, private or public, has goals to achieve and whatever the motivations or how often or pertinent the goals are, they mark the desired state and time available to reach it from the current state.</p><p>Once this is clear, one or more strategies are imagined and one of them is adopted. Each strategy requires actions to be done in a timely fashion and those actions and timetable can be broken down into resources. The human resources each have a set of skills and a workload capacity that will, according to the strategy, enable the company to reach its desired state in time, therefore fulfilling its goals.<br>This is all very high level because it is not the point of this document but the important thing is that <strong>company goals ultimately translate into human resources</strong> (and other material needs).</p><p>From a high level — executive/HR — perspective, a SOC (or MSSP) is, like any other department, viewed in terms of goals and resources.<br>However, as explained in the following subchapters, the hard skills required to do most of the tasks in a SOC, the soft skills needed to work efficiently as a team and the mindset to keep calm under pressure combined with the current (most of the time) amount of “busy work” compared to “interesting work” and the lack of trained professionals make it so that one SOC analyst is not equal to another one and they have plenty of available opportunities that literally present themselves to them on a daily basis.<br>This means that it may be easy-ish to attract SOC analysts from other companies because they may not be happy with their current situation, but it is actually really hard to keep them.</p><p>The amount of turnover is crucial in a SOC or MSSP because they both need strong teamplay in order to perform well — or at least to the level expected by executives — so the overall skill of a SOC is far from being the mere sum of the skills of its members.<br>Therefore, to maintain a strong cohesion, there must be a constant clear majority of members that form a stable core which can absorb newcomers and remain as-is even when it loses people.<br>In other words, if you replace one player of a sports team without the team having time to train as a whole — even if you take the best player, a well trained team’s performance may not vary much. Now, if you replace 20–30% (the more, the worst) of the players over a short period, then it is foolish to expect the team to stay at the same level.</p><p>This is why good management is needed. In this context, the human component has to be taken into account, as simply managing human resources will not cut it.<br>Each member of the SOC — analyst or otherwise — has to be understood or at least heard and compromises must be made so that both parties win — that is to say the company and the employee.<br>In the best case scenario, the SOC managers are actually leaders, the difference being that a leader leads by showing the example and inspiring his/her subordinates where the manager leads by distributing resources wherever needed to attain the objectives set. These leaders would naturally take into account the human component in their job and come to HR/upper management with solutions in the form of compromises.<br>Most likely, the SOC managers are “regular” managers and they would inevitably be facing issues by not hearing or acting on their teams’ needs and complaints.<br>In both cases, HR has to hear either the compromises or the issues and help the SOC managers find and settle compromises that <strong>would benefit everyone</strong> — this means that the employees also need to see an actual gain; it does not have to necessarily be a big one, but they need to see and know that the company is willing to move a step in their direction.</p><p>All in all, the most important thing to remember is that upper management and HR have to clearly identify the type of managers the SOC has and help them build and maintain a strong cohesion by listening to and hearing the people to find compromises.</p><p>This may be a bit of a catchy phrase but it completely applies in this case: it’s time to put the “H” back in “HR”.</p><h4><strong>2.2. SOC analysts’ jobs</strong></h4><p>Depending on the SOC or MSSP size and the missions it is expected to perform, the exact jobs and tasks may vary. The table below shows an example of the most common tasks, the skills they require and jobs that can exist by assembling these tasks.</p><figure><img alt="Example of SOC jobs with associated tasks and skills" src="https://cdn-images-1.medium.com/max/1024/1*NqHkQSJDHk6Le9z0uYlPmg.png" /><figcaption>Example of SOC jobs with associated tasks and skills</figcaption></figure><p>The jobs and tasks detailed in the table are merely examples of those that can exist in a SOC or MSSP. The tasks that add up to a job are always based on the needs, which depend on the context — and so does the number of people needed per job.<br>The hard skills shown in the table are not exhaustive, they are limited to the “security” aspects which are the essence of a SOC. Keep in mind that skills such as “Digital investigation” require both the knowledge and know-how of a digital investigation and the knowledge of how the underlying environment actually works. For example, to determine if a behavior is legitimate on a Windows system, one must know how Windows works to know what to look for and if such a chain of events would more likely be the result of malicious or legitimate intent, once the proper artifacts are gathered.</p><p>Ultimately, the jobs and tasks have to be tailored in a realistic way, meaning that there is actually a team member that can take up these tasks and has sufficient time to complete all their assignments. This is especially true for the technical skills needed in the long run: a “does it all” position will result in mediocre performances for the person holding it and/or a high amount of time (and money) spent training.</p><h4><strong>2.3. SOC analysts’ needs</strong></h4><p>The tasks and jobs presented above require diverse skills, including highly technical ones.<br>This is due to the fact that in order to find anomalies, qualify incidents and perform remediation actions, a SOC (or CERT) analyst has to have a deep understanding of “normal operations” to single out the “abnormal operations” and cut out the malicious activity, preferably without interrupting production.<br>This is true for every asset monitored by the SOC, hardware or software, systems, networks, Cloud based activity, IoT, OT…<br>Just to be clear: it is nowadays obvious for everyone that each item of the previous list would need a different person (or team) with special skills to deploy or maintain, but everybody expects <em>the SOC</em> to monitor all of these and promptly and correctly respond to any and all malicious activity.</p><p>Well, if it is not expected for one person (or team) to manage multiple scopes because each one has its own specificities, then how can it be expected for one person (or team) to <strong>understand</strong> — meaning knowing why this or that was done this way and how it should <strong>normally </strong>behave — multiple scopes <strong>and </strong>be able to restore of fix whatever may have been damaged or misconfigured?<br>The simple answer is that it is not humanly possible for one person to have, at all times, an understanding deep enough of all those things to perform the job expected of a SOC.</p><p>This is why a SOC is mainly teamwork and why a SOC analyst needs to spend most of his/her time reading through documentation, understanding <em>what</em> they are looking at and comparing the behavior — mainly a sequence of events — of what they are investigating to a baseline of a “normal” behavior.<br>For the bigger SOC (MSSP) out there, there can be people specialized in one specific field who are called whenever needed, but for the majority of SOC and MSSPs, the analysts have to be able to do most of their investigations and remediations by themselves with the occasional support of other colleagues.</p><p>Therefore, the SOC analysts have some needs in order for them to perform at the expected level:</p><ul><li>A well organized, up-to-date, very accessible knowledge repository enables all SOC personnel to minimize the time and effort put into open source research. For this to work, every analyst needs to contribute — this would only happen if the repository is well structured and accessible and if the SOC managers keep showing and reminding everyone that it actually helps a lot. For bigger SOCs/MSSPs, it is strongly advised to use the services of a knowledge manager whose actual job is to make information easier to access and update.</li><li>Regular and recurrent security training — internal or external — is very important to maintain a high level of awareness for analysts, build up cohesion and individual skills. The more the tasks given to the analysts are repetitive and “basic” (not technically advanced), the more regular training is needed.</li><li>Security training is fine, but as stated before, the security part is only the tip of the iceberg. The SOC analysts also need training for every scope they are tasked to monitor in order to understand them and more importantly differentiate normal from abnormal. All SOC analysts do not need to follow all training, but there have to be enough analysts trained for <strong>every scope at all times</strong> so that the knowledge is there — both up-to-date in the knowledge repository and in the minds of some analysts that are currently working. This ensures that the SOC responds correctly and in a timely fashion, whatever the security issue may be.</li><li>Finally, there need to be regular crisis simulations — both advertised and not advertised as an exercise — so that every analyst has experienced the pressure and the atmosphere of a crisis and that everyone knows their place and tasks in “crisis mode”. This is the only way to make sure that when an actual crisis happens, there is only a cybersecurity issue and not also a simultaneous “oh my god what are we supposed to do”/”headless chickens running around” issue.</li></ul><p>Usually, the further down the list, the less likely it is that the point is being well addressed. Therefore it is important for upper management, HR and SOC managers to understand and keep in mind that the SOC analysts need all of this to correctly do their jobs.</p><h4><strong>2.4. Understanding the profiles</strong></h4><p>The SOC managers have to know the profiles or their analysts in order to make the best of their teams.<br>Knowing what to aim for for the SOC as a whole, what the needs for the analysts are, what tasks can be given, what skills they require and how they can be added up to make coherent jobs is good — arguably better than what exists in some places today — but it is not enough.</p><p>To truly maximize the efficiency of the team members and, in the end, that of the SOC itself, there has to be a job and a place for everyone in the team and everyone in the team has to have a job and a place.<br>In other words, the company and the employee both need to be happy with the tasks assigned and the job done by the employee — this often means compromise.</p><p>A good way to reach an acceptable compromise is for the SOC managers and HR to understand the profile of the analyst — i.e. what makes them tick, explain to the analyst what the SOC needs and figure out together how to join both ends. If there is actually no common ground between what the analyst wants and what the SOC needs then it is maybe time to reassign the analyst elsewhere.<br>This may come across as crude, but motivation is key for the analyst to keep their skills at the expected level and for them to work well with the rest of the team. A SOC simply cannot afford internal conflicts or people that let themselves get carried by the flow, as the former simply destroys the cohesion and the latter is just dead weight that needs to be carried by the rest.</p><p>There are mostly two types of technical profiles for which a SOC or MSSP should look and one management profile. This of course covers only the SOC analysts and managers; other profiles may be needed for other jobs in the SOC.</p><p>Before talking about the management profile, here is a quick reminder that <strong><em>a great technician</em></strong> — i.e. person with high technical skills — <strong><em>rarely makes for a great manager</em></strong> or even a mediocre one, for that matter. Indeed, this cannot be said nor emphasized enough: <strong><em>management is not, never has been nor ever will be, an evolution of technical expertise</em></strong><em>.<br></em>A good SOC manager is typically someone curious, willing to try and understand technical subjects — at least enough to get the issues and possible solutions, with a good strategic vision and capacity for compromise. Basically, someone who is able to find a working compromise between the objectives set by the executives and the technical issues that the SOC is facing so that the SOC moves forward towards the objectives, even if the pace is slowed by technical issues.<br>In other words, a good SOC manager is a “Yes, but” person — meaning that everything could be achieved, <em>but </em>at some cost.</p><p>There are two main types of technical profiles that can be of use in a SOC.<br>The first one is the motivated and curious type: they most likely went into cybersecurity out of passion or interest for learning. The people with this profile are always asking “why” and “how” questions about every subject so they can truly understand what is happening. These make for good and great analysts because when they are responding to an incident, they will not rest until they are satisfied that they have understood exactly what happened and how so they can properly remedy the situation. Also, they are the type of people a SOC needs to better itself: because they like to learn and keep learning, they are often people that easily lose interest in repetitive actions in the sense that for them, any and every action they have to repeat without any added value is superfluous and therefore can and should be automated. In other words, they will try and optimize everything around them so that they can focus on what they want: learning stuff.<br>The downside is that they need to be kept in check and reminded that there are objectives and production priorities. They indeed tend to deep dive into subjects and sometimes the dive is too deep, taking too much of their time compared to what would have been acceptable from a production cost perspective.</p><p>The second type of technical profile is disciplined and hardworking in the sense that they don’t mind — or in some cases they even enjoy — repetitive tasks in a structured context with procedures to follow to the letter. For bigger SOCs and MSSPs, they can make the bulk of the teams tasked with investigations and remediation or even MRO because the job they do and the results they produce are very stable and reliable; that is exactly how a SOC needs to be. Also, if they are assigned tasks that suit them, they tend to be quiet and generally happy. That’s why it is extremely important to listen to and hear them whenever they make remarks or propose some kind of improvement about these tasks.<br>The people matching this profile often have less advanced technical skills than the other profile because they tend to dislike change, either in the tasks they are assigned or if they have to learn new things. It usually takes time and energy to make them pick up new skills or change their routine.</p><p>Both technical profiles are very important for a stable, reliable SOC that keeps on improving both the quality of its detection and response and the quantity of incidents per unit of time it can handle.<br>Of course and again, good management is key to put the right profiles on the right jobs, have all the profiles synergize well within the SOC and accurately convey the impacts of technical issues up the chain while explaining the “bigger picture” to the analysts.</p><h4><strong>2.5. Conclusion</strong></h4><p>A SOC or MSSP is a complex entity that requires a variety of people with specific profiles to perform how it is expected. All the profiles have to be correctly identified and positioned on the correct job, from the SOC analysts to the SOC managers. Therefore, it is important that HR helps the SOC managers manage their human resources and that both the upper management and HR pick the right kind of profile for the SOC managers together.<br>As a reminder: there is such a thing as technical expertise and it needs to be acknowledged — both in the missions and in the salary — and said technical expertise is the only way to improve technically.</p><p>Some of the current SOCs and MSSPs struggles are not having the right people in the right places, putting technical experts in management positions, leaving the MSSP managers battling the customers alone and/or having internal battles between the executives, HR and the SOC or MSSP managers instead of the formers helping the latter.<br>This leads to frustration, SOC managers leaving for another position with less pressure or a higher pay for the same amount of stress, SOC analysts corresponding to the first profile leaving for offensive or CERT/CSIRT positions and finally SOC analysts of the second profile leaving because as they stayed the longest, they are asked to do tasks they don’t want nor like.</p><p><strong>Summary<br></strong><a href="#c8a9">1. Introduction</a><br><a href="#d5d4">1.1. Definitions</a><br><a href="#f0c0">1.2. SOC/MSSP vs CERT/CSIRT</a><br><a href="#61c9">2. Human aspects</a><br><a href="#5ae5">2.1. Managing a SOC</a><br><a href="#3e23">2.2. SOC analysts’ jobs</a><br><a href="#2038">2.3. SOC analysts’ needs</a><br><a href="#c270">2.4. Understanding the profiles</a><br><a href="#f6a1">2.5. Conclusion</a></p><p>Part 2: <a href="https://medium.com/@7rm1ef8/a-soc-mssp-guide-2-of-4-f4fb93be2422">https://medium.com/@7rm1ef8/a-soc-mssp-guide-2-of-4-f4fb93be2422</a><br>Part 3: <a href="https://medium.com/@7rm1ef8/a-soc-mssp-guide-3-of-4-658e0cf99745">https://medium.com/@7rm1ef8/a-soc-mssp-guide-3-of-4-658e0cf99745</a><br>Part 4: <a href="https://medium.com/@7rm1ef8/a-soc-mssp-guide-4-of-4-a78779d830dd">https://medium.com/@7rm1ef8/a-soc-mssp-guide-4-of-4-a78779d830dd</a></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=3f5450638a98" width="1" height="1" alt="">]]></content:encoded>
        </item>
    </channel>
</rss>