<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0" xmlns:cc="http://cyber.law.harvard.edu/rss/creativeCommonsRssModule.html">
    <channel>
        <title><![CDATA[Stories by Johan Berggren on Medium]]></title>
        <description><![CDATA[Stories by Johan Berggren on Medium]]></description>
        <link>https://medium.com/@jberggren?source=rss-ae236e97a5------2</link>
        <image>
            <url>https://cdn-images-1.medium.com/fit/c/150/150/1*MSjifnrroB0mFuvQ1lpQ0w.jpeg</url>
            <title>Stories by Johan Berggren on Medium</title>
            <link>https://medium.com/@jberggren?source=rss-ae236e97a5------2</link>
        </image>
        <generator>Medium</generator>
        <lastBuildDate>Wed, 18 Nov 2026 12:36:53 GMT</lastBuildDate>
        <atom:link href="https://medium.com/@jberggren/feed" rel="self" type="application/rss+xml"/>
        <webMaster><![CDATA[yourfriends@medium.com]]></webMaster>
        <atom:link href="http://medium.superfeedr.com/" rel="hub"/>
        <item>
            <title><![CDATA[Thinking in Graphs: Exploring with Timesketch]]></title>
            <link>https://medium.com/timesketch/thinking-in-graphs-exploring-with-timesketch-84b79aecd8a6?source=rss-ae236e97a5------2</link>
            <guid isPermaLink="false">https://medium.com/p/84b79aecd8a6</guid>
            <category><![CDATA[neo4j]]></category>
            <category><![CDATA[dfir]]></category>
            <category><![CDATA[information-security]]></category>
            <category><![CDATA[cybersecurity]]></category>
            <category><![CDATA[infosec]]></category>
            <dc:creator><![CDATA[Johan Berggren]]></dc:creator>
            <pubDate>Tue, 05 Dec 2017 19:24:15 GMT</pubDate>
            <atom:updated>2017-12-05T20:24:05.444Z</atom:updated>
            <content:encoded><![CDATA[<p>As an incident response engineer at Google, nearly every incident I’ve investigated leads to one common truth: relationships between events are more important than the events themselves. As of today Timesketch supports a new experimental graph integration to explore these relationships.</p><h4><strong>Say hello to the new Graph View</strong></h4><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*WHaimAstoxkL4U-odZzAWQ.png" /></figure><h4><strong>Complementing the tabular view</strong></h4><p>Timesketch was designed to make collaboration, sharing and search easy as well as quickly correlate disparate events. The default search experience is based on Elasticsearch and the output is detailed and verbose by design. The tabular view shows ordered data available for specific queries.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*f9FKDn7VGE1vQqBqGlsdAg.png" /></figure><p>Common investigations that are best suited for a tabular view include:</p><ul><li>Profiling a sequence of actions performed by a set of users</li><li>Sequencing a number of process executions</li><li>Listing files created during a set time period</li></ul><p>More complex correlations like listing all users that were logged into a system that executed a specific process might however require multiple tabs, queries and much copying around. By building graph models from activities like this makes the data more accessible to the analyst without sacrificing transparency.</p><h4><strong>Graph backend</strong></h4><p>Timesketch uses Neo4j as a graph database backend. Neo4j implements a property graph and uses native graph storage to make traversals fast. Nodes in the graph can have have zero or more labels, and edges have exactly one type. Edges (or relationships as they are called in Neo4j) are directed and both nodes and relationships (edges) can have properties. These features gives us a powerful and expressive way to model and query graphs.</p><h4><strong>Graph model</strong></h4><p>The following examples profile a hypothetical (but realistic) incident and focuses on Windows logins and services. Windows event log entries (EventID 4624/7045) was used to structure the example graph used in this post:</p><pre><strong>Nodes</strong></pre><pre>Windows machines:           (machine)<br>Windows users:              (user)<br>Windows services:           (service)<br>Windows service image path: (image path)</pre><pre><strong>Relationships</strong></pre><pre>(user)-[ACCESS]-&gt;(machine)<br>(machine)-[ACCESS{user:&lt;USERNAME&gt;}]-&gt;(machine)<br>(service)-[START]-&gt;(machine)<br>(service)-[HAS]-&gt;(image path)</pre><h4><strong>Graph query language</strong></h4><p>Neo4j ships with a powerful query language called Cypher. Cypher has one of the lowest learning curves for graph queries thanks to its visual nature and <a href="https://neo4j.com/developer/cypher-query-language/">good tutorials</a>. A query looks like this:</p><pre><strong>MATCH (a:Label)-[r:TYPE]-&gt;(b {property: “foo”})<br>WHERE a.foo = “bar”<br>RETURN *</strong></pre><p>This query roughly translates to: “<em>Give me all paths where a given node “a” has a directed TYPE relationship to another node “b” that has a property “foo”, where “foo” = “bar</em>”. As you can see, Cypher is like working directly from a whiteboard representation of the graph with some SQL added. This makes it easy to get started and the learning curve is not too steep.</p><h4><strong>Example1: Get all interactive logins</strong></h4><p>Let’s get started with some examples. First, let’s retrieve all users who logged in to a system interactively:</p><pre><em>Returns all paths where a WindowADUser has a ACCESS relationship to a WindowsMachine the ACCESS login method is one of Interactive, CachedInteractive or Unlock</em></pre><pre><strong>MATCH (user:WindowsADUser)-[r1:ACCESS]-&gt;(m1:WindowsMachine) WHERE r1.method IN [“Interactive”, “CachedInteractive”, “Unlock”]</strong></pre><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*yUeZG9EMtIKZOHK2A07WyQ.png" /></figure><p>You might notice that there is a number on the relationship in parentheses. Instead of adding many edges to the graph the system adds the timestamp for each login event as a list property on the relationship itself. You will see how an analyst can take advantage of this later.</p><h4><strong>Transparency</strong></h4><p>In digital forensics it is important to be able to reason about how events are connected and why tools represent the data the way they do. When building tools the developer has to be transparent about how these relationships are created.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*7Fg47kRHCiyzjADsTr-LbQ.png" /></figure><p>Selecting a relationship shows an option to display which events were used to create that connection. This way you can explore and verify the data within the context of the graph and reason about why the data is represented the way it is. You can quickly switch between tabular view and graph view for the same data.</p><h4><strong>Example 2: List all users who logged in to a system where a specific service was started</strong></h4><p>This query is a bit more complicated and shows some of the power of the Cypher query language. For the sake of this example a normal legitimate service was chosen but you can imagine this being an evil service started by an attacker:</p><pre><em>Return all paths where a user logged in to machine A and then then laterally moved to a machine B where at some time a service was started with path to an executable with name GROOVE.EXE</em></pre><pre><strong>MATCH (user:WindowsADUser)-[r1:ACCESS]-&gt;(machineA:WindowsMachine)-[r2:ACCESS]-&gt;(machineB:WindowsMachine),(machineB)&lt;-[r3:START]-(service:WindowsService)-[r4:HAS]-&gt;(path:WindowsServiceImagePath) WHERE r2.username = user.username AND path.image_path contains “GROOVE.EXE”</strong></pre><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*pjpQ6LFq8aoqXf4xjj-vsg.png" /></figure><h4><strong>Example 3: What about time?</strong></h4><p>There is one thing missing in the above queries: time! Timesketch is about timeline analysis and the temporal dimension in the graph is important. Remember that there are timestamps added to each relationship as a list property, let’s see how that can be leveraged:</p><pre><em>Return all paths where user logged in interactively on machine A and then laterally moved to machine B using a network login. Constraint the result with a time window between the first login and the second login that has to be within 12 hours.</em></pre><pre><strong>MATCH (user:WindowsADUser)-[r1:ACCESS]-&gt;(m1:WindowsMachine)-[r2:ACCESS]-&gt;(m2:WindowsMachine) WHERE r1.method IN [“Interactive”, “CachedInteractive”, “Unlock”] AND r2.username = user.username AND r1.timestamp &lt; r2.timestamp &lt; r1.timestamp + 60 * 720</strong></pre><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*1vtNshgCGTj9fRklElkCWA.png" /></figure><p>The important detail in this query is:</p><pre>r1.timestamp &lt; r2.timestamp &lt; r1.timestamp + 60 * 720</pre><p>Instead of requiring complex Cypher statements the analyst can express time filters on relationships instead. The query is transpiled into valid Cypher on the backend and returns the matching nodes and relationships based on the time filter supplied.</p><p>This is just the beginning and the Timesketch team is excited to see what can be done with graphs and incident response. The roadmap includes:</p><ul><li>A Framework to model graphs from Timesketch queries</li><li>Manually adding nodes/relationships</li><li>Exploring graphs by following relationships</li><li>Saving snapshot of graph layout (like saved views)</li><li>Executing graph queries and alert on matches</li><li>Adding graph support to timesketch-api-client</li><li>Pre-defined queries with user supplied parameters</li></ul><p>If you made it this far you are probably keen on testing this feature yourself. The Timesketch team has made experimenting easy by loading and building a graph on the public Timesketch demo server. Just login with demo/demo and start exploring!</p><p><a href="https://demo.timesketch.org/sketch/3/graphs/">Timesketch</a></p><p>Many thanks to <a href="https://github.com/franekp">Franciszek Piszcz</a> who implemented this feature over the course of his 3 month Google internship! Also many thanks to <a href="https://github.com/We-St">Stefan Weghofer</a>, Google software engineer who lend his expertise and knowledge to the project and helped make it successful.</p><p><em>Johan is a Senior Security Engineer at Google. He is the author of Timesketch. If you like articles like this — or interested in open source digital forensic tools — you can</em><a href="https://twitter.com/jberggren"><em> </em><strong><em>follow him on Twitter</em></strong></a><em>.</em></p><p><em>If you want to fetch the code it is available over at </em><a href="https://github.com/google/timesketch"><strong><em>GitHub</em></strong></a><em>. Installation instructions are available on the </em><a href="https://github.com/google/timesketch/wiki"><strong><em>Wiki</em></strong></a><em>.</em></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=84b79aecd8a6" width="1" height="1" alt=""><hr><p><a href="https://medium.com/timesketch/thinking-in-graphs-exploring-with-timesketch-84b79aecd8a6">Thinking in Graphs: Exploring with Timesketch</a> was originally published in <a href="https://medium.com/timesketch">Timesketch</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Timeline analysis from the future]]></title>
            <link>https://medium.com/timesketch/timeline-analysis-from-the-future-59a7ad7da498?source=rss-ae236e97a5------2</link>
            <guid isPermaLink="false">https://medium.com/p/59a7ad7da498</guid>
            <category><![CDATA[infosec]]></category>
            <category><![CDATA[dfir]]></category>
            <category><![CDATA[incident-response]]></category>
            <category><![CDATA[digital-forensics]]></category>
            <dc:creator><![CDATA[Johan Berggren]]></dc:creator>
            <pubDate>Fri, 21 Jul 2017 15:14:36 GMT</pubDate>
            <atom:updated>2017-12-05T13:16:18.409Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*ZqAiZT2u2Zi1EL9NrHYoMg.png" /><figcaption>Demo server is now available! <a href="https://demo.timesketch.org/">https://demo.timesketch.org/</a></figcaption></figure><blockquote><a href="https://github.com/google/timesketch">Timesketch</a> is an open source collaborative forensic timeline analysis tool. It uses full text search to give you insight into your investigations. You can search hundreds of millions of events across different timelines all at once. Share your findings using saved views and add meaning to your data with labels and comments. Timesketch is build around collaboration, sharing and search.</blockquote><p>We are excited to announce a new version of Timesketch, codename “Donnie Darko”. This release brings exciting new backend features such as a Python API client and Neo4j graph database support.</p><h3><strong>Python API client</strong></h3><p>To integrate Timesketch in your environment has been difficult. You have to install Timesketch with all dependencies, configure the server and so on. This is clearly not optimal. To make this better for you we have created a standalone API client library. The library takes care of authentication and sessions for you so you can focus on what is important. This is the first release of this library and we plan to add more features in the near future.</p><h3><strong>Install and use the API client</strong></h3><pre>$ pip install timesketch-api-client<br>$ python<br>&gt;&gt;&gt; from timesketch_api_client.client import TimesketchApi<br>&gt;&gt;&gt; api_client = TimesketchApi(&quot;http://127.0.0.1:5000&quot; username=test, password=test)<br>&gt;&gt;&gt; api_client.list_sketches()<br>...<br>&gt;&gt;&gt; sketch = api_client.get_sketch(1)<br>&gt;&gt;&gt; sketch.search(&quot;search query&quot;)</pre><p>We plan to develop a command line tool and shell which will provide the same features that you are used to in the web interface. I’m excited to see what the community will be able to do and what integrations we will see.</p><h3><strong>Graph database backend</strong></h3><p>The beginning of some exciting new features. With an interface for communicating with the open source graph database <a href="https://neo4j.com/">Neo4j</a> we are prepared for graph exploration of timeline data. Our goal is to provide an intuitive and powerful graph exploration frontend. <strong>Stay tuned for more information on this!</strong> Here is a teaser (created with mock data):</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*6mlFr-XwEskOx3tafdpKaw.png" /></figure><h3><strong>For developers</strong></h3><p>Timesketch hackers, we are happy to announce that it is easier than ever to setup your environment with updated Vagrant support. Check out the <a href="https://github.com/google/timesketch/wiki/Vagrant">official documentation</a> to get started.</p><pre>$ git clone <a href="https://github.com/google/timesketch.git">https://github.com/google/timesketch.git</a><br>$ cd timesketch/vagrant<br>$ vagrant up<br>...<br>$ vagrant ssh<br>$ tsctl runserver -h 0.0.0.0</pre><pre>Visit http://127.0.0.1:5000</pre><p>The environment is setup in such a way that when you edit the code on your host computer it will be reflected in the Vagrant VM automatically. This way you can use your favourite text editor for development.</p><h3><strong>Better time filters</strong></h3><p>Time filters has become more user friendly and powerful. Thanks to <a href="https://twitter.com/hacktobeer">Ramses de Beer</a> you can now filter on time by using the new syntax.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*VD4hATso5hsriXL6hRw8-Q.png" /></figure><p>Timesketch will automatically parse your filter and create the correct time range. Examples:</p><ul><li>2017–01–12 (Specific day)</li><li>2017–01–12 +-1d (Specific day and 1 day before and after)</li><li>2017–01–12 12:01:01 +5m (Specific day and time and 5 minutes before and after)</li></ul><h3><strong>Other improvements</strong></h3><ul><li>Elasticsearch 5.x support.</li><li>Streaming results from Elasticsearch.</li><li>UI/UX refresh to make your Timesketch workflow even better.</li><li>You can now delete timelines.</li></ul><h3><strong>Live demo server</strong></h3><p>It is now easier than ever to test Timesketch. We have set up a live demo server over at <a href="https://demo.timesketch.org/">https://demo.timesketch.org/</a>. Login with demo/demo and start your adventure with the example investigation called “Greendale” (not a real incident).</p><p>Check it out here: <a href="https://demo.timesketch.org/sketch/3/explore/view/77/">https://demo.timesketch.org/sketch/3/explore/view/77/</a></p><h4><strong>Note on upgrading</strong></h4><p>Follow the <a href="https://github.com/google/timesketch/wiki/Upgrading">official upgrading instructions</a>. You will need to backup your database and migrate the SQL schema. This release also introduces Elasticsearch version 5 support. This breaks compatibility with Elasticsearch 1.x and 2.x. If you have indices created with version 1.x you will need to reindex them. Follow the <a href="https://www.elastic.co/guide/en/elasticsearch/reference/current/setup-upgrade.html">official documentation</a> before you upgrade Timesketch.</p><p><em>Johan is a Senior Security Engineer at Google and he is the author of Timesketch. If you like articles like this — or interested in open source digital forensic tools — you can follow him on </em><a href="https://twitter.com/jberggren"><em>Twitter</em></a><em>.</em></p><p><em>If you want to fetch the code it is available over at </em><a href="https://github.com/google/timesketch"><strong><em>GitHub</em></strong></a><em>. Installation instructions are available on the </em><a href="https://github.com/google/timesketch/wiki"><strong><em>Wiki</em></strong></a><em>.</em></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=59a7ad7da498" width="1" height="1" alt=""><hr><p><a href="https://medium.com/timesketch/timeline-analysis-from-the-future-59a7ad7da498">Timeline analysis from the future</a> was originally published in <a href="https://medium.com/timesketch">Timesketch</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Your timeline is a story worth telling]]></title>
            <link>https://medium.com/timesketch/your-timeline-is-a-story-worth-telling-6e2f2a9bfc0c?source=rss-ae236e97a5------2</link>
            <guid isPermaLink="false">https://medium.com/p/6e2f2a9bfc0c</guid>
            <category><![CDATA[cybersecurity]]></category>
            <category><![CDATA[dfir]]></category>
            <category><![CDATA[security]]></category>
            <category><![CDATA[information-security]]></category>
            <category><![CDATA[infosec]]></category>
            <dc:creator><![CDATA[Johan Berggren]]></dc:creator>
            <pubDate>Fri, 18 Nov 2016 15:10:46 GMT</pubDate>
            <atom:updated>2016-11-18T15:10:46.272Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*QJHuj9fYVuCDUi3IZEAxSw.png" /></figure><p>Finding the right tool for digital forensic timeline analysis is challenging. Analysts tend to reach for tools like sed, grep, awk or even spreadsheets to get the job done. We have all been there. This works quiet well when the dataset is a few hundred thousand events and you are the only analyst on the case. But there are times when you need to analyze and correlate millions of events from more than one source. For example you need to collect and process artifacts from Windows, Linux and Mac, and sometimes even create full disk timelines with <a href="https://github.com/log2timeline/plaso">Plaso</a>. The point being that the dataset tend to grow fast and making sense of it becomes difficult.</p><p>To answer questions like <em>“How did the actor move laterally within our network?” </em>becomes complicated. To scale analysis you need to collaborate and share findings with your colleagues. You need to be able to search across all your timelines at once. To keep the momentum you also need to hand over the current state of your investigation to the next analyst.</p><h4>You need a timeline analysis tool</h4><p>I created <a href="https://github.com/google/timesketch">Timesketch</a> to address these challenges. Timesketch is an <a href="https://github.com/google/timesketch/blob/master/LICENSE">open source</a> collaborative forensic timeline analysis tool. It uses full text search to give you insight into your timelines. You can search hundreds of millions of events across different timelines all at once. Share your findings using saved views and add meaning to your data with labels and comments. Bring life to your investigation with Timesketch Stories. Timesketch is build around collaboration, sharing and search.</p><p>The Timesketch development team is proud to announce the release of Timesketch version 2016.11, codename “Looper”. This release introduces new features like <strong>advanced search</strong>, <strong>search templates</strong> and <strong>editable views</strong>. Let us explore how they can help you in your analysis work.</p><h4>Timesketch Stories</h4><p>Timesketch lets you analyze your timelines in a completely new way. We call it Timesketch Stories. The story captures your notes, hypotheses and lets you embed interactive timeline events. Handing over the investigation now becomes part of your analysis workflow. <em>Note: The data shown in the screenshots throughout this post are all fictional.</em></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*poIHfBW3ihOAoTWEpt1jww.png" /><figcaption>A Timesketch story.</figcaption></figure><h4>Powerful search</h4><p>One of the central ideas in Timesketch is the ability to do full text search on your timelines. You have always been able to search with the<em> Query String Query</em> language. You can for example search based on boolean operators and regular expressions.</p><p><strong>Boolean operators with grouping</strong></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*asgPSI5QUWX1PdpShnt2cQ.png" /></figure><p><strong>Regular expressions</strong></p><pre>message:/joh?n(ath[oa]n)/.</pre><p>See the <a href="https://www.elastic.co/guide/en/elasticsearch/reference/current/query-dsl-query-string-query.html">official documentation </a>for a full list of features.</p><p>But sometimes you need more flexibility to get the results you need. With this release we introduce Advanced search. You are no longer limited to <em>Query String Query </em>for your searches<em>. </em>You can now use full <a href="https://www.elastic.co/guide/en/elasticsearch/reference/current/query-dsl.html">Elasticsearch DSL queries</a> right from the UI.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*-qtb9RSo8wQJ3Rw-KxtcNQ.png" /><figcaption>The new Advanced search.</figcaption></figure><h4>Saved Views just got a whole lot better</h4><p>You can save your queries and filters as Saved views. The view gives you instant access to the results and also a quick way to share your findings. It is also how you embed events in your stories.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*lnlhdiof6OSQIPG2bGYQYw.png" /><figcaption>Save your queries and filters.</figcaption></figure><p>With this release we have made a couple of improvements to Saved views. First we made them editable. If you want to change the search query or filters you can now click the “Update view” button. This will save the changes to the view and make it available to all users. And of course, all stories that embeds the view will update automatically.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*kCGu43ak3UDlDkgzFsidNg.png" /><figcaption>Update your views with a single click.</figcaption></figure><p>We have also added the ability to save only selected events as a Saved view. This is especially handy when you want to embed specific events in a story.</p><h4>Bootstrap your investigation with Search templates</h4><p>Search templates are like Saved views except they are not bound to any specific data. You can use templates to create new Saved views for your investigation.</p><p>Search templates can answer questions like <em>“Who logged in over RDP?”</em> or <em>“Do I have any hits for this [Indicator of Compromise]?”</em>. When you have created a view based on the template you can edit it by adding filters or changing the query. The templates supports both basic search and the new advanced search. It is easy to create new templates. Choose “Save as Search Template” when you create a new Saved view.</p><p>It is easy to create a new view in your investigation based on a Search template. Click the “Quick add” button and your are done.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*Cx2PR_qz1JDIzPcDFKrQng.png" /><figcaption>Just click “Quick add” to use the Search Template in your investigation.</figcaption></figure><h4>Meaningful visualizations</h4><p>When we create visualizations in Timesketch we want them to be meaningful. They should add value to your workflow. For example you can use the Heatmap chart to spot odd login patterns.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*oSaLCqYyVflnNHGxMaIXfQ.png" /><figcaption>Searching for Windows login events.</figcaption></figure><p>If you have ideas for visualizations in Timesketch, please speak up! Create a <a href="https://github.com/google/timesketch/issues/new">new feature request</a> and we will take a look.</p><h3>What we’re planning next</h3><p>We are already planning for the next releases and here are some of the features you can look forward to:</p><ul><li><strong>Better time filters </strong>— More flexible time filters and an easier UI to add filters for this important attribute.</li><li><strong>Activity streams</strong> — Get an overview of what your fellow analysts have been working on with real time updates of all actions taken in a sketch. This will also be the foundation of a new auditing system.</li><li><strong>Better UX for uploads</strong></li><li><strong>More visualizations</strong></li><li><strong>Pagination for search results</strong></li><li>.. and much more.</li></ul><p>If you have ideas for new features please file a <a href="https://github.com/google/timesketch/issues/new">feature request</a> on GitHub. <br>Thanks to all who made this release possible. Your fixes and bug reports are critical for the success of the project!</p><p><em>Johan is a Senior Security Engineer at Google. He is the author of Timesketch. If you like articles like this — or interested in open source digital forensic tools — you can</em><a href="https://twitter.com/jberggren"><em> </em><strong><em>follow him on Twitter</em></strong></a><em>.</em></p><p><em>If you want to fetch the code it is available over at </em><a href="https://github.com/google/timesketch"><strong><em>GitHub</em></strong></a><em>. Installation instructions are available on the </em><a href="https://github.com/google/timesketch/wiki"><strong><em>Wiki</em></strong></a><em>.</em></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=6e2f2a9bfc0c" width="1" height="1" alt=""><hr><p><a href="https://medium.com/timesketch/your-timeline-is-a-story-worth-telling-6e2f2a9bfc0c">Your timeline is a story worth telling</a> was originally published in <a href="https://medium.com/timesketch">Timesketch</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Timesketch stories]]></title>
            <link>https://medium.com/timesketch/timesketch-2016-7-db3083e78156?source=rss-ae236e97a5------2</link>
            <guid isPermaLink="false">https://medium.com/p/db3083e78156</guid>
            <category><![CDATA[infosec]]></category>
            <category><![CDATA[forensics]]></category>
            <category><![CDATA[information-security]]></category>
            <category><![CDATA[security]]></category>
            <category><![CDATA[incident-response]]></category>
            <dc:creator><![CDATA[Johan Berggren]]></dc:creator>
            <pubDate>Fri, 22 Jul 2016 11:09:45 GMT</pubDate>
            <atom:updated>2017-12-05T13:03:53.263Z</atom:updated>
            <content:encoded><![CDATA[<p><em>Timesketch is an open source collaborative timeline analysis tool (</em><a href="https://github.com/google/timesketch"><em>source code</em></a><em>) for for digital forensics and incident response. Using sketches multiple collaborators can easily organize and concurrently analyze timelines.</em></p><p>We are excited to announce a new version of Timesketch (2016.7 codename Interstellar). This version is packed with new features, tweaks and fixes that will make your analysis more efficient and fun!</p><h3>Stories</h3><p>A story is a place where you can capture the narrative of your technical investigation and add detail to your story with raw timeline data. The editor let you to write and capture the story behind your investigation and at the same time enable you to share detailed findings without spending hours writing reports.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*ejdEOmKK_4jz5c9_Cdbz-w.png" /></figure><p>At the moment, you can add events from previously saved searches. Just hit enter to start a new paragraph and choose the saved search from the dropdown menu.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*zLDyo2fvpBOzssS5pwmTMA.png" /></figure><p>This is just the beginning and we have lot of ideas going forward. For example, manually adding individual events to the story and automatically creating stories from Plaso analysis reports. If you have ideas please share them with us!</p><h3>New sharing options</h3><p>You’re now able to add more granular access control to your sketches with some new sharing options in the Interstellar release. The first is sharing a sketch with individual users of the system. This is ideal when you have a sensitive case and want to keep the sketch private but still need to collaborate with other analysts. In the sharing options there’s a new field called “Share with:”. Just put the username of the person you want to collaborate with and enjoy having a private sketch.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*cd8Q4Qz1p8473FMUkOvJlQ.png" /></figure><p>The second option is to share with a group of users. In this initial implementation groups are provisioned from your Single Sign On (SSO) system. To enable this feature you need to have your SSO implementation expose group information for the user when logging in. In future versions you will be able to manually create groups, stay tuned!</p><h3>Other improvements</h3><ul><li>Elasticsearch 2.x support.</li><li>UI/UX refresh to make your Timesketch workflow even better.</li><li>Database migration support.</li><li>More API endpoints to better support tools that want to integrate with Timesketch.</li></ul><h3>What is coming in the next release?</h3><p>We are already planning for the next releases and here are some of the features you can look forward to:</p><ul><li><strong>Canned queries</strong> — These are generic saved searches that can be applied to any sketch and on any number of Timelines. An example use of this is to store a generic query to enumerate all user logins or executed programs. With this feature you will be able to quickly bootstrap your investigations and to let the system automatically present you with relevant data.</li><li><strong>Manual timeline events</strong> — Manually add events to your investigation will open up new possibilities. You’ll be able to add ad hoc events that are not sourced from Plaso.</li><li><strong>Better time filters </strong>— More flexible time filters and an easier UI to add filters for this important attribute.</li><li><strong>Activity streams</strong> — Get an overview of what your fellow analysts have been working on with real time updates of all actions taken in a sketch. This will also be the foundation of a new powerful auditing system.</li></ul><p>See all planned features on the <a href="https://github.com/google/timesketch/milestones/2016.12">milestone page</a>.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=db3083e78156" width="1" height="1" alt=""><hr><p><a href="https://medium.com/timesketch/timesketch-2016-7-db3083e78156">Timesketch stories</a> was originally published in <a href="https://medium.com/timesketch">Timesketch</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Timesketch charts and visualisation]]></title>
            <link>https://medium.com/timesketch/timesketch-2015-12-d9a9a1ed9a13?source=rss-ae236e97a5------2</link>
            <guid isPermaLink="false">https://medium.com/p/d9a9a1ed9a13</guid>
            <category><![CDATA[forensics]]></category>
            <category><![CDATA[incident-response]]></category>
            <category><![CDATA[security]]></category>
            <dc:creator><![CDATA[Johan Berggren]]></dc:creator>
            <pubDate>Wed, 23 Dec 2015 14:27:05 GMT</pubDate>
            <atom:updated>2017-12-05T13:19:28.578Z</atom:updated>
            <content:encoded><![CDATA[<p><a href="http://www.timesketch.org/"><em>Timesketch</em></a><em> is an open source tool (</em><a href="https://github.com/google/timesketch"><em>source code on Github</em></a><em>) for collaborative timeline analysis intended for digital forensics and incident response. Using sketches multiple collaborators can easily organize and concurrently analyze timelines. It supports adding rich annotations, comments and stars to add meaning to the raw data.</em></p><p>We are happy to announce a new version of Timesketch (2015.12 codename <a href="https://en.wikipedia.org/wiki/About_Time_%282013_film%29"><em>About Time</em></a><em>). </em>Apart from bug fixes this version is packed with new features that will make your analysis more efficient and fun!</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*f_VSs4K_owtQRAaDKxJjzQ.png" /></figure><h4>Fewer distractions in the UI</h4><p>The navigation sidebar is now gone to give more space for things that matter, e.g. the event list and the new charts. Navigation has been transformed into a tab list on the top of the page making it easy to move around in your sketches. The lists of sketches, timelines and saved views also have more information available.</p><h4>Charts and aggregations</h4><p>To help you get more insight into your timelines it is valuable to be able to aggregate the search results and visualize the data. Timesketch aggregations does this for you and is perfect for exploratory analysis. Initially there are three aggregations available, data_type, histogram and heatmap.</p><p>The data_type aggregation uses the data_type attribute from Plaso, giving you a really quick way to filter out events of a certain type.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*g19sBo9AfoxVvw_WHGRGNA.png" /></figure><p>The heatmap aggregation calculates on which day of the week and at which hour events happened. This can be very useful e.g. when analyzing lateral movement or login events.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*5zLCzFnLboVZ90HbH_wc6Q.png" /></figure><p>There is also a classic histogram aggregation that shows you the number of events per day in the result.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*eh1h1EWL1UEgw2fRMDn9wg.png" /></figure><h4>Hiding events from view</h4><p>This has been a popular request and is all about reducing noise in your result views. You can now hit the little eye to hide events from the list making it possible to curate your views to emphasize the important things. But don’t worry, the events are still there and can be easily shown for those who want to see them. Just hit the big red button to show/hide the events.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*Nwp8DE9GpKn3-Q-LHI9VGA.png" /></figure><h4>Basic search and filtering with URL parameters</h4><p>Another popular request is to be able to link to a sketch with query and filter as request parameters. This is now possible and initially you can do basic filtering and queries. This is great if you want to dynamically create links to sketches from other applications without creating saved searches first.</p><pre>/sketch/1/explore/?q=ssh&amp;time_start=2015–01–01&amp;time_end=2015–12–13</pre><h4>Visualize time jumps</h4><p>A common issue when analyzing timelines is to be able to visually see when there are jumps in time, i.e. the distance between two events are bigger than a certain time e.g. 1 day. This is now shown in Timesketch with what we call “time bubbles”. You will never find yourself getting distracted by time jumps in your timelines again!</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*c-qk-USioJxTEzOpz1gTJg.png" /></figure><h4>Plaso tags as UI labels</h4><p>Plaso has the ability to tag events during processing. These tags are now shown in the Timesketch UI as labels in the output. This makes it super fast to spot interesting events tagged by Plaso’s powerful analysis plugin system.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*1hCysMjbuoQ4S4RLc2JFyw.png" /></figure><h4>CSV importer</h4><p>The control program for Timesketch, tsctl, can now ingest timelines in CSV format. This is much more efficient for large timelines compared to the JSON ingestion previously available. Adding timelines from sources other than Plaso is now much easier.</p><pre>$ tsctl csv2ts — file timeline.csv — name my_timeline</pre><h4>Other features added in this release</h4><ul><li>Deleting a saved view can now be done by the sketch owner.</li><li>Export the result of your queries and filters into a CSV file.</li><li>You can now update a user’s password via tsctl.</li><li>The <a href="https://en.wikipedia.org/wiki/Web_Server_Gateway_Interface">WSGI</a> program has moved into the Timesketch package making it easier to serve Timesketch with a web server.</li><li>Newlines and formatting are preserved in event info and comments.</li></ul><h4>Give it a spin over at the demo site</h4><p>We have a demo installation of Timesketch up and running. You can reach it at <a href="https://demo.timesketch.org/">https://demo.timesketch.org/</a> and login with demo/demo.</p><p><strong>To get you started here are some saved searches showing off the features mentioned in this post:</strong></p><ul><li><a href="https://demo.timesketch.org/sketch/34/explore/view/45/">Plaso tags in action</a></li><li><a href="https://demo.timesketch.org/sketch/34/explore/view/47/">Time bubbles for the win!</a></li><li><a href="https://demo.timesketch.org/sketch/34/explore/view/49/">Hidden events</a></li></ul><h4>How do I install or upgrade to the new release?</h4><p>If you already have Timesketch installed and working you just do:</p><pre>$ sudo pip install timesketch --upgrade</pre><p>If you need to install Timesketch from scratch check out the <a href="https://github.com/google/timesketch/wiki/Installation">installation instructions</a> on the Timesketch wiki.</p><h4>Sneak preview next release</h4><p>The next release (2016.6, codenamed <a href="https://en.wikipedia.org/wiki/Kung_Fury">Kung Fury</a>) is planned to be released this coming summer. To follow along with which features are planned and what issues are being worked on please see the <a href="https://github.com/google/timesketch/milestones/2016.6">2016.6 milestone page</a>.</p><p><strong>To give you a preview of what is coming in the summer of 2016</strong></p><ul><li>Better ACL controls in the UI. This will make it possible to have private sketches with specific users as collaborators.</li><li>Better time filters that will make it more intuitive to filter on time ranges etc. Date pickers and multiple time ranges is what we are thinking about.</li><li>Last but not least, initial experimental implementation of Timesketch Stories! A new way to work with forensic timelines which will make it possible to blend narrative and raw data.</li></ul><p>Stay tuned!</p><p>— The Timesketch team</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=d9a9a1ed9a13" width="1" height="1" alt=""><hr><p><a href="https://medium.com/timesketch/timesketch-2015-12-d9a9a1ed9a13">Timesketch charts and visualisation</a> was originally published in <a href="https://medium.com/timesketch">Timesketch</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
    </channel>
</rss>