<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0" xmlns:cc="http://cyber.law.harvard.edu/rss/creativeCommonsRssModule.html">
    <channel>
        <title><![CDATA[Ingest Engineering - Medium]]></title>
        <description><![CDATA[How we build a global platform for video. - Medium]]></description>
        <link>https://medium.com/ingest-engineering?source=rss----5db5b4c0256b---4</link>
        <image>
            <url>https://cdn-images-1.medium.com/proxy/1*TGH72Nnw24QL3iV9IOm4VA.png</url>
            <title>Ingest Engineering - Medium</title>
            <link>https://medium.com/ingest-engineering?source=rss----5db5b4c0256b---4</link>
        </image>
        <generator>Medium</generator>
        <lastBuildDate>Sun, 22 Nov 2026 05:06:16 GMT</lastBuildDate>
        <atom:link href="https://medium.com/feed/ingest-engineering" rel="self" type="application/rss+xml"/>
        <webMaster><![CDATA[yourfriends@medium.com]]></webMaster>
        <atom:link href="http://medium.superfeedr.com/" rel="hub"/>
        <item>
            <title><![CDATA[OPEN SOURCING INGEST’S HLS MANIFEST PARSER]]></title>
            <link>https://medium.com/ingest-engineering/open-sourcing-ingests-hls-manifest-parser-13740c9c6b54?source=rss----5db5b4c0256b---4</link>
            <guid isPermaLink="false">https://medium.com/p/13740c9c6b54</guid>
            <category><![CDATA[live-streaming]]></category>
            <category><![CDATA[technology]]></category>
            <category><![CDATA[web-development]]></category>
            <category><![CDATA[golang]]></category>
            <category><![CDATA[open-source]]></category>
            <dc:creator><![CDATA[Taina Leal]]></dc:creator>
            <pubDate>Tue, 06 Dec 2016 17:35:20 GMT</pubDate>
            <atom:updated>2016-12-07T14:17:04.809Z</atom:updated>
            <content:encoded><![CDATA[<p>It’s <a href="http://www.cisco.com/c/en/us/solutions/collateral/service-provider/visual-networking-index-vni/complete-white-paper-c11-481360.html">predicted</a> that by 2020, roughly a million minutes of video content will be streamed every second on the internet, and video traffic will count for 82% of all internet traffic. With statistics like these, it’s only logical to expect media streaming technologies to match that progression, improving user experience as much as possible. Currently, Adaptive Bitrate Streaming is the leading practice used by media delivery providers. If you haven’t experienced long video buffering and multiple streaming interruptions in a while, it’s mostly thanks to ABS.</p><p>One of its most popular implementations is Apple’s HTTP Live Streaming or HLS. It is widely supported by different OS, browsers, and players, which is why for us at Ingest the decision to provide HLS encoding and playback was a no-brainer.</p><p>As part of our commitment to the breakthrough performance, we chose to develop Ingest’s backend applications in Go (Golang). It’s a fully open source language, which motivates contributions from developers everywhere. Since we’re guilty of benefiting from some great open source packages in our applications, we feel is only fair to give back to the community. For that reason, we’re releasing our <a href="https://github.com/ingest/manifest">HLS Manifest Parser</a> package.</p><h4><strong>HLS Run-Through</strong></h4><p>In order to have your video ready for HLS delivery, it is first encoded into multiple variants, using different settings for things like bitrate and resolution. Each variant is later segmented in smaller chunks, of up to 10 seconds in duration.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/705/1*ocuScmwekWbla1scyJPh_g.jpeg" /><figcaption>HLS basic encoding flow</figcaption></figure><p>Information about each variant and where to request its segments is written in a Media Playlist, as seen in the example below.</p><iframe src="" width="0" height="0" frameborder="0" scrolling="no"><a href="https://medium.com/media/c43703d94c10c52d2951b49f9540433b/href">https://medium.com/media/c43703d94c10c52d2951b49f9540433b/href</a></iframe><p>Every created Media Playlist is then listed in a Master Playlist.</p><iframe src="" width="0" height="0" frameborder="0" scrolling="no"><a href="https://medium.com/media/8b4db17857b73a3415409066e21b4ff4/href">https://medium.com/media/8b4db17857b73a3415409066e21b4ff4/href</a></iframe><p>When the video is streamed, the client video player identifies the most appropriate set of options for the current network bandwidth — best bitrate, screen resolution — and can request the corresponding Media Playlist containing that segment.</p><h4><strong>Why we built a manifest parser</strong></h4><p>We were initially generating these manifest files (Media and Master Playlist) through FFMPEG and using grafov’s <a href="https://github.com/grafov/m3u8">m3u8</a> library to add media encryption. The first problem we ran into with this approach is we needed Ingest to support the latest HLS versions, which wasn’t possible through the m3u8 package. We want the library to keep up with Apple’s new specifications so we can guarantee our users the best quality possible in content delivery. Another issue was regarding FFMPEG and m3u8’s open source licenses and dealing with the possibility of a sudden license change.</p><p>After extensive research, we couldn’t find a solution that would fit our list of requirements and felt it’d be valuable to develop our own parser package. Writing it from scratch would give us more control over a very important part of our product and the certainty that we would be ready to quickly adjust to any future changes in HLS.</p><h4><strong>How to use it</strong></h4><p>The Manifest package has a very simple implementation. You can install it by running:</p><p>go get github.com/ingest/manifest</p><p>Below are simple examples of how you can generate manifest files:</p><iframe src="" width="0" height="0" frameborder="0" scrolling="no"><a href="https://medium.com/media/0284c33c1799aa4b2b90b85a2b687c36/href">https://medium.com/media/0284c33c1799aa4b2b90b85a2b687c36/href</a></iframe><iframe src="" width="0" height="0" frameborder="0" scrolling="no"><a href="https://medium.com/media/aca7b0afd21e28573206a26233518401/href">https://medium.com/media/aca7b0afd21e28573206a26233518401/href</a></iframe><p>You are also able to read a playlist and make adjustments as needed. The example below reads from a Media Playlist and adds encryption to each segment.</p><iframe src="" width="0" height="0" frameborder="0" scrolling="no"><a href="https://medium.com/media/f5c342dc83fbc5f9198e0374afebaa0c/href">https://medium.com/media/f5c342dc83fbc5f9198e0374afebaa0c/href</a></iframe><p>Manifest checks for backward compatibility errors described on the HTTP Live Streaming spec and validates required tags attributes. However, it does not report errors that wouldn’t result in playback conflicts. For example, some tags are only available in later HLS versions but when present in earlier versions will simply be ignored by players, as instructed by Apple’s specifications. We recommend you check the <a href="https://tools.ietf.org/html/draft-pantos-http-live-streaming-20">guidelines</a> to get the most out of this library.</p><h4><strong>Ingest + REDspace</strong></h4><p>Ingest is a brand new multimedia encoding/hosting/streaming service developed by REDspace. Together we’re working hard to develop leading-edge technology and produce high quality video streaming distribution. If you’re not familiar with our work, I invite you to learn a bit more about it <a href="https://www.ingest.io/">here</a> and <a href="https://www.redspace.com/">here</a>. We’re always open to chat, suggestions, and inquiries, so don’t hesitate to contact us anytime!</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=13740c9c6b54" width="1" height="1" alt=""><hr><p><a href="https://medium.com/ingest-engineering/open-sourcing-ingests-hls-manifest-parser-13740c9c6b54">OPEN SOURCING INGEST’S HLS MANIFEST PARSER</a> was originally published in <a href="https://medium.com/ingest-engineering">Ingest Engineering</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
    </channel>
</rss>