<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0" xmlns:cc="http://cyber.law.harvard.edu/rss/creativeCommonsRssModule.html">
    <channel>
        <title><![CDATA[Stories by Pratik Wadher on Medium]]></title>
        <description><![CDATA[Stories by Pratik Wadher on Medium]]></description>
        <link>https://medium.com/@pwadher?source=rss-c7a2a6097886------2</link>
        <image>
            <url>https://cdn-images-1.medium.com/fit/c/150/150/1*F0ELEm_soFJBgi9m4Xh_rQ.jpeg</url>
            <title>Stories by Pratik Wadher on Medium</title>
            <link>https://medium.com/@pwadher?source=rss-c7a2a6097886------2</link>
        </image>
        <generator>Medium</generator>
        <lastBuildDate>Thu, 19 Nov 2026 11:50:34 GMT</lastBuildDate>
        <atom:link href="https://medium.com/@pwadher/feed" rel="self" type="application/rss+xml"/>
        <webMaster><![CDATA[yourfriends@medium.com]]></webMaster>
        <atom:link href="http://medium.superfeedr.com/" rel="hub"/>
        <item>
            <title><![CDATA[Intuit Launches Open Source Stream Processing and AIOps Tools for AI-native Development]]></title>
            <link>https://medium.com/intuit-engineering/intuit-launches-open-source-stream-processing-and-aiops-tools-for-ai-native-development-ea49f8963593?source=rss-c7a2a6097886------2</link>
            <guid isPermaLink="false">https://medium.com/p/ea49f8963593</guid>
            <category><![CDATA[generative-ai-tools]]></category>
            <category><![CDATA[cloud-native]]></category>
            <category><![CDATA[open-source]]></category>
            <category><![CDATA[ai]]></category>
            <category><![CDATA[aiops]]></category>
            <dc:creator><![CDATA[Pratik Wadher]]></dc:creator>
            <pubDate>Mon, 06 Nov 2023 15:01:28 GMT</pubDate>
            <atom:updated>2023-11-06T15:01:28.505Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*DAh9X9Xdar1RThkIfqE_2Q.png" /></figure><p>As platform engineering evolves in a data-flooded world, becoming an AI-native platform can only be achieved through the successful use of automation and machine learning at scale. Capturing, processing, and making data useful will require new AI tools on cloud native technologies, and the open source community behind it.</p><p>At Intuit, we support 350 clusters with over 3500 micro services, processing 5 billion events per day for observability and real-time anomaly detection through AIOps. We’re constantly training the ML models that power 65B predictions per day.</p><p>This would never have been possible without adopting cloud native and open source tooling. It also required us to take an approach to building a development platform that provides a simplified experience so that technologists across the organization can focus less on infrastructure and more on application code for customers.</p><p>Our team isn’t just an end user of open source software, we maintain and contribute to many tools. When we have hard problems to solve we look to open source software (OSS) but also build solutions that we believe will help others solve hard problems. That’s why we’re excited to share some new contributions to the cloud native and AIOps community that we believe will drive the next phase of platform engineering on all our collective journeys to becoming an AI-native platform.</p><p>Today we announced the general availability release of <strong>Numaflow 1.0</strong>, a massively parallel, real-time data and stream processing engine, available for Kubernetes and as an ArgoCD extension. <a href="https://bit.ly/numaflowGAblog">Read more product details here</a>.</p><h3><strong>Operational excellence and automation powered by GenAI</strong></h3><p>GenAI is allowing us to create simpler, more powerful user experiences, dramatically improving the productivity of our developers. When the team set out to tackle a growing challenge with the amount of incoming data to decipher critical metrics needed during deployments, we realized the tools available just couldn’t handle the scale. This is where we focused our energy, to create the next generation of tooling with GenAI that enables real-time analytics on Kubernetes.</p><p>Numaflow 1.0 is one part of the <a href="https://numaproj.io/">Numaproj project</a> that includes two products: Numaflow for parallel stream processing and Numalogic for anomaly detection ML models. It’s also completely open source and generally available now.</p><p>Numaflow1.0 also has a metrics plugin for <a href="https://argoproj.github.io/">Argo</a>, another open source project that powers Intuit’s progressive delivery and deployments. These two tools (both created, tested, and open sourced by Intuit teams) together generate a single anomaly score tied to Kubernetes events using live streaming metrics. It enables top tier observability that gives developers the right level of critical data to make fast decisions during deployments. <a href="https://blog.numaproj.io/reduce-alert-fatigue-with-cluster-golden-signals-2e88afc3651b">Read more about that use case here</a>.</p><p>All of this infrastructure is what powers Intuit engineers to deliver app-level experiences that bring the power of GenAI to Intuit customers. Read more about that experience called<a href="https://www.intuit.com/blog/innovative-thinking/introducing-intuit-assist/"> Intuit Assist here</a>.</p><h3><strong>Join Intuit at ArgoCon and KubeCon North America</strong></h3><p>Learn more how Intuit is leveraging AI and platform engineering<a href="https://www.linkedin.com/pulse/kubecon-north-america-2024-intuit-aiops-argo-platform-engineering-z7aoc%3FtrackingId=OvHHUMDNQB6wKe3AvmZ%252B5Q%253D%253D/?trackingId=OvHHUMDNQB6wKe3AvmZ%2B5Q%3D%3D"> in these sessions at ArgoCon and KubeCon</a>.</p><p>You can also<a href="https://www.linkedin.com/showcase/intuitoss"> join our open source community on LinkedIn</a> here where we share updates, best practices, and look forward to conversations with the community!</p><p>Intuit is a two-time recognized End User of the Year by the Cloud Native Computing Foundation. Intuit’s investment in cloud native technologies to provide modern platforming company-wide has driven a 9x increase in development velocity over the last three years and enables Intuit to fuel product innovation at speed and scale for 100 million consumer and small business customers worldwide with <a href="https://turbotax.intuit.com/">TurboTax</a>, <a href="https://www.creditkarma.com/">Credit Karma</a>, <a href="https://quickbooks.intuit.com/">QuickBooks</a>, and <a href="https://mailchimp.com/">Mailchimp</a>. Intuit is the original creator of the <a href="https://www.intuit.com/blog/innovative-thinking/tech-innovation/argo-projects-cncf-graduation/">recently graduated Argo project</a>.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=ea49f8963593" width="1" height="1" alt=""><hr><p><a href="https://medium.com/intuit-engineering/intuit-launches-open-source-stream-processing-and-aiops-tools-for-ai-native-development-ea49f8963593">Intuit Launches Open Source Stream Processing and AIOps Tools for AI-native Development</a> was originally published in <a href="https://medium.com/intuit-engineering">Intuit Engineering</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Improving Development Productivity through AIOps-powered platforms]]></title>
            <link>https://blog.numaproj.io/improving-development-productivity-through-aiops-powered-platforms-ca6be252a13e?source=rss-c7a2a6097886------2</link>
            <guid isPermaLink="false">https://medium.com/p/ca6be252a13e</guid>
            <category><![CDATA[machine-learning]]></category>
            <category><![CDATA[observability]]></category>
            <category><![CDATA[open-source]]></category>
            <category><![CDATA[aiops]]></category>
            <category><![CDATA[data-science]]></category>
            <dc:creator><![CDATA[Pratik Wadher]]></dc:creator>
            <pubDate>Wed, 05 Oct 2022 15:45:23 GMT</pubDate>
            <atom:updated>2022-10-05T15:45:23.454Z</atom:updated>
            <content:encoded><![CDATA[<p>According to recent research on developer velocity for digital-first businesses, the number one driver of business performance is an investment in best-in-class development platforms. Organizations with strong developer tools are 65 percent more innovative, with 47 percent higher developer satisfaction and retention rates. In the past years, the adoption of containers and cloud-native technologies has been proven to accelerate development. In the <a href="https://www.computerweekly.com/news/252518356/Adoption-of-cloud-native-architectures-on-the-rise">past year, one million developers</a> have adopted cloud-native technology making up a global 7.1 million large community.</p><p>But even in this Cloud Native world, with remote work being the new normal, <a href="https://www.eweek.com/big-data-and-analytics/aiops-trends/">over 90% of IT, DevOps, and Site Reliability Engineering professionals</a> reported an increase in service incidents. So, collectively, as an industry, we still have a long way to go to detect and remediate production issues quickly — and ultimately provide abstracted but powerful experiences for developers.</p><p>Over the past four years, Intuit’s investment in cloud-native technologies such as Kubernetes and <a href="https://argoproj.github.io/">Argo</a> has resulted in a 6x increase in development velocity*. This journey began in earnest in early 2018, when <a href="https://www.intuit.com/blog/innovation/welcome-applatix-to-the-intuit-team/">Intuit acquired Applatix</a>, a venture-backed startup focused on cloud-native technologies for enterprises. Then the charter was to build Intuit’s modern development platform to accelerate the value to our customers. Today this is still true, and like many other technology companies, development velocity is a critical pillar driven by AI.</p><p>However, achieving the <em>next 6x increase</em> in development velocity relies on the next evolution in AIOps — building an even smarter platform with simpler user experiences. The key is through the data.</p><h3><strong>From data aggregation to automation to AIOps</strong></h3><p>Like many of you, when we started our AIOps journey, we began collecting and aggregating important log events, metrics, and platform configuration information into an operational data lake (ODL). However, the broad spectrum of data sources to gain an accurate 360 view of our systems was quickly evident as a challenge — it wasn’t possible to ensure a steady flow of quality data.</p><p>The ODL team had to tackle this in a way that enabled other teams to publish and manage their data with transparent governance. Over time, what started as a platform to gather data to improve operational data, became a platform that allowed the teams to derive actionable insights to power automation and faster decision making. AIOps in action!</p><p>To meet that next big 6x development velocity goal, we need to focus on a smarter but simple experience. Our next-generation development platform seeks to enable application teams to focus on specifying high-level requirements for running their applications rather than configuring and managing the underlying infrastructure. In addition, the platform must detect, isolate, remediate, and make itself smarter. But without effectively managing and leveraging real-time data and applying machine learning, we won’t get there.</p><h3><strong>Introducing Numaproj — real-time analytics and AIOps on Kubernetes</strong></h3><p>This brings me to the reason why I’m writing this blog. Today, I am happy to introduce <a href="https://github.com/numaproj/numaproj">Numaproj</a>, a Kubernetes-native collection of open source tools for real-time data analytics and AIOps. The initial tools are:</p><ul><li><a href="https://github.com/numaproj/numaflow">Numaflow</a> — Massively parallel real-time data/stream processing engine with automatic failure recovery, exactly-once semantics, autoscaling, back-pressure, and watermarks. It allows for the easy creation of fire-and-forget pipelines that reliably perform their assigned data processing and analytic tasks until instructed to stop.</li><li><a href="https://github.com/numaproj/numalogic">Numalogic</a> — ML models and algorithms for real-time data analytics and AIOps, including anomaly detection. The current version includes ML models for continuous real-time data enrichment, including anomaly scoring.</li></ul><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*WNddUzG2UY-eyxfUv5gc5g.png" /><figcaption><a href="https://github.com/numaproj/numaproj">Learn more about Numaproj here</a></figcaption></figure><p>Our next-generation development platform enables application teams to focus on specifying high-level requirements for running their applications rather than configuring and managing the underlying infrastructure. Using AIOps to derive real-time, actionable insights from operational data, the platform should be able to quickly detect, isolate and remediate production problems and automatically tune many system parameters that are manually configured by developers and platform engineers today. In short, data is the lifeblood of building a smarter platform.</p><p>If you would like additional details about Numaproj, read the technical <a href="https://medium.com/numaproj/introducing-numaproj-a-kubernetes-native-language-agnostic-real-time-data-analytics-engine-2113626e9153">blog here</a> and watch the demo of Argo Observability powered by Numaproj at the recent <a href="https://www.youtube.com/watch?v=_pRJ0_yzxNs">ArgoCon</a>. We invite you to try Numaproj and look forward to hearing from you!</p><p><em>*Development velocity as measured by the number of production releases per developer per week, and notable improvements in availability and time to detect and resolve production incidents.</em></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=ca6be252a13e" width="1" height="1" alt=""><hr><p><a href="https://blog.numaproj.io/improving-development-productivity-through-aiops-powered-platforms-ca6be252a13e">Improving Development Productivity through AIOps-powered platforms</a> was originally published in <a href="https://blog.numaproj.io/">numaproj</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Numaproj — Driving Dev Velocity with Real-time Analytics, AIOps on Kubernetes]]></title>
            <link>https://medium.com/intuit-engineering/numaproj-driving-dev-velocity-with-real-time-analytics-aiops-on-kubernetes-fba62e00eecf?source=rss-c7a2a6097886------2</link>
            <guid isPermaLink="false">https://medium.com/p/fba62e00eecf</guid>
            <category><![CDATA[aiops]]></category>
            <category><![CDATA[data-science]]></category>
            <category><![CDATA[open-source]]></category>
            <category><![CDATA[observability]]></category>
            <category><![CDATA[machine-learning]]></category>
            <dc:creator><![CDATA[Pratik Wadher]]></dc:creator>
            <pubDate>Wed, 05 Oct 2022 15:44:50 GMT</pubDate>
            <atom:updated>2022-10-05T15:48:42.221Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*PyXEKICKTj5zShWqJV_Vbw.jpeg" /></figure><h3>Numaproj — Driving Dev Velocity with Real-time Analytics, AIOps on Kubernetes</h3><p>The number one driver of business performance for digital-first businesses is investment in best-in-class development platforms, according to a <a href="https://azure.microsoft.com/en-us/solutions/developer-velocity/#key-drivers">recent </a><a href="https://azure.microsoft.com/mediahandler/files/resourcefiles/developer-velocity-how-software-excellence-fuels-business-performance/Developer-Velocity-How-software-excellence-fuels-business-performance-v4.pdf">McKinsey &amp; Company study</a> on developer velocity.</p><p>Over the past four years, Intuit’s investment in cloud-native technologies such as Kubernetes and <a href="https://argoproj.github.io/">Argo</a> to provide modern platforming company-wide has resulted in a 6X increase in development velocity.*</p><p>As the global financial technology platform that makes <a href="https://cts.businesswire.com/ct/CT?id=smartlink&amp;url=https%3A%2F%2Fturbotax.intuit.com%2F&amp;esheet=52904538&amp;newsitemid=20220915005356&amp;lan=en-US&amp;anchor=TurboTax&amp;index=2&amp;md5=466f755f7a84fceb1f25e690c7aad9ad">TurboTax</a>, <a href="https://cts.businesswire.com/ct/CT?id=smartlink&amp;url=https%3A%2F%2Fwww.creditkarma.com%2F&amp;esheet=52904538&amp;newsitemid=20220915005356&amp;lan=en-US&amp;anchor=Credit+Karma&amp;index=3&amp;md5=58a888209ac8617bd37a045ab6e4107d">Credit Karma</a>, <a href="https://cts.businesswire.com/ct/CT?id=smartlink&amp;url=https%3A%2F%2Fquickbooks.intuit.com%2F&amp;esheet=52904538&amp;newsitemid=20220915005356&amp;lan=en-US&amp;anchor=QuickBooks&amp;index=4&amp;md5=d81ae15458472226d3b49d9eef4bd89f">QuickBooks</a>, and <a href="https://cts.businesswire.com/ct/CT?id=smartlink&amp;url=https%3A%2F%2Fmailchimp.com%2F&amp;esheet=52904538&amp;newsitemid=20220915005356&amp;lan=en-US&amp;anchor=Mailchimp&amp;index=5&amp;md5=2d82a5199197f6b5173e80ceeb4b64d9">Mailchimp</a>, we’re proud of our progress to date in fueling product innovation at speed and scale for 100 million consumer and small business customers worldwide.</p><p>However, we recognize that achieving the next 6X increase in development velocity here at Intuit can only happen if we take steps to catalyze the next phase of <a href="https://www.pagerduty.com/blog/aiops-future-of-devops/?utm_source=google&amp;utm_medium=cpc&amp;utm_source_platform=gads&amp;utm_campaign=Global-Tr-FreeTrial-PdSrch-Google&amp;utm_creative_format=dsa-uptimeismoney&amp;utm_content=blogs_dsa-583767035745&amp;utm_term=&amp;matchtype=&amp;network=g&amp;utm_device=c&amp;utm_marketing_tactic=dsa&amp;gclid=Cj0KCQjwkOqZBhDNARIsAACsbfK6ws_AoobPUgg4G_jlIuE7rh4xIIw-Cp_9qr9PZpshjJ54UhyVQd8aAhU0EALw_wcB">AIOps</a> innovation. Building an even smarter platform with a simplified user experience means managing more (and more) data in an actionable way.</p><p>Collectively as an industry, we have a long way to go.</p><p>Even in today’s cloud native world, <a href="https://www.eweek.com/big-data-and-analytics/aiops-trends/">over 90% of IT, DevOps, and Site Reliability Engineering professionals</a> reported an increase in service incidents. An even higher percentage reported that incidents take longer to resolve while working remotely.</p><p>More data, more problems.</p><h3>Driving the next 6X in development velocity through AIOps</h3><p>Next-generation development platforms must enable application teams to focus on specifying high-level requirements for running their applications, rather than configuring and managing the underlying infrastructure.</p><p>Using AIOps to derive real-time, actionable insights from operational data, the platform should be able to quickly detect, isolate and remediate production problems, and automatically tune many system parameters that are manually configured by developers and platform engineers today.</p><h3>Introducing open source project Numaproj!</h3><p>That’s why we’ve built — and open sourced — <a href="https://github.com/numaproj/numaproj">Numaproj</a>, a Kubernetes-native collection of tools for real-time data analytics and AIOps.</p><figure><img alt="Polar bear holding a pie chart" src="https://cdn-images-1.medium.com/max/1024/1*7YUR5PjewcccgGDEOLxUHQ.png" /><figcaption>Numaproj logo</figcaption></figure><p>Numaproj has two initial tools to help with critical areas in your AIOps journey:</p><ul><li><a href="https://github.com/numaproj/numaflow">Numaflow</a> — Massively parallel real-time data/stream processing engine with automatic failure recovery, exactly-once semantics, autoscaling, back-pressure, and watermarks. It allows for easy creation of fire-and-forget pipelines that reliably perform their assigned data processing and analytic tasks until instructed to stop.</li><li><a href="https://github.com/numaproj/numalogic">Numalogic</a> — ML models and algorithms for real-time data analytics and AIOps including anomaly detection. The current version includes ML models for continuous real-time data enrichment including anomaly scoring.</li></ul><p>To learn more about Numaproj, check out this technical blog <a href="https://medium.com/numaproj/introducing-numaproj-a-kubernetes-native-language-agnostic-real-time-data-analytics-engine-2113626e9153">here</a>, head straight to the <a href="https://github.com/numaproj/numaproj">repo</a>, and watch the demo of Argo Observability powered by Numaproj at the recent <a href="https://www.youtube.com/watch?v=_pRJ0_yzxNs">ArgoCon</a>.</p><p><em>*Development velocity as measured by the number of production releases per developer per week as well as notable improvements in availability and time to detect and resolve production incidents.</em></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=fba62e00eecf" width="1" height="1" alt=""><hr><p><a href="https://medium.com/intuit-engineering/numaproj-driving-dev-velocity-with-real-time-analytics-aiops-on-kubernetes-fba62e00eecf">Numaproj — Driving Dev Velocity with Real-time Analytics, AIOps on Kubernetes</a> was originally published in <a href="https://medium.com/intuit-engineering">Intuit Engineering</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Applatix joins Intuit!]]></title>
            <link>https://blog.argoproj.io/applatix-joins-intuit-7ab587270573?source=rss-c7a2a6097886------2</link>
            <guid isPermaLink="false">https://medium.com/p/7ab587270573</guid>
            <category><![CDATA[kubernetes]]></category>
            <category><![CDATA[applatix]]></category>
            <category><![CDATA[intuit]]></category>
            <category><![CDATA[quickbooks]]></category>
            <dc:creator><![CDATA[Pratik Wadher]]></dc:creator>
            <pubDate>Mon, 22 Jan 2018 23:49:10 GMT</pubDate>
            <atom:updated>2018-01-23T01:08:55.605Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*OxJcoktywfWu3WdJ5_bAJg.png" /></figure><p>We are excited to announce that Applatix is joining Intuit!</p><p>Two and a half years ago, we started Applatix with a vision of creating a new type of platform for developing and running applications and services in the public cloud. This vision was borne from our own experience in delivering quality products while continuously scaling the teams, infrastructure, and services. Virtualization and automation were transformative in achieving these goals. Containers and cloud have the potential to provide another quantum leap.</p><p>Applatix’s focus has been to provide the essential building blocks based on containers and public cloud to enable enterprises to quickly and continuously develop and deploy software and services. As the new ecosystem began to evolve, we have embraced and worked with the rapidly growing Kubernetes community, and our enthusiasm for its potential as a core building block in enterprise software deployment has grown immensely.</p><p>Our first contribution to this new ecosystem is <a href="https://github.com/argoproj/argo"><strong>Argo</strong></a>, an open source container-native workflow engine for Kubernetes. You can think of Argo as an engine for feeding and tending a Kubernetes cluster. Argo natively leverages containers and makes it easy to specify, schedule and coordinate the running of complex workflows and applications on Kubernetes. We often think of Argo as a “shell” for your cloud. It puts the computational power of a cloud supercomputer at your fingertips.</p><p>As a part of Intuit, we will continue to pursue our passion to accelerate and transform the delivery of software at massive scale to thousands of developers and millions of customers around the world. We are thankful to our early adopter customers, colleagues, partners, and the community at large for their support and to Intuit for giving us the opportunity to continue our mission and together, power prosperity around the world.</p><p>Hope to see you all at the next KubeCon or at a meetup near you.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=7ab587270573" width="1" height="1" alt=""><hr><p><a href="https://blog.argoproj.io/applatix-joins-intuit-7ab587270573">Applatix joins Intuit!</a> was originally published in <a href="https://blog.argoproj.io/">Argo Project</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Introducing Argo — A Container-Native Workflow Engine for Kubernetes]]></title>
            <link>https://blog.argoproj.io/introducing-argo-a-container-native-workflow-engine-for-kubernetes-55c0b4b76fac?source=rss-c7a2a6097886------2</link>
            <guid isPermaLink="false">https://medium.com/p/55c0b4b76fac</guid>
            <category><![CDATA[kubernetes]]></category>
            <category><![CDATA[containers]]></category>
            <category><![CDATA[docker]]></category>
            <category><![CDATA[pipeline]]></category>
            <category><![CDATA[workflow]]></category>
            <dc:creator><![CDATA[Pratik Wadher]]></dc:creator>
            <pubDate>Thu, 31 Aug 2017 13:37:51 GMT</pubDate>
            <atom:updated>2017-10-06T18:19:43.407Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*yUQOBOdKiOzZkR90TXDlxQ.png" /></figure><p>Today, we are excited to announce the launch of the <a href="https://argoproj.github.io/argo-site/#/">Argo Project,</a> an open source container-native workflow engine for Kubernetes conceived at <a href="https://www.applatix.com/">Applatix</a>.</p><p>The Applatix team is an experienced group of enterprise software engineers from companies like Data Domain (Data Protection), Nicira (SDN), Bebop (Enterprise Development Platform acquired by Google), Apigee (API Platform pioneer acquired by Google) and Tintri (Virtualization) to name a few. These companies provided key infrastructure building blocks to solve fundamental system-level problems for enterprises.</p><p>Having led R&amp;D and Operations teams for close to two decades, one of the challenges I have had to address is to continue delivering quality products while continuously scaling the teams, infrastructure, and services. Virtualization and automation were transformative in achieving these goals. Containers and cloud have the potential to provide another quantum leap.</p><p>The emergence of containers and Kubernetes is driving a major shift in how applications and services will be developed, distributed, and deployed in the future. This will require new approaches to address the same basic system-level problems in monitoring, data protection, and workflow automation to name a few. We founded Applatix to focus on providing similar building blocks for this new ecosystem.</p><p>As we have worked with Kubernetes over the last 2 years, our enthusiasm for its potential as a core building block in enterprise software deployments has grown immensely. At the same time, we discovered that the ecosystem would benefit from the addition of essential elements that we are uniquely qualified to contribute. For example, an integrated workflow engine is fundamental in a distributed system for orchestrating jobs as well as distributing and deploying complex microservices-based applications.</p><p>We can tell you from experience that jobs don’t run themselves! Development teams typically build a framework to serve as a scalable “hopper” to manage the software development lifecycle workflows such as CI/CD, testing, experimentation, and deployments. This motivated us to create a generic container-native workflow engine for Kubernetes that makes it easier to use other services and enable the workflows to do useful work.</p><p><strong>Introducing Argo</strong></p><p>Our first contribution to the Kubernetes ecosystem is Argo, a container-native workflow engine for Kubernetes. You can think of Argo as an engine for feeding and tending a Kubernetes cluster. Argo makes it easy to specify, schedule and coordinate the running of complex workflows and applications on Kubernetes.</p><p>Argo accomplishes this by combining a workflow engine with native artifact management, admission control, “fixtures”, built-in support for DinD (Docker-in-Docker), and policies. There are several uses for Argo workflows including:</p><ul><li>Traditional CI/CD pipelines</li><li>Complex jobs with both sequential and parallel steps and dependencies</li><li>Orchestrating deployments of complex, distributed applications</li><li>Policies to enable time/event-based execution of workflows</li></ul><p><strong>Why a container-native workflow engine?</strong></p><p>Argo is a robust workflow engine for Kubernetes that enables the implementation of each step in a workflow as a container. It provides simple, flexible mechanisms for specifying constraints between the steps in a workflow and artifact management for linking the output of any step as an input to subsequent steps. Integrating artifact management with workflows is critical for achieving portability as well as greater efficiency and simplicity.</p><p>Unlike VMs, containers provide lightweight and reliable packaging of the execution environment and application together into a portable self-contained image. By building workflow steps entirely from containers, the entire workflow itself including all execution of steps as well as interactions between steps are specified and managed as source code.</p><p>While there are many use cases for workflows, one simple example would be a continuous integration (CI) environment to enable fast iteration and innovation. With Argo and Kubernetes, a user not only can create a “pipeline” for building an application, but the pipeline itself can be specified as code and built or upgraded using containers. In other words, you can use CI to manage your CI infrastructure :)</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*33NIfOLwCulfJLRbgOUc_w.png" /><figcaption>A sample Argo workflow</figcaption></figure><p>Another advantage of an integrated container-native workflow management system is that workflows can be defined and managed as code (YAML). With Argo, workflows are not only portable but are also version controlled. A workflow that runs on one Argo system will run exactly the same on another Argo system. Just point your new Argo system to the same source repo and container repository as used by your previous system.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/627/1*0c-LvERnzp7DNyN0_lQeZA.png" /><figcaption>Argo workflow illustrating passing artifacts between steps</figcaption></figure><p>Our goal at Applatix is enable developers and operators to adopt containers and Kubernetes for developing and deploying distributed applications. Argo is being used in the community today by a number of open source projects and enterprises including RocksDB Cloud, Heron, Apache BookKeeper, Apache Pulsar, and AppDynamics.</p><p>Argo is our first step toward advancing the Kubernetes ecosystem and making Kubernetes accessible and more useful to the broader community. We are grateful to the early users who provided invaluable feedback. We invite you to give <a href="https://argoproj.github.io/argo-site/#/get-started/installation">Argo</a> a try and welcome your input.</p><p>We hope that you find it an indispensable and delightful part of your containers and Kubernetes journey. To see our demo at the Kubernetes Community Meeting, please click <a href="https://blog.argoproj.io/argo-workflow-demo-at-the-kubernetes-community-meeting-c428c3c93f9d">here</a>.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=55c0b4b76fac" width="1" height="1" alt=""><hr><p><a href="https://blog.argoproj.io/introducing-argo-a-container-native-workflow-engine-for-kubernetes-55c0b4b76fac">Introducing Argo — A Container-Native Workflow Engine for Kubernetes</a> was originally published in <a href="https://blog.argoproj.io/">Argo Project</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
    </channel>
</rss>