<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0" xmlns:cc="http://cyber.law.harvard.edu/rss/creativeCommonsRssModule.html">
    <channel>
        <title><![CDATA[Stories by Vanessa Wang on Medium]]></title>
        <description><![CDATA[Stories by Vanessa Wang on Medium]]></description>
        <link>https://medium.com/@vjwang?source=rss-b76d4a053579------2</link>
        <image>
            <url>https://cdn-images-1.medium.com/fit/c/150/150/1*Fi8ybNqIdEcdxjk8zv_QTw.jpeg</url>
            <title>Stories by Vanessa Wang on Medium</title>
            <link>https://medium.com/@vjwang?source=rss-b76d4a053579------2</link>
        </image>
        <generator>Medium</generator>
        <lastBuildDate>Fri, 20 Nov 2026 03:16:56 GMT</lastBuildDate>
        <atom:link href="https://medium.com/@vjwang/feed" rel="self" type="application/rss+xml"/>
        <webMaster><![CDATA[yourfriends@medium.com]]></webMaster>
        <atom:link href="http://medium.superfeedr.com/" rel="hub"/>
        <item>
            <title><![CDATA[7 (More) Free Awesome Apache Kafka Resources for Beginners — 2024]]></title>
            <link>https://medium.com/confluent/7-more-free-awesome-apache-kafka-resources-for-beginners-2024-6f7581e9a613?source=rss-b76d4a053579------2</link>
            <guid isPermaLink="false">https://medium.com/p/6f7581e9a613</guid>
            <category><![CDATA[apache-kafka]]></category>
            <category><![CDATA[confluent]]></category>
            <category><![CDATA[data-streaming]]></category>
            <category><![CDATA[data-stream-processing]]></category>
            <dc:creator><![CDATA[Vanessa Wang]]></dc:creator>
            <pubDate>Wed, 22 May 2024 19:35:16 GMT</pubDate>
            <atom:updated>2024-06-26T16:57:16.053Z</atom:updated>
            <content:encoded><![CDATA[<h3>7 (More) Free Awesome Apache Kafka Resources for Beginners — 2024</h3><p><em>co-authored with </em><a href="https://medium.com/u/386f721bfa65"><em>Peter Moskovits</em></a></p><p>If you haven’t read it yet, be sure to check out our <a href="https://www.confluent.io/blog/best-kafka-tutorials-examples-and-learning-resources"><em>Top 7 Free Apache Kafka Learning Resources for Beginners in 2023</em></a> blog post.</p><p>In the second part of our series, we’ve compiled a list of resources that dive deeper into the world of Apache Kafka®, which we found helpful after building a foundation through the resources we shared in part one. This time, we’re focusing on material that takes us into essential and more advanced Kafka fundamentals. Understanding concepts like setting up schemas and using Kafka Connect will help you build durable and scalable data streaming applications, and it’s important to understand these early on, so that you set up your application for success. Later, we’ll check out ksqlDB and learn more concepts that are essential to building an application, including using the CLI and addressing common issues like maintaining the order of messages, preventing message duplication, and handling multiple event types in a topic.</p><p>As always, we found that the best way to learn was to watch the videos, then go through the hands-on exercises — we encourage you to do the same.</p><p>Seeing the keen interest in educational content on Kafka, we’ve also created a GitHub repo with an extensive list (60+ and counting) of <a href="https://github.com/pmoskovi/kafka-learning-resources">curated Kafka learning resources</a>. This collection encompasses a wide range of materials organized by and suited to different learning styles and skill levels. From in-depth guides and documentation to interactive courses and tutorials, all the way to articles and books, we’ve gathered resources to cater to a broad range of learners. If you have a resource that could benefit others in their understanding of Apache Kafka, we encourage you to contribute; information is in the repo on how to do so.</p><p>Ready to take your Kafka knowledge to the next level? Let’s get right to it!</p><p>The list of resources (at a glance):</p><ol><li>Schema Registry 101 (12 video modules)</li><li><a href="https://www.youtube.com/playlist?list=PLa7VYi0yPIH0uIC2F0M1_FsVUsx8j3ekm">Kafka Connect 101</a> (15 video modules)</li><li><a href="https://www.youtube.com/playlist?list=PLa7VYi0yPIH3ulxsOf5g43_QiB-HOg5_Y">ksqlDB 101</a> (29 video modules)</li><li><a href="https://developer.confluent.io/tutorials/kafka-console-consumer-producer-basics/kafka.html">What is the simplest way to write messages to and read messages from Kafka using CLI?</a></li><li><a href="https://developer.confluent.io/tutorials/message-ordering/kafka.html">How can I maintain the order of messages and prevent message duplication in a Kafka topic partition?</a></li><li><a href="https://developer.confluent.io/tutorials/multiple-event-type-topics/kafka.html">How can I have multiple event types in a topic and maintain topic-name subject constraints?</a></li><li><a href="https://developer.confluent.io/tutorials/creating-first-apache-kafka-streams-application/kstreams.html">How do I get started building my first Kafka Streams application?</a></li></ol><h3><strong>1. Schema Registry 101</strong></h3><p><a href="https://www.youtube.com/playlist?list=PLa7VYi0yPIH1KE10jwqmFEM61krd9WXQV">YouTube Playlist (12)</a> | <a href="https://developer.confluent.io/courses/schema-registry/connect-clients-to-confluent-cloud-hands-on">Hands-on exercises with videos &amp; written instructions (4)</a></p><p>Once you’ve learned how to build and deploy your first Kafka application, a natural next step is learning about the importance of schemas. Implementing schemas over your data is essential for any enduring event streaming system, particularly ones that share data between different microservices or teams. Schemas enforce the implied contract between applications that produce your data and downstream applications that consume your data. In this engaging course with Danica Fine, you can learn how to use schemas to establish this contract. The course includes several hands-on exercises that let you experience working with schemas.</p><figure><img alt="Screenshot of a person presenting a hand-on exercise for Schema Registry in Apache Kafka" src="https://cdn-images-1.medium.com/max/1024/0*7mHWXTQS3HzFL7CF" /></figure><h3><strong>2. Kafka Connect 101</strong></h3><p><a href="https://www.youtube.com/playlist?list=PLa7VYi0yPIH0uIC2F0M1_FsVUsx8j3ekm">YouTube Playlist (15)</a> | <a href="https://developer.confluent.io/courses/kafka-connect/how-to-generate-data-hands-on/">Hands-on exercises with videos &amp; written instructions (5)</a></p><p>Kafka Connect is a free, open-source component of Apache Kafka that serves as a centralized data hub for simple data integration between databases, key-value stores, search indexes, and file systems.1 Take this video class to learn about the architecture, deployment modes, and differences between fully managed and self-managed connectors. Additionally, you can also learn how to run a Connect cluster in Docker and manage connector instances using Confluent Connect API, Confluent CLI, and Kafka Connect REST API, enabling you to focus on application development and less on the tools.</p><figure><img alt="A diagram showing Confluent Cloud with a Kafka cluster inside of it, connecting bidrectionally with a self-managed connect cluster that has two workers, each with a connector. The worker on the left has source systems with an arrow pointing to its connector. The worker on the right has an arrow pointing from its connector to target systems. the self-managed connect cluster has a bidirectional connection with a second Kafka cluster." src="https://cdn-images-1.medium.com/max/1024/0*te39ntnmqJvjDTJt" /></figure><p>From Confluent’s <a href="https://docs.confluent.io/platform/current/connect/index.html">documentation</a> on Kafka Connect, which is also super helpful as you navigate this component.</p><h3>3. ksqlDB 101</h3><p><a href="https://www.youtube.com/playlist?list=PLa7VYi0yPIH3ulxsOf5g43_QiB-HOg5_Y">YouTube Playlist (29)</a> | <a href="https://developer.confluent.io/courses/ksqldb/hands-on-interacting-with-ksqldb/">Hands-on exercises with videos &amp; written instructions (11)</a></p><p>ksqlDB has emerged as part of the Apache Kafka ecosystem as <em>the</em> best way to process streams of events. This is a great course to take after you’ve learned Kafka Connect, as ksqlDB interacts with Kafka Connect, and you’ll be able to integrate your ksqlDB applications with Kafka Connect to use the same SQL syntax. If you’ve taken Apache Kafka 101 (which we suggested in part 1 of this blog series), you were introduced to ksqLDB ( <a href="https://developer.confluent.io/courses/apache-kafka/ksqldb/">Apache Kafka 101 &gt; ksqlDB</a> video and the accompanying <a href="https://developer.confluent.io/courses/apache-kafka/ksqldb-hands-on/">ksqlDB hands-on exercise</a>.. ksqlDB 101 gives a complete overview of ksqlDB, how it works, and how to use it — and in fact is hands down the best comprehensive resource on ksqlDB. Topics covered in this course include how to filter and transform data streams, how to query tables and streams with pull and push queries, and how to understand the difference between a stream and a table. You can also learn common utility functions like flattening out nested records, changing serialization formats, and merging and splitting streams.</p><p>Try this out yourself by following the step-by-step exercises.</p><h3>4. What is the simplest way to write messages to and read messages from Kafka Using CLI?</h3><p><a href="https://developer.confluent.io/tutorials/kafka-console-consumer-producer-basics/confluent.html">Tutorial — Hosted Cloud Environment</a> | <a href="https://developer.confluent.io/tutorials/kafka-console-consumer-producer-basics/kafka.html">Tutorial — Basic Kafka</a></p><p>Building on your foundational knowledge of Kafka Connect, ksqlDB, and the critical role of the Schema Registry, our next tutorial is a logical and essential progression. This tutorial is specifically designed for you if you’re looking to deepen your understanding of Kafka without the complexity of writing any code. By focusing on using the command line interface (CLI), you will gain practical skills in producing and consuming messages. This skill comes also handy when troubleshooting, performing quick data manipulation, and understanding the basics of real-time message flow.</p><figure><img alt="screenshot of a producer with sample code “confluent kafka topic produce orderes — parse-key” and a consumer with sample code “confluent kafka topic consume orders — print-key — delimiter “-” — from-beginning”." src="https://cdn-images-1.medium.com/max/1024/0*bUuC67ur1toVK9XX" /></figure><h3>5. How can I maintain the order of messages and prevent message duplication in a Kafka topic partition?</h3><p><a href="https://developer.confluent.io/tutorials/message-ordering/kafka.html">Tutorial — Basic Kafka</a></p><p>Diving deeper into the intricacies of Apache Kafka, this tutorial addresses a key concern in managing data stream: ensuring message order and avoiding duplication. If data integrity and sequencing are critical to your application, this tutorial is for you. By enabling idempotency in your Kafka producer, behind the scenes, a unique ID is assigned to each producer, and sequence IDs are tagged onto each message. Understanding and implementing this technique is crucial for maintaining the integrity and reliability of your streams, ensuring that your Kafka applications run reliably. This tutorial is a great resource for anyone looking to enhance their Kafka expertise, particularly in scenarios where data consistency and order are critical.</p><figure><img alt="Screenshot that says Short Answer. “Set the ProducerConfig configuration examples relevant to the idempotent producer: enable.idempotence=true acks=all”" src="https://cdn-images-1.medium.com/max/1024/0*rh0yDzgA1XRTEnYV" /></figure><h3>6. How can I have multiple event types in a topic and maintain topic-name subject constraints?</h3><p><a href="https://developer.confluent.io/tutorials/multiple-event-type-topics/confluent.html">Tutorial — Hosted Cloud Environment</a> | <a href="https://developer.confluent.io/tutorials/multiple-event-type-topics/kafka.html">Tutorial — Basic Kafka</a></p><p>You have distinct but related event types and you want to produce them to the same topic, but you also want to maintain topic-name subject constraints. Why produce different events to the same topic? One reason would be you have low-traffic topics and you’d like to consolidate them to reduce overhead for the brokers. Or you need to get the exact order of different events and by producing them to the same topic you are guaranteed correct ordering per-partition.</p><p>To do multiple events with topic-name constraints you’ll need to use schema references, which is a schema that contains a field representing an object which is reference to another schema. Follow along this tutorial to learn about using schema references with both Protobuf and Avro.</p><figure><img alt="Screenshot from the tutorial showing an event application" src="https://cdn-images-1.medium.com/max/1024/0*-PdFxvtm9gWdZDXp" /></figure><h3>7. How do I get started building my first Kafka Streams application?</h3><p><a href="https://developer.confluent.io/tutorials/creating-first-apache-kafka-streams-application/confluent.html">Tutorial — Hosted Cloud Environment</a> | <a href="https://developer.confluent.io/tutorials/creating-first-apache-kafka-streams-application/kstreams.html">Tutorial — Basic Kafka</a></p><p>Embarking on your journey with Kafka Streams can be an exciting yet daunting task. This tutorial is crafted to set you on the right path. It is ideal for beginners, providing a straightforward, step-by-step guide to building a basic stream processing application. By the end of this step-by-step guide, you will have not only developed your first Kafka Streams application but also gained the skills needed to delve even deeper into real-time data processing applications.</p><p>You’d like to get started with Kafka Streams, but you’re not sure where to start. In this tutorial, you’ll build a small stream processing application and produce some sample data to test it. After you complete this tutorial, you can go more in-depth in the <a href="https://docs.google.com/document/d/1PCikM0f7HX7137eNxbGLnCCMWSeS2T7kL6tFagiJcXc/edit#heading=h.pzyhw7qghuk6">Kafka Streams 101</a> course.</p><figure><img alt="screenshot of a stream processing topology defining business logic from the tutorial" src="https://cdn-images-1.medium.com/max/1024/0*jygdGxB8hL33gi2-" /></figure><p>We hope these resources help you continue your journey with Apache Kafka. Don’t forget to check out Confluent’s <a href="https://www.confluent.io/community/ask-the-community/">community Slack and forum</a> to get help if you run into any issues while learning and building, as well as to meet others who are learning Kafka.</p><p>As always, your feedback is encouraged. Did you find these resources helpful? Are there other topics you’d like to see included? Let us know!</p><p><em>The views expressed in this article are those of the author and do not necessarily reflect the position of Confluent.</em></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=6f7581e9a613" width="1" height="1" alt=""><hr><p><a href="https://medium.com/confluent/7-more-free-awesome-apache-kafka-resources-for-beginners-2024-6f7581e9a613">7 (More) Free Awesome Apache Kafka Resources for Beginners — 2024</a> was originally published in <a href="https://medium.com/confluent">Confluent</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[That Time I Co-Organized a 16,000-Member Tech Meetup]]></title>
            <link>https://medium.com/@vjwang/that-time-i-co-organized-a-16-000-member-tech-meetup-6ed7aec433f8?source=rss-b76d4a053579------2</link>
            <guid isPermaLink="false">https://medium.com/p/6ed7aec433f8</guid>
            <category><![CDATA[tech]]></category>
            <category><![CDATA[community]]></category>
            <category><![CDATA[html5]]></category>
            <category><![CDATA[diversity]]></category>
            <category><![CDATA[inclusion]]></category>
            <dc:creator><![CDATA[Vanessa Wang]]></dc:creator>
            <pubDate>Fri, 23 Mar 2018 22:09:15 GMT</pubDate>
            <atom:updated>2018-03-23T22:18:53.634Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*bz6GOeYEpVHv5G6-." /><figcaption><a href="https://twitter.com/vjwang">Myself</a>,<a href="https://twitter.com/rachelnabors"> Rachel Nabors</a>, and co-organizer<a href="https://twitter.com/peterlubbers"> Peter Lubbers</a> at the<a href="https://www.meetup.com/sfhtml5/events/219966671/"> SFHTML5 5th Anniversary, <em>State of Animation</em> Event</a>. Photo courtesy of SFHTML5.</figcaption></figure><p>For eight years, I co-organized<a href="http://sfhtml5.org/"> one of the biggest tech Meetups</a> in the world. Today is my last day; the group will continue its monthly events under the direction of my co-organizer, Peter Lubbers.</p><p>In the tech space, it’s easy to slide into a pattern that doesn’t exactly embrace diversity and inclusion, defaulting to male speakers and throwing events that don’t work well for working families. With no small amount of effort, we did a pretty good job at making a more inclusive Meetup, and I thought I’d share some of what Peter and I did, in hopes that other organizers will find it useful. It’s by no means a complete list.</p><p><strong>Women Speakers</strong>: We reached 50% women speakers in a not particularly female-oriented space. It wasn’t easy. I researched topics, attended many different conferences, watched videos, read blogs, and spoke with other organizers about how to feature more women speakers. I also looked at experts in the field on Twitter, and then tracked whom they were following (and their interactions) to specifically seek female voices.</p><p><strong>Recordings</strong>: For almost every event, someone asks if the talks will be recorded because they can’t attend in person, but want to hear the speaker(s). We’re a local Meetup, and we like to think globally. Starting with our first event in 2010, <a href="http://bit.ly/sfhtml5videos">every talk was recorded</a> (with over 2M views in total). It was an expensive endeavor, but we made it a priority to get sponsorship to scale the content and make it accessible.</p><iframe src="https://cdn.embedly.com/widgets/media.html?src=https%3A%2F%2Fwww.youtube.com%2Fembed%2Fvideoseries%3Flist%3DUUyupHmJVuUGpCMzemHYnUqQ&amp;url=http%3A%2F%2Fwww.youtube.com%2Fwatch%3Fv%3DhJhtK9yh7Vg&amp;image=https%3A%2F%2Fi.ytimg.com%2Fvi%2FhJhtK9yh7Vg%2Fhqdefault.jpg&amp;key=a19fcc184b9711e1b4764040d3dc5c07&amp;type=text%2Fhtml&amp;schema=youtube" width="854" height="480" frameborder="0" scrolling="no"><a href="https://medium.com/media/28a7147817be6cd66e046f7500fd4181/href">https://medium.com/media/28a7147817be6cd66e046f7500fd4181/href</a></iframe><p><strong>Lightning Talks</strong>: We include short, 2–5 minute talks at each event to help give an audience to new voices and technologies. This is a great way for us to discover future speakers, and also for newer speakers to get some experience presenting in front of a large audience.</p><p><strong>Childcare</strong>: We offer childcare, though our community generally does not need nor take advantage of it. However, we feel it is important to provide this option for working parents who want to be a part of our community.</p><p><strong>Code of Conduct</strong>: We have a <a href="https://www.meetup.com/sfhtml5/pages/11188962/SFHTML5_Code_of_Conduct/">code of conduct</a> with a zero tolerance policy for harassment, which we instituted and enforced from the group’s inception. This is <a href="https://www.ashedryden.com/blog/codes-of-conduct-101-faq">a conference must-have</a>.</p><p><strong>Special Meals</strong>: Many conferences have vegetarian food, but we also make sure to provide gluten-free and vegan options. We established these requirements with a regular caterer who was able to ramp up and prepare for them, knowing we’ll require them at every event.</p><p><strong>Non-Alcoholic Cocktails</strong>: A fair portion of our members doesn’t drink alcohol for a variety of reasons. I require from our<a href="http://www.alcademics.com/"> cocktail provider</a> that an equally tasty and beautiful non-alcoholic option is always available, so that no one feels left out, nor pressured to consume alcohol.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*rNPcvouCgTG2d73w." /><figcaption>Camper English from<a href="http://www.alcademics.com/"> Alcademics</a> preparing a specialty cocktail. Photo courtesy of SFHTML5.</figcaption></figure><p><strong>Support for Local Businesses and Artists</strong>: All the vendors that help us, from the people who handle the <a href="http://argushd.com/">recordings</a> to <a href="http://www.grantedwines.com/">wine tasting</a>, are all local to the area. For our speaker gift, I worked with San Francisco-based<a href="http://www.lunarienne.com/"> Luna Rienne Gallery</a> to commission a painting by<a href="http://ursulayoung.com/"> Ursula X. Young</a>, and we give signed, framed prints to all our speakers. I wanted our speakers to have a gift that reflects not just our tech Meetup, but also the community where the events are held.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*WT3MiF5EdPw9_Q97." /><figcaption><a href="https://twitter.com/amberroyVR"><em>Amber Roy</em></a><em> and</em><a href="https://twitter.com/misslivirose"><em> Liv Erickson</em></a><em> holding our custom art prints at the</em><a href="https://www.meetup.com/sfhtml5/events/230072340/"><em> SFHTML5/SFWebVR: WebVR Ecosystem and API Update Event</em></a><em> (in collaboration with</em><a href="https://twitter.com/auradeluxe"><em> Tony Parisi</em></a><em>). Photo courtesy of SFHTML5.</em></figcaption></figure><p><strong>Volunteer Day</strong>: I organized an annual volunteer day to help the group give back to the San Francisco community, which had the added benefit of being a fun day for the group, and a chance for members to get to know each other outside of the Meetup. Many members who attended had never volunteered before. After our first year, some members even asked far in advance for the next one so that they could plan to attend it.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*grX1fgG24qg1MbxB." /><figcaption><em>One of my favorite events: the annual</em><a href="https://www.meetup.com/sfhtml5/events/233631395/"><em> Volunteer Day</em></a><em> at the</em><a href="https://www.sfmfoodbank.org/"><em> San Francisco-Marin Food Bank</em></a><em>. Photo courtesy of SFHTML5.</em></figcaption></figure><p>So, why am I leaving? Peter and I started this Meetup in my spare time while I was working full time as a technical writer. Thanks in no small part to what I learned co-organizing this Meetup, I now have an awesome full-time job working in Developer Relations. I haven’t stopped trying to imbue tech events with inclusivity and local values — I am now able to do it on a larger scale. <a href="https://www.meetup.com/sfhtml5/">The Meetup is still going strong</a>.</p><p>I haven’t given up volunteer work, either. In addition to my job in Developer Relations, I’m excited to devote my time and energy to Code for Good Week, a program I started in 2015, which is dedicated to connecting volunteers with civic open source software projects. More details about this year’s events will be announced soon<a href="https://twitter.com/codeforgoodweek"> @codeforgoodweek</a>.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=6ed7aec433f8" width="1" height="1" alt="">]]></content:encoded>
        </item>
    </channel>
</rss>