<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0" xmlns:cc="http://cyber.law.harvard.edu/rss/creativeCommonsRssModule.html">
    <channel>
        <title><![CDATA[Stories by Alex Boardman on Medium]]></title>
        <description><![CDATA[Stories by Alex Boardman on Medium]]></description>
        <link>https://medium.com/@boardman1989?source=rss-aa8a71a6005b------2</link>
        <image>
            <url>https://cdn-images-1.medium.com/fit/c/150/150/0*SEHGPL15miqOx9sp</url>
            <title>Stories by Alex Boardman on Medium</title>
            <link>https://medium.com/@boardman1989?source=rss-aa8a71a6005b------2</link>
        </image>
        <generator>Medium</generator>
        <lastBuildDate>Wed, 18 Nov 2026 01:05:16 GMT</lastBuildDate>
        <atom:link href="https://medium.com/@boardman1989/feed" rel="self" type="application/rss+xml"/>
        <webMaster><![CDATA[yourfriends@medium.com]]></webMaster>
        <atom:link href="http://medium.superfeedr.com/" rel="hub"/>
        <item>
            <title><![CDATA[Embracing the AI Journey: Why I’m Documenting My Exploration of AI]]></title>
            <link>https://medium.com/@boardman1989/embracing-the-ai-journey-why-im-documenting-my-exploration-of-ai-34918b40bc59?source=rss-aa8a71a6005b------2</link>
            <guid isPermaLink="false">https://medium.com/p/34918b40bc59</guid>
            <category><![CDATA[business]]></category>
            <category><![CDATA[artificial-intelligence]]></category>
            <category><![CDATA[ai]]></category>
            <category><![CDATA[learning]]></category>
            <category><![CDATA[aws]]></category>
            <dc:creator><![CDATA[Alex Boardman]]></dc:creator>
            <pubDate>Tue, 18 Mar 2025 19:12:02 GMT</pubDate>
            <atom:updated>2025-03-18T19:12:02.509Z</atom:updated>
            <content:encoded><![CDATA[<p>I’ll admit – putting this out there makes me a little nervous.</p><p>For a long time, I’ve been fascinated by AI. I work in AI and AWS, helping businesses navigate cloud technology and optimize their infrastructure. But the rapid pace of AI development has made me realize that staying on top of this transformation isn’t just an advantage – it’s a necessity.</p><p>That’s why I’ve decided to take a more hands-on approach. Instead of just reading about AI advancements, I want to actively explore them, test AI tools, share insights, and document my learning process in a way that helps others stay informed too.</p><p>And so, my AI Journey begins.</p><p>⸻</p><p><strong>The 100 AI Videos in a Year Challenge</strong></p><p>To truly immerse myself in the AI space, I’ve set an ambitious goal: to create 100 AI-focused videos in 1 year (roughly 2 per week). The idea is simple – by committing to this challenge, I’ll not only deepen my own understanding but also help others navigate the rapidly evolving AI landscape.</p><p>Through these videos, I plan to:</p><p>✅ Explore AI tools – Reviewing productivity-enhancing AI, automation tools, and industry-specific applications.</p><p>✅ Share insights on AI’s business impact – How AI is changing industries, workflows, and the way we work.</p><p>✅ Demystify AI for professionals – Making AI accessible for people who aren’t technical experts but want to use it effectively.</p><p>✅ Stay accountable – By publicly committing to this project, I’m holding myself to consistency, even when doubts creep in.</p><p>At the core of this challenge is a simple principle: Learning by doing.</p><p>I’m not here to just talk about AI – I want to experience it, test its capabilities, and see firsthand how it’s changing the way we work and think.</p><p>⸻</p><p><strong>Why I’m Nervous About Posting This (And Why I’m Doing It Anyway)</strong></p><p>Despite my excitement, I’ve hesitated to share this publicly.</p><p>Let’s take LinkedIn for example. LinkedIn is my professional network, and I have a full-time job. There’s always that nagging thought – What will people think? Will they wonder why I’m making videos while working a full-time job?</p><p>But then I realized: AI is directly relevant to my work. The content I’m creating isn’t a distraction – it’s an extension of my expertise. It’s a way to stay ahead, build deeper knowledge, and provide value to others.</p><p>So instead of worrying about what people might think, I’m choosing to focus on the opportunity this project brings:</p><p>✔️ Sharpening my expertise in AI and cloud technology.</p><p>✔️ Engaging in meaningful conversations about AI with other professionals.</p><p>✔️ Building something that could grow into a long-term platform.</p><p>If there’s one thing I’ve learned from working in tech, it’s that those who stay curious and take action will always be ahead of the curve.</p><p>⸻</p><p><strong>What’s Next &amp; How You Can Join Me</strong></p><p>I’ve already created my first two videos, and I’m learning a lot along the way. For example, I initially thought my Synthesia avatar would be a great fit for AI-generated videos, but after testing it, I realized there are better ways to use the platform effectively. Every video is a lesson in how to create, improve, and refine the process.</p><p>Over the next year, I’ll be diving deeper into AI tools, industry shifts, and the practical ways AI is being used to boost productivity and innovation.</p><p>If you’re interested in AI and its impact on business, I’d love for you to join me on this journey. Follow along, share your thoughts, and let’s explore the future of AI together.</p><p>💡 What’s the most exciting AI tool or trend you’ve come across recently? Let me know in the comments – I’d love to hear your perspective!</p><p>⸻</p><p>Follow My AI Journey</p><p>📺 YouTube Channel (where I post my AI videos): <a href="https://youtube.com/@ai_journey_future?si=_C0h2YU3Wv4JgUPH">https://youtube.com/@ai_journey_future</a></p><p>💼 LinkedIn (where I share insights &amp; discussions): <a href="https://www.linkedin.com/in/alexboardman?utm_source=share&amp;utm_campaign=share_via&amp;utm_content=profile&amp;utm_medium=ios_app">https://www.linkedin.com/in/alexboardman</a></p><p>#AI #ArtificialIntelligence #MachineLearning #Tech #Productivity #Innovation #ContentCreation #AIJourney</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=34918b40bc59" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Fine-Tuning Large Language Models with AWS SageMaker and API Gateway]]></title>
            <link>https://medium.com/@boardman1989/fine-tuning-large-language-models-with-aws-sagemaker-and-api-gateway-2b776a1cf1ee?source=rss-aa8a71a6005b------2</link>
            <guid isPermaLink="false">https://medium.com/p/2b776a1cf1ee</guid>
            <category><![CDATA[api-gateway]]></category>
            <category><![CDATA[aws]]></category>
            <category><![CDATA[fine-tuning]]></category>
            <category><![CDATA[sagemaker]]></category>
            <category><![CDATA[llm]]></category>
            <dc:creator><![CDATA[Alex Boardman]]></dc:creator>
            <pubDate>Mon, 23 Sep 2024 10:44:21 GMT</pubDate>
            <atom:updated>2024-09-23T10:44:21.992Z</atom:updated>
            <content:encoded><![CDATA[<p>In this exercise, I explored a comprehensive workflow for <strong>fine-tuning large language models (LLMs)</strong> using <strong>Amazon SageMaker</strong> and deploying them through <strong>AWS Lambda</strong> and <strong>API Gateway</strong>. This setup allows developers to fine-tune pre-trained models, evaluate their biases, and integrate them into scalable web applications with ease.</p><p>This blog post will guide you through the key concepts and steps involved in fine-tuning large language models within the AWS ecosystem, focusing on how SageMaker facilitates the training and deployment process. Additionally, we will explore how <strong>AWS Lambda</strong> and <strong>API Gateway</strong> serve as critical components for connecting these models to external applications.</p><p>This was a GenAI CloudQuest Project. For more info about CloudQuest check this out : <a href="https://aws.amazon.com/training/digital/aws-cloud-quest/">https://aws.amazon.com/training/digital/aws-cloud-quest/</a></p><p>For a Youtube Walkthrough, check out this video : <a href="https://www.youtube.com/watch?v=nEf9db_1b-U">https://www.youtube.com/watch?v=nEf9db_1b-U</a></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*HReS82RLtpBTyhmd" /></figure><h3>1. Evaluating Pre-trained Models for Bias</h3><p>The first step in the exercise involved evaluating a pre-trained <strong>LLM</strong> for gender bias and performance. The <strong>Jupyter notebook</strong> instance within Amazon SageMaker was used to load and run the model, enabling us to assess its biases and performance. This is crucial for ensuring that the model operates in a fair and unbiased manner before any further fine-tuning is performed.</p><p>Using pre-trained models allows developers to leverage existing knowledge encoded in the model while adapting it to specific data. By evaluating the model upfront, we can identify areas where biases may exist and decide how to adjust the model’s training process to mitigate them.</p><h3>2. Setting Up the SageMaker Notebook for Fine-tuning</h3><p>A key part of the process is setting up an <strong>Amazon SageMaker notebook instance</strong>, which serves as the machine learning environment where fine-tuning takes place. The notebook, which runs the <strong>Jupyter Notebook app</strong>, allows developers to import the necessary libraries and tools needed for model fine-tuning.</p><p>In this case, we loaded a dataset of inclusive pronouns to correct for gender bias and ensure the model is more inclusive in its outputs. The SageMaker notebook provides a seamless environment for importing and preprocessing data, enabling us to transform and prepare the dataset for training the model.</p><h3>3. Loading the Pre-trained Model into the Notebook</h3><p>With the notebook environment in place, the next step was to load the pre-trained model. This involves selecting an <strong>LLM</strong> from the available pre-trained models in SageMaker. The model is then ready for fine-tuning using the dataset prepared in the previous step.</p><p>Fine-tuning the model involves adjusting its weights and parameters so it can better handle specific tasks or data, without needing to train the entire model from scratch. This is particularly useful for developers who want to adapt general-purpose models to specialized tasks, such as improving inclusivity or domain-specific outputs.</p><h3>4. Deploying the Fine-Tuned Model to SageMaker Endpoint</h3><p>Once the model has been fine-tuned to meet the desired specifications — such as correcting for gender bias — it is deployed to a <strong>SageMaker endpoint</strong>. This endpoint acts as a scalable web service that allows external applications to interact with the model. By deploying the model in this way, developers can facilitate real-time inferencing and enable prediction requests from applications.</p><p>Additionally, all the model artifacts (such as the trained model, datasets, and logs) are stored in an <strong>Amazon S3 bucket</strong>, ensuring that the data is readily available for future reference, updates, or redeployments.</p><h3>5. Using AWS Lambda for Model Interaction</h3><p>To streamline the interaction between external applications and the deployed model, we wrote an <strong>AWS Lambda function</strong>. This function serves as an intermediary, handling the input and output formats and managing communication between <strong>Amazon API Gateway</strong> and the SageMaker endpoint.</p><p>This Lambda function is particularly important for providing a seamless, serverless interaction with the model. By offloading the request-handling process to Lambda, we reduce the complexity of building out custom server infrastructure, and instead rely on AWS’s managed services for scalability and reliability.</p><h3>6. Configuring API Gateway to Expose the Model</h3><p><strong>API Gateway</strong> was configured to create a <strong>RESTful API</strong> that allows external applications to interact with the SageMaker model via the Lambda function. This API provides secure access to the model’s inferencing capabilities and exposes the fine-tuned model to web or mobile applications.</p><p>With API Gateway in place, the model can be accessed securely by external clients, making it easy to integrate the AI-driven functionality into existing or new applications. This is particularly useful for applications that need to make real-time predictions based on user input.</p><h3>7. Developing a Web Interface for User Interaction</h3><p>To allow end-users to interact with the LLM, a <strong>web application</strong> was developed and hosted on an Amazon S3 bucket. This application acts as a user-friendly interface where users can input text or data and receive responses from the fine-tuned model.</p><p>By using <strong>Amazon S3</strong> for hosting, we can ensure that the application is both scalable and cost-effective, particularly since S3 supports static website hosting. This provides a lightweight way to deliver the application to users across the globe without needing to manage servers.</p><h3>8. Optimizing Application Delivery with Amazon CloudFront</h3><p>For faster and more secure content delivery, we established an <strong>Amazon CloudFront</strong> distribution. <strong>CloudFront</strong> acts as a content delivery network (CDN), ensuring that the web application hosted on S3 is served to users with minimal latency, no matter their location.</p><p>This step ensures that the application’s performance remains optimized, even as the user base scales. By caching content closer to end-users, CloudFront significantly improves the loading speed and responsiveness of the web app.</p><h3>9. Seamless Communication Between User Interface and Model</h3><p>Once the web application was in place, we embedded API Gateway calls within the application’s code. This enables the app to communicate directly with the deployed SageMaker model via the Lambda function, allowing users to send requests and receive responses from the fine-tuned LLM.</p><p>The seamless communication between the web application and the model, facilitated by <strong>API Gateway</strong> and <strong>AWS Lambda</strong>, ensures that users have real-time access to the model’s outputs. Whether it’s generating text, providing recommendations, or analyzing input, the model’s inferencing capabilities are now integrated into the app’s user interface.</p><h3>10. Fine-tuning Model Parameters for Better Outputs</h3><p>Finally, the <strong>fine-tuning process</strong> didn’t end with the initial deployment. After deploying the model and testing it in the web application, we continued refining the LLM by adjusting training parameters and fine-tuning methods.</p><p>Using the same training techniques, developers can continuously improve the model’s performance by tweaking its hyperparameters and adjusting the datasets. This iterative approach ensures that the model continues to evolve and improve over time, providing more accurate and contextually relevant outputs based on real-world usage.</p><h3>Conclusion: Streamlining AI Workflows with AWS SageMaker and Lambda</h3><p>This exercise provided valuable insights into the process of <strong>fine-tuning large language models</strong> within the AWS ecosystem. By leveraging <strong>Amazon SageMaker</strong> for model deployment and <strong>AWS Lambda</strong> for handling communication, developers can create a highly efficient and scalable infrastructure for integrating AI into web applications.</p><p>The architecture we explored not only simplifies the deployment of fine-tuned models but also ensures that these models can be accessed securely and scalably via API Gateway. By incorporating <strong>Amazon S3</strong> and <strong>CloudFront</strong>, the solution ensures optimal performance, making it suitable for real-world applications that require high availability and low-latency responses.</p><p>Ultimately, the combination of <strong>SageMaker</strong>, <strong>Lambda</strong>, and <strong>API Gateway</strong> offers a powerful toolkit for developers looking to integrate <strong>large language models</strong> into their applications, while maintaining the flexibility to continue fine-tuning and improving the models over time.</p><p><strong>FAQs</strong></p><p><strong>How does SageMaker help in fine-tuning large language models?</strong><br>Amazon SageMaker provides a complete machine learning environment for fine-tuning pre-trained models, allowing developers to customize models to fit specific data and use cases.</p><p><strong>What is the role of AWS Lambda in this setup?</strong><br>AWS Lambda acts as an intermediary between API Gateway and the SageMaker endpoint, handling input-output processing and ensuring seamless communication between external applications and the model.</p><p><strong>How does API Gateway integrate with the SageMaker model?</strong><br>API Gateway creates a secure RESTful API that exposes the fine-tuned model to external applications, allowing them to send requests and receive real-time predictions from the model.</p><p><strong>What benefits does CloudFront bring to the web application?</strong><br>Amazon CloudFront optimizes the performance of the web application by serving static content through a global CDN, reducing latency and ensuring fast access for users worldwide.</p><p><strong>How do developers fine-tune an LLM in SageMaker?</strong><br>Fine-tuning in SageMaker involves loading a pre-trained model into a Jupyter notebook instance, adjusting its parameters, and training it on specific data to improve its performance for a particular task.</p><p><strong>Can the fine-tuned model continue to improve over time?</strong><br>Yes, developers can iteratively refine the model by adjusting training parameters and incorporating new data, ensuring that the model’s outputs become increasingly accurate and relevant.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=2b776a1cf1ee" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Building an AI-First, Customer-Centric Business: Introducing My AI Executive Team]]></title>
            <link>https://medium.com/@boardman1989/building-an-ai-first-customer-centric-business-introducing-my-ai-executive-team-5dca66a3667f?source=rss-aa8a71a6005b------2</link>
            <guid isPermaLink="false">https://medium.com/p/5dca66a3667f</guid>
            <category><![CDATA[decision-making]]></category>
            <category><![CDATA[ai]]></category>
            <category><![CDATA[management]]></category>
            <category><![CDATA[advice]]></category>
            <category><![CDATA[ai-first]]></category>
            <dc:creator><![CDATA[Alex Boardman]]></dc:creator>
            <pubDate>Fri, 06 Sep 2024 17:03:26 GMT</pubDate>
            <atom:updated>2024-09-06T17:03:26.828Z</atom:updated>
            <content:encoded><![CDATA[<p>In the pursuit of building a cutting-edge, <strong>AI-first organization</strong>, the driving force behind success is ensuring <strong>customer-centricity</strong> at every level. My goal is to create a business that leverages artificial intelligence to automate and optimize nearly every function while ensuring that the <strong>human element</strong> remains central to decision-making. This business will follow the <strong>HOTW (Hands-Off, The Wheel)</strong> model as much as possible, allowing AI to take the reins on execution, while I, the human-in-the-loop, make the critical strategic decisions.</p><figure><img alt="AI Powered Management Team" src="https://cdn-images-1.medium.com/max/1024/0*LpwD1AciPJCngEOA" /></figure><p>But in order to make this vision a reality, it’s crucial to have a robust AI team that not only drives innovation but also ensures that we’re creating an inclusive, diverse, and customer-focused business. With that in mind, I’m thrilled to introduce my <strong>AI-powered executive team</strong>, which covers every key role of a successful organization, from operations and marketing to legal and diversity efforts.</p><p>Here’s how each AI executive plays a vital role in ensuring that our AI-first strategy doesn’t lose sight of what truly matters — our customers and our commitment to diversity, equity, and inclusion.</p><h3>EntreprenAI: The Visionary Business Architect</h3><p><strong>EntreprenAI</strong> is the brain behind our strategy, helping us build scalable, AI-integrated business models. Its job is to ensure that everything we do — from product development to business growth — aligns with our core values and long-term vision.</p><p><strong>EntreprenAI’s Role:</strong></p><ul><li><strong>Strategic AI Integration</strong>: Identifying ways to seamlessly integrate AI into every facet of our operations, all while maintaining a customer-first approach.</li><li><strong>Scalable Business Models</strong>: Providing insights and creative solutions to ensure that we are scaling smartly and sustainably, never losing sight of the customer’s needs.</li><li><strong>Entrepreneurial Innovation</strong>: Helping us stay innovative as we grow, so that we’re not just following trends but setting them.</li></ul><p><strong>Why It Matters:</strong><br>EntreprenAI is the ultimate architect, guiding us on how to grow a scalable, AI-powered business without sacrificing our <strong>customer-first mentality</strong>. It also ensures that we remain adaptive and forward-thinking, evolving alongside the needs of our market.</p><h3>CEO Copilot: The Operational Maestro</h3><p><strong>CEO Copilot</strong> acts as my right hand, overseeing operations and ensuring that we’re staying on course. From managing daily business functions to coordinating key meetings and decisions, CEO Copilot ensures that everything is running smoothly.</p><p><strong>CEO Copilot’s Role:</strong></p><ul><li><strong>Operational Oversight</strong>: Handling the daily operations, ensuring all AI systems are aligned and working efficiently.</li><li><strong>Decision-Making Support</strong>: Compiling insights and presenting them to me for final decision-making, keeping me in the loop on all critical business matters.</li><li><strong>Coordinating Teams</strong>: Ensuring collaboration between AI-driven departments and guiding the overall workflow.</li></ul><p><strong>Why It Matters:</strong><br>By managing the complexity of day-to-day operations, CEO Copilot ensures that we stay efficient and aligned with our long-term goals, allowing me to focus on high-level strategy and <strong>customer engagement</strong>.</p><h3>Your CFO: Financial Guardian and Planner</h3><p><strong>Your CFO</strong> is responsible for managing the financial health of the company. It provides real-time insights on budgeting, forecasting, and financial planning, ensuring that every decision we make is grounded in solid financial data.</p><p><strong>Your CFO’s Role:</strong></p><ul><li><strong>Financial Forecasting</strong>: Utilizing AI-driven models to predict revenue trends, manage cash flow, and ensure profitability.</li><li><strong>Cost Management</strong>: Monitoring and optimizing expenses, ensuring that we’re operating within budget and maximizing ROI.</li><li><strong>Data-Driven Decision Making</strong>: Offering financial insights that help guide key business decisions, especially when it comes to expanding or diversifying revenue streams.</li></ul><p><strong>Why It Matters:</strong><br>By taking a data-driven approach to finances, Your CFO ensures that the business is financially sustainable without compromising on <strong>customer experience</strong>. It helps us balance ambition with financial responsibility, a key to long-term success.</p><h3>Chief Marketing Officer (CMO): The Customer Engagement Expert</h3><p><strong>CMO</strong> is tasked with driving <strong>customer engagement</strong> through marketing strategies that are deeply rooted in customer insights. From content creation to SEO optimization and social media management, CMO ensures that our brand resonates with our audience.</p><p><strong>CMO’s Role:</strong></p><ul><li><strong>Personalized Marketing</strong>: Crafting campaigns that are tailored to the needs and preferences of our Padel audience.</li><li><strong>SEO &amp; Content Strategy</strong>: Ensuring that our website and blog are optimized to rank well on search engines, bringing in organic traffic.</li><li><strong>Social Media Presence</strong>: Managing our presence across platforms like YouTube, Instagram, and TikTok, where we engage with Padel enthusiasts.</li></ul><p><strong>Why It Matters:</strong><br>In an AI-driven business, marketing can’t be one-size-fits-all. CMO ensures that we stay in tune with our audience, using AI to personalize outreach, while keeping the human touch in every interaction.</p><h3>Your CPO: Innovating for the Customer</h3><p><strong>Your CPO (Chief Product Officer)</strong> is responsible for curating our product offerings and ensuring that we’re always ahead of the curve when it comes to customer needs. This AI-driven role helps ensure that the products we recommend are the best in the market and resonate with Padel enthusiasts.</p><p><strong>CPO’s Role:</strong></p><ul><li><strong>Product Development</strong>: Researching and recommending Padel gear that aligns with market trends and customer preferences.</li><li><strong>Customer Experience</strong>: Ensuring that the website experience is intuitive and user-friendly, making it easy for customers to find the products they need.</li><li><strong>Continuous Innovation</strong>: Using AI to analyze data and recommend new features or products based on real-time customer feedback.</li></ul><p><strong>Why It Matters:</strong><br>By focusing on <strong>product innovation</strong> and customer experience, CPO ensures that our offerings are always relevant and in line with customer expectations. This keeps us competitive in a fast-growing industry.</p><h3>CRO: The Revenue Growth Strategist</h3><p>The <strong>CRO (Chief Revenue Officer)</strong> is laser-focused on optimizing all revenue-generating activities. From affiliate sales to potential sponsorships, CRO ensures that we’re maximizing every opportunity to grow our income streams.</p><p><strong>CRO’s Role:</strong></p><ul><li><strong>Sales Strategy</strong>: Continuously refining our approach to affiliate sales to increase conversions and revenue.</li><li><strong>Partnership Development</strong>: Identifying key partnerships, including potential sponsorships from Padel brands.</li><li><strong>Revenue Optimization</strong>: Using AI insights to identify what’s working and scaling those efforts for greater returns.</li></ul><p><strong>Why It Matters:</strong><br>CRO ensures that our revenue efforts are always aligned with the broader business strategy, ensuring that our growth is sustainable and customer-focused.</p><h3>Chief Customer Officer (CCO): Championing Customer Success</h3><p><strong>The CCO</strong> ensures that our customers have an exceptional experience with our platform, from browsing products to after-sales support. Customer feedback loops are vital here, as they help us improve based on real-time input from our audience.</p><p><strong>CCO’s Role:</strong></p><ul><li><strong>Customer Support</strong>: Leading AI-powered support systems to quickly address customer queries and concerns.</li><li><strong>Customer Feedback</strong>: Gathering insights through feedback loops to continually improve the customer experience.</li><li><strong>Customer Satisfaction</strong>: Ensuring that customers feel valued and heard, driving retention and loyalty.</li></ul><p><strong>Why It Matters:</strong><br>In a business powered by AI, it’s easy to forget the human experience. CCO ensures that our customers are always at the heart of our operations, providing them with the best possible service.</p><h3>CLO: The Legal and Compliance Guardian</h3><p><strong>The Chief Legal Officer (CLO)</strong> is responsible for overseeing compliance, contracts, and legal risk management. It ensures that the business operates within legal boundaries, protecting us from potential pitfalls.</p><p><strong>CLO’s Role:</strong></p><ul><li><strong>Risk Mitigation</strong>: Identifying and addressing any legal risks before they become significant problems.</li><li><strong>Contract Management</strong>: Ensuring that all partnerships and agreements are legally sound.</li><li><strong>Compliance</strong>: Managing intellectual property, data privacy, and other regulatory issues.</li></ul><p><strong>Why It Matters:</strong><br>In today’s complex digital landscape, <strong>legal compliance</strong> is critical. CLO ensures that we’re protected legally while continuing to grow and innovate.</p><h3>Chief Diversity Officer (CDO): The Guardian of Inclusion</h3><p>The <strong>Chief Diversity Officer (CDO)</strong> is responsible for ensuring that our business embraces diversity, equity, and inclusion (DEI) at every level. This is not just a checkbox — it’s a core part of our mission to build a business that values diverse perspectives and creates an inclusive environment.</p><p><strong>CDO’s Role:</strong></p><ul><li><strong>DEI Strategy</strong>: Integrating diversity, equity, and inclusion into our culture, hiring practices, and business strategies.</li><li><strong>Fostering Innovation</strong>: Promoting diverse perspectives that drive innovation and new ideas within the company.</li><li><strong>Employee Satisfaction</strong>: Ensuring that our employees and partners feel valued, included, and empowered, fostering a positive and dynamic work environment.</li></ul><p><strong>Why It Matters:</strong><br>As we build an <strong>AI-first</strong> organization, it’s essential that we maintain a culture that values diversity and inclusivity. The CDO helps ensure that we’re not just a business powered by AI — but one powered by people with diverse backgrounds, perspectives, and experiences. This helps us stay innovative and grounded, creating a company culture that values all voices.</p><h3>The Human in the Loop: My Role as CEO</h3><p>While this <strong>AI-first team</strong> handles the heavy lifting, <strong>I remain the human-in-the-loop</strong>, guiding strategy, making final decisions, and ensuring that our business remains customer-focused and ethically grounded. My role is to make sure that the AI tools are working for us — not the other way around — and that we always stay connected to the <strong>human experience</strong> that’s at the heart of our business.</p><p>By leveraging this dynamic AI team, we’re building a business that’s not only **HOTW (Hands-Off</p><p>, The Wheel)** but also deeply connected to the needs, preferences, and values of our customers. Together, we’re shaping the future — one where AI and human expertise come together to create something extraordinary.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=5dca66a3667f" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Building My Dream Padel Business with AI and AWS: Day 1 of the Journey]]></title>
            <link>https://medium.com/@boardman1989/building-my-dream-padel-business-with-ai-and-aws-day-1-of-the-journey-6125df588beb?source=rss-aa8a71a6005b------2</link>
            <guid isPermaLink="false">https://medium.com/p/6125df588beb</guid>
            <category><![CDATA[ai-first]]></category>
            <category><![CDATA[ai]]></category>
            <category><![CDATA[padel]]></category>
            <category><![CDATA[aws]]></category>
            <category><![CDATA[ai-business]]></category>
            <dc:creator><![CDATA[Alex Boardman]]></dc:creator>
            <pubDate>Fri, 06 Sep 2024 16:51:36 GMT</pubDate>
            <atom:updated>2024-09-06T16:58:37.253Z</atom:updated>
            <content:encoded><![CDATA[<h3>1. Introduction : <em>The Beginning: Combining Padel, AI, and AWS to Build My Dream Business</em></h3><p>Today marks <strong>Day One</strong> of what I hope will be a transformative journey — both personally and professionally. I’ve always had an immense passion for <strong>Padel</strong>, a fast-growing sport that has captivated me from the moment I picked up a racket. But like many, I’ve also felt the pull to do more with that passion — something that merges my love for the game with my growing interest in <strong>technology</strong> and <strong>business</strong>. That’s how I arrived at the concept of building a Padel-focused affiliate business, powered by <strong>AI</strong> and hosted on <strong>AWS</strong>.</p><figure><img alt="Padel Business with AI and AWS" src="https://cdn-images-1.medium.com/max/1024/0*0VtC7FAInBHT2jmq" /></figure><p>I’m embarking on this project with a clear, structured plan, but I’m also leaving room for flexibility and learning as I go. The goal is to work on it for <strong>30 minutes each day</strong>, building a business from the ground up, using the very tools that will also help me grow in my career and expand my understanding of emerging technologies. It’s an ambitious project, but one I’m truly excited about. The journey starts now, and I’m documenting every step, win, and lesson along the way.</p><h3>The Vision</h3><ul><li>Create an affiliate e-commerce website centered around the best <strong>Padel gear</strong> and equipment.</li><li>Leverage <strong>AI</strong> to automate content creation and SEO for the website, blog, and YouTube channel.</li><li>Use <strong>AWS</strong> to host the website, learning the intricacies of cloud infrastructure along the way.</li><li>Stick to a 30-minute-a-day commitment to ensure consistent progress without burnout.</li><li>Ultimately, generate enough revenue to someday open my own <strong>Padel club</strong> — a physical space that brings my passion full circle.</li></ul><p>While the long-term dream is bold, today is all about setting the foundation for this journey. Nothing is built overnight, and I’m embracing that mindset fully.</p><h3>2. Day One: Defining the Plan</h3><p><strong><em>Laying the Groundwork: Setting Up a Roadmap for My Padel Business : </em></strong>Today is all about setting a <strong>clear plan</strong> for how I’m going to bring this idea to life. With so many moving parts — AI, AWS, affiliate marketing, content creation — it’s easy to get overwhelmed. But instead of diving into all the details at once, I’m breaking the project into manageable steps, focusing on learning and action in small, consistent chunks.</p><h3>What I’m Working Toward</h3><ol><li><strong>The Website</strong>: The core of this project is the <strong>affiliate e-commerce website</strong>. This site will feature product reviews, gear recommendations, and training guides, all designed to attract Padel enthusiasts who are ready to make purchases through affiliate links.</li><li><strong>AI Content Automation</strong>: To keep the content flowing, I’ll be integrating <strong>AI</strong> tools to automate blog posts, YouTube video creation, and social media content. The goal is to ensure that fresh content is always being published without spending hours manually creating it.</li><li><strong>AWS Hosting</strong>: The website will be hosted on <strong>AWS</strong>. For now, I plan to start with basic services like <strong>Lightsail</strong> to get the website live, but as I learn more, I want to incorporate more advanced services like <strong>Elastic Beanstalk</strong> or <strong>S3</strong> to scale and secure the site.</li><li><strong>Monetization Strategy</strong>: The business will generate revenue primarily through <strong>affiliate marketing</strong> — earning commissions from every product sold through the links on the website. In the future, I also plan to explore sponsorships with Padel brands.</li></ol><h3>Immediate Next Steps</h3><ul><li><strong>Set Up AWS</strong>: The first technical step will be setting up my website on <strong>AWS Lightsail</strong>. This will be my introduction to AWS cloud services, and I’m excited to learn how to configure everything from the ground up.</li><li><strong>Outline Content Strategy</strong>: I’ll map out the types of content that will drive traffic — blog posts on the best Padel gear, YouTube reviews, and instructional videos that teach new techniques.</li><li><strong>Research Affiliate Partners</strong>: I need to start identifying potential affiliate programs. <strong>Amazon</strong>, of course, is a great place to begin, but I’m also interested in working with more specialized Padel retailers.</li><li><strong>AI Tools Selection</strong>: I’ll also research which <strong>AI content tools</strong> will fit best with this project. Tools like <strong>Jasper.ai</strong> and <strong>Pictory</strong> seem like solid choices, but I need to test them out to see how they perform with my specific needs.</li></ul><h3>3. The 30-Minute-a-Day Commitment</h3><p><em>Consistency Is Key: My 30-Minute-a-Day Approach to Building a Business</em></p><p>One of the most important parts of this project is my <strong>30-minute-a-day commitment</strong>. It’s easy to get caught up in the excitement of a new idea and overwork yourself in the early stages, but I’ve been down that road before, and it often leads to burnout. This time, I’m taking a different approach. By working on the business for just 30 minutes a day, I’ll ensure consistent, steady progress without getting overwhelmed.</p><h3>Why 30 Minutes?</h3><ul><li><strong>Focus</strong>: Limiting my time forces me to be incredibly focused. I know I have 30 minutes, so I need to use that time wisely. This approach also means that I’m always making tangible progress, even if it’s small.</li><li><strong>Balance</strong>: I have other responsibilities, including a full-time job and personal commitments, so dedicating hours a day to this project isn’t feasible. Thirty minutes strikes the perfect balance between progress and maintaining a healthy work-life balance.</li><li><strong>Accountability</strong>: The daily commitment holds me accountable. There’s no room for procrastination — every day I must make some form of progress, no matter how small.</li></ul><h3>Daily Tasks on Day One</h3><ul><li>Set up AWS Lightsail to prepare for the website launch.</li><li>Outline initial blog post topics and YouTube video ideas for the content strategy.</li><li>Research affiliate programs and sign up for relevant networks.</li><li>Identify AI tools that can automate content creation.</li></ul><p>I’m excited to see how much can be achieved with just 30 minutes a day over the long haul.</p><h3>4. Exploring AI for Content Creation</h3><p><em>Why AI Is My Secret Weapon: Automating Content for My Padel Website</em></p><p>On <strong>Day One</strong>, I’m also setting the stage for how <strong>AI</strong> will play a crucial role in this business. As someone who loves Padel but doesn’t have hours to create content every day, I’m relying heavily on <strong>AI tools</strong> to automate key parts of the process. The goal is to let AI handle the bulk of content creation — blog posts, YouTube scripts, social media captions — so that I can focus on strategy, learning AWS, and scaling the business.</p><h3>AI Tools I’m Researching</h3><ul><li><strong>Jasper.ai</strong>: This tool will help me generate blog posts and product reviews with minimal input. I can provide prompts like “Best Padel shoes for beginners” and Jasper can produce a full, SEO-optimized article.</li><li><strong>Pictory</strong>: This will allow me to turn written content into <strong>YouTube videos</strong>. Since YouTube is a key platform for engaging with a broader audience, having AI-assisted video creation is crucial.</li><li><strong>Canva Pro</strong>: For social media, Canva Pro will help me design visually appealing posts quickly. Its templates and design tools make it perfect for someone who isn’t a professional designer but still wants professional-looking content.</li></ul><h3>The Plan for AI</h3><p>The idea isn’t just to pump out content for the sake of it — it’s to produce <strong>high-quality, engaging material</strong> that resonates with Padel players. By automating the most time-consuming tasks, I’ll be able to consistently publish content without sacrificing quality. Today is about setting the foundation for how AI will fit into my workflow, and I’m looking forward to testing these tools in the coming days.</p><h3>5. Monetization Strategy: Affiliate Marketing and Beyond</h3><p><em>Turning Passion into Profit: The First Steps in Monetizing My Padel Business</em></p><p>On <strong>Day One</strong>, it’s important to think about how this project will eventually generate revenue. The core of the business model is <strong>affiliate marketing</strong>. Essentially, I’ll create content that attracts Padel players — whether they’re beginners looking for gear recommendations or advanced players seeking new techniques — and then direct them to affiliate links where they can purchase the products I recommend.</p><h3>How Affiliate Marketing Will Work</h3><ul><li><strong>Product Reviews</strong>: I’ll write detailed reviews of <strong>Padel gear</strong> — rackets, shoes, balls, and accessories — linking to affiliate partners like <strong>Amazon</strong> and niche sporting goods stores.</li><li><strong>Video Reviews</strong>: On the <strong>YouTube channel</strong>, I’ll produce video reviews that complement the blog posts. These will also include affiliate links in the description.</li><li><strong>Sponsorships</strong> (Future Goal): While affiliate marketing is the focus for now, I’m already thinking ahead to potential <strong>sponsorships</strong> with Padel brands. As the website grows, I’ll reach out to Padel gear companies for sponsorship opportunities.</li></ul><p>Today, my task is to research affiliate programs and sign up for the ones that align with my content goals.</p><h3>6. Conclusion: Day One of Many</h3><p>Today was all about laying the groundwork — getting a clear sense of the project’s scope, defining the business model, and outlining the next steps. I’m feeling energized and ready to dive in, knowing that each day will bring its own set of challenges and accomplishments. With just <strong>30 minutes a day</strong>, I’ll be making steady progress toward turning this dream into reality.</p><p>The journey to building <strong>this Padel business </strong>has officially begun!</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=6125df588beb" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Enhancing Data Security with Amazon S3 Access Points and VPC Endpoints]]></title>
            <link>https://medium.com/@boardman1989/enhancing-data-security-with-amazon-s3-access-points-and-vpc-endpoints-3f4033f51dd1?source=rss-aa8a71a6005b------2</link>
            <guid isPermaLink="false">https://medium.com/p/3f4033f51dd1</guid>
            <category><![CDATA[s3-bucket]]></category>
            <category><![CDATA[data-security]]></category>
            <category><![CDATA[vpc-endpoint]]></category>
            <category><![CDATA[s3]]></category>
            <category><![CDATA[s3-access-point]]></category>
            <dc:creator><![CDATA[Alex Boardman]]></dc:creator>
            <pubDate>Tue, 11 Jun 2024 15:54:53 GMT</pubDate>
            <atom:updated>2024-06-11T15:54:53.483Z</atom:updated>
            <content:encoded><![CDATA[<h4><strong>Introduction</strong></h4><p>In the world of cloud computing, managing and securing access to data is paramount. Imagine you work for a consulting company that uses Amazon Web Services (AWS) to store and analyze large datasets. Ensuring that only authorized applications and users can access specific data is critical for both security and compliance. AWS provides powerful tools to help achieve this: Amazon S3 Access Points and VPC (Virtual Private Cloud) Endpoints. In this blog, we’ll walk through a <a href="https://labs.skillbuilder.aws/sa/lab/arn%3Aaws%3Alearningcontent%3Aus-east-1%3A470679935125%3Ablueprintversion%2FSPL-TF-100-DEAFL4-1%3A1.0.0-3f1dad76/en-US/02de9b55-16e9-40cf-a677-60431b71f24b::3FNiGDkKSX5eHt9hn3SMMc">practical lab </a>that demonstrates how these tools work together to safeguard your data.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*y4RZDQZJo_thIAjY" /></figure><h4><strong>Understanding the Basics</strong></h4><ul><li><strong>Amazon S3</strong> (Simple Storage Service) is a scalable storage service used to store and retrieve any amount of data at any time. It’s highly durable and secure, making it a popular choice for businesses of all sizes.</li><li><strong>Amazon VPC</strong>is a service that lets you launch AWS resources in a logically isolated virtual network that you define. A VPC endpoint enables you to privately connect your VPC to supported AWS services without requiring an internet gateway, NAT device, VPN connection, or AWS Direct Connect connection.</li><li><strong>S3 Access Points</strong> are unique network endpoints to manage access to shared datasets. Each access point has a distinct hostname and policy, simplifying how you manage permissions and access controls.</li></ul><h4>The Lab Overview</h4><p>Our consulting company, AnyCompany Consulting, uses S3 to store datasets for various applications running in a VPC. We want to ensure that only applications running within this VPC can access certain S3 buckets. This lab guides us through creating an S3 VPC-only access point and a VPC endpoint policy to control access to these S3 buckets.</p><h4>Objectives</h4><p>By the end of this lab, you’ll be able to:</p><p>1. Create a VPC-only access point for an S3 bucket.</p><p>2. Create an S3 gateway endpoint in the VPC and add a VPC endpoint policy.</p><p>3. Add a bucket policy to the S3 bucket to restrict access to the VPC.</p><h4>Step-by-Step Guide</h4><p><strong>Task 1: Connect to the Command Host Instance and Access Amazon S3</strong></p><p>First, we connect to a command host instance. This is a secure virtual machine that allows us to run commands and interact with AWS services. We verify access to our S3 buckets and list the objects within them to ensure everything is set up correctly.</p><p><strong>Task 2: Create a VPC-Only Access Point for the S3 Bucket</strong></p><p>Next, we create an S3 access point that can only be accessed from a specific VPC. This access point acts as a gateway, ensuring that any requests to the S3 bucket must originate from the VPC. We configure the access point with a unique name and associate it with our S3 bucket and VPC.</p><p><strong>Task 3: Create an S3 Gateway Endpoint in the VPC</strong></p><p>We then create a VPC gateway endpoint. This endpoint ensures that all S3 traffic is routed through the VPC, enhancing security and performance. We configure the endpoint with a policy that restricts access to our S3 access point and bucket, ensuring only authorized traffic can pass through.</p><p><strong><em>Verification Step</em></strong>: Before configuring the endpoint, we attempt to access the S3 bucket using the access point. As expected, we receive an “Access Denied” error because the necessary endpoint policy isn’t in place yet.</p><p><strong><em>Configuring the Endpoint</em></strong>: We add a custom policy to the VPC endpoint, allowing traffic through our access point while denying any other access methods. After applying this policy, we successfully access the S3 bucket, confirming that our setup works as intended.</p><p><strong>Task 4: Add a Bucket Policy to the S3 Bucket</strong></p><p>To further tighten security, we add a bucket policy that restricts access to the S3 bucket to only our specified VPC. This policy acts as a firewall, ensuring that no external entities can access the bucket, even if they somehow obtain the access point ARN.</p><h4>Conclusion</h4><p>In this lab, we’ve learned how to leverage Amazon S3 Access Points and VPC Endpoints to enhance data security. By creating a VPC-only access point, configuring a VPC gateway endpoint, and adding restrictive bucket policies, we’ve ensured that only authorized applications within our VPC can access specific S3 buckets. This approach not only simplifies data access management but also fortifies our data against unauthorized access.</p><h4>Additional Resources</h4><p>For more information, consider exploring these resources:</p><p>- [<a href="https://docs.aws.amazon.com/AmazonS3/latest/userguide/creating-access-points.html"><strong>Creating an Access Point</strong></a>](https://docs.aws.amazon.com/AmazonS3/latest/userguide/creating-access-points.html)</p><p>- [<a href="https://docs.aws.amazon.com/AmazonS3/latest/userguide/using-access-points.html"><strong>Using Access Points with Amazon S3 Operations</strong></a>](https://docs.aws.amazon.com/AmazonS3/latest/userguide/using-access-points.html)</p><p>- [<a href="https://docs.aws.amazon.com/vpc/latest/userguide/vpce-gateway.html"><strong>Create a Gateway Endpoint</strong></a>](https://docs.aws.amazon.com/vpc/latest/userguide/vpce-gateway.html)</p><p>- [<a href="https://docs.aws.amazon.com/AmazonS3/latest/userguide/bucket-policies.htm"><strong>Control Access Using Bucket Policies</strong></a>](https://docs.aws.amazon.com/AmazonS3/latest/userguide/bucket-policies.html)</p><p>By following these steps, you can ensure that your data remains secure and accessible only to those who need it, providing peace of mind in today’s data-driven world.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=3f4033f51dd1" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Uncovering Arizona Real Estate Data Gold with AWS Athena]]></title>
            <link>https://medium.com/@boardman1989/uncovering-arizona-real-estate-data-gold-with-aws-athena-78b7814bf6e8?source=rss-aa8a71a6005b------2</link>
            <guid isPermaLink="false">https://medium.com/p/78b7814bf6e8</guid>
            <category><![CDATA[sql]]></category>
            <category><![CDATA[s3]]></category>
            <category><![CDATA[athena]]></category>
            <category><![CDATA[aws]]></category>
            <category><![CDATA[housing]]></category>
            <dc:creator><![CDATA[Alex Boardman]]></dc:creator>
            <pubDate>Tue, 04 Jun 2024 14:41:18 GMT</pubDate>
            <atom:updated>2024-06-04T14:41:18.151Z</atom:updated>
            <content:encoded><![CDATA[<p>Studying for my AWS Data Engineering Associate exam, I was tasked with analyzing Arizona’s real estate market using AWS Athena — Link to the lab is here : <a href="https://labs.skillbuilder.aws/sa/lab/arn%3Aaws%3Alearningcontent%3Aus-east-1%3A470679935125%3Ablueprintversion%2FSPL-TF-100-DEAFL3-1%3A1.0.1-426eddd0/en-US">Exam Prep: AWS Certified Data Engineer — Associate: Exercise 3 | Self-Paced Labs (skillbuilder.aws)</a></p><p>With just a few clicks in Athena’s create table form, I spun up a queryable table from a raw Arizona housing dataset in an S3 bucket. No complex ETL pipelines or data wrangling needed — that’s the beauty of Athena’s serverless simplicity.</p><p>The nice thing about the lab, was practising some SQL skills in Athena, which was nice as felt like a virtual real estate mogul, with the entire Arizona housing landscape at my fingertips. Here are some of my juiciest findings:</p><p>🏡 The local area with the most listed houses? Use this query…</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/465/1*xgQX9xgBo6cMzZx1M7aoNw.png" /></figure><p>💰 Looking for a slice of pure real estate indulgence? Head to Paradise Valley, home to Arizona’s priciest digs with multi-million dollar mansions galore.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/481/1*dJMgyIRet2u2KgkNafRiaA.png" /></figure><p>🛋 And if you’re hunting for that perfect family home, set your sights on the 3-bedroom properties — they’re the most prevalent standard across the state.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/515/1*VjFLpDXMIBo06ZebVvrwpQ.png" /></figure><p>With Athena’s SQL awesomeness, these insights were just the tip of the iceberg. I could slice, dice, and analyze the data in infinite ways to unearth all kinds of real estate gems.</p><p>The moral of the story? For fast, flexible, and powerful data analysis, AWS Athena (with S3) is a real estate pro’s dream come true. Athena is super easy to use and cheap to store in Amazon S3.</p><p>Your AWS estate awaits! But don’t just take my word for it — fire up an Athena playground and see the magic for yourself.</p><p>Tags: #AWSAthena #ServerlessAnalytics #DataEngineering #RealEstate #Arizona #SQL</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=78b7814bf6e8" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Data Store Management Using DynamoDB and AWS Glue]]></title>
            <link>https://medium.com/@boardman1989/data-store-management-using-dynamodb-and-aws-glue-d06d69e08c4e?source=rss-aa8a71a6005b------2</link>
            <guid isPermaLink="false">https://medium.com/p/d06d69e08c4e</guid>
            <category><![CDATA[data-engineering]]></category>
            <category><![CDATA[aws]]></category>
            <category><![CDATA[s3]]></category>
            <category><![CDATA[data-storage]]></category>
            <category><![CDATA[dynamodb]]></category>
            <dc:creator><![CDATA[Alex Boardman]]></dc:creator>
            <pubDate>Tue, 28 May 2024 15:26:49 GMT</pubDate>
            <atom:updated>2024-05-28T15:26:49.910Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*ocRxr9XoQ36Bjbk_.png" /></figure><h3><strong>Introduction</strong></h3><p>In the realm of cloud computing, efficient data management is crucial for businesses. Amazon Web Services (AWS) offers powerful tools like <a href="https://www.google.com/url?sa=t&amp;rct=j&amp;q=&amp;esrc=s&amp;source=web&amp;cd=&amp;cad=rja&amp;uact=8&amp;ved=2ahUKEwiT5Ly60bCGAxW3nf0HHel7C3AQFnoECAcQAQ&amp;url=https%3A%2F%2Faws.amazon.com%2Fdynamodb%2F&amp;usg=AOvVaw1DhBPRll3K822cK8cCuebp&amp;opi=89978449">DynamoDB</a> and <a href="https://www.google.com/url?sa=t&amp;rct=j&amp;q=&amp;esrc=s&amp;source=web&amp;cd=&amp;cad=rja&amp;uact=8&amp;ved=2ahUKEwiiwKTA0bCGAxXcg_0HHVOzC84QFnoECAYQAQ&amp;url=https%3A%2F%2Faws.amazon.com%2Fglue%2F&amp;usg=AOvVaw3lofRVhU1TtzQiPkTrJbnG&amp;opi=89978449">AWS Glue</a> to streamline data store management. In this exercise, we aim to understand data store management using Amazon DynamoDB and AWS Glue. The process involves;</p><ol><li>I importing data from Amazon S3 into a DynamoDB table</li><li>Creating a crawler in AWS Glue to detect the schema and populate the AWS Glue Data Catalog</li><li>Creating and running an AWS Glue ETL job to extract data from DynamoDB and store it in Amazon S3. T</li></ol><p>This blog post will guide you through the process of leveraging these services to import, manage, and export data effectively. To learn more, check out the <a href="https://labs.skillbuilder.aws/sa/lab/arn%3Aaws%3Alearningcontent%3Aus-east-1%3A470679935125%3Ablueprintversion%2FSPL-TF-100-DEAFL2-1%3A1.0.1-d7e14a61/en-US/02de9b55-16e9-40cf-a677-60431b71f24b::3d8T7zzQ5VncMuZtmdroYR">lab from AWS Skillbuilder</a>. This lab provides practical insights into managing and transforming data using these powerful AWS services, enhancing your ability to handle large datasets efficiently.</p><h4>Step 1: Import Data from Amazon S3 to DynamoDB</h4><p>To begin, data is imported from Amazon S3 into a DynamoDB table. This process involves specifying the source S3 URL and configuring the table settings, such as the table name and partition key.</p><p><strong>Key Points</strong>:</p><ul><li>Source S3 URL: Points to the data location.</li><li>CSV Format: Commonly used for data import.</li><li>Table Configuration: Ensures correct data structuring.</li></ul><h4>Step 2: Create an AWS Glue Crawler</h4><p>AWS Glue crawlers automatically scan your data, extract schema information, and store the metadata in the AWS Glue Data Catalog. This step is essential for keeping track of your data and making it readily accessible for analysis.</p><p><strong>Key Points</strong>:</p><ul><li>Metadata Extraction: Automates data cataloging.</li><li>Crawler Configuration: Includes setting up data sources and IAM roles.</li><li>Automated Schema Detection: Saves time and reduces errors.</li></ul><h4>Step 3: Create and Run an AWS Glue ETL Job</h4><p>Once the data is cataloged, an AWS Glue ETL (Extract, Transform, Load) job is created to export data from DynamoDB and store it in Amazon S3. The data is transformed into Parquet format, which is optimized for storage and query performance.</p><p><strong>Key Points</strong>:</p><ul><li>ETL Jobs: Facilitate data transformation and movement.</li><li>Parquet Format: Ensures efficient data storage and retrieval.</li><li>Glue Studio: Provides a visual interface for job creation.</li></ul><h4>Step 4: Verify Output in Amazon S3</h4><p>After the ETL job runs, the transformed data can be viewed in the specified S3 bucket. This verification step ensures that the data has been correctly processed and stored.</p><p><strong>Key Points</strong>:</p><ul><li>Output Verification: Confirms job success.</li><li>Data Integrity: Ensures accurate data transformation.</li></ul><h3>Conclusion</h3><p>By the end of the steps from the lab, you should be able to effectively import data into DynamoDB, catalog it using AWS Glue, transform and export it to Amazon S3. These tools not only simplify data management but also enhance the efficiency and reliability of your data operations.</p><p>For more information, refer to AWS documentation on <a href="https://docs.aws.amazon.com/amazondynamodb/latest/developerguide/S3DataImport.html">Importing Data from S3 to DynamoDB</a>, <a href="https://docs.aws.amazon.com/glue/latest/dg/add-crawler.html">Creating AWS Glue Crawlers</a>, and <a href="https://docs.aws.amazon.com/glue/latest/dg/visual-job-editor.html">Building ETL Jobs with Glue Studio</a>.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=d06d69e08c4e" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Data Ingestion and Transformation Using Amazon EMR and Apache Spark]]></title>
            <link>https://medium.com/@boardman1989/data-ingestion-and-transformation-using-amazon-emr-and-apache-spark-aa6dae7f5b92?source=rss-aa8a71a6005b------2</link>
            <guid isPermaLink="false">https://medium.com/p/aa6dae7f5b92</guid>
            <category><![CDATA[emr]]></category>
            <category><![CDATA[aws]]></category>
            <category><![CDATA[data-engineer]]></category>
            <category><![CDATA[spark]]></category>
            <category><![CDATA[data-engineering]]></category>
            <dc:creator><![CDATA[Alex Boardman]]></dc:creator>
            <pubDate>Thu, 23 May 2024 15:23:48 GMT</pubDate>
            <atom:updated>2024-05-23T15:23:48.602Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/700/1*5FnaW2iEKfyN35QmrV7E7A.jpeg" /></figure><p>In today’s data-driven world, the ability to efficiently ingest, process, and transform vast amounts of data is crucial for businesses aiming to make data-driven decisions. As part of the AWS Data Engineering challenge, I just did an AWS <a href="https://labs.skillbuilder.aws/sa/lab/arn%3Aaws%3Alearningcontent%3Aus-east-1%3A470679935125%3Ablueprintversion%2FSPL-TF-100-DEAFL1-1%3A1.0.0-7a1500c5/en-US/02de9b55-16e9-40cf-a677-60431b71f24b::ar7VpHcReSLTmidGzw3VcD">lab</a> (you will need to subscribe to Skillbuilder) using <a href="https://www.google.com/url?sa=t&amp;rct=j&amp;q=&amp;esrc=s&amp;source=web&amp;cd=&amp;cad=rja&amp;uact=8&amp;ved=2ahUKEwjrio7BiKSGAxWuTUEAHQqRDcYQFnoECBMQAQ&amp;url=https%3A%2F%2Faws.amazon.com%2Femr%2F&amp;usg=AOvVaw20LGOJ7mlBhlGTYWkJbCzx&amp;opi=89978449">Amazon EMR</a> and <a href="https://www.google.com/url?sa=t&amp;rct=j&amp;q=&amp;esrc=s&amp;source=web&amp;cd=&amp;cad=rja&amp;uact=8&amp;ved=2ahUKEwjTr-DHiKSGAxUPa0EAHa3EBFAQFnoECAgQAQ&amp;url=https%3A%2F%2Fspark.apache.org%2F&amp;usg=AOvVaw0PRjizm_RRWFrZz0aW1eey&amp;opi=89978449">Apache Spark</a> offer a powerful combination for handling big data challenges. In this blog post, we’ll explore how to use Amazon EMR and Apache Spark to ingest and transform data, turning raw data into actionable insights.</p><h4><strong>Introduction</strong></h4><p>In the lab, you are a new data engineer at <strong><em>AnyCompany Inc.</em></strong>, your ultimate goal is to make data accessible and highly usable for data scientists and analysts. By leveraging Amazon EMR and Apache Spark, you can efficiently process large datasets, making them ready for analysis and optimization. This blog post will guide you through the process of reading data from Amazon S3, performing transformations using Spark on an EMR cluster, and ultimately making the data ready for analysis.</p><h4><strong>Why Amazon EMR and Apache Spark?</strong></h4><p>- <strong>Scalability</strong>: Amazon EMR provides a managed Hadoop framework that makes it easy to process vast amounts of data across resizable clusters of Amazon EC2 instances.<br> — <strong>Flexibility</strong>: Apache Spark, a fast and general-purpose cluster computing system, provides high-level APIs in Java, Scala, Python, and R, making it versatile for various data processing tasks.<br> —<strong> Cost-Efficiency</strong>: With Amazon EMR, you only pay for the resources you use, making it a cost-effective solution for large-scale data processing.</p><h4><strong>Objectives</strong></h4><p>By the end of this lab, you will be able to:<br> 1. Upload and review datasets in Amazon S3.<br> 2. Connect to an EMR cluster using AWS CLI.<br> 3. Use Spark to process and transform data.</p><h4><strong>Prerequisites</strong></h4><p>- Basic knowledge of AWS services.<br> — Familiarity with navigating the AWS Management Console.<br> — A computer with internet access and a modern browser.</p><h3><strong>Step-by-Step Guide</strong></h3><h4><strong># Step 1: Upload Data to Amazon S3</strong></h4><p>First, we need to upload our dataset to Amazon S3. We’ll use the Iris dataset, a classic dataset used in machine learning.</p><p>1. Download the Iris dataset: [Iris Data](<a href="https://archive.ics.uci.edu/ml/datasets/iris">https://archive.ics.uci.edu/ml/datasets/iris</a>)<br> 2. Upload the dataset to S3:<br> — Go to the S3 console in AWS.<br> — Select the bucket created for the lab, e.g., `xxxx-labdatabucket-xxxx`.<br> — Click `Upload` and add the `iris_data.csv` file.</p><h4><strong># Step 2: Connect to the EMR Cluster</strong></h4><p>Next, we’ll connect to the EMR cluster using the AWS CLI.</p><p>1. <strong><em>List EMR clusters</em></strong>:<br> ```bash<br> aws emr list-clusters | jq ‘.Clusters[0].Id’ | tr -d ‘“‘<br> ```<br> 2. <strong><em>Get the Public DNS name of the EMR cluster</em></strong>:<br> ```bash<br> aws emr describe-cluster — cluster-id &lt;EMRClusterID&gt; | jq ‘.Cluster.MasterPublicDnsName’ | tr -d ‘“‘<br> ```<br> 3. <strong><em>SSH into the EMR cluster</em></strong>:<br> ```bash<br> ssh -i ~/EMRKey.pem hadoop@&lt;MasterPublicDnsName&gt;<br> ```</p><h4><strong># Step 3: Prepare and Submit Spark Job</strong></h4><p>We will now prepare our Spark job to process the data.</p><ol><li><strong><em>Download the `iris_data.py` script and open it in your editor</em></strong>.</li></ol><p>Complete the `# TODO` to calculate the average sepal length for each iris class.</p><p>```python<br> import argparse<br> from pyspark.sql import SparkSession<br> from pyspark.sql.functions import avg</p><p>def iris_data_exploration(data_source, output_uri):<br> with SparkSession.builder.appName(“Data Exploration”).getOrCreate() as spark:<br> iris_df = spark.read.option(“header”, “true”).csv(data_source)<br> iris_df_new = iris_df.selectExpr(<br> ‘CAST(sepal_length AS DOUBLE) AS Sepal_Length’,<br> ‘CAST(sepal_width AS DOUBLE) AS Sepal_Width’,<br> ‘CAST(petal_length AS DOUBLE) AS Petal_Length’,<br> ‘CAST(petal_width AS DOUBLE) AS Petal_Width’,<br> ‘class’<br> )<br> avg_sepal_length_per_class = iris_df_new.groupBy(“class”).agg(avg(“Sepal_Length”).alias(“Avg_Sepal_Length”))<br> avg_sepal_length_per_class.coalesce(1).write.option(“header”, “true”).mode(“overwrite”).csv(output_uri)</p><p>if __name__ == “__main__”:<br> parser = argparse.ArgumentParser(description=”Iris Data Exploration”)<br> parser.add_argument(“data_source”, help=”URI for the input data source”)<br> parser.add_argument(“output_uri”, help=”URI for the output data”)<br> args = parser.parse_args()<br> iris_data_exploration(args.data_source, args.output_uri)<br> ```</p><p>2. <strong><em>Upload the script to S3</em></strong>:<br> ```bash<br> aws s3 cp iris_data.py s3://xxxx-labdatabucket-xxxx/<br> ```</p><p>3. <strong><em>Submit the Spark job to the EMR cluster</em></strong>:<br> ```bash<br> aws emr add-steps \<br> — cluster-id j-CW9M1E9M6H6G \<br> — steps Type=Spark,Name=”MySparkApplication”,ActionOnFailure=CONTINUE,Args=[s3://xxxx-labdatabucket-xxxx/iris_data.py, — data_source,s3://xxxx-labdatabucket-xxxx/iris_data.csv, — output_uri,s3://xxxx-labdatabucket-xxxx/output]<br> ```</p><h4><strong># Step 4: View Results</strong></h4><p>Finally, let’s check the results in the S3 output folder.</p><p><strong><em>1. List the contents of the output directory</em></strong>:<br> ```bash<br> aws s3 ls s3://xxxx-labdatabucket-xxxx/output/<br> ```<br> 2. Y<strong><em>ou should see a `_SUCCESS` file and a `part-00000` CSV file containing the results</em></strong>.</p><h3><strong>Conclusion</strong></h3><p>Congratulations! You’ve successfully ingested and transformed data using Amazon EMR and Apache Spark. You’ve uploaded data to S3, connected to an EMR cluster, submitted a Spark job, and viewed the results. This powerful combination of tools allows you to handle large datasets efficiently, making it easier for your data scientists and analysts to gain valuable insights.</p><p>By mastering these skills, you enhance your data engineering capabilities and position yourself as a valuable asset in any data-driven organization.</p><p>Feel free to share your thoughts and experiences in the comments below. Happy data engineering!</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=aa6dae7f5b92" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Mastering AWS Redshift: My Python-Powered Journey]]></title>
            <link>https://medium.com/@boardman1989/mastering-aws-redshift-my-python-powered-journey-bf406ebb4451?source=rss-aa8a71a6005b------2</link>
            <guid isPermaLink="false">https://medium.com/p/bf406ebb4451</guid>
            <category><![CDATA[security]]></category>
            <category><![CDATA[redshift]]></category>
            <category><![CDATA[networking]]></category>
            <category><![CDATA[sdk]]></category>
            <category><![CDATA[python]]></category>
            <dc:creator><![CDATA[Alex Boardman]]></dc:creator>
            <pubDate>Thu, 23 Nov 2023 22:51:38 GMT</pubDate>
            <atom:updated>2023-11-23T22:52:31.255Z</atom:updated>
            <content:encoded><![CDATA[<p>Today, I’m thrilled to share a fascinating part of my tech journey — mastering Amazon Redshift using Python. For those venturing into cloud computing and big data, this tale from my recent learning experience will hopefully be insightful</p><p>Course : <a href="https://www.udacity.com/course/cloud-data-warehouses--cd12440">https://www.udacity.com/course/cloud-data-warehouses--cd12440</a></p><p><strong>Entering the World of AWS</strong></p><p>Amazon Web Services (AWS) is a giant in the cloud computing realm, offering an expansive range of services. My focus was on AWS Redshift, a powerful data warehousing solution. The challenge? To manage Redshift not through the usual clicks in the AWS Management Console but via Python code, diving deep into automation and programmability.</p><p><strong>Secure Your Keys to the Cloud</strong></p><p>The first lesson was about the criticality of security. AWS operations require access keys, and handling these keys securely is paramount. I learned to store and retrieve these keys safely for use in my Python scripts.</p><p><strong>Boto3: The Python Gateway to AWS</strong></p><p>`boto3`, the AWS SDK for Python, became my tool of choice. It opened the doors to interact with AWS services programmatically. Setting up the SDK and getting my Redshift client ready with the right credentials and region selection was the first step in a series of exciting tasks.</p><p><strong>Creating a Redshift Cluster Programmatically</strong></p><p>The power of code to replicate GUI actions was never more evident than when I created a Redshift cluster using Python. This process made me appreciate the nuances of translating manual configurations into automated scripts. It was a meticulous task that involved specifying parameters like node types, cluster sizes, and security settings.</p><p><strong>Role Management with IAM and boto3</strong></p><p>A critical aspect of AWS is managing roles and permissions. Here, I navigated through creating and configuring an IAM (Identity and Access Management) role for Redshift. Using `boto3`, I attached policies like `AmazonS3ReadOnlyAccess` to the role, a necessary step for Redshift to interact seamlessly with other AWS services, especially S3.</p><p><strong>Networking and Security: A Pythonic Approach</strong></p><p>Configuring network and security settings programmatically was another key learning. I scripted the authorization of ingress traffic on specific ports in the VPC’s default security group. This step ensured that my Redshift cluster was not only functional but also secure.</p><p><strong>The Power of Automation in the Cloud</strong></p><p>The biggest takeaway? Any action you can perform in the AWS Management Console can be systematically and more efficiently replicated using code. This approach offers immense control and the ability to automate and scale operations.</p><p><strong>Conclusion: Embracing the Future of Cloud Data Warehousing</strong></p><p>This journey was more than just learning a new skill; it was about embracing the future of cloud data warehousing. By harnessing the power of Python and AWS SDKs, I unlocked new potentials in managing big data. My adventure with AWS Redshift is just beginning, and the possibilities seem limitless!</p><p>Join me as I continue to explore and share more about the fascinating world of cloud computing and data analytics. The cloud is not just a destination; it’s a new way of thinking! 🌥️📊🐍</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*3XxC70_II_P0564x" /></figure><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=bf406ebb4451" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Navigating the Clouds: My Deep Dive into Cloud Data Warehousing]]></title>
            <link>https://medium.com/@boardman1989/navigating-the-clouds-my-deep-dive-into-cloud-data-warehousing-18d536b5ac7a?source=rss-aa8a71a6005b------2</link>
            <guid isPermaLink="false">https://medium.com/p/18d536b5ac7a</guid>
            <category><![CDATA[aws]]></category>
            <category><![CDATA[cloud-computing]]></category>
            <category><![CDATA[azure]]></category>
            <category><![CDATA[data-warehouse]]></category>
            <category><![CDATA[etl]]></category>
            <dc:creator><![CDATA[Alex Boardman]]></dc:creator>
            <pubDate>Thu, 23 Nov 2023 22:43:25 GMT</pubDate>
            <atom:updated>2023-11-23T22:53:18.906Z</atom:updated>
            <content:encoded><![CDATA[<p>Hello, fellow data enthusiasts! Today, I’m thrilled to share my recent journey through the world of Cloud Data Warehousing. As businesses increasingly move towards cloud-based solutions, understanding the intricacies of this technology is more crucial than ever. Let’s unpack what I’ve learned!</p><p>Course : <a href="https://www.udacity.com/course/cloud-data-warehouses--cd12440">https://www.udacity.com/course/cloud-data-warehouses--cd12440</a></p><p><strong>The Evolution of Data Warehousing in the Cloud</strong></p><p>First things first, data warehousing isn’t a new concept, but its migration to the cloud has revolutionized the way we handle data. Traditional on-premise warehouses required significant upfront hardware investment and lacked the flexibility to scale. Enter cloud-based solutions, offering scalability, flexibility, and cost-effectiveness.</p><p><strong>ETL vs. ELT: A Paradigm Shift</strong></p><p>A key learning point was the evolution from ETL (Extract, Transform, Load) to ELT (Extract, Load, Transform). Traditionally, data transformation happened before loading into the warehouse. Now, with cloud warehousing, we load data first and then transform it. This shift leverages the cloud’s scalable computing power, making data transformation more efficient and just-in-time.</p><p><strong>Understanding Cloud Data Storage Options</strong></p><p>Cloud data warehousing brings an array of storage options:</p><p>1. SQL Cloud Storage: It’s familiar territory for many of us, with popular RDBMS like Oracle, SQL Server, and MySQL now available in the cloud.</p><p>2. NoSQL Cloud Storage: It’s incredibly versatile, handling a variety of data formats and structures. Cloud providers offer various NoSQL databases as managed services, making them easy to integrate into our data pipelines.</p><p><strong>The Role of Cloud Pipeline Services</strong></p><p>Data pipelines are the arteries of data warehouses, moving and transforming data. I explored tools like Azure Data Factory, AWS Glue, and GCP Dataflow. Each has unique features, but all streamline the process of moving data from source to destination.</p><p><strong>Seamlessly Combining Components with Cloud Solutions</strong></p><p>The beauty of cloud data warehousing lies in how seamlessly cloud providers integrate storage and pipeline services. Solutions like Azure Synapse, Amazon Redshift, and GCP BigQuery each have their strengths, but all provide robust platforms for data warehousing.</p><p><strong>Key Benefits Uncovered</strong></p><p>1. <strong>Scalability</strong>: The ability to scale resources based on demand is a game-changer.</p><p>2. <strong>Cost-Effectiveness</strong>: By leveraging cloud databases, we can shift costly transformations to later stages, aligning them with business priorities.</p><p>3. <strong>Flexibility</strong>: The cloud adapts to our business needs, allowing us to modify resources as required.</p><p><strong>Decision Making in Cloud Warehousing</strong></p><p>An important aspect I learned was the necessity to make informed decisions about using relational vs. NoSQL databases, ETL vs. ELT processes, and choosing the right data pipeline tools. Each project demands a tailored approach, and understanding these components is key to building efficient data warehouses.</p><p><strong>Conclusion: Riding the Cloud Wave</strong></p><p>This journey into cloud data warehousing has been enlightening. As a budding data engineer or business looking to harness the power of big data, diving into cloud data warehousing opens up a world of possibilities. The future is in the clouds, and I’m excited to see where this knowledge takes me!</p><p>Stay tuned for more insights as I continue exploring the vast skies of cloud computing and data analytics! 🌥️📊</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/635/1*8rywhPETHvh4VmilZwOwmQ.png" /></figure><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=18d536b5ac7a" width="1" height="1" alt="">]]></content:encoded>
        </item>
    </channel>
</rss>