<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0" xmlns:cc="http://cyber.law.harvard.edu/rss/creativeCommonsRssModule.html">
    <channel>
        <title><![CDATA[Stories by santosh kumar gouda on Medium]]></title>
        <description><![CDATA[Stories by santosh kumar gouda on Medium]]></description>
        <link>https://medium.com/@sgouda835?source=rss-b2343fc5aaa9------2</link>
        <image>
            <url>https://cdn-images-1.medium.com/fit/c/150/150/1*tmCcVdkxacocl71TxEytDQ.png</url>
            <title>Stories by santosh kumar gouda on Medium</title>
            <link>https://medium.com/@sgouda835?source=rss-b2343fc5aaa9------2</link>
        </image>
        <generator>Medium</generator>
        <lastBuildDate>Wed, 18 Nov 2026 14:28:10 GMT</lastBuildDate>
        <atom:link href="https://medium.com/@sgouda835/feed" rel="self" type="application/rss+xml"/>
        <webMaster><![CDATA[yourfriends@medium.com]]></webMaster>
        <atom:link href="http://medium.superfeedr.com/" rel="hub"/>
        <item>
            <title><![CDATA[Data Engineering Best Practices for Production Data Pipelines]]></title>
            <link>https://sgouda835.medium.com/data-engineering-best-practices-for-production-data-pipelines-1b9fdc5df863?source=rss-b2343fc5aaa9------2</link>
            <guid isPermaLink="false">https://medium.com/p/1b9fdc5df863</guid>
            <category><![CDATA[production]]></category>
            <category><![CDATA[real-world]]></category>
            <category><![CDATA[data-engineer]]></category>
            <dc:creator><![CDATA[santosh kumar gouda]]></dc:creator>
            <pubDate>Thu, 27 Mar 2025 15:59:03 GMT</pubDate>
            <atom:updated>2025-03-27T15:59:03.796Z</atom:updated>
            <content:encoded><![CDATA[<p>Building robust, scalable, and maintainable data pipelines in production requires adherence to best practices. Below are key principles along with code examples (Python/SQL) to ensure reliability and efficiency.</p><h3>1. Modular and Maintainable Code</h3><p>Break pipelines into reusable components (functions, classes, or modules) to improve readability and maintainability.</p><p>Example: Modular Pipeline in Python</p><pre>import pandas as pd<br>def extract_data(source_path: str) -&gt; pd.DataFrame:<br>    &quot;&quot;&quot;Extract data from source.&quot;&quot;&quot;<br>    return pd.read_csv(source_path)<br>def transform_data(df: pd.DataFrame) -&gt; pd.DataFrame:<br>    &quot;&quot;&quot;Apply transformations.&quot;&quot;&quot;<br>    df[&#39;processed_at&#39;] = datetime.now()<br>    df[&#39;total_sales&#39;] = df[&#39;quantity&#39;] * df[&#39;unit_price&#39;]<br>    return df<br>def load_data(df: pd.DataFrame, target_path: str) -&gt; None:<br>    &quot;&quot;&quot;Load data to destination.&quot;&quot;&quot;<br>    df.to_parquet(target_path, index=False)<br># Orchestration<br>def run_pipeline(source_path: str, target_path: str) -&gt; None:<br>    df = extract_data(source_path)<br>    df = transform_data(df)<br>    load_data(df, target_path)<br>run_pipeline(&quot;sales_raw.csv&quot;, &quot;sales_processed.parquet&quot;)</pre><h3>2. Idempotency (Avoid Duplicate Data)</h3><p>Ensure pipelines can run multiple times without duplicating data.</p><p>Example: SQL UPSERT (PostgreSQL)</p><pre>INSERT INTO sales (order_id, customer_id, amount, processed_at)<br>VALUES (&#39;123&#39;, &#39;cust_456&#39;, 100.50, NOW())<br>ON CONFLICT (order_id) <br>DO UPDATE SET <br><br>    amount = EXCLUDED.amount,<br>    processed_at = EXCLUDED.processed_at;</pre><h3>3. Incremental Processing (Avoid Full Reloads)</h3><p>Process only new or changed data to save time and resources.</p><h3>Example: Incremental Load in PySpark</h3><pre>from pyspark.sql import SparkSession<br>from pyspark.sql.functions import max as spark_max<br><br>spark = SparkSession.builder.appName(&quot;IncrementalLoad&quot;).getOrCreate()<br># Get latest processed timestamp<br>last_processed = spark.sql(&quot;SELECT MAX(updated_at) FROM sales_processed&quot;).collect()[0][0]<br># Read only new records<br>new_data = spark.read.parquet(&quot;sales_source/&quot;) \<br>    .filter(f&quot;updated_at &gt; &#39;{last_processed}&#39;&quot;)<br># Append to existing table<br>new_data.write.mode(&quot;append&quot;).saveAsTable(&quot;sales_processed&quot;)</pre><h3>4. Logging and Monitoring</h3><p>Track pipeline execution, errors, and performance.</p><h3>Example: Structured Logging in Python</h3><pre>import logging<br>from logging.handlers import RotatingFileHandler<br><br>logging.basicConfig(<br>    level=logging.INFO,<br>    format=&#39;%(asctime)s - %(levelname)s - %(message)s&#39;,<br>    handlers=[<br>        RotatingFileHandler(&quot;pipeline.log&quot;, maxBytes=1e6, backupCount=3),<br>        logging.StreamHandler()<br>    ]<br>)<br>logger = logging.getLogger(__name__)<br>try:<br>    logger.info(&quot;Starting pipeline...&quot;)<br>    run_pipeline(&quot;input.csv&quot;, &quot;output.parquet&quot;)<br>    logger.info(&quot;Pipeline completed successfully!&quot;)<br>except Exception as e:<br>    logger.error(f&quot;Pipeline failed: {str(e)}&quot;, exc_info=True)</pre><h3>5. Automated Testing</h3><p>Test data transformations to ensure correctness.</p><h3>Example: Unit Test with PyTest</h3><pre>import pytest<br><br>def test_transform_data():<br>    input_data = pd.DataFrame({<br>        &#39;quantity&#39;: [2, 3],<br>        &#39;unit_price&#39;: [10, 20]<br>    })<br>    expected_output = pd.DataFrame({<br>        &#39;quantity&#39;: [2, 3],<br>        &#39;unit_price&#39;: [10, 20],<br>        &#39;total_sales&#39;: [20, 60],<br>        &#39;processed_at&#39;: [datetime.now(), datetime.now()]<br>    })<br>    result = transform_data(input_data)<br>    pd.testing.assert_frame_equal(result[[&#39;quantity&#39;, &#39;unit_price&#39;, &#39;total_sales&#39;]], <br>                                 expected_output[[&#39;quantity&#39;, &#39;unit_price&#39;, &#39;total_sales&#39;]])</pre><h3>6. Error Handling &amp; Retries</h3><p>Handle transient failures gracefully (e.g., API timeouts).</p><h3>Example: Retry Mechanism</h3><pre>import time<br>from tenacity import retry, stop_after_attempt, wait_exponential<br><br>@retry(stop=stop_after_attempt(3), wait=wait_exponential(multiplier=1, min=4, max=10))<br>def fetch_api_data(url):<br>    response = requests.get(url)<br>    response.raise_for_status()<br>    return response.json()</pre><h3>7. Data Validation</h3><p>Ensure data quality before processing.</p><h3>Example: Using Pandera for Schema Validation</h3><pre>import pandera as pa<br><br>schema = pa.DataFrameSchema({<br>    &quot;order_id&quot;: pa.Column(str, nullable=False),<br>    &quot;amount&quot;: pa.Column(float, pa.Check.ge(0)),<br>    &quot;customer_id&quot;: pa.Column(str, regex=r&#39;^cust_\d+$&#39;)<br>})<br>def validate_data(df: pd.DataFrame) -&gt; bool:<br>    try:<br>        schema.validate(df)<br>        return True<br>    except pa.errors.SchemaError as e:<br>        logger.error(f&quot;Data validation failed: {e}&quot;)<br>        return False</pre><h3>8. Infrastructure as Code (IaC)</h3><p>Define pipelines in version-controlled templates (e.g., Airflow, Terraform).</p><h3>Example: Airflow DAG</h3><pre>from airflow import DAG<br>from airflow.operators.python import PythonOperator<br>from datetime import datetime<br><br>dag = DAG(<br>    &#39;sales_pipeline&#39;,<br>    schedule_interval=&#39;@daily&#39;,<br>    start_date=datetime(2023, 1, 1)<br>)<br>extract_task = PythonOperator(<br>    task_id=&#39;extract&#39;,<br>    python_callable=extract_data,<br>    op_kwargs={&#39;source_path&#39;: &#39;sales_raw.csv&#39;},<br>    dag=dag<br>)<br>transform_task = PythonOperator(<br>    task_id=&#39;transform&#39;,<br>    python_callable=transform_data,<br>    dag=dag<br>)<br>extract_task &gt;&gt; transform_task</pre><h3>Conclusion</h3><p>Following these best practices ensures:<br>✅ <strong>Reliability</strong> (idempotency, error handling)<br>✅ <strong>Scalability</strong> (incremental processing, modular code)<br>✅ <strong>Maintainability</strong> (logging, testing, IaC)</p><p>By implementing these techniques, data engineers can build resilient pipelines that scale with business needs.</p><p>🔗 <strong>Further Reading:</strong></p><ul><li><a href="https://airflow.apache.org/">Apache Airflow Documentation</a></li><li><a href="https://pandera.readthedocs.io/">Pandera: Data Validation</a></li><li><a href="https://tenacity.readthedocs.io/">Tenacity: Retry Library</a></li></ul><p>Would you like a deeper dive into any of these topics? Let me know in the comments! 🚀</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=1b9fdc5df863" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Multiprocessing in Data Engineering: Boosting Performance with Parallel Processing]]></title>
            <link>https://sgouda835.medium.com/multiprocessing-in-data-engineering-boosting-performance-with-parallel-processing-82cd52cb20dc?source=rss-b2343fc5aaa9------2</link>
            <guid isPermaLink="false">https://medium.com/p/82cd52cb20dc</guid>
            <category><![CDATA[python]]></category>
            <category><![CDATA[multiprocessing]]></category>
            <dc:creator><![CDATA[santosh kumar gouda]]></dc:creator>
            <pubDate>Thu, 27 Mar 2025 15:31:59 GMT</pubDate>
            <atom:updated>2025-03-27T15:31:59.767Z</atom:updated>
            <content:encoded><![CDATA[<p>In data engineering, processing large datasets efficiently is crucial. One powerful technique to speed up data processing tasks is <strong>multiprocessing</strong>, which allows you to run multiple processes in parallel, leveraging multiple CPU cores. Unlike multithreading, which is limited by Python’s Global Interpreter Lock (GIL), multiprocessing enables true parallelism, making it ideal for CPU-bound tasks.</p><p>In this post, we’ll explore:</p><ul><li><strong>What is multiprocessing?</strong></li><li><strong>When to use multiprocessing in data engineering?</strong></li><li><strong>A practical example using Python’s </strong><strong>multiprocessing module.</strong></li></ul><h3>What is Multiprocessing?</h3><p>Multiprocessing is a Python module that allows the execution of multiple processes concurrently, bypassing the GIL by creating separate memory spaces for each process. This is especially useful for:</p><ul><li>Processing large datasets in chunks.</li><li>Running CPU-intensive tasks (e.g., data transformations, aggregations).</li><li>Speeding up ETL (Extract, Transform, Load) pipelines.</li></ul><h3>When to Use Multiprocessing in Data Engineering?</h3><p>Consider multiprocessing when:<br>✔ <strong>The task is CPU-bound</strong> (e.g., heavy computations).<br>✔ <strong>Data can be split into independent chunks</strong> (e.g., processing files in parallel).<br>✔ <strong>You need to maximize resource utilization</strong> (e.g., running on multi-core servers).</p><p>Avoid multiprocessing for:<br>❌ <strong>I/O-bound tasks</strong> (use multithreading or async I/O instead).<br>❌ <strong>Small datasets</strong> (overhead may outweigh benefits).</p><h3>Example: Parallel Processing of Large CSV Files</h3><p>Let’s say we have a large CSV file, and we want to:</p><ol><li><strong>Split the file into chunks</strong>.</li><li><strong>Process each chunk in parallel</strong> (e.g., filtering, aggregating).</li><li><strong>Combine results</strong>.</li></ol><h3>Step-by-Step Implementation</h3><p>We’ll use Python’s multiprocessing.Pool for parallel execution.</p><pre>import pandas as pd<br>from multiprocessing import Pool, cpu_count<br>import os<br><br># Sample function to process a chunk of data<br>def process_chunk(chunk):<br>    # Example: Filter rows where &#39;value&#39; &gt; 50 and compute mean<br>    filtered = chunk[chunk[&#39;value&#39;] &gt; 50]<br>    mean_val = filtered[&#39;value&#39;].mean()<br>    return mean_val<br>def parallel_process_csv(file_path, chunk_size=10000):<br>    # Determine the number of CPU cores<br>    num_cores = cpu_count()<br>    <br>    # Read CSV in chunks<br>    chunks = pd.read_csv(file_path, chunksize=chunk_size)<br>    <br>    # Create a multiprocessing Pool<br>    with Pool(num_cores) as pool:<br>        # Process chunks in parallel<br>        results = pool.map(process_chunk, chunks)<br>    <br>    # Combine results (e.g., average of all chunk means)<br>    final_result = sum(results) / len(results)<br>    return final_result<br>if __name__ == &quot;__main__&quot;:<br>    # Example usage<br>    file_path = &quot;large_dataset.csv&quot;<br>    result = parallel_process_csv(file_path)<br>    print(f&quot;Final mean value (filtered): {result}&quot;)</pre><h3>Explanation:</h3><ol><li><strong>process_chunk()</strong> – Processes a single chunk (e.g., filtering and computing mean).</li><li><strong>parallel_process_csv()</strong> – Reads the CSV in chunks and distributes work across CPU cores.</li><li><strong>Pool.map()</strong> – Executes process_chunk in parallel.</li><li><strong>Combining results</strong> — Aggregates results from all processes.</li></ol><h3>Best Practices for Multiprocessing in Data Engineering</h3><ol><li><strong>Avoid Shared State</strong>: Each process should work independently to prevent race conditions.</li><li><strong>Use Chunking</strong>: Break large datasets into manageable pieces.</li><li><strong>Monitor Resource Usage</strong>: Too many processes can lead to memory issues.</li><li><strong>Consider </strong><strong>multiprocessing.Manager</strong> for shared data (but use sparingly).</li><li><strong>Benchmark Performance</strong>: Compare sequential vs. parallel execution to ensure efficiency.</li></ol><h3>Conclusion</h3><p>Multiprocessing is a powerful tool for data engineers working with large-scale datasets. By distributing workloads across CPU cores, you can significantly reduce processing time. However, it’s essential to:</p><ul><li><strong>Choose the right task</strong> (CPU-bound, parallelizable).</li><li><strong>Optimize chunk sizes</strong> (balance overhead vs. parallelism).</li><li><strong>Test and benchmark</strong> to ensure efficiency gains.</li></ul><p>Have you used multiprocessing in your data pipelines? Share your experiences in the comments! 🚀</p><p><strong>Further Reading:</strong></p><ul><li><a href="https://docs.python.org/3/library/multiprocessing.html">Python Multiprocessing Docs</a></li><li><a href="https://dask.org/">Dask for Parallel Computing</a></li><li><a href="https://pandas.pydata.org/docs/user_guide/scale.html">Pandas + Multiprocessing Best Practices</a></li></ul><p>#DataEngineering #Python #Multiprocessing #BigData #PerformanceOptimization</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=82cd52cb20dc" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Handling Large Data Volumes (100GB — 1TB) in PySpark: Best Practices & Optimizations]]></title>
            <link>https://sgouda835.medium.com/handling-large-data-volumes-100gb-1tb-in-pyspark-best-practices-optimizations-b0ce2fe73f24?source=rss-b2343fc5aaa9------2</link>
            <guid isPermaLink="false">https://medium.com/p/b0ce2fe73f24</guid>
            <category><![CDATA[spark]]></category>
            <category><![CDATA[big-data]]></category>
            <dc:creator><![CDATA[santosh kumar gouda]]></dc:creator>
            <pubDate>Thu, 27 Mar 2025 10:45:06 GMT</pubDate>
            <atom:updated>2025-03-27T10:45:06.304Z</atom:updated>
            <content:encoded><![CDATA[<h3>Handling Large Data Volumes (100GB — 1TB) in PySpark: Best Practices &amp; Optimizations</h3><p>Processing large datasets efficiently is critical for modern data-driven businesses, whether for analytics, machine learning, or real-time processing. PySpark, the Python API for Apache Spark, provides a scalable, distributed framework capable of handling datasets ranging from <strong>100GB to 1TB</strong> (and beyond) with ease.</p><p>In this guide, we’ll explore best practices, optimization techniques, and step-by-step implementations to maximize PySpark’s performance when working with large-scale data.</p><h3>1. Why PySpark for Large-Scale Data Processing?</h3><p>PySpark leverages Apache Spark’s distributed computing engine, offering:</p><p>✔ <strong>Distributed Processing</strong> — Data is split across multiple nodes for parallel execution.<br>✔ <strong>Resilient Distributed Datasets (RDDs)</strong> — Fault-tolerant data structures for efficient computation.<br>✔ <strong>DataFrame API</strong> — Optimized query execution via Catalyst optimizer and Tungsten execution engine.<br>✔ <strong>Lazy Evaluation</strong> — Avoids unnecessary computations until an action (e.g., .show(), .count()) is called.</p><h3>2. Setting Up PySpark for Large Data</h3><p>First, install PySpark:</p><pre>pip install pyspark</pre><p>Then, configure your Spark session for optimal performance:</p><pre>from pyspark.sql import SparkSession<br>spark = SparkSession.builder \<br>    .appName(&quot;LargeDataProcessing&quot;) \<br>    .config(&quot;spark.sql.shuffle.partitions&quot;, &quot;200&quot;) \  # Adjust based on data size<br>    .config(&quot;spark.driver.memory&quot;, &quot;8g&quot;) \            # Increase if needed<br>    .config(&quot;spark.executor.memory&quot;, &quot;16g&quot;) \         # Allocate more for large jobs<br>    .getOrCreate()</pre><h3>3. Efficiently Reading Large Datasets</h3><h3>Choose the Right File Format</h3><p>Avoid CSV/JSON for large datasets — use <strong>Parquet</strong> or <strong>ORC</strong> for:<br>✅ <strong>Columnar storage</strong> (faster reads)<br>✅ <strong>Compression</strong> (smaller file sizes)<br>✅ <strong>Schema retention</strong></p><pre>df = spark.read.format(&quot;parquet&quot;).load(&quot;hdfs:///data/large_dataset.parquet&quot;)<br>df.show(5)</pre><h3>Partitioning &amp; Bucketing</h3><ul><li><strong>Partitioning</strong> splits data into directories (e.g., by date):</li><li>Bucketing groups data within partitions for optimized joins.</li></ul><pre>df.write.partitionBy(&quot;date&quot;).parquet(&quot;hdfs:///data/partitioned_dataset&quot;)</pre><pre>df.write.bucketBy(10, &quot;customer_id&quot;).saveAsTable(&quot;bucketed_table&quot;)</pre><h3>4. Optimizing Transformations</h3><h3>Use DataFrame API Over RDDs</h3><p>DataFrame operations are optimized under the hood:</p><pre>df_filtered = df.filter(df[&quot;sales&quot;] &gt; 5000)<br>df_grouped = df_filtered.groupBy(&quot;category&quot;).sum(&quot;sales&quot;)<br>df_grouped.show()</pre><h3>Handle Skewed Data</h3><p>Skewed data can slow down processing. Check distribution:</p><pre>df.groupBy(&quot;category&quot;).count().show()</pre><p>Repartition to balance data:</p><pre>df = df.repartition(&quot;category&quot;)  # Or manually: df.repartition(200)</pre><h3>5. Tuning Spark Configurations</h3><h3>Adjust Shuffle Partitions &amp; Memory</h3><pre>spark.conf.set(&quot;spark.sql.shuffle.partitions&quot;, &quot;400&quot;)  # Default is 200<br>spark.conf.set(&quot;spark.executor.memory&quot;, &quot;32g&quot;)         # Increase for heavy workloads</pre><h3>Use Broadcast Joins for Small Tables</h3><p>Avoid shuffling by broadcasting small DataFrames:</p><pre>from pyspark.sql.functions import broadcast</pre><pre>df_large = spark.read.parquet(&quot;hdfs:///data/large_dataset.parquet&quot;)<br>df_small = spark.read.parquet(&quot;hdfs:///data/small_lookup.parquet&quot;)<br>result_df = df_large.join(broadcast(df_small), &quot;key_column&quot;)</pre><h3>6. Writing Large Data Efficiently</h3><h3>Best Practices for Writing Data</h3><p><strong>Use Parquet/ORC</strong> for storage efficiency.</p><p><strong>Coalesce partitions</strong> to reduce output files:</p><pre>df.coalesce(10).write.format(&quot;parquet&quot;).save(&quot;hdfs:///data/output&quot;)</pre><p><strong>Overwrite mode</strong> to avoid duplicates:</p><pre>df.write.mode(&quot;overwrite&quot;).parquet(&quot;hdfs:///data/output&quot;)</pre><h3>7. Monitoring &amp; Debugging Performance</h3><h3>Spark UI for Job Insights</h3><p>Access the Spark Web UI at:</p><pre>http://localhost:4040</pre><h3>Analyze Query Execution Plans</h3><p>Check optimization opportunities with:</p><pre>df.explain(True)  # Displays physical/logical plansConclusion</pre><p>Handling <strong>100GB to 1TB datasets</strong> in PySpark requires:<br>✔ <strong>Efficient file formats</strong> (Parquet/ORC)<br>✔ <strong>Smart partitioning &amp; bucketing</strong><br>✔ <strong>Optimized transformations</strong> (avoiding skew, using broadcast joins)<br>✔ <strong>Proper Spark configurations</strong> (memory, partitions)<br>✔ <strong>Performance monitoring</strong> (Spark UI, query plans)</p><p>By applying these best practices, you can significantly improve processing speed, scalability, and reliability in large-scale PySpark workflows.</p><p><strong>Got questions or additional tips? Drop a comment below!</strong> 🚀</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=b0ce2fe73f24" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Supercharge Your Terminal with My Awesome Tmux Configuration]]></title>
            <link>https://sgouda835.medium.com/supercharge-your-terminal-with-my-awesome-tmux-configuration-5f87234e9110?source=rss-b2343fc5aaa9------2</link>
            <guid isPermaLink="false">https://medium.com/p/5f87234e9110</guid>
            <category><![CDATA[tmux]]></category>
            <dc:creator><![CDATA[santosh kumar gouda]]></dc:creator>
            <pubDate>Sun, 23 Mar 2025 17:25:15 GMT</pubDate>
            <atom:updated>2025-03-23T17:25:15.773Z</atom:updated>
            <content:encoded><![CDATA[<p>Tmux is a powerful terminal multiplexer that allows you to split your terminal into multiple panes and windows, making it easier to manage and organize your workflow. If you’re looking to enhance your terminal experience, my <strong>Awesome Tmux Configuration</strong> is here to help! With features like mouse support, a rich status bar, and intuitive key bindings, this configuration will take your productivity to the next level.</p><h3>Why Use This Configuration?</h3><p>This configuration is designed to make Tmux more user-friendly and feature-rich. Here’s what you get:</p><ul><li><strong>Mouse Support</strong>: Navigate Tmux with your mouse effortlessly.</li><li><strong>Custom Status Bar</strong>: Stay informed with a detailed status bar at the top.</li><li><strong>Automatic Window Renumbering</strong>: No more gaps in your window numbers.</li><li><strong>256-Color Support</strong>: Enjoy a vibrant terminal experience.</li><li><strong>Intuitive Key Bindings</strong>: Switch panes, windows, and sessions with ease.</li></ul><h3>Installation</h3><p>Getting started is simple:</p><ol><li><strong>Install Tmux</strong>: Ensure Tmux is installed on your system.</li></ol><pre>sudo apt install tmux</pre><ol><li><strong>Clone the Configuration</strong>: Run the following commands in your terminal:</li></ol><pre>git clone https://github.com/YanivZalach/Tmux_Config.git ~/.Tmux_Config <br>mv ~/.Tmux_Config/.tmux.conf ~/.</pre><pre>vi .tmux.conf<br><br>sudo apt install tmux<br><br>git clone https://github.com/YanivZalach/Tmux_Config.git ~/.Tmux_Config<br>mv ~/.Tmux_Config/.tmux.conf ~/.<br>vi .tmux.conf<br><br><br># _________  _____ ______   ___  ___     ___    ___ <br>#|\___   ___\\   _ \  _   \|\  \|\  \   |\  \  /  /|<br>#\|___ \  \_\ \  \\\__\ \  \ \  \\\  \  \ \  \/  / /<br>#     \ \  \ \ \  \\|__| \  \ \  \\\  \  \ \    / / <br>#      \ \  \ \ \  \    \ \  \ \  \\\  \  /     \/  <br>#       \ \__\ \ \__\    \ \__\ \_______\/  /\   \  <br>#        \|__|  \|__|     \|__|\|_______/__/ /\ __\ <br>#                                       |__|/ \|__| <br>#<br>#------------------PREFIX------------------<br><br># Use C-a as the prefix key, which is on the home row and easier to reach than C-b.<br>set -g prefix C-a<br>set -g prefix2 C-x<br>bind C-a send-prefix<br> <br>#------------------SETTINGS------------------<br> <br># Use Vi-like keybindings<br>set-window-option -g mode-keys vi<br><br># Enable mouse support<br>set-option -g mouse on<br><br># Allow immediate use of arrow keys after changing windows<br>set-option -g repeat-time 0<br><br># Automatically renumber windows to fill gaps<br>set-option -g renumber-windows on<br><br># Set the default terminal to support 256 colors<br>set-option -g default-terminal tmux-256color<br><br># Set window options and layout preferences<br>set-window-option -g other-pane-height 70<br>set-window-option -g other-pane-width 80<br>set-window-option -g display-panes-time 1500<br><br># Set window notifications<br>set-window-option -g monitor-activity on<br>set-option -g visual-activity on<br><br><br># Disable assume-paste-time for compatibility with iTerm6&#39;s &quot;Send Hex Codes&quot; feature<br>set-option -g assume-paste-time 0<br><br><br>#------------------STATUS_LINE------------------<br><br># Move the status bar to the top of the terminal window<br>set-option -g status-position bottom<br><br><br># Other status bar settings<br>set-option -g status-interval 1<br><br># Info displayed<br>set-option -g status-left &#39;[#S] &#39;<br>set-option -g status-right &#39;#{?selection_present,#[reverse]&lt;Copy Mode&gt;#[noreverse] ,} #{?pane_synchronized,#[reverse]&lt;Pane Sync&gt;#[noreverse] ,} #{?client_prefix,#[reverse]&lt;Prefix&gt;#[noreverse] ,} #{=21:pane_title} %H:%M %d-%b-%y&#39;<br>set-option -g status-fg default<br><br><br>#------------------COLORS------------------<br><br># Pane and border colors<br>set-option -g pane-active-border-style bg=black<br>set-option -g status-style bg=cyan,fg=black<br><br># Set the separator style for panes<br>set-option -g pane-border-style fg=cyan<br>set-option -g pane-active-border-style fg=blue<br><br>set-window-option -g window-status-current-style fg=yellow,bold,bg=black<br><br><br>#------------------KEY_BINDINGS------------------<br><br># Configuration reload<br>bind-key r source-file ~/.tmux.conf \; display-message &quot;tmux.conf reloaded.&quot;<br><br><br># Quitting TMUX<br>bind-key X confirm-before -p &quot;Kill this windows? (y/n)&quot; &quot;kill-window&quot;<br>bind-key Q confirm-before -p &quot;Kill session #S? (y/n)&quot; kill-session<br>bind-key q confirm-before -p &quot;Kill this pane? (y/n)&quot; &quot;kill-pane&quot;<br><br><br># Use Ctrl-a followed by s to detach (equivalent to Ctrl-b d)<br>bind s detach-client<br><br><br># Command Prompt<br>bind-key : command-prompt<br><br># clearing the terminal window<br>bind C-l send-keys &#39;C-l&#39;<br><br><br>#---Session---<br># Switch sessions with a convenient keybinding<br>bind-key C-s choose-tree<br><br># Rename the name of a session<br>bind-key M command-prompt -p &quot;Rename session:&quot; &quot;rename-session &#39;%%&#39;&quot;<br><br><br><br># ---WINDOWS---<br># Creating a new window<br>bind-key c new-window<br><br># Moving throw the windows-Tab<br>bind-key t next-window<br>bind-key T previous-window<br>bind-key C-o rotate-window<br><br># Moving throw the windows using the Shift+Arrow Key<br>bind -n S-Left previous-window<br>bind -n S-Right next-window<br><br># Reordering the windows using Ctrl+Shift+Arrow Key<br>bind-key -n C-S-Left swap-window -t -1<br>bind-key -n C-S-Right swap-window -t +1<br><br><br># Rename the name of a window<br>bind-key m command-prompt -p &quot;Rename window:&quot; &quot;rename-window &#39;%%&#39;&quot;<br><br><br><br># ---PANES---<br><br># Enable smart pane switching with Vim\Nvim awareness<br># If not in Vim/Nvim: Ctrl + h/j/k/l -&gt; movment between payes AND Alt + Arrow Keys resize panes<br># Vim<br># Moving<br>bind -n C-h run &quot;(tmux display-message -p &#39;#{pane_current_command}&#39; | grep -iqE &#39;(^|\/)vim$&#39; &amp;&amp; tmux send-keys C-h) || tmux select-pane -L&quot;<br>bind -n C-j run &quot;(tmux display-message -p &#39;#{pane_current_command}&#39; | grep -iqE &#39;(^|\/)vim$&#39; &amp;&amp; tmux send-keys C-j) || tmux select-pane -D&quot;<br>bind -n C-k run &quot;(tmux display-message -p &#39;#{pane_current_command}&#39; | grep -iqE &#39;(^|\/)vim$&#39; &amp;&amp; tmux send-keys C-k) || tmux select-pane -U&quot;<br>bind -n C-l run &quot;(tmux display-message -p &#39;#{pane_current_command}&#39; | grep -iqE &#39;(^|\/)vim$&#39; &amp;&amp; tmux send-keys C-l) || tmux select-pane -R&quot;<br>bind -n C-\\ run &quot;(tmux display-message -p &#39;#{pane_current_command}&#39; | grep -iqE &#39;(^|\/)vim$&#39; &amp;&amp; tmux send-keys &#39;C-\\&#39;) || tmux select-pane -l&quot;<br>#Nvim<br># Moving<br>bind -n C-h run &quot;(tmux display-message -p &#39;#{pane_current_command}&#39; | grep -iqE &#39;(^|\/)nvim$&#39; &amp;&amp; tmux send-keys C-h) || tmux select-pane -L&quot;<br>bind -n C-j run &quot;(tmux display-message -p &#39;#{pane_current_command}&#39; | grep -iqE &#39;(^|\/)nvim$&#39; &amp;&amp; tmux send-keys C-j) || tmux select-pane -D&quot;<br>bind -n C-k run &quot;(tmux display-message -p &#39;#{pane_current_command}&#39; | grep -iqE &#39;(^|\/)nvim$&#39; &amp;&amp; tmux send-keys C-k) || tmux select-pane -U&quot;<br>bind -n C-l run &quot;(tmux display-message -p &#39;#{pane_current_command}&#39; | grep -iqE &#39;(^|\/)nvim$&#39; &amp;&amp; tmux send-keys C-l) || tmux select-pane -R&quot;<br>bind -n C-\\ run &quot;(tmux display-message -p &#39;#{pane_current_command}&#39; | grep -iqE &#39;(^|\/)nvim$&#39; &amp;&amp; tmux send-keys &#39;C-\\&#39;) || tmux select-pane -l&quot;<br># Resizing<br>bind -n M-Left run &quot;(tmux display-message -p &#39;#{pane_current_command}&#39; | grep -iqE &#39;(^|\/)nvim$&#39; &amp;&amp; tmux send-keys M-Left) || tmux resize-pane -L 5&quot;<br>bind -n M-Down run &quot;(tmux display-message -p &#39;#{pane_current_command}&#39; | grep -iqE &#39;(^|\/)nvim$&#39; &amp;&amp; tmux send-keys M-Down) || tmux resize-pane -D  5&quot;<br>bind -n M-Up run &quot;(tmux display-message -p &#39;#{pane_current_command}&#39; | grep -iqE &#39;(^|\/)nvim$&#39; &amp;&amp; tmux send-keys M-Up) || tmux resize-pane -U 5&quot;<br>bind -n M-Right run &quot;(tmux display-message -p &#39;#{pane_current_command}&#39; | grep -iqE &#39;(^|\/)nvim$&#39; &amp;&amp; tmux send-keys M-Right) || tmux resize-pane -R 5&quot;<br><br># Moving throw panes in a Vim/Nvim window<br>bind-key Left select-pane -L<br>bind-key Down select-pane -D<br>bind-key Up select-pane -U<br>bind-key Right select-pane -R<br><br># Resizing the panes with Arrow Key<br>bind-key h resize-pane -L 7<br>bind-key j resize-pane -D 7<br>bind-key k resize-pane -U 7<br>bind-key l resize-pane -R 7<br><br># Use My-Vim-like keys for splitting and managing panes<br>bind-key x split-window -h -c &quot;#{pane_current_path}&quot;<br>bind-key y split-window -v -c &quot;#{pane_current_path}&quot;<br><br># Synchronize panes<br>bind S set-window-option synchronize-pane\; display-message &quot;synchronize mode toggled.&quot;<br><br># Panes layout<br>bind-key C-y select-layout main-horizontal<br>bind-key C-x select-layout main-vertical<br>bind-key enter next-layout<br><br># Pane circling<br>bind-key e last-pane<br>bind-key d display-panes<br><br># Custom keybindings for various actions<br>bind-key R refresh-client<br>bind-key Y clear-history<br><br><br># ---Copy Mode---<br># Enter copy mode<br>bind-key [ copy-mode<br><br># Past from clipboard<br>bind-key ] paste-buffer<br><br># In copy mode Vim-like bindings <br>bind-key -Tcopy-mode-vi &#39;v&#39; send -X begin-selection<br>bind-key -Tcopy-mode-vi &#39;y&#39; send -X copy-pipe-and-cancel &quot;reattach-to-user-namespace pbcopy&quot;<br><br># Fix to allow mouse wheel/trackpad scrolling in tmux 2.1<br>#bind-key -T root WheelUpPane if-shell -F -t = &quot;#{alternate_on}&quot; &quot;send-keys -M&quot; &quot;select-pane -t =; copy-mode -e; send-keys -M&quot;<br>#bind-key -T root WheelDownPane if-shell -F -t = &quot;#{alternate_on}&quot; &quot;send-keys -M&quot; &quot;select-pane -t =; send-keys -M&quot;<br><br><br></pre><h3>Usage, Features, and Special Key Bindings 🚀🪙</h3><p>Get ready to supercharge your Tmux experience</p><p>Features 🎉</p><ul><li>🖱️ Mouse Support: Enjoy using the mouse in Tmux with your preferred terminal emulator.</li><li>⏱️ Status Bar: Information-rich status bar displayed at the top.</li><li>🔄 Automatic Renumbering: Windows are automatically renumbered to fill gaps.</li><li>🔁 Immediate Window Switching: Quickly change windows using arrow keys.</li><li>🌈 256 Colors: Supports 256-color terminals for a colorful experience.</li></ul><p>Key Bindings</p><ul><li>Prefix Key 🌟</li><li>🎯 C-a , C-x: Your starting point. This is the prefix key. All Tmux commands begin with this key followed by another keybinding.</li></ul><p>General Commands 🛠️</p><ul><li>🧲 &lt;Prefix&gt; s: Detouch (quit and save) Tmux session.</li><li>M &lt;Prefix&gt; :: Command Prompt</li><li>🔄 &lt;Prefix&gt; r: Reload your Tmux configuration.</li><li>🪟 &lt;Prefix&gt; q: Confirm and kill the current pane.</li><li>🚪 &lt;Prefix&gt; X: Confirm and kill the current window.</li><li>🪟 &lt;Prefix&gt; Q: Confirm and kill the entire session.</li><li>📋 &lt;Prefix&gt; C-l: Clearing the terminal window</li></ul><p>Session Management 🪟</p><ul><li>📊&lt;Prefix&gt; C-s: Session Tree</li><li>📛 &lt;Prefix&gt; M: Rename the current session.</li></ul><p>Window Management 🪟</p><ul><li>🪟 &lt;Prefix&gt; c: Create a new Tmux window.</li><li>🖍️ &lt;Prefix&gt; m: Rename the current window.</li><li>⬅️ S-Left: Move to the Left window.</li><li>➡️ S-Right: Move to the Right window.</li><li>🔀 C-S-Left: Move window to the Left.</li><li>🔀 C-S-Right: Move window to the Right .</li><li>🔄 &lt;Prefix&gt; t: Move to the next window.</li><li>🔄 &lt;Prefix&gt; T: Move to the previous window.</li><li>🔃 &lt;Prefix&gt; C-o: Rotate windows (circularly).</li></ul><p>Pane Management 🪟</p><ul><li>🔗&lt;Prefix&gt; S: Synchronize panes.</li><li>📊&lt;Prefix&gt; d: Display pane numbers.</li><li>🧩&lt;Prefix&gt; e: Move to the previously active pane.</li><li>➡️ &lt;Prefix&gt; x: Split the current pane horizontally (x axis).</li><li>⬇️ &lt;Prefix&gt; y: Split the current pane vertically (y axis).</li><li>📊&lt;Prefix&gt; C-y: Use a horizontal layout.</li><li>📊&lt;Prefix&gt; C-x: Use a vertical layout.</li><li>⏩&lt;Prefix&gt; Enter: Switch to the next layout.</li><li>⬅️ A-Left: Resize pane to the left Not in Nvim.</li><li>➡️ A-Right: Resize pane to the right Not in Nvim.</li><li>⬆️ A-Up: Resize pane up Not in Nvim.</li><li>⬇️ A-Down: Resize pane down Not in Nvim.</li><li>⬅️ &lt;Prefix&gt;-Left: Resize pane to the left.</li><li>➡️ &lt;Prefix&gt;-Right: Resize pane to the right.</li><li>⬆️ &lt;Prefix&gt;-Up: Resize pane up.</li><li>⬇️ &lt;Prefix&gt;-Down: Resize pane down.</li><li>⬅️ C-h: Move to the pane on the left Not in Vim/Nvim.</li><li>➡️ C-l: Move to the pane on the right Not in Vim/Nvim.</li><li>⬆️ C-k: Move to the pane above Not in Vim/Nvim.</li><li>⬇️ C-j: Move to the pane below Not in Vim/Nvim.</li><li>⬅️ &lt;Prefix&gt; h: Move to the pane on the left.</li><li>➡️ &lt;Prefix&gt; j: Move to the pane on the right.</li><li>⬆️ &lt;Prefix&gt; k: Move to the pane above.</li><li>⬇️ &lt;Prefix&gt; l: Move to the pane below.</li><li>Copy Mode 📋</li><li>📋&lt;Prefix&gt; [: Enter copy mode.</li><li>📋&lt;Prefix&gt; ]: Paste from the clipboard.</li><li>✂️ v: Start selection (while in copy mode).</li><li>📋y: Copy selected text to the system clipboard (in MacOS requires reattach-to-user-namespace).</li></ul><h3>Acknowledgments</h3><p>A big thank you to the Tmux community for their support and contributions.</p><p>Happy Tmuxing! 🎉</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=5f87234e9110" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Setting Up Neovim for a Modern Development EnvironmentC,C++,Python, Bash]]></title>
            <link>https://sgouda835.medium.com/setting-up-neovim-for-a-modern-development-environmentc-c-python-bash-d140286c692f?source=rss-b2343fc5aaa9------2</link>
            <guid isPermaLink="false">https://medium.com/p/d140286c692f</guid>
            <category><![CDATA[neovim]]></category>
            <category><![CDATA[setup]]></category>
            <dc:creator><![CDATA[santosh kumar gouda]]></dc:creator>
            <pubDate>Sat, 22 Mar 2025 09:12:18 GMT</pubDate>
            <atom:updated>2025-03-22T10:33:24.166Z</atom:updated>
            <content:encoded><![CDATA[<p>Neovim is a powerful, extensible, and highly customizable text editor that has gained immense popularity among developers. With its rich plugin ecosystem and support for modern development tools, Neovim can be transformed into a full-fledged IDE. In this guide, we’ll walk through setting up Neovim (version &gt; 0.9.0) and configuring it for a seamless development experience.</p><h3>Step 1: Install Neovim</h3><p>First, ensure your system is up-to-date and install Neovim:</p><pre>sudo apt update<br>sudo apt install -y neovim</pre><p>Verify the installation:</p><pre>nvim --version | head -n 1</pre><h3>Step 2: Install Node.js and npm</h3><p>Many Neovim plugins, such as coc.nvim, rely on Node.js. Install the latest version of Node.js and npm:</p><pre>curl -fsSL https://deb.nodesource.com/setup_current.x | sudo -E bash -<br>sudo apt install -y nodejs</pre><p>Verify the installation:</p><pre>node -v<br>npm -v</pre><h3>Step 3: Install Nerd Fonts</h3><p>Nerd Fonts are essential for displaying icons and glyphs in Neovim. Verify if a Nerd Font is installed:</p><pre>fc-list | grep Nerd</pre><p>If no Nerd Font is found, install one (e.g., Hack):</p><pre>mkdir -p ~/.local/share/fonts<br>cd ~/.local/share/fonts<br>wget https://github.com/ryanoasis/nerd-fonts/releases/latest/download/Hack.zip<br>unzip Hack.zip<br>fc-cache -fv</pre><h3>Step 4: Install Vim-Plug for Neovim</h3><p>Vim-Plug is a popular plugin manager for Neovim. Install it with the following command:</p><pre>curl -fLo ~/.local/share/nvim/site/autoload/plug.vim --create-dirs \<br>    https://raw.githubusercontent.com/junegunn/vim-plug/master/plug.vim</pre><h3>Step 5: Configure Neovim</h3><p>Create a configuration file for Neovim:</p><pre>mkdir -p ~/.config/nvim<br>nano ~/.config/nvim/init.vim</pre><p>Alternatively, use vi or any other text editor:</p><pre>cd ~/.config/nvim<br>vi init.vim</pre><h3>Step 6: Set Up a Python Virtual Environment</h3><p>Neovim’s Python integration requires a virtual environment. Install Python and create a virtual environment:</p><pre>sudo apt install python3.10-venv<br>python3 -m venv ~/.virtualenvs/neovim3<br>source ~/.virtualenvs/neovim3/bin/activate</pre><p>Install essential Python packages:</p><pre>pip install pynvim pylint black debugpy jedi-language-server</pre><h3>Step 7: Install Essential Development Tools</h3><p>Install tools for compiling, debugging, and formatting code:</p><pre>sudo apt install -y gcc g++ clang clangd clang-format gdb \<br>    python3 python3-pip python3-venv shellcheck shfmt unzip ripgrep</pre><h3>Step 8: Configure Neovim Settings</h3><p>Add the following configuration to your init.vim file:</p><pre>&quot; General settings<br>set encoding=UTF-8<br>set number<br>set relativenumber<br>set tabstop=4<br>set shiftwidth=4<br>set expandtab<br>set autoindent<br>set smartindent<br>set clipboard+=unnamedplus<br>set wrap<br>set cursorline<br>set termguicolors<br>set background=dark<br>syntax on<br>filetype plugin indent on<br><br>&quot; vim-plug setup<br>call plug#begin(&#39;~/.config/nvim/plugged&#39;)<br><br>&quot; --- Language Server and Code Completion ---<br>Plug &#39;neoclide/coc.nvim&#39;, {&#39;branch&#39;: &#39;release&#39;} &quot; Autocompletion &amp; LSP<br><br>&quot; --- Linting and Formatting ---<br>Plug &#39;dense-analysis/ale&#39;                    &quot; Linting and Fixing<br>Plug &#39;akinsho/toggleterm.nvim&#39;, {&#39;tag&#39; : &#39;*&#39;}<br>Plug &#39;morhetz/gruvbox&#39;<br>Plug &#39;psf/black&#39;                              &quot; Python formatter<br>Plug &#39;tell-k/vim-autopep8&#39;                    &quot; AutoPEP8 for Python<br>Plug &#39;sbdchd/neoformat&#39;                       &quot; Code formatting<br>Plug &#39;rhysd/vim-clang-format&#39;                 &quot; Clang formatting for C/C++<br>Plug &#39;neovim/nvim-lspconfig&#39;<br>Plug &#39;williamboman/mason.nvim&#39;<br>Plug &#39;williamboman/mason-lspconfig.nvim&#39;<br>&quot; --- Debugging with nvim-dap ---<br>Plug &#39;mfussenegger/nvim-dap&#39;                  &quot; Debugging (DAP)<br>Plug &#39;rcarriga/nvim-dap-ui&#39;                   &quot; UI for nvim-dap<br>Plug &#39;mfussenegger/nvim-dap-python&#39;           &quot; Python DAP<br>Plug &#39;nvim-telescope/telescope-dap.nvim&#39;      &quot; Telescope integration for DAP<br><br>&quot; --- Syntax Highlighting ---<br>Plug &#39;sheerun/vim-polyglot&#39;                   &quot; Syntax highlighting for many languages<br>Plug &#39;nvim-tree/nvim-web-devicons&#39;<br>&quot; --- File Navigation &amp; UI Enhancements ---<br>Plug &#39;preservim/nerdtree&#39;                     &quot; File tree explorer<br>Plug &#39;ryanoasis/vim-devicons&#39;                 &quot; File icons<br>Plug &#39;itchyny/lightline.vim&#39;                  &quot; Status line<br>Plug &#39;nvim-lua/plenary.nvim&#39;                  &quot; Dependency for telescope<br>Plug &#39;nvim-telescope/telescope.nvim&#39;          &quot; Fuzzy finder<br>Plug &#39;tpope/vim-fugitive&#39;                     &quot; Git integration<br>Plug &#39;airblade/vim-gitgutter&#39;                 &quot; Git changes in the gutter<br>Plug &#39;nvim-neotest/nvim-nio&#39;<br>call plug#end()<br>&quot; Select All<br>nnoremap &lt;C-a&gt; ggVG<br><br>&quot; Copy to System Clipboard<br>vnoremap &lt;C-c&gt; &quot;+y<br><br>&quot; Paste from System Clipboard<br>inoremap &lt;C-v&gt; &lt;C-r&gt;+<br>nnoremap &lt;C-v&gt; &quot;+p<br>&quot; Enable vim-devicons globally<br>let g:webdevicons_enable = 1<br><br>&quot; --- LSP and Code Completion Configuration ---<br>let g:coc_global_extensions = [&#39;coc-clangd&#39;,&#39;coc-jedi&#39;,&#39;coc-sh&#39;,&#39;coc-snippets&#39;]<br>&quot;--- NERDTree Configuration ---<br>let g:NERDTreeShowHidden=1<br>nmap &lt;C-b&gt; :NERDTreeToggle&lt;CR&gt;<br>nmap &lt;C-f&gt; :NERDTreeFind&lt;CR&gt;<br><br>&quot; --- ALE Linting Configuration ---<br>let g:ale_linters = {<br>\   &#39;python&#39;: [&#39;pylint&#39;],<br>\   &#39;cpp&#39;: [&#39;clangd&#39;],<br>\   &#39;c&#39;: [&#39;clangd&#39;],<br>\   &#39;sh&#39;: [&#39;shellcheck&#39;]<br>\}<br>let g:ale_fixers = {<br>\   &#39;python&#39;: [&#39;black&#39;, &#39;autopep8&#39;],<br>\   &#39;cpp&#39;: [&#39;clang-format&#39;],<br>\   &#39;c&#39;: [&#39;clang-format&#39;],<br>\   &#39;sh&#39;: [&#39;shfmt&#39;]<br>\}<br>let g:ale_fix_on_save = 1<br>nnoremap &lt;C-s&gt; :w&lt;CR&gt;:ALEFix&lt;CR&gt;:ALELint&lt;CR&gt;<br>inoremap &lt;C-s&gt; &lt;Esc&gt;:w&lt;CR&gt;:ALEFix&lt;CR&gt;:ALELint&lt;CR&gt;a<br><br>&quot; open NERDTree automatically<br>autocmd StdinReadPre * let s:std_in=1<br>autocmd VimEnter * NERDTree<br><br>let g:NERDTreeGitStatusWithFlags = 1<br>&quot;let g:WebDevIconsUnicodeDecorateFolderNodes = 1<br>&quot;let g:NERDTreeGitStatusNodeColorization = 1<br>&quot;let g:NERDTreeColorMapCustom = {<br>    &quot;\ &quot;Staged&quot;    : &quot;#0ee375&quot;,  <br>    &quot;\ &quot;Modified&quot;  : &quot;#d9bf91&quot;,  <br>    &quot;\ &quot;Renamed&quot;   : &quot;#51C9FC&quot;,  <br>    &quot;\ &quot;Untracked&quot; : &quot;#FCE77C&quot;,  <br>    &quot;\ &quot;Unmerged&quot;  : &quot;#FC51E6&quot;,  <br>    &quot;\ &quot;Dirty&quot;     : &quot;#FFBD61&quot;,  <br>    &quot;\ &quot;Clean&quot;     : &quot;#87939A&quot;,   <br>    &quot;\ &quot;Ignored&quot;   : &quot;#808080&quot;   <br>    &quot;\ }                         <br><br>let g:coc_config = {<br>    \ &#39;jedi.enabled&#39;: v:true,<br>    \ &#39;jedi.executable&#39;: &#39;jedi-language-server&#39;,<br>    \}<br><br>let g:NERDTreeIgnore = [&#39;^node_modules$&#39;]<br>&quot; --- Debugging (nvim-dap) ---<br>lua &lt;&lt; EOF<br>local dap = require(&#39;dap&#39;)<br>local dapui = require(&#39;dapui&#39;)<br><br>require(&#39;dapui&#39;).setup()<br><br>-- Python Debugging<br>require(&#39;dap-python&#39;).setup(&#39;~/.virtualenvs/debugpy/bin/python&#39;)<br><br>-- Key mappings for debugging<br>vim.api.nvim_set_keymap(&#39;n&#39;, &#39;&lt;F5&gt;&#39;, &#39;:lua require(&quot;dap&quot;).continue()&lt;CR&gt;&#39;, { noremap = true, silent = true })<br>vim.api.nvim_set_keymap(&#39;n&#39;, &#39;&lt;F10&gt;&#39;, &#39;:lua require(&quot;dap&quot;).step_over()&lt;CR&gt;&#39;, { noremap = true, silent = true })<br>vim.api.nvim_set_keymap(&#39;n&#39;, &#39;&lt;F11&gt;&#39;, &#39;:lua require(&quot;dap&quot;).step_into()&lt;CR&gt;&#39;, { noremap = true, silent = true })<br>vim.api.nvim_set_keymap(&#39;n&#39;, &#39;&lt;F12&gt;&#39;, &#39;:lua require(&quot;dap&quot;).step_out()&lt;CR&gt;&#39;, { noremap = true, silent = true })<br>vim.api.nvim_set_keymap(&#39;n&#39;, &#39;&lt;Leader&gt;b&#39;, &#39;:lua require(&quot;dap&quot;).toggle_breakpoint()&lt;CR&gt;&#39;, { noremap = true, silent = true })<br>vim.api.nvim_set_keymap(&#39;n&#39;, &#39;&lt;Leader&gt;dr&#39;, &#39;:lua require(&quot;dap&quot;).repl.open()&lt;CR&gt;&#39;, { noremap = true, silent = true })<br>vim.api.nvim_set_keymap(&#39;n&#39;, &#39;&lt;Leader&gt;dl&#39;, &#39;:lua require(&quot;dap&quot;).run_last()&lt;CR&gt;&#39;, { noremap = true, silent = true })<br><br>-- Open/Close DAP UI<br>vim.api.nvim_set_keymap(&#39;n&#39;, &#39;&lt;Leader&gt;du&#39;, &#39;:lua require(&quot;dapui&quot;).toggle()&lt;CR&gt;&#39;, { noremap = true, silent = true })<br>EOF<br><br>&quot; --- Compilation &amp; Running Code ---<br>autocmd FileType c nnoremap &lt;F9&gt; :w&lt;CR&gt;:!gcc -Wall % -o %:r &amp;&amp; ./%:r&lt;CR&gt;<br>autocmd FileType cpp nnoremap &lt;F9&gt; :w&lt;CR&gt;:!g++ -Wall % -o %:r &amp;&amp; ./%:r&lt;CR&gt;<br>autocmd FileType sh nnoremap &lt;F9&gt; :w&lt;CR&gt;:!bash %&lt;CR&gt;<br>autocmd FileType python nnoremap &lt;F9&gt; :w&lt;CR&gt;:!python3 %&lt;CR&gt;<br><br>&quot; --- Telescope Mappings ---<br>nnoremap &lt;C-p&gt; :Telescope find_files&lt;CR&gt;<br>nnoremap &lt;C-g&gt; :Telescope live_grep&lt;CR&gt;<br>nnoremap &lt;Leader&gt;dt :Telescope dap commands&lt;CR&gt;<br><br>lua &lt;&lt; EOF<br>require(&quot;toggleterm&quot;).setup({<br>    size = function(term)<br>        if term.direction == &quot;horizontal&quot; then<br>            return 15<br>        elseif term.direction == &quot;vertical&quot; then<br>            return vim.o.columns * 0.4<br>        else<br>            return 20<br>        end<br>    end,<br>    open_mapping = [[&lt;c-j&gt;]], -- Map Ctrl + j to toggle the terminal<br>    direction = &#39;float&#39;,      -- Set the terminal to open as a floating window<br>    float_opts = {<br>        border = &#39;curved&#39;,    -- Border style for the floating window<br>        width = function()<br>            return math.floor(vim.o.columns * 0.8) -- 80% of the editor width<br>        end,<br>        height = function()<br>            return math.floor(vim.o.lines * 0.8) -- 80% of the editor height<br>        end,<br>    },<br>})<br>EOF<br><br><br>&quot; --- Auto Format on Save ---<br>autocmd BufWritePre *.py execute &#39;:Black&#39;<br>autocmd BufWritePre *.c,*.cpp execute &#39;:ClangFormat&#39;<br>autocmd BufWritePre *.sh execute &#39;:Neoformat&#39;<br><br>&quot; --- Undo/Redo Mappings ---<br>nnoremap &lt;C-z&gt; u<br>nnoremap &lt;C-r&gt; &lt;C-r&gt;<br>inoremap &lt;C-z&gt; &lt;Esc&gt;u<br>inoremap &lt;C-r&gt; &lt;Esc&gt;&lt;C-r&gt;<br>&quot; --- Key Bindings for Moving Between Modes ---<br>inoremap &lt;C-n&gt; &lt;Esc&gt;<br>vnoremap &lt;C-n&gt; &lt;Esc&gt;<br>nnoremap i i<br>nnoremap v v<br>inoremap &lt;expr&gt; &lt;CR&gt; pumvisible() ? &quot;\&lt;C-Y&gt;&quot; : &quot;\&lt;CR&gt;&quot;<br>set background=dark    &quot; Set background to dark mode<br>colorscheme gruvbox    &quot; Set colorscheme to Gruvbox<br>&quot; --- Git Integration ---<br>nmap &lt;Leader&gt;gs :Gstatus&lt;CR&gt;<br>nmap &lt;Leader&gt;gc :Gcommit&lt;CR&gt;<br>nmap &lt;Leader&gt;gp :Gpush&lt;CR&gt;<br>nmap &lt;Leader&gt;gl :Gpull&lt;CR&gt;</pre><h3>Step 9: Install Plugins</h3><p>After saving the init.vim file, open Neovim and install the plugins:</p><pre>nvim +PlugInstall +qall</pre><h3>Step 10: Enjoy Your Development Environment</h3><p>You now have a fully configured Neovim setup with:</p><ul><li><strong>Language Server Protocol (LSP)</strong> support for autocompletion and linting.</li><li><strong>Debugging</strong> with nvim-dap.</li><li><strong>File navigation</strong> with NERDTree and Telescope.</li><li><strong>Git integration</strong> with Fugitive and GitGutter.</li><li><strong>Code formatting</strong> with Black, ClangFormat, and Neoformat.</li></ul><p>Happy coding! 🚀</p><p>This setup provides a robust and modern development environment tailored to your needs. Customize it further to suit your workflow!</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=d140286c692f" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Setting Up a Website in Hugo: A Complete Guide]]></title>
            <link>https://sgouda835.medium.com/setting-up-website-in-hugo-06f6f2b5dcca?source=rss-b2343fc5aaa9------2</link>
            <guid isPermaLink="false">https://medium.com/p/06f6f2b5dcca</guid>
            <category><![CDATA[hugo]]></category>
            <dc:creator><![CDATA[santosh kumar gouda]]></dc:creator>
            <pubDate>Thu, 20 Mar 2025 08:25:01 GMT</pubDate>
            <atom:updated>2025-03-20T08:39:59.589Z</atom:updated>
            <content:encoded><![CDATA[<p>Hugo is one of the most popular open-source static site generators available today. Known for its blazing-fast build times and flexibility, Hugo makes creating websites simple and enjoyable. This guide will walk you through setting up a Hugo website with the Archie theme and deploying it to GitHub Pages.</p><h3>Prerequisites</h3><ul><li>Basic knowledge of Git and command line</li><li>GitHub account</li><li>Text editor of your choice</li></ul><h3>Installing Hugo</h3><p>Start by downloading and installing Hugo:</p><pre>wget https://github.com/gohugoio/hugo/releases/download/v0.125.7/hugo_extended_0.125.7_Linux-64bit.tar.gz<br>tar -xvzf hugo_extended_0.125.7_Linux-64bit.tar.gz<br>sudo mv hugo /usr/local/bin/<br>hugo version</pre><blockquote><em>Note: For Mac users, you can install Hugo with Homebrew: </em><em>brew install hugo For Windows users, you can use Chocolatey: </em><em>choco install hugo-extended</em></blockquote><h3>Creating a New Hugo Site</h3><p>Create a new Hugo site and initialize Git:</p><pre>hugo new site my-hugo-blog<br>cd my-hugo-blog<br>git init</pre><h3>Adding the Archie Theme</h3><p>Add the Archie theme as a Git submodule and configure it:</p><pre>git submodule add https://github.com/athul/archie.git themes/archie<br>cp themes/archie/exampleSite/config.toml .<br>rm -rf hugo.toml</pre><h3>Updating Site Configuration</h3><p>Edit the config.toml file to customize your site:</p><pre>vi config.toml</pre><p>Update these key settings:</p><pre>baseURL = &quot;https://your-username.github.io/&quot;<br>title = &quot;My Hugo Blog&quot;<br>theme = &quot;archie&quot;</pre><p>You can further customize your site by adjusting other parameters in the config file, such as:</p><pre># For light/dark mode toggle<br>enableEmoji = true<br>pygmentsstyle = &quot;monokai&quot;<br>pygmentscodefences = true</pre><pre># Author details<br>[params]<br>  mode = &quot;auto&quot;<br>  featherIconsCDN = true<br>  subtitle = &quot;Clean and minimal personal blog theme&quot;</pre><pre># Social media links<br>[[params.social]]<br>  name = &quot;GitHub&quot;<br>  icon = &quot;github&quot;<br>  url = &quot;https://github.com/your-username&quot;</pre><pre>[[params.social]]<br>  name = &quot;Twitter&quot;<br>  icon = &quot;twitter&quot;<br>  url = &quot;https://twitter.com/your-username&quot;</pre><h3>Adding Content</h3><p>Copy example content and create your first post:</p><pre>cp -r themes/archie/exampleSite/content .<br>hugo new posts/my-first-post.md</pre><p>Open the newly created post in your text editor and modify the front matter:</p><pre>---<br>title: &quot;My First Post&quot;<br>date: 2025-03-20T12:00:00+01:00<br>draft: false<br>tags: [&quot;hugo&quot;, &quot;web development&quot;]<br>---</pre><pre>Hello world! This is my first Hugo blog post.</pre><h3>Testing Locally</h3><p>Start the Hugo development server to preview your site:</p><pre>hugo server -D</pre><p>Visit <a href="http://localhost:1313/">http://localhost:1313</a> in your browser to see your site. The -D flag allows you to view draft posts.</p><h3>Setting Up GitHub Repository</h3><ol><li>Go to GitHub.com</li><li>Create a new repository with the name format: your-username.github.io</li><li>Configure your local repository:</li></ol><pre>git remote add origin https://github.com/your-username/your-username.github.io.git<br>git branch -M main<br>git add .<br>git commit -m &quot;Initial commit&quot;<br>git push -u origin main</pre><h3>Creating GitHub Pages Branch</h3><p>Create and push a gh-pages branch:</p><pre>git checkout -b gh-pages<br>git push origin gh-pages<br>git checkout main</pre><h3>Building and Deploying</h3><p>Build your site and push to the gh-pages branch:</p><pre>hugo<br>cd public<br>git init<br>git remote add origin https://github.com/your-username/your-username.github.io.git<br>git checkout -b gh-pages<br>git add .<br>git commit -m &quot;Deploy Hugo site&quot;<br>git push origin gh-pages --force</pre><h3>Accessing Your Live Site</h3><p>Once deployed, your site will be available at:</p><pre>https://your-username.github.io/</pre><h3>Automating Deployment with GitHub Actions</h3><p>For a more streamlined workflow, you can set up GitHub Actions to automatically build and deploy your site whenever you push changes:</p><ol><li>Create a .github/workflows directory in your repository</li><li>Add a file named hugo-deploy.yml with the following content:</li></ol><pre>name: Deploy Hugo site</pre><pre>on:<br>  push:<br>    branches:<br>      - main</pre><pre>jobs:<br>  deploy:<br>    runs-on: ubuntu-latest<br>    steps:<br>      - uses: actions/checkout@v3<br>        with:<br>          submodules: true<br>          fetch-depth: 0</pre><pre>      - name: Setup Hugo<br>        uses: peaceiris/actions-hugo@v2<br>        with:<br>          hugo-version: &#39;latest&#39;<br>          extended: true</pre><pre>      - name: Build<br>        run: hugo --minify</pre><pre>      - name: Deploy<br>        uses: peaceiris/actions-gh-pages@v3<br>        with:<br>          github_token: ${{ secrets.GITHUB_TOKEN }}<br>          publish_dir: ./public</pre><h3>Adding a Custom Domain (Coming Soon)</h3><p>To use a custom domain with your Hugo site:</p><ol><li>Purchase a domain from a domain registrar</li><li>Create a file named CNAME in the static directory of your Hugo project</li><li>Add your domain to the CNAME file (e.g., <a href="http://www.yourdomain.com)/">www.yourdomain.com)</a></li><li>Configure DNS settings with your domain provider</li><li>Enable HTTPS in your GitHub repository settings</li></ol><blockquote><em>A more detailed guide on custom domain setup will be covered in a future post.</em></blockquote><h3>Customization Tips</h3><ul><li>Replace your-username with your actual GitHub username in all commands</li><li>Edit your posts in the content/posts/ directory</li><li>Customize theme settings in config.toml</li><li>Run hugo server -D locally to preview changes before deploying</li><li>Explore Hugo’s <a href="https://themes.gohugo.io/">themes directory</a> for alternative themes</li></ul><h3>Conclusion</h3><p>You now have a fully functioning Hugo website deployed to GitHub Pages! Hugo offers powerful features for content management, and with the simplicity of GitHub Pages, you can focus on creating content while enjoying free, reliable hosting.</p><p>Happy blogging!</p><p><em>Last updated: March 20, 2025</em></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=06f6f2b5dcca" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[https://www.reddit.com/r/dataengineering/s/TsXFRWJZne]]></title>
            <link>https://sgouda835.medium.com/https-www-reddit-com-r-dataengineering-s-tsxfrwjzne-e35997e14170?source=rss-b2343fc5aaa9------2</link>
            <guid isPermaLink="false">https://medium.com/p/e35997e14170</guid>
            <dc:creator><![CDATA[santosh kumar gouda]]></dc:creator>
            <pubDate>Fri, 08 Nov 2024 07:23:16 GMT</pubDate>
            <atom:updated>2024-11-08T07:23:16.089Z</atom:updated>
            <content:encoded><![CDATA[<p>https://www.reddit.com/r/dataengineering/s/TsXFRWJZne</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=e35997e14170" width="1" height="1" alt="">]]></content:encoded>
        </item>
    </channel>
</rss>