<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0" xmlns:cc="http://cyber.law.harvard.edu/rss/creativeCommonsRssModule.html">
    <channel>
        <title><![CDATA[Stories by Rodney Dyer on Medium]]></title>
        <description><![CDATA[Stories by Rodney Dyer on Medium]]></description>
        <link>https://medium.com/@rodneydyer?source=rss-e1752baecdcf------2</link>
        <image>
            <url>https://cdn-images-1.medium.com/fit/c/150/150/1*UACHlJBgkWib2I5PpNsjpA@2x.jpeg</url>
            <title>Stories by Rodney Dyer on Medium</title>
            <link>https://medium.com/@rodneydyer?source=rss-e1752baecdcf------2</link>
        </image>
        <generator>Medium</generator>
        <lastBuildDate>Sat, 21 Nov 2026 04:48:24 GMT</lastBuildDate>
        <atom:link href="https://medium.com/@rodneydyer/feed" rel="self" type="application/rss+xml"/>
        <webMaster><![CDATA[yourfriends@medium.com]]></webMaster>
        <atom:link href="http://medium.superfeedr.com/" rel="hub"/>
        <item>
            <title><![CDATA[Suck Reduction: A Life Philosophy]]></title>
            <link>https://medium.com/@rodneydyer/suck-reduction-a-life-philosophy-4465a7df8a9f?source=rss-e1752baecdcf------2</link>
            <guid isPermaLink="false">https://medium.com/p/4465a7df8a9f</guid>
            <category><![CDATA[population-genetics]]></category>
            <category><![CDATA[philosophy-of-life]]></category>
            <dc:creator><![CDATA[Rodney Dyer]]></dc:creator>
            <pubDate>Mon, 08 Jan 2024 06:01:37 GMT</pubDate>
            <atom:updated>2024-01-08T06:01:37.733Z</atom:updated>
            <content:encoded><![CDATA[<p>This is a brief introduction to the mathematics of how to make your life suck just a little bit less—from the perspective of a Population Geneticist.</p><h3>Taxonomy of the Problem</h3><p>Distilling things down to their very essence is a fundamental tool for working in frameworks (e.g., general toolsets that can be applied broadly) instead of focusing on domain-specific solutions to many problems you may have. This becomes essential for the “Philosophy of Life” caliber of topics.</p><p>In its simplest form, things in your life can be categorized into two mutually exclusive groups.</p><ul><li>Things that <strong>suck</strong></li><li>The rest of the stuff</li></ul><p>Algebraically, things that suck occur at a frequency of <em>p,</em> whereas everything else in your life can be represented as <em>q = 1 — p</em>. Clearly, <em>p + q = 1, </em>and this is nice because I’m a <a href="https://en.wikipedia.org/wiki/Population_genetics">population geneticist</a>. We like to deal in simple probabilities because they allow us to extrapolate <em>ad absurdum</em> (for example, one of our founders with his trusty Guinea Pig below).</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/174/1*Vx6Oc2t72MUMzUZX_Kewjw.jpeg" /><figcaption>Sewell Wright and his trusty guinea pig—he did not use it to erase the chalkboard!</figcaption></figure><p>Visually, one may represent the fractions of suckiness and non-suckiness in our lives using a simple pie chart (I know those miscreants who do not like the pie chart, but this is a lame attempt at foreshadowing a future joke, so buzz off). As an example, from my own life right now, the fractions look something like the following:</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*qHoOIgYs13sYFsV8-2apaQ.png" /></figure><p>We must not only visualize this relationship but also keep a running log of how the suckiness in our lives changes through time. Now that a algebraic and visual representation has been defined, let’s turn our attention to the kinds of things that contribute to your life sucking.</p><h3>The Shape of Things That Suck</h3><p>So what are these things that ‘suck’, how do we know about them, how can we identify them, etc.? As in Buddhism, things that suck are ultimately the things in your life that cause suffering. Suffering is inevitable and part of the human experience. Some people even seem to need suffering as a condition of existence (my grandparents, for example, to be miserable).</p><p>In the modern age, the kinds of things that suck include (but are not limited to):</p><ul><li>Running out of ink on your printer the morning your paper is due,</li><li>Being a Cleveland Browns fan,</li><li>Stevia,</li><li>Waking up 45 minutes before your alarm goes off,</li><li>Most Pop Music (not you Tay Tay),</li><li>The Windows Operating System,</li><li>Stepping into the cat’s newly created “hairballs” in the middle of the night,</li><li>Finding that DoorDash delivered you the veggie burger instead of the dozen wings.</li></ul><p>I’m sure you can add many additional things to this list, but this only scratches the surface. Hopefully, it gives you a general idea and direction to start your inquiries.</p><h4>Other-than Radiohead&#39;s “Creep”</h4><p>So it is true that the “rest of that stuff in your life” is a big grab-bag of items. That is OK. As long as each of them does not suck in any way, they can stay in this category. However, it is crucial that you look at these items often and Marie Condo them to see if <em>they do suck, but you’ve ignored them mainly because the amount of sucking they contribute to is only marginally larger than zero.</em></p><p>Be vigilant! Do not let these things persist in this state. You MUST eradicate and exile them to the “Suck” category. Failing to do so results in a condition called <em>Suck Creep</em>, which through time, will slowly eat all of your non-sucking life parts. Eventually, your life will completely suck.</p><p>Below is a simple MCMC⁷ stochastic simulation in which an entire semester portion of incremental creep was ignored because “I’m too busy trying to be a good professor over here…”. Notice, there is an apparent <em>fixation</em> of total suckiness in the life after time step 69… (last year of the excellent muscle cars, too, IMHO), beyond which there is no hope for this poor professor to recover from a life that sucks 100%.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*intDd1Tiq-wGy0OEv4WBxw.png" /></figure><h3>Mitigating Suckiness</h3><p>So, one of the best ways to gain pleasure and enjoyment in your life is to figure out how to reduce that suckiness in your life and remove it.</p><p>In the examples above, we have a situation where roughly 22.2% of the life is classified as <em>The Part that Sucks</em>. Now, suppose that through some deep introspection, a week-long silent meditation retreat, experimentation with some “homemade cleansing elixirs,” and a dash of what can only be called honest self-reflection (this is the hard one), you can partition those things that suck into two subcategories, <em>p = p₁ + p₂</em>.</p><ul><li>The fraction things that suck, but there is no way I can do anything about it. We can call this <em>Immobilis Petra,</em> whose frequency will be defined by the parameter <em>p₁</em>. This is essentially the parts of your life that suck, yet you are going to have to come to some understanding with the forces of the universe on the magnitude of <em>p₁</em> in your life because there is nothing you can do about it.</li><li>The things in the large category of “things that suck” that, though some less feat of will, you can do something about can be parameterized as <em>p₂</em>. If you know <em>p</em> (how much sucks) and (<em>p₁</em> the sucky things you have no control over), you can estimate <em>p₂</em> by subtraction (e.g., <em>p - p₁=p₂</em>) in the same way that we typically find the Error Sums of Squares in our stats homework.</li></ul><p>That situation looks like this:</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*DDQcGGUWRXHkAILRyzZZsQ.png" /></figure><p>Now, here is the <strong>solemn truth of this entire philosophy</strong>. Look at the things that make up <em>p₂ </em>in your life and consider one of the following strategies:</p><ul><li><em>Suckexcision: </em>Remove them from your life (e.g., stop using Windows),</li><li><em>Suckslocation:</em> Give them to someone else (e.g., rehome the cat) or</li><li><em>Suckorcism:</em> Reconfigure your life so they no longer live rent-free in your head (e.g., become a <a href="https://www.seahawks.com/">Seattle Seahawks</a> fan)</li></ul><p>Then, you can enter what is technically called a <strong>period of suckiness reduction</strong>. You cannot rest upon your laurels, though; your life is anything but static, and without constant vigilance, suckiness returns (the above description of Suck Creep is but one avenue). The best we can hope for is reaching an equilibrium of sorts—a Plateau of Suckiness—commensurate with an enjoyable life. That being said, after all this effort, your life will be more like this:</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*xHb4pEU1XWIvRKYRLnudMA.png" /></figure><p>And <strong>by definition,</strong> you must reduce the amount of suckiness (don’t take my word for it; compare the last two graphs!).</p><p>A concomitant feature of this is that</p><blockquote>Your life will now suck just a little bit less.</blockquote><p>Which is the “sunny side of the pyramid” we are all attempting to reach—even if only metaphorically.</p><p>- RJD</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=4465a7df8a9f" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[2024—A Year forTool Deployment]]></title>
            <link>https://medium.com/@rodneydyer/2024-a-year-for-tool-deployment-6b8149e19854?source=rss-e1752baecdcf------2</link>
            <guid isPermaLink="false">https://medium.com/p/6b8149e19854</guid>
            <category><![CDATA[curriculum-development]]></category>
            <category><![CDATA[analytical-tools]]></category>
            <category><![CDATA[population-genetics]]></category>
            <category><![CDATA[faculty-development]]></category>
            <dc:creator><![CDATA[Rodney Dyer]]></dc:creator>
            <pubDate>Mon, 01 Jan 2024 09:01:04 GMT</pubDate>
            <atom:updated>2024-01-01T09:01:04.180Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*rEqo2lT_yoQqoTdFKjc3Cw.png" /><figcaption>Tools needing refinement and deployment in 2024.</figcaption></figure><p>This is the time of the year to reconfigure and figure out what is on the front burner for 2024! Finals are (finally) finished, projects are wrapping up for the year, and the university is going into the short torpor that allows the passing of the calendar year before rushing into the spring semester.</p><p>There will likely be a significant disruption in the configuration of my academic unit in the near future, so it is even more critical to develop a roadmap of intentions that can help me keep an even keel during this next year.</p><h3>Research Activities</h3><p>My academic research is primarily focused on population genetic analysis. I’m a botanist but have strayed into the “less interesting taxa” lately, and there are a lot of loose ends and low-hanging fruit that need to be tended to. Most of this concerns tools I’ve developed to help analyze population genetic structure and overall genetic connectivity.</p><h4>Population Graph Extensions</h4><p>My research program&#39;s most widely accepted toolsets focus on how we interpret genetic connectivity among populations (or sampling locales) using graph-theoretic mathematical models. This stems from an approach I first published while at <a href="https://eeob.iastate.edu/">Iowa State University</a>.</p><figure><img alt="Citation for my model of conditional genetic independence from google scholar." src="https://cdn-images-1.medium.com/max/1024/1*Rjt62vWNONYNyDMA6gPUWQ.png" /><figcaption>My most cited work demonstrates the importance of using conditional genetic independence in analyzing population genetic structure [<a href="https://onlinelibrary.wiley.com/doi/full/10.1111/j.1365-294X.2004.02177.x">citation</a>].</figcaption></figure><p><em>PopulationGraphs</em> uses conditional genetic independence (e.g., marginal probability density functions) to more accurately quantify the features and forces that have shaped the spatial distribution of multilocus genetic structure.</p><p>There are some tools that I’ve been working on to help apply this approach beyond the <em>popgraph</em> <a href="https://github.com/dyerlab/popgraph">R package</a> that I make publicly available. The key is the visualization and quantification of the overall shape of the resulting population graph network—not the magnitude of a fixation index with questionable provenance (see post <a href="https://medium.com/@rodneydyer/irreversibility-of-structure-diversity-statistics-8d74c73f7675">here</a> about irreversibility of structure and diversity statistics).</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*xgxFVOaQzyUPVtq7Ua0Otg.png" /><figcaption>The “shape of genetic structure” was initially introduced using a Sonoran desert cactus.</figcaption></figure><p>So, in 2024, I’ll make a couple of extensions to this model, the tools used to create these network structures and their subsequent analysis.</p><ul><li>A desktop/tablet version of the software that can take advantage of the hardware acceleration in the latest Apple Silicone chips (particularly those for ML; prototype below).</li></ul><figure><img alt="The UI interface for a stand-alone population graphs applications for the analysis of conditional genetic structure." src="https://cdn-images-1.medium.com/max/1024/1*OcUxGqLKT5HFGH9akKRyCQ.png" /><figcaption>Prototype desktop/tablet interface for stand-alone application for performing analyses of conditional genetic independence graphs based upon multivariate genetic data.</figcaption></figure><ul><li>Increased integration with spatial raster maps to extract raster conditions along covariance connectivity lines. This builds upon the methods used in the <a href="https://onlinelibrary.wiley.com/doi/10.1111/mec.12839">Gravity of Pollination</a> and <a href="https://royalsocietypublishing.org/doi/10.1098/rspb.2018.1224">Urban Hubs of Connectivity </a>manuscripts.</li><li>A complete benchmark of compressed and extended edges—a technique demonstrated before and implemented in the pop graph <a href="https://github.com/dyerlab/popgraph">R package</a> but yet to be properly introduced to its utility.</li><li>Preparation for <a href="https://www.apple.com/apple-vision-pro/">Apple Vision Pro</a>, which will accelerate the use of this approach, mainly as we reveal how it can be used within the genome… You know what I&#39;m getting at if you’ve seen my talk on Chromosome Walking.</li></ul><h4>GeneticStudio</h4><p>Similarly, the more general analysis platform for population genetic analyses has been GeneticStudio. There have been various versions of this my entire career (even a MacOS7/Win95 GUI from the turn of the century). I gave up on making GUIs because keeping up with Windows took too much of my time (and I’m not a Windows programmer because of <a href="https://dyerlab.org/posts/1969-10-14-dyers-philosophy-of-life/">this basic philosophy</a>).</p><p>It is also reasonable to combine a general data analytics interface with the <a href="http://dyerlab.github.io/applied_population_genetics/">Applied Population Genetics</a> textbook I wrote. My idea here is to incorporate both into a single interface, linking the background philosophy and theory behind individual analyses with the ability to directly apply them to your data.</p><figure><img alt="Interface for GeneticStudio" src="https://cdn-images-1.medium.com/max/1024/1*zCHBSbbPyheZhwtcIA59-Q.jpeg" /><figcaption>The latest incarnation of GeneticStudio, as I expand it to incorporate the background theoretical and statistical basis for all the analyses it performs.</figcaption></figure><p>The goal here is to try to cover 80% of the things that we do on a routine basis but then provide a direct export to R and my <a href="https://github.com/dyerlab/gstudio"><em>gstudio</em> package</a> so that one could easily do more specific and specialized sets of analyses.</p><h3>Curriculum/Administrative Projects</h3><p>Since 2017, I’ve had the privilege of serving as the Director of the <a href="https://ces.vcu.edu/">Center for Environmental Studies</a> at <a href="https://vcu.edu/">Virginia Commonwealth University</a>. During this time, the faculty and I have entirely reconfigured the curricula for our undergraduate and graduate programs.</p><p>We are almost finished with the complete revision but in hindsight, the data we’ve collected on this process, the metrics that I’ve been collecting, and the tools that I’ve been making to help in the process are potentially “artifacts of scholarly output” in their own right.</p><h4>Quantitative Analysis of Curricula—Administravia</h4><blockquote>Managing academic programs doesn’t have to feel like death by a thousand mosquito bites…</blockquote><p>As it turns out, the university could do a better job of making the data we collect on our academic program and faculty progress readily available or amenable to those of us who do the actual program development and deployment.</p><p>So I designed my own, called <a href="https://www.administravia.com/">Administravia</a>. It is currently on <a href="https://testflight.apple.com/">TestFlight</a> (email me if you’d like to give it a whirl).</p><figure><img alt="The main interface for the Administravia application for the analysis and maintenance of academic programs and facutly." src="https://cdn-images-1.medium.com/max/1024/1*g1ETDNWtEmVNdiO0Xp2FUA.png" /><figcaption>The main interface for the Administravia application for the analysis and maintenance of academic programs and faculty.</figcaption></figure><p>This is more of an analytical platform for academic departments, colleges, and schools. It currently serves to analyze:</p><ul><li>Faculty performance (quality and quantity of teaching)</li></ul><figure><img alt="Faculty overview UI for Administravia." src="https://cdn-images-1.medium.com/max/1024/1*x0MXQRXk04oFfg0MskY1Hw.png" /><figcaption>Faculty overview UI for Administravia.</figcaption></figure><ul><li>Core course performance and the throughput of students in the program</li></ul><figure><img alt="Programs, program performance, and core curriculum UI in Administravia." src="https://cdn-images-1.medium.com/max/1024/1*ptceGQHDp__SavW3IG1cBw.png" /><figcaption>Programs, program performance, and core curriculum UI in Administravia.</figcaption></figure><ul><li>Historical progress of courses as they contribute to individual program-level Learning Outcomes</li></ul><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*yg9TQzhvf7xYFb-kV_uq0Q.png" /></figure><ul><li>Temporal tracking of individual classes to include seats, DWF rates, average grades, and scheduling of whose taught it through time.</li></ul><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*BWYcbwYIT5dlmqnwUFniyA.png" /></figure><ul><li>Analysis of student feedback (qualitative and quantitative) for each course each semester for a broad range of student feedback.</li></ul><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*ugWbN_tvADBZZifyU_AhyQ.png" /></figure><ul><li>Temporal analysis of course assessments is based upon both quantitative feedback from students but also from linguistic sentiment analysis of written responses and student feedback.</li></ul><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*n4WiA1GwSR1SyWwJt-Ijbg.png" /></figure><ul><li>Report Generation for programs, faculty, and individual courses. This part helps save a tremendous amount of time for chairs and directors since the history of teaching output (quantity and several measures of quality) can be quickly exported as part of the annual review process.</li></ul><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*EugML0nYe05ytROm7UZ0Ig.png" /></figure><p>My goal for this next year is to be able to put in some additional components such as:</p><ul><li>Annual report templates for programs, faculty, and courses so that reports can be tailored to individual academic institutions.</li><li>Integration of assessment tools that can then be mapped, unambiguously, to Course Learning Objectives and then onto Program Learning Outcomes. This helps us track, through time, not only how effective our assessment tools are but perhaps more importantly how well we are doing at developing, reinforcing, and assessing for mastery the fundamental components of our units academic output.</li></ul><figure><img alt="Mapping of individual course-level assessments onto stated Course Learning Objectives and then Program Learning Outcomes." src="https://cdn-images-1.medium.com/max/1024/1*CZ4rgYsL1JwV7CGJMEIgRA.png" /><figcaption>Mapping of individual course-level assessments onto stated Course Learning Objectives and then Program Learning Outcomes.</figcaption></figure><p>It is currently in Apple TestFlight, send an email to <a href="/service/mailto:administravia@dyerlab.org">administravia@dyerlab.org</a> if you are interested in giving it a spin.</p><h4>Backwards Design</h4><p>Finally, here is a small project that I spun off of Administravia. While initially integrated into it, I found it more effective if it stood alone as a single desktop/tablet application. I’m a big fan of backwards design as it allows the development of more effective curricula and learning environments.</p><p>This application helps in that regard to walk someone though the process of applying a backwards design approach to the creation of a new class.</p><figure><img alt="The UI for Backflow Studio, a tool to aid in the development of academic content using a backwards design concept." src="https://cdn-images-1.medium.com/max/1024/1*ZpP_BewQLEm86braZX0IXA.png" /></figure><p>The Administravia application also imports the files from this one so that it can hook up the mappings that we show in the section above from Assessment Tool → Course Learning Objective → Program Learning Outcome.</p><p>By summer 2024, I’d like this to be in the <a href="https://www.apple.com/app-store/">App Store</a>. If you are interested in playing around in the beta program, drop me an email at <a href="/service/mailto://backflow@dyerlab.org">backflow@dyerlab.org</a>.</p><h3>The Wrap Up</h3><p>I’ve been putting a lot on the back burner this past year or two and slowly developing the next generation of tools for my craft. This has been mainly due to work-related “unexpected” things that come up (hurry, do a complete Academic Program Review, etc.) that have hit me hard in scholarly output. Before taking over an administrative approach, my annual citation index was “going up and to the right.”</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/628/1*5iMAjkuV5MVUxD7xLvSnBQ.png" /><figcaption>My recent scholarly output as determined by citation metrics from Google Scholar.</figcaption></figure><blockquote>You can have a significant impact in your academic field or at your institution—but not both.</blockquote><p>Overall, the demands of my administrative duties have pushed aside my scholarly activities, and as a result, I’m diminishing in my field. Nights and weekends have been spent trying to make this next revolutionary push in the tools we use for population genetic analyses, and this upcoming year will be when they are released into the wild. Maybe 2025 or 2026 will find me on a sabbatical or other intellectually re-invigorating activity.</p><p>A very exciting (or at least hopeful) time indeed…</p><p>I hope you have a wonderful winter (in the Northern Hemisphere) break and can spend it with those most important to you.</p><p>- RJD</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=6b8149e19854" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Using GitHub to Teach Data Literacy]]></title>
            <link>https://medium.com/@rodneydyer/using-github-to-teach-data-literacy-e5b0630e7718?source=rss-e1752baecdcf------2</link>
            <guid isPermaLink="false">https://medium.com/p/e5b0630e7718</guid>
            <category><![CDATA[github]]></category>
            <category><![CDATA[teaching]]></category>
            <dc:creator><![CDATA[Rodney Dyer]]></dc:creator>
            <pubDate>Tue, 22 Aug 2023 18:35:27 GMT</pubDate>
            <atom:updated>2023-08-22T18:35:27.030Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="Octocat from pngegg.com" src="https://cdn-images-1.medium.com/max/512/1*qniBPkAcWGhXnrUdnTpVBw.png" /></figure><p>Collaborating as a classroom is significantly improved for both short and long-term knowledge persistence with the help of GitHub. This is the first in a series of short posts about how I’m implementing this in my own teaching regime for graduate-level courses in data analysis.</p><p>Here is a short setup on how I’m using <a href="https://github.coim/">GitHub</a> in teaching an introduction course in Data Literacy for incoming Environmental Studies students. I’m going to post a series of short entities</p><p>This class is a required component for our <a href="https://bulletin.vcu.edu/graduate/vcu-life-sciences/center-environmental-studies/environmental-studies-ms/">MS</a> (thesis) and <a href="https://bulletin.vcu.edu/graduate/vcu-life-sciences/center-environmental-studies/environmental-studies-menvs/">MEnvs</a> (non-thesis) academic programs. This course is one of the foundational quantitative offerings in our program (along with CORE GIS training) and is intended for students to take it in their first semester of classes. We follow up in the spring semester with a second, more applied course offering.</p><p>Last year, I started directly exposing students to GitHub directly and used GitHub Classroom to distribute the homework and other issues. It got a bit odd and weird having so many different repositories, I thought that this year I’d try submodules as an approach.</p><h3>Main course structure</h3><p>The structure of the class is broken up into individual self-contained “Learning Modules”, each of which is contained in its own GitHub repository. This modularity of my teaching content allows me to pick-and-match topics that I’ve already created in a standard format and facilitates reproducibility and reusability when I’m spinning up new courses — I just grab the stuff that I’ve already created and add the set of new topics to GitHub. Mix and match from there. It has worked really well as most of my teaching has been on basic data literacy and analysis, genetic analysis, and spatial/landscape analyses.</p><p>The content of each topic is partitioned into the following components. I am a huge fan of [[Backward Design]] in curriculum development and generally try to flip my courses.</p><h4>Pre-Meeting content:</h4><ul><li>Background papers and examples using the topic.</li><li>Foundational literature on the mechanics of applying the topic.</li><li>A pre-recorded video of a lecture on the topic.</li><li>Slides &amp; data sets used in the topic.</li><li>A longer <em>Narrative</em> document on the topic that goes into examples and demonstrations of everything intended to be discussed in this topic. This is the “core” of literature that I develop on the topic itself.</li></ul><h4>In-Person Content:</h4><ul><li>Specialization and extension of the topic as very short lecture components.</li><li>Make sure all questions are answered on topic</li><li>Group or Individual work on applying the topic to promote `active learning`.</li></ul><h4>Post-Meeting Assessment on Mastery:</h4><ul><li>Some form of assessment where the individuals can demonstrate their mastery of the topic through direct and/or indirect assessment methods.</li><li>Closing the loop on the topic to make sure that subsequent visitations by the participants have all open items described with working examples, etc.</li></ul><h3>The main class repository</h3><p>The main repository has mostly logistics for the course. The main <em>README.md</em> is generally the syllabus. It goes over the description and basic need for the class, some background and motivations, the general <em>Course Level Learning Objectives</em>, the list of <em>Learning Modules</em>, grading/late/attendence policies, and the other syllabus materials that my university requires me to add.</p><p><a href="https://github.com/DyerlabTeaching/ENVS543-Fall_2023">Here</a> is an example this particular course.</p><h3>The Learning Modules</h3><p>Within the course, each <em>Learning Module</em> is a self-contained object, as outline above, and exists in their own <a href="https://github.com/">GitHub</a> repository. So, for example, the first day of class materials are contained within a <a href="https://github.com/DyerlabTeaching/Welcome/">Welcome Repository</a>. It is a pretty shallow one, with just a set of learning objectives and a single slide deck. This content is basically just getting everyones computers set up and having the proper software installed, etc. I find that the main syllabus and welcome modules are sufficient for the first “in-class” session to get everyone on the same level (and add/drop extends through the first week so I go a bit slow here).</p><p>So how I structure it is that I have the main repository for the class and with the addition of each <em>Learning Module</em>, I will add that repository as a submodule to the original one. I to this because it allows the students to “pull” new version as they become available. All the time keeping the content localized into a single main folder.</p><p>To get the submodules, you can add them by going to your main directory and issuing the following command (replacing `username`, `UserName`, and `Repository` with the appropriate content):</p><pre>git submodule add https://username@github.com/UserName/Repository.git</pre><p>So afterwards, as I added the `Welcome.git` repository as a submodule, I get see the following changes in my main folder.</p><pre>~/Desktop/ENVS543-Fall_2023 ‹main*› » git status<br>On branch main<br>Your branch is up to date with ‘origin/main’.<br>Changes to be committed:<br> (use “git restore — staged &lt;file&gt;…” to unstage)<br> new file: .gitmodules<br> new file: Welcome</pre><p>And if you look inside the new `.gitmodules` file, you’ll see that if you move that folder around much, you may break things.</p><pre>~/Desktop/ENVS543-Fall_2023 ‹main*› » cat .gitmodules<br>[submodule “Welcome”]<br>   path = Welcome<br>   url = https://dyerlab@github.com/DyerlabTeaching/Welcome.git<br></pre><p>After I <em>add</em>, <em>commit</em>, and <em>push</em> the main folder back up to <a href="https://github.com/">Github</a>, my repository shows the submodule as a link:</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*lPkTnBT6ErY0fWY_yDa7sA.png" /><figcaption>Submodule repository link in main module filder.</figcaption></figure><h3>Longer Maintenance</h3><p>As we go through the semester, we accumulate multiple repositories, each of which has these components. At the end of the semester, the students will then collate the individual <em>Narrative</em> components (from the Pre-Meeting Content) into a stand-alone textbook that covers the entirety of their learning experience. Since the repositories are directly linked into this textbook, as approaches and libraries evolve through time, they can easily keep up to date by pulling the latest version and remaking the textbook.</p><p>So through the semester, I can add each additional learning module to the repository, adding content and context. At the end of the course, I drop in a few scripts that allows the students to make the textbook with a simple build.</p><p>I’m still not decided if I’ll be using <a href="https://classroom.github.com/">Github Classroom</a> this year or not. I’ll have to play around with it a bit.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=e5b0630e7718" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Keybase Verification]]></title>
            <link>https://medium.com/@rodneydyer/keybase-verification-29b6357f47b7?source=rss-e1752baecdcf------2</link>
            <guid isPermaLink="false">https://medium.com/p/29b6357f47b7</guid>
            <category><![CDATA[pgp]]></category>
            <category><![CDATA[keybase]]></category>
            <category><![CDATA[public-key]]></category>
            <dc:creator><![CDATA[Rodney Dyer]]></dc:creator>
            <pubDate>Mon, 31 Oct 2022 01:52:02 GMT</pubDate>
            <atom:updated>2022-10-31T01:52:02.395Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/482/1*GWFdbNJ27CPQspZYtH4dPA.png" /></figure><h3>Proof of Existence</h3><p>I hereby claim:</p><ul><li>I am dyerlab on github.</li><li>I am rodneydyer (<a href="https://keybase.io/rodneydyer">https://keybase.io/rodneydyer</a>) on keybase.</li><li>I have a public key <em>ASAMBdr1DJY2hC1bF9Id_H_j3a91kB0rZ7kjsOHj6bT63wo</em></li></ul><p>To claim this, I am signing this object with the key</p><pre>{<br>  &quot;body&quot;: {<br>    &quot;key&quot;: {<br>      &quot;eldest_kid&quot;: &quot;012008a965e8616600137f5bf7a168ad185704c6781a588809f1cb019c302571d2490a&quot;,<br>      &quot;host&quot;: &quot;keybase.io&quot;,<br>      &quot;kid&quot;: &quot;01200c05daf50c9636842d5b17d21dfc7fe3ddaf75901d2b67b923b0e1e3e9b4fadf0a&quot;,<br>      &quot;uid&quot;: &quot;6d41dc3b4aac7f8a7e18c55654177419&quot;,<br>      &quot;username&quot;: &quot;rodneydyer&quot;<br>    },<br>    &quot;merkle_root&quot;: {<br>      &quot;ctime&quot;: 1615243846,<br>      &quot;hash&quot;: &quot;473f38f98581aa0277b3fffbfb3209b742d10fe4bf563c53d5cdf6fe890f026741610cb16420095657cdc7af4ed11e51c1d96397f49a494bd054956a88e17660&quot;,<br>      &quot;hash_meta&quot;: &quot;e9bdd92451122a516b2898fb0c482ee290c59032c8f8ad4c58b843d75c54f254&quot;,<br>      &quot;seqno&quot;: 19324019<br>    },<br>    &quot;service&quot;: {<br>      &quot;entropy&quot;: &quot;mLmRECiYMX0tIAHrKX5d/h1K&quot;,<br>      &quot;name&quot;: &quot;github&quot;,<br>      &quot;username&quot;: &quot;dyerlab&quot;<br>    },<br>    &quot;type&quot;: &quot;web_service_binding&quot;,<br>    &quot;version&quot;: 2<br>  },<br>  &quot;client&quot;: {<br>    &quot;name&quot;: &quot;keybase.io go client&quot;,<br>    &quot;version&quot;: &quot;5.6.2&quot;<br>  },<br>  &quot;ctime&quot;: 1615243895,<br>  &quot;expire_in&quot;: 504576000,<br>  &quot;prev&quot;: &quot;30d26881de4d343dd09b61f34b9f58356afb97ea579f99426b84c07283d6edfe&quot;,<br>  &quot;seqno&quot;: 6,<br>  &quot;tag&quot;: &quot;signature&quot;<br>}</pre><pre>hKRib2R5hqhkZXRhY2hlZMOpaGFzaF90eXBlCqNrZXnEIwEgDAXa9QyWNoQtWxfSHfx/492vdZAdK2e5I7Dh4+m0+t8Kp3BheWxvYWTESpcCBsQgMNJogd5NND3Qm2HzS59YNWr7l+pXn5lCa4TAcoPW7f7EIL31VOyitX0zHzCkfB4W6g+YTIAEfVO5Np5LMj5OsLJDAgHCo3NpZ8RA666goIZy9L7RZO23dLHLBobc1KsaOTjUEjq2W3Wij3dSzn8QvwG8BNnsd9wc3IALOdl0AQWVWTZF996yvTxABqhzaWdfdHlwZSCkaGFzaIKkdHlwZQildmFsdWXEIHZFoMkK0nXJyNkPERGOOIlylC5utSzXjlAJUE9JpXdSo3RhZ80CAqd2ZXJzaW9uAQ==</pre><p>And finally, I am proving ownership of the github account by posting this as a gist.</p><p><a href="https://keybase.io/rodneydyer">https://keybase.io/rodneydyer</a></p><p>Consider the <a href="https://keybase.io/download">keybase command line program</a>.</p><pre>keybase id rodneydyer</pre><p><em>Originally published at </em><a href="https://gist.github.com/dyerlab/4dd55221b22648d43508a42cd4588cd9"><em>http://github.com</em></a><em>.</em></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=29b6357f47b7" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Irreversibility of Structure & Diversity Statistics]]></title>
            <link>https://medium.com/@rodneydyer/irreversibility-of-structure-diversity-statistics-8d74c73f7675?source=rss-e1752baecdcf------2</link>
            <guid isPermaLink="false">https://medium.com/p/8d74c73f7675</guid>
            <category><![CDATA[genetic-structure]]></category>
            <category><![CDATA[fst]]></category>
            <category><![CDATA[ht]]></category>
            <category><![CDATA[sewall-wright]]></category>
            <category><![CDATA[population-genetics]]></category>
            <dc:creator><![CDATA[Rodney Dyer]]></dc:creator>
            <pubDate>Mon, 31 Oct 2022 01:22:26 GMT</pubDate>
            <atom:updated>2022-10-31T01:22:26.228Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/480/1*fKa1m9T6TwMo23xBJ2Myyg.gif" /></figure><p>An estimate of the amount of genetic variation in a sampled locale is often based upon the standardized mean divergence in allele frequencies as manifest in statistics such as Fₛₜ and their ilk. While informative, and indeed rooted in the foundations of evolutionary theory, simple abstractions such as these may be insensitive to more nuanced components of genetic structure due to their robustness — it is well understood that a specific value of Fₛₜ may represent an infinite number of population arrangements, all of which just happen to have the same ratio of among to within population genetic variance.</p><p>Non-uniqueness of frequency spectra resulting in identical among population (Fst) and within population (Hₜ) estimates of genetic diversity as demonstrated from allele frequencies for twelve populations for the first two alleles from a three allele locus.</p><p>The mapping of genotypes -&gt; estimates of both within locale diversity and among local structure are a fundamental component of population and landscape genetic analyses, and indeed the formulation for our understanding of how evolution proceeds.</p><p>A common method for measuring structure is from Sewell Wright’s Fₛₜ statistic and its offspring. At heart, the parameters is defined as the fraction of the total genetic variance that can be contributed to individuals being in different populations. This parameter has many offspring but in its most general form, it can be defined as the ratio of the among locale variance in allele frequencies standardized by the variance in the global allele frequencies. For a single locus, this becomes.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*xQXrua04yG_2xYz_kcUXyg.png" /></figure><p>Originally, Wright suggested that this should probably not be thought of in the way that most of us see ‘differentiation’. Namely,</p><blockquote>The fixation index [Fₛₜ] is thus not a measure of the degree of differentiation in the sense implied in the extreme case by the absence of any common allele. It measures differentiation within the total array in the sense of the extent to which the process of fixation has gone toward completion¹.</blockquote><p>To demonstrate this, he showed the following examples. Of note, compare cases 1, 6, 7, &amp; 8 in the following table, all of which have the same value for Fst but have different allele spectra (in particular, see 7 &amp; 8, which have subsets of populations that have Fₛₜ = 0!</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*LMe8H1vEdLINcRY5HAzldg.jpeg" /><figcaption>One of the most wide ranging pages in the four volume series from Wright¹.</figcaption></figure><p>To view this in a more broad context, we can easily show that for any particular value of Fst, we can define a similarly large number of population configurations that results in both the same amount of overall genetic structure (Fst) <em>and</em> the same amount of within strata diversity (Ht).</p><p>There are two examples that highlight some of the challenges for this.</p><ol><li>It is possible to fix the allele frequencies and shuffle the labels. For example, the identity of the specific locale relative to the inherent allele frequencies is not unique. Consider the case where Population A has p=0.3 at a locus and Population B has p=0.7 After some perturbation in the system or iterating across generations, we may have the situation where Population A has p = 0.7 and Population B has p = 0.3. Measuring structure or diversity within and among these pairs of pops will yield identical values even though the relative positions of each population has been swapped in allele space.</li><li>More generally, for any given value of diversity and structure, we can find an infinite set of populations that can yield the same estimates. The featured image on this page is an example with K=12 populations for a single 3-allele locus. The plots are of the first two allele frequencies and the estimates of both diversity and differentiation are the same to the first 3 decimal points (n.b., we can be more stringent but I think this makes the point close enough).</li></ol><p>In both of these situations, the relative position and arrangements of the individual populations are not unique. Now, this may not be an issue, if the kinds of questions you are working with do not rely upon interpreting the relative positions of populations in allele space.</p><p>However, for many population, conservation, and landscape type studies, it is exactly the relative positions of populations that are the focus of the study. As such, to ignore the <em>irreversibility of structure and diversity statistics</em> is to pass up on potentially valuable insights on the species and systems you are working with.</p><p>This is the first in a series of posts about how we may want to think about measuring genetic structure such that we can actually <em>capture</em> the manner in which populations diverge, with the goal of providing a more complete set of tools for practitioners of contemporary structure analysis yielding more accurate inferences for meso-time scales.</p><p>[1] Wright, S. 1978. <a href="https://www.amazon.com/Evolution-Genetics-Populations-Variability-Natural-dp-0226910415/dp/0226910415/ref=mt_other?_encoding=UTF8&amp;me=&amp;qid=">Evolution &amp; the Genetics of Populations 4: Variability within and among natural populations.</a> University of Chicago Press.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=8d74c73f7675" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[A Weekend Loaf of Substance]]></title>
            <link>https://medium.com/@rodneydyer/a-weekend-loaf-of-substance-4d60fe786faf?source=rss-e1752baecdcf------2</link>
            <guid isPermaLink="false">https://medium.com/p/4d60fe786faf</guid>
            <category><![CDATA[bread]]></category>
            <category><![CDATA[baking]]></category>
            <dc:creator><![CDATA[Rodney Dyer]]></dc:creator>
            <pubDate>Mon, 31 Oct 2022 00:01:01 GMT</pubDate>
            <atom:updated>2022-10-31T00:01:01.507Z</atom:updated>
            <cc:license>http://creativecommons.org/licenses/by/4.0/</cc:license>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*XsqM0viN0qXCxmOES5Fapg.jpeg" /></figure><p>One of the things that I like to do is make some fresh bread for my family. I generally do this on the weekends, make some dough and cool up one of the loafs on Sunday and then use the second half of the dough for focassia on Tuesday or Wednesday. I would love to get to the situation where I can have a nice sourdough that I could perpetuate on Sunday + Wednesdays (still working on that).</p><h3>Weekend Dough</h3><p>So, I’ve iterated the following recipe that does pretty well for a starting point. It is a bit of a wet dough, your mileage may vary. I’m going to use bakers percentages, as measuring weight for all baked goods is the way to go.</p><p>On the weekend, if I start this by 9:00 it can be ready by dinner. I use a large <a href="https://www.amazon.com/Camware-Translucent-Storage-Containers-Scraper/dp/B07S25K1W4/ref=sr_1_19?crid=3NJB6UJIUAC8X&amp;keywords=cambro&amp;qid=1667170551&amp;qu=eyJxc2MiOiI2LjIyIiwicXNhIjoiNS42MyIsInFzcCI6IjUuMzUifQ%3D%3D&amp;sprefix=cambro%2Caps%2C125&amp;sr=8-19">Cambro</a> (with lid) to do the fermenting in.</p><p>This is good for 2 loaves (I like a more wet dough for this, this is a 74% dough):</p><ul><li>Bread flour (1000g). It is in your best interest if you can get some locally milled bread flour… Just saying.</li><li>Water (740g). It is best if your water is between 91–95°F, depending on the season. Use a meat thermometer, this really matters.</li></ul><p>Mix these up, you can use a spatula just to incorporate the water and the flour. Let stand for 20–30 minutes. After this, add:</p><ul><li>4g Instant Bread Yeast</li><li>21g freshly ground salt (yes, 21g, it is really only 1.2% salt, by weight).</li></ul><p>You’ll need to fold this in. I make several “folds” and “cuts” on the dough:</p><ul><li>Folds: To fold the dough, I reach under one side of it (I consider the 4 cardinal sides in the Cambro), pull out the dough and fold it over the top and lay it down. Do this for all quadrants.</li><li>Cuts: Take the dough and ‘cut’ it with a squeezing motion using your thumb and fore-finger. Cut the dough into 4–6 clumps and mix them up. Then go back and fold.</li></ul><p>This should be done sufficiently long to incorporate the salt and yeast into the dough.</p><h3>2 Folds in the First Hour</h3><p>So the dough needs two sessions of folding in the first bit of time. I typically do the first set of 720 degree folds (e.g., four folds, twice around the Cambro), and then let it rest. I wet my hands a bit with warm water so it doesn’t stick to much as I go.</p><p>The next fold is 45 minutes later. Do the same.</p><p>I then let it rest until 2–3pm (if starting at 9), until it is ~4 times as large as you started with. It should look something like this, with all the bubbles on it. I put some flour to prepare bring it out.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*kp1j7JqdNVGZ11SultC-9g@2x.jpeg" /></figure><p>Carefully ‘pour’ out the dough onto a flowered surface. Then cut it in half. For both of these, we’ll need to put them into a proofing mold. I have both round and oblong ones. Make sure they are floured before you put the dough into them.</p><p>Also, before you put each of these into the baskets, try to manipulate them to make some surface tension. I do this by cupping my hands together and pulling the dough ball towards yourself, allowing the counter friction to pull the dough on the bottom together and make the surface skin more taught. I usually do this 3–4 times. The result is that the counter-side of the dough ball has a bunch of ‘slack’ dough pulled together and the top of the dough ball is tight.</p><p>Place each doughball in its own basket with the seam/less-taught part in the bottom of the basket. I then take the backup boule and wrap it in a grocery plastic bag and put it in the fridge for 2–3 days. Make sure to pull this one out 1–1.5 hours before you bake it.</p><p>The boule I cook is put into its basket and covered with a kitchen towel for 1–1.5 hours. Check on this at 45 minutes using a “finger poke test”. It will be done when you poke the dough with your finger and the divit doesn’t come all the way back to pre-poke levels.</p><h3>Ovens</h3><p>So to cook this, I had previously done it in the normal oven within a Dutch Oven. I now use an ANOVA Precision Oven (a birthday present by my wife). Here is how each of these methods are done.</p><p><em>Conventional Oven:</em> Put the Dutch Oven (with lid) in the oven and set it for 475°F (or as close as you can get to this) for at least 30 minutes prior to baking. You want to get the oven as hot as possible and environment in the oven will be key to getting the crunch and chewey crust.</p><p>When the loaf is proofed, using your oven mittens, take the Dutch Oven out of the oven and carefully invert the dough into the Dutch Oven. The side that was down in the basket should be the pointing up in the Dutch Oven. Use a <a href="https://www.amazon.com/Riccle-Slashing-Scoring-Leather-Storage/dp/B08CSXMKL9/ref=sr_1_1_sspa?crid=3NCCE92VEDU4G&amp;keywords=bakers+lame&amp;qid=1667171744&amp;qu=eyJxc2MiOiI0LjgyIiwicXNhIjoiNC4wNCIsInFzcCI6IjMuOTQifQ%3D%3D&amp;sprefix=bakers+lame%2Caps%2C85&amp;sr=8-1-spons&amp;psc=1">bakers lame</a> (or VERY sharp knife) and score the top of the loaf. There are a lot of good designs to use, look at these <a href="https://breadtopia.com/how-to-score-dough/">beautiful loaves</a>.</p><p>Bake the loaf, with the lid on, for 30 minutes and then take the lid off and allow it to brown a bit for 10–20 minutes further. I like it <em>almost</em> burnt. Take it out and let it rest (it is going to be a good crust if it is ‘crackling’ as it cools.</p><p><em>Anova Precision Oven:</em> This is medium sized oven that has the ability to steam (or sous vide if you will) by injecting. water into the oven and creating varying levels of humidity. This is the key to making the best crust (the Dutch Oven attempts to do this by creating a closed environment so the moisture cannot escape). I set up the oven as follows:</p><ul><li>Preheat to 482°F (the hottest it can be) with 100% humidity and the rack in the 2nd lowest position. Put in your baking stone (or cast iron) so it heats up as well. I let this go for 20–30 minutes.</li><li>Remove your baking stone/cast iron out and take the proofed loaf and invert it onto it. Score the loaf and put it back into the oven. Cook the oven at 482°F with 100% steam for 20 minutes. This is when your loaf gets its spring and increases in size.</li><li>Lower the temperature to 410°F and 0% humidity for up to 10 minutes to get browned and set the crust.</li></ul><p>No matter which method you use, remove it from the oven and let it cool down until <em>just warm</em>. Eat with butter or a dip of Olive Oil/Salt.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*X3-7Ba50upJgDgAhKAxF4A@2x.jpeg" /><figcaption>Oblong loaf, single cut (backside) and large (haphazzard) wheat cut on the front.</figcaption></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*s2Lh-uBWMl6Rnhu4J6-UJQ@2x.jpeg" /><figcaption>Good openings for a one-day loaf.</figcaption></figure><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=4d60fe786faf" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[ddRADSeq Demultiplexing]]></title>
            <link>https://medium.com/@rodneydyer/ddradseq-demultiplexing-e248ce210a30?source=rss-e1752baecdcf------2</link>
            <guid isPermaLink="false">https://medium.com/p/e248ce210a30</guid>
            <category><![CDATA[ddoscent]]></category>
            <category><![CDATA[ddradseq]]></category>
            <category><![CDATA[genomics]]></category>
            <category><![CDATA[stack]]></category>
            <category><![CDATA[snp]]></category>
            <dc:creator><![CDATA[Rodney Dyer]]></dc:creator>
            <pubDate>Wed, 05 Oct 2022 00:00:09 GMT</pubDate>
            <atom:updated>2022-10-31T15:13:49.711Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/640/1*O0HZCiBzn7CmVxCOsvGSGw.jpeg" /><figcaption>Photo by <a href="https://unsplash.com/@sangharsh_l?utm_source=unsplash&amp;utm_medium=referral&amp;utm_content=creditCopyText">Sangharsh Lohakare</a> on <a href="https://unsplash.com/@sangharsh_l?utm_source=unsplash&amp;utm_medium=referral&amp;utm_content=creditCopyText">Unsplash</a></figcaption></figure><p>Your sequencing facility will let you provide to you a ftp link to download compressed fasta files (ending in .fa.gz in my case). We are getting these data in raw form and will do own own demultiplexing and creating a de novo assembly from which to call SNPs.</p><h3>Setting up SSH</h3><p>One pain point in doing this is that you’ll have to do all the work on a remote server and logging in each time can lead to a pain point (because <em>you are</em> using unique, long, and complicated passwords for each of your accounts, right?).</p><p>To overcome this, set up your public/private SSH key pair. First, check if you have one setup.</p><pre>rodney@Rodneys-Mac-Studio ~ % ls .ssh/id*.pub .ssh/id_rsa.pub</pre><p>If there is nothing there, then you need to generate a new public key.</p><pre>rodney@Rodneys-Mac-Studio ~ % ssh-keygen -t rsa -b 4096 -C &quot;your_email@domain.com&quot;</pre><p>and follow the online instructions. If you do use a <em>passphrase</em> <strong>MAKE SURE</strong> you have it written down somewhere (like in your password manager).</p><p>After this, you should see both the public and private versions in your local repository.</p><pre>rodney@Rodneys-Mac-Studio ~ % ls .ssh/id* .ssh/id_rsa .ssh/id_rsa.pub</pre><p>Now, what you need to do is to copy your identity over to the new server.</p><pre>ssh-copy-id remoteUserID@remote.server.com</pre><p>You should get some message like:</p><pre>remoteUserID@remote.server.com&#39;s password: Number of key(s) added: 1 Now try logging into the machine, with: &quot;ssh &#39;remoteUserID@remote.server.com&#39;&quot; and check to make sure that only the key(s) you wanted were added.</pre><p>Now you should be able to log into the remote server without needing to copy over a password all the time.</p><p>One last thing that I find to help out. If your remote server has some long name to it, you can make a shortcut by adding an entry to the /etc/hosts file.</p><pre>sudo vim /etc/hosts</pre><p>To this file, add a line that has the full name of the server, a tab, and then a nickname you give it.</p><pre>rodney@Rodneys-Mac-Studio ~ % cat /etc/hosts <br>## <br># Host Database <br># <br># localhost is used to configure the loopback interface <br># when the system is booting. Do not change this entry. <br>## <br>127.0.0.1 localhost <br>255.255.255.255 broadcasthost <br>::1 localhost <br>my.server.with.long.name nickname</pre><p>Now, you should be able to log into your remote server as:</p><pre>ssh user@nickname</pre><p>much easier.</p><h3>Getting STACKS</h3><p>Stacks is a set of programs that are used to assemble sequence data. I use it commonly for demultiplexing. Go grab the link to the latest version <a href="https://catchenlab.life.illinois.edu/stacks/">here</a>.</p><p>When I did it for this document it was version 2.62. Grab it from your server. I typically put all the source code into a src folder.</p><pre>$ mkdir src $ cd src $ wget http://catchenlab.life.illinois.edu/stacks/source/stacks-2.62.tar.gz $ tar zxvf stacks-2.62.tar.gz $ cd stacks-2.62</pre><p>Then you need to install it.</p><p>On my current server, they use a Module system for loading various development environments. You can find the documentation <a href="https://wiki.vcu.edu/display/unix/Modules+at+HPRC">here</a>. To load up the most recent version of the gcc compiler set, you enter.</p><pre>$ module load gcc <br>$ module list <br>Currently Loaded Modules: <br>  1) gcc/10.2.1</pre><p>Then you can configure the compiliation and environment.</p><pre>$ ./configure --prefix=/home/user/</pre><p>And if all the stuff is there, you should get a long list of stuff ending with:</p><pre>checking that generated files are newer than configure... done configure: creating ./config.status <br>config.status: creating Makefile <br>config.status: creating htslib/Makefile <br>config.status: creating config.h <br>config.status: executing depfiles commands</pre><p>Now, compile the components (and go grab a cup of coffee)</p><p>If it died for some reason, you’ll have to do some spelunking and figure out why it died (probably due to a missing dependency) and then grab the components that you were missing.</p><p>After that, you can install it (to your local directories).</p><pre>$ make install</pre><p>And everything should be good.</p><h3>Screen</h3><p>Doing anything with this large amount of data will take time. It is good to remember that the vast majority of what you’ll be working with is actually stuff you are going to throw away in the end anyways. That being said, our first main tool will be screen. This is a program that allows you to create a &quot;sub shell&quot; for a process, do something that is going to take a long time, log out of the shell and continue on your daily routine. Then, at various times in the near (or distant) future, you can log back in and see how things are going.</p><p>You can run screen on your machine or on the remote server where things are happening. I’m going to run it on the other end.</p><pre>$ screen --help</pre><p>To start a new screen session, invoke it as:</p><pre>$ screen</pre><p>And you will be entered into a new session. To exit, hit CTRL-A D and you will be pooped out of the screen session.</p><p>To reattach to an existing session, you can list the current active ones</p><pre>$ screen -list <br>There are screens on: <br>  12892.pts-10.server (Detached) <br>  12775.pts-10.server (Detached) <br>  12658.pts-10.server (Detached) <br>3 Sockets in /var/run/screen/S-user.</pre><p>Then reattach to one, you need to specify it by the id.</p><pre>$ screen -r 12892</pre><p>To exit a session you are in (and no longer retain it), type</p><h3>Process Radtags</h3><p>Last time I tried this, I ran it with this configuration on a single linux instance. I am using a single barcode on these tags that was cut with EcoRI. The -r -e options are recommended by dDoscent.</p><pre>$ process_radtags -p ./raw/ -o ./samples/run_13_2/ -b ./barcodes/all/barcodes_all.csv --inline-null --disable-rad-check -i gzfastq -r -e ecoRI</pre><p>Now I am on a cluster and we need to submit our jobs through SLURM. Here is a config file to run a batch run.</p><pre>#!/bin/bash <br>#SBATCH --time=72:00:00 <br>#SBATCH --chdir=./ <br>#SBATCH --mem=16G <br>#SBATCH --mail-user=rjdyer@vcu.edu <br>#SBATCH --mail-type=BEGIN <br>#SBATCH --mail-type=END <br>#SBATCH --mail-type=FAIL <br>#SBATCH --mail-type=REQUEUE <br>#SBATCH --mail-type=ALL #SBATCH -J &quot;radtags&quot; <br>#SBATCH --ntasks=1 </pre><pre>START=$(date +%s.%N) <br>echo &quot;Starting process radtags&quot; </pre><pre># for the run, you need to change the lane process_radtags -p ./raw/lane3/ -o ./samples/land3/ -b ./barcodes/all/barcodes_all.csv --inline-null --disable-rad-check -i gzfastq -r -D -e ecoRI </pre><pre>END=$(date +%s.%N) <br>DIFF=$(echo &quot;($END - $START)/60&quot; | bc) <br>echo &quot;Processing radtags took ${DIFF} minutes to complete.&quot;</pre><p>To run it, I saved the script as 01-process_radtags_slurm.sh, made it executable as</p><pre>$ chmod +x 01-process_radtags_slurm.sh</pre><p>and ran it as:</p><pre>$ sbatch ./01-process_radtags_slurm.sh</pre><p>Actually I was not able to get sbatch to run, so I just did a quick bash srun job.</p><pre>$ srun -A rjdyer --nodes=1 --time=48:00:00 --mem=16G --pty /bin/bash $ process_radtags -p ./raw/lane3/ -o ./samples/land3/ -b ./barcodes/all/barcodes_all.csv --inline-null --disable-rad-check -i gzfastq -r -e ecoRI </pre><p>This was a bit of a more direct approach, just invoking a distributed session for bash and then running it that way. Seemed to work fine.</p><p>Some pages of interest</p><ul><li><a href="https://slurm.schedmd.com/quickstart.html">https://slurm.schedmd.com/quickstart.html</a></li><li><a href="https://gist.github.com/andersgs/4aa1c19f7cd8a2db49a26f06efe7492d">https://gist.github.com/andersgs/4aa1c19f7cd8a2db49a26f06efe7492d</a></li></ul><p>Cover Photo by <a href="https://unsplash.com/@sangharsh_l?utm_source=unsplash&amp;utm_medium=referral&amp;utm_content=creditCopyText">Sangharsh Lohakare</a> on <a href="https://unsplash.com/s/photos/dna?utm_source=unsplash&amp;utm_medium=referral&amp;utm_content=creditCopyText">Unsplash</a></p><p><em>Originally published at </em><a href="https://dyerlab.org/posts/2022-10-05-ddradseq-i/"><em>https://dyerlab.org</em></a><em> on October 5, 2022.</em></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=e248ce210a30" width="1" height="1" alt="">]]></content:encoded>
        </item>
    </channel>
</rss>