<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0" xmlns:cc="http://cyber.law.harvard.edu/rss/creativeCommonsRssModule.html">
    <channel>
        <title><![CDATA[Stories by Sami Muneer on Medium]]></title>
        <description><![CDATA[Stories by Sami Muneer on Medium]]></description>
        <link>https://medium.com/@samimuneer?source=rss-9c5a051d2954------2</link>
        <image>
            <url>https://cdn-images-1.medium.com/fit/c/150/150/1*gwDJksfEsqgJ-QEB7n5KCA.jpeg</url>
            <title>Stories by Sami Muneer on Medium</title>
            <link>https://medium.com/@samimuneer?source=rss-9c5a051d2954------2</link>
        </image>
        <generator>Medium</generator>
        <lastBuildDate>Tue, 17 Nov 2026 04:06:27 GMT</lastBuildDate>
        <atom:link href="https://medium.com/@samimuneer/feed" rel="self" type="application/rss+xml"/>
        <webMaster><![CDATA[yourfriends@medium.com]]></webMaster>
        <atom:link href="http://medium.superfeedr.com/" rel="hub"/>
        <item>
            <title><![CDATA[Continual Education: Lucrative And Underserved]]></title>
            <link>https://medium.com/@samimuneer/continual-education-lucrative-and-underserved-62256367e906?source=rss-9c5a051d2954------2</link>
            <guid isPermaLink="false">https://medium.com/p/62256367e906</guid>
            <category><![CDATA[learning]]></category>
            <category><![CDATA[education]]></category>
            <category><![CDATA[edtech]]></category>
            <dc:creator><![CDATA[Sami Muneer]]></dc:creator>
            <pubDate>Thu, 16 Dec 2021 22:00:18 GMT</pubDate>
            <atom:updated>2021-12-16T22:00:18.919Z</atom:updated>
            <content:encoded><![CDATA[<p>A lot of the Edtech innovation in recent years have, intentionally or inadvertently, begun to address the needs of an underserved market — <strong><em>continual education for professional skills</em></strong>. No single model addresses the four primary archetypes of learners for continual education. In this blog, I’ll address how an individual may transition through the four archetypes over the course of one’s career and some of the online alternatives for the respective needs.</p><p>One of the drivers behind the growing need for continual education is the rapid evolution in skills valued by the market. According to Linkedin, the top 10 job titles used by employees (e.g. iOS developer, big data architect, social media analyst, to name a few) did not even exist 5 years ago. Moreover, the Economist (2014) predicted that 47% of job categories today (e.g. telemarketers, accountants, technical writers) would likely be automated in the next 10–15 years with the evolution of technology. Technology-assisted access to national and global labor pools has accelerated the growth of the free-lance economy, and constitutes about 20% of the labor force in the US today (Bersin/Deloitte), potentially replacing an employee with an amalgam of skills that can be sourced from the market place based on the specific needs at any given time.</p><p>A lot of the changing skills are being learnt on the job for those privileged to be exposed to the relevant experience. There is a broad disparity, in the perception between employers and colleges, on the preparedness of students for the job market in both developed countries as the US as well as the BRIC nations (McKinsey Research 2012). This has exacerbated the situation for the youth in many countries, including Europe, who are struggling to find jobs after graduation, let alone a job they want. Youth unemployment rates are as high as 60% in countries as Spain and Greece (Eurostat).</p><p>Even those with a job have a challenging time to keep up with new skills in demand. While large companies may have structured learning management systems (LMS) and training resources, most small and medium businesses (SMB) do not have the necessary resources to up skill their employees. Most LMS in the market today are cost-prohibitive for SMBs. So SMBs, which constitute 65–75% of businesses in countries as Spain and Italy and as much as 99% in South Korea, not only feel the skill shortage in the market place but also lack the means to effectively recruit and train their employees.</p><p>This puts the burden on the potential employees themselves to address the skill gap. Traditionally, one can learn on the job or through a training program or vocational courses offered by the employer. However, only few employee-centric companies afford to refresh their training curriculum on a regular basis. One can also get certified for a skill (e.g. project management) by professional organizations, or take degree or non-degree classes in post-secondary institutions. Such traditional structured programs can be both a time and financial commitment — $90K for a Stanford masters degree, $40K for a Santa Clara masters degree, $14K for University of Phoenix online degree. Thus bootcamps, continuing study programs, and online alternatives have begun to address the under-served need for continual education with programs that fit the respective lifestyle and circumstances of potential students. In fact, according to EDX, at least 65% of their registrants for their university courses already have an undergraduate degree.</p><p>Per our research at SAP, we have identified four general archetypes of students of continual education. First there is the <strong><em>field promotion</em></strong> learner, who has to constantly refresh his skills to remain competitive and is willing to pay for it. According to Bersin/Deloitte, many professional skills, particularly in IT, have a mere 2.5–5 year half-life, and, consequently, 60% of such professionals have resorted to paying for their learning out-of-pocket to keep up-to-date. IT bootcamps, that could cost about $14k for a 8-week course, are capitalizing on this need with the promise of increased annual incomes. This underscores one of the attributes of such a learner, who may also be looking for a new job or role — <em>sensitivity to time and career disruption</em>. This is why such bootcamps, continuing studies programs at colleges and other intensive vocational programs have seen a substantial increase in enrollments in recent years. Employers have also started recognizing such programs, even though they are not accredited. Other than time-sensitivity, a field promotion learner also cares about the <em>quality of content and education provider based on peer and employer reviews</em> to compensate for the lack of accreditation of the emerging vocational programs. Such a learner also require the <em>flexibility in consumption options</em>, e.g. via mobile, as one may be gainfully employed and have a hectic travel schedule but is motivated to complete a program within a specific time.</p><p>A second archetype is the <strong><em>toolbox learner</em></strong> who cares about learning supplemental skills for career advancement and/or personal growth. Such learners have contributed to the rapid growth of $2 billion-per-year life-coaching industry and $11 billion-per-year self help books (Forbes, July 2014). Corporations are also responding; IDC research predicts that corporate training content in soft skills (e.g. leadership) will grow at 10% annually, and at twice the rate as that for hard skills e.g. IT. The toolbox learner has also turned to new online alternatives as MOOCs; over 45% of students of such programs cite career advancement as a primary driver (Babson Research survey). However, unlike the field promotion learner, the toolbox learner cares more about the specificity of the program to fit her individual specific need. That is why it is more important to have <em>variability of options</em>. It is not a surprise that search terms in MOOCs can be very varied. Given the intrinsic motivation required to pursue such education, it is considered discretionary spending. Hence such learners often chose to seek out <em>free alternatives</em> as manifested in the rise of free language tutorial programs e.g. Duolingo, Memrise at the expense of Rosetta Stone, a 22-year old company, that struggles to remain profitable now. The requisite intrinsic motivation and the availability of free options have also resulted in high attrition rates for such courses, as evident in the low number of completed courses for such skills. Thus some successful platforms e.g. Duolingo have focused on <em>the learning experience</em> itself to keep the toolbox learner engaged.</p><p>The third archetype for continual education is the <strong>resume</strong>-<strong>builder </strong>who essentially needs to learn to attain or maintain a degree/license/certificate. Today, there are about 130 licensed occupations certified by over 15 licensing authorities. Resume-builders expect a higher income as a result of such a license, for example, CPAs expect about a 15% higher salary than non-CPAs (2015 Robert Hall salary guide) or SAP-certified consultants bill at higher rates. Here the need is simple: <em>accreditation</em> to ensure the learner secures her license or certificate. As professionals, they also want to <em>minimize career disruption</em>. Accredited programs are capitalizing on this need. A growing number of business schools are creating specialized masters programs in business-related topics e.g. accounting, management and finance. According to the Graduate Management Admission Council’s (GMAC) survey, such programs have experienced an 86% rise in applications from five years ago. Such specialized programs can be done right after college without requiring the multi-year work experience required of MBA applicants.</p><p>The last archetype is the <strong>trouble-shooter</strong> who cares about solving immediate issues or challenges e.g. in a project. Such a person cares about the <em>immediacy of access</em>, getting answers quickly. They will consult peers or search online for resolution. They also care about <em>access to experts</em> in online communities, where the social perception of an “expert” is a function of one’s pedigrees, experience, active online participation with submissions and contributions, likes and votes on those submissions.</p><p>An individual will represent one or more of these archetypes with changing circumstances over the course of one’s career. Here are three examples. The first is Michelle, who seeks education to change careers in response fluctuations in her job market as well as to develop her passion in writing. She is a resume-builder (law degree), field promotion (bootcamp in negotiation, elder law), and toolbox learner (writing courses) at different stages.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/720/1*hI77XSP7_wZVG2P8U7GSkw.jpeg" /></figure><p>Josh is a recent grad who takes courses to build his technical and design expertise while leveraging existing communities for both assistance and projects. As a millennial, he is more comfortable with online options that help him learn quickly and apply to existing projects. He is field promotion (bootcamp) and toolbox learner (language) and trouble-shooter (online communities) as he develops varying skills.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/720/1*cppSAsBUcJm_ZxIHRb56tg.jpeg" /></figure><p>Mary is an ambitious professional who updates her skills with respect to market trends. She is a resume-builder (MBA) and field promotion learner (corporate course, evening university programs).</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/720/1*PnZH_ZvlBkt8JyjbhjLfJQ.jpeg" /></figure><p>While there are many new options for continuing education that better fit professionals’ lifestyles and circumstances, there are many more opportunities to capitalize on this need. Below is a high-level example of potential coveted features in the near future.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/470/1*LXjqorE_iI3nz9BqMnnH4A.png" /></figure><p>A whole set of macroeconomic trends (e.g. easy access to global labor with improving skills), social trends (e.g. more women returning to work after childbirth), labor trends (e.g. growing freelance economy) and technological impact (e.g. changing job needs) will not only increase the need for continual education but also necessitate education options that fit the professionals’ individual needs and budget. Such emphasis on flexibility and personalization create opportunities for alternatives beyond the limitations of existing structured programs at universities, training institutions and corporations.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=62256367e906" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[A lot of the Edtech innovation in recent years have, intentionally or inadvertently, begun to…]]></title>
            <link>https://medium.com/@samimuneer/a-lot-of-the-edtech-innovation-in-recent-years-have-intentionally-or-inadvertently-begun-to-ed72c15205b3?source=rss-9c5a051d2954------2</link>
            <guid isPermaLink="false">https://medium.com/p/ed72c15205b3</guid>
            <category><![CDATA[education]]></category>
            <category><![CDATA[edtech]]></category>
            <category><![CDATA[education-technology]]></category>
            <dc:creator><![CDATA[Sami Muneer]]></dc:creator>
            <pubDate>Tue, 23 Nov 2021 20:17:33 GMT</pubDate>
            <atom:updated>2021-11-23T20:17:33.055Z</atom:updated>
            <content:encoded><![CDATA[<p>A lot of the Edtech innovation in recent years have, intentionally or inadvertently, begun to address the needs of an underserved market — <strong><em>continual education for professional skills</em></strong>. No single model addresses the four primary archetypes of learners for continual education. In this blog, I’ll address how an individual may transition through the four archetypes over the course of one’s career and some of the online alternatives for the respective needs.</p><p>One of the drivers behind the growing need for continual education is the rapid evolution in skills valued by the market. According to Linkedin, the top 10 job titles used by employees (e.g. iOS developer, big data architect, social media analyst, to name a few) did not even exist 5 years ago. Moreover, the Economist (2014) predicted that 47% of job categories today (e.g. telemarketers, accountants, technical writers) would likely be automated in the next 10–15 years with the evolution of technology. Technology-assisted access to national and global labor pools has accelerated the growth of the free-lance economy, and constitutes about 20% of the labor force in the US today (Bersin/Deloitte), potentially replacing an employee with an amalgam of skills that can be sourced from the market place based on the specific needs at any given time.</p><p>A lot of the changing skills are being learnt on the job for those privileged to be exposed to the relevant experience. There is a broad disparity, in the perception between employers and colleges, on the preparedness of students for the job market in both developed countries as the US as well as the BRIC nations (McKinsey Research 2012). This has exacerbated the situation for the youth in many countries, including Europe, who are struggling to find jobs after graduation, let alone a job they want. Youth unemployment rates are as high as 60% in countries as Spain and Greece (Eurostat).</p><p>Even those with a job have a challenging time to keep up with new skills in demand. While large companies may have structured learning management systems (LMS) and training resources, most small and medium businesses (SMB) do not have the necessary resources to up skill their employees. Most LMS in the market today are cost-prohibitive for SMBs. So SMBs, which constitute 65–75% of businesses in countries as Spain and Italy and as much as 99% in South Korea, not only feel the skill shortage in the market place but also lack the means to effectively recruit and train their employees.</p><p>This puts the burden on the potential employees themselves to address the skill gap. Traditionally, one can learn on the job or through a training program or vocational courses offered by the employer. However, only few employee-centric companies afford to refresh their training curriculum on a regular basis. One can also get certified for a skill (e.g. project management) by professional organizations, or take degree or non-degree classes in post-secondary institutions. Such traditional structured programs can be both a time and financial commitment — $90K for a Stanford masters degree, $40K for a Santa Clara masters degree, $14K for University of Phoenix online degree. Thus bootcamps, continuing study programs, and online alternatives have begun to address the under-served need for continual education with programs that fit the respective lifestyle and circumstances of potential students. In fact, according to EDX, at least 65% of their registrants for their university courses already have an undergraduate degree.</p><p>Per our research at SAP, we have identified four general archetypes of students of continual education. First there is the <strong><em>field promotion</em></strong> learner, who has to constantly refresh his skills to remain competitive and is willing to pay for it. According to Bersin/Deloitte, many professional skills, particularly in IT, have a mere 2.5–5 year half-life, and, consequently, 60% of such professionals have resorted to paying for their learning out-of-pocket to keep up-to-date. IT bootcamps, that could cost about $14k for a 8-week course, are capitalizing on this need with the promise of increased annual incomes. This underscores one of the attributes of such a learner, who may also be looking for a new job or role — <em>sensitivity to time and career disruption</em>. This is why such bootcamps, continuing studies programs at colleges and other intensive vocational programs have seen a substantial increase in enrollments in recent years. Employers have also started recognizing such programs, even though they are not accredited. Other than time-sensitivity, a field promotion learner also cares about the <em>quality of content and education provider based on peer and employer reviews</em> to compensate for the lack of accreditation of the emerging vocational programs. Such a learner also require the <em>flexibility in consumption options</em>, e.g. via mobile, as one may be gainfully employed and have a hectic travel schedule but is motivated to complete a program within a specific time.</p><p>A second archetype is the <strong><em>toolbox learner</em></strong> who cares about learning supplemental skills for career advancement and/or personal growth. Such learners have contributed to the rapid growth of $2 billion-per-year life-coaching industry and $11 billion-per-year self help books (Forbes, July 2014). Corporations are also responding; IDC research predicts that corporate training content in soft skills (e.g. leadership) will grow at 10% annually, and at twice the rate as that for hard skills e.g. IT. The toolbox learner has also turned to new online alternatives as MOOCs; over 45% of students of such programs cite career advancement as a primary driver (Babson Research survey). However, unlike the field promotion learner, the toolbox learner cares more about the specificity of the program to fit her individual specific need. That is why it is more important to have <em>variability of options</em>. It is not a surprise that search terms in MOOCs can be very varied. Given the intrinsic motivation required to pursue such education, it is considered discretionary spending. Hence such learners often chose to seek out <em>free alternatives</em> as manifested in the rise of free language tutorial programs e.g. Duolingo, Memrise at the expense of Rosetta Stone, a 22-year old company, that struggles to remain profitable now. The requisite intrinsic motivation and the availability of free options have also resulted in high attrition rates for such courses, as evident in the low number of completed courses for such skills. Thus some successful platforms e.g. Duolingo have focused on <em>the learning experience</em> itself to keep the toolbox learner engaged.</p><p>The third archetype for continual education is the <strong>resume</strong>-<strong>builder </strong>who essentially needs to learn to attain or maintain a degree/license/certificate. Today, there are about 130 licensed occupations certified by over 15 licensing authorities. Resume-builders expect a higher income as a result of such a license, for example, CPAs expect about a 15% higher salary than non-CPAs (2015 Robert Hall salary guide) or SAP-certified consultants bill at higher rates. Here the need is simple: <em>accreditation</em> to ensure the learner secures her license or certificate. As professionals, they also want to <em>minimize career disruption</em>. Accredited programs are capitalizing on this need. A growing number of business schools are creating specialized masters programs in business-related topics e.g. accounting, management and finance. According to the Graduate Management Admission Council’s (GMAC) survey, such programs have experienced an 86% rise in applications from five years ago. Such specialized programs can be done right after college without requiring the multi-year work experience required of MBA applicants.</p><p>The last archetype is the <strong>trouble-shooter</strong> who cares about solving immediate issues or challenges e.g. in a project. Such a person cares about the <em>immediacy of access</em>, getting answers quickly. They will consult peers or search online for resolution. They also care about <em>access to experts</em> in online communities, where the social perception of an “expert” is a function of one’s pedigrees, experience, active online participation with submissions and contributions, likes and votes on those submissions.</p><p>An individual will represent one or more of these archetypes with changing circumstances over the course of one’s career. Here are three examples. The first is Michelle, who seeks education to change careers in response fluctuations in her job market as well as to develop her passion in writing. She is a resume-builder (law degree), field promotion (bootcamp in negotiation, elder law), and toolbox learner (writing courses) at different stages.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/720/1*hI77XSP7_wZVG2P8U7GSkw.jpeg" /></figure><p>Josh is a recent grad who takes courses to build his technical and design expertise while leveraging existing communities for both assistance and projects. As a millennial, he is more comfortable with online options that help him learn quickly and apply to existing projects. He is field promotion (bootcamp) and toolbox learner (language) and trouble-shooter (online communities) as he develops varying skills.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/720/1*cppSAsBUcJm_ZxIHRb56tg.jpeg" /></figure><p>Mary is an ambitious professional who updates her skills with respect to market trends. She is a resume-builder (MBA) and field promotion learner (corporate course, evening university programs).</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/720/1*PnZH_ZvlBkt8JyjbhjLfJQ.jpeg" /></figure><p>While there are many new options for continuing education that better fit professionals’ lifestyles and circumstances, there are many more opportunities to capitalize on this need. Below is a high-level example of potential coveted features in the near future.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/470/1*LXjqorE_iI3nz9BqMnnH4A.png" /></figure><p>A whole set of macroeconomic trends (e.g. easy access to global labor with improving skills), social trends (e.g. more women returning to work after childbirth), labor trends (e.g. growing freelance economy) and technological impact (e.g. changing job needs) will not only increase the need for continual education but also necessitate education options that fit the professionals’ individual needs and budget. Such emphasis on flexibility and personalization create opportunities for alternatives beyond the limitations of existing structured programs at universities, training institutions and corporations.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=ed72c15205b3" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[How Storyboarding Saved Us Few Months of Work: Lessons from NFL and German Soccer]]></title>
            <link>https://medium.com/marketing-102/how-storyboarding-saved-us-few-months-of-work-lessons-from-nfl-and-german-soccer-9d543cf65d99?source=rss-9c5a051d2954------2</link>
            <guid isPermaLink="false">https://medium.com/p/9d543cf65d99</guid>
            <category><![CDATA[growth]]></category>
            <category><![CDATA[design-thinking]]></category>
            <category><![CDATA[user-experience]]></category>
            <dc:creator><![CDATA[Sami Muneer]]></dc:creator>
            <pubDate>Fri, 25 Mar 2016 20:51:57 GMT</pubDate>
            <atom:updated>2019-12-09T11:45:32.260Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*c9Ti45eIMbFrVYUoHCW3Ew.jpeg" /></figure><p>In my first 2 blogs of this series, I shared stories from my engagement with NFL and soccer teams demonstrating how <a href="https://mng.lincolnwdaniel.com/what-to-observe-lessons-from-working-with-sports-teams-f74effc27117#.lds5z4gd1">observation techniques</a> and <a href="https://mng.lincolnwdaniel.com/do-personas-matter-lessons-from-working-with-sports-teams-136fcdb4b584#.95rv5t1h8">persona development</a> guided our product team on the right problems. In this chapter, I’ll recount the use of storyboards that helped us steer of developing software for scenarios that weren’t necessarily true despite the initial demands from the teams.</p><p>There was one scenario with an NFL team where the storyboard exposed fallacious assumptions. We were exploring how to leverage software and analytics to help the team with roster cuts in preparation for the upcoming season.</p><p>The “pre-season” for NFL teams start with training camp during the 3rd week of July, when they start with 90 players on their roster. In August, every team carries 90 players on its roster through the first two pre-season games. The team then cuts the roster to 75 players after the 3rd pre-season game and then further down to 53 players after the 4th pre-season game.</p><p>Teams are constantly evaluating their roster to make sure they are selecting the best players for the season. This includes both veterans and drafted rookies. They might even bring free agents to test them out. Some teams could be bringing in 8–10 players during the summer. They will look at other teams and try to predict the players they may waive based on their depth charts and other information; They are also “massaging” the status of the players on the injured list, putting them on PUP (players unable to perform). They also react to incidents at training camp.</p><figure><a href="https://getgist.com/"><img alt="" src="https://cdn-images-1.medium.com/max/835/1*I4S9hqbwLvItRrO1FI0nzw.png" /></a></figure><p>The entire operations team including the GM, DPP, pro scouts, coaches and salary cap managers are all involved in the process. There are many considerations to consider and scouts could differ from the coaches in their preferred roster. At the same time, coaches want to bring in people for practice but the salary cap managers may push back for financial reasons.</p><p>The specific scenario we evaluated in detail was the interaction between the coaches and scouts during this period. Each group ranks and orders the players on its version of the depth chart on a daily basis. The GM and the head coach debate their respective preferences every morning. The roster discussions need to account for multiple factors, including contractual and salary cap considerations, injury risks, off-field incidents, probability of players being released from other teams among many others. It was a cumbersome process to aggregate and collate this information regularly.</p><p>With the input of the scouts, we envisioned a world where the entire team could effectively leverage software analytics and create simulations of the roster with new information entered. Both scouts and coaches could have their own simulated version of the depth chart and the software could underline the differences. During their daily discourse, the GM and coach could assess the implications of depth chart changes in real-time, for example, the consequent impact on their salary cap position. The scouts were enthusiastically optimistic about the prospects of such simulation, except there was just one problem.</p><p>We created a storyboard elaborating the new scenario (<a href="http://www.samimuneer.com/pro-scouting/"><em>see the storyboard here</em></a>). As we reviewed it with different groups, it were the coaching assistants who shed light on the technical proficiency of the cohort of coaches: of the 20 or so in the coaching team, only 3–4 interacted with any system on their own; otherwise they depended on the assistants to print out all sorts of documents. The coaches were reading and writing on paper or whiteboards, and it was rather implausible that they would be doing software-driven simulations any time soon. We could always make the software very simple but we needed to contend with ingrained habits. The storyboard helped us avoid developing software for an idea that wouldn’t work with one of key target persona.</p><p>I had experienced another situation with the German national soccer team in preparation for the World Cup 2014. In this case, the storyboard helped us prioritize our efforts on the right problem, one that we hadn’t initially considered. The national teams got to practice as a team only for a mere 50–60 days in total during the 10–12 months leading up to the World Cup. The players needed to fulfill their obligations to their European club teams, limiting their preparation time for the World Cup. However, the coaches endeavored to keep in regular touch with the players by flying into the respective cities for face-to-face meetings on a monthly basis. In the meantime, the scouts would prepare detailed analysis of their performance in the leagues, collating stats and videos, which the coaches then shared with the players during the visits. Their goal was to inculcate the “German philosophy” of playing soccer in the players, which could easily differ from the guidance from their respective club teams.</p><figure><a href="https://getgist.com/"><img alt="" src="https://cdn-images-1.medium.com/max/835/1*f4mRVnSjscHK_Txd28CALg.png" /></a></figure><p>As we developed the storyboard, we inquired about the non-technical parts of the coach-to-player conversation. We explored how the GM and coaches interacted with the players remotely or how the players interacted with each other. It was astonishing to discover that a large proportion of the remote conversations among them were rather trivial, comprising of humor, anecdotes, PR, party stories, etc. The executives strived to instill a sense of camaraderie among the team, particularly between players. However, there was a problem. The emerging roster for the national team composed of veterans as well as new emerging players, which led to inevitable cliques since the players necessarily didn’t know each other well. Whatsapp was the primary channel for ad-hoc communication for the players, who avoided Facebook or emails, and the Whatsapp groups betrayed the cliques. It also appeared that the new players weren’t proactive enough to engage the experienced players. The continual effort by the GM and coaches to foster communication and bonds among the players underscored a core problem with the situation of remote players — the need to create a sense of strong team unity, a differentiating trait of German soccer. As we inset details to add color to the storyboard, we discerned a critical but implicit issue; however, the German executive team didn’t broach the topic, uncertain about the role of technology as a solution. Yet, the social features of the final solution, which even triggered behaviors we hadn’t considered, delivered the utmost benefits to the team.</p><p>Storyboards are an integral part of any design-thinking process. We leveraged them to:</p><ul><li>Validate our assumptions and research synthesis and course-correcting accordingly</li><li>Uncover behaviors and habits initially overlooked</li><li>Identify new and, even more, urgent user needs by exploring the details in specific scenarios</li></ul><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=9d543cf65d99" width="1" height="1" alt=""><hr><p><a href="https://medium.com/marketing-102/how-storyboarding-saved-us-few-months-of-work-lessons-from-nfl-and-german-soccer-9d543cf65d99">How Storyboarding Saved Us Few Months of Work: Lessons from NFL and German Soccer</a> was originally published in <a href="https://medium.com/marketing-102">Marketing And Growth Hacking</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Best Sites and Tools to Learn and Practice Design]]></title>
            <link>https://medium.com/startups-venture-capital/best-sites-and-tools-to-learn-and-practice-design-cbce0b9219d6?source=rss-9c5a051d2954------2</link>
            <guid isPermaLink="false">https://medium.com/p/cbce0b9219d6</guid>
            <category><![CDATA[tech]]></category>
            <category><![CDATA[design]]></category>
            <dc:creator><![CDATA[Sami Muneer]]></dc:creator>
            <pubDate>Wed, 16 Mar 2016 14:33:28 GMT</pubDate>
            <atom:updated>2026-10-29T21:30:38.282Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*UsnMGlCkeOHRZccpPFm-_g.jpeg" /></figure><p>With design a coveted skill today, there are quite a few websites and online institutions that offer classrooms or courses on the different aspects of this field, be it interaction design or visual design or design-thinking. The depth and quality of the content can vary, where a site may specialize in a specific area of design. Some of these sites offer courses for free while others charge a nominal fee relative to what one could expect to pay for a class at a post-secondary institution. Sure design, just like programming or engineering, cannot be learnt by merely attending a class or two, yet many of these sites make design education really accessible. Whether you are a novice and endeavor to learn the basics and be conversant in the topic, or you are experienced designer looking to expand on skills, these sites are good resources to leverage.</p><h4>Learn Design Online</h4><p>Here are a list of sites, along with sources of their content as well as their pricing options for their courses. The first list are third-party online learning platforms that offer a variety of courses of design alongside other disciplines. Some of these learning platforms such as <a href="http://www.lynda.com/"><strong>Lynda</strong></a> (now part of Linkedin) or <a href="https://www.pluralsight.com/"><strong>Pluralsight</strong></a><strong> </strong>have a highly selective process for content contributors while a MOOC as <a href="https://www.coursera.org/"><strong>Coursera</strong></a> is an open platform with content from a combination of both educators and other professionals. In the list below, <a href="https://www.udemy.com/"><strong>Udemy</strong></a> and <a href="https://generalassemb.ly/"><strong>General Assembly</strong></a> have the most comprehensive set of design courses across all disciplines of design, with quite some courses that are free. Pluralsight, Lynda, and <a href="https://www.skillshare.com/"><strong>Skillshare</strong></a> also offer courses on website and software design. <a href="https://www.bloc.io/"><strong>BLOC</strong></a> focuses primarily on front-end programming courses along with some on UX.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/720/1*-me6PQXkn5ZVxskLUI63MQ.jpeg" /></figure><p>This next list comprise of universities such as <a href="http://www.newschool.edu/"><strong>Parsons</strong></a><strong>, </strong><a href="http://www.fullsail.edu/"><strong>Fullsail</strong></a><strong>, </strong><a href="https://www.aionline.edu/online-education/"><strong>The Art Institute</strong></a> that offer online courses and degrees, and (design) community-curated programs such as <a href="https://www.howdesignuniversity.com/"><strong>How University</strong></a> and <a href="https://www.interaction-design.org/"><strong>Interaction Design Foundation</strong></a>.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/720/1*QQtNpI7U4LuLAsjUKWEjUQ.jpeg" /></figure><p>Design-thinking is gaining broad acceptance as a proven methodology to solve design problems. It focuses on empathizing with the user, truly understanding her needs, taking creating approaches to solving her issues and frequently iterating and testing prototypes to create the desired solution. There are many sites that offer courses on design-thinking including <a href="http://www.designkit.org/"><strong>IDEO’s Design Kit</strong></a><strong>, </strong><a href="https://novoed.com/"><strong>Stanford’s Novoed</strong></a><strong>, </strong><a href="https://www.udemy.com/"><strong>Udemy</strong></a><strong> </strong>and<strong> </strong><a href="http://www.coursera.com/"><strong>Coursera</strong></a><strong>.</strong></p><h4>Get Inspired</h4><p>If you are looking for design inspiration, here are some sites to look into:</p><p><a href="https://niice.co/"><strong>Niice:</strong></a> Large collection of well-designed websites</p><p><a href="https://dribbble.com/"><strong>Dribble:</strong></a> Site where designers show off their work</p><p><a href="http://designspiration.net/"><strong>Design Inspiration</strong></a> on Pinterest</p><p><a href="http://zurb.com/library"><strong>Zurb University:</strong></a> Offers UI library with patterns and building blocks</p><p><a href="http://www.awwwards.com/"><strong>Awwwards</strong></a>: Design awards for websites</p><p><a href="http://www.wallpaper.com/"><strong>Wallpaper:</strong></a> online publication with editorial content</p><p><a href="http://awards.ixda.org/"><strong>IXDA Awards:</strong></a> Design awards site with submissions from both companies and universities</p><h4>Get Started with Design Tools</h4><p>Once you have learnt the basics, there are many design tools available today that provide design templates and UI libraries, enable you to create mockups and prototypes for different devices, collaborate with project teams and review with end users. Quite a few of these tools integrate with other complementary tools e.g. with diagramming tools or development environments.</p><p>The following tools are commonly used by designers for <strong><em>diagramming</em></strong> and <strong><em>wireframes:</em></strong></p><p><a href="http://www.adobe.com/creativecloud.html"><strong>Adobe Creative Cloud:</strong></a> focused on the desktop, and includes creative apps as Photoshop, Illustrator and InDesign</p><p><a href="https://www.omnigroup.com/omnigraffle"><strong>Omnigraffle</strong>:</a> popular with artists and designers for mockups, diagramming and digital illustration.</p><p><a href="https://www.sketchapp.com/"><strong>Sketch</strong>:</a> focused on the Mac. Used for designing websites, interfaces, icons.</p><p><a href="https://products.office.com/en-us/Visio/flowchart-software"><strong>Visio:</strong></a> diagramming tool from Microsoft with integration to the Office suite</p><p>These following tools have have both simplified the wireframing features and extended them with <strong><em>prototyping</em></strong><em> </em>capabilities. Many are popular with designers as well:</p><p><a href="http://www.axure.com/"><strong>Axure</strong></a><strong>:</strong> includes collaboration features. Includes widgets from community. Simple learning tutorials</p><p><a href="http://www.invisionapp.com/"><strong>Invision</strong></a>: includes collaboration, feedback and project management.</p><p><a href="https://www.uxpin.com/"><strong>UXPin</strong></a>: includes stencil libraries and collaboration features. Integration to Photoshop and Sketch.</p><p><a href="http://www.irise.com/"><strong>iRise:</strong></a> with code-generation capabilities. Popular in large companies</p><p>There are many more vendors that have entered the prototyping market to address new audiences or focus on specific needs</p><p><a href="https://balsamiq.com/"><strong>Balsalmiq</strong></a><strong>:</strong> easy-to-use tool for anyone to create mockups.</p><p><a href="https://www.experiencesplash.com/splashapp/"><strong>SAP Build</strong></a>: unique focus on prototyping enterprise applications. Code generation capabilities makes it popular with developers and IT as well.</p><p><a href="https://proto.io/"><strong>Proto.io:</strong> </a>interactive prototyping tool with animation and UI libraries. Player allows to test app behavior</p><p><a href="https://atomic.io/"><strong>Atomic:</strong></a> interactive prototyping with visual styling guides</p><p><a href="http://www.protoshare.com/"><strong>Protoshare:</strong></a> emphasizes collaboration with integration to Google Drive, Jira, Confluence</p><p><a href="https://www.lucidchart.com/pages/ent_new?utm_expid=11945330-399.S7N5U0IjS-aN-L6rSYEAsQ.1&amp;utm_referrer=https%3A%2F%2Fwww.lucidchart.com%2Fpages%2Fent_new"><strong>Lucidchart</strong></a><strong>: </strong>primarily a diagramming tool with extended prototyping features; integrates with Jira, Jive.</p><p><a href="http://www.flairbuilder.com/"><strong>Flairbuilder</strong></a><strong>:</strong> prototyping tool used for websites</p><p><a href="https://pidoco.com/en"><strong>Pidoco</strong>:</a> simple tool to learn. Include UI libraries</p><p>Other than those listed above, there are many more similar tools in the market. Many are cloud-based apps, meaning they offer monthly subscriptions to use their features. The other tools include <a href="http://www.hotgloo.com/"><strong>Hotgloo</strong></a><strong>, </strong><a href="http://www.appcooker.com/"><strong>Appcooker</strong></a><strong>, </strong><a href="http://www.foreui.com/"><strong>ForeUI</strong></a><strong>, </strong><a href="https://cacoo.com/"><strong>Cacoo</strong></a><strong>, , </strong><a href="https://www.fluidui.com/"><strong>Fluid UI</strong></a><strong>, </strong><a href="http://wireframesketcher.com/"><strong>Wireframe Sketcher</strong></a><strong>, </strong><a href="http://framebox.org/"><strong>Framebox</strong></a><strong>, </strong><a href="https://www.gliffy.com/"><strong>Gliffy</strong></a><strong>, </strong><a href="https://www.mockflow.com/"><strong>Mockflow</strong></a><strong>, </strong><a href="https://moqups.com/"><strong>Moqups</strong></a><strong>, </strong><a href="http://www.antetype.com/"><strong>Antetype</strong></a><strong>, </strong><a href="http://www.wirify.com/"><strong>Wirify</strong></a><strong>, </strong><a href="http://quirktools.com/wires/"><strong>Wires</strong></a><strong>, </strong><a href="https://ninjamock.com/"><strong>Ninjamock</strong></a></p><p>There are quite a few emerging tools focused on the pre-design phase or <strong><em>discovery</em></strong> phase.</p><p><a href="https://mural.ly/"><strong>Murally</strong></a>: online brainstorming and collaboration tool</p><p><a href="http://www.tandemseven.com/"><strong>Tandemseven</strong></a>: tools for creating persona and journey maps</p><p><a href="http://www.extensio.com/index.html?"><strong>Extensio</strong></a><strong>: </strong>tools for creating persona, storyboards and lean canvas</p><p><em>Please free to let me know about any other good sites, tools or resources that I might have missed, and I’ll make sure to include them.</em></p><p><em>If you liked the post, please hit ♥ to share with others.</em></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=cbce0b9219d6" width="1" height="1" alt=""><hr><p><a href="https://medium.com/startups-venture-capital/best-sites-and-tools-to-learn-and-practice-design-cbce0b9219d6">Best Sites and Tools to Learn and Practice Design</a> was originally published in <a href="https://medium.com/startups-venture-capital">Startups &amp; Venture Capital</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Do Personas Matter? Lessons from Working with Sports Teams]]></title>
            <link>https://medium.com/marketing-102/do-personas-matter-lessons-from-working-with-sports-teams-136fcdb4b584?source=rss-9c5a051d2954------2</link>
            <guid isPermaLink="false">https://medium.com/p/136fcdb4b584</guid>
            <category><![CDATA[design-thinking]]></category>
            <category><![CDATA[growth]]></category>
            <category><![CDATA[user-experience]]></category>
            <dc:creator><![CDATA[Sami Muneer]]></dc:creator>
            <pubDate>Thu, 25 Feb 2016 23:16:04 GMT</pubDate>
            <atom:updated>2019-12-10T03:09:02.702Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*FPrXOi-AluJH4mNixyEJLw.jpeg" /></figure><p>In my first blog of this series, I shared stories from my engagement with NFL and soccer teams identifying areas to focus on during <a href="https://medium.com/@samimuneer/f74effc27117">observation</a>. In this chapter, I’ll focus on the lessons learned in creating <strong><em>personas</em></strong> during the synthesis of research.</p><p>Personas is an effective tool during synthesis in the design-thinking process. It is an archetype of the buyers, or one of the user groups, which assume the attributes of these groups, including demographics, background, needs, desires, goals and activities. However, one needs to ensure that the information is collected and assessed with due rigor.</p><p>Sports operations teams (scouting, coaching, salary cap) tend to be small teams. Teams claimed the need to make unified decisions as one team and so we had assumed the free flow of information among team members, particularly since most of them often sat in the same building, if not on the same floor. Yet, we discovered over time that information could be often restricted, where NFL salary cap managers, scouts and coaches didn’t necessarily share all the information with each other to avoid “influencing their evaluations.” By assessing the flow of information, we were able to discern between habits of individual groups vs. the needs of the organization.</p><figure><a href="https://getgist.com/"><img alt="" src="https://cdn-images-1.medium.com/max/835/1*I4S9hqbwLvItRrO1FI0nzw.png" /></a></figure><p>We also discovered misplaced assumptions when we tracked the flow of information within the German national soccer team. Scouts prepared all the player analysis, which was then conveyed by the coaches to the players. It made sense since the coaches could provide the requisite commentary. However, restraining from the obvious assumption, we inquired why the scouts didn’t share the stats or analysis with the players directly as we wondered if every analysis needed elucidation. The scouts themselves assumed that the players would take the information seriously only if the coaches delivered it, an assumption we clarified to be unfounded in our conversation with the players. The software, which enabled the scouts to share information directly with the players, changed the behaviors of both groups, motivating the scouts to share more analysis regularly to players who actually appreciated it.</p><p>During the player persona synthesis, we discovered sub-segments within them. The coaches of the German team shared humorous stories of players teasing each other on social apps as Whatsapp. However, when we inquired about the size of these online groups or the frequency of this communication, we recognized the implicit but undeniable cliques among the players, for example, experienced players vs. the newbies, regardless of position. This was in fact a problem for a team that endeavored to differentiate itself on team unity.</p><p>Despite the rigorous research, we had once overlooked a critical dependency that cost significant development time to rectify the NFL solution. When developing the college scouting application, we identified the comprehensive sources of information and all relevant dependencies. We had confirmed that college scouts did not depend on pro-scouts for any specific information for their evaluation process; however, we had failed to recognize the requisite reverse flow of information from college scouts to pro-scouts. While it didn’t impact the development of the college scouting software, it had considerable architectural implications for it when we starting developing pro-scouting.</p><p>Besides the flow of information, it was insightful to understand how different personas processed information, in other words, their mind-flows. Every question a scout or coach asked led to another relevant question. For example, when the scout reviewed a player’s stats, he wonders other players “around him” with very similar stats. Why does he care? His next question is whether the surrounding players are any good based on the scouts’ grades on the player. If they do have good grades, then are the compensations and contracts similar? This inquiry flow helps them identify similar players based on quantitative information that they might have missed during the qualitative assessment.</p><figure><a href="https://getgist.com/"><img alt="" src="https://cdn-images-1.medium.com/max/835/1*f4mRVnSjscHK_Txd28CALg.png" /></a></figure><p>In addition to mind-flows, it was beneficial to also consider the cognitive biases of the target persona. For example, scouts or coaches tend to anchor their draft evaluations based on their good picks in recent years. Other biases such as availability heuristics, clustering illusions or choice-supportive biases during the draft process underscored the need for accessible analytics for all users.</p><p>To truly understand the users and create accurate personas, we paid attention to:</p><ul><li>Flow of information across all primary and secondary user groups in both directions</li><li>Dependency on different information sources</li><li>Assumptions behind habits</li><li>Nuances and sub-segments within a user group</li><li>Mind-flows</li><li>Cognitive biases</li></ul><p>In each engagement with a new sports team, we spend considerable time developing and refining the personas, even if they were from the same sport. It helped us filter out the idiosyncrasies of any individual GM, coach or scout and paint the true persona, their needs, motivations, goals and mind-flows. Despite all this effort, we uncovered more critical issues, that we had overlooked, during <strong><em>storyboarding, </em></strong>the topic of my next blog in this series.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=136fcdb4b584" width="1" height="1" alt=""><hr><p><a href="https://medium.com/marketing-102/do-personas-matter-lessons-from-working-with-sports-teams-136fcdb4b584">Do Personas Matter? Lessons from Working with Sports Teams</a> was originally published in <a href="https://medium.com/marketing-102">Marketing And Growth Hacking</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[What to Observe? Lessons from Working with Sports Teams]]></title>
            <link>https://medium.com/marketing-102/what-to-observe-lessons-from-working-with-sports-teams-f74effc27117?source=rss-9c5a051d2954------2</link>
            <guid isPermaLink="false">https://medium.com/p/f74effc27117</guid>
            <category><![CDATA[growth]]></category>
            <category><![CDATA[user-experience]]></category>
            <category><![CDATA[design-thinking]]></category>
            <dc:creator><![CDATA[Sami Muneer]]></dc:creator>
            <pubDate>Thu, 25 Feb 2016 23:15:40 GMT</pubDate>
            <atom:updated>2019-12-10T03:08:26.871Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/738/1*RRmFFfMi4xyEzoCcbkZYiw.jpeg" /></figure><p>Over my few years of building software for NFL and soccer teams, it was almost always the same conversation with any sports team during one of the initial meetings. I would assert that our team didn’t want to get any specific requirements from them, but that we would infer their needs with different design techniques. We would surely review and iterate our findings and ideas at each step of the way. We would always get nods at the meeting only to receive a lengthy document of requirements within a couple of days if not that same evening. Surely, it is highly improbable, if not outright preposterous, to expect any sports GM, coach or scout to be acquainted with the design-thinking process. It would often take a few weeks of close collaboration and frequent iteration of artifacts for any sports team to eventually internalize the process.</p><p>Design-thinking was definitely the right approach to create entirely new apps for this segment. As product teams measured on delivery, we are often incentivized to release as many features as possible as quickly as possible. Delivery is much easier to measure than experience. Hence its rather natural we tend to prefer solutions that take the shortest route between the problem and the solution, avoiding the scenic route of continual iteration and testing promoted by design-thinking principles. Yet, by adhering to the latter, we were definitely able to avoid many costly mistakes later.</p><p>In a series of blogs, I’ll share stories along each step of the design-thinking process in our engagement with sports teams: observation, interviews, synthesis, storyboards, problem reframing for ideation and iterative prototyping. In this specific blog, I focus on what we learnt from<strong><em>observation</em></strong> that could be sometimes quite contrary to what was actually said.</p><figure><a href="https://getgist.com/"><img alt="" src="https://cdn-images-1.medium.com/max/835/1*I4S9hqbwLvItRrO1FI0nzw.png" /></a></figure><p>One of my favorite examples is when we had asked one of the NFL scouts to describe his most successful draft pick. It was one of his proudest achievements and hence it was, understandably, rather hard for him to contain his excitement. He described his rationale in detail. To do so, he opened 3 different cabinets to pull out a few folders. During his explanation, he opened the team’s current system and clicked through a few screens. He even ran to an adjacent room to bring in yet another folder or two. As he reminisced his decision process and ran around to pull out the player’s files, he enacted their core problem — the information was all over the place! 2 rooms, 3 cabinets, 5 folders, 7–8 screens — all to explain one player! We had learnt more from those 10 minutes of observation than I had the previous 90 minutes of interview with him.</p><p>Observation helped counter strong voices for specific features. One such example was the resolution of the debate with scouting execs for the need of complete mobile applications for NFL scouts to use at different events as the Combines or All-Stars. Some of the execs felt their scouts needed a mobile interface to the entire scouting application when they are on the field assessing players doing their different workouts at the Combines. Scouts recorded their own timing of the players’ speeds and jotted other notes. The reasoning for a mobile application is to enable the scouts to not only pull up information about the players, but also to be able to record the speed times and capture notes directly into the application. This would also enable the GM to review all information real-time while he is at the event. It all made sense in theory till we observed the scouts on the field.</p><p>With the workouts happening in rapid succession, the scouts try to keep up with accurate recording of speeds with their stopwatches. They usually jot a few notes down on a small notepad, and that too written in shorthand. The primary information they seek on a player is to ensure they are watching the right player, identified by the jersey number. The younger scouts made an unconvincing effort trying to retrieve any information from an iPad, let alone the less tech-savvy, often older, scouts. In fact, the iPad would often be laid on the grass if there was not a scout assistant to hold it. The most effective solution would be have only a screen or two to surface the 2–3 most pertinent information about the player required at that time with rather prominent typography to be legible in broad daylight. We were only able to push back on the original requirements after such an observation.</p><p>There were other cases where observation revealed various circumstances we would not have accounted for, e.g. urgency or time pressure. There are many situations where the scouts are subjected to multiple queries to justify their evaluation on a player. This could happen when a GM needs to backfill the position of an injured player in a critical position with an unrestricted free agent. If the GM is not convinced with the evaluation, he may barrage the scout with questions within the short window they have to make a decision. Its through observation that such situations that we realized that the user navigation, that feels intuitive enough during a regular evaluation process, becomes extremely frustrating as the scout jumps around to find the key information dispersed in different sections.</p><p>We have observed many such situations, for example, when the salary cap manager is trying to verify the stats and contractual information of comparative players during his phone negotiation with the agent who just brought them up; or the GM is trying to find emergency players for try-outs or UFA players to replace injured players while he is on the field or at the game.</p><p>Ironically, these situations necessarily do not come up during interviews or the requirements don’t account for them yet the users tend to remember these 10–15 minutes of frustration with the software more vividly than any other experience.</p><figure><a href="https://getgist.com/"><img alt="" src="https://cdn-images-1.medium.com/max/835/1*f4mRVnSjscHK_Txd28CALg.png" /></a></figure><p>There were quite a few funny observations in the difference of opinions or perceptions between different user groups. NFL teams use a rather complex grading system to evaluate their players. Given that the grade is so fundamental to the evaluation process — for example, specifying a college player’s position on the draft board — the scouting execs asserted that all their scouts knew the grading system by memory. Yet in almost all our interviews with the scouts, we observed each one pull out a cheat sheet of the grades from their drawers.</p><p>While some locations were planned for observation, other observations were serendipitous. Yet we learnt a lot from the observations than we would have otherwise missed during the interviews or group workshops. There were a few steps we always endeavored to follow to allow us as much opportunity to observe the users in different circumstances and locations:</p><ul><li>Talk to them at their location at different times (day, season, etc.)</li><li>Shadow them for periods of time (day, weeks)</li><li>Shadow them in group interactions or during periods of heavy workload</li><li>Capture as much of the detailed environment and setting of every story shared</li><li>Nudge them to tell detailed stories, particularly those associated with heightened emotions; and contrast those with dull periods.</li></ul><p>The above steps steered our efforts on the right problems which were sometimes contrary to what was said or prioritized by the teams themselves. In the next blog, I’ll highlight both the insights and issues with our <strong><em>user interviews</em></strong> with them</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=f74effc27117" width="1" height="1" alt=""><hr><p><a href="https://medium.com/marketing-102/what-to-observe-lessons-from-working-with-sports-teams-f74effc27117">What to Observe? Lessons from Working with Sports Teams</a> was originally published in <a href="https://medium.com/marketing-102">Marketing And Growth Hacking</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Lessons from NFL: Merits of Observation]]></title>
            <link>https://medium.com/@samimuneer/lessons-from-nfl-merits-of-observation-c91f0629cf2c?source=rss-9c5a051d2954------2</link>
            <guid isPermaLink="false">https://medium.com/p/c91f0629cf2c</guid>
            <category><![CDATA[ux]]></category>
            <category><![CDATA[design]]></category>
            <dc:creator><![CDATA[Sami Muneer]]></dc:creator>
            <pubDate>Sun, 14 Feb 2016 19:51:08 GMT</pubDate>
            <atom:updated>2016-02-14T19:51:08.203Z</atom:updated>
            <content:encoded><![CDATA[<p>Over my few years of building software for NFL and soccer teams, it was almost always the same conversation with any sports team during one of the initial meetings. I would assert that our team didn’t want to get any specific requirements from them, but that we would infer their needs with different design techniques. We would surely review and iterate our findings and ideas at each step of the way. We would always get nods at the meeting only to receive a lengthy document of requirements within a couple of days if not that same evening. Surely, it is highly improbable, if not outright preposterous, to expect any sports GM, coach or scout to be acquainted with the design-thinking process. It would often take a few weeks of close collaboration and frequent iteration of artifacts for any sports team to eventually internalize the process.</p><p>Design-thinking was definitely the right approach to create entirely new apps for this segment. As product teams measured on delivery, we are often incentivized to release as many features as possible as quickly as possible. Delivery is much easier to measure than experience. Hence its rather natural we tend to prefer solutions that take the shortest route between the problem and the solution, avoiding the scenic route of continual iteration and testing promoted by design-thinking principles. Yet, by adhering to the latter, we were definitely able to avoid many costly mistakes later.</p><p>In a series of blogs, I’ll share stories along each step of the design-thinking process in our engagement with sports teams: observation, interviews, synthesis, storyboards, problem reframing for ideation and iterative prototyping. In this specific blog, I focus on what we learnt from <strong><em>observation</em></strong> that could be sometimes quite contrary to what was actually said.</p><p>One of my favorite examples is when we had asked one of the NFL scouts to describe his most successful draft pick. It was one of his proudest achievements and hence it was, understandably, rather hard for him to contain his excitement. He described his rationale in detail. To do so, he opened 3 different cabinets to pull out a few folders. During his explanation, he opened the team’s current system and clicked through a few screens. He even ran to an adjacent room to bring in yet another folder or two. As he reminisced his decision process and ran around to pull out the player’s files, he enacted their core problem — the information was all over the place! 2 rooms, 3 cabinets, 5 folders, 7–8 screens — all to explain one player! We had learnt more from those 10 minutes of observation than I had the previous 90 minutes of interview with him.</p><p>Observation helped counter strong voices for specific features. One such example was the resolution of the debate with scouting execs for the need of complete mobile applications for NFL scouts to use at different events as the Combines or All-Stars. Some of the execs felt their scouts needed a mobile interface to the entire scouting application when they are on the field assessing players doing their different workouts at the Combines. Scouts recorded their own timing of the players’ speeds and jotted other notes. The reasoning for a mobile application is to enable the scouts to not only pull up information about the players, but also to be able to record the speed times and capture notes directly into the application. This would also enable the GM to review all information real-time while he is at the event. It all made sense in theory till we observed the scouts on the field.</p><p>With the workouts happening in rapid succession, the scouts try to keep up with accurate recording of speeds with their stopwatches. They usually jot a few notes down on a small notepad, and that too written in shorthand. The primary information they seek on a player is to ensure they are watching the right player, identified by the jersey number. The younger scouts made an unconvincing effort trying to retrieve any information from an iPad, let alone the less tech-savvy, often older, scouts. In fact, the iPad would often be laid on the grass if there was not a scout assistant to hold it. The most effective solution would be have only a screen or two to surface the 2–3 most pertinent information about the player required at that time with rather prominent typography to be legible in broad daylight. We were only able to push back on the original requirements after such an observation.</p><p>There were other cases where observation revealed various circumstances we would not have accounted for, e.g. urgency or time pressure. There are many situations where the scouts are subjected to multiple queries to justify their evaluation on a player. This could happen when a GM needs to backfill the position of an injured player in a critical position with an unrestricted free agent. If the GM is not convinced with the evaluation, he may barrage the scout with questions within the short window they have to make a decision. Its through observation that such situations that we realized that the user navigation, that feels intuitive enough during a regular evaluation process, becomes extremely frustrating as the scout jumps around to find the key information dispersed in different sections.</p><p>We have observed many such situations, for example, when the salary cap manager is trying to verify the stats and contractual information of comparative players during his phone negotiation with the agent who just brought them up; or the GM is trying to find emergency players for try-outs or UFA players to replace injured players while he is on the field or at the game.</p><p>Ironically, these situations necessarily do not come up during interviews or the requirements don’t account for them yet the users tend to remember these 10–15 minutes of frustration with the software more vividly than any other experience.</p><p>There were quite a few funny observations in the difference of opinions or perceptions between different user groups. NFL teams use a rather complex grading system to evaluate their players. Given that the grade is so fundamental to the evaluation process — for example, specifying a college player’s position on the draft board — the scouting execs asserted that all their scouts knew the grading system by memory. Yet in almost all our interviews with the scouts, we observed each one pull out a cheat sheet of the grades from their drawers.</p><p>While some locations were planned for observation, other observations were serendipitous. Yet we learnt a lot from the observations than we would have otherwise missed during the interviews or group workshops. There were a few steps we always endeavored to follow to allow us as much opportunity to observe the users in different circumstances and locations:</p><ul><li>Talk to them at their location at different times (day, season, etc.)</li><li>Shadow them for periods of time (day, weeks)</li><li>Shadow them in group interactions or during periods of heavy workload</li><li>Capture as much of the detailed environment and setting of every story shared</li><li>Nudge them to tell detailed stories, particularly those associated with heightened emotions; and contrast those with dull periods.</li></ul><p>The above steps steered our efforts on the right problems which were sometimes contrary to what was said or prioritized by the teams themselves. In the next blog, I’ll highlight both the insights and issues with our <strong><em>user interviews</em></strong> with them.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=c91f0629cf2c" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Lucrative Yet Underserved Opportunity in EdTech]]></title>
            <link>https://medium.com/startups-venture-capital/continual-education-lucrative-yet-underserved-30dd09919303?source=rss-9c5a051d2954------2</link>
            <guid isPermaLink="false">https://medium.com/p/30dd09919303</guid>
            <category><![CDATA[education]]></category>
            <category><![CDATA[college]]></category>
            <category><![CDATA[tech]]></category>
            <dc:creator><![CDATA[Sami Muneer]]></dc:creator>
            <pubDate>Fri, 12 Feb 2016 17:59:36 GMT</pubDate>
            <atom:updated>2026-10-29T21:38:24.397Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*SODYRotm5Bidyf6_056khw.jpeg" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*7lOaf1ki1TQsuCpcTANJ-w.jpeg" /></figure><p>A lot of the Edtech innovation in recent years have, intentionally or inadvertently, begun to address the needs of an underserved market — <strong><em>continual education for professional skills</em></strong>. No single model addresses the four primary archetypes of learners for continual education. In this blog, I’ll address how an individual may transition through the four archetypes over the course of one’s career and some of the online alternatives for the respective needs.</p><p>One of the drivers behind the growing need for continual education is the rapid evolution in skills valued by the market. According to Linkedin, the top 10 job titles used by employees (e.g. iOS developer, big data architect, social media analyst, to name a few) did not even exist 5 years ago. Moreover, the Economist (2014) predicted that 47% of job categories today (e.g. telemarketers, accountants, technical writers) would likely be automated in the next 10–15 years with the evolution of technology. Technology-assisted access to national and global labor pools has accelerated the growth of the free-lance economy, and constitutes about 20% of the labor force in the US today (Bersin/Deloitte), potentially replacing an employee with an amalgam of skills that can be sourced from the market place based on the specific needs at any given time.</p><p>A lot of the changing skills are being learnt on the job for those privileged to be exposed to the relevant experience. There is a broad disparity, in the perception between employers and colleges, on the preparedness of students for the job market in both developed countries as the US as well as the BRIC nations (McKinsey Research 2012). This has exacerbated the situation for the youth in many countries, including Europe, who are struggling to find jobs after graduation, let alone a job they want. Youth unemployment rates are as high as 60% in countries as Spain and Greece (Eurostat).</p><p>Even those with a job have a challenging time to keep up with new skills in demand. While large companies may have structured learning management systems (LMS) and training resources, most small and medium businesses (SMB) do not have the necessary resources to up skill their employees. Most LMS in the market today are cost-prohibitive for SMBs. So SMBs, which constitute 65–75% of businesses in countries as Spain and Italy and as much as 99% in South Korea, not only feel the skill shortage in the market place but also lack the means to effectively recruit and train their employees.</p><p>This puts the burden on the potential employees themselves to address the skill gap. Traditionally, one can learn on the job or through a training program or vocational courses offered by the employer. However, only few employee-centric companies afford to refresh their training curriculum on a regular basis. One can also get certified for a skill (e.g. project management) by professional organizations, or take degree or non-degree classes in post-secondary institutions. Such traditional structured programs can be both a time and financial commitment — $90K for a Stanford masters degree, $40K for a Santa Clara masters degree, $14K for University of Phoenix online degree. Thus bootcamps, continuing study programs, and online alternatives have begun to address the under-served need for continual education with programs that fit the respective lifestyle and circumstances of potential students. In fact, according to EDX, at least 65% of their registrants for their university courses already have an undergraduate degree.</p><p>Per our research at SAP, we have identified four general archetypes of students of continual education. First there is the <strong><em>field promotion</em></strong> learner, who has to constantly refresh his skills to remain competitive and is willing to pay for it. According to Bersin/Deloitte, many professional skills, particularly in IT, have a mere 2.5–5 year half-life, and, consequently, 60% of such professionals have resorted to paying for their learning out-of-pocket to keep up-to-date. IT bootcamps, that could cost about $14k for a 8-week course, are capitalizing on this need with the promise of increased annual incomes. This underscores one of the attributes of such a learner, who may also be looking for a new job or role — <em>sensitivity to time and career disruption</em>. This is why such bootcamps, continuing studies programs at colleges and other intensive vocational programs have seen a substantial increase in enrollments in recent years. Employers have also started recognizing such programs, even though they are not accredited. Other than time-sensitivity, a field promotion learner also cares about the <em>quality of content and education provider based on peer and employer reviews</em> to compensate for the lack of accreditation of the emerging vocational programs. Such a learner also require the <em>flexibility in consumption options</em>, e.g. via mobile, as one may be gainfully employed and have a hectic travel schedule but is motivated to complete a program within a specific time.</p><p>A second archetype is the <strong><em>toolbox learner</em></strong> who cares about learning supplemental skills for career advancement and/or personal growth. Such learners have contributed to the rapid growth of $2 billion-per-year life-coaching industry and $11 billion-per-year self help books (Forbes, July 2014). Corporations are also responding; IDC research predicts that corporate training content in soft skills (e.g. leadership) will grow at 10% annually, and at twice the rate as that for hard skills e.g. IT. The toolbox learner has also turned to new online alternatives as MOOCs; over 45% of students of such programs cite career advancement as a primary driver (Babson Research survey). However, unlike the field promotion learner, the toolbox learner cares more about the specificity of the program to fit her individual specific need. That is why it is more important to have <em>variability of options</em>. It is not a surprise that search terms in MOOCs can be very varied. Given the intrinsic motivation required to pursue such education, it is considered discretionary spending. Hence such learners often chose to seek out <em>free alternatives</em> as manifested in the rise of free language tutorial programs e.g. Duolingo, Memrise at the expense of Rosetta Stone, a 22-year old company, that struggles to remain profitable now. The requisite intrinsic motivation and the availability of free options have also resulted in high attrition rates for such courses, as evident in the low number of completed courses for such skills. Thus some successful platforms e.g. Duolingo have focused on <em>the learning experience</em> itself to keep the toolbox learner engaged.</p><p>The third archetype for continual education is the <strong>resume</strong>-<strong>builder </strong>who essentially needs to learn to attain or maintain a degree/license/certificate. Today, there are about 130 licensed occupations certified by over 15 licensing authorities. Resume-builders expect a higher income as a result of such a license, for example, CPAs expect about a 15% higher salary than non-CPAs (2015 Robert Hall salary guide) or SAP-certified consultants bill at higher rates. Here the need is simple: <em>accreditation</em> to ensure the learner secures her license or certificate. As professionals, they also want to <em>minimize career disruption</em>. Accredited programs are capitalizing on this need. A growing number of business schools are creating specialized masters programs in business-related topics e.g. accounting, management and finance. According to the Graduate Management Admission Council’s (GMAC) survey, such programs have experienced an 86% rise in applications from five years ago. Such specialized programs can be done right after college without requiring the multi-year work experience required of MBA applicants.</p><p>The last archetype is the <strong>trouble-shooter</strong> who cares about solving immediate issues or challenges e.g. in a project. Such a person cares about the <em>immediacy of access</em>, getting answers quickly. They will consult peers or search online for resolution. They also care about <em>access to experts</em> in online communities, where the social perception of an “expert” is a function of one’s pedigrees, experience, active online participation with submissions and contributions, likes and votes on those submissions.</p><p>An individual will represent one or more of these archetypes with changing circumstances over the course of one’s career. Here are three examples. The first is Michelle, who seeks education to change careers in response fluctuations in her job market as well as to develop her passion in writing. She is a resume-builder (law degree), field promotion (bootcamp in negotiation, elder law), and toolbox learner (writing courses) at different stages.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/720/1*hI77XSP7_wZVG2P8U7GSkw.jpeg" /></figure><p>Josh is a recent grad who takes courses to build his technical and design expertise while leveraging existing communities for both assistance and projects. As a millennial, he is more comfortable with online options that help him learn quickly and apply to existing projects. He is field promotion (bootcamp) and toolbox learner (language) and trouble-shooter (online communities) as he develops varying skills.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/720/1*cppSAsBUcJm_ZxIHRb56tg.jpeg" /></figure><p>Mary is an ambitious professional who updates her skills with respect to market trends. She is a resume-builder (MBA) and field promotion learner (corporate course, evening university programs).</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/720/1*PnZH_ZvlBkt8JyjbhjLfJQ.jpeg" /></figure><p>While there are many new options for continuing education that better fit professionals’ lifestyles and circumstances, there are many more opportunities to capitalize on this need. Below is a high-level example of potential coveted features in the near future.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/470/1*LXjqorE_iI3nz9BqMnnH4A.png" /></figure><p>A whole set of macroeconomic trends (e.g. easy access to global labor with improving skills), social trends (e.g. more women returning to work after childbirth), labor trends (e.g. growing freelance economy) and technological impact (e.g. changing job needs) will not only increase the need for continual education but also necessitate education options that fit the professionals’ individual needs and budget. Such emphasis on flexibility and personalization create opportunities for alternatives beyond the limitations of existing structured programs at universities, training institutions and corporations.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=30dd09919303" width="1" height="1" alt=""><hr><p><a href="https://medium.com/startups-venture-capital/continual-education-lucrative-yet-underserved-30dd09919303">Lucrative Yet Underserved Opportunity in EdTech</a> was originally published in <a href="https://medium.com/startups-venture-capital">Startups &amp; Venture Capital</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[The Premium Model in EdTech: Aggregators]]></title>
            <link>https://medium.com/startups-venture-capital/the-premium-model-in-edtech-aggregators-35d7e22faea9?source=rss-9c5a051d2954------2</link>
            <guid isPermaLink="false">https://medium.com/p/35d7e22faea9</guid>
            <category><![CDATA[edtech]]></category>
            <category><![CDATA[tech]]></category>
            <category><![CDATA[education]]></category>
            <dc:creator><![CDATA[Sami Muneer]]></dc:creator>
            <pubDate>Fri, 05 Feb 2016 18:49:20 GMT</pubDate>
            <atom:updated>2026-10-28T19:22:16.859Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*EPeVG_U7BhsV_G_65xfMsQ.jpeg" /></figure><p>While Edtech has experienced a rapid growth of investments and a proliferation of startups across the secondary, post-secondary and corporate markets, there is a specific segment of the market that has received the most attention globally: <strong><em>the aggregator (open and selective).</em></strong></p><p>If we break down the core activities of a teacher, she produces the education content (provider) or sources and aggregates the relevant content for the course, delivers it to the needs of her students, and assesses their progress with formative and summative evaluation. The suppliers to the education market (including Edtech) mimic a similar structure. As in the chart below, there are:</p><ul><li>content providers who produce or publish original content</li><li>education programs or software for structured delivery of the content which include learning management systems</li><li>aggregators which offer curated market places for content providers</li><li>vendors who provide immersive learning experiences (e.g. with use of simulations)</li><li>traditional evaluation and test providers</li><li>suppliers that provide tools and services to the above.</li></ul><figure><img alt="" src="https://cdn-images-1.medium.com/max/507/1*SHaTGpLfXPmOhpzSW07uSg.png" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/503/1*JgsCA65fXBdnneA8qFcOvQ.png" /></figure><p>The shift to e-learning has led to the rapid growth of the aggregation model in recent years. Higher ed or the postsecondary market led the transition to e-learning. In 2014, while the K-12 sector represented over 50% of the relative expenditure in education in the US, the post-secondary market accounted for about 60% of the e-learning expenditure.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/498/1*IZa19eGciqm6Igm7KYxVEg.png" /></figure><p>Historically, e-learning as a concept dates back to 1989 by the University of Phoenix whose online university now boasts over 320K students. This was followed by CalCampus who offered the first complete online curriculum in 1994, and then by Jones International University that became the first accredited fully web-based university in 1996. Today, 96% of US universities offer some online course, with some of the top-rated online degrees offered by traditional programs as Penn State, UCLA and Columbia. Moreover, many of these online programs generate higher revenues, for example, the online MBA programs of UMass and Amherst make up a quarter of the enrollment but contribute 40% of the revenue.</p><p>This shift to e-learning in the post-secondary market led to the emergence of the aggregator in the past few years, driven by the early models as MOOCs and their university alternatives e.g. OpenCourseware by MIT or Stanford. Cheaper and better authoring tools (e.g. Adobe Captivate, Storyline, Lectora Inspire, etc.) and services (e.g. guidance to create online content with Fedora and Skilljar) democratized the creation the content, enabling a whole new population of independent teachers and non-educators to produce education content. MOOCs gave them access to a marketplace of consumers, which further accelerated the proliferation of content, making a lot of general education a commodity for an evolving generation of consumers expecting such content for free.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/472/1*s5qJrL0zjG5mdSs_aMnLng.png" /></figure><p>In fact, a disproportionate amount of VC funding went into the aggregation model, not only within the US, but also globally. Per SAP research into fundraising volumes in Edtech globally in 2012–2103, 70% of it went into the aggregator model globally, led by investments in USA, India and China.</p><p>Over the 3 year-period from 2011 to 2014, majority of the VC investments in Edtech in US went into companies that are essentially aggregators (table below).</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/505/1*ELpPH2ytWiXi3dwCGQRbQw.png" /></figure><p>However, while the MOOCs, the initial aggregator model, rapidly gained in popularity and signed up millions of students, they struggled to translate a rapidly growing user base into revenues. Ironically, the rapid growth of the open market raised the premium on content curation. Lynda and Pluralsight exemplify a <strong><em>selective</em></strong> aggregation model. They play more the role of a publisher with a relatively stringent selection and editorial process with services to enhance the final video output of educational content providers. These 2 companies had attracted almost as much funding as the largest 6 companies in the <strong><em>open</em></strong> aggregation model, which serve more as market places than publishers.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/521/1*MHLBLwVqSa1jSmJEFBgFQw.png" /></figure><p>Consumers and corporations have been willing to pay a subscription fee for this perceptively premium content, resulting in a higher share of the industry revenues for these 2 companies. It was not a surprise that Linkedin finally bought Lynda for $1.5 billion last year, given its successful penetration in the corporate market, which the MOOCs are trying to emulate (e.g. Udacity partnership with AT&amp;T and Udemy with 1800-Flowers).</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/521/1*E4CR2cnHd8wz0BQF4MgK0Q.png" /></figure><p>Cheaper authoring tools, tutorials and easy access to existing and new student populations via the aggregators have all led to the proliferation of education content. It has also led to the rise of the independent instructor, who now earn supplemental income or entire salaries through this new channel. Subsequently, this explosion of content has elevated the importance of search, discovery and curation, be it editorial or algorithmic. There has been a similar premium on such features in other content markets as music and videos. While Lynda and Pluralsight have capitalized on this need thus far, new features that further enable students to find the right content for one’s specific need on demand will differentiate the next generation of aggregators.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=35d7e22faea9" width="1" height="1" alt=""><hr><p><a href="https://medium.com/startups-venture-capital/the-premium-model-in-edtech-aggregators-35d7e22faea9">The Premium Model in EdTech: Aggregators</a> was originally published in <a href="https://medium.com/startups-venture-capital">Startups &amp; Venture Capital</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Do NFL Teams Really Know How To Handle Their Growing Data?]]></title>
            <link>https://medium.com/the-cauldron/do-nfl-teams-really-know-how-to-handle-their-growing-data-f25d8f2e94c4?source=rss-9c5a051d2954------2</link>
            <guid isPermaLink="false">https://medium.com/p/f25d8f2e94c4</guid>
            <category><![CDATA[data-science]]></category>
            <category><![CDATA[nfl]]></category>
            <category><![CDATA[sports]]></category>
            <dc:creator><![CDATA[Sami Muneer]]></dc:creator>
            <pubDate>Mon, 01 Feb 2016 14:29:03 GMT</pubDate>
            <atom:updated>2016-02-01T14:29:03.045Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*y2FxyB_n7XCdbVx0xcKbVQ.jpeg" /><figcaption>(AP)</figcaption></figure><h4>The analytics era definitely hasn’t rid professional football of many of its long-time player evaluation biases.</h4><p><em>(Editor’s note: The author is a software designer who has worked with professional and college teams across a variety of sports.)</em></p><p>Player evaluation in a team sport is as much an art as it is a science. Scouts, coaches, and the general manager very well may assess the same player differently based on the same information.</p><p>The most heated discussions of December and February NFL team meetings, when teams evaluate the current draft class, are about those players who fall in the middle of the grading pack — the third-to-fifth-rounders. Those prospects’ quantitative data, measurables or workouts may not all be exceptional and/or there might some behavioral traits or off-field incidents that spur debate, but the fundamental problem in evaluation lies with the lack of empirical evidence behind a lot of teams’ assumptions — hence the disproportionate reliance on film to watch the players in action.</p><p>First, there is the quantitative issue. Scouts evaluate a player on 20 to 30 quantitative attributes based on his position, and dependent on the position, they might implicitly assign different weightings to each of these attributes. For example, hand size matters for a quarterback, while speed is really important for a running back.</p><p>Those are obvious ones, but how do the rest of the measurables matter for each respective position? To assess players within a specific data set, scouts need to be able to normalize comparative factors — in other words, rank players based on the weighted average of measurables (e.g. height, weight, speed, hand size, arm, etc.), workouts (e.g. jumps, shuttles, 3-cone, bench press, etc.) and primary stats (e.g. yards/carry). However, scouts realize that they do not have enough empirical evidence to assign a specific weighting with a high degree of confidence, so they focus on the three key measurables of height, weight and speed with relatively equal weighting.</p><p>It’s even harder to assess the effect of the qualitative data, or the “intangibles.” Teams strive to find the correlation of innumerable intangibles to success — for example, background (parents married and divorced, siblings, small town or city, kind of high school or college) or personality (self-centered, toughness, durability) or medical condition (ADD, ADHD), and a variety of other factors. They may put a number grade on many such intangibles.</p><p>In lieu of supporting evidence, though, teams are subject to a multitude of cognitive biases. For example, scouts or coaches tend to anchor draft evaluations based on their good picks in recent years; and, yes, they tend to selectively “disremember” most of their questionable picks, save for the most expensive mistakes. Availability heuristics could be another problem, as GMs and coaches often are fixated on a few historical players for comparison — the exceptional QB or RB one had once coached. They may focus on aspects of a player — be it qualitative, quantitative or playing style — that “remind” them of the reference player.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*_YAebaJj9yhbs_courxb0A.jpeg" /><figcaption>NFL prospect evaluation hasn’t quite evolved with technology. (AP)</figcaption></figure><p>Draft debates also are prone to confirmation bias, where teams tend not to question few existing factors for decisions, and the right picks affirm their perspectives. Some quantitative factors are of paramount importance of a draftees’ evaluation — for example, the trifecta of height, weight and speed — but they are measured in absolute terms. Players who fall short of the threshold often are dismissed, so they are not really retrospectively examined to prove or negate the existing bias toward specific variables. The biases hold until an anomaly, such as the height of a QB like Russell Wilson, becomes front and center, which, in turn, could polarize discussions.</p><p>On the road, college scouts can exhibit specific biases. First, there is the bandwagon effect when scouts’ interest in a specific draftee begets interest from scouts of other teams. In fact, most scouts tend to pay extra attention to specific players or schools if they gather others are doing the same. “What am I missing? There must be something in this guy” is a typical thought process that can catapult a draftee onto the draft board.</p><p>On the other hand, there is an ingrained negative bias in the industry which pays particular attention to off-field incidents. As one executive once said, “in football, players are trained to be menacing machines on the field throughout the year, so it can be a little hard to turn that temperament off quickly once off the field. So it’s not a surprise we have all these incidents with players. What we really need to worry about is the degree of such incidents.”</p><p>The group dynamics within teams can sustain other biases. Few teams manage a healthy tension between the scouting and coaching teams without necessarily succumbing to the in-group bias that causes one to overestimate the abilities and value of one’s respective group. Strong GM or coach personalities can supplement such biases. Paradoxically, it’s scouting teams that have worked together for many years who are more likely to consider contradictory perspectives or data than those teams faced with constant turnover.</p><p>The industry tends to be rather insular, which augments existing biases. The overall recruitment process into the industry of scouts and coaches, where interns are groomed from an early stage of their career or players leave the field to join the operations teams, serves to retain the conservative tendencies of analysis. It’s rare to break into the fraternity from another industry, or at a later stage of the career.</p><p>Coaches and scouts, first and foremost, “trust their eyes.” They form their primary impression watching film on games; this is more relevant for pro scouting than college scouting, given the variability in game quality in the latter. The rest of their evaluation is based on the “facts” they know and their years of experience, colored by some of the other biases.</p><p>So why not validate assumptions and biases with empirical analysis of historical information? A team could establish baselines of the quintessential NFL player by position that could serve as benchmarks for player evaluation. There are a lot of analytical programs out there to crunch the data.</p><p>Well, there are two fundamental issues. The first is a <em>translation</em> problem. Historical or statistical analysis is traditionally the purview of the team statistician, or someone with quant skills. The scouts aggregate and process the information on players, and the statistician may provide additional insights on correlation based on current or historical data. At times, the scouts may reach out to the “stats guy” to affirm or negate any personal instinctive feeling with data. The scouts and coaches need to understand and internalize the implications of any analysis. In other words, the analysis must be explained in latent terms, and not in the language of <em>percentiles</em> and <em>heteroscedasticity</em>.</p><p>It is more important for a scout or coach to intuitively understand a formula to internalize its implications than to learn any advanced statistical approach. A report that is rated a 3 out of 10 (on statistical validity) but is understood by the team can be much better than a report that is judged 10 out of 10 but inscrutable to the team. In fact, most statisticians spend more time explaining the meaning or significance of any stat to the coaches than necessarily doing any sophisticated analysis. The successful stats guy in a NFL team is the <em>eloquent stats guy</em>. Most of the systematic research is usually done by parties outside the industry, but the implications similarly get lost in translation.</p><p>Given the complexity of the sport, any quantitative analysis will be a trial-and-error process that extends or modifies existing hypotheses and lends to new ones: “We may not even know the questions to ask, or the answers we should be looking for.” The reality is one cannot create an unique successful NFL profile for a position; there may be different baselines to evaluate a college player based on the draft round or some other variable.</p><p>Some of the most basic questions every team contends with are:</p><ul><li>What profile succeeds in a league?</li><li>Do any of the stats we scrutinize have any impact on success?</li><li>What can one do to predict if a college player is going start with performance at NFL level?</li><li>How do we identify a good player from a great player?</li><li>Do we have the right criteria for evaluation and do we have the right thresholds?</li><li>How do you measure longevity? What playing time do we look at? What was the grade throughout?</li></ul><p>The scouts and coaches, those who are most suited to investigate different assumptions or hypotheses through a trial-and-error process, need to be <em>self-reliant</em> on any analytical programs out there to tease out the insights for themselves. That is the only way they will counter their own biases.</p><p>Therein lies the second problem: The sophisticated analytical tools, used by many other industries today, are rendered rather useless in sports because of this challenge of translation. The challenge is the language in the available tools is either too sophisticated for them, or not football-speak, which reinforces the current dependency on the 1–2 statisticians (if any) for every analysis. “This chart is showing me some percentile. What is that again?”</p><p>Most teams in the NFL comprehend the promise of analytics to provide new insights, but those tools need to both accessible and intelligible to the scouts and coaches. The hired quants need to be eloquent enough to guide them to be self-reliant, not reinforce dependency on the quants for every question. That is the only way scouts and coaches will truly internalize the implications, negate existing biases, and build on insights they hadn’t even considered before. There is a lot that the individual NFL teams have yet to explore.</p><figure><img alt="" src="https://cdn-images-1.medium.com/proxy/1*qGr4tJSC0XFp2wosV_u--g.png" /></figure><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=f25d8f2e94c4" width="1" height="1" alt=""><hr><p><a href="https://medium.com/the-cauldron/do-nfl-teams-really-know-how-to-handle-their-growing-data-f25d8f2e94c4">Do NFL Teams Really Know How To Handle Their Growing Data?</a> was originally published in <a href="https://medium.com/the-cauldron">The Cauldron</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
    </channel>
</rss>