<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0" xmlns:cc="http://cyber.law.harvard.edu/rss/creativeCommonsRssModule.html">
    <channel>
        <title><![CDATA[Stories by SoLAR Nexus on Medium]]></title>
        <description><![CDATA[Stories by SoLAR Nexus on Medium]]></description>
        <link>https://medium.com/@solarnexus?source=rss-7bc0e8501388------2</link>
        <image>
            <url>https://cdn-images-1.medium.com/fit/c/150/150/1*Ie50hzXmjTeuxC11bQIkLA.png</url>
            <title>Stories by SoLAR Nexus on Medium</title>
            <link>https://medium.com/@solarnexus?source=rss-7bc0e8501388------2</link>
        </image>
        <generator>Medium</generator>
        <lastBuildDate>Sat, 21 Nov 2026 02:03:51 GMT</lastBuildDate>
        <atom:link href="https://medium.com/@solarnexus/feed" rel="self" type="application/rss+xml"/>
        <webMaster><![CDATA[yourfriends@medium.com]]></webMaster>
        <atom:link href="http://medium.superfeedr.com/" rel="hub"/>
        <item>
            <title><![CDATA[Dashboards for learners don’t always motivate them]]></title>
            <link>https://medium.com/solar-nexus/dashboards-for-learners-dont-always-motivate-them-f765c68a248?source=rss-7bc0e8501388------2</link>
            <guid isPermaLink="false">https://medium.com/p/f765c68a248</guid>
            <category><![CDATA[motivation]]></category>
            <category><![CDATA[evaluation]]></category>
            <category><![CDATA[learning-analytics]]></category>
            <category><![CDATA[dashboard]]></category>
            <category><![CDATA[statistics]]></category>
            <dc:creator><![CDATA[SoLAR Nexus]]></dc:creator>
            <pubDate>Mon, 21 Mar 2022 00:31:02 GMT</pubDate>
            <atom:updated>2022-03-21T00:31:02.223Z</atom:updated>
            <content:encoded><![CDATA[<p><em>Natercia Valle tells a cautionary tale about the use of learning analytics dashboards to increase student motivation, and the challenges of translating theory into design solutions.</em></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*b7BnqOeKMD_0sYJZjfjSOQ.jpeg" /><figcaption>Image on <a href="https://pixabay.com/illustrations/company-social-network-community-3502288/">Pixabay</a></figcaption></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/207/1*DRmY3eHtHxTLCj3K3zS5FA.png" /></figure><p><strong>Author: </strong>Natercia Valle</p><p>Natercia Valle is the STEM Instruction Librarian at the University of Florida. Her research focuses on the theoretical and practical aspects of teaching and learning in STEM-related disciplines. She has applied learning analytics to investigate if and how certain design and instructional components influence students’ learning experiences and performance outcomes. As part of a multidisciplinary team, Natercia has designed, developed, and implemented theory-driven learning analytics dashboards as technology-enhanced instructional tools to support learners’ motivation and learning outcomes.</p><p><a href="https://twitter.com/naterciavalle"><strong>Follow Natercia on Twitter</strong></a></p><p><strong>Keywords:</strong> Learning Analytics Dashboards; Motivation; Statistics; Evaluation</p><p><strong>Target readers:</strong> educators, researchers, learners</p><h3>Domain-specific learner-facing learning analytics dashboards (LADs)</h3><blockquote><em>Did you ever feel nervous when taking a stats test? Did you ever dread meeting with your statistics professor? Did you ever feel overwhelmed by the number of formulas and computations covered in a stats course?</em></blockquote><p>If you answered “YES!” to any of those questions, you are not alone. In fact, this uneasiness and negative feelings when dealing with statistics characterize a well-known phenomenon called <a href="https://www.tandfonline.com/doi/abs/10.1080/0260293042000160384">statistics anxiety</a>. To mitigate statistics anxiety and improve the learning experience in an online statistics course, we conceptualized and tested theory-driven learning analytics dashboards (LADs). Below, I provide a brief description of this effort, including the primary inquiry behind the research project, the current stage of the field (unexplored areas in LAD research), and the outcomes related to the two experimental design studies conducted as part of this research.</p><h3>Why LADs?</h3><p>The popularization of learning analytics dashboards (LADs) has prompted researchers and designers to consider specific target audiences and their needs. However, even when we focus on a specific audience — such as graduate students taking an online statistics course — the possibilities of how to design, develop, implement, and evaluate LADs can still be overwhelming. While the organization of the data in manageable “chunks” of information is what makes LADs useful to learners, deciding what and how to present information is the key challenge for designers, researchers, and practitioners. In other words,</p><blockquote><em>Can theory-driven LADs be used as effective instructional tools to support learning and motivation?</em></blockquote><figure><img alt="" src="https://cdn-images-1.medium.com/max/707/1*NbUBpP-Mr9pIkGFxKfveVA.png" /><figcaption>Image on <a href="https://undraw.co/search">UnDraw</a></figcaption></figure><h3>Are we missing the target?</h3><p>To tackle the challenges associated with the development and evaluation of LADs intended to support learners, several researchers and practitioners have <a href="https://link.springer.com/chapter/10.1007/978-3-319-66610-5_7">adopted self-regulated learning</a> models to guide their efforts. One important benefit of using self-regulated learning models is that it encompasses cognitive, behavioral, and affective/motivational constructs. Still, there has been a misalignment between proposed goals and measured outcomes of learner-facing LADs. While most LADs have been developed to support learners’ cognitive outcomes, their evaluations are usually centered around affective or motivational constructs. Ironically, <a href="https://bera-journals.onlinelibrary.wiley.com/doi/epdf/10.1111/bjet.13089">motivation is underrepresented as a target outcome in LADs</a>.</p><h3>Why should we care about motivation?</h3><p>The lack of interventions using LADs to support learners’ motivation is particularly striking because not only is motivation an important element of <a href="https://doi.org/10.1007/s10648-004-0006-x">self-regulated learning</a>, it can promote <a href="https://par.nsf.gov/servlets/purl/10107236">learners’ interest and performance in STEM</a>. But how can we design dashboards to support learners’ motivation? The wealth of knowledge and theories of motivation are essential to help us systematically conceive, design, and test LADs. The following two sections describe two experimental studies that have done exactly that. Implemented in the context of an online statistics course, these studies illustrate how the operationalization of theories into LADs to support learners’ motivation is not as straightforward as one would imagine. In fact, these empirical studies have shown some mixed results that highlight how the design of LADs can interact with learners’ specific characteristics (e.g., initial levels of motivation) to generate unexpected outcomes.</p><h3>Predictive vs. Descriptive LADs</h3><blockquote><em>Which do you think is more effective at boosting student motivation? Showing them how they’re doing in relation to the class average, or showing them what grade they’re likely to get?</em></blockquote><p>Informed by the <a href="https://psycnet.apa.org/record/2002-18006-014">multiple-goal orientation framework</a>, which assumes that mastery and performance goal orientations can co-exist within learners and can optimize motivation and learning outcomes, <a href="https://link.springer.com/article/10.1007/s11423-021-09998-z">we designed two LADs in a research study</a>. The first one is a descriptive LAD that features students’ performance in terms of percentages as shown below:</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/902/1*rkYNa8J9fVd-nofzS8WUVg.png" /></figure><p>This <em>descriptive</em> learner-facing LAD shows that this student got 94% of responses correct in the module about t-test.</p><p>The second example is a <em>predictive</em> LAD that features students’ probability of receiving a specific letter grade at the end of the course</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/969/1*W0DBg9H_m5W_fn-4d7Slmw.png" /></figure><p>This <em>predictive</em> learner-facing LAD shows that this student has a 77% probability of receiving a letter grade “B” (blue line) by the end of semester.</p><p>We found that:</p><p>● both the descriptive and predictive dashboards <em>reduced learners’ negative attitudes toward statistics</em></p><p>● but only the predictive dashboard influenced learners’ <em>motivation</em>.</p><p>Still, that influence depended on learners’ initial levels of motivation. More specifically:</p><p>● the predictive dashboard <em>increased </em>motivation for learners with <em>initially higher levels of motivation,</em></p><p>● but <em>reduced</em> motivation for learners with <em>initially lower levels of motivation.</em></p><p>Moreover, interviews indicated that learners who adopted a more performance-avoidance goal orientation (fear of performing poorly in the course) presented higher levels of anxiety <em>regardless</em> of the dashboard used.</p><h3>Can we scaffold for task value?</h3><blockquote><em>Which do you think is more effective at boosting student motivation? Simply teaching them topics, or explaining why each topic is important?</em></blockquote><p>Based on the results above, we changed the design of the predictive dashboard to include prompts about <em>the value of learning specific topics and skills in the statistics course</em>. Different prompts were used for each module and emphasized the utility of learning the topics/skills covered in that module as shown below. This design was informed by the <a href="https://www.sciencedirect.com/science/article/pii/S0361476X20300242?casa_token=urPEzJotFUkAAAAA:l9Yg2xg89YhSwqsOZoiLpVYsxPvvcE4xTcNbOFW-D3igyCqqHTn2xTEr63zNRzODqOYcalYX">situated expectancy-value theory</a>, which assumes that self-efficacy (expectancy for performing the task well) and interest in the task (subjective task value) are key components to support learners’ motivation. Based on this theory, we were relatively confident that the inclusion of these prompts would result in improved outcomes.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/786/1*chF7MTvN_R01pwLl4hPuCQ.png" /></figure><p>We conducted an experimental study to compare the effect of using these prompts. The results indicated that the use of task-value prompts did not influence learners’ motivation.</p><blockquote><em>Importantly, contrary to what we expected, we found that these prompts increased learners’ computation anxiety and negative attitude toward statistics!</em></blockquote><p>Taken together, these results highlight that the design of LADs to support motivation can be challenging, and indicate that more experimental studies are needed to explore which design elements will support learners’ motivation and under which conditions.</p><p>In particular, we have learned that one should not take for granted that the inclusion of theory-inspired features into LADs in and of itself will have a positive impact on students.</p><h3>Learn More</h3><p>Eccles, J. S., &amp; Wigfield, A. (2020). <a href="https://doi.org/10.1016/j.cedpsych.2020.101859">From expectancy-value theory to situated expectancy-value theory: A developmental, social cognitive, and sociocultural perspective on motivation</a>. <em>Contemporary Educational Psychology</em>, Volume 61, April 2020, 101859.</p><p>Harackiewicz, J. M., Barron, K. E., Pintrich, P. R., Elliot, A. J., &amp; Thrash, T. M. (2002). <a href="https://doi.org/10.1037/0022-0663.94.3.638">Revision of achievement goal theory: Necessary and illuminating</a>. <em>Journal of Educational Psychology</em>, 94(3), 638–645.</p><p>Jivet I., Scheffel M., Drachsler H., Specht M. (2017) <a href="https://doi.org/10.1007/978-3-319-66610-5_7">Awareness Is Not Enough: Pitfalls of Learning Analytics Dashboards in the Educational Practice</a>. In: Lavoué É., Drachsler H., Verbert K., Broisin J., Pérez-Sanagustín M. (eds), <em>Data Driven Approaches in Digital Education: Proceedings of EC-TEL 2017</em>. Lecture Notes in Computer Science, vol 10474. Springer, Cham.</p><p>Onwuegbuzie, A. J. (2004). Academic procrastination and statistics anxiety. Assessment &amp; Evaluation in Higher Education, 29(1), 3–19.</p><p>Pintrich, P. R. (2004). <a href="https://doi.org/10.1007/s10648-004-0006-x">A Conceptual Framework for Assessing Motivation and Self-Regulated Learning in College Students</a>. <em>Educational Psychology Review</em>, 16(4), 385–407.</p><p>Rosenzweig, E. Q., Wigfield, A., &amp; Hulleman, C. S. (2020). More useful or not so bad? Examining the effects of utility value and cost reduction interventions in college physics.<em> Journal of Educational Psychology</em>, 112(1), 166.</p><p>Schunk, D. H., Meece, J. L., &amp; Pintrich, P. R. (2014). <em>Motivation in education: Theory, research, and applications</em> (4th Ed.). Pearson.</p><p>Valle, N., Antonenko, P., Dawson, K., &amp; Huggins-Manley, A. C. (2021). <a href="https://doi.org/10.1111/bjet.13089">Staying on target: A systematic literature review on learner-facing learning analytics dashboards</a>. <em>British Journal of Educational Technology</em>, 52(4), 1724–1748.</p><p>Valle, N., Antonenko, P., Valle, D., Dawson, K., Huggins-Manley, A. C., &amp; Baiser, B. (2021). <a href="https://doi.org/10.1016/j.compedu.2021.104288">The influence of task-value scaffolding in a predictive learning analytics dashboard on learners’ statistics anxiety, motivation, and performance</a>. <em>Computers &amp; Education</em>, 173, 104288.</p><p>Valle, N., Antonenko, P., Valle, D., Sommer, M., Huggins-Manley, A. C., Dawson, K., Kim, D., &amp; Baiser, B. (2021). <a href="https://doi.org/10.1007/s11423-021-09998-z">Predict or describe? How learning analytics dashboard design influences motivation and statistics anxiety in an online statistics course</a>. <em>Educational Technology Research and Development</em>, 69, 1405–1431</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=f765c68a248" width="1" height="1" alt=""><hr><p><a href="https://medium.com/solar-nexus/dashboards-for-learners-dont-always-motivate-them-f765c68a248">Dashboards for learners don’t always motivate them</a> was originally published in <a href="https://medium.com/solar-nexus">SoLAR Nexus</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Same, same but different: the fading boundaries between LA and AIED]]></title>
            <link>https://medium.com/solar-nexus/same-same-but-different-the-fading-boundaries-between-la-and-aied-d1040bfa6527?source=rss-7bc0e8501388------2</link>
            <guid isPermaLink="false">https://medium.com/p/d1040bfa6527</guid>
            <category><![CDATA[discipline-boundaries]]></category>
            <category><![CDATA[artificial-intelligence]]></category>
            <category><![CDATA[learning-analytics]]></category>
            <dc:creator><![CDATA[SoLAR Nexus]]></dc:creator>
            <pubDate>Thu, 09 Dec 2021 22:32:19 GMT</pubDate>
            <atom:updated>2021-12-09T22:32:19.325Z</atom:updated>
            <content:encoded><![CDATA[<p><em>What’s the overlap between Artificial Intelligence and Learning Analytics? How an answer to a playful OpenAI question turned out to be surprisingly insightful!</em></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*bo811BQPYDs60EILRhQTTw.jpeg" /><figcaption>Photo by <a href="https://unsplash.com/@lazycreekimages?utm_source=unsplash&amp;utm_medium=referral&amp;utm_content=creditCopyText">Michael Dziedzic</a> on <a href="https://unsplash.com/?utm_source=unsplash&amp;utm_medium=referral&amp;utm_content=creditCopyText">Unsplash</a></figcaption></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/654/1*LliLTH4NAqwgcb_T4D2tFQ.jpeg" /></figure><p><strong>Author: </strong>Prof Manolis Mavrikis &amp; Dr Mutlu Cukurova</p><p><strong>Position: </strong><a href="https://iris.ucl.ac.uk/iris/browse/profile?upi=EMAVR27">Manolis Mavrikis</a> and <a href="https://iris.ucl.ac.uk/iris/browse/profile?upi=MCUKU85">Mutlu Cukurova</a> are based at the UCL Knowledge Lab — a research centre of the UCL Institute of Education dedicated to exploring how people live and learn with technology in order to solve societal challenges. The Knowledge Lab hosts the <a href="https://www.ucl.ac.uk/prospective-students/graduate/taught-degrees/education-and-technology-ma">MA in Education and Technology</a> where they also teach on the design, use and evaluation of educational technology with a particular focus on Artificial Intelligence and Learning Analytics. Manolis and Mutlu are also currently two of the co-editors of the <a href="https://bera-journals.onlinelibrary.wiley.com/journal/14678535">British Journal of Educational Technology</a>. Manolis is on the executive committee of the <a href="https://iaied.org/">International Artificial Intelligence in Education Society</a> (IAIED).</p><p><a href="https://twitter.com/mavrikis"><strong>Follow Manolis on Twitter</strong></a></p><p><a href="https://twitter.com/mutlucukurova"><strong>Follow Mutlu on Twitter</strong></a></p><p><strong>Keywords</strong>: artificial intelligence, learning analytics, discipline boundaries</p><p><strong>Target readers</strong>:<em> </em>Learning Analytics Practitioners, Learning Designers, Educators, Researchers</p><p>No one expected that our last team catch-up call at the <a href="https://www.ucl.ac.uk/ioe/departments-and-centres/centres/ucl-knowledge-lab">UCL Knowledge Lab</a> would spark laughter and debate over a seemingly unimportant statement.</p><p>A member of our group marking assignments for the <a href="https://www.ucl.ac.uk/prospective-students/graduate/taught-degrees/education-and-technology-ma">master’s of Education and Technology</a> claimed that soon our students would use tools such as <a href="https://openai.com/about/">OpenAI</a> to answer essay questions.</p><p>While a plausible claim, referring to a genuine question of a teacher in our cohort, one of the essay assessors in our group said:</p><blockquote>I doubt that OpenAI would be able to answer what is the difference between Artificial Intelligence in education and Learning Analytics.</blockquote><p>Seconds later a postgraduate student coded a call to OpenAI’s API and shared its ‘wisdom’:</p><blockquote>Q: What is the difference between Artificial Intelligence and Learning Analytics?</blockquote><blockquote>A: Learning Analytics is a subset of AI. <br> AI is a subset of Learning Analytics.</blockquote><p>You can imagine the chaos that ensued! Following the initial laughter, a heated debate started about set theory — for OpenAI to say that two sets are subsets of each other, it must be that they are the same set! How could that be the case? The philosophical debate was reduced at times to a chicken and egg problem and moved on whether the difference is “just semantics”.</p><p>Once everyone had calmed down, we moved into a more sobre discussion about how Artificial Intelligence in Education (AIED), Educational Data Mining (EDM) and Learning Analytics (LA) relate to each other as sister research fields and communities. We tried to resolve some of these debates by resorting to historical evidence (and a bit of hearsay!). Here are a few of the key takeaways, with pointers for readers who want to go deeper.</p><p>As everyone interested in AI can imagine, the discussion naturally gravitated towards what artificial intelligence (and intelligence in the first place) means in the above sentence. Of course, one can go back to the origins as described in seminal books, talk about strong and weak AI, Knowledge Representation vs Machine Learning and so on.</p><p>The discussion reminded us that <strong>AI is a field of research</strong> (or <a href="https://www.sciendo.com/article/10.2478/jagi-2019-0002">may be conceptualised as multiple fields</a>) and (in our context) <strong>AI is both a technology (</strong>best characterised by its features and functions) <strong>and a scientific methodology applied in educational settings</strong>. A well-known conundrum in the field is the <a href="https://docs.google.com/document/d/1_fXqnjYGtjuf3VwwvB6Yqr8N90MwTmzZamXwSCgcMy8/edit">‘AI effect’</a>: the definition of AI changes over time because <strong>as soon as we invent machines that can do something previously referred to as ‘intelligent’, it’s demoted to being mere computation.</strong></p><p>Before being accused of dodging the question of defining AI, even if a community can’t agree on a single AI definition, individual researchers and projects should make their working definition of AI clear. This is especially important as AI gains visibility in the public eye, where terms such as <a href="https://link.springer.com/chapter/10.1007/978-3-319-96448-5_21"><em>intelligence</em> and <em>learning</em> are used in myriad ways, sowing confusion</a>.</p><h3><strong>A bit of AIED history</strong></h3><p>To help the discussion, we reminded newcomers of the history of AIED. This blog cannot capture the field’s 50+ years, but readers may want to check out early traces of the field in Jaime Carbonell’s <a href="https://ieeexplore.ieee.org/abstract/document/4081977">An AI Approach to Computer-Assisted Instruction</a> in the 1970s. This was the era of <a href="https://en.wikipedia.org/wiki/History_of_artificial_intelligence">expert systems</a> like ELIZA, SCHOLAR and MYCIN, which influenced the emergence of what is now called <a href="https://en.wikipedia.org/wiki/Intelligent_tutoring_system"><em>Intelligent Tutoring Systems</em></a>, now often marketed as <em>Adaptive/Personalized Learning systems</em>.</p><p><a href="https://iaied.org/">The International Artificial Intelligence in Education</a> (IAIED) Society was formed in 1991 as a division of the Association for the Advancement of Computing in Education (AACE), which was already hosting the <a href="https://www.springer.com/journal/40593">International Journal of Artificial Intelligence in Education (IJAIED)</a>.</p><p>Nowadays, IAIED is home to an interdisciplinary community of computer scientists, educators, and psychologists across the globe, bringing diverse methods to the research and development of interactive and adaptive learning environments <em>“for learners of all ages, across all domains”</em>. The society continues to host an active conference and its journal passed its 25th Anniversary recently.</p><h3><strong>Fading disciplinary boundaries</strong></h3><p>Some NEXUS readers may be familiar with the history of Educational Data Mining and Learning Analytics. The two communities broadly share the goal of improving the analysis of educational data to support practice and education. Two of the ‘founding fathers’, George Siemens and Ryan Baker <a href="https://dl.acm.org/doi/10.1145/2330601.2330661">reviewed how the fields compared and contrasted</a> in 2012, just as LA was emerging. They noted that EDM research tends to focus on the automated discovery of patterns in data, improving data analysis techniques, and reducing phenomena into components looking into the relationships between them. In contrast, LA research seeks to understand systems as a “whole, in their full complexity”, focusing, for instance, on organizational readiness and strategy for LA to make institutional impact.</p><p>Beyond these differences however, Siemens &amp; Baker emphasised that these characterisations are oversimplifications, and called for the two communities to build stronger collaborative links. This argument was expanded in a recent paper by Baker et al. who examined <a href="https://doi.org/10.1016/j.caeai.2021.100021">how the core methodological paradigms of each field are informed by developments in other fields including AIED</a>.</p><p>It seems that the call to build links has borne fruit, at least, in the eyes of some of our students/teachers. In their view, the boundaries between the fields are dissolving. The <a href="https://www.solaresearch.org/events/lak/">International Conference on Learning Analytics &amp; Knowledge</a> (LAK) publishes work that is not strictly “data-intensive research” in a traditional sense (e.g., paying attention to the importance of human-centered design methods). Similarly, many AIED papers tend to employ data-driven AI techniques, in particular machine learning, to answer research questions. Of course, this also represents the evolution of the AI field from purely symbolic or model-driven, to data-driven. However, the proceedings also involve research with a focus on design issues, as well as on the broader ethical and societal implications of AI in education.</p><h3>​<strong>Building bridges</strong></h3><p>Returning to the opening dialogue, it is probably beyond OpenAI’s abilities to comprehend that research in these fields is deeply interdisciplinary by its nature, and this significant overlap is also a healthy sign of the fact that the conferences and communities are diverse and inclusive.</p><p>For us, this diversity is a value to flourish, rather than a challenge to be addressed within each community. All research societies in the field have common points of contact and a remit to build bridges with other societies. This has led to the <a href="http://www.alliancelss.com/">International Alliance to Advance Learning in the Digital Era</a> that aims to foster this diversity and facilitate productive partnerships.</p><p>So, who would imagine? Perhaps OpenAI was onto something!</p><h3><strong>Learn more</strong></h3><p><strong>1. The blog builds on the following article ​​that accompanies the special issue in Artificial Intelligence and Education of <em>Bildung Und Erziehung</em></strong></p><p>Mavrikis, M., Cukurova, M., Di Mitri, D., Schneider, J., &amp; Drachsler, H. (2021). A short history, emerging challenges and co-operation structures for Artificial Intelligence in education. <em>Bildung Und Erziehung</em>, <em>74</em>(3), 249–263.<a href="https://doi.org/10.13109/buer.2021.74.3.249"> https://doi.org/10.13109/buer.2021.74.3.249</a></p><p><strong><em>2. </em>Readers interest in a detailed history of the society, and the journal, are referred to the following</strong></p><p>Self, J.A. (2016): The birth of IJAIED. Int. J. of Artificial Intelligence in Education, 26, 1, 4–12. <a href="https://link.springer.com/article/10.1007/s40593-015-0040-5">https://link.springer.com/article/10.1007/s40593-015-0040-5</a></p><p>McCalla, G. (forthcoming): The History of Artificial Intelligence in Education — The First Quarter Century. In du Boulay, Ben, Mitrovic, Tania &amp; Yacef, Kalina (eds) <em>Handbook of Artificial Intelligence in Education.</em></p><p><strong>3. Other references we drew upon when writing the blog</strong></p><p>Buckingham Shum, S.J. &amp; Luckin, R. (2019), Eds: Learning Analytics and AI: Politics, Pedagogy and Practices. <em>British Journal of Educational Technology</em> (50th Anniversary Special Issue), 50, (6), pp.2785–2973. <a href="https://doi.org/10.1111/bjet.12880">https://doi.org/10.1111/bjet.12880</a></p><p>Chen, G., Rolim, V., Mello, R. F., &amp; Gašević, D. (2020). Let’s Shine Together! A Comparative Study between Learning Analytics and Educational Data Mining. <em>Proceedings of the Tenth International Conference on Learning Analytics &amp;amp; Knowledge</em>, 544–553. <a href="https://doi.org/10.1145/3375462.3375500">https://doi.org/10.1145/3375462.3375500</a></p><p>Porayska-Pomsta, K. AI as a Methodology for Supporting Educational Praxis and Teacher Metacognition. <em>International Journal of Artificial Intelligence in Education</em>, 26, 679–700 (2016). <a href="https://doi.org/10.1007/s40593-016-0101-4">https://doi.org/10.1007/s40593-016-0101-4</a></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=d1040bfa6527" width="1" height="1" alt=""><hr><p><a href="https://medium.com/solar-nexus/same-same-but-different-the-fading-boundaries-between-la-and-aied-d1040bfa6527">Same, same but different: the fading boundaries between LA and AIED</a> was originally published in <a href="https://medium.com/solar-nexus">SoLAR Nexus</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Four roles for learning analytics: How pre-service teachers envisage learning analytics]]></title>
            <link>https://medium.com/solar-nexus/four-roles-for-learning-analytics-how-pre-service-teachers-envisage-learning-analytics-ef7a4540dd38?source=rss-7bc0e8501388------2</link>
            <guid isPermaLink="false">https://medium.com/p/ef7a4540dd38</guid>
            <category><![CDATA[educational-practice]]></category>
            <category><![CDATA[student-engagement]]></category>
            <category><![CDATA[dashboard-design]]></category>
            <category><![CDATA[learning-analytics]]></category>
            <dc:creator><![CDATA[SoLAR Nexus]]></dc:creator>
            <pubDate>Wed, 01 Dec 2021 22:31:00 GMT</pubDate>
            <atom:updated>2021-12-01T22:31:00.067Z</atom:updated>
            <content:encoded><![CDATA[<p><em>The success of learning analytics rests on how students understand and use them. We asked pre-service teachers how they would see LA supporting their studies in higher education. Learn more about the four roles that we identified from students’ conversations!</em></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/596/1*dm4eR519YQ_JZSUSU2NheA.png" /><figcaption>Photo by<a href="https://unsplash.com/@jasongoodman_youxventures?utm_source=unsplash&amp;utm_medium=referral&amp;utm_content=creditCopyText"> Jason Goodman</a> on<a href="https://unsplash.com/s/photos/teachers?utm_source=unsplash&amp;utm_medium=referral&amp;utm_content=creditCopyText"> Unsplash</a></figcaption></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/236/1*OaFjq2qD3jPxHi5nAZnG6Q.jpeg" /></figure><p><strong>Author: </strong>Anni Silvola</p><p><strong>Position: </strong>Doctoral candidate at the University of Oulu, Faculty of Educational sciences. Anni is currently writing her dissertation about student perspectives on using learning analytics as a support for academic paths.</p><p><a href="https://twitter.com/asilvola"><strong>Follow Anni on Twitter</strong></a></p><p><strong>Keywords: </strong>Student engagement, educational practices, learning analytics, dashboard design</p><p><strong>Target readers:<em> </em></strong>Learning Analytics Practitioners, Learning Designers, Educators, Researchers</p><p>When learning analytics are designed effectively, they offer students valuable feedback and visualizations that help students to better direct their effort and engage with their studies. Student ‘engagement’ encompasses students’ observable behaviors, as well as their internal cognitions, emotions, and agency throughout their studies. <a href="https://psycnet.apa.org/record/2004-13809-003">Students who are well engaged, typically perform well, and enjoy their studies</a>.</p><h3><strong>What kind of design in learning analytics supports engagement?</strong></h3><p>In our recent work, we examined pre-service teachers’ expectations, support needs, and concerns for learning analytics use as a support for their studies. In this post, I’ll describe the four different roles for learning analytics to support student engagement that we uncovered (summarising our <a href="https://doi.org/10.1016/j.compedu.2021.104192">more detailed analysis</a>). These roles have important implications for both designing student dashboards, and the kinds of <a href="https://medium.com/solar-nexus/mind-the-pedagogical-gap-when-preparing-staff-to-use-learning-analytics-48f4ba489aa9">new educational practices</a> that can be implemented with learning analytics.</p><p><strong>1. Learning analytics can mediate information between the institution and student.</strong></p><p><em>Students hoped that their progression in studies is monitored but that they are in charge of their learning and progression</em>. They suggested a two-way role for learning analytics to mediate information. Firstly, students could have dashboards that gather all the relevant information in the same place. For example, they suggested a dashboard that would gather all the deadlines and ongoing course assignments into one place. That would help them to keep on track how they are doing with the courses.</p><p>At the same time they suggested that teachers and advisors would have an overview of student progression to see if someone isn’t progressing as expected. That would help academic staff to identify and contact students that need help. The important thing is the <em>tone of how student progression is being monitored</em>: students hoped not to be controlled, but better supported with new technologies<em>.</em></p><p><strong>2. Learning analytics can facilitate effective studying and increase students’ awareness.</strong></p><p>Students wanted more detailed feedback on their learning. Students desired information on how to make their study habits more effective and ultimately improve their exam scores. In other words, students considered it very important that the LA tools would help them <em>become more aware of their learning progression </em>and to <em>facilitate them to study effectively.</em> They explained how important it would be for them to better identify gaps in their knowledge, and to be able to monitor the continuum in their skill development. That would also help in professional development, such as choosing the directions in their studies and reflecting their professional identity.</p><p><strong>3. Learning analytics can provide help and support in different challenging situations.</strong></p><p>Students emphasised how important it is that the feedback provided via LA tools <em>motivates, activates, and inspires </em>them on their academic paths. Students explained that they are aware of when they are falling behind with their studies — it’s getting back on track that’s tough when they face difficulties such as knowing how to organize delayed course assignments, how to start improving your exam grades or continue a course that you almost dropped out from. So students discussed the need for visualizations that don’t just present their current situation, but <em>provide insights</em> and <em>possible suggestions of how to resolve the challenges</em>, such as if they are about to fail a course. As increasingly discussed in learning <a href="https://medium.com/solar-nexus/how-data-presentation-can-help-or-hurt-student-motivation-4ec19f952f7b">analytics community</a>, students also recognized the possible risk of LA feedback decreasing their motivation</p><p>So, while students certainly felt that the feedback should guide their learning, they also discussed<em> how important they personally consider certain tools for their learning. </em>They identified that their peers might need different kinds of LA tools. It is important to understand why students would use the designed tools and how these tools can actually help different students in practice.</p><p><strong>4. Learning analytics can work as a feedback channel to adapt the learning conditions according to students’ individual needs.</strong></p><p><em>Student agency</em> was highlighted throughout the conversations about study paths and learning analytics. Students suggested that LA could help them to <a href="https://www.springerprofessional.de/en/student-facing-dashboards-one-size-fits-all/12249114">personalise their learning </a>by making different options visible, and helping them by adapting the goals and materials for learning. They especially discussed the possibilities for designing individual academic paths with the help of learning analytics tools. They envisaged that knowing what kinds of courses were available to them would help them to make better course choices as they planned for different kinds of careers.</p><p>Agency was also related to their sense of autonomy: students wanted to<em> be able to decide when and how to use available LA tools. </em>They also discussed critically the importance of their agency in privacy control and data protection. Students wanted to be involved in the conversation about institutional data management.</p><p>To summarise, we learned that considering all dimensions of engagement is important in designing LA tools. The four roles that students named for learning analytics help to contextualize how learning analytics at their best can positively influence student engagement. These roles help us to see how designing good LA tools is not just about the working functionalities in the dashboard, but remind us to raise our eyes beyond the digital systems, and see students as a whole. The key action is to understand students beyond the digital contexts and see how the LA tools can deliver <a href="https://www.solaresearch.org/2020/10/designing-dashboards-to-help-students-take-action/">actionable and meaningful insights in</a> their everyday studies.<strong> How will you leverage learning analytics tools to improve educational practice?</strong></p><h3><strong>Learn more…</strong></h3><p>Silvola, A., Näykki, P., Kaveri, A. &amp; Muukkonen, H. (2021). <a href="https://www.sciencedirect.com/science/article/pii/S0360131521000695">Expectations for supporting student engagement with learning analytics: An academic path perspective</a>. <em>Computers and Education</em>, 168, 104192.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=ef7a4540dd38" width="1" height="1" alt=""><hr><p><a href="https://medium.com/solar-nexus/four-roles-for-learning-analytics-how-pre-service-teachers-envisage-learning-analytics-ef7a4540dd38">Four roles for learning analytics: How pre-service teachers envisage learning analytics</a> was originally published in <a href="https://medium.com/solar-nexus">SoLAR Nexus</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Learning with and from Artificial Intelligence-Driven Analytics]]></title>
            <link>https://medium.com/solar-nexus/learning-with-and-from-artificial-intelligence-driven-analytics-88ee4d5ed3f?source=rss-7bc0e8501388------2</link>
            <guid isPermaLink="false">https://medium.com/p/88ee4d5ed3f</guid>
            <category><![CDATA[artificial-intelligence]]></category>
            <category><![CDATA[aied]]></category>
            <dc:creator><![CDATA[SoLAR Nexus]]></dc:creator>
            <pubDate>Tue, 09 Nov 2021 05:28:55 GMT</pubDate>
            <atom:updated>2021-11-09T05:28:55.036Z</atom:updated>
            <content:encoded><![CDATA[<p><em>How is the field of Artificial Intelligence shaping educational contexts? Let’s explore both the benefits and challenges of innovative AI-Driven analytics…</em></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/624/1*FRKHNDAlbVRwU51KayVLBA.png" /><figcaption>Phoebe by <a href="https://unsplash.com/photos/45FJgZMXCK8">Joey Kybur</a> from <a href="https://unsplash.com/photos/45FJgZMXCK8">Unsplash</a></figcaption></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/157/1*n823MbuGhxEGsfaDcH1akg.png" /></figure><p><strong>Author</strong>: Rachel Dickler</p><p>Rachel Dickler is a Postdoctoral Research Associate at the NSF AI Institute for Student-AI Teaming (iSAT) at the University of Colorado Boulder. Her research spans across many fields including Human Computer Interaction, Artificial intelligence, Learning Sciences, and Education. Specifically, she is exploring the development of innovative technological tools (e.g., AI pedagogical agents, teacher dashboards) that can be used to promote collaborative learning in middle school and high school classrooms.</p><p><strong>Follow Rachel on </strong><a href="https://www.linkedin.com/in/racheldickler"><strong>LinkedIn</strong></a></p><p><strong>Keywords: </strong>Artificial Intelligence, AIED</p><p><strong>Target readers</strong>: leaders; educators</p><h3>Artificial intelligence (AI)</h3><p>The phrase “Artificial Intelligence” (AI) is often associated with ideas of humanoid robots, self-driving cars, or virtual assistants like Alexa and Siri. Rarely do we think of <em>classrooms</em> as primary examples of AI, but interdisciplinary innovations across fields such as Computer Science and the Learning Sciences are using AI to reshape how we measure learning in educational settings. So what does this mean for the future of education? How can we design AI that is safe, equitable, and effective in both assessing and promoting learning? The answers to these questions can be found in research at the intersection of AI and learning analytics.</p><h3>What is AI?</h3><p>AI can take on many forms but generally involves machines that are able to make decisions and adapt in similar ways to people. People interact with their environments based on different experiences over time and “learning” from the outcomes of those experiences (e.g., when we drive to work we first try to take a direct route and eventually discover that some roads have significant traffic during rush hour). We then use this information that we have learned to inform our future decisions (e.g., we may decide to take a longer, less direct route in order to avoid traffic), but sometimes these decisions are far from perfect depending on the context and unexpected obstacles (e.g., there happens to be construction the day that we take the less direct route and so we are still late to work).</p><p>Just like humans, machines can be trained to make decisions by providing them with experiences (i.e., in the form of data) and the corresponding outcomes associated with the experiences to create a model (i.e., representing relationships between certain features of the data and outcomes). The machine then applies the model to make decisions and predictions about outcomes of <em>new experiences</em> based on the features of the new data. These AI models can be applied to help accomplish complicated tasks across contexts, including in classrooms. Specifically, AI is often used to make decisions and predictions about student learning outcomes in educational settings by informing learning analytics.</p><h3>AI-Driven Learning Analytics</h3><p>One reason that AI is particularly useful in educational settings is because it can drive the assessment of complex student competencies that would otherwise be challenging and time-consuming to measure. For example, it takes hours to manually grade middle school students’ argumentative essays, particularly because there is not just one “correct” answer or way of organizing the essays. Researchers, however, have created AI-driven models that can <a href="https://link.springer.com/article/10.1007/s40593-017-0143-2">automatically score students’ essays</a> for complicated areas such as students’ use of evidence to support claims in their writing as well as the organization of the ideas within the essay.</p><p>AI analytics can also be used to inform individualized support to students and displays of student performance to teachers. For instance, if multiple middle school students are completing a scientific lab experiment simultaneously, it can be difficult to monitor each students’ progress and provide personalized support to students at the appropriate time. AI analytics within virtual <a href="https://www.tandfonline.com/doi/full/10.1080/10508406.2013.837391?casa_token=9oJWuWrSHlgAAAAA%3AikU5yRyM9wgMfaYBsNNhRfa2wlTbszOIiBNc6xwf3xP4paetDS7FZeGie2i6RwKtnfGKkTZEZDY">lab environments</a> provide an opportunity to automatically score student progress and correspondingly provide personalized support to students in real-time through an AI tutoring agent. The AI analytics can also be used to keep teachers informed of student progress through a <a href="https://learning-analytics.info/index.php/JLA/article/view/7153">dashboard</a> that provides real-time alerts on student difficulties as well as other essential visualizations and data on student progress.</p><p>These are just a few examples of the cutting-edge innovations emerging at the intersection of AI and Learning Analytics. It has been exciting to see the potential of these tools to support instruction and learning in classroom settings, but, just like people driving to work, AI technologies are not perfect. Let’s think through some of the challenges that come with implementing AI innovations in educational settings.</p><h3>Challenges with AI in Education</h3><p>It is critical to keep in mind that all initial stages of AI technologies are created by humans, which means that these tools are susceptible to human biases and error. Correspondingly, some of the greatest challenges with creating AI for educational contexts are that people must decide: <a href="https://edarxiv.org/pbmvz/">the sample of <em>which</em> people’s experiences or data are used to train the AI model</a>, <a href="https://discovery.ucl.ac.uk/id/eprint/10110036/1/BJET%202019%20Learning%20Analytics%20and%20AI%20Politics%2C%20Pedagogy%20and%20Practices.pdf">the types of data to include in the model</a>, <a href="https://link.springer.com/chapter/10.1007/978-3-030-78292-4_21">the approach that is used to model the data</a>, and how to define outcomes (i.e., decide what is a “correct” versus “incorrect” student answer). All of these decisions (and more) impact the way that AI analytics evaluate student learning, which can have a substantial impact on critical educational outcomes for students. Many AI researchers have emphasized the importance of <a href="https://books.google.com/books?hl=en&amp;lr=&amp;id=qrLjDwAAQBAJ&amp;oi=fnd&amp;pg=PA101&amp;dq=info:mmA_SdBoFJIJ:scholar.google.com&amp;ots=E94n7nzG3R&amp;sig=zh4p6Y-I6KFG2WsqUTLsuzq0kuw#v=onepage&amp;q&amp;f=false">keeping humans involved</a> in final decision making to help mediate some of these issues.</p><p>Another core challenge with AI analytics in classrooms is privacy concerns. While using different types of data (e.g., voice data, eye movements, facial expressions, etc.) can help to make AI models more powerful in certain cases, these types of data are also extremely personal. Therefore trust is needed in terms of how data is collected, used, and stored. Establishing standards for data use and implementation of AI technologies requires cross-disciplinary efforts.</p><h3>Interdisciplinary Collaboration is Essential</h3><p>There have been efforts across fields and institutions to promote interdisciplinary collaboration that is addressing the challenges faced around AI in education. The National Science Foundation has recently funded several institutes including the <a href="http://isat.ai/">NSF AI Institute for Student-AI Teaming (iSAT)</a>, <a href="https://www.aiengage.org/">NSF AI Institute for Engaged Learning (AIEngage.org)</a>, and AI Institute for Adult Learning &amp; Online Education (AI-ALOE) which all have a focus on creating ethical and equitable AI learning environments.</p><p>Additionally, communities such as the Center for Integrative Research in Computing and Learning Sciences (<a href="https://circls.org/">CIRCLS</a>) provide opportunities for these important conversations through events such as their <a href="https://circls.org/circls-21">recent virtual convening</a> with multiple sessions that brought together stakeholders across fields. For example, there was an expertise exchange led by Dr. Diane Litman, Dr. Janice Gobert, and Aditi Mallavarapu on “<a href="https://circls.org/circls21-expertise-connections/using-the-learning-sciences-and-computational-approaches-to-develop-assessments-and-intelligent-tutoring-systems">Using the Learning Sciences and Computational Approaches to develop Assessments and Intelligent Tutoring Systems</a>” that addressed many of the ideas and questions presented in this blog through discussions with practitioners in K12 and informal settings, higher education faculty, technology developers, researchers, and graduate students.</p><p>Through conversations across disciplines and with diverse stakeholders, we can take action to address core challenges with AI in education while also providing opportunities for learning analytics to shape educational settings in valuable ways.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=88ee4d5ed3f" width="1" height="1" alt=""><hr><p><a href="https://medium.com/solar-nexus/learning-with-and-from-artificial-intelligence-driven-analytics-88ee4d5ed3f">Learning with and from Artificial Intelligence-Driven Analytics</a> was originally published in <a href="https://medium.com/solar-nexus">SoLAR Nexus</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Applying the Science of Data Analytics to Product Development]]></title>
            <link>https://medium.com/solar-nexus/applying-the-science-of-data-analytics-to-product-development-1b9c77a03cbf?source=rss-7bc0e8501388------2</link>
            <guid isPermaLink="false">https://medium.com/p/1b9c77a03cbf</guid>
            <category><![CDATA[research]]></category>
            <category><![CDATA[evaluation]]></category>
            <category><![CDATA[implementation-science]]></category>
            <category><![CDATA[edtech]]></category>
            <category><![CDATA[learning-science]]></category>
            <dc:creator><![CDATA[SoLAR Nexus]]></dc:creator>
            <pubDate>Thu, 07 Oct 2021 04:53:18 GMT</pubDate>
            <atom:updated>2021-10-07T04:53:18.975Z</atom:updated>
            <content:encoded><![CDATA[<p><em>How can product developers use data analytics to improve products, prove their effectiveness, and increase the fidelity of implementation? Learn more in the latest Nexus story by Rachel Schechter</em></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*7-lu2I8kiSdmI0SPF5WjRg.png" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/355/1*_JinW_r6CigsoReZCiSq6g.jpeg" /></figure><p><strong>Author</strong>: <a href="http://drrachelschechter.com/">Rachel Schechter</a></p><p>Dr. Rachel Schechter leads Learning Experience Design, Evaluation, and Consulting services at <a href="https://www.charlesrivermedia.com/lxd-evaluation-consulting/">Charles River Media Group</a>, acting as a Chief Research Officer “for hire” to companies large and small. Rachel helps guide the use of data and evaluation to support product improvements, build evidence of efficacy, and strengthen customer implementations. Rachel has led research teams evaluating multimedia educational programming for learners of all ages since 2007 and most recently was the Vice President of Learning Sciences at Houghton Mifflin Harcourt. Her research often examines motivation, feedback, and learning in blended learning environments, and she has published several research articles evaluating formal and informal educational programming.</p><p><strong>Follow Rachel on </strong><a href="https://www.linkedin.com/in/dr-rachel-schechter/"><strong>LinkedIn</strong></a></p><p><strong>Keywords: </strong>implementation science, evaluation, edtech, learning sciences, research, learning design, social and emotional learning</p><p><strong>Target readers: </strong>Researchers, practitioners, administrators, students</p><p>What do product improvement, product efficacy, and product implementation all have in common? Using data! Anyone working on an online product needs to monitor who is using what, when, for how long, and how did it go. If you are looking for new ways to understand and leverage user data to understand engagement and learning, you’ll want to check out these stories about how I combine evaluation, learning, and implementation sciences to engage users and improve outcomes.</p><p>While climbing up the ranks in educational technology research for the last 10 years, I’ve seen that improving educational outcomes requires pulling research and methodologies from a variety of fields. The three I’ve focused on over the years are <em>evaluation sciences, implementation sciences, </em>and<em> learning sciences</em>. While deep expertise in at least one of these realms is helpful, an EdTech research leader needs to integrate ideas from complementary scientific fields including psychology, economics, and marketing.</p><p>While these sciences are listed separately, a single person or team may employ methods and resources from each at different stages of the development process. Let’s walk through each science, what it is, what it looks like in EdTech, and how to learn more about it.</p><h3><strong><em>Evaluation Sciences</em></strong></h3><p>I first explored evaluation sciences while working on my dissertation at Tufts University about the use of educational music videos in the preschool show Jim Henson’s<em> </em><a href="https://pbskids.org/sid"><em>Sid the Science Kid </em></a>(thank you <a href="https://www.emmys.com/foundation/programs/mister-rogers/apply">Mr. Rogers Scholarship</a>)<em>.</em></p><p><a href="http://cdmc.georgetown.edu/wp-content/uploads/2015/03/Calvert-2001.pdf">Research</a> suggests that young children don’t understand song lyrics; for example, they can understand the ABCs but not understand that the phrase “LMNOP” represents five different letters. What could children understand about science, though, from the 90-second music video’s visuals? And was that learning significantly different from watching a 12-minute episode?</p><p><a href="https://sciencetvstudy.wordpress.com/summary-and-results/">I found </a>that teachers could successfully teach preschoolers simple <em>engineering concepts</em> just as well with the short music video as with the long episode, meaning that kids could learn how a pulley system worked in 88% less time.</p><p>However, I found that kids who only watched the music video did not pick up on the scientific <em>vocabulary</em>. Why? Because of cognitive overload: they couldn’t process the music, lyrics, and visuals all at the same time.</p><p>Children can learn a lot from visuals, and rather than using terms like “rope” and “axle” they described those objects using their own words (“string,” “metal thing,” “round gray thing”). I recommend that teachers (or a character guide) preview any academic vocabulary before and after the music video to support understanding and retention.</p><h3><strong><em>Learning Sciences</em></strong></h3><p><a href="https://digitalpromise.org/2020/03/10/what-is-learning-sciences-and-why-does-it-matter/">Learning sciences</a> integrates principles of learning across systems and disciplines and focuses on realistic learning environments that use technology. At <a href="https://www.hmhco.com/">Houghton Mifflin Harcourt</a>, I guided the <a href="https://www.hmhco.com/programs/waggle#overview">Waggle</a> (ELA and math practice program) product design team when they took on the task of reimagining their student user experience using the newly created <a href="https://www.hmhco.com/blog/why-is-applying-learning-science-so-complex-for-teachers">HMH Learning Sciences Pillars RAMP</a>.</p><p>With a goal of student engagement, we focused on <a href="https://selfdeterminationtheory.org/theory/">self-determination theory</a> to inform the student dashboard design and better support students’ autonomy, competence, and sense of belonging (which foster intrinsic motivation). Data analytics can increase or diminish intrinsic motivation through its use of data visualization and design. For example, in the original design, five rows of numbers and donut graphs felt overwhelming and lacked direction (reducing a student’s sense of autonomy). In the revised design, only two “missions in progress” were shown and student progress was indicated using a bar graph that more closely represents a journey with an end.</p><p>In the original design, five different scores and points were placed on the right side and the bottom of the screen (this is a lot for a student to process). To better support a student’s sense of competence, the revised design featured a single score at the bottom of the screen and a focus on the learning goals for current and future missions instead of a collection of metrics. Probably the biggest change from the original to the revised design was the student’s ability to design a custom avatar, which better supported their sense of belonging through its full-size featured place on the right side of the screen. I’m thrilled to share that Waggle was CODIE 2021 finalist for <a href="https://history.siia.net/codie/2021-Finalists/details/cID/70">Best Gamification in Learning</a>!</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*knZ2vP_OhsXllCPY9LDySg.png" /></figure><h3><strong>Implementation Sciences</strong></h3><p>Implementation sciences are the study of methods that support the application of research findings and best practices (Carnegie Foundation for the Advancement of Teaching has a nice intro blog about it <a href="https://www.carnegiefoundation.org/blog/quality-improvement-approaches-implementation-science/">here</a>). Educational technology research is a great venue for its application because evaluation research identifies the best practices, learning sciences helps us design products with those in mind, and then the last is figuring out how to help increase the uptake of those best practices.</p><p>At <a href="https://www.lexialearning.com/">Lexia Learning</a>, I was tasked with creating individualized prescriptions for Lexia Reading Core5 so students who were farther behind were prescribed more usage time to match the intensity of instruction that they needed. While that logic makes perfect sense and was commonly described in Response to Intervention Models (RtI) or Multi-Tiered Systems of Support (MTSS), it was quite radical to have four different usage times in one classroom for the same app!</p><p>We saw right away that changing user behavior (both teacher and student) would not happen on its own. I created a piece called “<a href="https://www.lexialearning.com/resources/research/every-minute-counts-meeting-usage-targets-core5#:~:text=Lexia%C2%AE%20Core5%C2%AE%20Reading,grades%20Pre%2DK%20through%205.&amp;text=Based%20on%20their%20risk%20level,minutes)%20that%20is%20updated%20monthly.">Every Minute Counts</a>” that showed how when students met their recommended minutes consistently, the group made much more progress and succeeded as a group more often. It took a few years to get this message clear and powerful, and when we did, this graph became a staple in every launch training!</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*0bRp8bjJqy7cKUHRknX9Ow.png" /></figure><h3><strong>Context, Context, Context</strong></h3><p>In addition to all the scientific frameworks, at this moment in EdTech development it is critical to include Social and Emotional Learning (SEL) and Employee Engagement, which both include a Diversity, Equity, and Inclusion lens (DEI). A few thoughts on these:</p><p>● SEL considers social and emotional awareness and management, individual variability, and local context for learners and educators. Researchers partner with Product, Content, Professional Learning, Sales, and Marketing to elevate user voice to inform decision making that best meets the needs of users (learners and educators). While we empathize with our users, we also maintain boundaries for ourselves to maintain psychological safety and manage our own mental health. (Check out this resonating <a href="https://uxdesign.cc/the-ux-of-google-classroom-940e8b64a535">podcast episode by Alicia Quan featuring Amanda Rosenburg</a> telling her story about empathizing with users at the start of the pandemic.)</p><p>● To engage employees, EdTech companies need to foster an environment for diversity, equity, and inclusion for team members company-wide. Researchers can partner with Human Resources, Learning and Development, and other Support teams to inform strong communication patterns, staff development planning, and collaborate on collecting data through interviews, focus groups, and surveys.</p><p>The work I’ve done in the last 10 years has brought together evaluation, implementation, and learning sciences to create engaging and effective learning tools. Organizations need to break down the silos and form collaborations that keep the information flowing through the research teams so that data, analytics, and insights from different sources inform decisions.</p><p>The US EdTech market is approaching a spending peak that will not sustain once pandemic relief funds expire. More than ever before, school leadership will be looking for evidence before buying. The methods, the information, and the tools are available, much of the information I’ve shared today is free, and tools are more affordable and friendly to use than even a decade ago. EdTech researchers can help schools make effective toolkits that meet educators’ and students’ evolving needs. It’s an exciting time to be in EdTech research!</p><h3><strong>Summaries Explaining Evaluation, Learning, and Implementation Sciences</strong></h3><p><a href="https://oes.gsa.gov/"><strong>Evaluation Sciences</strong></a><strong> </strong>uses and builds evidence to learn what works and what doesn’t, for whom, and under what circumstances. Evaluation can happen anywhere and everywhere that data can be collected, stored, and compared. Product evaluation works best when data collection systems can inform iterative and continual product development. When implementing design changes, include an analysis plan for how you will measure the impact of those changes. The <a href="https://www.eval.org/">American Evaluation Association</a> provides several great frameworks. Also, see evaluation scholar <a href="https://journals.sagepub.com/doi/full/10.1177/1098214018763121">Michael Quin Patton</a> and data viz guru <a href="https://stephanieevergreen.com/">Stephanie Evergreen</a> to get started.</p><p><a href="https://digitalpromise.org/2020/03/10/what-is-learning-sciences-and-why-does-it-matter/"><strong>Learning Sciences </strong></a>explores concepts related to the understanding of the learning process, pulling together cognitive psychology, neuroscience, educational psychology, and other disciplines. Learning Scientists inform data architecture, advise on reporting for educators and administrators, establish and review skill progressions and mastery models, and inform data analytics plans for product improvement. <a href="https://digitalpromise.org/">Digital Promise</a> has excellent resources about Learning Sciences for educators, while the Learning Scientists (learningscientists.org) is more academic-focused.</p><p><a href="https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4573926/"><strong>Implementation Sciences</strong></a> facilitates the <em>uptake of evidence-based practices</em> into users’ applications of products. Implementation studies are often conducted in between product sprints, to help inform prioritization and understand what may or may not be working with product design, training, or support. While looking at a whole user population is fast, organizing users into subgroups using personas or various profiles as a guide can help you find inspirational stories that can drive implementation improvements.EdSurge has put together a <a href="https://www.edsurge.com/research/guides/the-personalized-learning-toolkit">personalized learning toolkit</a> that walks through the inclusion of implementation science. The<strong> </strong>Learning Accelerator has a helpful article about <a href="https://practices.learningaccelerator.org/do/measure-progress/implementation">measuring the quality and progress towards stronger implementations</a>.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=1b9c77a03cbf" width="1" height="1" alt=""><hr><p><a href="https://medium.com/solar-nexus/applying-the-science-of-data-analytics-to-product-development-1b9c77a03cbf">Applying the Science of Data Analytics to Product Development</a> was originally published in <a href="https://medium.com/solar-nexus">SoLAR Nexus</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Humanizing AI Research and Design in Education by Broadening Community Engagement]]></title>
            <link>https://medium.com/solar-nexus/humanizing-ai-research-and-design-in-education-by-broadening-community-engagement-5a3144ceace1?source=rss-7bc0e8501388------2</link>
            <guid isPermaLink="false">https://medium.com/p/5a3144ceace1</guid>
            <category><![CDATA[learning-analytics]]></category>
            <category><![CDATA[inclusion]]></category>
            <category><![CDATA[visualization]]></category>
            <category><![CDATA[diversity]]></category>
            <category><![CDATA[ai-in-education]]></category>
            <dc:creator><![CDATA[SoLAR Nexus]]></dc:creator>
            <pubDate>Mon, 13 Sep 2021 00:11:41 GMT</pubDate>
            <atom:updated>2021-09-13T00:11:41.589Z</atom:updated>
            <content:encoded><![CDATA[<p><em>How can broadening community engagement help mitigate the challenges of inequity, privacy, trust and bias in AI? Join us at an exciting online event…</em></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/624/1*uDnB9dzSXPh_K5ELy94ukQ.png" /><figcaption>Photo by Zainul Yasni from Unsplash</figcaption></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/125/1*YBhkwMByNZ-zqq1mY7MyzA.png" /></figure><p><strong>Author</strong>: Aditi Mallavarapu</p><p><strong>Position</strong>: Learning Sciences and Technology Postdoctoral Researcher at CIRCLS. Her research projects all have the shared goal of collaborating with practitioners to design and build computational and analytical methods and tools to support and improve exploration-based learning. She has worked professionally as a technical consultant where she developed software solutions for healthcare and financial organizations. As an instructor she is involved with underserved communities to pique their interests in Computer Science.</p><p><strong>Follow Aditi on Twitter:</strong> <a href="https://twitter.com/EducatorCIRCLS">EducatorCIRCLS</a> and <a href="https://twitter.com/circls_org">circls_org</a></p><p><strong>Keywords: </strong>Learning Analytics, AI in Education, Broadening, Diversity, Inclusion, Visualization</p><p><strong>Target readers</strong>: Researchers</p><p>This blog is the second of the three-part shared series, between <a href="https://www.solaresearch.org/publications/nexus/"><em>Nexus</em></a><em> and the Center for Integrative Research in Computing and Learning Sciences or </em><a href="https://circls.org/"><em>CIRCLS</em></a><em>. The </em><a href="https://medium.com/solar-nexus/circls-meet-nexus-exploring-learning-analytics-aied-inclusion-e88818d515dc"><em>first post</em></a><em> described the synergy between the two communities, and introduced the CIRCLS priority around broadening/inclusion in Learning Analytics/AI in education. In this post, we highlight the concerns and the importance of “broadening” participation in research of AI in education, equally raised by both the communities.</em></p><h3>The “FATE” of AI educational research</h3><p>Education, like many other fields, has been revolutionized in this era of datafication. The omni-present machines, with the so-called “intelligence,” are being used to improve the way we learn and teach through devices and technologies, and connect learners, teachers, and even families across ecologies (classrooms, museums, homes) to manage learning. Some innovations have started to dominate the way we learn and remember, sometimes even remembering for us. The imaginative artificial technologies enacted in <em>Star Trek</em> with communicators, talking virtual assistants, and video chats have become our reality. But this reality has not been equitably rolled out across individuals, schools, or communities.</p><p>As AI technologies become intertwined with our daily lives, there are justifiable concerns in society around algorithmic fairness, accountability, trustworthiness and ethics (“FATE”). Research is developing rapidly to ask how <em>can we, as a community, rethink AI-based technological progress to address this inequity? How can we address the concerns around privacy, trust, and bias, that have become prevalent due to the prolific use of data and recording devices in these AI technologies?</em> Progress in defining the nature of the challenges, and ways forward, is being made in both the <a href="https://www.learning-analytics.info/index.php/JLA/article/view/7254">Learning Analytics</a> and <a href="https://link.springer.com/article/10.1007%2Fs40593-021-00239-1">AIED communities</a>, but there remains much to do.</p><p>Researchers have suggested addressing these issues, in part, by <strong>broadening community engagement</strong>. With the recent transition to online learning due to the COVID-19 pandemic, the need to address these issues has become more urgent.</p><h3>Addressing the issues by broadening engagement</h3><p>For over a decade, researchers have been working synergistically across disciplines to address issues around equity, privacy, trust and bias. Some researchers have highlighted, humanizing the issues by engaging all stakeholders, learners, educators, caregivers and domain experts, in contributing to the design of the AI systems. One goal of broadening engagement is to consider the complex dynamics that result from multiple perspectives of the different stakeholders involved in a learning process, while designing the AI system. To fully achieve this, the design process should provide the stakeholders an active and respected role, which is non-trivial. The black box-like opaqueness that many of these AI technologies possess makes it difficult for practitioners to contribute. This should not be an excuse.</p><p>One way of providing everyone a platform to voice their opinions is to reduce the opaqueness through enacting and visualizing scenarios, making the design process about the humans involved in conceiving and using the system. Taking such a human-centered approach engages practitioners in conversations around what should be measured, and how that measurement could be used in decisions, with a hopeful view of mitigating at least some unwarranted applications and effects that a researcher alone might not be able to anticipate from where they sit.</p><h3>Come be a part of the conversation!</h3><p>We at <a href="https://circls.org/">CIRCLS</a>, have planned the <a href="https://circls.org/circls-21">CIRCLS’21</a> convening for the community with the theme of “Remake Broadening.” Broadening participation for emergent technologies, like AI design, is an important aspect of this initiative. The keynote speakers are committed to broadening participation in Computer Science and AI education across different age groups and communities using emergent AI technologies. They will engage the attendees in thinking about “designing for broadening” through “broadening participation in design.”</p><p>The community will also be hearing the vision of researchers at the <a href="https://www.nsf.gov/funding/pgm_summ.jsp?pims_id=505686">AI institutes</a>,<a href="https://www.colorado.edu/research/ai-institute/who-we-are"> iSat</a>, <a href="https://www.ic.gatech.edu/news/649137/georgia-tech-will-help-bring-critical-advancements-online-learning-part-multimillion">AI-ALOE</a> and <a href="https://www.aiengage.org/">AIEngage.org</a> (part of the 11 institutes that won the recent <a href="https://www.nsf.gov/news/news_summ.jsp?cntn_id=303176">NSF “AI institute” competition</a>). This session will highlight how the community of both researchers and practitioners can contribute to and participate in AI research.</p><p>We invite SoLAR members to the conversation. Our <em>Expertise Connections</em> sessions (<em>September 13, 4pm Eastern: Equity and Ethics Considerations for AI</em>) and our <em>Strategy</em> sessions <em>(September 14, 3pm Eastern: Remake Broadening) </em>will allow researchers and practitioners alike to survey the emerging landscape and think strategically about how we could remake the envisioned broadening. We’ve designed these sessions to engage participants with the most pressing topics in small group activities — a “low floor and high ceiling” setting for both practitioners and researchers, that encourages the understanding of each others’ perspectives.</p><p>We hope this plan will give all attendees the chance to shape the broadening process. Our vision for this convening is a first step to “remake broadening”. With more engagements to follow, we hope to keep the conversation going even after the convening. We hope you’ll join us. You can see details about all the sessions when you <a href="https://www.eventbrite.com/e/circls21-registration-159740152095">register</a> and explore Swapcard for <a href="https://circls.org/circls-21">CIRCLS’21</a>.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=5a3144ceace1" width="1" height="1" alt=""><hr><p><a href="https://medium.com/solar-nexus/humanizing-ai-research-and-design-in-education-by-broadening-community-engagement-5a3144ceace1">Humanizing AI Research and Design in Education by Broadening Community Engagement</a> was originally published in <a href="https://medium.com/solar-nexus">SoLAR Nexus</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[CIRCLS meet NEXUS! Exploring Learning Analytics, AIED & Inclusion]]></title>
            <link>https://medium.com/solar-nexus/circls-meet-nexus-exploring-learning-analytics-aied-inclusion-e88818d515dc?source=rss-7bc0e8501388------2</link>
            <guid isPermaLink="false">https://medium.com/p/e88818d515dc</guid>
            <category><![CDATA[learning-analytics]]></category>
            <category><![CDATA[visualization]]></category>
            <category><![CDATA[diversity]]></category>
            <category><![CDATA[inclusion]]></category>
            <category><![CDATA[ai-in-education]]></category>
            <dc:creator><![CDATA[SoLAR Nexus]]></dc:creator>
            <pubDate>Mon, 06 Sep 2021 00:45:59 GMT</pubDate>
            <atom:updated>2021-09-06T00:45:59.039Z</atom:updated>
            <content:encoded><![CDATA[<p><em>Let’s think about our research of the future so we can be more inclusive. </em><strong><em>Who</em></strong><em> do we involve, </em><strong><em>where</em></strong><em> do we do it, </em><strong><em>what</em></strong><em> do we research, </em><strong><em>why</em></strong><em> do we do this research, and </em><strong><em>how</em></strong><em> do we do it?</em></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/926/1*eGD0Hm2HSt0BkS4OmNo2MQ.png" /><figcaption>Image by <a href="https://unsplash.com/photos/_Yc7OtfFn-0">RhondaK</a> on <a href="https://unsplash.com/photos/_Yc7OtfFn-0">Unsplash</a></figcaption></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/188/1*QfLzT5yafbfJ2LxDro3BbA.png" /></figure><p><strong>Author</strong>: Judi Fusco</p><p><strong>Position</strong>: Senior Research Scientist Digital Promise and CIRCLS Co-PI.</p><p>Dr. Fusco has spent much of her career working to help close the gap between teachers and researchers and wants to ensure that educator voices are involved in the creation of emerging technologies for teaching and learning. Early in her career, she helped co-found and direct the community development of Tapped In, one of the first online communities for education professionals.</p><p><strong>Follow Judi on Twitter: </strong><a href="https://twitter.com/EducatorCIRCLS"><strong>EducatorCIRCLS</strong></a><strong> and </strong><a href="https://twitter.com/circls_org"><strong>circls_org</strong></a></p><p><strong>Keywords</strong>: Learning Analytics, AI in Education, Broadening, Diversity, Inclusion, Visualization</p><p><strong>Target readers</strong>: Researchers</p><p><em>A nexus is a collection of interconnected ideas. The </em><a href="https://www.solaresearch.org/publications/nexus/"><em>Nexus</em></a><em> blog from the Society for Learning Analytics Research (SoLAR) shares practical developments in Learning Analytics with a broad audience. Now we’re forging new links: in this first post in a three-part shared series between NEXUS and the Center for Integrative Research in Computing and Learning Sciences or </em><a href="https://circls.org/"><em>CIRCLS</em></a><em>, we will learn more about CIRCLS and describe ways the two communities can synergize. This post is cross-posted on the CIRCLS website at </em><a href="https://circls.org/educator-circls"><em>Educator CIRCLS</em></a><em>.</em></p><h3>Who We Are and What We Do</h3><p>CIRCLS is a National Science Foundation funded hub that works to bring together a community of researchers, practitioners in K12 and informal settings, higher education faculty, technology developers, and graduate students, who are researching, developing, or working with emerging technologies for teaching and learning. Learning Analytics has played and continues to play a prominent and important role in projects with these future oriented technologies.</p><p>CIRCLS works to bring researchers together to address common needs, plan for the future, and create broader impact as they work to support personal-, community-, and context-centered needs with emerging technologies for learning. In our work, advancing equity is a core goal. In addition, CIRCLS helps to amplify work on emerging technologies for teaching and learning to policymakers, practitioners, and interested stakeholders. We’ve included a link to a 3-minute video to share more about how CIRCLS works to <a href="https://stemforall2021.videohall.com/presentations/2222">Build Community to Shape Emerging Technologies</a>.</p><h3>History and Mission</h3><p>CIRCLS is a new center with a long history that is grounded with the work done in the <a href="https://circlcenter.org/">Center for Innovative Research on Cyberlearning</a>, which started in 2013. CIRCL supported the Cyberlearning program area at NSF, which preceded the <a href="https://www.nsf.gov/pubs/2020/nsf20612/nsf20612.htm">Research on Emerging Technologies for Teaching and Learning </a>(RETTL) program. CIRCLS is the new center supporting the RETTL program. First CIRCL, and now CIRCLS, shares <a href="https://circlcenter.org/resources/">reports</a> about <a href="https://circls.org/reports/ambitious-mashups-reflections-on-a-decade-of-cyberlearning-research">work</a> that influenced the field. The projects involve ambitious designs for more equitable learning experiences with emerging technology.</p><p>Another characteristic of the projects is how they work to develop learning theories and technologies that are likely to become important to the field within 5–10 years. We see how CIRCLS projects often overlap with the research being done in SOLAR and that there are many members who are active in both communities. Artificial Intelligence (AI) is a <a href="https://www.nsf.gov/news/news_summ.jsp?cntn_id=303176">growing area</a> and Learning Analytics is integral when thinking about AI and how it could augment learning.</p><p>In our work to bridge the gap between research and classroom practice, we involve practitioners through <a href="https://circls.org/educator-circls">Educator CIRCLS</a> and also think about <a href="https://circls.org/ai-and-education-policy">policy</a> needs for emerging technologies, specifically AI. We also have special programming for graduate students and new scholars in our <a href="https://circls.org/emerging-scholar-circls">Emerging Scholars</a> expertise exchange. If interested in any of these communities, SoLAR members are welcome to visit our website, read more, and <a href="https://digitalpromise.az1.qualtrics.com/jfe/form/SV_87mnagX53dhcKkl">join</a>.</p><h3>Remaking “Broadening”</h3><p>When you hear the term <em>“broadening”</em> (or for our non-US readers, perhaps <em>“inclusion” </em>is more familiar) — what do you think? Our <a href="https://circls.org/circls-21">upcoming virtual convening</a> will focus on building an understanding of how the field can make stronger progress by examining and remaking “broad.” How can this familiar word become more meaningful and specific, leading to greater intellectual merit and impacts? How can broadening address who we involve in research, where we conduct research, what we research, why we do the research, and how we do research?</p><p>The theme “Remake Broadening” challenges our community to learn and engage in innovative ways to make positive changes in education.Through roundtable discussions, breakout sessions, plenaries, and more, we will reflect and consider next steps and recommendations for the field. Our keynote speakers <a href="https://nickiwashington.com/">Nicki Washington</a> and <a href="https://journalism.utexas.edu/faculty/s-craig-watkins">Craig Watkins</a> will offer insights as to how we can further our work to nurture inclusive communities and how we must move forward to “broaden” multiple aspects of the field. Some of the topics the community will explore include:</p><p>● <em>Learning Analytics and Data Visualization: Broadening our View</em></p><p>● <em>AI and Education Policy</em></p><p>● <em>Equity and Ethics Considerations for Teaching and Learning with AI</em></p><p>● <em>Using the Learning Sciences and Computational Approaches to develop Assessments and Intelligent Tutoring Systems</em></p><p>● <em>Towards Equity, Accessibility, &amp; Inclusion</em></p><p><a href="https://cynthiadangelo.com/cv/">Cynthia D’Angelo</a>, <a href="https://concord.org/about/staff/chad-dorsey/">Chad Dorsey</a> and <a href="https://www.csc.ncsu.edu/people/tmbarnes">Tiffany Barnes</a>, the facilitators for the <em>Learning Analytics and Data Visualization: Broadening our View</em> session, give us a preview:</p><blockquote>“For example, as we think about learning analytics and broadening our view, the production and application of learning analytics has extensive implications for education choices both now and in the future. While learning analytics can be used in many ways to improve learning, we must be aware of the more subtle consequences of its use in order to ensure that they are oriented toward the most positive ends possible. We make many choices and assumptions (sometimes implicitly) at many stages of research, including question selection, data collection, data processing, analysis, and presentation. These choices frequently have equity implications, often in subtle ways.”</blockquote><p>If this sounds interesting, we hope you’ll <a href="https://www.eventbrite.com/e/circls21-registration-159740152095">register </a>for CIRCLS’21 and join us in thinking about these and other issues.</p><p>In our second post, we’ll share more about the sessions focused on bringing learning sciences and computer sciences together as we think about broadening in research on emerging technologies for teaching and learning.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=e88818d515dc" width="1" height="1" alt=""><hr><p><a href="https://medium.com/solar-nexus/circls-meet-nexus-exploring-learning-analytics-aied-inclusion-e88818d515dc">CIRCLS meet NEXUS! Exploring Learning Analytics, AIED &amp; Inclusion</a> was originally published in <a href="https://medium.com/solar-nexus">SoLAR Nexus</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Educational data storytelling: How can we communicate important insights into your learning…]]></title>
            <link>https://medium.com/solar-nexus/educational-data-storytelling-how-can-we-communicate-important-insights-into-your-learning-3410e7247b84?source=rss-7bc0e8501388------2</link>
            <guid isPermaLink="false">https://medium.com/p/3410e7247b84</guid>
            <category><![CDATA[learning-dashboards]]></category>
            <category><![CDATA[data-storytelling]]></category>
            <category><![CDATA[learning-analytics]]></category>
            <dc:creator><![CDATA[SoLAR Nexus]]></dc:creator>
            <pubDate>Thu, 02 Sep 2021 04:44:53 GMT</pubDate>
            <atom:updated>2021-09-02T04:44:53.040Z</atom:updated>
            <content:encoded><![CDATA[<h3><strong>Educational data storytelling: How can we communicate important insights into your learning dashboards?</strong></h3><p><em>Learning dashboards can be challenging to interpret for our teachers and students. Educational Data Storytelling can help communicate meaningful insights and drive attention to what is important</em>.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*xoI4J0xGoX4ZfGDN1h6eFg.jpeg" /><figcaption>Photo by <a href="https://unsplash.com/@lukechesser?utm_source=unsplash&amp;utm_medium=referral&amp;utm_content=creditCopyText">Luke Chesser</a> on <a href="https://unsplash.com/s/photos/data-storytelling?utm_source=unsplash&amp;utm_medium=referral&amp;utm_content=creditCopyText">Unsplash</a></figcaption></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/199/1*EO69bUEET2rlbxZIK_eO-g.png" /></figure><p><strong>Author</strong>: Vanessa Echeverria</p><p>Vanessa Echeverria is an Assistant Professor at Escuela Superior Politécnica del Litoral (Ecuador). Her research interests lie in the intersection of Human-Computer Interaction, Artificial Intelligence, and collaborative learning to support teachers and learners in their learning process.</p><p><a href="https://twitter.com/vanechev"><strong>Follow Vanessa on Twitter</strong></a></p><p><strong>Keywords</strong>: data storytelling, learning dashboards, learning analytics</p><p><strong>Target readers</strong>: Designers; Researchers</p><p>In the learning analytics community, we are all familiar with visualizations and dashboards generated using data from technology-enhanced learning tools and systems. Usually, these visualizations are <em>exploratory</em>. They are intended to show the big picture and invite users to analyze the data, explore questions, and get answers.</p><p><strong>But how do we guide users (teachers or learners) on where to look to get the key <em>insights </em>we want to convey?</strong></p><p><strong>What if we could provide a call-to-action message for users to take after inspecting, analyzing, and interpreting the visualization?</strong></p><p>Borrowing ideas from data storytelling, in this blog, I introduce educational data storytelling, a technique to guide users when interpreting complex data.</p><p>First, we need to define what data storytelling is to learn how to embed these concepts into our learning visualizations.</p><h4><strong>What is data storytelling?</strong></h4><p>Data storytelling is the process of creating a story using data. For instance, journalists and data scientists from the New York Times have crafted <a href="https://www.nytimes.com/interactive/2015/07/24/business/international/the-world-according-to-china-investment-maps.html">powerful data stories</a> to a broader audience using data storytelling. Data storytelling builds on narrative storytelling foundations and Information Visualization techniques to engage the audience and increase their attention.</p><p>While <strong>data visualizations</strong> invite users to explore, ask questions, and get answers by these, <strong>data storytelling</strong> aims to communicate insights through the combination of <a href="https://www.blastanalytics.com/blog/persuasive-storytelling-with-data-visualization">data, visuals, and narrative</a>. Ideally, data storytelling will drive the users to take action based on critical information.</p><p>Summarising data storytelling’s goal and purposes, here are some key points:</p><p>· <strong>Data storytelling is goal-oriented. </strong>The design of a data story should be aligned with a specific goal. This enables the identification of the data that should be highlighted.</p><p>· <strong>The data story should rely on an appropriate chart type. </strong>Some charts work better for specific purposes. For example, line charts effectively show changes over time.</p><p>· <strong>The data story should be reduced to essentials. </strong>It should avoid complexity by removing unnecessary data and visual elements that do not add informative value.</p><p>· <strong>The data story should guide attention. </strong>Visual and narrative elements can be used to emphasize key data points to create meaning. This can be achieved by 1) leveraging visual design elements such as shape, color, text; and 2) place the data story into a narrative structure such as introduction, rising action, climax, and conclusion.</p><h4><strong>Educational data storytelling</strong></h4><p>Now that we have defined what data storytelling is, let’s see how we can combine these data storytelling key points with learning dashboards to communicate the main insights.</p><p>To illustrate the educational data storytelling approach, I present an example from <a href="https://dl.acm.org/doi/10.1145/3170358.3170380">prior work</a> done in this research area. Figure 1 depicts a line chart combined with a dot chart about a team’s performance in a collaborative database design activity, which was intended as feedback for the students to reflect on. In brief, the chart shows that as the activity progressed, the team added more and more elements to their database design. As can be seen, the figure has a lot of information for students to process: objects represented as dots, such as entities/attributes and relationships from an Entity-relationship diagram, and the score solution, represented as a line. <strong>But what are the key insights the students should take from this?</strong></p><p>Figure 2 illustrates the result of applying the educational data storytelling approach. The educator’s pedagogical purposes are translated into visual elements to help emphasize and communicate key insights: identifying main objects (i.e., entities, attributes, relationships) and the score evolution during the design activity. The blue labels and boxes in Figure 2 have been added for illustrative purposes, explaining the data storytelling elements that were applied into the original visualization. The descriptive title foregrounds the main insight, only the main objects are retained in the visualization, narratives highlight key changes during the group activity, and the shaded explanatory area adds some context about the activity.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/664/1*PJ7v5MqCazKffgROpwqBxQ.jpeg" /><figcaption>Figure 1. A visualization showing the team’s performance in a collaborative activity.</figcaption></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*vLaJDcJzMMOb9lUfiuaKvA.png" /><figcaption>Figure 2. A visualization about team performance after applying the educational data storytelling approach. Note that blue boxes were added to point to different data storytelling elements.</figcaption></figure><h4><strong>How can we do this automatically?</strong></h4><p>While data storytelling techniques can be used by anyone to improve their visuals, learning analytics visuals may be dynamically generated — the story may not be known in advance. Our <a href="https://dl.acm.org/doi/10.1145/3170358.3170380">prior work</a> describes four steps to generating such educational data stories automatically:</p><p><strong>Step 1: Understanding the context. </strong>First, we must<strong> </strong>understand the data we can collect, which tools were utilized in the learning environment, what kinds of artifacts were created during the learning activity, and the interactions among different actors (i.e., teachers and students). This context can be derived by the <em>learning design</em> of the activity or by the user’s inquiry (e.g., asking teachers what is relevant for students to learn). In this step, it is also essential that we define the targeted audience of these visuals — <em>who will be the consumers of these learning dashboards/visualizations? Are these visualizations targeted at teachers or students?</em></p><p>The outcome of this step is a set of pedagogical purposes or main insights that will be represented as data stories. For example, when a group of students is designing an Entity-Relationship database model from the Student-Scholarship case study, the teacher sets a pedagogical purpose for this task: students must recognize three entities such as <em>Student</em>, <em>Scholarship</em> and <em>Deposit</em> as main entities of the Entity-Relationship database model.</p><p><strong>Step 2:</strong> <strong>Translating pedagogical purposes into rules</strong>. Once we define the pedagogical purposes, the next step is to explain these with a formal language, such as <em>rules</em>, that can be coded in any programming language, similar to pseudo code. These rules consider the data that have been gathered from the learning environment, the expected interactions among actors and expected outcomes. For example, we can create a rule from the pedagogical purpose in Step 1 such as the following:</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1018/1*9i8psCjM8fXd_35zu0YnCA.jpeg" /></figure><p>In other words: when a main entity, such as <em>Student</em>, <em>Scholarship</em> or <em>Deposit</em> is recognized during the task, add this as a data point in the chart.</p><p><strong>Step 3: Mapping rules with visual elements. </strong>This step consists of mapping the rules identified in the previous step to visual elements that emphasize key data points and the <em>call-to-action</em> message we want the student to engage with. The visual elements can include shape, color, line, contrast, size, orientation, and position. For example, from the rule defined in step 2, we can add visual elements to highlight a key entity using colors and shapes (as in Figure 2). We can also remove unimportant entities. The table below lists some visual elements that can be used for this step.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/873/1*D_4L6fBjQbwgi5FEWZbBNg.jpeg" /></figure><p><strong>Step 4: Crafting the visualizations. </strong>This is where we apply the visual elements and data storytelling principles into our visualizations. Once we have defined our context, intentions, and visual elements, we apply these to our visualizations. Following <a href="https://www.wiley.com/en-us/Storytelling+with+Data%3A+A+Data+Visualization+Guide+for+Business+Professionals-p-9781119002253">Knaflic’s steps</a> for creating data stories, we select our chart type according to our data, apply decluttering, focus attention on our key insights, and give a call-to-action message.</p><p><strong>And the moral of the story…</strong></p><p>While there are many benefits to using data storytelling, this is not always applicable to all learning visualizations. Researchers and designers should keep in mind that data stories are helpful when insights are hard to understand due to the data complexity. For example, if we rely on multiple data sources or work with many variables in the same visual representation, it may be worth applying this educational data storytelling approach.</p><p>Data storytelling provides a way to emphasize critical insights via learning visualizations. It helps you engage with your audience and directly impacts the decision-making process. Next time you are working with data and designing your learning visualizations, consider crafting good data stories to better communicate important insights.</p><h4><strong>Learn more:</strong></h4><p>Echeverria, V., Martinez-Maldonado, R., Granda, R., Chiluiza, K., Conati, C., &amp; Buckingham Shum, S. (2018). <a href="https://www.researchgate.net/profile/Vanessa_Echeverria/publication/323860940_Driving_data_storytelling_from_learning_design/links/5b18d3e145851587f297d325/Driving-data-storytelling-from-learning-design.pdf?origin=publication_detail">Driving Data Storytelling from Learning Design</a>. In <em>Proceedings of the</em> <em>Eighth International Learning Analytics &amp; Knowledge Conference</em>, (pp. 131–140). ACM. <a href="https://doi.org/10.1145/3170358.3170380">https://doi.org/10.1145/3170358.3170380</a></p><p>Echeverria, V., Martinez-Maldonado, R., Buckingham Shum, S., Chiluiza, K., Granda, R., &amp; Conati, C. (2018). <a href="https://learning-analytics.info/journals/index.php/JLA/article/view/6114/7037">Exploratory versus Explanatory Visual Learning Analytics: Driving Teachers’ Attention through Educational Data Storytelling</a>. <em>Journal of Learning Analytics</em>, <em>5</em>(3), 72–97. <a href="https://doi.org/10.18608/jla.2018.53.6">https://doi.org/10.18608/jla.2018.53.6</a></p><p>Echeverria, V., Lawrence, L., Tsai, Y.-S., Singh, S., Fernandez-Nieto, G., &amp; Martinez-Maldonado, R. (2021). <a href="https://www.datastorytellingforeducation.org/">Data Storytelling for Learning Analytics Dashboards</a>. <em>LAK21 — Tutorial</em>.</p><p>Knaflic, C. N. (2015). <a href="https://www.storytellingwithdata.com/books">Storytelling with data: A data visualization guide for business professionals</a>. John Wiley &amp; Sons.</p><p>Martinez-Maldonado, R., Echeverria, V., Fernandez Nieto, G., &amp; Buckingham Shum, S. (2020).<a href="http://martinezmaldonado.net/files/CHI20-Multimodal_Layered_Approach.pdf"> From data to insights: a layered storytelling approach for multimodal learning analytics</a>. In J. McGrenere, &amp; A. Cockburn (Eds.), <em>Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems,</em> Association for Computing Machinery ACM. <a href="https://doi.org/10.1145/3313831.3376148">https://doi.org/10.1145/3313831.3376148</a></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=3410e7247b84" width="1" height="1" alt=""><hr><p><a href="https://medium.com/solar-nexus/educational-data-storytelling-how-can-we-communicate-important-insights-into-your-learning-3410e7247b84">Educational data storytelling: How can we communicate important insights into your learning…</a> was originally published in <a href="https://medium.com/solar-nexus">SoLAR Nexus</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Partnering with educators to take advantage of tools that predict student academic performance]]></title>
            <link>https://medium.com/solar-nexus/partnering-with-educators-to-take-advantage-of-tools-that-predict-student-academic-performance-aef05ea35fe5?source=rss-7bc0e8501388------2</link>
            <guid isPermaLink="false">https://medium.com/p/aef05ea35fe5</guid>
            <category><![CDATA[learning-analytics]]></category>
            <category><![CDATA[online-teaching]]></category>
            <category><![CDATA[predictive-analytics]]></category>
            <dc:creator><![CDATA[SoLAR Nexus]]></dc:creator>
            <pubDate>Mon, 23 Aug 2021 02:21:21 GMT</pubDate>
            <atom:updated>2021-08-23T05:27:23.671Z</atom:updated>
            <content:encoded><![CDATA[<p><em>How can we change established ways of teaching to take full advantage of predictive analytics tools? How can we embed innovation in teaching in ways that help teachers acknowledge its value?</em></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*ZvBgTrO2uLhsJeM7w7DeDQ.png" /><figcaption>Photo by <a href="https://unsplash.com/photos/smgTvepind4">Chris Montgomery</a> from Unsplash</figcaption></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/231/1*hhj7VK16sW6cmTsKf0vHbg.jpeg" /></figure><p><strong>Author</strong>: Christothea Herodotou</p><p>Christothea Herodotou is an Associate Professor at the Open University UK with research interests in predictive learning analytics, citizen science, and mobile learning. She led the evaluation of the Early Alert Indicators project that enabled the adoption and use of predictive learning analytics across the Open University.</p><p><a href="https://twitter.com/herodotouc"><strong>Follow Christothea on Twitter</strong></a></p><p>Or email her: christothea.herodotou@open.ac.uk</p><p><strong>Keywords: </strong>Learning Analytics, Online Teaching, Predictive Analytics</p><p><strong>Target readers: </strong>researchers, leaders, educators</p><p>In an earlier <a href="https://www.solaresearch.org/2021/04/predictive-learning-analytics-an-empowering-tool-in-the-hands-of-online-teachers/?utm_source=rss&amp;utm_medium=rss&amp;utm_campaign=predictive-learning-analytics-an-empowering-tool-in-the-hands-of-online-teachers">blog post</a>, I told the story of Emma. Emma was an engineering student who appeared to perform well at her studies, but would have failed due to an upcoming pregnancy. Using predictive analytics, her online teacher identified a problem and intervened in time.</p><p>Emma’s story is far from unique. Over the years, teachers shared stories with me of how a predictive analytics <a href="https://analyse.kmi.open.ac.uk/">system</a> that forecasts their students’ future learning outcomes — in particular whether they are going to submit their next assignment — helped them to stay “on top” of their students. <strong>They gained insights otherwise not accessible to them because their students were studying at a distance.</strong></p><p>Engaging teachers with predictive learning analytics is not straightforward. Some teachers devised their own ways of monitoring students and their progress. For example, by keeping their own records or checking on whether a student has submitted an assignment. Others rely on student support teams to identify and support students at risk of failing.</p><p>Asking teachers to use predictive learning analytics requires a change in teaching practice and more importantly a change in the way of thinking and acting as a teacher.</p><blockquote>How can we change established ways of teaching to take full advantage of predictive analytics tools? How can we embed innovation in teaching in ways that teachers acknowledge its value?</blockquote><p>Stakeholders often resist change. In higher education, researchers attribute resistance to change to factors such as the inertia in established organizational structures and staff with long-lasting positions.</p><p><a href="https://doi.org/10.1016/j.iheduc.2020.100725">Our work</a> at the Open University UK demonstrated that for an innovation to become “business as usual” requires considerable time and effort. <strong>Working with teachers for more than four years, we learnt how to design innovations <em>with</em> teachers.</strong> We learnt what the actions are to make the journey, from introduction to systematic use, a less bumpy one.</p><p>I will share some key lessons we’ve learnt that I hope will help you introduce predictive learning analytics to teachers at your institution.</p><h4><strong>Lesson 1: Make teachers part of the research and design team</strong></h4><p>Inform the teaching community about the upcoming initiative to design and pilot a system that predicts students learning outcomes. A research team should also pay a group of teachers (ideally a group of them coming from different Faculties) to join the research team. They should make clear that the intention is to design a system that responds to teachers’ needs and requirements. The process of design should be participatory in nature; teachers are those who can share insights from the teaching practice and ensure that what is designed responds to their context, acknowledges challenges and functions in ways that can improve the teaching practice.</p><h4><strong>Lesson 2: Produce evidence of whether predictive learning analytics work for teachers and students</strong></h4><p>Evaluate <a href="https://link.springer.com/article/10.1007/s11423-019-09685-0">the impact of using predictive learning analytics on students’ performance</a> and the teaching practice. A research expert can facilitate implementation and data analysis, and sharing findings about the effectiveness of the system. Studies should not only be driven by project objectives, but also inspired by teachers’ reactions to the idea of using a predictive system. For example, one of the studies we conducted <a href="https://bera-journals.onlinelibrary.wiley.com/doi/abs/10.1111/bjet.12853">compared different ways of monitoring students’ progress</a>, in particular predictive analytics to other practices, as a means to respond to teachers’ queries about whether the proposed system is a better way of monitoring students than other practices.</p><h4><strong>Lesson 3: Communicate the unique selling points of predictive learning analytics as…</strong></h4><h4><strong>…a consistent approach to monitoring students</strong></h4><p>The fact that each teacher may have a different way of monitoring students means that some students may have a more supportive teacher than others. For instance, a more proactive teacher may be able to identify and support a student early on. In contrast, a teacher who relies on student support teams may only find out a student was struggling after they fail. A research team should communicate to teachers that predictive learning analytics is a unifying approach to monitoring students to help ensure that all teachers have access to the same type of student information.</p><h4><strong>…a systematic approach to checking on students’ progress</strong></h4><p>Some teachers may be aware of what students are doing and how they are progressing without the use of a system. Yet, there may be unexpected cases of students that may fail if a teacher is not systematic in checking on new predictions when these are produced (in our case once a week). Even a well performing student may be at risk of failing (<a href="https://www.solaresearch.org/2021/04/predictive-learning-analytics-an-empowering-tool-in-the-hands-of-online-teachers/?utm_source=rss&amp;utm_medium=rss&amp;utm_campaign=predictive-learning-analytics-an-empowering-tool-in-the-hands-of-online-teachers">read the story of Emma</a>) when their personal circumstances change. Checking on new predictions can provide insights that a student has not declared, and which a teacher is not aware of.</p><h4><strong>…a call to action rather than a </strong>self-fulfilling prophecy</h4><p>Some teachers may view predictions as a self-fulfilling prophecy, that is, predictions will be confirmed no matter what the teachers’ response to a prediction is. Emphasize to teachers that predictive analytics are a call to action and that they are most likely to become a self-fulfilling prophecy when a teacher <em>fails</em> to take action early on to support and help a student to submit their next assignment.</p><h4><strong>…insights BEFORE a student fails</strong></h4><p>To assess students’ progress, some teachers may rely on whether a student has submitted and passed their first assignment. This is viewed as an indicator of whether a student is doing well. While this may be a good proxy of student progress and performance, this information is available rather late and after a student has already failed their first assignment.</p><p><a href="https://www.tandfonline.com/doi/abs/10.1080/0268051042000177863">Researchers</a> have showed that failing to submit a first assignment is likely to lead to failing the course. Therefore, teachers should have access to information about students before they submit their first assignment. Predictive analytics inform teachers BEFORE an assignment outcome is produced. When teachers check analytics well ahead before the assignment submission deadline, they can allow students time to work towards an upcoming assignment, submit and eventually pass it.</p><p>To sum up, in our experience from four years of embedding predictive analytics in a distance and online university, teachers are most likely to see the value of such tools for their teaching when they are meaningfully involved in the process of designing and piloting such a project, while at the same time important messages are clearly communicated with them.</p><p>Online teaching and learning are of course now the sudden experience of millions of students and teachers due to the pandemic, leaving many teachers feeling like they are “flying blind”, with less insight into how their students are doing.</p><blockquote>Our experiences demonstrate convincingly that “online students” ≠ “invisible students” — in fact, they are digitally more visible — if your institution has built the human-centred analytics ‘glasses’ to see and support them.</blockquote><p>Our experiences also show that this is a learning journey, and I hope that sharing what we’ve learnt helps you map your path. Should you want to find out more recommendations about how to implement predictive learning analytics at your organisation, you may like to <a href="https://learning-analytics.info/index.php/JLA/article/view/5949">read this paper</a>.</p><h4><strong>To learn more…</strong></h4><p>Herodotou, C., Rienties, B., Hlosta, M., Boroowa, A., Mangafa, C., &amp; Zdrahal, Z. (2020). <a href="http://oro.open.ac.uk/68953/">The scalable implementation of predictive learning analytics at a distance learning university: Insights from a longitudinal case study</a>. <em>The Internet and Higher Education</em>, <em>45</em>, 100725.</p><p>Herodotou, C., Hlosta, M., Boroowa, A., Rienties, B., Zdrahal, Z., &amp; Mangafa, C. (2019). <a href="http://oro.open.ac.uk/62192/">Empowering online teachers through predictive learning analytics</a>. <em>British Journal of Educational Technology</em>, <em>50</em>(6), 3064–3079.</p><p>Herodotou, C., Rienties, B., Boroowa, A., Zdrahal, Z., &amp; Hlosta, M. (2019). <a href="https://link.springer.com/article/10.1007/s11423-019-09685-0">A large-scale implementation of predictive learning analytics in higher education: the teachers’ role and perspective</a>. <em>Educational Technology Research and Development</em>, <em>67</em>(5), 1273–1306</p><p>Herodotou, C., Rienties, B., Verdin, B., &amp; Boroowa, A. (2019). <a href="https://learning-analytics.info/index.php/JLA/article/view/5949/7151">Predictive learning analytics ‘at scale’: Guidelines to successful implementation in Higher Education based on the case of the Open University UK</a>. <em>Journal of Learning Analytics</em>, <em>6</em>(1), 85–95.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=aef05ea35fe5" width="1" height="1" alt=""><hr><p><a href="https://medium.com/solar-nexus/partnering-with-educators-to-take-advantage-of-tools-that-predict-student-academic-performance-aef05ea35fe5">Partnering with educators to take advantage of tools that predict student academic performance</a> was originally published in <a href="https://medium.com/solar-nexus">SoLAR Nexus</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Mind the ‘pedagogical gap’ when preparing staff to use learning analytics]]></title>
            <link>https://medium.com/solar-nexus/mind-the-pedagogical-gap-when-preparing-staff-to-use-learning-analytics-48f4ba489aa9?source=rss-7bc0e8501388------2</link>
            <guid isPermaLink="false">https://medium.com/p/48f4ba489aa9</guid>
            <category><![CDATA[pedagogy]]></category>
            <category><![CDATA[professional-development]]></category>
            <category><![CDATA[data-literacy]]></category>
            <category><![CDATA[learning-analytics]]></category>
            <category><![CDATA[dashboard-design]]></category>
            <dc:creator><![CDATA[SoLAR Nexus]]></dc:creator>
            <pubDate>Wed, 16 Jun 2021 02:14:38 GMT</pubDate>
            <atom:updated>2021-06-16T02:15:57.946Z</atom:updated>
            <content:encoded><![CDATA[<p><em>There’s growing evidence that educators benefit from some training in order to make the most of learning analytics dashboards. Linda Corrin shares insights from her extensive experience — and it’s about more than “data literacy”…</em></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*mW3JQzxWqEkZRjPKcwZDNw.jpeg" /><figcaption>Photo by <a href="https://unsplash.com/@brucemars?utm_source=unsplash&amp;utm_medium=referral&amp;utm_content=creditCopyText">bruce mars</a> on <a href="https://unsplash.com/s/photos/confusion?utm_source=unsplash&amp;utm_medium=referral&amp;utm_content=creditCopyText">Unsplash</a></figcaption></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/135/1*1M3mZDwv7J4u5vsg4l0Bsg.jpeg" /></figure><p><strong>Author</strong>: Linda Corrin</p><p><strong>Position</strong>: Director, Learning Transformations Unit and Associate Professor, Learning Analytics at Swinburne University of Technology (Melbourne, Australia)</p><p><a href="https://twitter.com/lindacorrin"><strong>Follow Linda on Twitter</strong></a></p><p><strong>Target readers</strong>: Higher Education Leaders, Learning Analytics Practitioners, Learning Designers, Educators, Researchers</p><p><strong>Keywords</strong>: Learning analytics, professional development, pedagogy, data literacy, dashboard design</p><p>When running workshops on the use of analytics in the University’s learning management system (LMS) I often see educators’ eyes light up when they see brightly coloured graphs and tables of data appear on the screen. They see these data representations as a gateway to previously inaccessible insights into how their students engage with content and learning activities. Interest and motivation to use the analytics is high and they are ready to dive in and learn more.</p><p>Yet, as the workshop progresses it becomes clear that some participants have difficulty interpreting this data in ways that allow them to determine specific actions to take. But why do some struggle to make sense of this student data?</p><p>To take one example, should the educator intervene directly with students the system highlights as struggling, or might a change to the learning design of the course be necessary? Some attribute such dilemmas about how to respond to analytics as a lack of <a href="https://www.gartner.com/smarterwithgartner/a-data-and-analytics-leaders-guide-to-data-literacy/">data literacy</a>, something which is increasingly <a href="https://doi.org/10.1080/13562517.2019.1696301">being discussed</a> in the learning analytics literature.</p><p>But could it also be attributed to a lack of understanding of the pedagogy behind the learning activity? What should we expect the data to show about how students to are engaging in a learning activity? Is there data missing that we need to complete the pedagogical picture?</p><p>In this post, I’ll explore data literacy — but also highlight the element often overlooked in these discussions, that is, the pedagogical gap.</p><h3><strong>The need for professional development for learning analytics</strong></h3><p>From its beginnings, the learning analytics community <a href="https://dl.acm.org/doi/pdf/10.1145/2330601.2330605?casa_token=EaIuBjPrK8gAAAAA:ESLA9pRR834bPtPooIQ_B4-JepSLd1kav0dl7bZNlUnrT_coaBxXHSncUGA5UoCtBqByDh_EnmdP">has acknowledged</a> need for professional development to prepare staff to use learning analytics. In my own research my colleagues and I found it to be <a href="https://www.ascilite.org/conferences/sydney13/program/papers/Corrin.pdf">a key element</a> for successful implementation of learning analytics in universities. However, when scanning the literature on new learning analytics systems or tools, mention of some form of training is often only brief, if included at all. That is not to say that training doesn’t exist — it’s just that we don’t talk about it in as much detail as we do the design and use of the tool itself.</p><p>At a <a href="https://blog.ascilite.org/professional-learning-for-learning-analytics-what-can-we-learn-and-adapt-in-response-to-current-events/">workshop</a> held by the <a href="https://ascilite.org/get-involved/sigs/learning-analytics-sig/">ASCILITE Learning Analytics Special Interest Group</a> in 2019, participants felt that institutions hadn’t invested sufficient time and resources into providing professional development opportunities for educators. They especially wanted to know how to make use of the analytics capabilities in both LMS and custom-built analytics systems. Participants also wanted insights from the learning analytics community about their approaches to professional learning about learning analytics.</p><h3><strong>Is it just about data literacy?</strong></h3><p>No.</p><p>Data literacy is important — it enables the educator to read the data or visualisation. However, for them to be able to choose the right course of action, other knowledge and skills are required.</p><p>For example, recently Gray and colleagues put together a <a href="https://dl.acm.org/doi/fullHtml/10.1145/3448139.3448162">Framework for continuous professional development in learning analytics</a>. In this framework, they highlight skills necessary for educators to (1) <em>know</em> what they can see, (2) <em>use and practice</em> with the data to gain insight on students’ activity<em>, </em>and<em> (3) take action</em>. To do these three things educators need to be data literate, but also have knowledge and skills related to ethics and privacy, generating feedback, and reflection.</p><h3><strong>A strong pedagogical foundation</strong></h3><p>However, many discussions and frameworks on professional development for learning analytics are based on the assumption that educators already have a strong understanding of pedagogical design.</p><p>In my work with educators, I noticed that this foundational pedagogical knowledge is not always there. Consequently, this makes conversations regarding the link between the analytics and the pedagogy difficult.</p><p>Student learning and learning design are complex concepts which require careful study. However, many universities still <a href="https://www.tandfonline.com/doi/pdf/10.1080/07294360.2018.1512955">don’t require staff to complete educational qualifications</a> before they start teaching.</p><p>An understanding of foundational pedagogical concepts and core theories related to student learning can help all stakeholders who make decisions based on learning analytics data. This includes not only the educators, but also learning designers, learning analytics developers, and administrators. This awareness assists in determining different ways the data can be interpreted, and what additional information may be needed to make sense of data in certain contexts.</p><h3><strong>What can we do to address the gap?</strong></h3><p>For educators to be able to make good use of learning analytics we need to ensure that they can make the right connections between what they interpret from the data and actions that can improve learning. Aligning and integrating data literacy with existing pedagogical training is one way to address this pedagogical gap.</p><p>Rather than data literacy being addressed as something separate, integrating it into existing learning and teaching training can help educators better understand the link between their pedagogical design and the patterns of data that result.</p><p>For example, at <a href="http://www.swinburne.edu.au/">Swinburne University of Technology</a>, we incorporate data and visualisations into our professional learning sessions to help introduce pedagogical concepts. In our workshop on designing and facilitating online discussions we start by showing participants different patterns of actual student interaction across a range of different discussion forum designs (using the social network diagrams shown below). With reference to what they observe in these diagrams, we then discuss the underlying principles and impacts that design decisions can have on how students engage with the learning activity.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*c5DSw9oUhnAkSbcxp_sOfA.png" /></figure><p>The exposure to the data visualisation and the in-depth, guided discussion of what this means and how it relates to the learning design helps to bridge the pedagogical gap. This also prepares educators to be able to work with learning analytics data in their own context.</p><p>I also encourage institutions to view these approaches as part of a continuous professional learning plan. Learning analytics, and the field of education more broadly, are constantly evolving — so approaches to professional learning need to reflect that evolution. Building and maintaining communication and collaboration with educators around data literacy and pedagogy is critical to enabling new and innovative learning analytics initiatives to be implemented, shared, and improved over time.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=48f4ba489aa9" width="1" height="1" alt=""><hr><p><a href="https://medium.com/solar-nexus/mind-the-pedagogical-gap-when-preparing-staff-to-use-learning-analytics-48f4ba489aa9">Mind the ‘pedagogical gap’ when preparing staff to use learning analytics</a> was originally published in <a href="https://medium.com/solar-nexus">SoLAR Nexus</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
    </channel>
</rss>