<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0" xmlns:cc="http://cyber.law.harvard.edu/rss/creativeCommonsRssModule.html">
    <channel>
        <title><![CDATA[Knowledge Technologies - Medium]]></title>
        <description><![CDATA[All about organizing data in to enable its discovery and availability. We’re publishing about  knowledge graphs and other related technologies. Brought to you by the Knowledge Graph Conference. - Medium]]></description>
        <link>https://medium.com/knowledge-technologies?source=rss----968434706002---4</link>
        <image>
            <url>https://cdn-images-1.medium.com/proxy/1*TGH72Nnw24QL3iV9IOm4VA.png</url>
            <title>Knowledge Technologies - Medium</title>
            <link>https://medium.com/knowledge-technologies?source=rss----968434706002---4</link>
        </image>
        <generator>Medium</generator>
        <lastBuildDate>Fri, 20 Nov 2026 02:11:27 GMT</lastBuildDate>
        <atom:link href="https://medium.com/feed/knowledge-technologies" rel="self" type="application/rss+xml"/>
        <webMaster><![CDATA[yourfriends@medium.com]]></webMaster>
        <atom:link href="http://medium.superfeedr.com/" rel="hub"/>
        <item>
            <title><![CDATA[Open Knowledge Networks]]></title>
            <link>https://medium.com/knowledge-technologies/open-knowledge-networks-b9631dc1b678?source=rss----968434706002---4</link>
            <guid isPermaLink="false">https://medium.com/p/b9631dc1b678</guid>
            <dc:creator><![CDATA[Kathy Cruz]]></dc:creator>
            <pubDate>Mon, 22 Nov 2021 23:49:45 GMT</pubDate>
            <atom:updated>2021-11-23T16:45:11.124Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*TrVRtAbQPATdic08SQZW1w.png" /></figure><p>Since the beginning of time, humans have always understood the need to share critical information. Communication evolved slowly from images on cave walls to scrolls and paper, and then rapidly in the 20th century with the advent of radio and climaxing with the invention of the internet. This exponential movement of widespread communication has brought humanity to the brink of a new era in information sharing! Imagine making progressive decisions for the earth and society based on a 360-degree kaleidoscope of information from abundant experts with intersecting responsibilities. This idea of forward thinking resolutions is the foundation of Open Knowledge Networks.</p><p>An Open Knowledge Network (OKN) is essentially the cooperative sharing of non-proprietary information between individuals, communities and organizations with the ultimate goal of encouraging collaborative spatial decision making. There are several OKNs that exist today tackling massive environmental and community problems. The National Science Foundation (NSF) has been an instrumental advocate for these platforms.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/979/1*gdqwnDcZyQiAISQnn4-1mQ.png" /></figure><p>With the intent to drive superior solutions to societal challenges, the NSF presented their Convergence Accelerator Program in 2019. As part of this enterprise, the NSF granted $1 million across 10 organizations with the goal to support parties that handle biodiversity, wildfires and water quality. (The recipients of this grant include New Jersey Institute of Technology, Arizona State University, Conservation Biology Institute, Esri, Geodesign Technologies, Mountain View Business Group, Portland State University, University Consortium for Geographic Information Science, and USDA Forest Service.) By driving collaborations between academia, industry, nonprofit organizations and government, the NSF is connecting diverse teams with varied expertise, innovations and technological approaches to steer the development of OKNs and thereby establishing faster and more powerful solutions to mega-societal issues. Experts estimate that this multidisciplinary “team science” approach will not only energize transformative and innovative partnerships, but will expedite research and accelerate significant decisions by years! What would have taken silo-based, basic research 10 years in the past will now achieve superior solutions in as little as two years. What a positively powerful impact to humanity!</p><p>The Convergence Accelerator program centered its mission on driving the collaboration of multidisciplinary groups to support two of the NSF’s 10 Big Ideas: “Harnessing the Data Revolution” (aka developing Open Knowledge Networks) and “Growing Convergence Research” (the unification of ideas and technologies from multifarious experts to inspire unique innovation and scientific breakthroughs.)</p><p>Learn more about <a href="https://www.nsf.gov/news/special_reports/big_ideas/index.jsp">NSF’s 10 Big Ideas</a>.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*Ggk1r7HJ87q1oQus" /></figure><p>See below for three current examples of actively functioning open knowledge networks!</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*AJd6G5ef-S4Mi5d0" /></figure><p><strong>OceanOKN — The Open Knowledge Network to Meet Ocean Decision Challenges</strong></p><p>Sponsored by the National Science Foundation, this network integrates climate, fisheries, ecosystem and socioeconomic data sets with Artificial Intelligence to optimize seafood industry decision making and business strategies. In addition, this effort also tackles other critical maritime issues, such as plans to sustainably harvest resources, preserve gainful fisheries in a fluctuating environment, as well as uphold the resilience of coastal communities.</p><p>Read more on the <a href="https://www.gmri.org/projects/open-knowledge-network-meet-ocean-decision-challenges-oceanokn/">OceanOKN</a>.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/432/0*MsfIgJadTOvwOchY" /></figure><p><strong>EarthCube</strong></p><p>EarthCube is another remarkable example of an open knowledge network. This knowledge management structure organizes massive datasets of information from various geoscientific domains across the globe. The central goal of EarthCube is to support geoscientists in comprehending and forecasting the Earth and its interactive systems. For example, a scientist may be researching climate fluctuations in one area of the globe based on volcanic eruptions that took place in that hemisphere. EarthCube data helps determine the relationship between these facets or if any relationship exists at all! Funded by the National Science Foundation, EarthCube also strives to accelerate Earth system studies, enrich the geoscience research output, drive data-merging across multiple disciplines, and transform geoscience data management and research methodologies. This exceptional example of data sharing is having a prominent impact upon our perception of how the globe functions within the universe!</p><p>Learn more about <a href="https://www.earthcube.org/">EarthCube</a>.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*SV7MvZJApVHkNLOD" /></figure><p><strong>Urban Flooding OKN</strong></p><p>The Urban Flooding Open Knowledge Network uses knowledge graphs based on geospatial datasets and hydrologic models to connect information on high-risk areas, current infrastructure, historical flooding, and much more to mitigate the many devastating effects of floods. This phenomenal OKN answers critical questions, such as which streets and communities are at most risk for flooding, which communities should be evacuated first in the event of extreme weather, and how to architecturally design more floodproof communities. An integral tool for first responders and many metropolitan authorities, the UF-OKN “connects urban information and links it to flood forecasts to deliver actionable information to anyone, anytime, anywhere”.</p><p>Read more about the <a href="https://ufokn.com/">Urban Flooding OKN</a>.</p><p>— — — — — — — — — — — — — — — — — — — — — — — — —</p><h3>KGC Video Library</h3><p>KGC has a collection of more than 100 video presentations with featured speakers from our annual conferences and Knowledge Espresso sessions over the last two years. There are sure to be topics you’ll find interesting and useful. Different subscription levels are available, and you can start off with a free trial. Click <a href="https://knowledgegraphconference.vhx.tv/">here </a>to learn more.</p><p>— — — — — — — — — — — — — — — — — — — — — — — — — —</p><h3><strong>See below for OKN-related talks that happened this year at KGC 2021!</strong></h3><p>The following talks are available on the KGC Video Library, and you can view them with a free trial.</p><p><a href="https://knowledgegraphconference.vhx.tv/videos/chaitan-baru-open-knowledge-network"><strong>Open Knowledge Network</strong></a><strong><br>by Dr. Chaitany Baru, </strong>Senior Science Advisor in the Convergence Accelerator Office.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/199/1*rEpGVaxw05m7NkxOydpC7Q.png" /></figure><p><a href="https://knowledgegraphconference.vhx.tv/videos/sergio-baranzini-spoke-a-biomedical-open-knowledge-graph"><strong>SPOKE: a biomedical open knowledge graph</strong></a><br>by <strong>Sergio E. Baranzini, </strong>Distinguished Professor of Neurology at University of California San Francisco (UCSF).</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/203/0*YjObaoydLxZi9prd" /></figure><p><a href="https://knowledgegraphconference.vhx.tv/videos/krzysztof-janowicz-know-know-where-knowwheregraph"><strong>Know, Know Where, KnowWhereGraph</strong></a><br>by <strong>Krzysztof Janowicz,</strong> professor for Geographic Information Science and Geoinformatics at the Geography Department of the University of California, Santa Barbara, USA.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/190/0*6lkx3gKh3YozRQXl" /></figure><p><a href="https://knowledgegraphconference.vhx.tv/videos/michael-cafarella-infrastructure-for-knowledge-graph-application-programming"><strong>Infrastructure for Knowledge Graph Application Programming</strong></a><br>by <strong>Michael Cafarella. </strong>Mike is<strong> </strong>Principal Research Scientist at MIT CSAIL. His research interests include databases, information extraction, data integration, and knowledge graphs.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/168/1*D8Lov57NyBbbnbTszJnTzw.png" /></figure><p><a href="https://knowledgegraphconference.vhx.tv/videos/peter-rose-integrating-heterogeneous-data-sources-into-a-covid-19-graph"><strong>Integrating Heterogeneous Data Sources into a COVID-19 Knowledge Graph</strong></a><strong> </strong>by <strong>Peter Rose.</strong> Dr. Rose is Director of the Structural Bioinformatics Lab and Lead, Bioinformatics and Biomedical Applications at the San Diego Supercomputer Center (SDSC)/UC San Diego.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/168/1*TNRO7PSmj3aD1aFmFdw9Zg.png" /></figure><p><a href="https://knowledgegraphconference.vhx.tv/kgc-2021/videos/may-6th-t4-okn-panel-discussion-057fe242-0606-4fe2-bae2-114042f6b097"><strong>KGC Panel Discussion on Open Knowledge Networks</strong></a></p><p>— — — — — — — — — — — — — — — — — — — — — — — — —</p><h3>KGC 2022 Call for Presentations</h3><p>For KGC 2022, we will be hosting a hybrid conference experience from May 2–5 using a virtual platform and a physical venue in the heart of New York City. We welcome either virtual presentations or presentations given in person in NYC. Both technical and non technical presentations are welcome. If you’d like to present, click <a href="https://tinyurl.com/24cfsvfj">here</a> for more information.</p><p>— — — — — — — — — — — — — — — — — — — — — — — — — —</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/110/0*OpWa-1X0TgduMRpr.png" /></figure><p><strong>Join our Slack Channels</strong><br><a href="https://tinyurl.com/5fv5kn4s">KGC Community</a><br><a href="https://tech.us5.list-manage.com/track/click?u=91b44d31bcbd7826e5051df37&amp;id=20dd974ad7&amp;e=418ecdc936">KGC Business Partnership</a><br><a href="https://tech.us5.list-manage.com/track/click?u=91b44d31bcbd7826e5051df37&amp;id=dfc4f6c3fb&amp;e=418ecdc936">Knowledge Espresso</a></p><p>— — — — — — — — — — — — — — — — — — — — — — — — — —</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=b9631dc1b678" width="1" height="1" alt=""><hr><p><a href="https://medium.com/knowledge-technologies/open-knowledge-networks-b9631dc1b678">Open Knowledge Networks</a> was originally published in <a href="https://medium.com/knowledge-technologies">Knowledge Technologies</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Graph Thinking]]></title>
            <link>https://medium.com/knowledge-technologies/graph-thinking-5e9c85134ab0?source=rss----968434706002---4</link>
            <guid isPermaLink="false">https://medium.com/p/5e9c85134ab0</guid>
            <category><![CDATA[graph-thinking]]></category>
            <category><![CDATA[data-management]]></category>
            <category><![CDATA[knowledge-graph]]></category>
            <category><![CDATA[artificial-intelligence]]></category>
            <dc:creator><![CDATA[Paco Xander Nathan]]></dc:creator>
            <pubDate>Thu, 05 Aug 2021 20:15:04 GMT</pubDate>
            <atom:updated>2021-08-13T13:24:44.840Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*TrVRtAbQPATdic08SQZW1w.png" /></figure><p>A kind of cognitive framework called <em>graph thinking</em> is circulating through the KGC community. So let’s explore this notion. Also, let’s suspend any discussion about technology, for the moment, and talk about <strong>cognition</strong>. Among the people who use knowledge graphs effectively, how do they conceptualize the problem? Ostensibly, when we consider how we think about problems, machine cognition may be able to help. In other words, which portions of the human cognition involved are likely candidates for AI applications?</p><p>To frame this, let’s look at two precursors for graph thinking. First, <strong>Seymour Papert</strong> first described <em>computational thinking</em> (CT) at MIT in 1980. A more fully developed version is explored in the 2006 article “<a href="https://www.cs.cmu.edu/~15110-s13/Wing06-ct.pdf">Computational Thinking</a>” by <strong>Jeannette Wing</strong>. Wing led a program to leverage this for courses at Carnegie Mellon University, and there are excellent resources at the <a href="http://www.cs.cmu.edu/~CompThink/">CMU Center for Computational Thinking</a>.</p><p>CT provides a structured way of conceptualizing a problem which computing may help to solve. The general approach, in four parts, can be stated as:</p><ol><li><strong>decomposition</strong>: break down a complex problem into smaller solvable problems;</li><li><strong>pattern recognition</strong>: identify when a known approach can be leveraged (e.g., <em>design patterns);</em></li><li><strong>abstraction</strong>: extrapolate from those patterns into generalizations as strategies;</li><li><strong>algorithm design</strong>: articulate strategies as <em>algorithms</em> (i.e., as general recipes for how to handle complex problems).</li></ol><p>In terms of software development, these steps are related to an earlier notion in computer science called <em>stepwise refinement</em>. This can also provide a structured way of developing notes for yourself and your team — which in turn can become the basis for team process, software requirements, and so on.</p><p>Second, let’s consider the notion of <em>statistical thinking, </em>which <strong>Russ Poldrack</strong> at Stanford explores in <a href="https://statsthinking21.org/"><em>Statistical Thinking for the 21st Century</em></a>:</p><blockquote>a way of understanding a complex world by describing it in relatively simple terms that nonetheless capture essential aspects of its structure, and that also provide us some idea of how uncertain we are about our knowledge</blockquote><p>A central tenet of statistics is that systems involve interconnected processes and variation exists in all processes. In other words, real-world processes are probabilistic. To make effective decisions, we should design a methodology to collect meaningful data and analyze it, so we can quantify the observed variation. We must first understand the variance in the data before we can determine how and when we can draw valid inferences from it. This often occurs in contexts where human intuition tends to fail.</p><p>Taking both <em>computational thinking</em> and <em>statistical thinking </em>together, we have means of approaching complex problems — while embracing and leveraging <em>uncertainty</em> — and then apply computing resources for <em>analysis</em> and <em>inference</em> to find solutions, help make decisions, etc. Another notion — closely related to this combo — is <a href="https://en.wikipedia.org/wiki/Systems_theory#Systems_thinking"><em>systems thinking</em></a>. Great, but how does all this apply for graph technologies?</p><p>Two of our speakers from <a href="https://knowledgegraphconference.vhx.tv/products/kgc-2021">Knowledge Graph Conference (KGC) 2021</a>, <strong>Denise Gosnell</strong> and <strong>Matthias Broecheler,</strong> recently published <a href="https://www.goodreads.com/book/show/50204616"><em>The Practitioner’s Guide to Graph Data</em></a>. Check out their first chapter, titled “<a href="https://www.oreilly.com/library/view/the-practitioners-guide/9781492044062/ch01.html#ch1">Graph Thinking</a>,” which they define as:</p><blockquote>understanding a problem domain as an interconnected graph and using graph techniques to describe domain dynamics in an effort to solve domain problems</blockquote><p>Denise and Matthias also explore a history of <em>data management </em>approaches through the decades, evolving toward the contemporary use of graph technologies. A recurring theme within their text is about the need to solve <em>complex</em> problems.</p><p>Another KGC 2021 speaker, <strong>Dan McCreary</strong> wrote an article last year about graph thinking in the context of <em>systems thinking</em>: “<a href="https://dmccreary.medium.com/the-god-graph-d382525ba0ae">The God Graph</a>.” Dan also led the KGC workshop “<a href="https://knowledgegraphconference.vhx.tv/packages/kgc-2021/videos/may-4th-t4-how-graphs-improve-systems-thinking-2594cd05-606d-4ee3-8029-0eb7aecd798a">How Graphs Improve Systems Thinking</a>.” Again, the central theme is about understanding a complex system by representing the relations among its component parts.</p><p><strong>Andreas Kollegger</strong> from neo4j also explored this theme in the 2016 talk “<a href="https://www.slideshare.net/neo4j/graph-thinking-why-it-matters">Graph Thinking: Why it Matters</a>.” This provides several deep-dives into the business use cases for graph databases.</p><p>More recently, <strong>Jürgen Müller</strong> at BASF and I have been talking about <em>graph thinking</em> as a way to bring business stakeholders into this discussion about leveraging graphs. An article called “<a href="https://medium.com/derwen/sense-and-scalability-4d474dd0661c">Sense and Scalability</a>” captures some of what Jürgen and I have been using to these ends. We explore some of the foundations of how people and organizations understand complex systems in the face of uncertainty. In other words, how do individuals and teams <em>learn</em> when confronted with a complex, unknown situation?</p><p>A good starting point is <a href="https://derwen.ai/s/s8kgr56cycsp"><em>How Learning Works</em></a> by <strong>Susan Ambrose</strong>, et al., — quite literally, an exploration of the learning theory that describes how people acquire expertise. It’s quite interesting to see how human cognition typically develops as people progress from <em>novice </em>to <em>expert </em>in a particular subject. This is effectively about how people organize knowledge.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/452/0*Hy_GpwTwT5JeGBTU" /><figcaption>Ambrose: knowledge organization by level of expertise</figcaption></figure><p>Novices tend to start out by memorizing an unconnected set of simple facts. As they become more adept in a subject, these facts become increasingly connected into more structured cognition. At an expert stage, people typically connect these kinds of cognitive structures into <em>graphs</em>. This is especially the case when the experts must understand how to contend with nuances, uncertainty and exceptions to the rules. For sense-making, experts leverage emergent patterns within graph structures.</p><p>This is what cognitive psychology plus studies in pedagogy tell us about human cognition — “<a href="https://www.theatlantic.com/magazine/archive/1945/07/as-we-may-think/303881/">As we may think</a>,” so to speak. No technology is involved per se. Even so, consider the key phrases used here: <em>complex systems</em>, <em>uncertainty</em>, <em>patterns</em>, <em>graphs</em>, etc. Do these sound a wee bit familiar? Yes, quite. Graph technologies are an embodiment of what Ambrose, et al., present, with the added benefit of being something that both people and machines can leverage. It’s no coincidence that artificial intelligence has mimicked this approach of the more organic intelligence.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/814/1*OyyLdlsLRJPKv4g2yi1B_g.png" /></figure><p>Of course, that kind of argument may be fine to use when one has the luxury of 1,000 words, plus a dozen or so primary sources. However, when engaging stakeholders, one must obey the discipline of an “executive overview” at its distillate level — which Jürgen and I attempt to present in “The Village” (<a href="https://youtu.be/WhSGqIX3LQM?t=742">video</a>) (<a href="https://derwen.ai/s/kcgh#21">slides</a>).</p><p>It’s something to think about.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/973/1*zWr_2o4HDC5G_v6IgT71bA.png" /></figure><p>Over the next several months, leading up to KGC 2022, we’ll be exploring this notion of <em>graph thinking</em> and how this gets applied in business. In particular, we’ll be talking with people in industry who are leading large graph practices to find out more about how their teams <em>think</em> about business problems that can be solved by leveraging graphs.</p><p>— — — — — — — — — — — — — — — — — — — — — — — — — —</p><h3>What’s on Your Mind?</h3><p>KGC is interested in knowing how we can serve our community better. Please take our survey and tell us what you liked (or didn’t) about KGC’s offerings and events over the last year, and what features you’d like to see in the future. Click <a href="https://kgconf.typeform.com/to/RfJC1uUS">here </a>for our survey. Thanks in advance!</p><p>— — — — — — — — — — — — — — — — — — — — — — — — — —</p><h3>KGC Video Library</h3><p>KGC has a collection of more than 100 video presentations with featured speakers from our annual conferences and Knowledge Espresso sessions over the last two years. There are sure to be topics you’ll find interesting and useful. Different subscription levels are available, and you can start off with a free trial. Click <a href="https://knowledgegraphconference.vhx.tv/">here </a>to learn more.</p><p>— — — — — — — — — — — — — — — — — — — — — — — — — —</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/110/1*_yXx7PBeItJI9TzgN4TbGA.png" /></figure><p><strong>Join our Slack Channels</strong><br><a href="https://tinyurl.com/5fv5kn4s">KGC Community</a><br><a href="https://tech.us5.list-manage.com/track/click?u=91b44d31bcbd7826e5051df37&amp;id=20dd974ad7&amp;e=418ecdc936">KGC Business Partnership</a><br><a href="https://tech.us5.list-manage.com/track/click?u=91b44d31bcbd7826e5051df37&amp;id=dfc4f6c3fb&amp;e=418ecdc936">Knowledge Espresso</a></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=5e9c85134ab0" width="1" height="1" alt=""><hr><p><a href="https://medium.com/knowledge-technologies/graph-thinking-5e9c85134ab0">Graph Thinking</a> was originally published in <a href="https://medium.com/knowledge-technologies">Knowledge Technologies</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[2021 Knowledge Graph Conference Recap]]></title>
            <link>https://medium.com/knowledge-technologies/2021-knowledge-graph-conference-recap-16a28bdd7c6?source=rss----968434706002---4</link>
            <guid isPermaLink="false">https://medium.com/p/16a28bdd7c6</guid>
            <category><![CDATA[ai]]></category>
            <category><![CDATA[surveys]]></category>
            <category><![CDATA[data-mesh]]></category>
            <category><![CDATA[knowledge-graph]]></category>
            <category><![CDATA[conference]]></category>
            <dc:creator><![CDATA[Paco Xander Nathan]]></dc:creator>
            <pubDate>Thu, 01 Jul 2021 19:50:44 GMT</pubDate>
            <atom:updated>2021-07-12T19:25:11.017Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*TrVRtAbQPATdic08SQZW1w.png" /></figure><p>The <a href="https://knowledgegraphconference.vhx.tv/products/kgc-2021">2021 Knowledge Graph Conference</a>, held online May 3–6, had over 1,000 people attending. Special thanks to all of the 20+ people who <a href="https://www.knowledgegraph.tech/about">volunteered</a> to assist with the conference!</p><p>We have the results from an <a href="https://kgconf.typeform.com/report/oHKlsR0p/EUiNwc3cFtCX0r8L">audience poll</a> about which parts they liked best, and also from an informal poll among the people who helped organize <a href="https://www.knowledgegraph.tech/#program">events</a>. There are recordings for every tutorial, keynote, session talk, panel, etc. — resulting in 100 hours of videos. That’s a lot of content, and so far we really don’t know of anyone who’s been through the whole collection…<a href="https://knowledgegraphconference.vhx.tv/"> https://knowledgegraphconference.vhx.tv/</a> Here’s your opportunity to become the first person to view THE ENTIRETY of KGC 2021. 😍 In any case, we’ll summarize a few of the highlights here, with pointers to the whole catalog. <strong>Tiernan Ray</strong> described the conference in ZDnet, <a href="https://www.zdnet.com/article/the-knowledge-graph-expands-as-disciplines-conference-spreads-its-wings/">“The Knowledge Graph expands as discipline’s conference spreads its wings”</a>:</p><blockquote>“What began in 2019 as a two-day gathering in a ballroom has turned into a global event for those in love with graphing relationships.”</blockquote><p>Hands down, the top pick was the keynote talk <a href="https://knowledgegraphconference.vhx.tv/packages/kgc-2021/videos/may-6th-from-network-medicine-to-food-and-knowledge-graphs-70caf844-3bda-4bf5-b405-5ff27f179109">“From Network Medicine to Food and Knowledge Graphs”</a> by <strong>Albert-László Barabási</strong>, who also received the<a href="https://twitter.com/barabasi/status/1391311219471044609"> KGC 2021 Award</a> for contributions to the field of <em>Network Science</em>. His tour-de-force keynote reviewed the <a href="https://foodome.co/">Foodome</a> project, a research collaboration across Harvard, Northeastern, Boston University, and other institutions to solve cross-disciplinary problems. For example, the USDA only tracks 150 key nutritional components, while there are more than 26,000 distinct, definable biochemicals present in our food sources. To address that, Foodome uses a large KG to map foods to ingredients and their chemical composition, plus linking to known interactions among proteins for both gut biome and human biome. Many of the “lesser” nutritional components — i.e., mostly ignored by USDA and others — have been shown to interact in significant pathways that lead to diseases. Foodome has pioneered “network medicine” where graph technology predicts novel biochemical pathways that are subsequently confirmed through laboratory work. Related KG approaches to drive life science experimentation are employed in other areas of Pharma research, such as drug discovery — for instance <a href="https://neo4j.com/blog/connecting-dots-in-early-drug-discovery-at-novartis/">“Connecting the Dots in Early Drug Discovery at Novartis”</a> by <strong>Stephan Reiling</strong> at GraphConnect 2018, and overall KG adoption is growing in this business vertical. For more details about the Foodome project, see their <em>Nature </em>paper:</p><p><a href="https://www.nature.com/articles/s43016-019-0005-1">“The unmapped chemical complexity of our diet”</a><br>Albert-László Barabási, Giulia Menichetti , Joseph Loscalzo<br><a href="https://www.nature.com/natfood"><em>Nature Food</em></a> <strong>1</strong>, 33–37 (2020)<br>open access:<a href="https://barabasi.com/f/1055.pdf"> https://barabasi.com/f/1055.pdf</a></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/667/0*SU6VZavLw1Npci89" /><figcaption><strong>Allison DeLozier, </strong><a href="https://thesketcheffect.com/"><strong>The Sketch Effect</strong></a></figcaption></figure><p>Another popular keynote by <strong>Zhamak Dehghani</strong> of ThoughtWorks presented<a href="https://knowledgegraphconference.vhx.tv/kgc-subscription/videos/may-6th-introduction-to-data-mesh-a-paradigm-shift-in-managing-analytical-data-03251231-320f-4560-9d4c-ef0eb34c8871"> “Introduction to Data Mesh: A paradigm shift in managing analytical data”</a>. Zhamak founded the concept of <a href="https://launchpass.com/data-mesh-learning">Data Mesh</a> in 2018 — a paradigm shift in big data management toward data decentralization, which has gained remarkable popularity. Think: service mesh is to microservices as data mesh is to distributed data assets, and both have much bearing on business culture. The interaction of knowledge graph and data mesh in contemporary data architectures has been trending as one of our more popular discussion topics.</p><p>Later in the same day, another top pick was the <a href="https://knowledgegraphconference.vhx.tv/packages/kgc-2021/videos/may-6th-t1-panel-discussion-on-data-architecture-af2c8121-e194-4b5f-a688-e26a26d17d8f-1">“Panel Discussion on Data Architecture,</a>” led by data.world Principal Scientist and KGC co-chair <strong>Juan Sequeda</strong>, along with <strong>Zhamak Dehghani</strong>, <strong>Teresa Tung</strong> from Accenture, and <strong>Jay Yu</strong> from Intuit.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/667/0*KRkHc3XFO17Ph4oA" /><figcaption><strong>Allison DeLozier, </strong><a href="https://thesketcheffect.com/"><strong>The Sketch Effect</strong></a></figcaption></figure><p>Among other top picks, without question, we had a rather impromptu — albeit highly anticipated and utterly fascinating — <a href="https://deelythomas.medium.com/collective-intelligence-at-the-knowledge-graph-conference-6de36eb84e01">lounge table discussion</a> with <strong>Conor White-Sullivan</strong>, founder of<a href="https://roamresearch.com/"> Roam Research</a>. For the full deets, see <a href="https://deelythomas.medium.com/collective-intelligence-at-the-knowledge-graph-conference-6de36eb84e01">“Collective Intelligence at the Knowledge Graph Conference”</a> by <strong>Thomas Deely</strong>. As some have noted, this far-reaching discussion included multiple invocations of computing pioneer <a href="https://www.dougengelbart.org/content/view/88/45/"><strong>Doug Engelbart</strong></a>. If you haven’t seen it before, please go check out the 1968 “<a href="https://youtu.be/B6rKUf9DWRI">Mother of All Demos</a>,” which invented desktop computing, previewed the Internet, and so much more — all in one concise demo. For a brillant <strong>James Burke</strong>-esque backstory, see <strong>Mark Pesce</strong>’s <a href="https://nextbillionseconds.com/2018/12/07/1968-when-the-world-began-the-mother-of-all-demos/">“1968: When the World Began”</a> podcast interview series. Then check out <a href="https://roamresearch.com/">Roam</a> for an astounding “How it started / How it’s going” comparison. One favorite line from Conor’s lounge table discussion:</p><blockquote>“We are the DVD mailing stage of this…”</blockquote><p>A fifth highlight for this newsletter edition is to recommend the new <a href="https://zenodo.org/record/4912131#.YM7rdZNKjly"><em>2021 Knowledge Graph Industry Survey</em></a>, an examination of the practices and priorities driving knowledge technology. The report authors — <strong>Michael Atkin</strong>, <strong>Thomas Deely</strong>, <strong>François Scharffe</strong> — presented an <a href="https://knowledgegraphconference.vhx.tv/packages/kgc-2021/videos/kg-industry-survey">overview of the survey results</a>, and you can download the full report from Zenodo at <a href="https://zenodo.org/record/4950097#.YOiCS-jYpPY">https://zenodo.org/record/4950097#.YOiCS-jYpPY</a><a href="https://doi.org/10.5281/zenodo.4912131"> </a>(yes, we use persistent identifiers!). This survey provides key insights about knowledge graph adoption in industry: drivers, growth inhibitors, use cases, primary executive sponsors, success criteria, and so on. In particular, results from the KG maturity section provide an especially helpful “instrument” for comparing the stage of any given KG practice with the industry in general. Look for the <em>Four Key Takeaways</em> as you’re preparing your BoD-level proposal for FY2022 funding!</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/667/0*OjzrQlfHe5ME4R4r" /><figcaption><strong>Allison DeLozier, </strong><a href="https://thesketcheffect.com/"><strong>The Sketch Effect</strong></a></figcaption></figure><p>Other prizes were awarded this year at the <a href="https://knowledgegraphconference.vhx.tv/packages/kgc-2021/videos/may-3rd-t3-startup-pitch-event-dde81e75-4700-45af-b40e-0bd7bfdf095f">Startup Pitch Event</a>. Check out this video for a showcase of new ventures in the graph space. Congratulations to each team participating, and especially to our award winners:</p><ul><li><a href="https://the-qa-company.com/">QA Company</a> — for the investor prize</li><li><a href="https://www.perfect-memory.com/">Perfect Memory</a> — for the public prize</li></ul><p>There are also some editorial clips from the conference, if you’d like to check these: <strong>Ching-Hua Chen</strong>’s <a href="https://knowledgegraphconf.slack.com/files/U012SSCRL2X/F020Q9P6V8X/closing_summary_phkg_workshop.mp4">summary</a> of the Personal Healthcare Knowledge Graph workshop, <strong>Mike Welch</strong> from Verizon <a href="https://vimeo.com/564375714">discussing AWS Neptune</a>, and <strong>Alan Morrison</strong>’s <a href="https://vimeo.com/552159546">workgroup on Personal Knowledge Graph</a>.</p><p>So many kudos are so well deserved, although we want to show heartfelt appreciation to <strong>Ellie Young</strong> and the leadership team for organizing, above and beyond the call of duty. Also to <strong>Larry Swanson</strong> for hosting the community networking events on <a href="https://ohyay.co/">Ohyay</a>, plus the nearly unimaginable — albeit dearly unforgettable — online <em>Presentation Karaoke</em> event. Life will never quite be the same, although the video proof seems to be mysteriously missing from the archives 🤔</p><p>Many thanks to our <a href="https://www.knowledgegraph.tech/#partners">sponsors</a>:</p><ul><li>Lead Partner: <strong>Accenture</strong></li><li>Diamond: <strong>Katana Graph</strong></li><li>Platinum: <strong>Cambridge Semantics</strong></li><li>Gold: <strong>Lymba</strong>, <strong>DataStax</strong>, <strong>Origin Trail</strong>, <strong>Brighthive</strong>, <strong>Ontotext</strong>, <strong>Oracle</strong>, <strong>Semantic Web/PoolParty</strong></li><li>Silver: <strong>Fluree</strong>, <strong>relationalAI</strong>, <strong>Amazon Neptune</strong>, <strong>data.world</strong>, <strong>Stardog</strong>, <strong>Franz</strong></li><li>Bronze: <strong>Enterprise Knowledge Graph Foundation (EKGF)</strong>, <strong>TerminusDB</strong>, <strong>Derwen.ai</strong></li><li>Founding Partners: <strong>TigerGraph</strong>, <strong>Collibra</strong>, <strong>Ontotext</strong></li></ul><p>— — — — — — — — — — — — — — — — — — — — — — — — — —</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/110/1*_yXx7PBeItJI9TzgN4TbGA.png" /></figure><p><strong>Join our Slack Channels</strong><br><a href="https://tinyurl.com/5fv5kn4s">KGC Community</a><br><a href="https://tech.us5.list-manage.com/track/click?u=91b44d31bcbd7826e5051df37&amp;id=20dd974ad7&amp;e=418ecdc936">KGC Business Partnership</a><br><a href="https://tech.us5.list-manage.com/track/click?u=91b44d31bcbd7826e5051df37&amp;id=dfc4f6c3fb&amp;e=418ecdc936">Knowledge Espresso</a></p><p>— — — — — — — — — — — — — — — — — — — — — — — — — —</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=16a28bdd7c6" width="1" height="1" alt=""><hr><p><a href="https://medium.com/knowledge-technologies/2021-knowledge-graph-conference-recap-16a28bdd7c6">2021 Knowledge Graph Conference Recap</a> was originally published in <a href="https://medium.com/knowledge-technologies">Knowledge Technologies</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Review: Metadata Day 2020]]></title>
            <link>https://medium.com/knowledge-technologies/review-metadata-day-2020-e38c28c4cf1a?source=rss----968434706002---4</link>
            <guid isPermaLink="false">https://medium.com/p/e38c28c4cf1a</guid>
            <category><![CDATA[knowledge-graph]]></category>
            <category><![CDATA[data-governance]]></category>
            <category><![CDATA[open-source]]></category>
            <category><![CDATA[metadata-management]]></category>
            <dc:creator><![CDATA[Paco Xander Nathan]]></dc:creator>
            <pubDate>Thu, 28 Jan 2021 21:23:33 GMT</pubDate>
            <atom:updated>2021-02-03T19:49:21.440Z</atom:updated>
            <content:encoded><![CDATA[<p>For a full day on December 14, 2020, LinkedIn sponsored a virtual workshop called Metadata Day, followed by a public online meetup called Metaspeak. View <a href="https://metadataday2020.splashthat.com/">videos of the event</a> on their website including a set of lightning talks provided by several of the speakers.</p><p>The gist is that circa 2018, the pending regulatory compliance for GDPR, CCPA, etc., drove urgency in enterprise organizations to have a better understanding and accountability about datasets and their use cases. Several firms, about a dozen, responded in strikingly similar ways — which signals that a kind of “design pattern” is emerging for how to handle these compliance challenges. Given how the datasets in question are connected to one or more use cases, and how each use case requires use of one or more datasets to train machine learning models, when auditors begin asking difficult questions about data provenance, the answers usually require graph-based approaches.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*XVT8cuI5wXIsBYkh" /></figure><p>Of course, <em>data governance</em> is not a new topic — it’s been around for decades. Good products exist for managing data catalogs, tracking lineage/provenance, and so on. What changed was (1) urgency since 2018; and (2) a crucial role of graphs for understanding metadata. How are <em>connected datasets</em> getting used? Which team is responsible for producing and updating each dataset? Who manages the metadata? What customer products rely on a given dataset?</p><p>A 2017 paper out of UC Berkeley’s <a href="https://rise.cs.berkeley.edu/">RISELab</a> has explored these questions formally, <a href="https://rise.cs.berkeley.edu/wp-content/uploads/2017/03/CIDR17.pdf">“Ground: A Data Context Service”</a> by <a href="https://twitter.com/joe_hellerstein">Joseph M. Hellerstein</a>, <a href="https://twitter.com/shirshanka">Shirshanka Das</a>, et al., CIDR ’17, which predicted the needs of what the industry would begin to recognize the following year. Shirshanka (co-organizer Metadata Day 2020) as chief architect of Data at LinkedIn led the metadata strategy for LinkedIn to drive data discovery and compliance. In the article “<a href="https://engineering.linkedin.com/blog/2020/datahub-popular-metadata-architectures-explained">DataHub: Popular metadata architectures explained</a>” he describes the evolution of frameworks for this kind of use case, particularly regarding the <a href="https://datahub.io/">DataHub</a> platform developed at LinkedIn. Early solutions for data catalog involved relatively static, represented by database tables. A second generation followed that, providing metadata API services. However, more contemporary needs in enterprise (since GDPR, etc.) demand graph-based solutions.</p><p><a href="https://twitter.com/mark_grover">Mark Grover</a> held a similar role at Lyft, as product manager for the <a href="https://www.amundsen.io/">Amundsen</a> project, coordinating their solutions for GDPR compliance needs. In the article <a href="https://mark-grover.medium.com/production-consumption-gap-75080253244f">“The data production-consumption gap”</a>, Mark describes how Lyft recognized this as an organizational problem — where understanding enterprise use of connected datasets requires much more than a data catalog. There’s an inherent producer/consumer problem where HR data about the organization is needed (“Who’s responsible for curating XYZ?”) as well as data from operations and other departments. Graph-based representation allowed Lyft to collect and integrate metadata at a layer above the typical departmental data silos. Coupled with discovery and search UX, the experiences with Amundsen led to a stark discovery: “Over 30% of analyst time was wasted in finding and validating trusted data.” Lyft has 250 data analysts, so their 30% overhead translates to roughly $20M/year. Given this new “360 view” of their data assets, they also began to discover relations among their connected datasets that could open new business opportunities. Two major enterprise costs — compliance as a risk and the overhead of impedance across teams — were converted into business upside. Thirty firms now use the Amundsen platform, including ING Bank, Square, Instacart, Workday, Edmunds, etc. Mark also presented in the session <a href="https://www.knowledgeconnexions.world/talks/from-discovering-data-to-trusting-data/">“From discovering data to trusting data”</a> at Knowledge Connexions.</p><p>Approximately a dozen tech companies reached similar realizations about GDPR-era data context and graph-based metadata approaches: LinkedIn, Lyft, Netflix, Airbnb, Uber, PayPal, and so on. Most of these efforts resulted in open source projects. <a href="https://twitter.com/eugeneyan">Eugene Yan</a> authored an excellent survey article <a href="https://eugeneyan.com/writing/data-discovery-platforms/">“Data Discovery Platforms and Their Open Source Solutions”</a> to compare/contrast these projects. The common ground is that these projects tend to combine graph-based overlays atop organizational data silos, along with serious investments in UX work, to provide local search plus recommender systems. This design affords <em>understanding</em> and <em>trust</em> about connected datasets, their use cases, and also about the relationships within an organization — since one lesson learned is that root problems in this area often require executives to intercede.</p><p>Another key observation: three tech start-ups have recently spun out based on this new category of data context, with these use cases and open source projects as a core: <a href="https://stemma.ai/">Stemma</a>, <a href="https://metaphor.io/">Metaphor Data</a>, and one other to be announced. Venture capital investors describe this kind of situation in terms of <a href="https://mashable.com/2015/02/04/category-defining-company/">category-defining</a> companies. In other words, as certain start-ups begin to reshape the industry, equity growth typically follows.</p><p>Recognizing that an industry “moment” was in progress, LinkedIn organized the Metadata Day event to pull together the people leading these projects. The event was structured in two parts. First, an invitation-only virtual workshop (Foo Camp style) which split into one track for the systems implementations (i.e., issues about production and scale) and another track for articulating use case issues (i.e., expertise about metadata and knowledge graphs). The latter track included: Joe Hellerstein; <a href="https://scholar.google.com/citations?user=FE08ALAAAAAJ&amp;hl=en">Natasha Noy</a> (Google) and <a href="https://scholar.google.com/citations?user=PLJ0L4QAAAAJ&amp;hl=en">Deborah McGuinness</a> (RPI) who co-authored the famous <a href="http://www-ksl.stanford.edu/people/dlm/papers/ontology-tutorial-noy-mcguinness-abstract.html">“Ontology 101”</a> paper while at Stanford; data governance pioneer <a href="https://twitter.com/satyx">Satyen Sangani</a> from Alation; <a href="https://twitter.com/AxSaucedo">Alejandro Saucedo</a> from Seldon, plus metadata experts <a href="https://twitter.com/DaniLowenberg">Daniella Lowenberg</a> (UC), <a href="https://metadatagamechangers.com/">Ted Habermann</a> (Metadata Game Changers), <a href="https://twitter.com/IanMulvany">Ian Mulvany</a> (BMJ). The workshop track discussions worked to articulate key points about their practices, quickly assembled into slide decks. Then the tracks reconvened to compare notes.</p><p>The second part of the Metadata Day event was a public meetup online, introduced with a keynote talk by LinkedIn CDO <a href="https://www.linkedin.com/in/igorperisic/">Igor Perisic</a>. Both tracks presented their slide decks as panel discussions, open to much audience Q&amp;A. The full video is at <a href="https://youtu.be/LS2LxEsj-94">https://youtu.be/LS2LxEsj-94</a></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*4jFLssqgFTwas4XI" /></figure><p>One of the quintessential insights out of Metadata Day was articulated by Natasha Noy during our discussion about “What is a knowledge graph?” Natasha described how Google’s Knowledge Graph project, while it has well-known use within the search engine results, also fulfills another crucial purpose to help cohere Google’s data context across many different data silos. To paraphrase Natasha, there was a realization that no “one data framework to rule them all” would ever happen, and instead it was important to decentralize services for translating schema and identifiers (e.g., “foreign keys”) across different data frameworks, allowing many teams to work independently on the kinds of producer/consumer challenges described above by LinkedIn and Lyft.</p><p>To be fair, this is certainly not a “solved problem”, nor are graph-based methods a panacea for resolving tech debt and cross-team impedance in enterprise IT. The challenges of data silos and enabling cross-team collaboration are <em>organizational problems</em> at their core which require Leadership to resolve. These data context platforms introduce open source solutions and related practices which can help greatly, when the corporate leadership and will to resolve is there first. Graph-based approaches are not a magic solution, though they are proving to be the more effective approach.</p><p>Also recognize that using knowledge graphs about metadata as an “overlay” to make an organization’s data silos <em>cohere</em> is not specific to Google — we’re hearing about this kind of practice across many enterprise organizations. Mainstream IT may not be referring to these kinds of practices as knowledge graphs — not yet, at least if one listens to Gartner Research and their “Hype Cycle”. However, the reality on the ground which Metadata Day proves is that Silicon Valley is driving and recognizing a category-defining moment.</p><p>From within the KGC community, there are two related articles:</p><ul><li><a href="https://medium.com/derwen/metaspeak-meetup-dec-14-2020-220b7af5e4cc">”Introduction to Metadata Day”</a> by <a href="https://derwen.ai/paco">Paco Nathan</a> (before the event)</li><li><a href="https://guitton.co/posts/dbt-search/">“Rethinking the search over your dbt models”</a> by <a href="https://twitter.com/louis_guitton">Louis Guitton</a> (reviewing the event)</li></ul><p>Also check out the closely related article:</p><ul><li><a href="https://gradientflow.com/the-growing-importance-of-metadata-management-systems/">“The Growing Importance of Metadata Management Systems”</a> by <a href="https://twitter.com/bigdata">Ben Lorica</a> (Gradient Flow) and <a href="https://twitter.com/bigdata_ml">Assaf Araki</a> (Intel Capital)</li></ul><p>To add more context, there have also been notable, long-term efforts in research towards similar ends which focused on delivering research results along the code and data required to <em>reproduce</em> them. That’s the academic research analog for what data science teams perform in industry. Notably, <a href="https://www.research.manchester.ac.uk/portal/carole.goble.html">Carole Goble</a> and colleagues at University of Manchester have pushed toward better tooling and practices for data context in the sciences, over the past two decades — e.g., the <a href="https://www.research.manchester.ac.uk/portal/en/publications/towards-fair-principles-forresearchsoftware(0bea2ca4-c609-48a0-8c13-3a52ce174880).html">FAIR Guiding Principles</a> for data governance. Their work has been foundational for semantic technologies. Another good example is the work by <a href="https://www.janelia.org/freeman-lab">Jeremy Freeman</a> at HHMI Janelia and their <a href="http://codeneuro.org/">CodeNeuro</a>, weaving a web of open source support for understanding and leveraging connected datasets in neuroscience worldwide. Project Jupyter’s <a href="https://binderhub.readthedocs.io/en/latest/">Binder</a> was a direct result. Part of Metadata Day’s pretext was to bring experts from the academic side who’ve had decades of work in metadata management and connected datasets, together with open source project leads from leading tech firms, to find and articulate common ground to help guide other organizations.</p><p>One thing to watch: as more companies turn to graph-based solutions for their data context, i.e., addressing their needs to understand and trust metadata about connected datasets, that creates pervasive opportunities for <em>leveraging</em> this new category of graph data with even more sophisticated graph-based approaches. Most of the solutions mentioned above are relatively light in terms of leveraging semantic technologies, inference, graph embedding, advanced approaches for interactive graph visualization at scale, etc. That absence was quite apparent from Metadata Day discussions on the “production” side.</p><p>One wonders what will happen when the new graph acolytes in Silicon Valley — and the many enterprise firms who follow their lead and adopt their open source frameworks — begin to discover KGE, UMAP, SHACL, PSL, and so on. Considering the point by Natasha Noy at Google, the foundations for knowledge graph work are becoming widespread across enterprise IT; this new abstraction layer of discovery and trust, driven by regulatory compliance, may catalyze industry adoption of enterprise knowledge graphs. And that practice may happen years before Gartner Research decides to give it a name 😀</p><p>###</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=e38c28c4cf1a" width="1" height="1" alt=""><hr><p><a href="https://medium.com/knowledge-technologies/review-metadata-day-2020-e38c28c4cf1a">Review: Metadata Day 2020</a> was originally published in <a href="https://medium.com/knowledge-technologies">Knowledge Technologies</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Metaspeak Meetup, Dec 14 2020]]></title>
            <link>https://medium.com/knowledge-technologies/metaspeak-meetup-dec-14-2020-220b7af5e4cc?source=rss----968434706002---4</link>
            <guid isPermaLink="false">https://medium.com/p/220b7af5e4cc</guid>
            <category><![CDATA[open-source]]></category>
            <category><![CDATA[data-science]]></category>
            <category><![CDATA[knowledge-graph]]></category>
            <category><![CDATA[dataset]]></category>
            <category><![CDATA[metadata]]></category>
            <dc:creator><![CDATA[Paco Xander Nathan]]></dc:creator>
            <pubDate>Tue, 26 Jan 2021 00:35:50 GMT</pubDate>
            <atom:updated>2020-12-01T05:14:54.169Z</atom:updated>
            <content:encoded><![CDATA[<p>Registration is open for the <strong>Metaspeak Meetup</strong> (a free online event) on December 14, 2020, hosted by LinkedIn <a href="https://metadataday2020.splashthat.com/">https://metadataday2020.splashthat.com/</a></p><p>This is the public portion of the <strong>Metadata Day 2020</strong> workshop, which convenes leaders from several open source projects for <em>graph-based dataset metadata management</em>, along with thought leaders in metadata management and dataset governance from Google, IBM, UC Berkeley, etc.</p><p><strong>Igor Perisic</strong>, CDO @ LinkedIn, will present our welcome address, followed by two panels of expert practitioners who will summarize outcomes from our workshop earlier in the day — (1) focus on use cases, and (2) focus on production at scale — plus Q&amp;A from the audience.</p><p>A little over a year ago I presented <a href="https://youtu.be/AzpS8nvmQz0">“Overview of Data Governance”</a> at Big Things Conference in Madrid. One of my slides referenced <a href="https://rise.cs.berkeley.edu/wp-content/uploads/2017/03/CIDR17.pdf">“Ground: A Data Context Service”</a> by <strong>Joe Hellerstein</strong>, et al., at <a href="https://rise.cs.berkeley.edu/people/">UC Berkeley</a>, followed by a list of open source projects which focused on <em>graph-based discovery for metadata about datasets</em>. I cited work from LinkedIn, Lyft, Uber, Netflix, etc.</p><figure><a href="https://youtu.be/AzpS8nvmQz0?t=1167"><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*r1mYThBAw8R9SV39Fi1RpQ.png" /></a></figure><p>That DG <a href="https://derwen.ai/s/6fqt">talk</a> had begun as a request by my colleague and co-author <a href="https://gradientflow.com/">Ben Lorica</a> — we’d been conducting a <a href="https://derwen.ai/s/6fqt#4">series of industry surveys</a>, beginning in 2018, about “ABC” (AI, Big Data, Cloud) adoption trends.</p><p>2018 was a banner year for data governance: the launch of GDPR, published findings about Facebook/Cambridge Analytica scandal, and — although not in the headlines as much — a year in which hundreds of millions of people had their private info exposed (i.e., sold) through several large industry failures. Data Governance was becoming top-of-mind for many IT leaders as a consequence — in contrast to what I’d seen in four decades of computing during which DG had largely been swept under the run.</p><p>Earlier in the talk I referenced <a href="https://zenodo.org/record/556504#.X8WSMhNKgWp">“The Case for Open Metadata”</a> by <strong>Mandy Chessell</strong> at IBM, plus her team’s work on the open standard <a href="https://www.odpi.org/projects/egeria">ODPi Egeria</a> and its reference implementation <a href="https://atlas.apache.org/index.html#/">Apache Atlas</a>. I’d also described related US government initiatives, such as the US <a href="https://strategy.data.gov/">Federal Data Strategy</a>, H.R. 4174 <a href="https://www.congress.gov/bill/115th-congress/house-bill/4174">evidence-based policymaking</a>, etc. Plus, I’d mentioned the <a href="https://github.com/jupyterlab/jupyterlab-metadata-service/blob/master/press_release.md">JupyterLab Metadata Explorer project</a> that I’d helped work on with Brian Granger, et al., at Project Jupyter.</p><p>Speaking of those open source projects… I stuck that slide into the deck with a “Watch this space” caveat in the voice-over. It seemed worth tracking carefully, and that’s proven out over time.</p><p>For a particular cohort of organizations, the natural response to GDPR was simple:</p><ol><li>Collect metadata about dataset usage across your organization.</li><li>Build a graph-based platform for metadata representation.</li><li>Build out UX features for dataset discovery and reporting (aka, <em>compliance</em>).</li><li>Recognize savings across your organization since your data scientists finally have a definitive source for collected knowledge about datasets.</li><li>Push the thing public as an open source project and advocate for adoption by other organizations.</li><li>Recognize business upside beyond compliance efforts, since this new lens into dataset usage allows insights about possible new business lines which were previously unavailable.</li><li>Elevate reporting of these results up to executive levels.</li></ol><p>While GDPR compliance was probably all good right around Step #3, these organizations kept pushing the envelope. The found both ROI and increased markets from an activity that began as risk mitigation.</p><p>From my vantage point, the next logical step in business would be for these projects to begin to marry AI methods along with their graph-based metadata discovery practices, leading inevitably into something much larger. That’s on deck now.</p><p>You may have read the excellent, recent (2020–10) article <a href="https://eugeneyan.com/writing/data-discovery-platforms/">“Almost Everything You Need To Know on Data Discovery Platforms”</a> by Eugene Yan at Amazon. If not, please do. The article is filled with brilliant analysis and insights. Eugene curates a list of open source projects within this emerging category: <a href="https://github.com/eugeneyan/applied-ml#data-discovery">https://github.com/eugeneyan/applied-ml#data-discovery</a></p><p>The list of these data discovery projects, courtesy of Eugene, currently includes:</p><ul><li><a href="https://www.amundsen.io/">Amundsen</a> — Lyft, Square, ING, Edmunds, Workday, etc.</li><li><a href="https://engineering.linkedin.com/blog/2019/data-hub">DataHub</a> — LinkedIn</li><li><a href="https://marquezproject.github.io/marquez/">Marquez</a> — WeWork, Stitch Fix</li><li><a href="https://medium.com/airbnb-engineering/democratizing-data-at-airbnb-852d76c51770">Dataportal</a> — Airbnb</li><li><a href="https://eng.uber.com/metadata-insights-databook/">DataBook</a> — Uber</li><li><a href="https://atlas.apache.org/#/">Apache Atlas</a> — IBM, plus several large enterprise firms</li><li><a href="https://netflixtechblog.com/metacat-making-big-data-discoverable-and-meaningful-at-netflix-56fb36a53520">Metacat</a> — Netflix</li><li><a href="https://engineering.atspotify.com/2020/02/27/how-we-improved-data-discovery-for-data-scientists-at-spotify/">Lexikon</a> — Spotify</li><li><a href="https://blog.twitter.com/engineering/en_us/topics/insights/2016/discovery-and-consumption-of-analytics-data-at-twitter.html">Data Platform</a> — Twitter</li><li><a href="https://engineering.fb.com/2020/10/09/data-infrastructure/nemo/">Nemo</a> — Facebook</li><li><a href="https://cloud.google.com/data-catalog/">Data Catalog</a> — Google</li></ul><p>From the perspective of an equity partner at a <a href="https://amplifypartners.com/">Bay Area VC firm</a>, “Something is definitely up!”</p><p>This much activity emerging from several different tech firms indicates both needs and capabilities, i.e., a new market category emerging. Indeed, two of these projects have recently spun out VC-funded tech start-ups.</p><p>Part of the pitch is simple: if you, as an enterprise firm, want to be competitive, you’ll need to leverage AI applications … because your competitors already are doing so. One consistent signal that Ben Lorica have found throughout our industry surveys is that when firms begin to recognize ROI from machine learning investments, they double-down on those investments. Consequently the gap between “have’s” and “have-not’s” in the AI space is accelerating. One major hurdle among the “have-not’s” who aren’t competitive: they must get their data in order. Like, yesterday. Data governance. Data strategy. Effective data engineering at scale. Visibility into what data they have. How their data assets can be leveraged. Taking advantage of their metadata to gain even more leverage.</p><p>Approximately 50% of enterprise is in the “have-not’s” category currently, and they need help. This emerging category of tech start-ups focusing on these graph-based solutions is key.</p><p>If you haven’t been involved much in <a href="https://www.oreilly.com/library/view/fifty-years-of/9781492057512/">graph-based data management</a>, nor its applications which are rapidly spilling over into AI, let me tell you that “Something is definitely up!”</p><p>I’ve been assisting organizers at knowledge graph conferences such as <a href="https://www.knowledgeconnexions.world/">Knowledge Connexions</a> and <a href="https://www.knowledgegraph.tech/">The Knowledge Graph Conference</a>. There’s also the fantastic workshop <a href="https://www.akbc.ws/">AKBC</a>, albeit more about research. The dirty little secret is that KG practices are widespread throughout enterprise — with the caveat that historically it’s been difficult to get those teams to talk about their work in an industry-first forum, outside of academic conferences. The list of related topics goes well beyond graph DBs and knowledge graphs, into more specific technology areas such as interactive graph visualization, graph algorithms, embedding and graph AI (deep learning), statistical relational learning, probabilistic inference on networks, causal reasoning, persistent homology, and so on.</p><p>Full disclosure: I’ve been teaching industry courses about these topics for several years; I’m an advisor for related AI start-ups including <a href="https://www.recogn.ai/">Recognai</a> and <a href="https://primer.ai/">Primer</a>; I’m a committer for a nascent little open source project called <a href="https://github.com/DerwenAI/kglab/">kglab</a> which attempts to blend these application areas into a simple Python-based abstraction layer with <a href="https://gradientflow.com/towards-an-infinite-laptop/">“infinite laptop”</a> scale-out provided by <a href="https://ray.io/">Ray</a> from UC Berkeley and <a href="https://www.anyscale.com/">Anyscale</a>; plus I’m super excited about this general area of <a href="https://arxiv.org/abs/2003.02320">knowledge graphs</a> and math-meets-code-meets-use-cases. But I digress…</p><p>There was another twist. For those of you who haven’t been working much in the federal sector and spending time in DC, let me just say that mention of <em>metadata management</em> or <em>data governance</em> tends to get people excited. There’s work to be done, there’s recent policy to support that work, and the priorities (and consequences) for the public are crystal clear: the 2019 US federal data strategy in response to the 2017 bipartisan H.R. 4174 bill sets the stage for dramatic changes in how approximately 30% of the US economy leverages data in the Age of AI.</p><p>Compliance, privacy, fairness/bias, security, managing pandemic response, etc., are all key concerns, although the larger issue is about potentially missing out on <em>opportunity</em>. One problem: the US federal government — aside from perhaps the Intelligence Community — has not been renowned as an “early adopter” of technology.</p><p>Late last year I was co-chair for the “Rich Context” workshop in DC, which brought together expert practitioners from government, expert practitioners from Silicon Valley, plus top researchers from academia and corporate research labs. <strong>Ian Mulvany,</strong> also a co-chair there, helped wrangle metadata experts in the room into a “Foo Camp” styled unconference, including <strong>Natasha Noy</strong> from Google, <strong>Deborah McGuinness</strong> from RPI, <strong>Daniella Lowenberg</strong> from Dryad (University of California library system), and more. I had invited several colleagues, including Ed Kearns and his team handling dataset management at NOAA, plus my good friend <strong>Mark Grover,</strong> product manager for Amundsen at Lyft.</p><p>During that workshop I noticed something rare: people who had 30+ years working in the data-intensive parts of the US federal government got <em>really excited</em> about talking with leaders from data-intensive projects in Silicon Valley. One side thoroughly understood <em>policy</em>, <em>compliance</em>, <em>security</em>, <em>accountability</em>, <em>social impact.</em> One side thoroughly understood how to deliver technology solutions that scale, based on open source, while leveraging data with machine learning. Ed Kearns in one corner of the room talking fast with Mark Grover — <em>that</em> told me <em>most</em> of what I needed to know!</p><p>To wit, even though <em>decades</em> of data governance products have resulted in a balkanized field of <em>point solutions</em>, the stars appear to be aligning for the next stage of evolution. Indications include:</p><ul><li>Top research institutions (e.g., RISElab at UC Berkeley) are focusing on how to define the hard problems — “Something is definitely up!”</li><li>A flurry of recent open source projects from sophisticated tech firms in response to critical data governance needs, are earning ROI and gaining enterprise adoption — “Something is definitely up!”</li><li>VC firms are jumping into this space, defining a new category of tech start-up s— “Something is definitely up!”</li><li>Federal government recognizes the need and is reaching out to partner with Silicon Valley on solutions at scale — “Something is definitely up!”</li></ul><p>That last item is especially important. The more data-intensive US federal agencies have budgets that would make most Silicon Valley execs scream, or cry, or both. While we may talk about trillion-dollar market valuations for unicorns on NASDAQ, try comparing that with a decade’s worth of the federal budget. Moreover, given the world’s need for better handling of data (AI ethics, anyone? Urgent pandemic responses?) this is a case of <em>need</em> meeting <em>opportunity</em>. These stars are aligning.</p><p>Again, projects such as Amundsen began in response to crucial needs for GDPR compliance, but then led to business upside. Think about that at a much, much larger scale. These stars are aligning. Your work, given the ubiquity of data applications, will probably depend on these innovations, soon.</p><p><strong>Metadata Day</strong> is a workshop of leading practitioners in this field. We’ll hold a closed session in the morning and collaborate to reduce the outcomes into two presentations: one about <strong>use cases</strong>, and the other about <strong>production practices at scale</strong>.</p><figure><a href="https://metadataday2020.splashthat.com/"><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*8KGiHFfAtpdgTYtXddNbQA.png" /></a></figure><p>Metadata Day is a workshop of leading practitioners in this field. We’ll hold a closed session in the morning and collaborate to reduce the outcomes into two presentations: one about <strong>use cases</strong>, and the other about <strong>production practices at scale</strong>.</p><p>Several people I mentioned above will be among the expert practitioners participating in this workshop: Joe Hellerstein, Mandy Chessell, Deborah McGuinness, Natasha Noy, Daniella Lowenberg, Ian Mulvany, Mark Grover — and more. Plus we’ll have leads from several of the open source projects mentioned. <strong>Shirshanka Das</strong> (DataHub), <strong>Nadiya Hayes</strong>, and <strong>Kapil Surlaker</strong> from LinkedIn are hosting the event — and I’m helping them.</p><p><strong>Please join us!</strong></p><p>Register (free) for the online event at <a href="https://metadataday2020.splashthat.com/">https://metadataday2020.splashthat.com/</a></p><p>Social media hashtag: <a href="https://www.linkedin.com/feed/hashtag/?keywords=metaspeak2020&amp;highlightedUpdateUrns=urn%3Ali%3Aactivity%3A6739317571595718656">#metaspeak2020</a></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=220b7af5e4cc" width="1" height="1" alt=""><hr><p><a href="https://medium.com/knowledge-technologies/metaspeak-meetup-dec-14-2020-220b7af5e4cc">Metaspeak Meetup, Dec 14 2020</a> was originally published in <a href="https://medium.com/knowledge-technologies">Knowledge Technologies</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
    </channel>
</rss>