<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0" xmlns:cc="http://cyber.law.harvard.edu/rss/creativeCommonsRssModule.html">
    <channel>
        <title><![CDATA[rivery-blog - Medium]]></title>
        <description><![CDATA[Rivery’s fully-managed SaaS ELT platform provides a unified solution for data ingestion, transformation, and workflow orchestration. - Medium]]></description>
        <link>https://medium.com/rivery-blog?source=rss----2155f39f5170---4</link>
        <image>
            <url>https://cdn-images-1.medium.com/proxy/1*TGH72Nnw24QL3iV9IOm4VA.png</url>
            <title>rivery-blog - Medium</title>
            <link>https://medium.com/rivery-blog?source=rss----2155f39f5170---4</link>
        </image>
        <generator>Medium</generator>
        <lastBuildDate>Sun, 22 Nov 2026 01:33:17 GMT</lastBuildDate>
        <atom:link href="https://medium.com/feed/rivery-blog" rel="self" type="application/rss+xml"/>
        <webMaster><![CDATA[yourfriends@medium.com]]></webMaster>
        <atom:link href="http://medium.superfeedr.com/" rel="hub"/>
        <item>
            <title><![CDATA[How to Improve Your Customer Support with Rivery & Snowflake Cortex]]></title>
            <link>https://medium.com/rivery-blog/how-to-improve-your-customer-support-with-rivery-snowflake-cortex-41ad029e3456?source=rss----2155f39f5170---4</link>
            <guid isPermaLink="false">https://medium.com/p/41ad029e3456</guid>
            <category><![CDATA[data-integration]]></category>
            <category><![CDATA[snowflake]]></category>
            <category><![CDATA[salesforce]]></category>
            <category><![CDATA[llm]]></category>
            <category><![CDATA[snowflake-cortex]]></category>
            <dc:creator><![CDATA[Rivery]]></dc:creator>
            <pubDate>Tue, 30 Jul 2024 13:02:50 GMT</pubDate>
            <atom:updated>2024-07-30T13:02:15.105Z</atom:updated>
            <content:encoded><![CDATA[<p>At Rivery, we pride ourselves on <a href="https://rivery.io/blog/g2-summer-2024/">delivering exceptional customer support </a>. To maintain and improve our service, we continuously seek innovative ways to understand better and respond to our customers’ needs.</p><p>One of our latest initiatives involves leveraging the power of generative AI to analyze support tickets via and <a href="https://www.snowflake.com/en/data-cloud/cortex/">Snowflake Cortex </a>.</p><p>Rivery is a complete data integration platform that simplifies and speeds up data pipeline creation by seamlessly integrating hundreds of data sources. This eliminates the complexities of building and maintaining connections between structured and unstructured data sources. By linking Rivery with Snowflake, we can efficiently extract data from different support systems, load it into Snowflake, and transform it so it’s ready for large language models (LLMs) usage.</p><p>This enables us to utilize <a href="https://docs.snowflake.com/en/user-guide/snowflake-cortex/overview">Snowflake’s Cortex </a>functions to perform analysis using LLMs on top of pertinent and current data from any source via simple SQL queries. With this capability, generative AI can utilize the retrieved information to answer specific questions regarding your data. This blog post delves into why we are undertaking this initiative and how our engineering team utilized Rivery and Snowflake Cortex to summarize long text inputs from support tickets.</p><h3>Why Analyze Support Ticket Data With AI?</h3><p>One of the core differentiators of our product is the dedicated customer support we provide to our customers. This involves multiple support channels, often resulting in a ticketing system that handles customer tickets in a reasonable time.</p><p>Support tickets are a rich source of information about the challenges our customers face. By analyzing this often unstructured data with AI, we can identify common issues, recurring themes, and areas where our product may need enhancement. This understanding helps us proactively address problems before they escalate, ensuring our customers have a smoother experience.</p><p><strong>2 . Enhancing Response Times and Efficiency:</strong></p><p>Smarter support ticket analysis allows us to track metrics such as average response and resolution times. By identifying bottlenecks and inefficiencies, we can streamline our support processes, allocate resources more effectively, and ultimately reduce the time customers spend waiting for resolutions.</p><p><strong>3. Improving Product Development:</strong></p><p>Insights gained from support ticket data can directly influence our product development roadmap. By understanding the features and functionalities that generate the most support queries, we can prioritize improvements and new features that address the real needs of our users.</p><p><strong>4. Personalized Customer Support:</strong></p><p>With detailed analysis, we can offer more personalized support. Understanding the history of a customer’s interactions with our support team enables us to provide tailored solutions and build stronger, more trusting relationships with our users.</p><h3>Rivery and Snowflake Cortex enabling AI functionality</h3><p>Without Rivery and Snowflake Cortex, this process could have been a hassle for data teams to complete. It would involve a data engineer having to set infrastructure and code to extract data out of the ticketing data source. Prepping the data and then running it via a dedicated workflow for generative AI would have additional another large undertaking. The reality is that most data teams don’t have this luxury, and need a fast way for someone that knows SQL to perform all of this without relying on additional resources. Performing this process with Rivery and Snowflake is as simple as writing any SQL query.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/300/0*Myt1IJjI0u29-sgH.png" /></figure><h3>Step 1: Extract and load the Data into Snowflake</h3><p>The first step in our data workflow is to get the raw data from our support ticketing system to Snowflake to run further analyses on the text data. In this example the featured support ticketing system is <a href="https://rivery.io/integration/salesforce/">Salesforce </a>but it could also be , or any other system.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/300/0*MZu9PZ8Dh0WIAsPS.jpg" /></figure><p>We do this by creating a <a href="https://docs.rivery.io/docs/using-source-to-target-variables-in-logic-river">Source to Target River </a>(Data pipeline) in Rivery that loads the data from Salesforce to our target which is Snowflake. The steps are very simple:</p><ol><li>Configure a connection to your data source</li><li>Configure a connection to your data-target</li><li>Select what data to bring from the source</li></ol><p>Here is a short video of how to create such a data pipeline.</p><p>In this case, we selected the following support ticket tables to be replicated from Salesforce to Snowflake. These tables contain free-form text fields such as the case comments and responses captured within email exchanges:</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/300/0*Yk3CtJB1Ueg-wltO.jpg" /></figure><h3>Step 2: Prepping the data &amp; Running Cortex Functions</h3><p>Next, we have to transform our data inside Snowflake which we can easily orchestrate via Rivery.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/300/0*qJoScXyBiQTMwIbo.jpg" /></figure><p>In the above process, we aggregate and concatenate the full history of case comments for each Case ID from the relevant tables into a single record instead of having separate records for each exchange related to the same support ticket (Case ID). This results in one unified set of all comments made on a specific ticket, which we can then use to run the cortex function.</p><p>From there, we can run a step that executes the Cortex functions to generate insights.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/300/0*K58kh1sb-5ESA432.png" /></figure><p>Let’s enlarge the SQL Query and preview the results:</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/300/0*V4ZNMT1UIxOt0So4.png" /></figure><p>For each ticket, we generate a summary to identify if the issue was resolved, what the resolution was, and whether the sentiment with the customer was positive, neutral, or negative. One thing to note is that running Cortex functions has a maximum limit on the number of tokens you can send as input variables. You can think of tokens as the equivalent of words, and most algorithms have a 32,000 token limit. Some of the cases we had in our tickets were going over that limit and we had to define our business logic to deal with this limit.</p><p>Let’s quickly break down the various Cortex functions we used and what they are accomplishing.</p><p><strong>Snowflake.Cortex.Summarize: </strong>Gets the full history of the ticket and summarizes it. <strong>Snowflake.Cortex.Complete: </strong>A versatile function in Snowflake that lets you specify its tasks. In our case, we used it to analyze support tickets to determine if each ticket was resolved and to provide a summary of the resolution type. We also required the result to be a valid JSON containing one of three options with no additional text. Finally, we consolidated this information into a single field named “case resolution and sentiment” and loaded it into a final table in Snowflake.</p><p>Here is the full SQL Query we used in this case:</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/300/0*uWUBlpwkTnuGID70.jpg" /></figure><h3>Moving Forward</h3><p>By utilizing Rivery’s modern data integration platform, which seamlessly connects to hundreds of data sources, along with the LLM capabilities of Snowflake Cortex, we have effortlessly created a streamlined process to gain deeper insights into our customer support tickets. This enables us to provide superior support to our customers and continuously enhance our product to meet the ever-evolving needs of our users.</p><p>This process can be easily applied on top of any free-form unstructured text. Watch this short video to see a similar flow we put together on top of our product review data.</p><p>Ready to integrate and run generative AI on top of your data in Snowflake?</p><p><em>Originally published at </em><a href="https://rivery.io/blog/how-to-improve-your-customer-support-with-rivery-snowflake-cortex/"><em>https://rivery.io</em></a><em> on July 23, 2024 by Ariel Pohoryles.</em></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=41ad029e3456" width="1" height="1" alt=""><hr><p><a href="https://medium.com/rivery-blog/how-to-improve-your-customer-support-with-rivery-snowflake-cortex-41ad029e3456">How to Improve Your Customer Support with Rivery &amp; Snowflake Cortex</a> was originally published in <a href="https://medium.com/rivery-blog">rivery-blog</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Change Data Capture (CDC)]]></title>
            <link>https://medium.com/rivery-blog/change-data-capture-cdc-64389841c18b?source=rss----2155f39f5170---4</link>
            <guid isPermaLink="false">https://medium.com/p/64389841c18b</guid>
            <category><![CDATA[data-processing]]></category>
            <category><![CDATA[batch-processing]]></category>
            <category><![CDATA[golang]]></category>
            <category><![CDATA[data-management]]></category>
            <category><![CDATA[change-data-capture]]></category>
            <dc:creator><![CDATA[Rivery]]></dc:creator>
            <pubDate>Tue, 16 Aug 2022 17:31:30 GMT</pubDate>
            <atom:updated>2022-08-16T17:39:16.492Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="Rivery Change Data Capture: Lessons learned from building a CDC solution from scratch" src="https://cdn-images-1.medium.com/max/1024/1*OgxN3GPbp627slqUuVahUA.png" /></figure><h4>Lessons learned building a solution from scratch</h4><h4>By Alon Reznik, Co-Founder &amp; Chief Architect at <a href="https://rivery.io/">Rivery</a></h4><h3>Once upon a time, in a data pipeline not so far away</h3><p>At Rivery, we’re all about data, specifically managing the data pipeline lifecycle.</p><p>We move data from point A to point B, but we also focus on moving updates and changes from point A to point B in the most efficient and fastest way possible.</p><p>To optimize this process, we chose Change Data Capture (CDC) as the best solution to help our customers take care of these updates and changes.</p><p>Initially, we selected a well-regarded, open-source CDC solution, but it ended up not working out. There were a number of hurdles that we had to overcome, which ultimately made this option a non-starter.</p><p>If you’re looking to deploy a CDC platform, then it’s worthwhile to read through some of the challenges we faced and learn from our experience, so you can be more confident in the solution you choose to support your specific needs.</p><p>First, let’s take a quick look at why CDC is so important. Then, we’ll dive into why the platform we chose wasn’t optimal for our needs, and what we did to make CDC work for us and our customers.</p><h3>Why CDC in the first place?</h3><h4>The need for replication speed</h4><p>As data engineers and analysts, we need to move data from our relational databases (point A), such as SQL Server or MySQL, to data warehouses, data lakes, or other target databases (point B).</p><p>Whenever there’s a change or update in the database, we also need to sync between the two in as close to real time as possible, and with as little friction and complexity as possible.</p><p>Traditionally, doing this has been achieved through batch data replication; executing once or several times a day. But batch data pulling requires additional computing, provides insufficient inputs on the history of deleted rows, and entails higher latencies.</p><p>When it comes to data replication, data engineers and analysts need a different approach.</p><h4>In comes a different approach</h4><p>To reduce overhead, eliminate latency, and enable real-time analytics, organizations have moved away from batch or bulk load updating to incremental updating with change data capture.</p><p>Basically, CDC speeds up data processing by eliminating the need for full-scale database replication in the ETL/ELT pipeline, and creating an analytics database as a separate copy of the production database.</p><p>This process entails identifying and capturing any data change (e.g. insert, updates, deletes) to the database logs in real time at point A, using the database engine’s native API, and then delivering changes to point B.</p><p>Because it only deals with changes to the logs, it eliminates the need for ongoing database replication using the database engine, thereby minimizing the resources required for ETL/ELT processes.</p><p>And since it deals with new database events as they occur, it enables real-time or near-real-time data movement.</p><p>As such, CDC is ideal for near-real-time business intelligence as well as for cloud migrations.</p><h4>The Debezium path to CDC</h4><p>At first, we decided to go with Debezium. Among the different CDC tools out there, with 7K GitHub stars and 1.8K GitHub forks, Debezium is one of the most popular.</p><p>This is an open-source distributed platform that’s built on top of Apache Kafka, where you can:</p><blockquote>“Start it up, point it at your databases, and your apps can start responding to all of the inserts, updates, and deletes that other apps commit to your databases.” (<a href="https://debezium.io/">Debezium</a>)</blockquote><p>The advantages of Debezium are said to include:</p><ul><li>Durability and speed</li><li>Scalability in handling large volumes of data</li><li>Incubating connectors for MySQL, SQL Server, Postgres, and Oracle</li><li>Community sink connectors for ElasticSearch</li><li>Sink connectors for MySQL and SQL Server</li><li>MongoDB connector maturity</li><li>Fault tolerance</li></ul><p>And, of-course, the fact that it’s open-source was an additional advantage for us. So, we went with Debezium.</p><h4>Our short affair with Debezium</h4><p>We were feeling good. Optimistic. Debezium is known for being great and we want nothing less than the best for our customers.</p><p>We implemented Debezium, which we were planning to manage on the backend as our customers were to enjoy its benefits when CDC was required by processes executed by our platform on the front end.</p><p>But, sadly, Debezium just didn’t work for our needs. Some of the main issues we faced include:</p><p><strong>Running after open source version updates</strong></p><p>Embedding a core solution which is open source into your own product is challenging. You need to run over any new version, track the changes, and make sure your product is stable in light of all these changes, all while reviewing other prioritizations, fixing velocity, and implementing security patches. So, while Debezium is a well-regarded solution for some cases, for us, the overhead from version upgrades and the impact on our customers, made the effort greater than expected.</p><p><strong>Error messages</strong></p><p>With Debezium, as with any solution that’s built on Kafka Connect, error messages provide the full Java stack, without the option to search for the root cause of the underlying message. This lack of visibility made remediation very difficult, and sharing with our customers what the real error was behind the message, was quite challenging.</p><p><strong>Scale</strong></p><p>On Debezium and Kafka Connect, all pipelines run on the same connectors. The result is a round robin among the pipelines that makes scale complex and often out of reach as the number of sources grows.</p><p><strong>Code transparency</strong></p><p>Debezium uses Kafka Connect to move data into Kafka. The issue with Kafka Connect is that it doesn’t come with the required level of code transparency, which also complicates the maintenance of CDC processes for hundreds of different types of configurations that our customers have executed in their own databases.</p><p><strong>Logging</strong></p><p>Debezium logs aren’t aligned with our formatting, nor did they provide the essential information that we needed. To illustrate, every row in the error stack is provided as one row in the logs. This makes tracking very challenging. Some logs are even hidden in certain use cases, while in other cases, there’s over-logging.</p><p><strong>Topologies support</strong></p><p>While Debezium does offer support for certain topologies, it doesn’t support the hundreds of different types of topologies that are used by our customers.</p><p><strong>SSH tunnels</strong></p><p>Whenever a customer organization was using SSH tunnels for connectivity, Debezium couldn’t support it.</p><p>We needed (and ultimately created) a solution that would connect to our client’s databases using different topologies, such as SSH tunnel, SSL, and VPN tunnels. SSH tunnels are commonly used to connect remote databases in internal VPCs and unfortunately, this isn’t embedded out of the box in Debezium.</p><p><strong>Use cases</strong></p><p>The biggest issue we experienced is that Debezium use cases couldn’t be tailored to our customers’ needs. For example, we received regular feedback that the open platform simply wasn’t working with specific data types and tables from our customers.</p><h4>What should you evaluate when considering a CDC platform?</h4><ul><li><strong>Frequent version updates:</strong> will you be able to handle regular merges and heavy maintenance?</li><li><strong>Error messages: </strong>does the platform deliver clarity for quick and efficient remediation?</li><li><strong>Scale:</strong> does the platform work with all of your database types?</li><li><strong>Code transparency:</strong> can you easily get into the code to make changes when needed?</li><li><strong>Logging:</strong> do the log files provide the information you need?</li><li><strong>Topologies support:</strong> does it support your topology?</li><li><strong>SSH tunnels:</strong> does it support SSH connectivity and other connectivity best practices?</li><li><strong>Use cases:</strong> can it handle all your use cases, tables, etc.?</li></ul><p>Unfortunately, the answer to all of the above was <em>‘no’</em> for us. As a result, we decided to take things into our own hands and develop our own CDC solution.</p><h3>A new approach to CDC</h3><p>Our goal was to create another solution, our own platform, which we could intuitively know how to maintain and debug. When the code is yours, you have access to it, you have visibility, and you know how to handle any issue that might arise.</p><p>But building your own CDC platform is no simple task. It requires a lot of knowledge about so many different possible specifications that need to be applied to just about every database.</p><p>It’s not just about knowing your own data, database, tables, and topology. It’s about knowing everything about them, and how to get data from point A to point B seamlessly, quickly, and efficiently.</p><p>But for us, and for our customers, the advantages of creating our own CDC platform far outweighed the challenges.</p><p><strong>So, what did we do?</strong></p><p>We mapped out all the issues we were experiencing, aggregated insights, assembled our best and brightest for the task, and built our own CDC platform as follows.</p><p>For the programming language, we evaluated and considered Python and Go.</p><p>In our consideration, we quickly realized that Python doesn’t support multithreading well enough, nor does it offer a robust solution for Kafka. Since multithreading is so important for processing many events at the same time (a pillar of CDC), and since our solution is on Kafka, we chose not to go with Python as our programming language.</p><p>This led us to choose Go, which offers many advantages:</p><ul><li>Multithreading out of the box (using <a href="https://go.dev/tour/concurrency/1">Goroutines</a>).</li><li>Task queues using Go channels for <a href="https://go.dev/tour/concurrency/2">concurrency</a> out of the box.</li><li>Great support for I/O.</li><li>Stability</li><li>Flexibility</li><li>Very Light.</li></ul><h4>The architecture</h4><p>We built an architecture that drives high rates of CDC efficiency. For example, the consumer pushes data log entries to queues and everything is orchestrated by the manager, which also performs validation for MySQL and creates a status report if something doesn’t fit or connect.</p><p>This also drives great flexibility, enabling a new connector to be deployed in less than two weeks, as opposed to the three weeks that are typically required.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*ttGNuwGRGXZdx66MYdn2UQ.png" /></figure><h4>SSH connectivity and other topologies</h4><p>To support our customers’ connectivity needs, we created our own SSH tunnel as an external service that we embedded as a side car.</p><p>This new solution provides us with the ability to align our clients’ connecting topologies and offers better, higher performance, and more stable solutions for their specific needs.</p><h4>Centralized management</h4><p>The consumer in this architecture can push data to Kafka. It’s a system that can get messages at a very high capacity; understanding how to bring a lot of different data types quickly from a lot of different sources, all with the ease-of-use and clarity of central management.</p><h4>A transactional process against Kafka</h4><p>When it comes to pushing data to Kafka, the execution needs to be transactional through the Kafka API. So, we needed to create a transactional process that would collect all the data that we needed to push, ensuring the process would also let the user know where this collection started and where <em>exactly</em> it would be pushed.</p><p>This was the hard part, but it’s exactly what we did!</p><p>Having such visibility into the process helps you to avoid delays. When events interrupt the consuming, it’s hard to know where you started, where you stopped, and where you need to pick up again. Ultimately, it can cause a lot of problematic delays.</p><p>Going back and forth enables us to manage any change in our customers’ databases and make sure we’re catching all of the messages in a quick and easy way.</p><h4>The flip/flop functionality</h4><p>Knowing where you started and where you left off is also key to the flip/flop functionality that we designed and implemented.</p><p>We created two queues instead of one, so that we could make sure that messages are accepted by Kafka, while at the same time, we could fetch more data from the source without causing any of the processes to be blocked.</p><p>Whenever one queue gets filled up, the data coming in goes into the second empty queue instead of creating a backlog. Only once the full queue has emptied out, would we get back to using it for new data coming in.</p><p>This flip/flop functionality is only possible when you know where you started, where you are, and where you left off, so that you only fetch the data you need from the database without any unnecessary replications.</p><p>The benefit of this approach is not only about avoiding delays. Although this was a fantastic benefit as we reduced delays down to about 10 seconds vs. the 2–3 minutes that we had with Debezium when we opened it for scale.</p><p>Additional benefits include:</p><ul><li>Eliminating the need for redundancy</li><li>Greater stability</li><li>Scalability out of the box</li></ul><p>And the biggest benefit of all was that we could finally focus on the business logic and address our customers’ needs, instead of expending tons of energy on database replication.</p><p>No overhead. Just value.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*28wENUO-uQvLOpEiKZQCWQ.png" /></figure><h3>Closing thoughts on Change Data Capture and choosing the best CDC platform for your data needs</h3><p>If you need CDC to help streamline, accelerate, and drive efficiency in synchronizing your data, you could go with a popular platform, but it may not be able to meet all of your needs out of the box.</p><p>You could design your own, but keep overhead front of mind. Would you really want to take all that on? Especially when we’ve already done the heavy lifting for you? 🏋️‍♂️</p><p>With Rivery’s CDC solution, you get some of the toughest challenges pre-solved for you:</p><ul><li><strong>A language that’s very light</strong> and supports multithreading out of the box with compatibility for multiple channels, I/O support, and stability</li><li><strong>A flexible architecture</strong> that drives higher rates of efficiency</li><li><strong>Built-in SSH connectivity</strong></li><li><strong>A better transactional process</strong> that offers more visibility and minimizes delays</li><li><strong>Flip/flop functionality</strong> <strong>with two queues</strong>, which eliminates the need for redundancy, provides greater stability, and delivers scalability out of the box</li><li><strong>Frees up valuable time and resources</strong> to focus on business logic instead</li></ul><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=64389841c18b" width="1" height="1" alt=""><hr><p><a href="https://medium.com/rivery-blog/change-data-capture-cdc-64389841c18b">Change Data Capture (CDC)</a> was originally published in <a href="https://medium.com/rivery-blog">rivery-blog</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[How SMBs Can Unlock the Full Potential of Big Data]]></title>
            <link>https://medium.com/rivery-blog/how-small-businesses-can-unlock-the-full-potential-of-big-data-4421118e620d?source=rss----2155f39f5170---4</link>
            <guid isPermaLink="false">https://medium.com/p/4421118e620d</guid>
            <dc:creator><![CDATA[Kevin Bartley]]></dc:creator>
            <pubDate>Thu, 03 Dec 2020 21:07:28 GMT</pubDate>
            <atom:updated>2020-12-07T17:27:37.310Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*8jHAYLYnXj9ubdD7upN5HA.jpeg" /></figure><p>According to a recent study, <a href="https://www.forbes.com/sites/louiscolumbus/2017/12/24/53-of-companies-are-adopting-big-data-analytics/#152e76b639a1">53% of all companies</a> now incorporate big data in business operations. But many SMBs still think that big data is off limits for them. In a global market that pits everyone else against enterprise companies, SMBs are losing a competitive advantage by allowing large businesses to gain the upper hand with big data.</p><p>Enterprise companies have been investing in big data infrastructure for decades. However, recent technological advancements are enabling SMBs to close this gap and harness big data to compete for customers. Read on to learn how.</p><p><strong>The Data Landscape: How the Gap Between SMBs and Enterprises Emerged</strong></p><p>Over the past twenty-five years, enterprise companies have been eating into the market share of SMBs by dominating two interrelated trends: web commerce and big data. With the emergence of intuitive web dev technologies, online POS platforms, and third-party marketplaces, SMBs can now legitimately compete with enterprises in terms of web commerce.</p><p>But when it comes to big data, SMBs are still behind. And this matters for the bottom line. Companies that leverage big data analytics experience a <a href="https://www.georgiasbdc.org/how-can-small-business-thrive-in-a-big-data-world/">15% increase in sales</a> compared to companies that do not.</p><p>The deficit traces back several decades. In the 80s and 90s, many enterprise companies invested substantially in data infrastructure and data personnel. Enterprises companies purchased on-premise data warehouses to collate all their data sources, and employed specialized engineers to maintain this hardware.</p><p>In recent years, with the emergence of big data and algorithmic user experiences, this investment in data infrastructure has paid off. Enterprise companies reimagined the buyer’s journey with an unprecedented level of data-driven granularity, targeting customers more effectively than ever before. Meanwhile, most SMBs still don’t even know what a data warehouse is.</p><p>This gap in big data capabilities endures to this day. And it seemed as if it would stay that way. But in recent years, new technologies have democratized big data. Now, SMBs can utilize big data, too. Here’s an overview of these new technologies, and the insights they can yield for SMBs.</p><p><strong>Three Technologies that Unlock Big Data for SMBs</strong></p><p>Three particular technologies — cloud data management platforms, cloud data warehouses, and business intelligence (BI) platforms — make big data accessible to SMBs. When used in tandem, these technologies enable SMBs to generate sophisticated insights that were once only available to enterprise companies.</p><p><strong>1. Cloud Data Management Platform</strong></p><p>In the era of big data, even SMBs must manage a vast number of data sources. To generate meaningful insights, SMBs must develop ways to extract, orchestrate, and clean data from all these varied sources.</p><p>For decades, enterprise companies spent heavily to build out this kind of data infrastructure. They employed full data teams to construct technical systems, produce data connectors, and manage data processes. SMBs had neither the time or resources for such projects.</p><p>But with cloud data management platforms, SMBs can now manage all of their data in a single platform, minus the prohibitive cost and the technical complexity. With pre-built data connectors, data process automation, and other key features, a data management platform allows SMBs to collate and format all their data without requiring large financial investments or data engineering skills.</p><p><strong>2. Cloud Data Warehouse</strong></p><p>Data warehouses enable businesses to store, centralize, and analyze all of a company’s data. Since the 1980s, many enterprises have invested in expensive on-premise data warehouses that are unaffordable for SMBs. Besides the high up-front costs, on-premise data warehouses also require maintenance and technical expertise that most SMBs cannot provide.</p><p>In recent years, solutions such as Snowflake and BigQuery brought data warehouses into the cloud. Cloud data warehouses are serverless, distributed platforms that do not require SMBs to invest in costly on-premise hardware. These platforms also offer features such as auto-scalability and no-code interfaces that allow SMBs to develop a single source of data truth without all the maintenance burdens.</p><p><strong>3. Business Intelligence Platform</strong></p><p>Business intelligence, analytics, and reporting are major weak points for most SMBs. Over the years, enterprise companies built out dedicated BI teams to produce these specialized business insights. This is often the end goal of big data workflows, and historically, SMBs were locked out due to a lack of resources.</p><p>However, the rise of BI platforms have enabled SMBs that lack specialized personnel to produce custom insights, reports, and visualizations. With a BI platform, SMBs can finally access the kinds of data and analytics that only enterprise companies have had access to. This allows SMBs to compete more evenly with enterprises.</p><p><strong>5 Ways SMBs Can Implement Big Data</strong></p><p>Once an SMB unlocks big data with the right technology, there’s almost no limit to what they can do with the data. Today, SMBs are using big data in a number of ways, but here are some standout use cases:</p><ul><li><strong>Enhancing business operations </strong>— Combine ERP data with other sources, such as HR data and sales data, to track business operations. Measure the efficiency of customer interactions, workers per shift, hours of operation, and other key indicators by using hybrid data patterns.</li><li><strong>Leveraging sales trends </strong>— Match in-store data, online data, and buyer intent signals to anticipate and meet customer demand. Understand seasonal, temporal, and geographic sales variances and isolate abnormal buying patterns. Take advantage of trends as they happen in real-time.</li><li><strong>Building comprehensive customer profiles </strong>— Aggregate every data source related to a customer, from CRM platforms, to website activity, to third-party sources, and form a comprehensive customer profile. Improve ad serves, personalization, and conversion rates.</li><li><strong>Optimizing pricing </strong>— Splice together sales volume data across channels, inventory differentials, and other markers to develop supply and demand funnels. Then develop optimized pricing schemes.</li><li><strong>Improving customer interactions </strong>— Tie customer satisfaction to dates, times, stores, employees, and other indicators to make customer interactions better, more efficient, and more impactful.</li></ul><p>These use cases are a good start. But they’re only scratching the surface of what SMBs can do with big data.</p><p><strong>How to Find the Right Big Data Technology for Your SMB</strong></p><p>For SMBs, diving straight into the world of big data can be overwhelming. This sense of not knowing where to start is a big reason why SMBs avoid implementing big data altogether. Thankfully, in the past few years, a number of online resources have appeared that help SMBs choose the right big data technologies.</p><p>The best resources are always the unvarnished opinions of other SMBs. The sites below empower SMBs to read objective reviews and commentaries from other SMBs about leading big data technologies on the market today. This allows SMBs to cut through the clutter of marketing content and find out what really works for companies of a similar size.</p><ul><li><a href="https://www.trustradius.com/">TrustRadius</a> — TrustRadius is a technology review forum with highly active sections for data integration, cloud data warehouses, and business intelligence platforms. The site enables SMBs to sort independently confirmed reviews by company size and background.</li><li><a href="https://www.g2.com/">G2</a> — With over 1 million confirmed reviews from real end-users, G2 offers SMBs a robust view into all big data technologies on the market today. Harness comparison matrices to assess competing services side-by-side and read reviews from verified SMBs users.</li><li><a href="https://www.capterra.com/">Capterra</a> — Capterra’s in-depth examinations of features and pricing give SMBs a more granular look at each big data technology, without drowning them in obscure jargon. This is a great resource to augment searches from the other sites with more detail.</li><li><a href="https://www.softwarereviews.com/">SoftwareReviews</a> — Software Reviews melds sentiment towards the client-vendor relationship and product effectiveness into a novel Emotional Footprint score. Users can filter Emotional Footprint scores based on company size to understand the holistic benefits big data solutions have on SMBs.</li></ul><p>Of course, these are just a few of the resources SMBs can tap to find the right big data technologies. But they offer a firm foundation for SMBs as they seek to incorporate big data.</p><p><strong>Now is the Time for SMBs to Seize Big Data</strong></p><p>Until recently, SMBs did not have the resources to realize the full potential of big data. But today, new technologies have eliminated the pricing and technical barriers that once barred SMBs from maximizing all of their data sources. Enterprise companies have been using big data within their business process for years. But now, SMBs can harness big data like the big players.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=4421118e620d" width="1" height="1" alt=""><hr><p><a href="https://medium.com/rivery-blog/how-small-businesses-can-unlock-the-full-potential-of-big-data-4421118e620d">How SMBs Can Unlock the Full Potential of Big Data</a> was originally published in <a href="https://medium.com/rivery-blog">rivery-blog</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Why Offices Were Dead Before COVID-19]]></title>
            <link>https://medium.com/rivery-blog/why-offices-were-dead-before-covid-19-e01119bb8727?source=rss----2155f39f5170---4</link>
            <guid isPermaLink="false">https://medium.com/p/e01119bb8727</guid>
            <category><![CDATA[office]]></category>
            <category><![CDATA[covid19]]></category>
            <category><![CDATA[office-culture]]></category>
            <dc:creator><![CDATA[Kevin Bartley]]></dc:creator>
            <pubDate>Thu, 03 Sep 2020 18:48:52 GMT</pubDate>
            <atom:updated>2020-09-03T18:48:52.552Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/724/0*As4BZCFAaV_OVRXh.jpg" /></figure><p>The sudden appearance of COVID-19 in late 2019 forced an unprecedented worldwide shift in work habits. Almost overnight, workers across the globe performed their jobs from living rooms, bedrooms, even patios. Some commentators claimed the shift to remote work would kill offices outright.</p><p>But it’s impossible to kill something that’s already dead. The fact is, offices died before COVID-19. The pandemic did not cause this, but rather highlighted what was right in front of us. Here’s why.</p><h3><strong>The Death of the Office: Physical Workspaces Lose Their Edge</strong></h3><p>Offices weren’t always dead. For most of history, workers needed physical closeness to perform many tasks. Employees could not attend meetings, build products, or engage in certain conversations without a shared space.</p><p>The telephone, telex, and other technologies made in-person interactions less necessary. But it wasn’t until the arrival of the internet that the death of the office truly began. Online services such as email, video chat, and collaborative software dramatically reduced the need for physical proximity between employees. Today, white collar workers can perform most job duties remotely with these technologies.</p><p>And yet, before COVID-19, companies continued to spend significant money on office real estate. The <a href="https://priceithere.com/business-tips/how-much-does-it-cost-to-rent-office-space/#:~:text=In%20New%20York%2C%20the%20average,%2413%2C032%20per%20year%20per%20employee.">average price</a> for office space per employee is $14,800 per year in New York City, and $13,032 in San Francisco. Despite these advances in technology, companies still paid these sky-high prices for in-person interactions.</p><p>Many businesses assumed that offices offered irreplaceable benefits, particularly in terms of productivity. But was there any ever hard data to back that up?</p><p>Few studies probed this question directly, because the supremacy of offices was taken for granted. However, research about remote working allows for empirical comparisons between office and remote environments. And studies show that remote workers are actually more productive than office workers:</p><ul><li>Remote workers experience a 13% increase in performance over office workers, the equivalent of about an extra day of output per week (<a href="https://nbloom.people.stanford.edu/sites/g/files/sbiybj4746/f/wfh.pdf">Quarterly Journal of Economics</a>)</li><li>On average, remote workers have 37% less idle time than office workers (<a href="https://www.businessnewsdaily.com/15259-working-from-home-more-productive.html">AirTasker</a>)</li><li>77% of remote workers are more productive than their office counterparts (<a href="https://www.cosocloud.com/press-releases/connectsolutions-survey-shows-working-remotely-benefits-employers-and-employees">ConnectSolutions</a>)</li><li>91% of remote workers claim they are more productive when working remotely, as opposed to in an office (<a href="https://cdn2.hubspot.net/hubfs/443262/TINYpulse_What_Leaders_Need_to_Know_About_Remote_Workers.pdf">TINYpulse</a>)</li></ul><p>Without co-workers, office bustling, long lunch breaks, and other interruptions, employees get more done. Yet even in the face of this data, many companies still believe that workers are more productive in the office. In recent years, some companies have even <a href="https://www.hrtechnologist.com/articles/compensation-benefits/ibm-bans-workfromhome-policy/">rescinded</a> work from home policies on these grounds.</p><p>But as the studies above show, there is little evidence to suggest that office workers are more productive. If anything, the opposite seems true. Decades ago, workers could not perform their jobs without an office. Now, with new technologies, many workers perform their jobs <em>better </em>without an office.</p><p>This is what the “death” of the office looks like. The expensive, physical spaces designed to make businesses more productive actually reduce productivity.</p><p>Today, physical offices provide advantages that are not a function of productivity, but a function of social proof. Offices do not offer unique operational advantages. But they provide cultural currency. For example, in the eyes of investors and clients, physical office space makes a business more legitimate.</p><p>This helps explain why businesses will rarely if ever eliminate office space altogether. Before COVID-19, not having an office was considered too risky and idiosyncratic. But in the midst of the pandemic, businesses essentially operated in just such a manner. And that’s when the death of the office became apparent to the business world at large.</p><h3><strong>Maybe This Whole Office Thing Isn’t Working Out</strong></h3><p>For many companies, the COVID-19 office shutdowns were not like jumping into the deep end without knowing how to swim. Companies have been gradually incorporating remote working for years. Before COVID-19, <a href="https://www.flexjobs.com/blog/post/remote-work-statistics/">4.7 million Americans</a> worked remotely full time, roughly 3.4% of the population. And over 60 million Americans worked remotely some of the time, about <a href="https://news.gallup.com/businessjournal/206033/america-coming-workplace-home-alone.aspx">43% of the population</a>.</p><p>By the time COVID-19 struck, the infrastructure for remote working was already in place at many companies. Technologies such as Slack, Zoom, Google Documents, and Basecamp enabled effective real-time remote collaboration. As the seemingly impossible lift of going entirely remote unlocked new efficiencies, companies throughout the world reached a realization.</p><p>Maybe that whole office thing wasn’t all it was cracked up to be.</p><p>The COVID-19 shutdowns made companies see that the office, as it had been known for so many decades, was dead. And it had been for some time. For years, companies operated under the assumption that physical offices offered irreplicable benefits, an in-person alchemy that was essential for team efficiency, productivity, and cohesion. But the pandemic forced companies to see the truth.</p><p><a href="https://www.nytimes.com/2020/06/23/business/working-from-home-productivity.html">The New York Times </a>recently examined the productivity gains companies have seen since companies went remote for the pandemic:</p><ul><li>At <a href="https://www.cisco.com/">Cisco</a>, customer service representatives are taking more calls and customers are more satisfied with the help they receive.</li><li>Employees at <a href="https://www.chegg.com/">Chegg,</a> an education technology company, are completing projects ahead of schedule and taking on higher workloads.</li><li><a href="https://www.affirm.com/">Affirm</a>, a fintech financial lender, saw workers achieve “hyper-productivity,” reminiscent of startup growth.</li></ul><p>Of course, this is just anecdotal evidence. And it should also be noted that despite the boosted productivity, managers are worried about eventual employee burnout. But perhaps the best gauge of where companies stand on office space is how they’re investing their money.</p><p>In this regard, companies both big and small have vowed to reduce their office footprint. Three of New York City’s largest commercial tenants, Barclays, JP Morgan Chase, and Morgan Stanley, all plan to significantly <a href="https://www.cnbc.com/2020/05/01/major-companies-talking-about-permanent-work-from-home-positions.html">scale back</a> office space. Twitter has announced that all employees can work from home <a href="https://techcrunch.com/2020/05/12/twitter-says-staff-can-continue-working-from-home-permanently/">permanently</a> if they so choose. So has <a href="https://www.vox.com/recode/2020/5/21/21266570/facebook-remote-work-from-home-mark-zuckerberg-twitter-covid-19-coronavirus">Facebook</a>.</p><p>For smaller companies, the situation is even more pronounced. Startups are performing particularly well in smaller remote teams, and see no benefit to spending limited funding on unnecessary space. A majority of startups plan to move to an office/remote hybrid work model after the pandemic, while 11% have already <a href="https://techcrunch.com/2020/06/29/exclusive-survey-finds-startups-drifting-away-from-offices-post-covid-19/">permanently eliminated</a> their physical offices.</p><h3><strong>Out with the Old, In with the New</strong></h3><p>There’s been much talk about how COVID-19 killed the office. But, in reality, the office died a while ago. Due to emerging technologies, these physical spaces ceased to offer a competitive edge. The evidence was there all along, but it took a shock to the system like COVID-19 to force companies to realize this.</p><p>Of course, every company is different, and for some it makes perfect sense to keep the same amount of office space during and after COVID-19. Offices are not literally<em> </em>dead. There will always be a market for commercial office space. What has actually died is our shared <em>concept</em> of the office. The fact is, most companies will neither keep all their office space nor eliminate all of it. They will adopt a hybrid approach. But the office will never again be seen as the nucleus of productivity in a company.</p><p>With such a focus on white collar offices, it should also be noted that millions of workers cannot work remotely under any circumstances. According to the <a href="https://www.brookings.edu/blog/up-front/2020/04/06/telecommuting-will-likely-continue-long-after-the-pandemic/">Brookings Institute</a>, half of all American workers did not work remotely during the pandemic. For grocery stockers, delivery drivers, nurses, and emergency personnel, physical workspaces will always be an inseparable part of the job.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=e01119bb8727" width="1" height="1" alt=""><hr><p><a href="https://medium.com/rivery-blog/why-offices-were-dead-before-covid-19-e01119bb8727">Why Offices Were Dead Before COVID-19</a> was originally published in <a href="https://medium.com/rivery-blog">rivery-blog</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Covid’s impact on data science job openings and career prospects]]></title>
            <link>https://medium.com/rivery-blog/covids-impact-on-data-science-job-openings-and-career-prospects-47f04b4ec4ff?source=rss----2155f39f5170---4</link>
            <guid isPermaLink="false">https://medium.com/p/47f04b4ec4ff</guid>
            <category><![CDATA[data-science-education]]></category>
            <category><![CDATA[data-science]]></category>
            <category><![CDATA[data-science-job]]></category>
            <category><![CDATA[data-science-careers]]></category>
            <category><![CDATA[data-science-training]]></category>
            <dc:creator><![CDATA[Daniel Buchuk]]></dc:creator>
            <pubDate>Tue, 01 Sep 2020 15:48:09 GMT</pubDate>
            <atom:updated>2020-09-01T15:48:09.677Z</atom:updated>
            <content:encoded><![CDATA[<h3><strong>COVID-19&#39;s Impact on Data Science Job Openings and Career Prospects</strong></h3><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*t6Jq3oAwrqtw7_t633a85Q.jpeg" /></figure><p>Harvard Business Review named it <a href="https://hbr.org/2012/10/data-scientist-the-sexiest-job-of-the-21st-century">the sexiest job of the 21st Century</a>. Data scientist has become one of the fastest growing careers over the past decade, as well as one of the best paid disciplines. The shortage of skilled data scientists became a serious constraint in certain sectors, which are determined to become more data driven. This means that data scientists became some of the most sought-after professionals, often fencing multiple job offers and commanding exceptional compensation packages. In the US, most roles for experienced data scientists (such as data architects, data engineers, machine learning scientists) pay<a href="https://www.northeastern.edu/graduate/blog/data-science-careers-shaping-our-future/"> six figure salaries on average</a>.</p><p>The demand for skilled professionals in this field also means that there has been a boom in courses and degrees focusing on data. Not only in terms of formal education, but there are also multiple open resources online to learn the craft, and also to get all the insider tips for a fruitful career in data science.</p><p>For example, <a href="https://www.youtube.com/channel/UCiT9RITQ9PW6BhXK0y2jaeg">Ken Lee’s YouTube channel</a> is a great resource dedicated to helping people with an interest in the subject with tools, tips, and advice on how to start and build a career in data science.</p><p>And then Covid happened.</p><p>There is virtually no industry that hasn’t been impacted by the global pandemic — whether directly or indirectly. Many people have lost their jobs, and even in the sexiest, and most sought-after disciplines, the job market is tough.</p><p>Edward Harris, from <a href="https://towardsdatascience.com/">Towards Data Science</a>, saw the impact first hand earlier this year, as their organization mentors data scientists before they get hired. While there was a general hiring slowdown during March, he saw a drop<a href="https://towardsdatascience.com/whats-happened-to-the-data-science-job-market-in-the-past-month-88c748a4cd25"> of about 60–70% for data scientists. </a>In addition, some job offers were withdrawn, something which was highly unusual before the pandemic.</p><p>Fast-forward to July, and Quartz reported that <a href="https://qz.com/work/1886620/data-scientist-job-postings-on-indeed-are-in-deep-decline/">data science jobs are still in deep decline</a>. Data from Indeed revealed that the number of US job postings was down 43% from last year and outside US tech hubs, that figure goes up to 51% below year-ago levels. Tech jobs as a whole are d<a href="https://www.businessinsider.com/indeed-tech-job-postings-are-down-36-from-last-year-2020-8">own 36% from their July 2019 level</a>, exceeding the 21% decline in overall job postings during the pandemic.</p><p>An uncertain future?</p><p>Data roles will be increasingly important, in spite of the pandemic. In fact, many businesses are looking deeper into their data (and their data processes) to operate more efficiently and make better informed decisions in uncertain times where budgets are being slashed across many departments.</p><p>It will be interesting to see whether this drop in job openings will affect the next generation of data scientists or students that are now choosing what to study in college. Tech courses remain some of the most attractive courses. In fact, <a href="https://www.princetonreview.com/college-advice/top-ten-college-majors">The Princeton Review</a> found that computer science is currently the most popular college major in the US.</p><p>While tech leaders like Tim Cook and Elon Musk have highlighted in the “skills gap” when it comes to qualified employees in data and engineering disciplines, this might be a good opportunity for them to recruit — as there’s a bigger talent pool and you could argue that it might become a “buyer’s market”.</p><p>It’s important to emphasize that the job decline is happening across most sectors, so it might not be the wisest move for someone passionate about data to choose an alternative path in college based on these extenuating circumstances. Ultimately, companies rely upon talent to thrive and the need for better business insights and <a href="https://rivery.io/">smarter data processes</a> are here to stay.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=47f04b4ec4ff" width="1" height="1" alt=""><hr><p><a href="https://medium.com/rivery-blog/covids-impact-on-data-science-job-openings-and-career-prospects-47f04b4ec4ff">Covid’s impact on data science job openings and career prospects</a> was originally published in <a href="https://medium.com/rivery-blog">rivery-blog</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[74% of executives predict AI will be integrated into all enterprise applications within three years]]></title>
            <link>https://medium.com/rivery-blog/74-of-executives-predict-ai-will-be-integrated-into-all-enterprise-applications-within-three-years-48834b68e74a?source=rss----2155f39f5170---4</link>
            <guid isPermaLink="false">https://medium.com/p/48834b68e74a</guid>
            <category><![CDATA[ai]]></category>
            <category><![CDATA[machine-learning]]></category>
            <category><![CDATA[deep-learning]]></category>
            <category><![CDATA[deloitte]]></category>
            <category><![CDATA[big-data]]></category>
            <dc:creator><![CDATA[Daniel Buchuk]]></dc:creator>
            <pubDate>Tue, 11 Aug 2020 13:53:22 GMT</pubDate>
            <atom:updated>2020-08-11T13:53:22.154Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/640/1*svEGrDDSZaH5EvRwLqbCOA.jpeg" /></figure><p>After 5 years of relentless buzz about AI, is it finally hitting the mainstream? A <a href="https://www2.deloitte.com/content/dam/insights/us/articles/6462_state-of-ai-in-the-enterprise/DI_State-of-AI.pdf">new report</a> by the Deloitte AI Institute about the State of BI in the Enterprise shows the giant leaps that enterprise businesses are taking to integrate AI into their data processes.</p><p>To obtain these insights, Deloitte surveyed 2,737 executives across nine countries from companies which have adopted AI technology. In this year’s survey, <strong>73% of adopters say AI is very or critically important to their business success today</strong>, and 71% expect to increase their investment next fiscal year.</p><p>An interesting finding from the report is the overwhelming preference that enterprises have for buying over building AI technology in-house. Just 8% of the executives surveyed said they will “build all” their AI technology, and 13% responded they will “build more than buy.” The remaining 79% will be looking to purchase solutions within a thriving market of tools and alternatives that fit their needs.</p><p>With this appetite for outsourced AI tech it is not surprising that AI startups <a href="http://venturebeat/">raised $31.8 billion</a> over 2,899 deals in 2019. Of course, there are multiple types of technologies within the umbrella of AI, including machine learning, deep learning, natural language processing, and computer vision. So it is important not to treat AI as a homogeneous industry, whether in terms of technologies, the companies developing solutions, or the market needs.</p><p>In the words of Jason Yosinski, co-founder of Uber AI Labs: “This is a new period in the world’s history — we build models and machines in AI that are more complicated than we can understand”. No matter the industry, it is most likely being equipped with AI technology to evolve.</p><p>Whether it is <a href="https://www.marketingweek.com/the-future-of-ai-marketing/">used by marketing teams </a>to model and predict user behavior, or by e-commerce platforms to <a href="https://readwrite.com/2020/08/06/the-future-of-cybersecurity-in-the-hands-of-ai/">mitigate cyber attacks</a>, the applications of AI are broad and diverse. To an extent, any data-driven organization that relies upon insights or <a href="https://rivery.io/solution/data_orchestration/">vast amounts of data </a>will benefit from AI technologies.</p><p>For some companies, AI is about automating processes previously executed by humans. But for most businesses, AI will optimize processes, such as preventing fraud, finding errors in software code, or personalizing ad placement. AI technologies also enhance what individuals and teams can accomplish. AI enables much more sophisticated data analysis and insights that can predict trends, forecast revenues, and even diagnose patients with better data.</p><p>But while a machine can suggest the right reply to an email, it won’t kill human jobs any time soon. That’s because AI can’t replace human cognitive skills. In an article for MIT Tech Review titled <a href="https://www.technologyreview.com/2020/02/19/868178/what-ai-still-cant-do/">What AI still can’t do</a>, Judea Pearl explains that AI can’t be truly intelligent until it has a rich understanding of cause and effect. As a quote from the article explains the dilemma of machine intelligence: “It’s as if you knew that the presence of clouds made rain likelier, but you didn’t know clouds caused rain.”</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=48834b68e74a" width="1" height="1" alt=""><hr><p><a href="https://medium.com/rivery-blog/74-of-executives-predict-ai-will-be-integrated-into-all-enterprise-applications-within-three-years-48834b68e74a">74% of executives predict AI will be integrated into all enterprise applications within three years</a> was originally published in <a href="https://medium.com/rivery-blog">rivery-blog</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Is it time for marketers and advertisers to embrace Snapchat?]]></title>
            <link>https://medium.com/rivery-blog/is-it-time-for-marketers-and-advertisers-to-embrace-snapchat-c1b1c3306b81?source=rss----2155f39f5170---4</link>
            <guid isPermaLink="false">https://medium.com/p/c1b1c3306b81</guid>
            <category><![CDATA[social-media-marketing]]></category>
            <category><![CDATA[digital-advertising]]></category>
            <category><![CDATA[snapchat]]></category>
            <category><![CDATA[snapchat-marketing]]></category>
            <category><![CDATA[marketing-technology]]></category>
            <dc:creator><![CDATA[Daniel Buchuk]]></dc:creator>
            <pubDate>Thu, 16 Jul 2020 16:23:35 GMT</pubDate>
            <atom:updated>2020-07-16T16:23:35.748Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/640/1*kAxzEMR40OVRAQ3KnTlrTA.jpeg" /></figure><p>Snapchat reaches 90% of the 13 to 24-year-old population in the US, with the average user spending over 30 minutes a day on the platform. However, many advertisers still struggle to grasp the value of the platform as they’re not fully familiar with the dynamics within it. As the social platform tries to lure more advertiser dollars, they <a href="https://www.searchenginejournal.com/snapchat-launches-ads-certification-program/372124/#close">announced the launch of ‘Focus’</a>, their new module-based training for advertisers and brands. Dubbed as the place for “everything you need to know about Snapchat ads,” this comes as part of a push from the company to grow both users and the app’s abilities.</p><p>Last month, Snapchat launched <a href="https://businesshelp.snapchat.com/en-US/a/dynamic-ads">Dynamic Ads</a> to make it easier for brands to drive e-commerce sales through the social platform. The COVID-19 lockdown has meant that many businesses are working tirelessly to shape their e-commerce efforts in response to consumer demand. In this environment, Snap is steadily pushing to get more ad dollars.</p><p>As the younger demographics continue to abandon Facebook and older demographics start embracing Instagram, Snapchat has maintained its small but mighty hold on the elusive 13–24 demographic. The company claims 170 million people use the app’s augmented reality daily, up from 55 million in 2017. What’s more, Snap states that there has been a 40% increase year over year in consumption of “Discover” content, a crucial part of the platform for both publishers and advertisers to target users.</p><p>It is a brilliant opportunity for advertisers if seized correctly. It might not have the reach of a Facebook or Google, but can reach a demographic which is notoriously difficult to target through digital advertising. At Rivery, it’s no surprise to see that two of our Top10 most used data integration API connectors by our customers are for Google or LinkedIn Ads. Interestingly, our <a href="https://rivery.io/integration/snapchat_ads/">Snapchat Ads API</a> is nowhere near as popular.</p><p><strong>What will it take for marketers to embrace the social platform?</strong></p><p>On the one hand, advertisers love to complain about the hold that Facebook and Google have on the digital advertising industry. On the other hand, our data shows that many advertisers are often slow and reluctant to embrace new networks and platforms. Of course, not every brand will be interested in appealing to Snapchat’s demographic. However, it is something that every brand complaining about how ‘instagram is getting older’ should try.</p><p>The industry is slow to move, but those who have the vision and agility to act fast are often reap enormous benefits. It’s important to remember how long it took for big brands to embrace Facebook as a platform that delivers enormous ROI.</p><p>And this isn’t only about Snapchat. Considering other platforms such as TikTok will be crucial for those brands trying to appeal to a young demographic. A couple of weeks ago the emerging social giant <a href="https://techcrunch.com/2020/06/25/tiktok-launches-tiktok-for-business-for-marketers-takes-on-snapchat-with-new-ar-ads/">officially introduced</a> a new brand and platform called “<a href="https://www.tiktok.com/business/">TikTok For Business</a>” that will serve as the home for all its current and future marketing solutions for brands.</p><p>At launch, the site will include access to TikTok ad formats, including its marque product, TopView, which is the ad that appears when you first launch the TikTok app. While TikTok doesn’t publicly disclose the pricing for its ad tools and solutions, they claim pricing is based on what the brand wants to achieve and the scope of its campaign.</p><p>It is interesting to see how some of our customers at Rivery (some of which are marketing agencies or divisions) use the different digital advertising platforms. And while some of our users (very few!) are already embracing Snapchat and the data it brings about a coveted demographic, it’s still in the hands of a few early adopters at this stage.</p><p>Even though <a href="https://www.statista.com/statistics/814300/snapchat-users-in-the-united-states-by-age/">78% of internet</a> users aged 18–24 use Snapchat, the company’s worldwide advertising revenue in 2019 was merely <a href="https://www.statista.com/statistics/603550/snapchat-worldwide-advertising-revenue/">$1.53 billion</a>. We look forward to seeing what platforms marketers place their bets to reach a younger generation.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=c1b1c3306b81" width="1" height="1" alt=""><hr><p><a href="https://medium.com/rivery-blog/is-it-time-for-marketers-and-advertisers-to-embrace-snapchat-c1b1c3306b81">Is it time for marketers and advertisers to embrace Snapchat?</a> was originally published in <a href="https://medium.com/rivery-blog">rivery-blog</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Top 8 LinkedIn Groups for Data Science]]></title>
            <link>https://medium.com/rivery-blog/top-8-linkedin-groups-for-data-science-8140d3840dd3?source=rss----2155f39f5170---4</link>
            <guid isPermaLink="false">https://medium.com/p/8140d3840dd3</guid>
            <category><![CDATA[networking]]></category>
            <category><![CDATA[linkedin]]></category>
            <category><![CDATA[data-science]]></category>
            <dc:creator><![CDATA[Kevin Bartley]]></dc:creator>
            <pubDate>Fri, 10 Jul 2020 15:57:41 GMT</pubDate>
            <atom:updated>2020-07-13T18:42:30.349Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*grAk1kpwM_pYPYXn5Gq-mg.png" /></figure><p>As the premier social platform for networking, LinkedIn hosts many groups that provide unparalleled professional insights. Groups related to data science are especially active and informative on the LinkedIn platform.</p><p>LinkedIn data science groups cover a host of topics, from <a href="https://rivery.io/">data integration</a> and visualization, to job postings and coding. But with so many groups to choose from, it’s important to identify the groups worth your time</p><p>Here are the top eight LinkedIn groups for data science.</p><ol><li><a href="https://www.linkedin.com/groups/8535151/">Advanced Analytics and Data Science</a></li></ol><p>This group is designed for data-driven professionals who want to learn advanced analytics and data science. The group covers topics such as big data, predictive analytics, statistics, machine learning, real-time analytics, and more. Group members hail from diverse backgrounds, from data scientists and data analysts, to data-driven decision makers in operations, marketing, finance, and other departments.</p><p>2. <a href="https://www.linkedin.com/groups/54257/">KDnuggets AI, Big Data, Data Science, Machine Learning group</a></p><p>This LinkedIn group is an outgrowth of KDnuggets, the data science forum known for rigorous, novel research submitted by contributors. The KDnuggets group amplies contributor research projects, which are typically derived from real-world problems, along with original postings from LinkedIn members. The group enables in-depth discussions on anything from deep learning to the latest COVID-19 data models. A must join for those who think data is awesome and beautiful.</p><p>3. <a href="https://www.linkedin.com/groups/1824590/">Data Warehouse — Big Data — Hadoop — Cloud — Data Science — ETL</a></p><p>Learn, discuss, and educate, along with other data professionals, on the intersection between data warehousing and data science. Find out how to best operationalize data science projects using data warehousing, including best practices and the latest tips on generating efficiencies. The group also has a strong community presence that offers great connections and opportunities for data professionals.</p><p>4. <a href="https://www.linkedin.com/groups/35222/">Data Science Central</a></p><p>Data Science Central is a large community (over 330,000 members) that focuses on data science, AI, deep learning, big data, Hadoop, business intelligence, and much more. With its deep reservoir of user support, Data Science Central offers a broad range of perspectives on all things data. The group is Co-founded by Vincent Granville and is a part of the DataScienceCentral.com community.</p><p>5. <a href="https://www.linkedin.com/groups/152247/">Data Mining, Statistics, Big Data, Data Visualization, AI, Machine Learning, and Data Science</a></p><p>This group offers data mining and statistical professionals a space to share ideas, projects, and issues while networking with other members. Discussions range from software and technology (Hadoop, relational databases), to conferences and job postings. The group also gives professionals a venue to advertise their services.</p><p>6. <a href="https://www.linkedin.com/groups/23006/">Big Data, Analytics, Business Intelligence &amp; Visualization Experts Community</a></p><p>This community empowers data professionals and data-driven companies to research the convergence of big data analytics, data warehousing, unified data architectures, digital marketing, and much more. The group’s 300,000+ members are developers, data scientists, business analysts, marketers, enterprise architects, CIOs, CDOs, and other interested professionals.</p><p>7. <a href="https://www.linkedin.com/groups/1895501/">RMDS — Research Methods and Data Science</a></p><p>As an extension of the community at <a href="http://www.grmds.org/">www.GRMDS.org</a>, RMDS is perfect for those who are concerned with the research aspects of data science. RMDS offers members a forum to discuss research methodologies, including research flow management, process standardization, automation, competency assessment, among other topics. The group also focuses on how to use AI to improve research.</p><p>8. <a href="https://www.linkedin.com/groups/4488721/">Data Science and Artificial Intelligence</a></p><p>With about 33,000 members, Data Science and Artificial Intelligence offers a closer knit community for data scientists that want to research, learn, and educate. The group is tailored for a wide variety of topics and verticals, so data professionals of all backgrounds can gain something by joining. The active networking culture is also helpful, especially for those new to the field.</p><p><strong>LinkedIn Groups: A Way for Data Scientists to Connect and Grow with Peers</strong></p><p>The scene for data science groups on LinkedIn is robust and thriving. Every day, new groups seem to pop up to support this rapidly growing professional sector. The groups we listed are some of the best, but there are many other fantastic data science communities on LinkedIn as well. Reach out to us if you think we should feature a specific group in one of our upcoming lists!</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=8140d3840dd3" width="1" height="1" alt=""><hr><p><a href="https://medium.com/rivery-blog/top-8-linkedin-groups-for-data-science-8140d3840dd3">Top 8 LinkedIn Groups for Data Science</a> was originally published in <a href="https://medium.com/rivery-blog">rivery-blog</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Only 21% of the global workforce fully confident in their data literacy skills]]></title>
            <link>https://medium.com/rivery-blog/only-21-of-the-global-workforce-fully-confident-in-their-data-literacy-skills-6f7fba489edf?source=rss----2155f39f5170---4</link>
            <guid isPermaLink="false">https://medium.com/p/6f7fba489edf</guid>
            <category><![CDATA[analytics]]></category>
            <category><![CDATA[data-literacy]]></category>
            <category><![CDATA[business-skills]]></category>
            <category><![CDATA[data-science]]></category>
            <category><![CDATA[data-skills]]></category>
            <dc:creator><![CDATA[Daniel Buchuk]]></dc:creator>
            <pubDate>Wed, 08 Jul 2020 14:16:26 GMT</pubDate>
            <atom:updated>2020-07-08T14:16:26.002Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/640/1*Fq15nUA-XbGzL2OMVpujYA.jpeg" /></figure><p>According to a recent <a href="https://www.accenture.com/_acnmedia/PDF-115/Accenture-Human-Impact-Data-Literacy-Latest.pdf">study from Accenture</a>, 92% of business executives think it’s important for their employees to be data literate, yet just 21 percent of the global workforce are fully confident in their data literacy skills — i.e., their ability to read, understand, question and work with data.</p><p>While organizations are collecting, storing, and analyzing more and more data, its real potential remains largely untapped. In fact, research from Forrester found that up to <a href="https://www.inc.com/jeff-barrett/misusing-data-could-be-costing-your-business-heres-how.html">73 percent of all enterprise data goes unused</a> for analytics.</p><p>The increased availability of data has its own set of challenges. Accenture’s research found that nearly three quarters (74 percent) of employees said they feel overwhelmed or unhappy when working with data. As a result, this impacts their performance, with more than one-third (36 percent) of respondents stating they spend at least one hour a week procrastinating over data-related tasks.</p><p>With most businesses trying to foster a data-driven workplace and corporate culture, the gap in skills when it comes to data literacy needs to be tackled fast and efficiently. There is no point in owning a state-of-the-art data stack if your teams can’t put it to good use. What’s more, if the corporate rollout of your data and analytics tools isn’t successful, you might not only be harming your company’s insights but also your teams’ morale — expecting them to operate with tools they’re not comfortable with.</p><p>Companies need to acknowledge this issue and take charge if there is a serious expectation from their team to fluently handle data and business insights as part of their role. There is a difference between data appreciation and employee adoption. In fact, Accenture’s report highlights that two-thirds of C-suite executives, senior managers and directors would go with their gut feeling over data-driven insight.</p><p>People in the industry are also taking action to address the gap in data literacy. Qlik, the analytics company launched the <a href="https://thedataliteracyproject.org/about">Data Literacy Project</a>, alongside academic thought leaders and industry partners including Accenture, Cognizant, Experian, Pluralsight, the Chartered Institute of Marketing, and Data to the People. Together, they aim to ignite discussion and develop the tools we need to shape a successful, data literate society.</p><p>As data becomes more democratic within organizations, CIOs and team leaders have the responsibility to provide their teams with the tools and skills needed to help their businesses leverage their data. Understanding that most people aren’t comfortable with slicing and dicing data, or overwhelmed by tools and platforms they’re not familiar with is a great start.</p><p>At <a href="https://rivery.io/">Rivery</a>, we make a conscious effort to simplify data processes, to ensure data is accessible to anyone. Teams should be able to control their data (without having to code!) so they can freely unleash their insights — and more importantly, work with data confidently. While there is an expectation from organizations that their employees should be more data literate, it is also the responsibility of the industry to provide intuitive tools that can be adopted quickly and efficiently by anyone. The idea of democratizing data won’t be a revolution, but an evolution.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=6f7fba489edf" width="1" height="1" alt=""><hr><p><a href="https://medium.com/rivery-blog/only-21-of-the-global-workforce-fully-confident-in-their-data-literacy-skills-6f7fba489edf">Only 21% of the global workforce fully confident in their data literacy skills</a> was originally published in <a href="https://medium.com/rivery-blog">rivery-blog</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Sooner or later, you must eliminate the data silos holding back your business]]></title>
            <link>https://medium.com/rivery-blog/sooner-or-later-you-must-eliminate-the-data-silos-holding-back-your-business-5c0b5715d250?source=rss----2155f39f5170---4</link>
            <guid isPermaLink="false">https://medium.com/p/5c0b5715d250</guid>
            <category><![CDATA[data-integration]]></category>
            <category><![CDATA[towards-data-science]]></category>
            <category><![CDATA[data-silos]]></category>
            <category><![CDATA[data-management]]></category>
            <category><![CDATA[machine-learning]]></category>
            <dc:creator><![CDATA[Daniel Buchuk]]></dc:creator>
            <pubDate>Tue, 30 Jun 2020 15:06:25 GMT</pubDate>
            <atom:updated>2020-06-30T15:06:25.308Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/640/1*FDZhR9E0HZcMJJKthqjhXw.jpeg" /></figure><p>Data Silos are still a problem.</p><p>Firstly, they often mean unnecessary duplication and repetitive work that could be centralized and streamlined across an organization. Secondly, by not orchestrating and aligning company data, a lot of valuable insights that could emerge from orchestrating all data will never see the light of day.</p><p>This means that siloing is becoming an increasingly acute problem for businesses, <strong><em>creating inefficiencies across their operations and more worryingly, not giving management teams the 360 customer or product views that they need to make critical business decisions.</em></strong></p><p>There are a few factors that trigger this. Today’s data-driven teams maintain and manipulate myriad data sources. This includes external sources, such as Facebook Ads, Salesforce, and ZenDesk, along with internal sources, such as mongoDB, mySQL, and SFTP. Teams that want to scale effectively must avoid siloing these diverse data sources. The more a company scales up, the harder siloed data is to combine, manage, and analyze.</p><p>Data integration platforms eliminate data siloing altogether. These platforms aggregate data from any source, internal or external, inside a single repository. This enables teams to unify all data sources in a single infrastructure. <strong><em>Companies can scale up without the bottlenecks of dislocated data sources. </em></strong>There are many <a href="https://rivery.io/new-rivery-ebook-5-data-integration-projects-you-can-automate-right-now/">data integration processes that can be automated</a>, not only reducing silos within your organization but also improving efficiencies across the board.</p><blockquote>Data integration platforms eliminate data siloing altogether.</blockquote><p>Many organizations leverage a d<a href="https://rivery.io/solution/data-migration-to-cloud/">ata migration to a new cloud data warehouse</a> as a stepping stone or opportunity to orchestrate all their data sources, align the insights across teams, and ultimately centralize the way they manage data. In addition to the obvious efficiencies in terms of saving time and money, ending data silos means taking data processes to the next level. <strong><em>Once all data points are aligned, you can finally get the full picture of your operational performance.</em></strong> Even though we often take charts and graphs as gospel, these insights are often incomplete and they might be hiding some truth bombs you should be aware of.</p><p>In addition, as companies move towards machine learning algorithms and dip their toes into AI, it is essential for them to unify and align all their data first. These emerging technologies rely on as many data points and data sources as possible to be able to generate accurate insights, predictions, or even take automatic action through AI.</p><blockquote>Sooner or later, all your data will have to be in sync and align so it can become the single source of truth across your organization.</blockquote><p>It is normal to have data silos. After all, they probably emerged organically as different teams or employees looked for ways to improve their data collection processes. However, having a data overhaul in which processes are streamlined is a must. Sooner or later, all your data will have to be in sync and align so it can become the single source of truth across your organization. In addition, it will give you an opportunity to develop new KPIs, that accurately depict your performance and help teams make the best decisions with the most comprehensive insights.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=5c0b5715d250" width="1" height="1" alt=""><hr><p><a href="https://medium.com/rivery-blog/sooner-or-later-you-must-eliminate-the-data-silos-holding-back-your-business-5c0b5715d250">Sooner or later, you must eliminate the data silos holding back your business</a> was originally published in <a href="https://medium.com/rivery-blog">rivery-blog</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
    </channel>
</rss>