<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0" xmlns:cc="http://cyber.law.harvard.edu/rss/creativeCommonsRssModule.html">
    <channel>
        <title><![CDATA[Stories by Cloudera, Inc. on Medium]]></title>
        <description><![CDATA[Stories by Cloudera, Inc. on Medium]]></description>
        <link>https://medium.com/@clouderainc?source=rss-475d0d40b87a------2</link>
        <image>
            <url>https://cdn-images-1.medium.com/fit/c/150/150/2*arOrQI-MZhRc1prEAcAspQ.png</url>
            <title>Stories by Cloudera, Inc. on Medium</title>
            <link>https://medium.com/@clouderainc?source=rss-475d0d40b87a------2</link>
        </image>
        <generator>Medium</generator>
        <lastBuildDate>Tue, 17 Nov 2026 20:39:53 GMT</lastBuildDate>
        <atom:link href="https://medium.com/@clouderainc/feed" rel="self" type="application/rss+xml"/>
        <webMaster><![CDATA[yourfriends@medium.com]]></webMaster>
        <atom:link href="http://medium.superfeedr.com/" rel="hub"/>
        <item>
            <title><![CDATA[How data helps address healthcare consumerism for price transparency]]></title>
            <link>https://medium.com/cloudera-inc/how-data-helps-address-healthcare-consumerism-for-price-transparency-2d581547f325?source=rss-475d0d40b87a------2</link>
            <guid isPermaLink="false">https://medium.com/p/2d581547f325</guid>
            <category><![CDATA[big-data]]></category>
            <category><![CDATA[cloudera]]></category>
            <category><![CDATA[healthcare]]></category>
            <dc:creator><![CDATA[Cloudera, Inc.]]></dc:creator>
            <pubDate>Wed, 15 Jan 2020 16:03:14 GMT</pubDate>
            <atom:updated>2020-01-16T18:08:56.961Z</atom:updated>
            <content:encoded><![CDATA[<p><em>By Abbas Mooraj, Managing Director, Healthcare and Life Sciences</em></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*WXHumQlRN7XtJTIsnJjA7g.png" /></figure><p>Today’s consumers want to interact with their healthcare like it’s a retail experience. They want to shop for services based on costs, find alternative times and locations for care — such as urgent care or minute clinics during evenings and on weekends, have their providers incorporate data from wearables and other personal devices into care plans and generally take more control over their own health.</p><p>And while healthcare organizations want to deliver what their patients or members want — and are taking steps to deliver some services that mirror retail — they are now faced with policies that enforce more price transparency for consumers. For example, <a href="https://www.modernhealthcare.com/reports/achieving-transparency-in-healthcare/#!/">85% of self-insured employers offer healthcare cost estimator tools</a> to their employees to search for common clinical services and get cost estimates before seeking care — something usually offered through organizations such as Castlight or Truven Health Analytics. However, more can be done.</p><p>I believe a big part of helping healthcare organizations on this journey toward consumerism and price transparency centers around data and our ability to stream, ingest and consume information to better meet patients’ and members’ needs. Earlier in my career, I worked at Partners HealthCare (now Mass General Brigham), where I led and managed large-scale analytics initiatives. Recently, Partners announced a $100 million digital health <a href="https://www.fiercehealthcare.com/tech/partners-healthcare-launches-100m-five-year-digital-health-initiative">initiative</a> “to advance patient reach, impact and outcomes in a transformational way.” The goal is to make healthcare more convenient and accessible with online appointment tools, video and text communication with providers. In addition, Partners plans to expand their efforts by offering cost estimates for procedures and diagnostic imaging.</p><h3>Healthcare consumerism drivers</h3><p>Recently, the push to achieve the “<a href="https://qsinstitute.com/about/what-is-quantified-self/">Quantified Self</a>,” whose motto is “self-knowledge through self-tracking,” is among the movements pioneering trends toward consumerism. It promotes the monitoring of daily activities and physiological details to “find personal meaning in your personal data.”</p><p>In addition, consumers are using the internet or mobile apps for quality and medical cost comparisons more frequently. A recent<a href="https://www.healthleadersmedia.com/finance/price-shopping-influencing-healthcare-choices"> survey</a> indicates that 36% of consumers were using the internet or mobile apps to check medical services quality and cost — an increase of 257% from 2012 when just 14% said they had done price shopping.</p><p>Another factor driving price shopping in healthcare is the number of high-deductible health insurance plans being offered. Approximately <a href="https://scholar.harvard.edu/mehrotra/consumerism-price-transparency-and-high-deductible-health-plans">half of all people who have employer-offered health insurance</a> have a high-deductible health plan. This means employers also have a vested interest in making sure their employees are given the opportunity to compare health care costs whenever possible to help manage their out-of-pocket expenditures.</p><p>Two main issues need to be resolved for this future consumer- and policy-driven state of healthcare to happen: how to collect, store, analyze and act on unimaginable amounts of data, and — mindful of strict HIPAA regulations — how to secure it and protect people’s privacy. Neither are to be reckoned with lightly.</p><h3>How regulators are responding</h3><p>In response to consumers’ growing demands for healthcare price transparency, and in an effort to lower healthcare costs, the Centers for Medicare and Medicaid Services (CMS) recently finalized<a href="https://www.cms.gov/newsroom/fact-sheets/cy-2020-hospital-outpatient-prospective-payment-system-opps-policy-changes-hospital-price"> policies</a> that follow directives in President Donald Trump’s Executive Order, “Improving Price and Quality Transparency in American Healthcare to Put Patients First.” The goal is to put a system in place to create price transparency for hospital items and services in the U.S. The thinking is that patients can be more informed about what they pay before service is delivered — and being more mindful of costs and selecting providers based on who will deliver the lowest cost service with high-quality outcomes — will drive down costs.</p><p>Healthcare payers and providers are challenged on a variety of levels to deliver this type of information, and have expressed the following concerns:</p><ul><li>Overwhelming amounts of data for payers and providers to sift through before offering information to consumers</li><li>Too much data for consumers to easily review on their own</li><li>Disclosure of proprietary information</li><li>Hampered negotiations if medical providers see they are underpriced compared with peers</li></ul><p>Information required to respond to the policies for providers and payers needs to include gross charges, negotiated rates and cash prices for every one of thousands of services offered by hospitals, which they will be required to update annually.</p><p>To make the information easier for consumers to understand, providers are also required to put together “shoppable” services that include all the ancillary charges for procedures like knee replacements, hernia repairs and other treatments.</p><p>In another policy-related push to pressure organizations to better manage costs, the Trump administration announced an effort to explore ways to i<a href="https://www.businessinsider.com/trump-exploring-imports-of-cheaper-prescription-drugs-from-canada-2019-7">mport cheaper prescription medications from Canada and other countries</a> earlier this year.</p><p>While this holds a promise of lower-cost drugs, details need to be worked out, including exploration of new rules for states, pharmacies, and other parties to bring Canadian drugs into the US through a pilot project. The US Food and Drug Administration could also allow manufacturers to bring their versions of drugs sold overseas into the US.</p><p>According to <a href="https://www.businessinsider.com/trump-exploring-imports-of-cheaper-prescription-drugs-from-canada-2019-7">Health and Human Services Secretary Alax Azar</a>, “We all know how unfair it is that other countries are paying lower prices for the same drugs, and we’re taking action.”</p><p>While pending regulations present valid reasoning for price transparency and lowering drug costs, enforcing the regulations adds additional workforce burdens and costs to already-strained healthcare organizations. Plus, regulations will take years to put in place, and then more years to determine their effectiveness.</p><h3>How big data can provide assistance to healthcare organizations</h3><p>Here’s how we believe data that can be streamed, ingested and used in a hybrid and cloud-agnostic environment can help healthcare organizations respond to price transparency policies.</p><ul><li>Offer multi-function analytics that stream and integrate data management and analytic experiences on all data types from anywhere, including public and private clouds or hybrid clouds.</li><li>Provide structure to a variety of unstructured data sources for better usability, including data from edge applications like bedside monitors, to electronic health records and more.</li><li>Offer a secure and governed environment that meets enterprise security, compliance, migration and metadata management needs, which are all essential to managing HIPAA and the Privacy Rule for protected health information, or PHI.</li></ul><p>Cloudera is not alone in efforts to offer better price transparency and respond to rising healthcare costs. I previously worked at Optum for the analytics team that provided an analytics platform and solution to payers and providers to help them improve their clinical and financial performance. In a recent Forbes article, <a href="https://www.forbes.com/sites/brucejapsen/2019/12/04/unitedhealth-president-optum-rolling-out-seamless-healthcare-city-by-city/#11c448f81f41">Andrew Witty</a>, president of UnitedHealth Group and CEO of Optum, said that the hundreds of clinics, surgery centers and urgent care assets the company has acquired will increasingly be “wired together” in markets across the U.S. to create a more seamless experience for patients.</p><p>I feel that the era of consumerism that is driving price transparency in healthcare is a positive step forward for everyone — patients, members and healthcare organizations — that will require all of us to wrap our arms around big data in a way that helps drive down overall healthcare costs while enhancing overall care quality.</p><p><strong>For additional information about Cloudera in healthcare, please visit our </strong><a href="https://www.cloudera.com/solutions/healthcare.html"><strong>webpage</strong></a><strong>.</strong></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=2d581547f325" width="1" height="1" alt=""><hr><p><a href="https://medium.com/cloudera-inc/how-data-helps-address-healthcare-consumerism-for-price-transparency-2d581547f325">How data helps address healthcare consumerism for price transparency</a> was originally published in <a href="https://medium.com/cloudera-inc">Cloudera</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[A new era of SQL-development, fueled by a modern data warehouse]]></title>
            <link>https://medium.com/@clouderainc/a-new-era-of-sql-development-fueled-by-a-modern-data-warehouse-7b0fb485a968?source=rss-475d0d40b87a------2</link>
            <guid isPermaLink="false">https://medium.com/p/7b0fb485a968</guid>
            <category><![CDATA[data-warehouse]]></category>
            <category><![CDATA[big-data]]></category>
            <category><![CDATA[database]]></category>
            <category><![CDATA[sql]]></category>
            <category><![CDATA[data-analysis]]></category>
            <dc:creator><![CDATA[Cloudera, Inc.]]></dc:creator>
            <pubDate>Mon, 17 Sep 2018 16:36:48 GMT</pubDate>
            <atom:updated>2018-10-18T19:54:00.447Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*2_zyZAaQfxcQZCkO.jpg" /></figure><p>SQL development is not a new concept. However, as the data warehousing world shifts into a fast-paced, digital, and agile era, the demands to quickly generate reports and help guide data-driven decisions are constantly increasing. This puts new pressures on the people working behind the scenes to prepare and serve data in a consumable way to a growing audience with various levels of access credentials and technical expertise. It also puts pressure on tooling and technology platforms to enable self-serve BI in an easy, yet secure and controlled way.</p><p>Consider the following:</p><ul><li>More data types to be queried, but increasingly the data resides in separate silos</li><li>New data types need to be quickly joined with existing data sets</li><li>Quick changes in business needs require quick changes or fine-tuning of previously run reports or questions</li><li>The volume of data is now in the petabytes, and businesses require high demand on availability and reliability</li><li>Success in agility means demands on more people having access to the same insights at the same time</li><li>An organization with bottlenecks to acquire, prepare, process, and serve data — can lead to important decisions being made with stale data</li></ul><p>These trends and demands lead to stress for existing data warehouse solutions — scale, efficiency, security integrations, IT budgets, ease of access. The stress is also reflected by end users and SQL developers on how efficiently they are expected to serve the business.</p><p>Cloudera recently launched Cloudera Data Warehouse, a <a href="https://vision.cloudera.com/a-new-era-in-data-warehousing/">modern data warehousing</a> solution. It is designed and optimized to help with the majority of stress elements outlined above. It also comes out of the box with a widely adopted, easy-to-use SQL Developer Workbench: Hue, that is specifically designed for the needs of the modern knowledge worker:</p><ul><li>No need to know _where_ the data resides. Hue can help you navigate to the right data no matter if the data is on-prem or in cloud</li><li>No need to be a 100% expert on your data. Guiding intelligence with Hue can help you confidently choose the right tables, indexes, and files to work with</li><li>No need to be an SQL backend expert. Hue can suggest optimizations and warn on bad query design, as well as allow the query to execute where and when there is compute available — be it on-prem or in cloud</li><li>No need to learn a new skill. Hue delivers the same familiar experience — the #1 choice of SQL Workers on Cloudera’s platform — when you transition your data warehousing workloads to or between cloud environments, or back to on-prem again</li></ul><p>In the latest release of <a href="http://vision.cloudera.com/introducing-cloudera-enterprise-6-0/">Cloudera Enterprise (C6)</a> we enabled Hue 4.0 by default, which aims to expedite and simplify the common tasks for the modern SQL user. Here are some highlights:</p><p><strong><em>Data Ingest</em></strong></p><p>Most data is ingested through data engineering pipelines. Cloudera has a number of fully integrated tools such as Sqoop, Flume, Kafka, cloud service options, and optimized partner solutions from Informatica and Streamsets to satisfy our customer’s needs. But for an SQL user, it is also common to have “data laying around” — some flat files on S3, some tables in an external DB. Bringing in tables or files can now easily and in a guided way be done through Hue, which connects to MySQL, S3, ADLS, and other backends to streamline the task of ingesting important additional data sets.</p><p><strong><em>Data Discovery and Exploration</em></strong></p><p>Finding the right data to work with can be daunting for a large organization. We have implemented ways that will expedite data discovery as well as exploration. In the simplified data browser in C6 the end user can easily search for databases, namespaces, tables, views, collections, and even files. You can also easily preview and sample the data to validate you have found the relevant assets to work with.</p><p>A unique integration with our Cloudera Navigator tool (which is part of the Cloudera Data Warehousing portfolio and helps with catalogs, lineage, and auditing) allows us to show you the most commonly used tables (crowdsourced) — very helpful information that will give an indication of which table is most likely the one to work with if you are not entirely sure. It has been estimated to shorten the discovery phase by hours.</p><p>Once you found your datasets of interest, there are easy ways to tag them, so that you at next visit can find them immediately — the search functionality also covers tags!. This is thanks to another unique to Cloudera integration with our Navigator tool.</p><p><strong><em>Query Design</em></strong></p><p>Our SQL workbench allows users to iteratively design queries. Often SQL users step away or get interrupted and need to revisit the coding at a later time. We provide both the ability to save queries and look at query history, to speed up the process of getting started. This also conveniently serves the SQL user any time a new business question arises as he or she can easily start from an already saved query, or copy parts of previously run queries to kickstart their new query design.</p><p>Throughout the query design process, there are helpful tools to assist you. There is the auto-complete functionality that allows you to start typing both commands and table names and dynamically helps with suggestions. It also proposes tables based on frequent use. Auto-complete is something our users can’t live without, as it speeds up their process by estimated 10x.</p><p><strong><em>Optimization</em></strong></p><p>Also, if using Navigator Optimizer (another tool in our Data Warehousing portfolio that allows our customers to quickly assess the potency of SQL statements) and if query history has been configured to be uploaded, this tool can warn on “bad query design” and suggest optimizations for better performance. The proactive SQL assist via Navigator Optimizer adds resiliency to the overall service, as it prevents some memory-intensive queries to occupy resources that could be used for other users and query execution.</p><p><strong><em>Visualization</em></strong></p><p>Whether your result is from our structured query engine (Impala in our case) or our unstructured query engine (Solr in our case), the results can be visualized in the same simple drag and drop dashboard. This allows knowledge workers to quickly and visually share their insights with others.</p><p><strong><em>Sharing</em></strong></p><p>There are simple ways of posting new created views or queries to GitHub to share with a wider audience or directly with other users. The collaboration part is more important than ever where the border between traditional SQL analysts and ML-focused data scientists blur so slightly — the assets need to be shared between these groups and a tool, such as Cloudera’s Knowledge Worker and SQL Developer Workbench enables a seamless transition.</p><p>This is the contemporary Modern Data Warehousing trend we are observing amongst our customers and seems to be catching fire. It’s all about self-service and collaboration at multiple levels. We are enabling it at the query level with Hue.</p><p>Cloudera’s SQL user experience is based on unique, valuable integrations to provide intuitive and proactive assist throughout the SQL developer’s journey. Our SQL workbench allows users to <em>iteratively design, optimize, and troubleshoot queries and with proactive SQL assist speed up their overall process. </em>Hue, in addition, persists your work, expediting SQL users to start new projects.</p><p>Our SQL Developer Workbench that comes with Cloudera’s Modern Data Warehouse is a leading discovery, exploration, development, and collaboration tool. It opens access to data otherwise siloed and locked down in traditional data warehouse systems. The ease of use and seamless value-add integrations makes Hue the number one choice of modern data warehouse workers that seek to draw deeper insights over both structured and unstructured data and that aims to collaborate over Analyst and Data Science organizational borders.</p><p><em>Originally published at </em><a href="https://vision.cloudera.com/a-new-era-of-sql-development-fueled-by-a-modern-data-warehouse/"><em>vision.cloudera.com</em></a><em> on September 17, 2018.</em></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=7b0fb485a968" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Boosting enterprise machine learning with automated feature engineering]]></title>
            <link>https://medium.com/@clouderainc/boosting-enterprise-machine-learning-with-automated-feature-engineering-b1dcc8476843?source=rss-475d0d40b87a------2</link>
            <guid isPermaLink="false">https://medium.com/p/b1dcc8476843</guid>
            <category><![CDATA[data]]></category>
            <category><![CDATA[machine-learning]]></category>
            <category><![CDATA[data-science]]></category>
            <dc:creator><![CDATA[Cloudera, Inc.]]></dc:creator>
            <pubDate>Thu, 13 Sep 2018 13:30:49 GMT</pubDate>
            <atom:updated>2018-10-18T19:52:48.618Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*D-EfgnMXR-A_wAxV.jpg" /></figure><p>Machine learning. The very name suggests there’s little involvement required from actual people. It’s a bit surprising to note, then, that perhaps the most limiting factor in data science and machine learning today is people. People add complexity. People add the risk of error. And people add a lot of time.</p><p>However, we’ll always need people to come up with the overarching prediction problems to solve and to make the ultimate choices to solve them, but there is a lot of data science work now that’s being done manually, and is repeated in project after project. This is where the promises of machine learning come in. Once human input is completed, automation takes over, reducing complexity, risk, and therefore, time. This frees up humans to focus on the most critical tasks they need to accomplish to advance their projects.</p><p>Feature engineering, or the process of transforming raw data into a chosen representation of the underlying problem to be solved, is the data science process most ripe for automation. Before any machine learning can be applied to a business problem, data scientists need to define the problem itself. They use their domain knowledge to extract new and crucial variables from raw data, and then apply machine learning to that information. This can mean manually brainstorming and calculating variables and questions to try to answer and can take weeks or longer.</p><p>Tools and platforms that automate and streamline manual tasks like feature engineering are finally making their way into the enterprise. This technology empowers organizations for data science success.</p><p>Here are a few of the best ways to get started:</p><p><strong>Structure the development process</strong></p><p>Generally, building end-to-end machine learning models today is an ad hoc process in which every new dataset requires figuring out a solution from scratch. It’s like if every time a car company developed a new sedan, it reinvented the wheel.</p><p>Automating manually intensive processes, like feature engineering and feature extraction, provides a structured way to approach the taxing process of preparing raw data for machine learning. It has the added bonus of providing a framework that can be leveraged for future projects.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*3aJlsnjb8fRmP3ez.png" /></figure><p><em>Feature Labs uses the </em><a href="https://www.featurelabs.com/blog/deep-feature-synthesis/"><em>Deep Feature Synthesis</em></a><em> (DFS) algorithm to automatically build features</em></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*uNFGjIzUYXMYTu3F.png" /></figure><p><em>DFS brainstorms, calculates, and recommends the most predictive features for any machine learning problem</em></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*uog9WPsu0_nGxWzW.png" /></figure><p><em>Understanding the top features provides valuable insights into your business</em></p><p><strong>Develop and deploy faster</strong></p><p>When an organization takes up a data science project, they usually don’t have time to wait for results. If you’re coming up with solutions to fight credit card fraud, for example, every day matters.</p><p>Automated tools help you quickly implement accurate machine learning solutions. When you implement feature engineering and machine learning tools, you can shave weeks off the timeline of manual feature engineering processes. With these tools, you often don’t have to recode in order to deploy machine learning projects to production. A data science platform can then help you provision computational resources to run them.</p><p><strong>Use a platform for enterprise machine learning</strong></p><p>Cloudera Data Science Workbench (CDSW) can supercharge machine learning projects in a number of ways. Improving collaboration among teammates and code versioning capabilities, for example, help you create results that are reproducible across projects. You never start from scratch.</p><p>And let’s not forget the IT side of things. Data science projects can strain IT departments that are already strapped for time and resources. Platforms that are secure by default, and flexible — ones that let you run in the cloud, on-premises, or both — free up your IT department to focus on the business-critical aspects of machine learning.</p><p>Finally, there are the benefits of easy integration when it comes to platforms and tools. For example, Feature Labs’ Python APIs let developers build solutions directly inside CDSW. This means that users can take advantage of CDSW’s code versioning, collaboration, and other features to deliver reproducible results.</p><p><strong>Removing the bottlenecks in the data science process</strong></p><p>Data science and machine learning have come a long way, and are a critical part of solving enterprise problems. They can still be complicated and taxing, though. So, take advantage of the tools available to ease the burden on your data scientists — and your IT team — to get the most out of every machine learning initiative.</p><p><em>Contact </em><a href="https://www.featurelabs.com/contact/"><em>Feature Labs</em></a><em> to learn more about making your data machine-learning ready.</em></p><p><em>Originally published at </em><a href="https://vision.cloudera.com/boosting-enterprise-machine-learning-with-automated-feature-engineering-2/"><em>vision.cloudera.com</em></a><em> on September 13, 2018.</em></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=b1dcc8476843" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Building an Open Data Processing Pipeline for IoT]]></title>
            <link>https://medium.com/@clouderainc/building-an-open-data-processing-pipeline-for-iot-8b05cbd12c8b?source=rss-475d0d40b87a------2</link>
            <guid isPermaLink="false">https://medium.com/p/8b05cbd12c8b</guid>
            <category><![CDATA[big-data]]></category>
            <category><![CDATA[data]]></category>
            <category><![CDATA[iot]]></category>
            <category><![CDATA[data-analysis]]></category>
            <category><![CDATA[open-source]]></category>
            <dc:creator><![CDATA[Cloudera, Inc.]]></dc:creator>
            <pubDate>Tue, 11 Sep 2018 14:07:24 GMT</pubDate>
            <atom:updated>2018-10-18T19:51:27.286Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*MhzKAqc87IUuMAYM.jpg" /></figure><p><em>Authors: David Bericat, Global Technical Lead, Internet of Things, Red Hat and Jonathan Cooper-Ellis, Solutions Architect, Cloudera</em></p><p>Last week <a href="https://vision.cloudera.com/an-end-to-end-open-modular-architecture-for-iot/">Cloudera introduced an open end-to-end architecture for IoT </a>and the different components needed to help satisfy today’s enterprise needs regarding operational technology (OT), information technology (IT), data analytics and machine learning (ML), along with modern and traditional application development, deployment, and integration.</p><p><a href="http://www.redhat.com/iot">Red Hat</a>, <a href="https://www.eurotech.com/">Eurotech</a>, and <a href="https://www.cloudera.com/solutions/iot.html">Cloudera</a> are working together to address these areas with an open, flexible, modular and interoperable architecture. A big part of that architecture deals with the flow and management of data, as well as the insights, actions, and decisions that can be created from data to produce better business outcomes.</p><p>So today, let’s talk DATA!</p><h3>The open data processing pipeline</h3><p>IoT is expected to generate a volume and variety of data greatly exceeding what is being experienced today, requiring modernization of information infrastructure to realize value.</p><p>To take advantage of all the disparate types of data, Red Hat, Eurotech and Cloudera have built an open and scalable data processing pipeline as part of an end-to-end IoT architecture. This enables data to be acquired, pre-processed, filtered, aggregated and dynamically routed, with only the meaningful information sent to the centralized hub so it can be stored, analyzed, processed, modeled, acted upon, and shared with different applications and services.</p><p>The illustration below highlights the typical IoT data journey, with key components of the IoT data pipeline and their functionalities:</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*l8krsH_0c9l_vE7f.png" /></figure><h3>What’s happening at the IoT edge?</h3><p>It is already challenging to effectively ingesting and managing data streams coming in from numerous connected devices and assets, using a multitude of different field protocols and network alternatives. The additional need to break through the different data sets to correlate the telemetry data in real-time adds to the complexity. Having to send all that raw sensor data “as is” is not feasible due to constraints around connectivity and network transmission costs, especially in moving target scenarios where intermittent connectivity over cellular or even GPRS or radio occurs. That is why the first step of the open data processing pipeline begins at the IoT edge, where protocol translation and different processing patterns will transform raw data into meaningful data-sets relevant for the business, which are then appropriately routed to proper downstream entities based on predefined scenarios.</p><p>At the edge or at the gateways, a combination of <a href="https://www.eurotech.com/en/products/iot/iot-edge-framework/everyware-software-framework">Eurotech Everyware Software Framework</a> (ESF) and <a href="https://www.redhat.com/en/technologies/jboss-middleware/fuse">Red Hat Fuse</a> and <a href="https://www.redhat.com/en/technologies/jboss-middleware/amq">Red Hat AMQ</a> middleware provides the ability to more securely acquire data through different industry protocols such as OPC-UA, ModBus, CANbus, Siemens S7, and Profinet, as well as other custom extensions. Additionally, the Wires functionality in ESF, combined with <a href="http://camel.apache.org/routes.html">Apache Camel Routes</a>, enables OT architects and developers to create edge applications and to distribute the meaningful business logic needed to optimize business operations.</p><h3>The IoT integration hub</h3><p>Along with enabling some of the key functionalities such as device management, the IoT integration hub also logically centralizes management operations, security and data access, and routes the information to the right channels. By combining <a href="https://www.eurotech.com/en/products/iot/iot-integration-platform/everyware-cloud">Eurotech Everyware Cloud </a>with <a href="https://www.redhat.com/en/technologies/jboss-middleware/amq">Red Hat AMQ </a>and Red Hat <a href="https://www.openshift.com/products/container-platform/">OpenShift Container Platform</a>, IoT specific services like device management, health monitoring, and command and control can be executed in an open hybrid cloud leveraging both public and private cloud platforms , with workloads and data flowing into the <a href="https://www.cloudera.com/products/enterprise-data-hub.html">Cloudera Enterprise Data Hub</a> (EDH).</p><h3>The Enterprise Data Hub</h3><p>Telemetry data routed to the <a href="https://www.cloudera.com/products/enterprise-data-hub.html">Cloudera Enterprise Data Hub</a> flows into <a href="https://www.cloudera.com/products/open-source/apache-hadoop/apache-kafka.html">Apache Kafka</a>. From there, it can be easily consumed by an <a href="https://www.cloudera.com/products/open-source/apache-hadoop/apache-spark.html">Apache Spark </a>streaming application for processing, enrichment, and near real-time analysis (including machine learning inference), and then persisted in the appropriate storage system.</p><p>Cloudera EDH offers several storage options which users may choose from — including HDFS, HBase, Kudu, or any of the leading public cloud object storage objects as well, based on their specific use case requirements. For many IoT use cases, <a href="https://www.cloudera.com/products/open-source/apache-hadoop/apache-kudu.html">Apache Kudu</a> is likely an ideal choice, as it provides an optimal combination of features for telemetry data, including fast ingestion, updates, and high performance for random reads as well as analytical scans.</p><p>In addition to being highly performant, Kudu is also highly scalable, which is important for IoT use cases where the final goal should be matching real-time data coming from the field with long-term historical data to offer a complete historical view to consumers. This is especially important for data scientists and machine learning applications, where subtle trends may only emerge over long periods of time.</p><p>For those data scientists, Cloudera <a href="https://www.cloudera.com/products/data-science-and-engineering/data-science-workbench.html">Data Science Workbench</a> enables consumption of data from Kudu and other sources, including Cloudera’s other storage systems and contextual data residing in external systems, to analyze and develop machine learning models based on all of the information available to them. Cloudera Data Science Workbench let data scientists use R, Python, or Scala with on-demand compute and secure access to <a href="https://www.cloudera.com/products/open-source/apache-hadoop/apache-spark.html">Apache Spark</a>™ and <a href="https://www.cloudera.com/products/open-source/apache-hadoop/impala.html">Apache Impala</a>™ to quickly develop or prototype new machine learning models and easily deploy them into production.</p><h3>Pushing actionable predictions to the edge</h3><p>Data science is generally considered to be an offline practice, but often IoT solutions demand insights and predictions in real-time. In many cases, even subsecond latencies achievable by Spark Streaming are too slow, or the network is too expensive or unreliable, so machine learning and analytics must be pushed to the edge where true real-time is possible. What exactly it means to “push a machine learning model to the edge” is a mysterious concept to most, and properly explaining that is outside the scope of this article, but suffice it to say that machine learning models are serializable. This means that once trained, they can be saved, loaded, and transmitted over a network. So, in much the same way that an IoT data pipeline enables telemetry to flow from the edge to the data hub, trained machine learning models can flow from the data hub back to the edge.</p><p>By implementing edge analytics and machine learning inferencing at the edge, predictions can be made and decisions can be executed in real-time. Cutting edge implementations take advantage of this to optimize operations, productivity, costs and improve safety in the field by reacting faster.</p><p>In summary, an open data processing pipeline covers the data lifecycle of your field telemetry data; moving data from the data producer to the right location, at the right time and only the right amount, so it can be processed, stored, analyzed and acted upon across the different tiers of the open IoT end-to-end architecture.</p><p><strong>To Learn More:</strong></p><p><em>Originally published at </em><a href="https://vision.cloudera.com/building-an-open-data-processing-pipeline-for-iot/"><em>vision.cloudera.com</em></a><em> on September 11, 2018.</em></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=8b05cbd12c8b" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Cloudera Data Warehouse — A Partner Perspective]]></title>
            <link>https://medium.com/@clouderainc/cloudera-data-warehouse-a-partner-perspective-2e16f09176fd?source=rss-475d0d40b87a------2</link>
            <guid isPermaLink="false">https://medium.com/p/2e16f09176fd</guid>
            <category><![CDATA[data-science]]></category>
            <category><![CDATA[partner-perspectives]]></category>
            <category><![CDATA[data-warehouse]]></category>
            <category><![CDATA[big-data]]></category>
            <category><![CDATA[data-warehousing]]></category>
            <dc:creator><![CDATA[Cloudera, Inc.]]></dc:creator>
            <pubDate>Mon, 10 Sep 2018 19:00:42 GMT</pubDate>
            <atom:updated>2018-10-18T19:49:39.506Z</atom:updated>
            <content:encoded><![CDATA[<h3>Cloudera Data Warehouse — A Partner Perspective</h3><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*07h4VcJvLgd3BiA4.jpg" /></figure><p>Among the many reasons that a majority of large enterprises have adopted <a href="https://www.cloudera.com/products/data-warehouse.html">Cloudera Data Warehouse</a> as their modern analytic platform of choice is the incredible ecosystem of partners that have emerged over recent years. In this new blog series, we will take a closer look at some of the most innovative partners, and how the Cloudera platform is helping them deliver groundbreaking solutions to our customers.</p><p>At Cloudera, we’re lucky to work with some amazing partners, and in the data warehouse category in particular, we see a couple of key trends:</p><ul><li><strong>New innovation in the Cloudera ecosystem</strong>: Several new companies have emerged that tightly integrate with our platform, effectively betting their business on our own success, which is humbling! According to Crunchbase, our closest Cloudera-native partners have raised over $260M based on our tight alignment.</li><li><strong>Incumbents are adapting to modern platforms:</strong> More established vendors are building or buying tools that leverage the Cloudera platform more effectively. Informatica’s Big Data Manager and Qlik’s acquisition of Podium Data are just 2 examples.</li><li><strong>Sophisticated specialists are emerging:</strong> As the use cases for Cloudera Data Warehouse become more sophisticated, so do the partners. We are tracking very interesting development in areas like security, catalogs, data masking and more.</li></ul><p>In this post, we’ll focus on one of our Cloudera-native partners, <a href="https://www.cloudera.com/solutions/gallery/arcadia-data-arcadia-enterprise.html">Arcadia Data</a>. Their software is a great example of how Cloudera’s platform can be seen not only as a massively scalable data store but as a complete data warehousing platform on top of which their BI application is built.</p><p>The main Arcadia Data product, Arcadia Enterprise, is a BI and visual analytics tool that leverages the power of Cloudera. One of the key Arcadia Enterprise tenets is that data should be analyzed where it resides, and unnecessary data movement should be avoided in the analytic lifecycle. As a result, customers get a fast, scalable and secure (with Apache Sentry integration) analytics deployment on Cloudera that gives users, including non-technical business users, easy access to all the data without excessive IT intervention.</p><p>In addition, Arcadia Data is one of the first partners who have certified on Cloudera 6, which will open up a wealth of new possibilities for discovery &amp; operational data warehouses where the combination of structured SQL-based queries with <a href="https://blog.cloudera.com/blog/2018/05/new-in-cloudera-enterprise-6-0-analytic-search/">Analytic Search</a> on (often fast moving) unstructured data can be extremely valuable.</p><p>Cloudera and Arcadia Data have teamed up to <a href="https://www.arcadiadata.com/blog/on-cluster-bi-procter-and-gamble/">solve business challenges</a> that require massive scale and hybrid compute interfaces. Cybersecurity, supply chain analysis, operations optimization, and predictive maintenance are only a few examples of how we’ve jointly helped customers.</p><p>Arcadia Enterprise, combined with Apache Impala and Apache Kudu, work well for data warehouse use cases. We’re also seeing growing interest in that stack for near real-time analytics on Internet-of-things streaming data. Arcadia Enterprise also integrates with Cloudera Search for analytics on textual/unstructured data formats like log files. This provides BI-style analytics on data that was typically limited to a technical user base.</p><p>Learn more about how Arcadia Enterprise and Kudu work together in <a href="http://watch.arcadiadata.com/watch/pezV6M5eSDqcpc2DMWpkWK??utm_source=Website&amp;utm_medium=Blog&amp;utm_campaign=c6">this short video</a>.</p><p><em>Co-written by Dan Wilson, Director of Partnerships for Cloudera Data Warehouse, and Dale Kim, Sr. Director of Products and Solutions, Arcadia Data</em></p><p><em>Originally published at </em><a href="https://vision.cloudera.com/cloudera-data-warehouse-a-partner-perspective/"><em>vision.cloudera.com</em></a><em> on September 10, 2018.</em></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=2e16f09176fd" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Delivering a Shared Multidisciplinary Analytics Experience Anywhere With SDX and Altus]]></title>
            <link>https://medium.com/@clouderainc/delivering-a-shared-multidisciplinary-analytics-experience-anywhere-with-sdx-and-altus-70fb38cf753e?source=rss-475d0d40b87a------2</link>
            <guid isPermaLink="false">https://medium.com/p/70fb38cf753e</guid>
            <category><![CDATA[big-data]]></category>
            <category><![CDATA[cloud-computing]]></category>
            <category><![CDATA[cloud]]></category>
            <category><![CDATA[data-science]]></category>
            <category><![CDATA[analytics]]></category>
            <dc:creator><![CDATA[Cloudera, Inc.]]></dc:creator>
            <pubDate>Mon, 10 Sep 2018 10:30:07 GMT</pubDate>
            <atom:updated>2018-10-18T19:48:34.479Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*ue05QWOuylUQy7Mq.jpg" /></figure><p>Woodworking is one of my passions and I often use wooden pallets as my source material. Regardless of what I build — whether a shelf, chair, or bookcase — I always use the same things: Wood, tools, and a plan that shows dimensions and steps to put all the bits together.</p><p>The other day, it struck me how similar this is to how organizations digitally transform and become data-driven. Rather than a fancy Adirondack chair, your plans focus on growing, connecting, or protecting your business. Your raw material is data instead of wood, and you use multidisciplinary analytics rather than woodworking tools like a hammer, saw, and sander. Just like the tools, your analytic functions need to work in concert although the results are insights rather than sanded rough cuts left by the saw. If not, your observations may be misguided and business value not fully realized, if achieved at all.</p><p>Multidisciplinary analytics are the tools, the different workloads you need: data engineering, data warehousing, data science, and operational analytics. To achieve your business goal or solve for your particular use case, you need the full complement and in varying ratios throughout the project.</p><p>Working on the same shared data, the workloads also need to integrate on another level: data context. Uniquely, Cloudera’s machine learning and analytics platform have a fundamental characteristic called the <a href="https://youtu.be/RP94M4TOyzA">Shared Data Experience (SDX)</a> that provides just that.</p><p>When transient cloud infrastructures are used to complement existing on-premises investments, establishing and capturing this data context is essential for success. We addressed many of these requirements when we <a href="https://vision.cloudera.com/introducing-cloudera-sdx-a-shared-data-experience-for-the-hybrid-cloud/">introduced</a> SDX a year ago and <a href="https://vision.cloudera.com/altus-sdx-shared-services-for-cloud-based-analytics/">extended its capabilities</a> to Cloudera Altus.</p><p>There are several permutations when it comes to the infrastructure and storage that you can use to run these diverse analytic workloads, ranging from on-premises to public (IaaS or PaaS) and private cloud or any hybrid combination. Therefore, it’s crucial that we provide complete consistency across the entire realm of data context: security, governance, lifecycle, control and data catalog.</p><p>Rather than wait until everything everywhere is fully implemented, we bring out the support in stages. IaaS and private cloud are already supported through our <a href="http://bit.ly/2Ms5OPO">reference architecture</a>. With the release of SDX for Altus workloads as-a-service, we’re now supporting the second most common combination: sharing data and metadata between customers’ own Cloudera workloads deployed to the public cloud (IaaS) with Altus Director and those managed in the public cloud by Cloudera as a service (Altus PaaS).</p><p>Organizations are no longer constrained in choosing how and where they deploy their workloads based on the ability they have to manually manage the data context between them. Any combination of workloads can now take advantage of the most appropriate infrastructure. The benefits are realized as soon as more than one workload is deployed.</p><p>Here are a few real customer examples:</p><ul><li>A retailer needs insights on web-based sales. IT has tight control and is running its highly customized Cloudera Data Warehouse workload 24×7 as an Altus Director-deployed Cloudera Enterprise cluster. The company also has a transient Altus Data Engineering workload to bring the data into the Data Warehouse environment. This has the benefit of being highly repeatable and automated as well as providing the lowest TCO. With SDX, the data context from the transient workloads is directly shared with the Data Warehouse, providing critical auditing information and ensuring trusted data is always used for analysis.</li><li>A large financial services organization is required to provide always-on analytics to their customers and doesn’t want to depend on a single cloud vendor for that. Using a team of just three administrators (rather than the 15 they needed before) and thanks to SDX providing single consistent context, they can now deploy their Cloudera analytics applications to no fewer than three public clouds in less than an hour. In addition to their operational cost savings, they went from concept to production in just six months and achieved substantial business benefits.</li></ul><p>In all cases, SDX helps IT reduce its management overhead and costs, as well as lower risk for the company as a whole. The business further benefits from improved governance, greater agility, and faster business insight. With SDX now on Altus, you have maximum cloud flexibility. You can run clusters anywhere and manage them in any way, with the unified control IT needs and the self-service business and data professionals demand.</p><p>For me, the joy of woodworking is discovering new techniques and solutions, like glueless joints. I start by trying them on a small scale before using them in anger; it helps me familiarize myself with the approach and the tools for the job. You can do the same for your data-driven projects: Add SDX to your Cloudera Enterprise deployment and follow the steps in our <a href="http://bit.ly/2Ms5OPO">reference architecture documentation</a>. With our <a href="https://cloudera.com/altus">free 30-day Altus trial</a>, you can try the shared data experience for yourself in your environment.</p><p>With that in place, what will be your first project?</p><p><em>Originally published at </em><a href="https://vision.cloudera.com/delivering-a-shared-multidisciplinary-analytics-experience-anywhere-with-sdx-and-altus/"><em>vision.cloudera.com</em></a><em> on September 10, 2018.</em></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=70fb38cf753e" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Altus Data Warehouse]]></title>
            <link>https://medium.com/@clouderainc/altus-data-warehouse-9bb6c3940453?source=rss-475d0d40b87a------2</link>
            <guid isPermaLink="false">https://medium.com/p/9bb6c3940453</guid>
            <category><![CDATA[analytics]]></category>
            <category><![CDATA[data-warehousing]]></category>
            <category><![CDATA[big-data]]></category>
            <category><![CDATA[database]]></category>
            <category><![CDATA[data-warehouse]]></category>
            <dc:creator><![CDATA[Cloudera, Inc.]]></dc:creator>
            <pubDate>Sun, 09 Sep 2018 19:00:27 GMT</pubDate>
            <atom:updated>2018-10-18T19:47:13.994Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*SnLwAkqr1In-l0Bp.jpg" /></figure><p>We are proud to announce the general availability of <a href="https://www.cloudera.com/products/altus/altus-analytic-db.html">Cloudera Altus Data Warehouse</a>, the only cloud data warehousing service that brings the warehouse to the data. Cloudera’s modern data warehouse runs wherever it makes the most sense for your business — on-premises, public cloud, hybrid cloud, or even multi-cloud.</p><h3>Modern data warehousing for the cloud</h3><p>Data is one of the most valuable assets for a company, however, many teams still struggle with the friction of bringing new data sets into their data warehouse and reacting quickly enough to the constantly changing reporting needs of their users. Businesses need to be agile and quick in using data to drive insights, lest they lose the opportunity they are trying to capitalize on. It’s no surprise that there is a strong correlation between successful businesses and those that exceed in extracting value from data.</p><p>Cloudera Altus Data Warehouse is designed with agile data teams in mind. It enables organizations to address their data warehousing reporting needs by making it quick and easy to consolidate data into a single repository yet still service your users’ needs in a scalable and cost-effective way. Because Cloudera Altus decouples storage and compute, and uses a shared data experience (SDX), it provides the ability to isolate different workloads from each other while operating over a single shared repository of data and data context. This makes it easy to meet the ever-changing needs of your data teams.</p><p>Security is top of mind with Cloudera Altus. Because Cloudera Altus Data Warehouse operates directly over data in your AWS or Microsoft Azure account, you can create security policies that comply with your company’s standards. This stands in stark contrast to other vendors that require data be copied or loaded into their proprietary account or service.</p><h3>Using Cloudera Altus for your cloud data warehouse</h3><p>Cloudera Altus offers several key integrated services for data warehousing needs:</p><p>A typical data warehouse scenario might use Altus Data Engineering jobs to process raw files (eg: text delimited or JSON) stored in the cloud object store and output <a href="https://parquet.apache.org/">Apache Parquet</a> format which is optimized for analytical query workloads back to the cloud object store. Altus Data Warehouse would then query these same files to service the SQL query needs of analytical users — so no data loading is required. Should a use case require stream processing, Altus Director can be used to deploy a persistent Apache Spark Streaming cluster which could also write to the cloud object store. And SDX for Altus stores all the data context in a shared catalog that can be used across every Altus Data Engineering, Altus Data Warehouse and Altus Director cluster eliminating data silos. Because Altus Data Warehouse uses open source formats and the data resides in your cloud storage rather than in a proprietary data store, there is no concern about vendor lock-in.</p><h3>Altus Data Warehouse is not like other cloud data warehouses</h3><p>Cloudera Altus Data Warehouse delivers a number of benefits that other cloud data warehouses simply can’t provide including:</p><ol><li><strong>Zero-data copy: </strong>Altus operates directly over a customer’s data in the cloud object store, which means there is no requirement for data be copied/loaded onto another system or service.</li><li><strong>Cloudera’s Shared Data Experience (SDX):</strong> maintains the lineage (history) of transient workloads, and provides secure sharing of data and metadata across workloads, clusters, clouds, and even hybrid environments.</li><li><strong>Hybrid and Multi-cloud capabilities:</strong> Cloudera uniquely addresses the hybrid cloud needs of enterprise customers that desire a single experience across on-prem and multi-cloud</li><li><strong>Multi-function analytics: </strong>Cloudera Altus goes beyond SQL to support data engineering and machine learning use cases in a unified platform.</li></ol><h3>Try Altus Data Warehouse today</h3><p>We could not be more excited for you to try Altus Data Warehouse! Get started today and let us know your feedback.</p><p><em>Originally published at </em><a href="https://vision.cloudera.com/altus-data-warehouse/"><em>vision.cloudera.com</em></a><em> on September 9, 2018.</em></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=9bb6c3940453" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Taking out the threat from the inside]]></title>
            <link>https://medium.com/@clouderainc/taking-out-the-threat-from-the-inside-12d46694591b?source=rss-475d0d40b87a------2</link>
            <guid isPermaLink="false">https://medium.com/p/12d46694591b</guid>
            <category><![CDATA[cybersecurity]]></category>
            <category><![CDATA[security]]></category>
            <category><![CDATA[data-science]]></category>
            <category><![CDATA[big-data]]></category>
            <dc:creator><![CDATA[Cloudera, Inc.]]></dc:creator>
            <pubDate>Fri, 07 Sep 2018 19:00:41 GMT</pubDate>
            <atom:updated>2018-10-18T19:44:52.449Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*ZWTRUiYjBDDsMf8z.jpg" /></figure><p>The worst thing about an inside job is that once it’s detected, it’s usually too late. Early detection is critical to prevent considerable damage arising out of insider threats to the business. But that’s easier said than done! Whether it’s a rogue trader in a bank or brokerage or someone illegally sharing company intellectual property or intelligence, illegal insider actions put enterprises at risk of losing millions. This could be in the form of reputational damage or unfavorable regulatory consequences in case of compromised customer data, for example.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/600/0*jg1-8zxAXzXuIT5K.jpg" /></figure><p>Enterprises prepare to avoid or tackle threats by monitoring employee and third-party communications such as e-mail, instant messaging, social media, and voice, as well as by analyzing log files and file attachments. This conventional approach also employs a Relational Database Management System (RDBMS) technology, which, however, falls short in meeting current business demands for scalable, flexible and cost-efficient solutions to insider threat.</p><p>Moreover, this approach struggles to deal with the large volume and variety of data that must be analyzed and often correlated. Analyzing unstructured data sets such as text, audio and images are challenging, especially while determining illegal intent in communications. Worse, insider attacks remain undetected as data is disregarded before it can be correlated, or patterns identified in time.</p><p><strong>A tag team against insider threat</strong></p><p>Accenture and Cloudera have joined hands to help enterprises move from a post-incident forensic approach to a proactive, preventive method to insider threat. The Insider Threat Detection Solution leverages Cloudera Enterprise together with Accenture’s Aspire Content Processing and Analysis technology and fraud detection consulting expertise to devise a faster, stronger and smarter anti-insider threat system.</p><p>The comprehensive solution covers simple text analytics and communications monitoring for e-mail, voice and text messages, to more complex pattern detection and machine learning-based text analysis models. This analysis can also be extended to determine a “risk score” for employee behavior based on application logs, transactions, and other user behavior data. Our joint solution is scalable and can effectively manage the growing volumes of communications data, and extendable with sophisticated risk analysis techniques.</p><p><strong>Benefits</strong></p><ul><li><strong>Quicker</strong>: Faster time to incident investigation and response with comprehensive enterprise visibility</li><li><strong>Smarter</strong>: Deeper insights with a full complement of analytic and machine learning frameworks for all threat detection</li><li><strong>Extendable</strong>: Continued innovation, learning, and application of best practices to insider threat programs</li></ul><p>The business benefit of this solution is to enable enterprises to move from a post-incident forensic approach to a proactive preventative approach saving millions of dollars.</p><p>Accenture and Cloudera’s Insider Threat Detection Solution features the following components and capabilities:</p><ul><li><strong>Cloudera Enterprise:</strong> A scalable and secure data platform, which is machine-learning ready and optimized for the cloud, offers deeper insights with a full complement of analytics frameworks for threat detection.</li><li><strong>Accenture insider threat program development</strong>: With Accenture’s vast expertise and experience in fraud and risk analytics, the joint solution brings in continuous innovation and application of insider threat best practices.</li><li><strong>Accenture insider threat detection IP portfolio: Leverage Accenture IP in content processing, natural language understanding, risk analytics modeling, and data visualization to deliver faster incident investigation and response with complete visibility into enterprise data.</strong></li></ul><p><strong>Next Step — Engage with us to schedule a discovery session to identify:</strong></p><ul><li>Organizational needs to monitor existing and new data sources</li><li>Requirements for data protection and governance</li><li>Areas where we can bring immediate value to data governance</li></ul><p>Contact us at info.stc@accenture.com or amit.jayaswal@cloudera.com</p><p><strong>Disclaimer</strong>: <em>This blog has been published for information purposes only and is not intended to serve as advice of any nature whatsoever. The information contained and the references made in this blog is in good faith and neither Accenture nor any of its directors, agents or employees give any warranty of accuracy (whether expressed or implied), nor accepts any liability as a result of reliance upon the content including (but not limited) information, advice, statement or opinion contained in this blog. Accenture does not warrant or solicit any kind of act or omission based on this blog.</em></p><p><em>The blog is the joint property of Accenture and Cloudera. No part of this Blog may be reproduced/ redistributed in any manner without the written permission of both the parties.</em></p><p><em>Originally published at </em><a href="https://vision.cloudera.com/taking-out-the-threat-from-the-inside/"><em>vision.cloudera.com</em></a><em> on September 7, 2018.</em></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=12d46694591b" width="1" height="1" alt="">]]></content:encoded>
        </item>
    </channel>
</rss>