<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0" xmlns:cc="http://cyber.law.harvard.edu/rss/creativeCommonsRssModule.html">
    <channel>
        <title><![CDATA[Stories by Datafiniti on Medium]]></title>
        <description><![CDATA[Stories by Datafiniti on Medium]]></description>
        <link>https://medium.com/@Datafiniti?source=rss-35c2074581c4------2</link>
        <image>
            <url>https://cdn-images-1.medium.com/fit/c/150/150/1*tJbmiIiftE_yL7I5KWWmtw.png</url>
            <title>Stories by Datafiniti on Medium</title>
            <link>https://medium.com/@Datafiniti?source=rss-35c2074581c4------2</link>
        </image>
        <generator>Medium</generator>
        <lastBuildDate>Tue, 17 Nov 2026 10:10:26 GMT</lastBuildDate>
        <atom:link href="https://medium.com/@Datafiniti/feed" rel="self" type="application/rss+xml"/>
        <webMaster><![CDATA[yourfriends@medium.com]]></webMaster>
        <atom:link href="http://medium.superfeedr.com/" rel="hub"/>
        <item>
            <title><![CDATA[Datafiniti Targets Primary Product Images From Top Retailers With New Field Release]]></title>
            <link>https://medium.com/datafiniti/datafiniti-product-data-primaryimageurls-160cda38e361?source=rss-35c2074581c4------2</link>
            <guid isPermaLink="false">https://medium.com/p/160cda38e361</guid>
            <category><![CDATA[user-experience]]></category>
            <category><![CDATA[data-science]]></category>
            <category><![CDATA[api]]></category>
            <category><![CDATA[data]]></category>
            <category><![CDATA[product-data]]></category>
            <dc:creator><![CDATA[Datafiniti]]></dc:creator>
            <pubDate>Mon, 24 Jun 2019 15:01:01 GMT</pubDate>
            <atom:updated>2019-06-24T15:01:01.488Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*ZVTTH4GVGxDgK0HzC0KOSw.png" /></figure><p>Datafiniti’s mission is to help companies gain instant access to valuable data sourced from thousands of websites. The team strives to curate and clean the data we collect so that businesses can quickly implement our products into their actions, analytics, and applications. Our love for and curiosity about data does not stop there. We also develop in-house solutions to better meet specific customer needs. Learn more about how we now collect and designate an image as a primary product image for our users in this latest update.</p><p>If an image tells a story, then a picture-perfect product image should leave nothing to the imagination. A primary product image plays a pivotal role in boosting a company’s brand and helping a customer understand what a product is. This eye-catching image is the most significant visual a consumer will come across in the buying process. Today, Datafiniti customers can capture the attention of their end-users by targeting the main image featured in a product listing with the release of our brand-new primaryImageURLs field for <a href="https://datafiniti.co/products/product-data/">Datafiniti’s Product API and Database</a>.</p><p>“Before releasing primaryImageURLs, customers would have to look through our imageURLs field and figure out on their own which images could be used to showcase a listing,” said Phil Coleman, CTO. “Now, they can be certain the image they are pulling is the actual image of the product they want to show.”</p><p>Datafiniti’s product database provides access to over 100 million records across more than 30 fields of information including imageURLs. PrimaryImageURLs completes the product image puzzle by specifically identifying the primary images taken from top retailers and other domains sourced in a record. Rather than a running list of all imageURLs for a product, this list will only contain one URL per domain.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*wCDVnYCyZ2ho-q-J6S0TbA.png" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*lkmivIrGFR7PSELE5LaGmg.png" /><figcaption>A record used to previously include a lengthy list of product images (imageURLs) from multiple retail domains. <br>Today, a record still incorporates a long list of imageURLs, but also zeros in on single, primary product image (primaryImageURLs) from each retail domain.</figcaption></figure><p>In just under a week, the Datafiniti team made adjustments to the <a href="https://developer.datafiniti.co/docs/product-data-schema">Product Data schema</a>, added in current validation to ensure that there is one single URL per source, and made changes to the <a href="https://80legs.com/products/custom-web-crawling/">80app</a> that collects the primary image from each source that Datafiniti crawls. The enhancement makes it easy to leverage high-quality product images by feeding directly into customer applications.</p><p>“We get a lot of requests from customers, but they are specific to their use case,” said Coleman. “In making a large change like this, we want it to be beneficial for the entire user base.”</p><p>At the top level of the schema, the tool comes as a highly-requested feature directly from our users. This product development focused on turning feedback into an improvement in the usability and value that the database delivers. Customers can now utilize primaryImageURLs within Datafiniti’s Product API to upgrade the quality of their content, provide comprehensive product information, elevate the experience of their users, and more.</p><p><em>To view the updated Product Data Schema </em><a href="https://developer.datafiniti.co/docs/product-data-schema"><em>click here</em></a><em>.</em></p><p>No matter your industry, Datafiniti has over 100 million records across our <a href="https://datafiniti.co/products/business-data/">Business</a>, <a href="https://datafiniti.co/products/people-data/">People</a>, <a href="https://datafiniti.co/products/product-data/">Product</a>, and <a href="https://datafiniti.co/products/property-data/">Property</a> Data Products to take your company to the next level. Are you ready to get started? Click Create a Free Account below to get started on your own or Request a Demo to talk to a member of our sales team.</p><figure><a href="https://datafiniti.co/request-a-demo/"><img alt="" src="https://cdn-images-1.medium.com/max/901/1*m6eQ2ps4GLeXNbP6AfAaRQ.png" /></a></figure><figure><a href="https://datafiniti.co/pricing/product-data-pricing/"><img alt="" src="https://cdn-images-1.medium.com/max/1000/1*FqOiJEVa9xgZocqIlqw0hQ.png" /></a></figure><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=160cda38e361" width="1" height="1" alt=""><hr><p><a href="https://medium.com/datafiniti/datafiniti-product-data-primaryimageurls-160cda38e361">Datafiniti Targets Primary Product Images From Top Retailers With New Field Release</a> was originally published in <a href="https://medium.com/datafiniti">Knowledge from Data: The Datafiniti Blog</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Datafiniti Simplifies Business Data Search with Taxonomy Field Release]]></title>
            <link>https://medium.com/datafiniti/datafiniti-business-data-taxonomy-8fe13ab0c845?source=rss-35c2074581c4------2</link>
            <guid isPermaLink="false">https://medium.com/p/8fe13ab0c845</guid>
            <category><![CDATA[api]]></category>
            <category><![CDATA[data]]></category>
            <category><![CDATA[user-experience]]></category>
            <category><![CDATA[machine-learning]]></category>
            <category><![CDATA[data-science]]></category>
            <dc:creator><![CDATA[Datafiniti]]></dc:creator>
            <pubDate>Mon, 29 Oct 2018 14:01:01 GMT</pubDate>
            <atom:updated>2018-11-20T18:43:11.701Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*x2k4MR0yp5vp0edU6g0TMQ.png" /></figure><p><a href="https://datafiniti.co/">Datafiniti</a>’s mission is to help companies gain instant access to valuable data sourced from thousands of websites. The team strives to curate and clean the data we collect so that businesses can quickly implement our products into their actions, analytics, and applications. Our love for and curiosity about data does not stop there. We also develop in-house solutions to better meet specific customer needs. Learn more about how we classify our <a href="https://datafiniti.co/products/business-data/">Business Data</a> records based on federal NAICS codes and streamline search operations for customers in this latest update.</p><p>In January, the team introduced a way to simplify customers’ search operations <a href="https://blog.datafiniti.co/dfproducttaxonomy-b9bb43b60068">with the release of our product taxonomy field, primaryCategories</a>. Today, Datafiniti announces it now offers the same taxonomy field and capability, but for its Business API.</p><p>“Just like how we classified products into a taxonomy to make those records easily searchable, we want to apply the same process to our business data,” said Nirav Shah, data scientist.</p><p>Business records in the database are grouped into a high-level taxonomy and classified based on the first level of <a href="https://www.census.gov/eos/www/naics/">NAICS codes</a>. The classification is equivalent to 2-digit NAICS codes that <a href="https://www.census.gov/eos/www/naics/faqs/faqs.html#q5">designate a business’s specific sector</a>.</p><p>“Say someone wants to search for landmarks or points of interest,” said Shah. “There used to be many possibilities, but now they can simply utilize a corresponding NAICS string.”</p><p>This new taxonomy will finally lift the burden of time-consuming searches by allowing users to effortlessly categorize records and narrow their search for specific types of businesses.</p><p><strong>The values for the NAICS code categories now available include the following:</strong></p><ol><li>“Accommodation &amp; Food Services”</li><li>“Administrative Support Waste Management &amp; Remediation”</li><li>“Agriculture”</li><li>“Arts Entertainment &amp; Recreation”</li><li>“Construction”</li><li>“Educational Services”</li><li>“Finance &amp; Insurance”</li><li>“Healthcare &amp; Social Assistance”</li><li>“Information”</li><li>“Management of Companies &amp; Enterprises”</li><li>“Manufacturing”</li><li>“Mining Quarrying &amp; oil &amp; Gas Extraction”</li><li>“Other Services”</li><li>“Professional Scientific &amp; Technical Services”</li><li>“Public Administration”</li><li>“Real Estate Rental &amp; Leasing”</li><li>“Retail”</li><li>“Transportation &amp; Warehousing”</li><li>“Utilities”</li><li>“Wholesale Trade”</li></ol><p>The current implementation only generates values for primaryCategories. Up next, the team hopes to generate data for a secondaryCategories field or 4-digit NAICS codes that can provide additional information on a business’s sub-sector and industry group.</p><p><em>To view the updated Business Data Schema </em><a href="https://developer.datafiniti.co/docs/business-data-schema"><em>click here</em></a><em>.</em></p><p><em>To view the primaryCategories field and all values, </em><a href="https://developer.datafiniti.co/docs/possible-values-for-business-fields"><em>click here</em></a><em>.</em></p><p>No matter your industry, Datafiniti has over 100 million records across our <a href="https://datafiniti.co/products/business-data/">Business</a>, <a href="https://datafiniti.co/products/people-data/">People</a>, <a href="https://datafiniti.co/products/product-data/">Product</a>, and <a href="https://datafiniti.co/products/property-data/">Property</a> Data Products to take your company to the next level. Are you ready to get started? Click <em>Create a Free Account</em> below to get started on your own or <em>Request a Demo</em> to talk to a member of our sales team.</p><figure><a href="https://datafiniti.co/request-a-demo/"><img alt="" src="https://cdn-images-1.medium.com/max/901/1*0bFYnVW266N1edvtYQ8uGQ.png" /></a></figure><figure><a href="https://datafiniti.co/pricing/business-data-pricing/"><img alt="" src="https://cdn-images-1.medium.com/max/1000/1*VrOhfbQ4X0-gIGj6Msac8g.png" /></a></figure><p><em>If you have any questions, you can contact your customer success representative or email our team at </em><a href="/service/mailto:support@datafiniti.co"><em>support@datafiniti.co</em></a><em>.</em></p><p>— <em>Written by Nicholle Shaver, content marketer.</em></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=8fe13ab0c845" width="1" height="1" alt=""><hr><p><a href="https://medium.com/datafiniti/datafiniti-business-data-taxonomy-8fe13ab0c845">Datafiniti Simplifies Business Data Search with Taxonomy Field Release</a> was originally published in <a href="https://medium.com/datafiniti">Knowledge from Data: The Datafiniti Blog</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Datafiniti Tackles Incomplete Postal Code and Address Formats for 60 Countries With AddressParser]]></title>
            <link>https://medium.com/datafiniti/datafiniti-address-parser-18699c518ab?source=rss-35c2074581c4------2</link>
            <guid isPermaLink="false">https://medium.com/p/18699c518ab</guid>
            <category><![CDATA[data]]></category>
            <category><![CDATA[api]]></category>
            <category><![CDATA[data-extraction]]></category>
            <category><![CDATA[artificial-intelligence]]></category>
            <category><![CDATA[information]]></category>
            <dc:creator><![CDATA[Datafiniti]]></dc:creator>
            <pubDate>Mon, 17 Sep 2018 15:01:02 GMT</pubDate>
            <atom:updated>2018-09-17T15:01:02.874Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*sQobM03utaF2JGkarvmeHw.png" /></figure><p><a href="https://datafiniti.co/">Datafiniti</a>’s mission is to help companies gain instant access to valuable data sourced from thousands of websites. The team strives to curate and clean the data we collect so that businesses can quickly implement our products into their actions, analytics, and applications. Our love for and curiosity about data does not stop there. We also develop in-house solutions to better meet specific customer needs. Learn more about how we provide locational data with our <a href="https://datafiniti.co/products/business-data/">Business Data</a> and <a href="https://datafiniti.co/products/people-data/">People Data</a> Products in this latest update.</p><p>There are 195 countries across the globe, each with their unique postal code and address formats. Without a standard data collection protocol for these variations, developers lose valuable time and face quality control issues. Today, customers will begin to experience increased and comprehensive coverage of address information for over 60 countries with the release of AddressParser.</p><p>“International customers increasingly drive our sales, but in the past, we’ve built our systems for U.S. data,” said Will Hudgins, data engineer. “This project will help us tackle and deliver data, which has been a thorn in our side, for diverse customer needs.”</p><p>AddressParser is an intelligent system that will take an unstructured raw address string and parse it into components including the street address, city, province, postalCode, and country fields as available in Datafiniti’s <a href="https://developer.datafiniti.co/docs/business-data-schema">Business Data</a> and <a href="https://developer.datafiniti.co/docs/people-data-schema">People Data</a> schema. In cases of incomplete address information, the system can infer missing values and identify whether it is a U.S. or non-U.S. address based on the combination of postalCode, city, and or province.</p><p>“For example, in Italy and Spain they often have prepositions in the city names, but sometimes they don’t,” said Hudgins. “There’s a lot of domain-specific knowledge that has to be understood and applied to make this system work.”</p><p>The most exciting part of this project for Hudgins was the ability to apply machine learning principles to his work. AddressParser utilizes constraint propagation like a puzzle for addresses. This process starts with a large scale problem and slowly strips away possible solutions by applying rules tied to the problem. Once all rules or constraints are applied, the AddressParser can identify or propagate a single value for each field of an address and compile all of the information into one, usable data format.</p><p>“That AI technique is the linchpin of this project and brings it together to make it work,” said Hudgins.</p><p><strong>Are you a current Datafiniti customer? </strong>No action is required to start experiencing this upgrade. Increased and comprehensive coverage of western and European Union addresses will automatically be visible through the API and Portal as we update our data sets with the new technology. Up next, the team hopes to expand to include countries across the globe such as India, Mexico, and countries of Africa.</p><p>“The more we develop this idea, the more it’s a game changer for Datafiniti and our customers,” said Hudgins.</p><p>No matter your industry, Datafiniti has over 100 million records across our <a href="https://datafiniti.co/products/business-data/">Business</a>, <a href="https://datafiniti.co/products/people-data/">People</a>, <a href="https://datafiniti.co/products/product-data/">Product</a>, and <a href="https://datafiniti.co/products/property-data/">Property</a> Data Products to take your company to the next level. Are you ready to get started? Click <em>Create a Free Account</em> below to get started on your own or<em> Request a Demo</em> to talk to a member of our sales team.</p><figure><a href="https://datafiniti.co/request-a-demo/"><img alt="" src="https://cdn-images-1.medium.com/max/901/1*0bFYnVW266N1edvtYQ8uGQ.png" /></a></figure><figure><a href="https://datafiniti.co/pricing/people-data-pricing/"><img alt="" src="https://cdn-images-1.medium.com/max/1000/1*VrOhfbQ4X0-gIGj6Msac8g.png" /></a></figure><p><em>If you have any questions, you can contact your customer success representative or email our team at </em><a href="/service/mailto:support@datafiniti.co"><em>support@datafiniti.co</em></a><em>.</em></p><p>— <em>Written by Nicholle Shaver, content marketer.</em></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=18699c518ab" width="1" height="1" alt=""><hr><p><a href="https://medium.com/datafiniti/datafiniti-address-parser-18699c518ab">Datafiniti Tackles Incomplete Postal Code and Address Formats for 60 Countries With AddressParser</a> was originally published in <a href="https://medium.com/datafiniti">Knowledge from Data: The Datafiniti Blog</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[80legs Launches A Newly Redesigned User Portal]]></title>
            <link>https://medium.com/datafiniti/new-80legs-portal-6215545c2221?source=rss-35c2074581c4------2</link>
            <guid isPermaLink="false">https://medium.com/p/6215545c2221</guid>
            <category><![CDATA[user-experience]]></category>
            <category><![CDATA[data]]></category>
            <category><![CDATA[user-interface]]></category>
            <category><![CDATA[web-crawler]]></category>
            <category><![CDATA[crawling]]></category>
            <dc:creator><![CDATA[Datafiniti]]></dc:creator>
            <pubDate>Mon, 02 Jul 2018 12:31:01 GMT</pubDate>
            <atom:updated>2018-07-02T12:31:01.332Z</atom:updated>
            <content:encoded><![CDATA[<h3>80legs Launches a Newly Redesigned User Portal</h3><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*u4yjqxfO_P_FQZ086W492A.png" /></figure><p>Before the birth of Datafiniti, there was <a href="http://80legs.com/">80legs</a>, our cloud-based web crawling, and scraping tool. Today, we announce a better way to continue supporting self-service customers with the launch of a newly redesigned user portal. The modern and user-friendly design mirrors that of Datafiniti’s user portal that <a href="https://blog.datafiniti.co/dfnewuserportal-dd9f4b164c5">launched back in December</a>.</p><figure><a href="http://portal.80legs.com/users/sign_in"><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*okSzayb0TB7MggkW3pHDlg.png" /></a></figure><p>As Datafiniti scales, the team continues to innovate 80legs for users to setup, design, and run their own web crawls. With the start of a new year, the team wanted to start fresh and create a user interface that promotes intuitive navigation and usability.</p><p>“We are always excited about improving our product designs,” said Trevor Pace, product developer. “However, our team is most excited about the code quality increase and ability to make changes faster to the portal for our users.”</p><p>The project was a collaborative effort by teammates in two different countries, the United States and Costa Rica. Pace, and Vincent Zierigen, product developer. Over the course of five months, the pair focused on a set of design mockups and code optimization.</p><p>“Users will find themselves in a whole new environment,” said Zierigen. “With new web technologies in place, the site not only is friendlier but works twice as fast as its predecessor.”</p><p>Customers will experience the same great features, with fewer bugs, and a more polished experience. New customers should have an easier time getting up and running with the crawling process.</p><p><strong>Are you a current 80legs user? Here is what these changes mean for you:</strong></p><p><strong>User interface – </strong>A new interface will showcase an intuitive layout and include helper text for users.</p><p><strong>Crawl dashboard – </strong>A new crawl dashboard will track the status and display an overview of queued crawls, completed crawls, and failed crawls.</p><p><strong>80app validation – </strong>Broken 80apps will trigger an error message during the upload process for a user.</p><p><strong>URL list validation – </strong>Invalid URLs will trigger an error message during the entry process for a user.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*Za_-QJKORKLDwkXMZAvGaA.png" /></figure><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*iU5wffwQtCvbdtFhMkzXsg.png" /></figure><p>“We look forward to maintaining both the Datafiniti and 80legs portal while working on new internal products for our team,” said Pace.</p><p><em>Detailed documentation and resources to guide developers and non-developers in interacting with the unique portal are </em><a href="https://developer.80legs.com/"><em>available here</em></a><em>.</em></p><figure><a href="http://80legs.com/"><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*Z094cu6vQT7Onvr5HacsGw.png" /></a></figure><p><em>If you have any questions, you can contact your customer success representative or email our team at </em><a href="/service/mailto:support@datafiniti.co"><em>support@datafiniti.co</em></a><em>.</em></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=6215545c2221" width="1" height="1" alt=""><hr><p><a href="https://medium.com/datafiniti/new-80legs-portal-6215545c2221">80legs Launches A Newly Redesigned User Portal</a> was originally published in <a href="https://medium.com/datafiniti">Knowledge from Data: The Datafiniti Blog</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[80legs Users Increase Web Crawler Rates with Release of New API]]></title>
            <link>https://medium.com/datafiniti/new-80legs-api-6328fbf7811a?source=rss-35c2074581c4------2</link>
            <guid isPermaLink="false">https://medium.com/p/6328fbf7811a</guid>
            <category><![CDATA[data]]></category>
            <category><![CDATA[user-experience]]></category>
            <category><![CDATA[web-crawler]]></category>
            <category><![CDATA[crawling]]></category>
            <category><![CDATA[api]]></category>
            <dc:creator><![CDATA[Datafiniti]]></dc:creator>
            <pubDate>Mon, 02 Jul 2018 12:01:01 GMT</pubDate>
            <atom:updated>2018-08-29T14:27:57.769Z</atom:updated>
            <content:encoded><![CDATA[<h3>80legs Users Increase Web Crawler Rates With Release of New API</h3><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*u4yjqxfO_P_FQZ086W492A.png" /></figure><p><a href="https://blog.datafiniti.co/what-is-web-crawling-9184d019e094">Every web crawl is different from the next</a>. Web scraping can eat up time, which is why <a href="http://80legs.com/">80legs</a> aims to take on the legwork for its customers. Today, users will notice an uptick in the reliability and speed of their web crawls, thanks to a rework of the 80legs API back-end.</p><p>“We were encountering limits to achievement with our existing architecture,” said Shawn Rushefsky, software engineer. “It has been the bottleneck of our data-ingestion pipeline.”</p><p>Over the course of five months, Moe Jangda, software engineer, and Rushefsky rebuilt the API from the ground up to be more extensible, maintainable, and scalable. Together, the pair researched their technology options for addressing the problem of stuck crawls and extending the lifelong functionality of 80legs.</p><p>“We want our crawling engine to crawl as fast as the internet allows,” said Moe Jangda, software engineer. “To achieve this, we’re setting up our tech stack to dynamically scale based on load.”</p><p>Going forward the 80legs existing architecture will be replaced by RabbitMQ, an open source message broker. With a new codebase, the team can focus their efforts towards elevating throughput and overcoming the limitations of horizontal scaling. In the next few months, the team will deploy additional components to get a better window into the crawling platform and reduce the turnaround time on fixing bugs and delivering features.</p><p><strong>Are you a current 80legs user? Here is what these changes mean for you:</strong></p><p><strong>Faster crawl speeds – </strong>New technology will enhance and increase crawl speeds across the board.</p><p><strong>Fewer stuck crawls – </strong>A more maintainable API will eradicate a category of bugs that often are the cause of stuck crawls.</p><p><strong>Improved customer support – </strong>Admin tools will enable our team to better diagnose and resolve performance problems.</p><p><strong>Enhanced Postman collections – </strong>Custom collections will be available and include your documentation, user information, and access to endpoints.</p><p><strong>Support for query parameters in API calls – </strong>Filter capabilities will allow you to narrow down extensive API results to retrieve the exact information you need.</p><p><strong>Useful error messages – </strong>Messages will provide actionable information regarding the error you received.</p><p>Any current integrations with the 80legs API should remain functional without any changes, but users may want to explore taking advantage of some of the new functionality.</p><p>“We hope this will be a big quality improvement for everyone who interacts with 80legs,” said Rushefsky.</p><p><em>Detailed documentation and resources to guide developers and non-developers in interacting with the unique portal are </em><a href="https://developer.80legs.com/"><em>available here</em></a><em>.</em></p><figure><a href="http://80legs.com/"><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*Z094cu6vQT7Onvr5HacsGw.png" /></a></figure><p><em>If you have any questions, you can contact your customer success representative or email our team at </em><a href="/service/mailto:support@datafiniti.co"><em>support@datafiniti.co</em></a><em>.</em></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=6328fbf7811a" width="1" height="1" alt=""><hr><p><a href="https://medium.com/datafiniti/new-80legs-api-6328fbf7811a">80legs Users Increase Web Crawler Rates with Release of New API</a> was originally published in <a href="https://medium.com/datafiniti">Knowledge from Data: The Datafiniti Blog</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Turning Obstacles Into Opportunities • Q&A With Datafiniti Customer, Datlinq]]></title>
            <link>https://medium.com/datafiniti/datlinq-scala-wrapper-e977eb27fe8c?source=rss-35c2074581c4------2</link>
            <guid isPermaLink="false">https://medium.com/p/e977eb27fe8c</guid>
            <category><![CDATA[scala]]></category>
            <category><![CDATA[developer]]></category>
            <category><![CDATA[api]]></category>
            <category><![CDATA[open-source]]></category>
            <category><![CDATA[data]]></category>
            <dc:creator><![CDATA[Datafiniti]]></dc:creator>
            <pubDate>Tue, 26 Jun 2018 14:01:01 GMT</pubDate>
            <atom:updated>2018-07-15T18:09:07.196Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*9MwPUsgS_uUEJSLsvycihw.png" /></figure><p>Every obstacle with a product is an opportunity to improve and meet customer needs. Or, in the case of one Datafiniti customer, a challenge creates a path to an in-house solution.</p><p>Back in December, our team announced the <a href="https://blog.datafiniti.co/dfv4api-406e737604a8">arrival of our v4 API</a> with the hopes of providing customers with more intuitive user functionality. While working with v3, Tom Lous, a data engineer at Datlinq took matters into his own hands.</p><p><a href="https://datlinq.com/">Datlinq</a> is a foodservice and location database that helps brands gain market insight and connect with potential buyers using Datafinti’s Business Data. To better integrate the Datlinq platform with the Datafiniti API, Lous built an open source Scala wrapper.</p><p>Today, we are talking about feedback and the project’s process in a Q&amp;A with Lous and Shion Deysarkar, CEO and Founder at Datafiniti.</p><p><strong>Q: Tell me a little bit more about yourself and your role at Datlinq.</strong></p><p><strong>TL: </strong>I’m Tom Lous, I’m a Data Engineer at Datlinq. I’m responsible for creating the ingestion processing pipeline from all data sources to one huge data storage and applying machine learning tools. I also build APIs on top of that.</p><p><strong>SD: That sounds like quite a lot of projects you have going on.</strong></p><p><strong>TL:</strong> The main thing is the big data pipeline where we collect a lot of data from Datafiniti, Facebook, Google, and other sources. We combine it all in the pipeline by matching it, sanitizing it, and putting it in a final data store to be accessed by our internal systems.</p><p><strong>Q: When you started using the Datafiniti API, what were your initial impressions?</strong></p><p><strong>TL:</strong> It was pretty straightforward, the v3 API. I know you guys were still in development. There were some things I had to communicate and you got them fixed quite early on. I think some of the little hiccups, for all intents and purposes, were pretty useful. You improved a lot with the v4 API. It’s more standardized in the sense of security and flow.</p><p><strong>Q: Are there any outstanding features of the API you wish were there?</strong></p><p><strong>TL:</strong> No. One of the main things we were looking for, <em>Search by ID</em>, is now implemented in the v4 API. What will be neat is if we could limit the size of some fields. For example, returning reviews for search and locations. For Tower of London, it gives me 50,000 reviews which are not very useful to us. It will be great if you could create views where you say, ‘Limit these fields to a max of and only use the latest versions’. That will be a nice feature.</p><p><strong>Q: What motivated you to build a Scala wrapper with the Datafiniti API?</strong></p><p><strong>TL: </strong>That’s a good question. We were going to use this API in different parts of our pipeline. First of all the ingestion part, but also for our data scientist to get little batches of samples, and maybe some other places as well. Mainly, because the standard API is pretty straightforward, but the download flow, especially authentication, was pretty complicated. It involves a lot of steps that you have to remember. I think putting it all in one single location is more advantageous and makes our developers not have to think about how to implement the API authentication and flow. That being said, I talked to my CEO about it, ‘If we’re building this IP, it will be great if we just open source it’. It’s a good way to showcase that we’re part of the open source community and maybe help some people who also use Java or Scala in that fashion.</p><p><strong>Q: Were there any other specific challenges that you faced when writing the wrapper?</strong></p><p><strong>TL: </strong>As I said, the download flow, especially in v3 was challenging. I had to solve it with polling constructs to see if it was ready, when it was ready, and when to start downloading individual files. I ran into some interesting issues. For example, the way you generated downloads, it depended on how short the information was and the underlying Elasticsearch database. Sometimes it resulted in three separate download links and sometimes it resulted in 200 separate download links, especially if the dataset was pretty big. Since I did everything multithreaded, for each download, I spawned different threads. It jammed up my system because I spawned 200 threads and downloaded from AWS. My system didn’t like it, and AWS didn’t like it as well. I had to provision some stuff. ‘If there’s more than X downloads, just use at most, 20 threads’.</p><p><strong>Q: Do you think handling the download process is the main benefit of using the wrapper over the API directly?</strong></p><p><strong>TL:</strong> If I have the library in my Scala […] I don’t have to think about the authentication flow. V4, actually, I think involves an extra step in generating the token, which is a good practice in my opinion, but if you want to deploy that in your software, you have to either remember to first do this, then that, where to store information, and this gives us a general approach. I think that’s the main benefits.</p><p><strong>Q: What additional features would you like to add to the wrapper?</strong></p><p><strong>TL: </strong>Now it’s what I return as pure JSON because I haven’t bothered with creating data constructs out of the results sets. From a purely functional approach, I would rather define models that can be used down the line, so I don’t have to parse or check the JSON. It’s more pure. The difficulty is, because depending on what view you’re using, the model may change. I’m not sure if on your end you can change the data type or the data structure as well, but if you do, the model will break. I’m a bit apprehensive about implementing that, but it’s something that’s on my wish list.</p><p><strong>Q: How can other people or developers help with the project?</strong></p><p><strong>TL: </strong>Oh, that’s great. Just clone the repository and check it out. If you change stuff, make a pull request. I’m not promising that I will get back to you the next day, but I take every contribution seriously. Feel free to help.</p><p>At Datafiniti, our team strives to improve our products by actively engaging with our customers. We are excited about the initial feedback we have received and intend to incorporate this information into our development process for future designs. Stay tuned for more updates coming soon on additional 80legs products.</p><p><em>You can learn more about and contribute to Datlinq’s open source Scala wrapper </em><a href="https://github.com/datlinq/scalafiniti"><em>here</em></a><em>.</em></p><p><strong><em>You can connect with us and learn more about our business, people, product, and property APIs and datasets by selecting one of the options below.</em></strong></p><figure><a href="https://datafiniti.co/request-a-demo/"><img alt="" src="https://cdn-images-1.medium.com/max/1000/1*MQZr3xmXlTG7G_5Nin6CkA.png" /></a></figure><figure><a href="https://portal.datafiniti.co/"><img alt="" src="https://cdn-images-1.medium.com/max/1000/1*FMx9F3bWiWRlT14qS5Anrg.png" /></a></figure><p><em>If you have any questions, you can contact your customer success representative or email our team at </em><a href="/service/mailto:support@datafiniti.co"><em>support@datafiniti.co</em></a><em>.</em></p><p>— <em>Written by Nicholle Shaver, content marketer.</em></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=e977eb27fe8c" width="1" height="1" alt=""><hr><p><a href="https://medium.com/datafiniti/datlinq-scala-wrapper-e977eb27fe8c">Turning Obstacles Into Opportunities • Q&amp;A With Datafiniti Customer, Datlinq</a> was originally published in <a href="https://medium.com/datafiniti">Knowledge from Data: The Datafiniti Blog</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Datafiniti Expedites Data Access with Faster Searches Following ElasticSearch Update]]></title>
            <link>https://medium.com/datafiniti/dffastersearches-e44b17d129ab?source=rss-35c2074581c4------2</link>
            <guid isPermaLink="false">https://medium.com/p/e44b17d129ab</guid>
            <category><![CDATA[elasticsearch]]></category>
            <category><![CDATA[api]]></category>
            <category><![CDATA[data-extraction]]></category>
            <category><![CDATA[data]]></category>
            <category><![CDATA[search]]></category>
            <dc:creator><![CDATA[Datafiniti]]></dc:creator>
            <pubDate>Wed, 28 Mar 2018 18:55:16 GMT</pubDate>
            <atom:updated>2018-04-26T15:39:38.131Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*8U9iTm8JvhzeYmcWGlN5CA.png" /></figure><p>Empowering customers to navigate and put millions of data records into action is one of the cornerstones of Datafiniti. Today, we introduce a way for users to spend more time focusing on building a data-driven strategy with faster searches and increased stability. — <a href="https://ctt.ec/7zkr6"><em>Tweet about this</em></a></p><p>The significant changes come as a result of a complete migration to the <a href="https://www.elastic.co/blog/elasticsearch-6-0-0-released">most recent version of ElasticSearch</a>.</p><p>“We never want to miss a chance to polish our infrastructure and product,” said Phil Coleman, chief technology officer. “We can leverage this to accelerate access for our users.”</p><p>Datafiniti is always on the lookout for ways to stay competitive with frequent updates to our database technology. For two months, the team planned for enhancements that would complement and expand existing infrastructure. This ElasticSearch upgrade will elevate the way customers interact with the product, as well as, store and fetch their data results.</p><p>“By providing faster searches we should amplify the overall user experience,” said Coleman. “Our users can get even more data than they would have before.”</p><p><strong>Are you a current Datafiniti customer?</strong> No action is required to start experiencing this upgrade. Faster searches and downloads will automatically occur within the API and portal. Up next, the team hopes to further explore cutting-edge advances in barriers to data collection and delivery.</p><p><strong><em>You can connect with us and learn more about our business, people, product, and property APIs and datasets by selecting one of the options below.</em></strong></p><figure><a href="https://datafiniti.co/request-a-demo/"><img alt="" src="https://cdn-images-1.medium.com/max/1000/1*MQZr3xmXlTG7G_5Nin6CkA.png" /></a></figure><figure><a href="https://portal.datafiniti.co/"><img alt="" src="https://cdn-images-1.medium.com/max/1000/1*FMx9F3bWiWRlT14qS5Anrg.png" /></a></figure><p><em>If you have any questions, you can contact your customer success representative or email our team at </em><a href="/service/mailto:support@datafiniti.co"><em>support@datafiniti.co</em></a><em>.</em></p><p>— <em>Written by Nicholle Shaver, content marketer.</em></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=e44b17d129ab" width="1" height="1" alt=""><hr><p><a href="https://medium.com/datafiniti/dffastersearches-e44b17d129ab">Datafiniti Expedites Data Access with Faster Searches Following ElasticSearch Update</a> was originally published in <a href="https://medium.com/datafiniti">Knowledge from Data: The Datafiniti Blog</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[What is the Fast Food Capital of America?]]></title>
            <link>https://medium.com/datafiniti/dffastfoodrestaurantsamerica-8e5ba0efab96?source=rss-35c2074581c4------2</link>
            <guid isPermaLink="false">https://medium.com/p/8e5ba0efab96</guid>
            <category><![CDATA[food]]></category>
            <category><![CDATA[api]]></category>
            <category><![CDATA[data]]></category>
            <category><![CDATA[data-analysis]]></category>
            <category><![CDATA[fast-food]]></category>
            <dc:creator><![CDATA[Datafiniti]]></dc:creator>
            <pubDate>Fri, 16 Mar 2018 07:00:00 GMT</pubDate>
            <atom:updated>2018-05-18T13:31:01.823Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*bTa5Qugl9JjvHL3zXTRLDg.png" /></figure><p>When it comes to fast food, Americans are lovin’ it! In our latest exploration piece with <a href="https://priceonomics.com/ranking-the-places-with-the-most-and-least-fast/">Priceonomics</a>, we discover which cities and states offer the most finger-lickin’ good options by analyzing over 190,000 records provided by our <a href="https://datafiniti.co/products/business-data/">Business API and Database</a>.</p><ul><li>What is the total number of fast food restaurants per capita?</li><li>What are the major cities with the most and least fast food restaurants per capita?</li><li>What are the top fast food restaurants per capita for all states?</li><li>Which fast food restaurants have the most locations nationally?</li><li>Which small cities have the most fast food restaurants per capita?</li><li>Which states have the most and least fast food restaurants per capita?</li></ul><p><strong><em>Interested in reading more? Click below.</em></strong></p><figure><a href="https://datafiniti.co/fast-food-restaurants-america/"><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*cD5BNgdp-VCxHJwQRYDaqw.png" /></a></figure><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=8e5ba0efab96" width="1" height="1" alt=""><hr><p><a href="https://medium.com/datafiniti/dffastfoodrestaurantsamerica-8e5ba0efab96">What is the Fast Food Capital of America?</a> was originally published in <a href="https://medium.com/datafiniti">Knowledge from Data: The Datafiniti Blog</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Datafiniti Customers Level Up Lead Generation with People Data Vertical]]></title>
            <link>https://medium.com/datafiniti/dfpeopledatavertical-97769f1d7b54?source=rss-35c2074581c4------2</link>
            <guid isPermaLink="false">https://medium.com/p/97769f1d7b54</guid>
            <category><![CDATA[demographics]]></category>
            <category><![CDATA[people]]></category>
            <category><![CDATA[api]]></category>
            <category><![CDATA[data-science]]></category>
            <category><![CDATA[data]]></category>
            <dc:creator><![CDATA[Datafiniti]]></dc:creator>
            <pubDate>Mon, 05 Mar 2018 12:01:01 GMT</pubDate>
            <atom:updated>2018-04-11T19:21:04.997Z</atom:updated>
            <content:encoded><![CDATA[<h3><strong>Datafiniti Customers Level Up Lead Generation With People Data Vertical</strong></h3><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*Zhl2iReKKioK3tJAIfKimQ.png" /></figure><p>When it comes to lead generation, quality reigns supreme. Following this long-standing demand for data, our customers’ wish is our command. — <a href="https://ctt.ec/mbU4_"><em>Tweet about this</em></a></p><p>“This is the first time we’ve added an entirely new data type since mid-2015,” said Will Hudgins, data engineer. “A data vertical like this will allow us to serve a major segment of the market that we previously could not meet the needs of.”</p><p>People Data will launch with access to 5 million reliable demographic records. Each record includes diverse contact information for the person it represents. Customers can query on both individual and company-features including job level and title, position, company and industry size, revenue, and more.</p><p>“Our team worked for two months to prepare this data to be stored and then offer our customers with a stress-free way to retrieve it,” said Hudgins.</p><p>Through an Extract Transform Load (ETL) software process, Hudgins extracted, transformed, and integrated the data from a variety of publicly available sources into a usable form.</p><h4>Are you a current or future Datafiniti customer? You can now subscribe to People Data and leverage these top-level fields for your lead generation activities:</h4><ol><li>Emails</li><li>Phones</li><li>JobTitle</li><li>BusinessName</li><li>BusinessCategories</li></ol><p><em>View the </em><a href="https://developer.datafiniti.co/v4/docs/people-data-schema"><em>People Data Schema in full here</em></a><em>.</em></p><p><strong><em>You can connect with us and learn more about our business, people, product, and property APIs and datasets by selecting one of the options below.</em></strong></p><figure><a href="https://datafiniti.co/request-a-demo/"><img alt="" src="https://cdn-images-1.medium.com/max/1000/1*MQZr3xmXlTG7G_5Nin6CkA.png" /></a></figure><figure><a href="https://portal.datafiniti.co/"><img alt="" src="https://cdn-images-1.medium.com/max/1000/1*FMx9F3bWiWRlT14qS5Anrg.png" /></a></figure><p>Our team looks forward to seeing how the outcomes of this release will empower your team to streamline its workflow and maximize productivity as we collaborate on fulfilling your data needs.</p><p><em>— Written by Nicholle Shaver, content marketer</em></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=97769f1d7b54" width="1" height="1" alt=""><hr><p><a href="https://medium.com/datafiniti/dfpeopledatavertical-97769f1d7b54">Datafiniti Customers Level Up Lead Generation with People Data Vertical</a> was originally published in <a href="https://medium.com/datafiniti">Knowledge from Data: The Datafiniti Blog</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Is There a Connection Between Spelling Errors and Negative Online Reviews?]]></title>
            <link>https://medium.com/datafiniti/dfgrammarofonlinereviews-9675ad80d680?source=rss-35c2074581c4------2</link>
            <guid isPermaLink="false">https://medium.com/p/9675ad80d680</guid>
            <category><![CDATA[data]]></category>
            <category><![CDATA[api]]></category>
            <category><![CDATA[writing]]></category>
            <category><![CDATA[review]]></category>
            <category><![CDATA[data-analysis]]></category>
            <dc:creator><![CDATA[Datafiniti]]></dc:creator>
            <pubDate>Tue, 06 Feb 2018 08:00:00 GMT</pubDate>
            <atom:updated>2018-05-14T16:31:00.859Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*hfrV3Cs7NC3g-W4XlpmUIw.png" /></figure><p>On e-commerce sites, consumers turn to reviews to inform their purchase decisions. In our February 2018 exploration piece with <a href="https://priceonomics.com/is-there-a-connection-between-bad-grammar-and/">Priceonomics</a>, we assess three aspects of writing quality: length, spelling errors, and grammar usage by analyzing over 100,000 written product provided by our <a href="https://datafiniti.co/products/product-data/">Product API and Database.</a></p><ul><li>Do reviewers use punctuation correctly?</li><li>Does the number of spelling errors differ by rating?</li><li>How does review length differ by rating?</li><li>How long is the typical review?</li><li>What is the distribution of star ratings across products?</li><li>What is the frequency of words with spelling errors by rating?</li><li>What is the number of reviews that don’t end sentences with punctuation?</li><li>What is the proportion of reviews with spelling errors?</li></ul><p><strong><em>Interested in reading more? Click below.</em></strong></p><figure><a href="https://datafiniti.co/grammar-of-online-reviews/#"><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*cD5BNgdp-VCxHJwQRYDaqw.png" /></a></figure><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=9675ad80d680" width="1" height="1" alt=""><hr><p><a href="https://medium.com/datafiniti/dfgrammarofonlinereviews-9675ad80d680">Is There a Connection Between Spelling Errors and Negative Online Reviews?</a> was originally published in <a href="https://medium.com/datafiniti">Knowledge from Data: The Datafiniti Blog</a> on Medium, where people are continuing the conversation by highlighting and responding to this story.</p>]]></content:encoded>
        </item>
    </channel>
</rss>