Streamlining Text Pre-Processing and Metrics Extraction

Natural Language Processing involves reshaping and refining data sets into data that can be used for analysis, ensuring that the data is well formatted. The efficiency gap of data scientists spending most of their time preparing data is an opportunity for the technology sector to work on solutions to the problem. For this reason, a web tool has been developed that is capable of, on the one hand, speeding up the text cleaning process and, on the other hand, facilitating the extraction of metrics by analyzing and processing the texts through customized dictionaries in LIWC format, uploaded by the users themselves, and through sentiment analysis. All this, from a single interface that allows the user to customize the whole pipeline offering different modules for pre-processing and metrics extraction in order to be a solution to facilitate, streamline and automate the whole process.