PinnedStefano Lori·Jul 2, 2023Ranking document similarity at scale with Spark NLPCombining the power of Spark NLP sentence embeddings and LSH approximate nearest neighbors search pipelines to catch contextual and…
Stefano Lori·Mar 18, 2024Spark NLP Document Similarity Ranker as-retriever for RAG tasksBreaking news! Spark NLP (https://sparknlp.org/) gets enhanced with a new DocumentSimilarityRanker as-retriever interface for your RAG…
Stefano Lori·May 20, 2023Polars is all you need: SQL chapterI just found a powerful Python SQL API for my data analysis
Inspark-nlpbyStefano Lori·Jan 13, 2021Cleaning and extracting content from HTML/XML documents using Spark NLPSpark NLP is an open-source text processing library for advanced natural language processing for the Python, Java and Scala programming…
Stefano Lori·Jul 21, 2020Reliable and serverless data ingestion using Delta Lake on AWS GlueThe Big Data scenario