apache / spark
Apache Spark - A unified analytics engine for large-scale data processing
See what the GitHub community is most excited about today.
Apache Spark - A unified analytics engine for large-scale data processing
The pure asynchronous runtime for Scala
Gluten is a middle layer responsible for offloading JVM-based SQL engines' execution to native engines.
An Agile RISC-V SoC Design Framework with in-order cores, out-of-order cores, accelerators, and more
Scala 2 compiler and standard library. Scala 2 bugs at https://github.com/scala/bug; Scala 3 at https://github.com/scala/scala3
Source code for Twitter's Recommendation Algorithm
The Scala 3 compiler, also known as Dotty.
Open-source high-performance RISC-V processor
Scala based HDL
An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs
Open-source code analysis platform for C/C++/Java/Binary/Javascript/Python/Kotlin based on code property graphs. Discord https://discord.gg/vv4MH284Hc
Modern Load Testing as Code
The Community Maintained High Velocity Web Framework For Java and Scala.
Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.
Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.
Spark RAPIDS plugin - accelerate Apache Spark with GPUs
An open protocol for secure data sharing
TheHive: a Scalable, Open Source and Free Security Incident Response Platform