DEV Community

Aleksei Aleinikov
Aleksei Aleinikov

Posted on

๐Ÿš€ Kyuubi + Apache Spark: Big Data, Smarter Execution

Kyuubi supercharges Spark SQL with resource isolation, multi-user support, interactive performance, and high availability.

No more:

  • Cluster-wide slowdowns from one heavy query โ˜ ๏ธ
  • Missing security controls ๐Ÿ”
  • Session crashes without recovery ๐Ÿงจ

Why Kyuubi > Spark Thrift Server?

  • ๐Ÿงฉ Isolates sessions & allocates resources per user
  • ๐Ÿ” Integrates with Apache Ranger for row/column-level security
  • โšก๏ธ Uses ZooKeeper for failover + session continuity
  • ๐Ÿš€ Pre-warms Spark sessions for blazing-fast interactive queries

Key Features:

  1. Multi-tenancy: Each user gets their own Spark instance
  2. JDBC/ODBC + REST API support
  3. Python, SQL, Scala compatibility
  4. HA with ZooKeeper
  5. Extensions (UDFs, auth, logging)
  6. Works great in Arenadata Hadoop (ADH) stacks

Try it out and bring efficiency, security, and scalability to your Spark environment!

https://medium.datadriveninvestor.com/kyuubi-spark-power-of-big-data-a51d385f2f19

Top comments (0)

OSZAR »