🚀 Kyuubi + Apache Spark: Big Data, Smarter Execution
Aleksei Aleinikov

Aleksei Aleinikov @aleksei_aleinikov

About: My interests range from building complex algorithms and designing high-performance systems to applying AI to solve real-world challenges.

Location:
Thessaloniki, Greece
Joined:
Mar 17, 2025

🚀 Kyuubi + Apache Spark: Big Data, Smarter Execution

Publish Date: Mar 21
0 1

Kyuubi supercharges Spark SQL with resource isolation, multi-user support, interactive performance, and high availability.

No more:

  • Cluster-wide slowdowns from one heavy query ☠️
  • Missing security controls 🔐
  • Session crashes without recovery 🧨

Why Kyuubi > Spark Thrift Server?

  • 🧩 Isolates sessions & allocates resources per user
  • 🔐 Integrates with Apache Ranger for row/column-level security
  • ⚡️ Uses ZooKeeper for failover + session continuity
  • 🚀 Pre-warms Spark sessions for blazing-fast interactive queries

Key Features:

  1. Multi-tenancy: Each user gets their own Spark instance
  2. JDBC/ODBC + REST API support
  3. Python, SQL, Scala compatibility
  4. HA with ZooKeeper
  5. Extensions (UDFs, auth, logging)
  6. Works great in Arenadata Hadoop (ADH) stacks

Try it out and bring efficiency, security, and scalability to your Spark environment!

https://medium.datadriveninvestor.com/kyuubi-spark-power-of-big-data-a51d385f2f19

Comments 1 total

  • Renqiang2020
    Renqiang2020Jul 10, 2025

    如何在HUE中配置使用开启HA的kyuubi ?

Add comment