Acceldata
 ODP
Search documentation… ⌘K

Manage Configurations

Version-Specific Configurations

Each Livy version has independent configuration files:

/etc/livy3/conf/ # Livy 3.5.5
/etc/livy3_3_3_3/conf/ # Livy 3.3.3
/etc/livy3_3_5_1/conf/ # Livy 3.5.1

Key Configuration Files

livy.conf

Main Livy configuration file containing server settings:

# /etc/livy3_3_3_3/conf/livy.conf
livy.server.port = 8333
livy.spark.master = yarn
livy.spark.deploy-mode = cluster
livy.repl.enable-hive-context = true
livy.rsc.jars = /usr/odp/current/livy3_3_3_3-server/rsc-jars
livy.server.session.timeout = 1h
spark-blacklist.conf
Controls which Spark configurations clients can override:

# Configurations that Livy clients cannot override
spark.master
spark.submit.deployMode
spark.yarn.keytab
spark.yarn.principal
livy-env.sh
Environment variables for Livy server:

export SPARK_HOME=/usr/odp/current/spark3_3_3_3-client
export SPARK_CONF_DIR=/etc/spark3_3_3_3/conf
export HADOOP_CONF_DIR=/etc/hadoop/conf
export LIVY_SERVER_JAVA_OPTS="-Xmx2g"

Modifying Configurations via Ambari

  1. Navigate to Services → Select Livy version
  2. Click the "Configs" tab
  3. Modify settings as needed
  4. Save changes
  5. Restart Livy Server

Example: Increase session timeout for Livy 3.3.3

  1. Go to Spark3 3.3.3 service
  2. Configs → Advanced livy3-3.3.3-conf
  3. Set livy.server.session.timeout = 2h
  4. Save and restart the Livy Server