Acceldata
ODP

Monitoring and Metrics

Livy Server Logs

# Livy 3.5.5
tail -f /var/log/livy3/livy-livy-server.out
# Livy 3.3.3
tail -f /var/log/livy333/livy-livy-server.out
# Livy 3.5.1
tail -f /var/log/livy351/livy-livy-server.out

REST API Metrics

# Get all sessions
curl http://<host>:8355/sessions | jq '.total'
# Get batch jobs
curl http://<host>:8355/batches | jq '.total'
# Session states
curl http://<host>:8355/sessions | jq '.sessions[] | {id, state}'

Ambari Metrics

Monitor via Ambari dashboard:

  • Livy server JVM heap usage
  • Active sessions count
  • Request rate
  • Response times