Acceldata
ODP

Livy 3 Migration Guide

Migrating from Livy 3.3.3 to Livy 3.5.5

Step 1: Assessment

# Check current session usage
curl http://<host>:8333/sessions | jq '.total'
# Identify client applications
grep -r "8333" /path/to/application/configs

Step 2: Testing

# Test application with Livy 3.5.5
livy_client = LivySession(url='http://<host>:8355')
session = livy_client.create(kind='pyspark')
# Run test workloads
# Validate results
# Check for errors

Step 3: Gradual Migration

  1. Update non-critical applications first
  2. Monitor for issues for 1-2 weeks
  3. Migrate critical applications during the maintenance window
  4. Keep Livy 3.3.3 running for 30 days post-migration

Step 4: Decommission

# Stop Livy 3.3.3 server via Ambari UI
# Monitor for any connection attempts
# Remove service after validation period