Enhancements

Airflow

• OCR-2567: Airflow's OpenLineage integration has been updated to 1.14.0, along with related dependencies, picking up the latest lineage capabilities and fixes.

Celeborn

• OCR-2546: Celeborn 2239 and 2240 now supports Spark 4.1.

Druid

• ODP-7065: Druid is now compatible with Hive 4.1.0.

Flink

• ODP-7065: Flink's Hive connector now matches Hive 4.1.0 and is used by default.

Hive

• OCR-2508: You can now search for databases using a wildcard (*), matching the previous search behavior.
• ODP-2718|ODP-2733: Updated Python script shebangs to use ambari-python-wrap for improved compatibility with the Ambari environment.
• OCR-2317: You can now set S3 credentials on a per-session basis in Warehouse, instead of using a single shared credential.
• ODP-4465: Added unit test cases to validate exception handling and message formatting.

Hue

• ODP-6942: Hue's Trino connector now supports Kerberos authentication.

Impala

• ODP-7065: Impala is now compatible with Hive 4.1.0.

Kafka3

• ODP-6598: Kafka3 now includes the Aiven Kafka tiered storage plugins for Google Cloud Storage and Azure, so you can offload older log segments to cloud object storage.

Kudu

• ODP-7065: Kudu is now compatible with Hive 4.1.0.

Livy

• ODP-7065: Livy is now compatible with Hive 4.1.0.

NiFi

• OCR-2039: NiFi now exposes Jetty JMX beans, so you can monitor the embedded Jetty server through JMX.
• OCR-2389: You can now set a remote-charset parameter for the DeleteSFTP processor.

NiFi2

• OCR-2039: NiFi2 now exposes Jetty JMX beans, so you can monitor the embedded Jetty server through JMX.
• OCR-2389: You can now set a remote-charset parameter for the DeleteSFTP processor.

ODP-Ambari

• OCR-2397: Ambari now includes a ruler control for resizing table columns.
• OCR-2523: The Configs dropdown and Manage Config Groups pages now show full configuration group names instead of truncating them.
• OCR-2482: You can now set the Knox umask through the knox-env.sh template in Ambari.
• ODP-6820: Ambari now supports Azul Platform Prime JVM tuning flags and profiles across services.
• ODP-7420: Ambari now runs the Impala service check on an Impala Daemon host, improving check reliability.

Oozie

• ODP-7065: Oozie is now compatible with Hive 4.1.0.

Phoenix

• ODP-7065: Phoenix is now compatible with Hive 4.1.0.

Ranger

• ODP-7065: Ranger is now compatible with Hive 4.1.0.
• ODP-6363: Ranger now includes initial support for syncing the RMS mapper service.
• ODP-7094: Ranger UserSync now supports SASL binding for LDAP connections.
• ODP-7180: Ranger's Hive service definition now includes a read/write storage type.
• ODP-7181: Ranger now allows SPNEGO authentication only when unauthenticated access is also allowed.
• ODP-7182: Ranger resource mapping now performs better against larger sets of entities.

Spark2

• ODP-7065: Spark2 is now compatible with Hive 4.1.0.

Spark3

• ODP-6259: You can now enable TRUNCATE TABLE on external tables in Spark3 through a configuration flag.
• ODP-7260: Spark3 now bundles the ODP Celeborn client.
• ODP-7314 | ODP-7313: The Spark 3.5.5 YARN shuffle service now runs isolated from other shuffle service versions, reducing the risk of version conflicts.

Spark4

• ODP-7314: The Spark 4.1.1 YARN shuffle service now runs isolated from other shuffle service versions, reducing the risk of version conflicts.
• ODP-7307: Spark4 now uses Gluten 1.7.0.3.3.6.5.
• ODP-6987: Spark4 now uses Apache Iceberg 1.10.2.

Sqoop

• ODP-7065: Sqoop is now compatible with Hive 4.0.1.

Spark3 Warehouse Connector

• OCR-2522: The Spark3 Warehouse Connector now supports Direct Reader V2 compatibility with the Spark 2 Hive Warehouse Connector.
• ODP-7065: The Spark3 Warehouse Connector is now compatible with Hive 4.1.0.

Trino

• ODP-7065: Trino is now compatible with Hive 4.1.0.
• ODP-7240: Trino now supports legacy Hive Metastore (HMS) requests.

Zeppelin

• ODP-7065: Zeppelin is now compatible with Hive 4.1.0.