Enhancements
What's New
This section consists of the enhancements by services introduced in this release.
ODP-Ambari
Ambari
ODP JIRA | Apache JIRA | Description |
|---|---|---|
ODP-4147 | Added the SSL properties in hbase-site.xml. | |
ODP-4149 | Set the default log level for Infra-solr to INFO. | |
ODP-4088 | Reverted ODP-46 HUE order in the 3.0 stack and applied ODP-717 LIVY3 order in the 3.3 stack. | |
ODP-4088 ODP-3812 | The Kafka 2 default configurations are now tuned for the 3.0 stack. | |
ODP-4088 ODP-3277 | Replaced root-level Hive commands with sudo-compatible alternatives. | |
ODP-3812 | The Kafka 2 default configurations are now tuned for the 3.3 stack (#240). | |
ODP-3825 | Updated the Zeppelin default configurations (#236). | |
ODP-3786 | Updated the HBase version in Ambari to 2.7.9.1-1 -v2. | |
ODP-3926 | Updated the Zeppelin version to 0.11.2 (#234). | |
ODP-3922 | Updated the Oozie version to 5.2.1 (#233). | |
ODP-3881 | The HBase default configurations are now tuned for the 3.0 and 3.3 stacks (#231) | |
ODP-3794 | Updated the Hadoop default configurations (#224). | |
ODP-3802 | Updated the Hive default configurations (#225). | |
ODP-3810 | Updated the Druid's default configurations (#226). | |
ODP-3801 | Updated the HBase 2.6.2 default configurations (#220). | |
ODP-3767 | Refactored hadoopheapsize Minimum/Maximum parameters to a unified hadoop_heapsize setting. | |
ODP-3786 | Updated the HBase version in Ambari-2.7.9.1-1. | |
ODP-2519: | Introduced JMX-based observability for Kafka Connect in stack 3.3. | |
ODP-2577 | Introduced Kafka MirrorMaker2 observability via JMX port (#154) in stack 3.3. | |
ODP-3530 | AMBARI-26108 | Added the Systemd support for Ambari and fixed the executable issue (#208). |
ODP-3456 | Knox Improvements: Updated template and increased TTL (#207) | |
ODP-3451 | Added log rotation for Kafka 2 Cruise-Control. | |
ODP-3198 | Updated the Python version to 3.11. | |
ODP-2747 | Removed the stacks older than 3.0 (#164). | |
ODP-2752 | Removed the stack ODPWIN. | |
ODP-2719 | Refactored shebangs for scripts to ambari-python-wrap (#168). | |
ODP-2805 | Fixed the Python 3 candidates and version check for ambari-python-wrap. | |
ODP-2425 | Enabled the SOLR auditing for Kudu (Python 3). | |
ODP-2519 | Introduced the Kafka Connect observability for JMX. | |
ODP-2577 | Introduced Kafka MirrorMaker 2 observability via JMX port (#154) | |
ODP-3541 | Added the HIVE_CLIENT identity to Hive kerberos mapping. | |
ODP-3278 | AMBARI-26306 | Bumped Logback to version 1.5.16 (#196). |
ODP-3277 | Replaced root commands in Hive with sudo-compatible alternatives (#195) | |
ODP-3143 | Increased MR’s JHS heap size | |
ODP-3207 | AMBARI-26305 | Set up Hive’s initial heap size (Xms) configuration. |
ODP-1954 | AMBARI-26107 | Migrated away from DOMNodeInserted to MutationObserver (ambari-admin) (#3819) |
ODP-2977 | Handle NameNode restart timeout during rolling upgrade |
Airflow
ODP JIRA | Apache JIRA | Description |
|---|---|---|
ODP-3652 ODP-2769 | Refactored shebangs for Python scripts to ambari-python-wrap. | |
ODP-3875 | Added the Apache Airflow installation through tarball. |
Druid
ODP JIRA | Apache JIRA | Description |
|---|---|---|
ODP-2718 ODP-2759 | Refactored shebangs for Python scripts to use ambari-python-wrap (#20) | |
ODP-3953 | Fixed Druid’s open version to project version (#21) |
Flink
ODP JIRA | Apache JIRA | Description |
|---|---|---|
ODP-2774) | Refactored the shebangs for Python scripts to use ambari-python-wrap |
HBase
ODP JIRA | Apache JIRA | Description |
|---|---|---|
ODP-2761 | Refactored shebangs for Python scripts to ambari-python-wrap. | |
ODP-3912 | Added Acceldata staging repository | |
ODP-3913 | Changed distribution management to point to staging repository |
Hive
ODP JIRA | Apache JIRA | Description |
|---|---|---|
ODP-2718 ODP-2733 | Refactored the shebangs for Python scripts to use ambari-python-wrap |
Impala
ODP JIRA | Apache JIRA | Description |
|---|---|---|
ODP-3630 | Upgraded Ozone and HBase to version ODP-3.3.6.1-1. | |
ODP-2739 | Refactored to use ambari-python-wrap. | |
ODP-3089 | Added Acceldata repository in Java and FE projects. |
Kafka
ODP JIRA | Apache JIRA | Description |
|---|---|---|
ODP-2772 | Refactored the shebangs for Python scripts to use ambari-python-wrap. |
Kafka 3
ODP JIRA | Apache JIRA | Description |
|---|---|---|
ODP-2770 | Refactored Kafka3 to use ambari-python-wrap for all scripts. | |
ODP-2577 | Added observability for Kafka MirrorMaker2 JMX port. | |
ODP-2519 | Added observability for Kafka Connect JMX. |
Knox
ODP JIRA | Apache JIRA | Description |
|---|---|---|
ODP-2718 ODP-2773 | Refactored shebangs for Python scripts to use ambari-python-wrap |
Livy
ODP JIRA | Apache JIRA | Description |
|---|---|---|
ODP-2795 | Refactored Livy to use ambari-python-wrap. | |
ODP-2050 | Bumped up the Thrift version to match with Spark 3. | |
ODP-3750 | Changed the ODP version to 3.3.6.1-1. |
NiFi/NiFi-Registry
ODP JIRA | Apache JIRA | Description |
|---|---|---|
ODP-2771: | Refactored shebangs for Python scripts to use ambari-python-wrap. |
Oozie
ODP JIRA | Apache JIRA | Description |
|---|---|---|
ODP-2760 | Refactored Oozie to use ambari-python-wrap for all scripts | |
ODP-2415 | Updated Oozie to use ODP jars for dependent projects | |
ODP-3945 | Removed open.oozie.version |
Ranger
ODP JIRA | Apache JIRA | Description |
|---|---|---|
ODP-4170 | Fixed the Trino supported version. | |
ODP-4078 | Added missing hadoop-client-runtime required for Ranger HDFS auditing. | |
ODP-4078 | Added missing hadoop-hdfs-client required for Ranger HDFS auditing (#65) | |
ODP-3773 | Upgraded Ozone to 1.4.1.3.3.6.1-1. | |
ODP-3785 | Updated the HBase and HBase third-party versions to ODP stack version. | |
ODP-3628 | Updated Kafka and Sqoop to ODP stack version | |
ODP-3190 | Added message to Kudu Ranger plugin connection test (#59) | |
ODP-2718 ODP-2746 | Refactored shebangs for Python scripts to use ambari-python-wrap (#61). |
Schema Registry
ODP JIRA | Apache JIRA | Description |
|---|---|---|
ODP-2765 | Refactored to use ambari-python-wrap |
Sqoop
ODP JIRA | Apache JIRA | Description |
|---|---|---|
ODP-3785 | Updated the HBase version in Sqoop. | |
ODP-2764 | Refactored Sqoop to use ambari-python-wrap for all scripts. |
Tez
ODP JIRA | Apache JIRA | Description |
|---|---|---|
ODP-2718 ODP-2763 | Refactored shebangs for Python scripts to ambari-python-wrap. |
Zeppelin
ODP JIRA | Apache JIRA | Description |
|---|---|---|
ODP-2782 | Refactored to use ambari-python-wrap. |
Zookeeper
ODP JIRA | Apache JIRA | Description |
|---|---|---|
ODP-3652 ODP-2769 | Refactored shebangs for Python scripts to ambari-python-wrap. |
Cruise Control
ODP JIRA | Apache JIRA | Description |
|---|---|---|
ODP-2777 | Refactored shebangs for Python scripts to ambari-python-wrap. | |
ODP-1649 | Updated the ZooKeeper and Netty versions in gradle.properties. | |
ODP-1798 | Removed the Cruise Control script (#7). | |
ODP-1230 | Applied the source code changes for Cruise Control (cutoff from tag 2.5.84) (#1). |
Cruise Control 3
ODP JIRA | Apache JIRA | Description |
|---|---|---|
ODP-2718 ODP-2777 | Refactored shebangs for Python scripts to ambari-python-wrap (#9). |
Ambari-Mpack
Hue (4.11.0)
ODP JIRA | Apache JIRA | Description |
|---|---|---|
ODP-3711 | Handled secret_key with random string generation (#182). | |
ODP-2776 | Refactored shebangs for Python scripts to ambari-python-wrap. |
Impala (4.4.0)
ODP JIRA | Apache JIRA | Description |
|---|---|---|
ODP-4087 | Integrated Ranger plugin support via Impala component setup (#195). |
Jupyterhub (5.2.1)
ODP JIRA | Apache JIRA | Description |
|---|---|---|
ODP-3853 | Added compatibility with 3.3.6 |
Kafka (3.7.1)
ODP JIRA | Apache JIRA | Description |
|---|---|---|
ODP-3984 | Handled xasecure.audit.destination.hdfs.dir for Kafka 3. | |
ODP-3813 | Updated the Kafka 3 default configs (#184). | |
ODP-4117 | Supports multiple security protocols with Kafka 3 config. |
NiFi/NiFi Registry (1.27.0)
ODP JIRA | Apache JIRA | Description |
|---|---|---|
ODP-2776 | Refactored shebangs for Python scripts to ambari-python-wrap. |
Ozone (1.4.1)
ODP JIRA | Apache JIRA | Description |
|---|---|---|
ODP-4197 | Fixed the Ozone Ranger audit filespool directory to be user-defined log directory. | |
ODP-4004 | Added HDFS core-site and hdfs-site for Ozone Ranger Audits to HDFS. | |
ODP-3831 | Upgraded the Ozone version to 1.4.1 in mpack. | |
ODP-2776: | Refactored shebangs for Python scripts to ambari-python-wrap. |
Spark 3 (3.5.1)
ODP JIRA | Apache JIRA | Description |
|---|---|---|
ODP-3967: | Added the Spark3 SSL parameters in spark3-defaults.xml (#187). |