Acceldata
 ODP
Search documentation… ⌘K

Tez

Update the Tez Java 17 flags as shown below.

Advanced tez-env -> tez-env

File location: Log into the Ambari UI → Tez → Configs → Advanced tez-site -> tez-env

# Tez specific configuration
export TEZ_CONF_DIR={{config_dir}}
{% if java_version == 8 %}
# Java 8 JVM options
export tez.am.launch.cmd-opts="-XX:+PrintGCDetails -verbose:gc -XX:+PrintGCTimeStamps -XX:+UseNUMA -XX:+UseG1GC -XX:+ResizeTLAB{{heap_dump_opts}}"
export tez.task.launch.cmd-opts="-XX:+PrintGCDetails -verbose:gc -XX:+PrintGCTimeStamps -XX:+UseNUMA -XX:+UseG1GC -XX:+ResizeTLAB{{heap_dump_opts}}"
{% elif java_version == 11 %}
export tez.am.launch.cmd-opts="-Xlog:gc*:file={{gc_log_path}}/tez_am_gc.log:time,uptime,level,tags:filecount=10,filesize=10M -XX:+UseNUMA -XX:+UseG1GC -XX:+ResizeTLAB{{heap_dump_opts}}"
export tez.task.launch.cmd-opts="-Xlog:gc*:file={{gc_log_path}}/tez_task_gc.log:time,uptime,level,tags:filecount=10,filesize=10M -XX:+UseNUMA -XX:+UseG1GC -XX:+ResizeTLAB{{heap_dump_opts}}"
{% else %}
# For Java 11+
export tez.am.launch.cmd-opts="-Xlog:gc*:file={{gc_log_path}}/tez_am_gc.log:time,uptime,level,tags:filecount=10,filesize=10M -XX:+UseNUMA -XX:+UseG1GC -XX:+ResizeTLAB{{heap_dump_opts}} {{jvm_flags}}"
export tez.task.launch.cmd-opts="-Xlog:gc*:file={{gc_log_path}}/tez_task_gc.log:time,uptime,level,tags:filecount=10,filesize=10M -XX:+UseNUMA -XX:+UseG1GC -XX:+ResizeTLAB{{heap_dump_opts}} {{jvm_flags}}"
{% endif %}
# Set HADOOP_HOME to point to a specific hadoop install directory
export HADOOP_HOME=${HADOOP_HOME:-{{hadoop_home}}}
# The java implementation to use.
export JAVA_HOME={{java64_home}}

Advanced tez-env -> tez.am.launch.cluster-default.cmd-opts & tez.task.launch.cluster-default.cmd-opts

File location: Log into the Ambari UI → Tez → Configs → Advanced tez-site -> tez.am.launch.cluster-default.cmd-opts & tez.task.launch.cluster-default.cmd-opts

-server -Djava.net.preferIPv4Stack=true -Dodp.version=${odp.version}{% if java_version|int > 11 %} {{jvm_flags}}{% endif %}

Custom tez-site -> jvm_flags

File location: Log into the Ambari UI → Tez → Configs → Custom tez-site -> jvm_flags

--add-opens=java.base/java.lang=ALL-UNNAMED --add-opens=java.base/java.net=ALL-UNNAMED --add-opens=java.base/java.nio=ALL-UNNAMED --add-opens=java.base/java.util.concurrent.atomic=ALL-UNNAMED --add-opens=java.base/java.util=ALL-UNNAMED