ODP

Search documentation… ⌘K

Acceldata Open Source Data Platform Support Matrix

Version

↑↓ navigate ↵ open esc close

Release Notes

Acceldata ODP 3.3.6.0-1 Release Notes

Supported Apache Component Versions Summary of New Features Enhancements Bug Fixes Apache Release Notes Known Limitations

End of Support Notice

Unsupported Components Notice

What is ODP

Introduction to Open Source Data Platform (ODP)

Installation

Getting Started

Apache Ambari Installation and Cluster Setup

Pre-installation Preparation Software and Memory Requirements Maximum Open Files Configuration Data Collection and Environment Preparation Setting up the Environment 1 Configuring Password-less SSH 2 Enable NTP on Cluster and Browser Host 3 Edit the Host File and Set the Hostname 4 Edit the Network Configuration File 5 Configuring iptables 6 Disable SELinux, PackageKit, and check the umask Value

Using an Existing Database or Installing a Default One

Using a Local Repository

Deploying ODP In Production Data Centers With Firewalls

Accessing Acceldata Repositories

Ambari Repositories ODP Stack Repositories

Installing Ambari

Installing the Ambari Server Set up the Ambari Server Installing the Ambari Agents Manually

Cluster Deployment and Configuration

Start the Ambari Server Log in to Apache Ambari Launch the Cluster Install Wizard Cluster Naming and Version Selection Configuring Ambari with RedHat Satellite or Spacewalk Installation Options Host Confirmation Service Selection Master, slave, and client node Assignment Service Customization Review Install, Start, or Test Finalization and Completion Guide for Management Packs Adding a New Node to the ODP Cluster

Component User guide and Installation Instructions

Installing Oozie

Airflow

Single Node Installation MultiNode Installation Advanced Configurations Installing Custom Packages in Apache Airflow Airflow Log Clean-up and DAG Management Apache Airflow Logging Guide Running Apache Airflow Commands via CLI

Installing Knox

Configure Okta SSO for Apache Knox

NiFi Setup, Security, and Registry Configuration

Druid

Enabling Kerberos in Druid Enabling LDAP on Druid Enabling SSL on Druid

Installing Impala

Installing Kafka 3

Kafka MirrorMaker3 Kafka Connect3 Kafka Cruise Control3 Zookeeper to Kraft Migration Deployment of Standalone Kafka

Ozone

Ozone Configurations Ozone Installation Ozone Command Line Interface Working with Ozone File System Using Ozone S3 Gateway

Kafka

Kafka Connect Kafka MirrorMaker2 Cruise Control

Schema Registry Installing Flink and Usage

Modern Open Table Format integration with ODP

Hudi Iceberg

Delta Lake

Deploy the Delta-Hive Connector

Upgrade Instructions

Master Upgrade Guide to ODP-3.3.6.0-1

Pre-requisites for Upgrade Pre-requisites for Configuration Backup ODP Stack Upgrade ODP Upgrade Halt State Ambari Server Upgrade Ambari Agents Upgrade Infra Solr Upgrade Start the ODP Stack Services Resume the ODP Stack Upgrade Finalize the Upgrade Troubleshooting

Rolling Upgrade Sanity Check Upgrade Standalone Kafka

ODP Reference Guide

Ambari Admin Guide

Using the Administrator Role in Ambari Web Setting up Ambari to use an Internet proxy server Managing Cluster Roles Managing Versions Managing Local Users Ambari High Availability Setup

Administration

Administering HDFS Managing and Monitoring a Cluster Managing High Availability Configuring Dynamic Management for HDFS NameNode and DataNode Enhance Replication and Decommissioning process Setting Hadoop Service Log Levels at Runtime

Storage

Configuring ADLS Gen2 with ODP Configuring ODP with GCS Configuring ODP with AWS S3 using S3A

Configuring Ports Controlling ODP Services Manually HDFS Router Federation

Set up the ODBC and JDBC Connections

Set up the Hive and Impala ODBC Connection Set up the Hive and Impala JDBC Connection

Securing Hive with KNOX Set up HAProxy Load Balancer for HiveServer2

Service Tuning

HDFS: Separate RPC Queues and Enable Lifeline Protocol

Erasure Coding for Data Durability

Understanding Erasure Coding Policies Comparing Replication and Erasure Coding Best Practices for Rack and Node Setup for EC Prerequisites for Enabling Erasure Coding Limitations of Erasure Coding Using Erasure Coding for Existing Data Using Erasure Coding for New Data Advanced Erasure Coding Configuration Erasure Coding CLI Commands Erasure Coding Examples

ODP Troubleshooting Guide

Troubleshooting ODP

Ambari Troubleshooting HDFS NameNode Heap Estimation Troubleshooting premature swapping Troubleshooting the Kerberos Configuration Issues in Ambari Troubleshooting JVM: JStack, Heap Dumps and JFR

Troubleshooting ODP SSL, Keystore, and Truststore

What is SSL? Key Concepts: Keystore and Truststore Types of Certificates How to Check the Certificate Type? JKS Creation and Management Extracting Certificates and Keys Checking Subject Alternative Name (SAN) and Extensions Creating a Keystore in PKCS12 Format TLS Verification Checking SSL Ciphers Additional SSL Troubleshooting Commands Troubleshooting Ambari SSL and LDAPS Setup Services SSL and Truststore Configuration Configure the Ranger Plugin Truststore SSL SSL Troubleshooting for Hadoop Clusters SSL/TLS Security Best Practices for Hadoop Clusters

Security

Authentication

Replacing Knox Self-Signed Certificate with CA Certificate Enabling SSL for Services Using Bash Script Enabling Kerberos in an ODP Cluster Bash Scripts for Automated Tasks Securing NiFi with Existing CA Certificates Configuring SSL for the Ambari Server Accessing a Kerberized UI Firefox Configure Ranger Admin and Usersync with SSSD or Centrify Enabling Cross-Cluster and Cross-Realm Kerberos Authentication for Hadoop Data Migration

Authorization

Providing Authorization with Apache Ranger Configuring Ambari Authentication for LDAP/AD Securing HiveServer2 with LDAP Authentication Configuring Ranger Admin High Availability (HA)

Encryption

Enabling the ODP Ranger KMS High Availability (HA) and Troubleshooting Disabling High Availability (HA) in ODP Ranger KMS Copying the Encrypted Data Between Two ODP Clusters Using Ranger KMS

Uninstall ODP

Complete Uninstallation of ODP

ODP › Upgrade Instructions › Resume the ODP Stack Upgrade

Resume the ODP Stack Upgrade

Resume Upgrade

Resume the ODP Stack Upgrade from its Paused state.

Retry the upgrade

Preserved image

Was this page helpful?

0 helpful · 0 not helpful

On this page