Acceldata
Pulse

Upgrade to Version 3.8.4

Prerequisite

Upgrade the Docker version to 20.10.x or above.

Steps to upgrade the Docker version:

  1. Uninstall the current Docker:
yum remove -y docker-ce docker-ce-cli containerd.io
  1. Install the latest version of Docker:
yum install -y docker-ce docker-ce-cli containerd.io
  • To install a specific version of Docker:
yum install -y docker-ce-24.0.5 docker-ce-cli-24.0.5 containerd.io
  • Replace 24.0.5 with the appropriate version string
  • To list specific versions of docker
yum list docker-ce --showduplicates | sort -r
  1. Start Docker:
systemctl start docker

Migration Steps from Version 3.8.0 to 3.8.4

Follow these steps to upgrade Pulse.

  1. Update Configuration:
    • Update ImageTag in the $AcceloHome/config/accelo.yml file to 3.8.4.
  2. Push Updated Configuration to Database:
    • Run the following command:
accelo admin database push-config -a
  1. Take a backup of the accelo file and download the latest version for accelo.linux CLI.
  2. Move and make the latest accelo CLI file as an executable. Also, check the updated Pulse information for the following.
mv accelo.linux accelo
chmod +x ./accelo
  1. For the Online installations, run the following command and press 'Y' at the prompt to get the most recent binaries.
accelo login docker
accelo pull all
  1. For the Offline Installations, download all the latest image packs and run the following command to upload the latest images.
docker load -i
  1. Run the command below to update and add new keys in vars.yml.
accelo reconfig cluster
  1. [Optional: If AD-LDAP is deployed] Run the following command to generate an encrypted password for the LDAP server connection.
accelo admin encrypt
  • Enter the plain-text password to generate the encrypted password.
  • Update the bindPW field in /data01/acceldata/config/ldap/ldap.conf with the encrypted value and add the encryptedPassword = true flag in the same configuration file.
  1. Run the below command to push acceldata.conf and other updated files to MongoDB.
accelo admin database push-config
  1. Restart all containers, including database(s,) with the following command.
accelo restart all -d
  1. Uninstall the Hydra Agent.
accelo uninstall remote
  1. Install the Hydra Agent.
accelo deploy hydra
  1. (Optional for Spark Standalone Deployment) If you are upgrading from Pulse 3.8.0 and the Spark master URL is blocked, add the list of Spark worker URLs to the $AcceloHome/config/acceldata_<clustername>.conf file in the following format:
spark.worker.urls = "<http/s>://<FQDN>:<port>,<http/s>://<FQDN>:<port>"
For example:
spark.worker.urls = "http://host1:8082,http://host2:8082"
Add the above field in group.configuration in the $AcceloHome/config/acceldata_<clustername>.conf file. The group.configuration section should be in the following format:
group {
...<irrelevant content>
configuration = {
...<irrelevant content>
spark.standalone.enable = true
spark.standalone.urls = "http://host1:8080,http://host2:8081,"
spark.worker.urls = "http://host1:8081,http://host2:8082,"
spark.history.server.url = "http://host1:18080,http://host2:18080"
...<irrelevant content>
}
}

Info

If the Spark master URL is accessible and you want to use it to retrieve the list of worker URLs, add SYNC_SPARK_MASTER="true" to the /etc/profile.d/ad.sh file and run source /etc/profile.d/ad.sh to apply the changes.

  1. Reconfigure the cluster to get the updated configurations for Agents.
accelo reconfig cluster -a

Migration Steps from Version 3.7.x to 3.8.4

Follow these steps to upgrade Pulse.

  1. Take a backup of the accelo file and download the latest version for accelo.linux CLI.
  2. Move and make the latestaccelo CLI file as an executable. Also, check the updated Pulse information for the following:
mv accelo.linux accelo
chmod +x ./accelo
  1. For the Offline Installations, download all the latest image packs and run the following command to upload the latest images.
docker load -i
  1. Push the updated configuration to the database.
    • Run the following command:
accelo admin database push-config -a
  1. Follow the manual steps in the document below to update MongoDB to the latest version, 8.0.8.

Note

For information about migrating MongoDB manually, see Upgrade MongoDB Manually.

  1. Update Configuration:
    • Update ImageTag in the $AcceloHome/config/accelo.yml file to 3.8.4.
  2. For the Online installations, run the following command and press 'Y' at the prompt to get the most recent binaries.
accelo login docker
accelo pull all
  1. Run the command below to update and add new keys in vars.yml
accelo reconfig cluster

Info

If your ODP cluster has Kafka 3 installed, run accelo config cluster before performing this step.

  1. [Optional: If AD-LDAP is deployed] Run the following command to generate an encrypted password for the LDAP server connection.
accelo admin encrypt
  • Enter the plain-text password to generate the encrypted password.
  • Update the bindPW field in /data01/acceldata/config/ldap/ldap.conf with the encrypted value and add the encryptedPassword = true flag in the same configuration file.
  1. Run the below command to push acceldata.conf and other updated files to MongoDB.
accelo admin database push-config

Info

Once the above command is executed, move the license from the local work directory to a backup directory.

Important

Ensure that you do not change the value of v from 3.8.0 to anything else unless explicitly advised by Acceldata. The following command needs to be run on all the Pulse nodes, including standalone nodes, i.e., nodes where PULSE_SA_NODE is true. The examples of such nodes include, but aren’t limited to, Logsearch, FS Analytics V2, and Dashplot.

  1. Run the migration command. For example:
    1. -v 3.8.0 : The version you are migrating to. Keep the version as -v 3.8.0, even when you are migrating to any update release version in 3.8.x.
    2. -i 3.7.0 : The version you are migrating from.
    3. To migrate from version 3.7.0 to 3.8.4, the migration command looks as shown below.

Info

Ensure that you run the following command from $AcceloHome.

For a single cluster:

accelo migrate -v 3.8.0 -i 3.7.0 -b

For multi-cluster:

accelo migrate -v 3.8.0 -i 3.7.0 -a -b
  1. Run the same command again if any issue occurs during migration on any step.
  2. Restart all the containers so that they use the updated images
accelo restart all -d
  1. Uninstall the Hydra Agent.
accelo uninstall remote
  1. Install the Hydra Agent.
accelo deploy hydra
  1. (Optional for Spark Standalone Deployment) If you are upgrading from Pulse 3.8.0 and the Spark master URL is blocked, add the list of Spark worker URLs to the $AcceloHome/config/acceldata_<clustername>.conf file in the following format.
spark.worker.urls = "<http/s>://<FQDN>:<port>,<http/s>://<FQDN>:<port>"
For example:
spark.worker.urls = "http://host1:8082,http://host2:8082"
Add the above field in group.configuration in the $AcceloHome/config/acceldata_<clustername>.conf file. The group.configuration section should be in the following format:
group {
...<irrelevant content>
configuration = {
...<irrelevant content>
spark.standalone.enable = true
spark.standalone.urls = "http://host1:8080,http://host2:8081,"
spark.worker.urls = "http://host1:8081,http://host2:8082,"
spark.history.server.url = "http://host1:18080,http://host2:18080"
...<irrelevant content>
}
}

Info

If the Spark master URL is accessible and you want to use it to retrieve the list of worker URLs, add SYNC_SPARK_MASTER="true" to the /etc/profile.d/ad.sh file and run source /etc/profile.d/ad.sh to apply the changes.

  1. Reconfigure the cluster to get the updated configuration for Agents.
accelo reconfig cluster -a
  1. To push the updated configuration to the database, execute the following command.
accelo admin database push-config -a
  1. To configure when gauntlet snap must run the MongoDB cleanup and compaction, run the following command.
accelo config retention
  1. Finally, execute the following command to create indices for database collections.
If readOnlyRootFSEnabled is set to true in $AcceloHome/config/accelo.yml, then follow the steps listed below instead of running the command directly.
1. Open $AcceloHome/config/accelo.yml and set the value of readOnlyRootFSEnabled to false.
2. Run accelo admin database push-config
3. Run accelo restart all -d.
4. Run accelo admin database index-db.
5. Open $AcceloHome/config/accelo.yml and set the value of readOnlyRootFSEnabled to true.
6. Run accelo admin database push-config.
7. Run accelo restart all -d.
accelo admin database index-db
  1. If the older playbooks are already present in the node where Ad-Director is deployed, delete them, and download the latest playbooks tar from the License UI.
    1. Delete the older playbooks using the command: rm -rf $AcceloHome/work/<cluster_name>/director/playbook/*.Replace <cluster_name> with the name of the cluster where the playbooks are present.
    2. Download the playbooks tar from the License UI. For details, see Deploy Playbooks.

Migration Steps from Version 3.6.x to 3.8.4

Follow these steps to upgrade Pulse.

  1. Take a backup of the accelo file and download the latest version for accelo.linux CLI.
  2. Move and make the latestaccelo CLI file as an executable. Also, check the updated Pulse information for the following:
mv accelo.linux accelo
chmod +x ./accelo
  1. For the Offline Installations, download all the latest image packs and run the following command to upload the latest images.
docker load -i
  1. Run the following command to push the updated configuration to the database**.**
accelo admin database push-config -a
  1. Follow the manual steps in the document below to update MongoDB to the latest version, 8.0.8.

Note

For information about migrating MongoDB manually, see Upgrade MongoDB Manually.

  1. Update Configuration:
    • Update ImageTag in the $AcceloHome/config/accelo.yml file to 3.8.4.
  2. For the Online installations, run the following command and press 'Y' at the prompt to get the most recent binaries.
accelo login docker
accelo pull all
  1. Run the command below to update and add new keys in vars.yml
accelo reconfig cluster

Info

If your ODP cluster has Kafka 3 installed, you need to run accelo config cluster before performing this step.

  1. [Optional: If AD-LDAP is deployed] Run the following command to generate an encrypted password for the LDAP server connection.
accelo admin encrypt
  • Enter the plain-text password to generate the encrypted password.
  • Update the bindPW field in /data01/acceldata/config/ldap/ldap.conf with the encrypted value and add the encryptedPassword = true flag in the same configuration file.
  1. Run the below command to push acceldata.conf and other updated files to MongoDB.
accelo admin database push-config

Info

Once the above command is executed, move the license from local work directory to a backup directory.

Important

Ensure that you do not change the value of v from 3.8.0 to anything else unless explicitly advised by Acceldata. The following command needs to be run on all the Pulse nodes, including standalone nodes i.e., nodes where PULSE_SA_NODE is true. The examples of such nodes include, but aren’t limited to, LogSearch, FS Analytics V2, and Dashplot.

  1. Run the migration command. For example:
    1. -v 3.8.0 : The version you are migrating to. Keep the version as -v 3.8.0, even when you are migrating to any update release version in 3.8.x.
    2. -i 3.6.6 : The version you are migrating from.
    3. To migrate from version 3.6.6 to 3.8.4, the migration command looks as shown below.

Info

Ensure that you run the following command from $AcceloHome.

For a single cluster:

accelo migrate -v 3.8.0 -i 3.6.6 -b

For multi-cluster:

accelo migrate -v 3.8.0 -i 3.6.6 -a -b
  1. Run the same command again if any issue occurs during migration on any step.
  2. Restart all the containers so that they use the updated images
accelo restart all -d
  1. Uninstall the Hydra Agent.
accelo uninstall remote
  1. Install the Hydra Agent.
accelo deploy hydra
  1. (Optional for Spark Standalone Deployment) If you are upgrading from Pulse 3.8.0 and the Spark master URL is blocked, add the list of Spark worker URLs to the $AcceloHome/config/acceldata_<clustername>.conf file in the following format.
Bash+ xspark.worker.urls = "<http/s>://<FQDN>:<port>,<http/s>://<FQDN>:<port>"
For example:
spark.worker.urls = "http://host1:8082,http://host2:8082"
Add the above field in group.configuration in the $AcceloHome/config/acceldata_<clustername>.conf file. The group.configuration section should be in the following format:
group {
...<irrelevant content>
configuration = {
...<irrelevant content>
spark.standalone.enable = true
spark.standalone.urls = "http://host1:8080,http://host2:8081,"
spark.worker.urls = "http://host1:8081,http://host2:8082,"
spark.history.server.url = "http://host1:18080,http://host2:18080"
...<irrelevant content>
}
}

Info

If the Spark master URL is accessible and you want to use it to retrieve the list of worker URLs, add SYNC_SPARK_MASTER="true" to the /etc/profile.d/ad.sh file and run source /etc/profile.d/ad.sh to apply the changes.

  1. Reconfigure the cluster to get the updated configuration for Agents.
accelo reconfig cluster -a
  1. To push the updated configuration to the database, execute the following command.
accelo admin database push-config -a
  1. To push the updated configuration to the database, execute the following command.
accelo config retention
  1. Finally, execute the following command to create indices for database collections.
If readOnlyRootFSEnabled is set to true in $AcceloHome/config/accelo.yml, then follow the steps listed below instead of running the command directly.
1. Open $AcceloHome/config/accelo.yml and set the value of readOnlyRootFSEnabled to false.
2. Run accelo admin database push-config
3. Run accelo restart all -d.
4. Run accelo admin database index-db.
5. Open $AcceloHome/config/accelo.yml and set the value of readOnlyRootFSEnabled to true.
6. Run accelo admin database push-config.
7. Run accelo restart all -d.
accelo admin database index-db
  1. If the older playbooks are already present in the node where ad-director is deployed, delete them, and download the latest playbooks tar from the License UI.
    1. Delete the older playbooks using the command: rm -rf $AcceloHome/work/<cluster_name>/director/playbook/*.Replace <cluster_name> with the name of the cluster where the playbooks are present.
    2. Download the playbooks tar from the License UI. For details, see Deploy Playbooks.