Upgrade to Version 3.8.3
Prerequisite
Upgrade the Docker version to 20.10.x or above.
Steps to upgrade the Docker version:
- Uninstall the current Docker:
yum remove -y docker-ce docker-ce-cli containerd.io
- Install the latest version of Docker:
yum install -y docker-ce docker-ce-cli containerd.io
- To install a specific version of Docker:
yum install -y docker-ce-24.0.5 docker-ce-cli-24.0.5 containerd.io
- Replace 24.0.5 with the appropriate version string
- To list specific versions of docker
yum list docker-ce --showduplicates | sort -r
- Start Docker:
systemctl start docker
Migration Steps from Version 3.8.0 to 3.8.3
Follow these steps to upgrade Pulse.
- Update Configuration:
- Update ImageTag in the $AcceloHome/config/accelo.yml file to 3.8.3.
- Push Updated Configuration to Database:
- Run the following command:
accelo admin database push-config -a
- Take a backup of the accelo file and download the latest version for accelo.linux CLI.
- Move and make the latest accelo CLI file as an executable. Also, check the updated Pulse information for the following.
mv accelo.linux accelo
chmod +x ./accelo
- For the Online installations, run the following command and press 'Y' at the prompt to get the most recent binaries.
accelo login docker
accelo pull all
- For the Offline Installations, download all the latest image packs and run the following command to upload the latest images.
docker load -i
- Run the command below to update and add new keys in vars.yml.
accelo reconfig cluster
- [Optional: If AD-LDAP is deployed] Run the following command to generate an encrypted password for the LDAP server connection.
accelo admin encrypt
- Enter the plain-text password to generate the encrypted password.
- Update the bindPW field in /data01/acceldata/config/ldap/ldap.conf with the encrypted value and add the encryptedPassword = true flag in the same configuration file.
- Run the below command to push acceldata.conf and other updated files to MongoDB.
accelo admin database push-config
- Restart all containers, including database(s,) with the following command.
accelo restart all -d
- Uninstall the Hydra Agent.
accelo uninstall remote
- Install the Hydra Agent.
accelo deploy hydra
- (Optional for Spark Standalone Deployment) If you are upgrading from Pulse 3.8.0 and the Spark master URL is blocked, add the list of Spark worker URLs to the $AcceloHome/config/acceldata_<clustername>.conf file in the following format:
spark.worker.urls = "<http/s>://<FQDN>:<port>,<http/s>://<FQDN>:<port>"
For example:
spark.worker.urls = "http://host1:8082,http://host2:8082"
Add the above field in group.configuration in the $AcceloHome/config/acceldata_<clustername>.conf file. The group.configuration section should be in the following format:
group {
...<irrelevant content>
configuration = {
...<irrelevant content>
spark.standalone.enable = true
spark.standalone.urls = "http://host1:8080,http://host2:8081,"
spark.worker.urls = "http://host1:8081,http://host2:8082,"
spark.history.server.url = "http://host1:18080,http://host2:18080"
...<irrelevant content>
}
}
Info
If the Spark master URL is accessible and you want to use it to retrieve the list of worker URLs, add SYNC_SPARK_MASTER="true" to the /etc/profile.d/ad.sh file and run source /etc/profile.d/ad.sh to apply the changes.
- Reconfigure the cluster to get the updated configurations for Agents.
accelo reconfig cluster -a
Migration Steps from Version 3.7.x to 3.8.3
Follow these steps to upgrade Pulse.
- Take a backup of the accelo file and download the latest version for accelo.linux CLI.
- Move and make the latestaccelo CLI file as an executable. Also, check the updated Pulse information for the following:
mv accelo.linux accelo
chmod +x ./accelo
- For the Offline Installations, download all the latest image packs and run the following command to upload the latest images
docker load -i
- Push the updated configuration to the database.
- Run the following command:
accelo admin database push-config -a
- Follow the manual steps in the document below to update MongoDB to the latest version, 8.0.8.
Note
For information about migrating MongoDB manually, see Upgrade MongoDB Manually.
- Update Configuration:
- Update ImageTag in the $AcceloHome/config/accelo.yml file to 3.8.3.
- For the Online installations, run the following command and press 'Y' at the prompt to get the most recent binaries.
accelo login docker
accelo pull all
- Run the command below to update and add new keys in vars.yml
accelo reconfig cluster
Info
If your ODP cluster has Kafka 3 installed, run accelo config cluster before performing this step.
- [Optional: If AD-LDAP is deployed] Run the following command to generate an encrypted password for the LDAP server connection.
accelo admin encrypt
- Enter the plain-text password to generate the encrypted password.
- Update the bindPW field in /data01/acceldata/config/ldap/ldap.conf with the encrypted value and add the encryptedPassword = true flag in the same configuration file.
- Run the below command to push acceldata.conf and other updated files to MongoDB.
accelo admin database push-config
Info
Once the above command is executed, move the license from the local work directory to a backup directory.
Important
Ensure that you do not change the value of v from 3.8.0 to anything else unless explicitly advised by Acceldata. The following command needs to be run on all the Pulse nodes, including standalone nodes, i.e., nodes where PULSE_SA_NODE is true. The examples of such nodes include, but aren’t limited to, Logsearch, FS Analytics V2, and Dashplot.
- Run the migration command. For example:
- -v 3.8.0 : The version you are migrating to. Keep the version as -v 3.8.0, even when you are migrating to any update release version in 3.8.x.
- -i 3.7.0 : The version you are migrating from.
- To migrate from version 3.7.0 to 3.8.3, the migration command looks as shown below.
Info
Ensure that you run the following command from $AcceloHome.
For a single cluster:
accelo migrate -v 3.8.0 -i 3.7.0 -b
For multi-cluster:
accelo migrate -v 3.8.0 -i 3.7.0 -a -b
- Run the same command again if any issue occurs during migration on any step.
- Restart all the containers so that they use the updated images
accelo restart all -d
- Uninstall the Hydra Agent.
accelo uninstall remote
- Install the Hydra Agent.
accelo deploy hydra
- (Optional for Spark Standalone Deployment) If you are upgrading from Pulse 3.8.0 and the Spark master URL is blocked, add the list of Spark worker URLs to the $AcceloHome/config/acceldata_<clustername>.conf file in the following format.
spark.worker.urls = "<http/s>://<FQDN>:<port>,<http/s>://<FQDN>:<port>"
For example:
spark.worker.urls = "http://host1:8082,http://host2:8082"
Add the above field in group.configuration in the $AcceloHome/config/acceldata_<clustername>.conf file. The group.configuration section should be in the following format:
group {
...<irrelevant content>
configuration = {
...<irrelevant content>
spark.standalone.enable = true
spark.standalone.urls = "http://host1:8080,http://host2:8081,"
spark.worker.urls = "http://host1:8081,http://host2:8082,"
spark.history.server.url = "http://host1:18080,http://host2:18080"
...<irrelevant content>
}
}
Info
If the Spark master URL is accessible and you want to use it to retrieve the list of worker URLs, add SYNC_SPARK_MASTER="true" to the /etc/profile.d/ad.sh file and run source /etc/profile.d/ad.sh to apply the changes.
- Reconfigure the cluster to get the updated configuration for Agents.
accelo reconfig cluster -a
Info
If your ODP cluster has Kafka 3 installed, you need to run accelo config cluster before performing this step.
- To push the updated configuration to the database, execute the following command.
accelo admin database push-config -a
- To configure when gauntlet snap must run the MongoDB cleanup and compaction, run the following command.
accelo config retention
- Finally, execute the following command to create indices for database collections.
If readOnlyRootFSEnabled is set to true in $AcceloHome/config/accelo.yml, then follow the steps listed below instead of running the command directly.
1. Open $AcceloHome/config/accelo.yml and set the value of readOnlyRootFSEnabled to false.
2. Run accelo admin database push-config
3. Run accelo restart all -d.
4. Run accelo admin database index-db.
5. Open $AcceloHome/config/accelo.yml and set the value of readOnlyRootFSEnabled to true.
6. Run accelo admin database push-config.
7. Run accelo restart all -d.
accelo admin database index-db
- If the older playbooks are already present in the node where Ad-Director is deployed, delete them, and download the latest playbooks tar from the License UI.
- Delete the older playbooks using the command: rm -rf $AcceloHome/work/<cluster_name>/director/playbook/*.Replace <cluster_name> with the name of the cluster where the playbooks are present.
- Download the playbooks tar from the License UI. For details, see Deploy Playbooks.
Migration Steps from Version 3.6.x to 3.8.3
Follow these steps to upgrade Pulse.
- Take a backup of the accelo file and download the latest version for accelo.linux CLI.
- Move and make the latestaccelo CLI file as an executable. Also, check the updated Pulse information for the following:
mv accelo.linux accelo
chmod +x ./accelo
- For the Offline Installations, download all the latest image packs and run the following command to upload the latest images
docker load -i
- Run the following command to push the updated configuration to the database**.**
accelo admin database push-config -a
- Follow the manual steps in the document below to update MongoDB to the latest version, 8.0.8.
Note
For information about migrating MongoDB manually, see Upgrade MongoDB Manually.
- Update Configuration:
- Update ImageTag in the $AcceloHome/config/accelo.yml file to 3.8.3.
- For the Online installations, run the following command and press 'Y' at the prompt to get the most recent binaries.
accelo login docker
accelo pull all
docker load -i
- Run the command below to update and add new keys in vars.yml
accelo reconfig cluster
Info
If your ODP cluster has Kafka 3 installed, run accelo config cluster before performing this step.
- [Optional: If AD-LDAP is deployed] Run the following command to generate an encrypted password for the LDAP server connection.
accelo admin encrypt
- Enter the plain-text password to generate the encrypted password.
- Update the bindPW field in /data01/acceldata/config/ldap/ldap.conf with the encrypted value and add the encryptedPassword = true flag in the same configuration file.
- Run the below command to push acceldata.conf and other updated files to MongoDB.
accelo admin database push-config
Info
Once the above command is executed, move the license from local work directory to a backup directory.
Important
Ensure that you do not change the value of v from 3.8.0 to anything else unless explicitly advised by Acceldata. The following command needs to be run on all the Pulse nodes, including standalone nodes i.e., nodes where PULSE_SA_NODE is true. The examples of such nodes include, but aren’t limited to, LogSearch, FS Analytics V2, and Dashplot.
- Run the migration command. For example:
- -v 3.8.0 : The version you are migrating to. Keep the version as -v 3.8.0, even when you are migrating to any update release version in 3.8.x.
- -i 3.6.6 : The version you are migrating from.
- To migrate from version 3.6.6 to 3.8.3, the migration command looks as shown below.
Info
Ensure that you run the following command from $AcceloHome.
For a single cluster:
accelo migrate -v 3.8.0 -i 3.6.6 -b
For multi-cluster:
accelo migrate -v 3.8.0 -i 3.6.6 -a -b
- Run the same command again if any issue occurs during migration on any step.
- Restart all the containers so that they use the updated images
accelo restart all -d
- Uninstall the Hydra Agent.
accelo uninstall remote
- Install the Hydra Agent.
accelo deploy hydra
- (Optional for Spark Standalone Deployment) If you are upgrading from Pulse 3.8.0 and the Spark master URL is blocked, add the list of Spark worker URLs to the $AcceloHome/config/acceldata_<clustername>.conf file in the following format.
Bash+ xspark.worker.urls = "<http/s>://<FQDN>:<port>,<http/s>://<FQDN>:<port>"
For example:
spark.worker.urls = "http://host1:8082,http://host2:8082"
Add the above field in group.configuration in the $AcceloHome/config/acceldata_<clustername>.conf file. The group.configuration section should be in the following format:
group {
...<irrelevant content>
configuration = {
...<irrelevant content>
spark.standalone.enable = true
spark.standalone.urls = "http://host1:8080,http://host2:8081,"
spark.worker.urls = "http://host1:8081,http://host2:8082,"
spark.history.server.url = "http://host1:18080,http://host2:18080"
...<irrelevant content>
}
}
Info
If the Spark master URL is accessible and you want to use it to retrieve the list of worker URLs, add SYNC_SPARK_MASTER="true" to the /etc/profile.d/ad.sh file and run source /etc/profile.d/ad.sh to apply the changes.
- Reconfigure the cluster to get the updated configuration for Agents.
accelo reconfig cluster -a
Info
If your ODP cluster has Kafka 3 installed, you need to run accelo config cluster before performing this step.
- To push the updated configuration to the database, execute the following command.
accelo admin database push-config -a
- To push the updated configuration to the database, execute the following command.
accelo config retention
- Finally, execute the following command to create indices for database collections.
If readOnlyRootFSEnabled is set to true in $AcceloHome/config/accelo.yml, then follow the steps listed below instead of running the command directly.
1. Open $AcceloHome/config/accelo.yml and set the value of readOnlyRootFSEnabled to false.
2. Run accelo admin database push-config
3. Run accelo restart all -d.
4. Run accelo admin database index-db.
5. Open $AcceloHome/config/accelo.yml and set the value of readOnlyRootFSEnabled to true.
6. Run accelo admin database push-config.
7. Run accelo restart all -d.
accelo admin database index-db
- If the older playbooks are already present in the node where ad-director is deployed, delete them, and download the latest playbooks tar from the License UI.
- Delete the older playbooks using the command: rm -rf $AcceloHome/work/<cluster_name>/director/playbook/*.Replace <cluster_name> with the name of the cluster where the playbooks are present.
- Download the playbooks tar from the License UI. For details, see Deploy Playbooks.
