Yesterday I did a plan upgrade of our 16-node (4 block) Nutanix 3050 cluster. The version which were running in last couple of months was 4.5.3.2 and the plan was to upgrade to 4.6.3. Using the GUI and the 1-click upgrade we took the following steps:
- I’ve Downloaded the upgrade binaries and metadata file from the Nutanix portal:
- Went to the software upgrade section and uploaded the binaries there:
- Wait for the upload to complete the I started the upgrade process:
- The beginning was fine, but after few minutes I noticed that one of the CVM upgrade is failing at 93% and the process was restarting:
- After this was repeated several times I realized that there is something wrong. Doing some troubleshooting I have realized that the SeviceVM ISO is not mounted to the VM’s CD-ROM. After checking with the Nutanix support, they confirmed that the ISO must be attached all the time:
- It is very important to make sure that the operational procedures are updated and your scripts does not include any of the Nutanix Controller VMs and always follow the vendor recommendations.
The following two tabs change content below.
Nikolay Nikolov
VDI Engineer
Nikolay has 9 years work experience in IT and 5 of them in the Virtualization technologies mainly based on VMware products. Currently works as VDI Engineer at MSD IT Global Innovation Center and he is an ex-member of VMware CoE at IBM. He holds VCIX6-DCV, VCIX6-DTM and VCP on DCV, DTM, NV and Cloud, Nutanix NPP certificate and also Master Degree of Computer Systems and Networks. Honored with vExpert 2015/2016 by VMware and Nutanix Technology Champion 2016/2017.
Latest posts by Nikolay Nikolov (see all)
- Build a vRealize Orchestrator 7 (vRO) Cluster - February 13, 2017
- VMware vCenter Server Appliance 6.5 – Install and Configure - November 16, 2016
- Nutanix Upgrade fails at 93% - August 18, 2016
Good blog, two things to note:
1). Never mess about with CVMs – Nutanix don’t even want you to snapshot them as it can cause IO issues.
2). Notable that a cluster upgrade process could fail and no indication of any issues to the running systems.
I’ve never had an upgrade fail, but it is comforting that even in failure Nutanix remains robust.
I completely agree with both of your points! The thing I wanted to describe is not that my upgrade failed, but that you must exclude all CVMs from any kind of scripts. The customers are running lots of scripts against vCenters and once a Nutanix cluster is added to those vCenters, the scripts must be changed, otherwise they will end up in my situation.
Hi Nikolay,
your blog is very good. Thank you!
I have a little problem with a AppVolumes 2.11. Under Activities (Pending Actions, every day, I see 3/4 records like this: Audit VM state and ensure attachments are in sync – Failed 5 times”
I think there’s a problem with a job named “Audit VMs”. But I don’t know where. can you help me?
Thank you
Francesco