Reboot schedule is not getting completed with Nutanix-hosted VDAs

Reboot schedule is not getting completed with Nutanix-hosted VDAs

book

Article ID: CTX579055

calendar_today

Updated On:

Description

Reboot schedule is not getting completed with Nutanix-hosted VDAs when Nutanix AHV Plug-In for Citrix version 2.7.3.0 or 2.7.4.0 is deployed.

Environment

Citrix is not responsible for and does not endorse or accept any responsibility for the contents or your use of these third party Web sites. Citrix is providing these links to you only as a convenience, and the inclusion of any link does not imply endorsement by Citrix of the linked Web site. It is your responsibility to take precautions to ensure that whatever Web site you use is free of viruses or other harmful items.

Resolution

This is identified as a Nutanix AHV Plug-In for Citrix issue. Please contact the Nutanix support team for the root cause leading to reboot schedule not working.

Nutanix has provided a workaround for the issue. Please refer to https://portal.nutanix.com/page/documents/kbs/details?targetId=kA00e000000LLlaCAG for the solution.

Problem Cause

In CDF traces, reboot schedule was happening as expected which was followed by the shutdown command initiated by AHV plugin:

DDC 1:

  • 35634   35064,1,2023/07/26 02:00:43:93791,6536,3136,BrokerService.exe,0,BrokerRebootSchedule,,0,,1,Information,"RebootCycle(316080): WorkerAction(Notify, SID=S-x-x-xx-): InProgress ",""    316080  S-x-x-xx-
  • 35641   35071,1,2023/07/26 02:00:43:95461,6536,3136,BrokerService.exe,0,BrokerRebootSchedule,,0,,1,Information,"RebootCycle(316080): Request Shutdown of worker(S-x-x-xx-)...","" 316080  S-x-x-xx-
  • 35645   35075,1,2023/07/26 02:00:43:96143,6536,3136,BrokerService.exe,0,BrokerRebootSchedule,,0,,1,Information,"RebootCycle(316080): WorkerAction(Reboot, SID=S-x-x-xx-): InProgress ",""  316080  S-x-x-xx-
  • 37502   36911,2,2023/07/26 02:01:14:10405,8940,3136,BrokerService.exe,0,BrokerRebootSchedule,,0,,1,Information,"RebootCycle(316080): Worker(S-x-x-xx-) shutdown complete. To restart = True. rebootedWorker.PowerState = On",""    316080  S-x-x-xx-)
DDC 2:
  • 6385     6301,3,2023/07/26 02:00:43:66607,7584,3244,BrokerService.exe,0,BrokerOpEvent,,0,,1,Information,"2023-07-26T00:00:43.8600000Z:PowerActionStarted(b76592cf-a558-4bd0-b510-2c0f20d4944c, S-x-x-xx-, Uid=359608, Shutdown, Schedule, Queued @ 07/26/2023 00:00:43)","TraceId=efa6a63babd303449ebfa7e1ae4ed4b4, SpanId=a80101d149b53a46, ParentId=ec7a51a3a0ea994b, TransactionId=efa6a63b-abd3-0344-9ebf-a7e1ae4ed4b4"       PowerAction       S-x-x-xx-
  • 6432     6343,0,2023/07/26 02:00:43:67861,7584,3244,BrokerService.exe,0,BrokerController,,0,,1,Information,"Activity stop: Citrix.Cds.HostingManagement.PowerActionManager:StartPendingPowerAction/Shutdown/Schedule","TraceId=efa6a63babd303449ebfa7e1ae4ed4b4, SpanId=a80101d149b53a46, ParentId=ec7a51a3a0ea994b, TransactionId=efa6a63b-abd3-0344-9ebf-a7e1ae4ed4b4, span.name=StartPendingPowerAction/Shutdown/Schedule, span.kind=Internal, thread.id=73, TraceFlags=None, span.starttime=2023-07-26T00:00:43.8708879Z, span.duration=00:00:00.0199066, machine.name=Domain\Machinename, machine.sid=S-x-x-xx-, poweraction.uid=359608"        PowerAction       S-x-x-xx-   
  • 6661,1,2023/07/26 02:00:46:04487,8968,3244,BrokerService.exe,0,BrokerOpEvent,,0,,1,Information,"2023-07-26T00:00:46.2370000Z:PowerStateUpdated(b76592cf-a558-4bd0-b510-2c0f20d4944c, S-x-x-xx-, Off, , )","TraceId=2cde9d5625751f46a4d0a545ca745a9e, SpanId=1972e21dc8cbbd44, ParentId=efb2165bb768f948, TransactionId=2cde9d56-2575-1f46-a4d0-a545ca745a9e"   PowerStateUpdated   S-x-x-xx-
  • 6973     6828,0,2023/07/26 02:00:50:20544,2208,3200,Citrix.Monitor.exe,0,MonitorDataProcessing,,0,,1,Performance,"OpEvent","TraceId=1cf4cadbc779414792e53b8f6297a8e3, SpanId=b2b7942832168848, TransactionId=1cf4cadb-c779-4147-92e5-3b8f6297a8e3, EventType=PowerActionStarted, WorkerSid= S-x-x-xx-, EventTime=2023-07-26T00:00:43.8600000Z, ProcessingTime(ms)=2, LagTime(s)=6.5571357"       PowerAction      S-x-x-xx-
  • 6986     6841,0,2023/07/26 02:00:50:22229,2208,3200,Citrix.Monitor.exe,0,MonitorDataProcessing,,0,,1,Performance,"OpEvent","TraceId=1cf4cadbc779414792e53b8f6297a8e3, SpanId=b2b7942832168848, TransactionId=1cf4cadb-c779-4147-92e5-3b8f6297a8e3, EventType=PowerStateUpdated, WorkerSid=S-x-x-xx-, PowerState=Off, EventTime=2023-07-26T00:00:46.2370000Z, ProcessingTime(ms)=13, LagTime(s)=4.1971359"        PowerStateUpdated          S-x-x-xx-
  • 7776     7626,2,2023/07/26 02:01:04:37520,14324,3244,BrokerService.exe,0,BrokerDAL,,0,,5,EntryExit,"DAL <<< RegisterWorker(RegistrationData[]): returns False","TraceId=f8cb0f459b8f894e8eca42f865483741, SpanId=737fe0835087494c, ParentId=xxxxxx, TransactionId=f8cb0f45-9b8f-894e-8eca-42f865483741"   RegisterWorker    S-x-x-xx-
  • 9807     9577,2,2023/07/26 02:01:11:15276,8992,3244,BrokerService.exe,0,BrokerOpEvent,,0,,1,Information,"2023-07-26T00:01:11.3500000Z:PowerStateUpdated(uuid, S-x-x-xx-, On, , )","TraceId=2cde9d5625751f46a4d0a545ca745a9e, SpanId=40b1e9434953514c, ParentId=efb2165bb768f948, TransactionId=2cde9d56-2575-1f46-a4d0-a545ca745a9e"            PowerStateUpdated          S-x-x-xx-
  • 10140   9892,3,2023/07/26 02:01:19:26353,11356,3200,Citrix.Monitor.exe,0,MonitorDataProcessing,,0,,1,Performance,"OpEvent","TraceId=8078edba122e9e4eb26fb28e85c2a4ad, SpanId=3d9f0b7f6c6e234e, TransactionId=8078edba-122e-9e4e-b26f-b28e85c2a4ad, EventType=PowerStateUpdated, WorkerSid=S-x-x-x-x-, PowerState=On, EventTime=2023-07-26T00:01:11.3500000Z, ProcessingTime(ms)=2, LagTime(s)=8.1253422"          PowerStateUpdated          S-x-x-xx-
  • 2610841,3,2023-07-26 02:06:15:42577,9496,3244,BrokerService.exe,0,BrokerHostingPlugin,,0,,1,Information,"[NutanixAHV-2.7.3.0]: Logger.TraceMsg: Exit: ResultFromHttpRequest",""
  • 2610842,3,2023-07 2602:06:15:42586,9496,3244,BrokerService.exe,0,BrokerHostingPlugin,,0,,1,Information,"[NutanixAHV-2.7.3.0]: Logger.TraceMsg: Exit: PrismConnection.ConnectNutanixGETAsString",""
  • 2610843,3,2023-07-26 02:06:15:42594,9496,3244,BrokerService.exe,0,BrokerHostingPlugin,,0,,1,Information,"[NutanixAHV-2.7.3.0]: Logger.TraceMsg: NTNXVMProvisioning.AHVPrismVMInterface.getTaskStatus(): JSON = {""taskInfo"":{""uuid"":"""",""metaRequest"":{""methodName"":""VmSetPowerState""},""metaResponse"":{""error"":""kNoError"",""errorDetail"":""""},""createTime"":1690329974538993,""startTime"":1690329974557970,""completeTime"":1690329975621166,""lastUpdatedTime"":1690329975621166,""entityList"":[{""uuid"":""68c96f9e-59d0-4e1a-a367-d2fbe3a7618c"",""entityType"":""VM"",""entityName"":""""},{""uuid"":""d5336e17-d451-4cbe-a6dd-33cb1a202a73"",""entityType"":""Node"",""entityName"":""""}],""operationType"":""VmSetPowerState"",""message"":"""",""percentageComplete"":100,""progressStatus"":""Succeeded""},""isUnrecognized"":false}",""
  • 2610844,3,2023-07-26 02:06:15:42605,9496,3244,BrokerService.exe,0,BrokerHostingPlugin,,0,,1,Information,"[NutanixAHV-2.7.3.0]: Logger.TraceMsg: NTNXVMProvisioning.AHVPrismVMInterface.getTaskSuccessStatus(): Task:ID: fc2279c9-dbc6-4ca5-b08b-0f2c02b0a62b operationType : VmSetPowerState",""
  • 2610846,3,2023-07-26 02:06:15:42620,9496,3244,BrokerService.exe,0,BrokerHostingPlugin,,0,,1,Information,"[NutanixAHV-2.7.3.0]: Logger.TraceMsg: Task Id = fc2279c9-dbc6-4ca5-b08b-0f2c02b0a62b  ProgressStatus = Succeeded Percentage : 100  Error=kNoError  ErrorDetail=",""
  • 2610847,3,2023-07-26 02:06:15:42626,9496,3244,BrokerService.exe,0,BrokerHostingPlugin,,0,,1,Information,"[NutanixAHV-2.7.3.0]: Logger.TraceMsg: Acropolis Management:: ManageVMPowerState(): Result = True, ErrorCode = , ErrorMessage = ",""
  • 2610848,3,2023-07-26 02:06:15:42634,9496,3244,BrokerService.exe,0,BrokerHostingPlugin,,0,,1,Information,"[NutanixAHV-2.7.3.0]: Logger.TraceMsg: ManagePowerOperations: Updating VM power state for VM - uuid, to State - StopVM",""
    2610849,3,2023-07-26 02:06:15:42641,9496,3244,BrokerService.exe,0,BrokerHostingPlugin,,0,,1,Information,"[NutanixAHV-2.7.3.0]: Logger.TraceMsg: Acropolis_Management: end managing power-state for each machine",""
     
  • PowerStateUpdated          S-x-x-xx-
  • 40741   39878,0,2023/07/26 02:06:50:65369,9732,3200,Citrix.Monitor.exe,0,MonitorDataProcessing,,0,,1,Performance,"OpEvent","TraceId=d33c87685cb41f48babc4ea1f5bcf2fb, SpanId=3e68c03b631f3f49, TransactionId=d33c8768-5cb4-1f48-babc-4ea1f5bcf2fb, EventType=PowerStateUpdated, WorkerSid= S-x-x-x-x-, PowerState=Off, EventTime=2023-07-26T00:06:41.7770000Z, ProcessingTime(ms)=12, LagTime(s)=9.090699"          PowerStateUpdated          S-x-x-x-x-
Powered by Wolken Software