Repository navigation
ISO deploy causes unwanted isolated guest network creation even when L2 network is selected #11227
Description
Activity
@omurozlu Not able to reproduce the issue
Could you please provide the management server logs to investigate further
i have also seen this issue where I selected L2 network but an isolated network was created after the instance was deployed and the instance was attached to the isolated network rather than the desired L2 network. At the time, my testing was limited but it seemed to be related to a template being present within the system that had the same OS type as the instance i deployed (I am not quite sure if this was the true cause). I will need to test the ISO method you mentioned above.
management server log.
@mattmonday88 I get this error when I create a machine with the iso
2025-07-30 13:06:19,525 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-28:[ctx-5a81e264, job-46562/job-46566, ctx-353e7398, FirstFitRoutingAllocator]) (logid:615fb440) STATS: Can alloc MEM from host: Host {"id":9,"name":"ist-esx07.flexapp360.cloud","type":"Routing","uuid":"3e468ea5-008e-4cb7-be3a-b6a60e96adc1"}, used: (541.50 GB) 581431197696, reserved: (0 bytes) 0, total: (1.4995 TB) 1648692297728; requested mem: (512.00 MB) 536870912, alloc_from_last_host?: false, considerReservedCapacity?: true 2025-07-30 13:06:19,526 DEBUG [c.c.a.m.a.i.FirstFitRoutingAllocator] (Work-Job-Executor-28:[ctx-5a81e264, job-46562/job-46566, ctx-353e7398, FirstFitRoutingAllocator]) (logid:615fb440) Found a suitable host, adding to list: Host {"id":9,"name":"ist-esx07.flexapp360.cloud","type":"Routing","uuid":"3e468ea5-008e-4cb7-be3a-b6a60e96adc1"} 2025-07-30 13:06:19,526 DEBUG [c.c.a.m.a.i.FirstFitRoutingAllocator] (Work-Job-Executor-28:[ctx-5a81e264, job-46562/job-46566, ctx-353e7398, FirstFitRoutingAllocator]) (logid:615fb440) Host Allocator returning 3 suitable hosts 2025-07-30 13:06:19,526 INFO [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-28:[ctx-5a81e264, job-46562/job-46566, ctx-353e7398]) (logid:615fb440) Re-ordering hosts [Host {"id":1,"name":"ist-esx05.flexapp360.cloud","type":"Routing","uuid":"dd27f36c-a0c9-4be0-b566-5974279bcb56"}, Host {"id":13,"name":"ist-esx04.flexapp360.cloud","type":"Routing","uuid":"5b9e7168-799e-4255-b99a-3054f6adeeed"}, Host {"id":9,"name":"ist-esx07.flexapp360.cloud","type":"Routing","uuid":"3e468ea5-008e-4cb7-be3a-b6a60e96adc1"}] by priorities {} 2025-07-30 13:06:19,526 INFO [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-28:[ctx-5a81e264, job-46562/job-46566, ctx-353e7398]) (logid:615fb440) Hosts after re-ordering are: [Host {"id":1,"name":"ist-esx05.flexapp360.cloud","type":"Routing","uuid":"dd27f36c-a0c9-4be0-b566-5974279bcb56"}, Host {"id":13,"name":"ist-esx04.flexapp360.cloud","type":"Routing","uuid":"5b9e7168-799e-4255-b99a-3054f6adeeed"}, Host {"id":9,"name":"ist-esx07.flexapp360.cloud","type":"Routing","uuid":"3e468ea5-008e-4cb7-be3a-b6a60e96adc1"}] 2025-07-30 13:06:19,529 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-28:[ctx-5a81e264, job-46562/job-46566, ctx-353e7398]) (logid:615fb440) Checking suitable pools for volume [Volume {"id":5886,"instanceId":1238,"name":"ROOT-1238","uuid":"390b9f39-27f6-46c1-b00e-9886d354303b","volumeType":"ROOT"}, ROOT] of VM [VM instance {"id":1238,"instanceName":"r-1238-VM","state":"Starting","type":"DomainRouter","uuid":"d73b60cf-857c-46a8-9ff8-2fa294778968"}]. 2025-07-30 13:06:19,532 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:[ctx-f632cd00]) (logid:c72a1b5b) Resetting hosts suitable for reconnect 2025-07-30 13:06:19,533 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-28:[ctx-5a81e264, job-46562/job-46566, ctx-353e7398]) (logid:615fb440) System VMs will use shared storage for zone Zone {"id": "1", "name": "IST01", "uuid": "36a59d65-2c25-403c-997b-3b3f7997cc8a"} 2025-07-30 13:06:19,533 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-28:[ctx-5a81e264, job-46562/job-46566, ctx-353e7398]) (logid:615fb440) Calling StoragePoolAllocators to find suitable pools to allocate volume [Volume {"id":5886,"instanceId":1238,"name":"ROOT-1238","uuid":"390b9f39-27f6-46c1-b00e-9886d354303b","volumeType":"ROOT"}] necessary to deploy VM [VM instance {"id":1238,"instanceName":"r-1238-VM","state":"Starting","type":"DomainRouter","uuid":"d73b60cf-857c-46a8-9ff8-2fa294778968"}]. 2025-07-30 13:06:19,533 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-28:[ctx-5a81e264, job-46562/job-46566, ctx-353e7398]) (logid:615fb440) Trying to find suitable pools to allocate volume [Volume {"id":5886,"instanceId":1238,"name":"ROOT-1238","uuid":"390b9f39-27f6-46c1-b00e-9886d354303b","volumeType":"ROOT"}] necessary to deploy VM [VM instance {"id":1238,"instanceName":"r-1238-VM","state":"Starting","type":"DomainRouter","uuid":"d73b60cf-857c-46a8-9ff8-2fa294778968"}], using StoragePoolAllocator: [LocalStoragePoolAllocator]. 2025-07-30 13:06:19,533 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator] (Work-Job-Executor-28:[ctx-5a81e264, job-46562/job-46566, ctx-353e7398]) (logid:615fb440) LocalStoragePoolAllocator is returning null since the disk profile does not use local storage and bypassStorageTypeCheck is false. 2025-07-30 13:06:19,534 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:[ctx-f632cd00]) (logid:c72a1b5b) Completed resetting hosts suitable for reconnect 2025-07-30 13:06:19,534 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:[ctx-f632cd00]) (logid:c72a1b5b) Acquiring hosts for clusters already owned by this management server 2025-07-30 13:06:19,533 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-28:[ctx-5a81e264, job-46562/job-46566, ctx-353e7398]) (logid:615fb440) Trying to find suitable pools to allocate volume [Volume {"id":5886,"instanceId":1238,"name":"ROOT-1238","uuid":"390b9f39-27f6-46c1-b00e-9886d354303b","volumeType":"ROOT"}] necessary to deploy VM [VM instance {"id":1238,"instanceName":"r-1238-VM","state":"Starting","type":"DomainRouter","uuid":"d73b60cf-857c-46a8-9ff8-2fa294778968"}], using StoragePoolAllocator: [ClusterScopeStoragePoolAllocator]. 2025-07-30 13:06:19,534 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-28:[ctx-5a81e264, job-46562/job-46566, ctx-353e7398]) (logid:615fb440) Looking for pools in dc [1], pod [1] and cluster [1]. Disabled pools will be ignored. 2025-07-30 13:06:19,536 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:[ctx-f632cd00]) (logid:c72a1b5b) Completed acquiring hosts for clusters already owned by this management server 2025-07-30 13:06:19,536 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-28:[ctx-5a81e264, job-46562/job-46566, ctx-353e7398]) (logid:615fb440) Found pools [[]] that match with tags [[]]. 2025-07-30 13:06:19,536 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:[ctx-f632cd00]) (logid:c72a1b5b) Acquiring hosts for clusters not owned by any management server 2025-07-30 13:06:19,537 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-28:[ctx-5a81e264, job-46562/job-46566, ctx-353e7398]) (logid:615fb440) No storage pools available for [shared] volume allocation. 2025-07-30 13:06:19,537 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator] (Work-Job-Executor-28:[ctx-5a81e264, job-46562/job-46566, ctx-353e7398]) (logid:615fb440) Using allocation algorithm [random] to reorder pools. 2025-07-30 13:06:19,537 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:[ctx-f632cd00]) (logid:c72a1b5b) Completed acquiring hosts for clusters not owned by any management server 2025-07-30 13:06:19,537 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-28:[ctx-5a81e264, job-46562/job-46566, ctx-353e7398]) (logid:615fb440) Trying to find suitable pools to allocate volume [Volume {"id":5886,"instanceId":1238,"name":"ROOT-1238","uuid":"390b9f39-27f6-46c1-b00e-9886d354303b","volumeType":"ROOT"}] necessary to deploy VM [VM instance {"id":1238,"instanceName":"r-1238-VM","state":"Starting","type":"DomainRouter","uuid":"d73b60cf-857c-46a8-9ff8-2fa294778968"}], using StoragePoolAllocator: [ZoneWideStoragePoolAllocator]. 2025-07-30 13:06:19,543 DEBUG [o.a.c.s.a.ZoneWideStoragePoolAllocator] (Work-Job-Executor-28:[ctx-5a81e264, job-46562/job-46566, ctx-353e7398]) (logid:615fb440) Checking if storage pool [StoragePool {"id":9,"name":"PS100T_MUSTERI_NVME","poolType":"PreSetup","uuid":"8456ae93-49f3-35aa-a6c3-c48b3c3a05f1"}] is suitable to disk [DskChr[ROOT|5242880000|]]. 2025-07-30 13:06:19,544 DEBUG [c.c.s.StorageManagerImpl] (Work-Job-Executor-28:[ctx-5a81e264, job-46562/job-46566, ctx-353e7398]) (logid:615fb440) Volume [Volume {"id":5886,"instanceId":1238,"name":"ROOT-1238","uuid":"390b9f39-27f6-46c1-b00e-9886d354303b","volumeType":"ROOT"}] is not allocated to any pool. Cannot check compatibility with pool [StoragePool {"id":9,"name":"PS100T_MUSTERI_NVME","poolType":"PreSetup","uuid":"8456ae93-49f3-35aa-a6c3-c48b3c3a05f1"}]. 2025-07-30 13:06:19,545 INFO [c.c.s.StorageManagerImpl] (Work-Job-Executor-28:[ctx-5a81e264, job-46562/job-46566, ctx-353e7398]) (logid:615fb440) Storage pool StoragePool {"id":9,"name":"PS100T_MUSTERI_NVME","poolType":"PreSetup","uuid":"8456ae93-49f3-35aa-a6c3-c48b3c3a05f1"} does not supply IOPS capacity, assuming enough capacity 2025-07-30 13:06:19,545 DEBUG [c.c.s.StorageManagerImpl] (Work-Job-Executor-28:[ctx-5a81e264, job-46562/job-46566, ctx-353e7398]) (logid:615fb440) Checking pool StoragePool {"id":9,"name":"PS100T_MUSTERI_NVME","poolType":"PreSetup","uuid":"8456ae93-49f3-35aa-a6c3-c48b3c3a05f1"} for storage, totalSize: 109950894342144, usedBytes: 55992248172544, usedPct: 0.5092477738135347, disable threshold: 0.85 2025-07-30 13:06:19,545 DEBUG [c.c.s.StorageManagerImpl] (Work-Job-Executor-28:[ctx-5a81e264, job-46562/job-46566, ctx-353e7398]) (logid:615fb440) Destination pool: StoragePool {"id":9,"name":"PS100T_MUSTERI_NVME","poolType":"PreSetup","uuid":"8456ae93-49f3-35aa-a6c3-c48b3c3a05f1"} 2025-07-30 13:06:19,573 DEBUG [c.c.s.StorageManagerImpl] (Work-Job-Executor-28:[ctx-5a81e264, job-46562/job-46566, ctx-353e7398]) (logid:615fb440) Pool ID for the volume Volume {"id":5886,"instanceId":1238,"name":"ROOT-1238","uuid":"390b9f39-27f6-46c1-b00e-9886d354303b","volumeType":"ROOT"} is null 2025-07-30 13:06:19,577 DEBUG [c.c.s.StorageManagerImpl] (Work-Job-Executor-28:[ctx-5a81e264, job-46562/job-46566, ctx-353e7398]) (logid:615fb440) Found storage pool StoragePool {"id":9,"name":"PS100T_MUSTERI_NVME","poolType":"PreSetup","uuid":"8456ae93-49f3-35aa-a6c3-c48b3c3a05f1"} of type PreSetup with overprovisioning factor 2 2025-07-30 13:06:19,577 DEBUG [c.c.s.StorageManagerImpl] (Work-Job-Executor-28:[ctx-5a81e264, job-46562/job-46566, ctx-353e7398]) (logid:615fb440) Total over provisioned capacity calculated is 2 * (99.9998 TB) 109950894342144 2025-07-30 13:06:19,577 DEBUG [c.c.s.StorageManagerImpl] (Work-Job-Executor-28:[ctx-5a81e264, job-46562/job-46566, ctx-353e7398]) (logid:615fb440) Total capacity of the pool StoragePool {"id":9,"name":"PS100T_MUSTERI_NVME","poolType":"PreSetup","uuid":"8456ae93-49f3-35aa-a6c3-c48b3c3a05f1"} is (199.9995 TB) 219901788684288 2025-07-30 13:06:19,578 DEBUG [c.c.s.StorageManagerImpl] (Work-Job-Executor-28:[ctx-5a81e264, job-46562/job-46566, ctx-353e7398]) (logid:615fb440) Checking pool: StoragePool {"id":9,"name":"PS100T_MUSTERI_NVME","poolType":"PreSetup","uuid":"8456ae93-49f3-35aa-a6c3-c48b3c3a05f1"} for storage allocation , maxSize : (199.9995 TB) 219901788684288, totalAllocatedSize : (72.9898 TB) 80253138352268, askingSize : (4.88 GB) 5242880000, allocated disable threshold: 0.85 2025-07-30 13:06:19,579 DEBUG [o.a.c.s.a.ZoneWideStoragePoolAllocator] (Work-Job-Executor-28:[ctx-5a81e264, job-46562/job-46566, ctx-353e7398]) (logid:615fb440) Found suitable local storage pool [StoragePool {"id":9,"name":"PS100T_MUSTERI_NVME","poolType":"PreSetup","uuid":"8456ae93-49f3-35aa-a6c3-c48b3c3a05f1"}] to allocate disk [DskChr[ROOT|5242880000|]] to it, adding to list. 2025-07-30 13:06:19,579 DEBUG [o.a.c.s.a.ZoneWideStoragePoolAllocator] (Work-Job-Executor-28:[ctx-5a81e264, job-46562/job-46566, ctx-353e7398]) (logid:615fb440) ZoneWideStoragePoolAllocator is returning [1] suitable storage pools [[StoragePool {"id":9,"name":"PS100T_MUSTERI_NVME","poolType":"PreSetup","uuid":"8456ae93-49f3-35aa-a6c3-c48b3c3a05f1"}]]. 2025-07-30 13:06:19,579 DEBUG [o.a.c.s.a.ZoneWideStoragePoolAllocator] (Work-Job-Executor-28:[ctx-5a81e264, job-46562/job-46566, ctx-353e7398]) (logid:615fb440) Using allocation algorithm [random] to reorder pools. 2025-07-30 13:06:19,580 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-28:[ctx-5a81e264, job-46562/job-46566, ctx-353e7398]) (logid:615fb440) StoragePoolAllocator [ZoneWideStoragePoolAllocator] found 1 suitable pools to allocate volume [Volume {"id":5886,"instanceId":1238,"name":"ROOT-1238","uuid":"390b9f39-27f6-46c1-b00e-9886d354303b","volumeType":"ROOT"}] necessary to deploy VM [VM instance {"id":1238,"instanceName":"r-1238-VM","state":"Starting","type":"DomainRouter","uuid":"d73b60cf-857c-46a8-9ff8-2fa294778968"}]. 2025-07-30 13:06:19,582 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-28:[ctx-5a81e264, job-46562/job-46566, ctx-353e7398]) (logid:615fb440) Trying to find a potenial host and associated storage pools from the suitable host/pool lists for this VM 2025-07-30 13:06:19,583 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-28:[ctx-5a81e264, job-46562/job-46566, ctx-353e7398]) (logid:615fb440) Checking if host: Host {"id":1,"name":"ist-esx05.flexapp360.cloud","type":"Routing","uuid":"dd27f36c-a0c9-4be0-b566-5974279bcb56"} can access any suitable storage pool for volume: ROOT 2025-07-30 13:06:19,585 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-28:[ctx-5a81e264, job-46562/job-46566, ctx-353e7398]) (logid:615fb440) Host: Host {"id":1,"name":"ist-esx05.flexapp360.cloud","type":"Routing","uuid":"dd27f36c-a0c9-4be0-b566-5974279bcb56"} can access pool: StoragePool {"id":9,"name":"PS100T_MUSTERI_NVME","poolType":"PreSetup","uuid":"8456ae93-49f3-35aa-a6c3-c48b3c3a05f1"} 2025-07-30 13:06:19,587 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-28:[ctx-5a81e264, job-46562/job-46566, ctx-353e7398]) (logid:615fb440) Found a potential host Host {"id":1,"name":"ist-esx05.flexapp360.cloud","type":"Routing","uuid":"dd27f36c-a0c9-4be0-b566-5974279bcb56"} and associated storage pools for this VM 2025-07-30 13:06:19,587 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-28:[ctx-5a81e264, job-46562/job-46566, ctx-353e7398]) (logid:615fb440) Returning Deployment Destination: Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(1)-Pod(1)-Cluster(1)-Host(1)-Storage(Volume(5886|ROOT-->Pool(9))] 2025-07-30 13:06:19,588 DEBUG [c.c.v.ClusteredVirtualMachineManagerImpl] (Work-Job-Executor-28:[ctx-5a81e264, job-46562/job-46566, ctx-353e7398]) (logid:615fb440) Deployment found - Attempt #1 - P0=VM instance {"id":1238,"instanceName":"r-1238-VM","state":"Starting","type":"DomainRouter","uuid":"d73b60cf-857c-46a8-9ff8-2fa294778968"}, P0=Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(1)-Pod(1)-Cluster(1)-Host(1)-Storage(Volume(5886|ROOT-->Pool(9))] 2025-07-30 13:06:19,609 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-28:[ctx-5a81e264, job-46562/job-46566, ctx-353e7398]) (logid:615fb440) VM instance {"id":1238,"instanceName":"r-1238-VM","state":"Starting","type":"DomainRouter","uuid":"d73b60cf-857c-46a8-9ff8-2fa294778968"} state transited from [Starting] to [Starting] with event [OperationRetry]. VM's original host: null, new host: Host {"id":1,"name":"ist-esx05.flexapp360.cloud","type":"Routing","uuid":"dd27f36c-a0c9-4be0-b566-5974279bcb56"}, host before state transition: null 2025-07-30 13:06:19,617 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-28:[ctx-5a81e264, job-46562/job-46566, ctx-353e7398]) (logid:615fb440) Hosts's actual total CPU: 201120 and CPU after applying overprovisioning: 201120 2025-07-30 13:06:19,617 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-28:[ctx-5a81e264, job-46562/job-46566, ctx-353e7398]) (logid:615fb440) We are allocating VM, increasing the used capacity of this host:Host {"id":1,"name":"ist-esx05.flexapp360.cloud","type":"Routing","uuid":"dd27f36c-a0c9-4be0-b566-5974279bcb56"} 2025-07-30 13:06:19,617 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-28:[ctx-5a81e264, job-46562/job-46566, ctx-353e7398]) (logid:615fb440) Current Used CPU: 126000 , Free CPU:75120 ,Requested CPU: 500 2025-07-30 13:06:19,617 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-28:[ctx-5a81e264, job-46562/job-46566, ctx-353e7398]) (logid:615fb440) Current Used RAM: (488.00 GB) 523986010112 , Free RAM:(535.46 GB) 574950473728 ,Requested RAM: (512.00 MB) 536870912 2025-07-30 13:06:19,618 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-28:[ctx-5a81e264, job-46562/job-46566, ctx-353e7398]) (logid:615fb440) CPU STATS after allocation: for host: Host {"id":1,"name":"ist-esx05.flexapp360.cloud","type":"Routing","uuid":"dd27f36c-a0c9-4be0-b566-5974279bcb56"}, old used: 126000, old reserved: 0, actual total: 201120, total with overprovisioning: 201120; new used: 126500, reserved: 0; requested cpu: 500, alloc_from_last: false 2025-07-30 13:06:19,618 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-28:[ctx-5a81e264, job-46562/job-46566, ctx-353e7398]) (logid:615fb440) RAM STATS after allocation: for host: Host {"id":1,"name":"ist-esx05.flexapp360.cloud","type":"Routing","uuid":"dd27f36c-a0c9-4be0-b566-5974279bcb56"}, old used: (488.00 GB) 523986010112, old reserved: (0 bytes) 0, total: (1023.46 GB) 1098936483840; new used: (488.50 GB) 524522881024, reserved: (0 bytes) 0; requested mem: (512.00 MB) 536870912, alloc_from_last: false 2025-07-30 13:06:19,619 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-28:[ctx-5a81e264, job-46562/job-46566, ctx-353e7398]) (logid:615fb440) Host {"id":1,"name":"ist-esx05.flexapp360.cloud","type":"Routing","uuid":"dd27f36c-a0c9-4be0-b566-5974279bcb56"} has cpu capability (cpu: 96, speed: 2095 ) to support requested CPU: 1 and requested speed: 500 2025-07-30 13:06:19,620 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-28:[ctx-5a81e264, job-46562/job-46566, ctx-353e7398]) (logid:615fb440) Checking if host: Host {"id":1,"name":"ist-esx05.flexapp360.cloud","type":"Routing","uuid":"dd27f36c-a0c9-4be0-b566-5974279bcb56"} has enough capacity for requested CPU: 500 and requested RAM: (512.00 MB) 536870912 , cpuOverprovisioningFactor: 1.0 2025-07-30 13:06:19,621 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-28:[ctx-5a81e264, job-46562/job-46566, ctx-353e7398]) (logid:615fb440) Hosts's actual total CPU: 201120 and CPU after applying overprovisioning: 201120 2025-07-30 13:06:19,621 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-28:[ctx-5a81e264, job-46562/job-46566, ctx-353e7398]) (logid:615fb440) We need to allocate to the last host again, so checking if there is enough reserved capacity 2025-07-30 13:06:19,621 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-28:[ctx-5a81e264, job-46562/job-46566, ctx-353e7398]) (logid:615fb440) Reserved CPU: 0 , Requested CPU: 500 2025-07-30 13:06:19,621 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-28:[ctx-5a81e264, job-46562/job-46566, ctx-353e7398]) (logid:615fb440) Reserved RAM: (0 bytes) 0 , Requested RAM: (512.00 MB) 536870912 2025-07-30 13:06:19,621 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-28:[ctx-5a81e264, job-46562/job-46566, ctx-353e7398]) (logid:615fb440) STATS: Failed to alloc resource from host: Host {"id":1,"name":"ist-esx05.flexapp360.cloud","type":"Routing","uuid":"dd27f36c-a0c9-4be0-b566-5974279bcb56"} reservedCpu: 0, requested cpu: 500, reservedMem: (0 bytes) 0, requested mem: (512.00 MB) 536870912 2025-07-30 13:06:19,622 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-28:[ctx-5a81e264, job-46562/job-46566, ctx-353e7398]) (logid:615fb440) Host does not have enough reserved CPU available, cannot allocate to this host. 2025-07-30 13:06:19,622 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-28:[ctx-5a81e264, job-46562/job-46566, ctx-353e7398]) (logid:615fb440) Checking if host: Host {"id":1,"name":"ist-esx05.flexapp360.cloud","type":"Routing","uuid":"dd27f36c-a0c9-4be0-b566-5974279bcb56"} has enough capacity for requested CPU: 500 and requested RAM: (512.00 MB) 536870912 , cpuOverprovisioningFactor: 1.0 2025-07-30 13:06:19,623 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-28:[ctx-5a81e264, job-46562/job-46566, ctx-353e7398]) (logid:615fb440) Hosts's actual total CPU: 201120 and CPU after applying overprovisioning: 201120 2025-07-30 13:06:19,623 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-28:[ctx-5a81e264, job-46562/job-46566, ctx-353e7398]) (logid:615fb440) Free CPU: 75120 , Requested CPU: 500 2025-07-30 13:06:19,623 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-28:[ctx-5a81e264, job-46562/job-46566, ctx-353e7398]) (logid:615fb440) Free RAM: (535.46 GB) 574950473728 , Requested RAM: (512.00 MB) 536870912 2025-07-30 13:06:19,623 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-28:[ctx-5a81e264, job-46562/job-46566, ctx-353e7398]) (logid:615fb440) Host has enough CPU and RAM available 2025-07-30 13:06:19,623 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-28:[ctx-5a81e264, job-46562/job-46566, ctx-353e7398]) (logid:615fb440) STATS: Can alloc CPU from host: Host {"id":1,"name":"ist-esx05.flexapp360.cloud","type":"Routing","uuid":"dd27f36c-a0c9-4be0-b566-5974279bcb56"}, used: 126000, reserved: 0, actual total: 201120, total with overprovisioning: 201120; requested cpu: 500, alloc_from_last_host?: false, considerReservedCapacity?: true 2025-07-30 13:06:19,623 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-28:[ctx-5a81e264, job-46562/job-46566, ctx-353e7398]) (logid:615fb440) STATS: Can alloc MEM from host: Host {"id":1,"name":"ist-esx05.flexapp360.cloud","type":"Routing","uuid":"dd27f36c-a0c9-4be0-b566-5974279bcb56"}, used: (488.00 GB) 523986010112, reserved: (0 bytes) 0, total: (1023.46 GB) 1098936483840; requested mem: (512.00 MB) 536870912, alloc_from_last_host?: false, considerReservedCapacity?: true 2025-07-30 13:06:19,877 DEBUG [c.c.n.NetworkModelImpl] (Work-Job-Executor-28:[ctx-5a81e264, job-46562/job-46566, ctx-353e7398]) (logid:615fb440) Service SecurityGroup is not supported in the network Network {"id": 798, "name": "omur.ozlu-network", "uuid": "34c6b263-a9f2-4d19-8d42-b390166f09a6", "networkofferingid": 37} 2025-07-30 13:06:19,976 DEBUG [o.a.c.h.H.HAManagerBgPollTask] (BackgroundTaskPollManager-4:[ctx-fef22974]) (logid:064c6531) HA health check task is running... 2025-07-30 13:06:19,978 DEBUG [o.a.c.e.o.NetworkOrchestrator] (Work-Job-Executor-28:[ctx-5a81e264, job-46562/job-46566, ctx-353e7398]) (logid:615fb440) Asking VirtualRouter to prepare for Nic {"broadcastUri":"vlan:\/\/1154","deviceId":0,"iPv4Address":"10.1.1.1","id":10514,"instanceId":1238,"reservationId":"897445e3-b652-4dc8-8e71-4c9d08ce4a10","uuid":"9db1e208-bcc9-4c40-9d9d-29191fac7b80"} 2025-07-30 13:06:19,980 DEBUG [c.c.n.NetworkModelImpl] (Work-Job-Executor-28:[ctx-5a81e264, job-46562/job-46566, ctx-353e7398]) (logid:615fb440) Service SecurityGroup is not supported in the network Network {"id": 798, "name": "omur.ozlu-network", "uuid": "34c6b263-a9f2-4d19-8d42-b390166f09a6", "networkofferingid": 37} 2025-07-30 13:06:20,086 DEBUG [c.c.d.d.DataCenterIpAddressDaoImpl] (Work-Job-Executor-28:[ctx-5a81e264, job-46562/job-46566, ctx-353e7398]) (logid:615fb440) Releasing ip address for nic=10518 2025-07-30 13:06:20,104 DEBUG [c.c.n.g.ControlNetworkGuru] (Work-Job-Executor-28:[ctx-5a81e264, job-46562/job-46566, ctx-353e7398]) (logid:615fb440) Allocated a nic NicProfile {"broadcastUri":null,"deviceId":1,"iPv4Address":"172.16.216.133","id":10518,"reservationId":"897445e3-b652-4dc8-8e71-4c9d08ce4a10","uuid":"2831fabd-a3fb-45b6-9d1d-9177a52876f0","vmId":1238} for VM instance {"id":1238,"instanceName":"r-1238-VM","state":"Starting","type":"DomainRouter","uuid":"d73b60cf-857c-46a8-9ff8-2fa294778968"} 2025-07-30 13:06:20,159 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl] (Work-Job-Executor-28:[ctx-5a81e264, job-46562/job-46566, ctx-353e7398]) (logid:615fb440) template Template {"format":"OVA","id":289,"name":"SystemVM Template v4.20 (vSphere)","uniqueName":"289-2-e34a1aa1-3d3b-39ba-8566-4f200b04c36c","uuid":"fd35b75d-3c51-47ff-bef2-93ee4a9170b5"} with id 289 is already in store:ImageStore {"id":1,"name":"CSNFS01","uuid":"373f55c3-ce25-4004-9779-da33fbd55342"}, type: Image 2025-07-30 13:06:20,210 DEBUG [o.a.c.s.m.AncientDataMotionStrategy] (Work-Job-Executor-28:[ctx-5a81e264, job-46562/job-46566, ctx-353e7398]) (logid:615fb440) copyAsync inspecting src type TEMPLATE copyAsync inspecting dest type VOLUME 2025-07-30 13:06:20,223 DEBUG [c.c.h.o.r.Ovm3HypervisorGuru] (Work-Job-Executor-28:[ctx-5a81e264, job-46562/job-46566, ctx-353e7398]) (logid:615fb440) getCommandHostDelegation: class org.apache.cloudstack.storage.command.CopyCommand 2025-07-30 13:06:20,226 DEBUG [c.c.h.XenServerGuru] (Work-Job-Executor-28:[ctx-5a81e264, job-46562/job-46566, ctx-353e7398]) (logid:615fb440) We are returning the default host to execute commands because the target hypervisor of the source data is not XenServer. 2025-07-30 13:06:20,227 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] (Work-Job-Executor-28:[ctx-5a81e264, job-46562/job-46566, ctx-353e7398]) (logid:615fb440) Wait time setting on org.apache.cloudstack.storage.command.CopyCommand is 1800 seconds 2025-07-30 13:06:20,228 DEBUG [c.c.a.m.ClusteredDirectAgentAttache] (Work-Job-Executor-28:[ctx-5a81e264, job-46562/job-46566, ctx-353e7398]) (logid:615fb440) Seq 37-4204391727127069459: Routed from 345050216744 2025-07-30 13:06:20,231 DEBUG [c.c.a.t.Request] (Work-Job-Executor-28:[ctx-5a81e264, job-46562/job-46566, ctx-353e7398]) (logid:615fb440) Seq 17-4204391727127069459: Sending { Cmd , MgmtId: 345050216744, via: 17(ist-esx08.flexapp360.cloud), Ver: v1, Flags: 100111, [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"645a8e530fe4380394fe96e26bc91e9a","origUrl":"https://download.cloudstack.org/systemvm/4.20/systemvmtemplate-4.20.1-x86_64-vmware.ova","uuid":"fd35b75d-3c51-47ff-bef2-93ee4a9170b5","id":"289","format":"OVA","accountId":"2","checksum":"90076ec77bd987a7e8f27756b116ebb8","hvm":"true","displayText":"SystemVM Template v4.20 (vSphere)","imageDataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"8456ae93-49f3-35aa-a6c3-c48b3c3a05f1","name":"PS100T_MUSTERI_NVME","id":"9","poolType":"PreSetup","host":"ist-vc01.flexapp360.cloud","path":"/ISTDC01/PS100T_MUSTERI_NVME","port":"0","url":"PreSetup://ist-vc01.flexapp360.cloud/ISTDC01/PS100T_MUSTERI_NVME/?ROLE=Primary&STOREUUID=8456ae93-49f3-35aa-a6c3-c48b3c3a05f1","isManaged":"false"}},"name":"289-2-e34a1aa1-3d3b-39ba-8566-4f200b04c36c","size":"(4.88 GB) 5242880000","hypervisorType":"VMware","bootable":"false","uniqueName":"289-2-e34a1aa1-3d3b-39ba-8566-4f200b04c36c","directDownload":"false","deployAsIs":"false","followRedirects":"false"}},"destTO":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"390b9f39-27f6-46c1-b00e-9886d354303b","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"8456ae93-49f3-35aa-a6c3-c48b3c3a05f1","name":"PS100T_MUSTERI_NVME","id":"9","poolType":"PreSetup","host":"ist-vc01.flexapp360.cloud","path":"/ISTDC01/PS100T_MUSTERI_NVME","port":"0","url":"PreSetup://ist-vc01.flexapp360.cloud/ISTDC01/PS100T_MUSTERI_NVME/?ROLE=Primary&STOREUUID=8456ae93-49f3-35aa-a6c3-c48b3c3a05f1","fullCloneFlag":"true","diskProvisioningStrictnessFlag":"false","isManaged":"false"}},"name":"ROOT-1238","size":"(4.88 GB) 5242880000","volumeId":"5886","vmName":"r-1238-VM","accountId":"491","format":"OVA","provisioningType":"THIN","poolId":"9","id":"5886","deviceId":"0","hypervisorType":"VMware","directDownload":"false","deployAsIs":"false","followRedirects":"false"}},"executeInSequence":"true","options":{},"options2":{},"wait":"0","bypassHostMaintenance":"false"}}] } 2025-07-30 13:06:20,233 DEBUG [c.c.a.t.Request] (Work-Job-Executor-28:[ctx-5a81e264, job-46562/job-46566, ctx-353e7398]) (logid:615fb440) Seq 17-4204391727127069459: Executing: { Cmd , MgmtId: 345050216744, via: 17(ist-esx08.flexapp360.cloud), Ver: v1, Flags: 100111, [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"645a8e530fe4380394fe96e26bc91e9a","origUrl":"https://download.cloudstack.org/systemvm/4.20/systemvmtemplate-4.20.1-x86_64-vmware.ova","uuid":"fd35b75d-3c51-47ff-bef2-93ee4a9170b5","id":"289","format":"OVA","accountId":"2","checksum":"90076ec77bd987a7e8f27756b116ebb8","hvm":"true","displayText":"SystemVM Template v4.20 (vSphere)","imageDataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"8456ae93-49f3-35aa-a6c3-c48b3c3a05f1","name":"PS100T_MUSTERI_NVME","id":"9","poolType":"PreSetup","host":"ist-vc01.flexapp360.cloud","path":"/ISTDC01/PS100T_MUSTERI_NVME","port":"0","url":"PreSetup://ist-vc01.flexapp360.cloud/ISTDC01/PS100T_MUSTERI_NVME/?ROLE=Primary&STOREUUID=8456ae93-49f3-35aa-a6c3-c48b3c3a05f1","isManaged":"false"}},"name":"289-2-e34a1aa1-3d3b-39ba-8566-4f200b04c36c","size":"(4.88 GB) 5242880000","hypervisorType":"VMware","bootable":"false","uniqueName":"289-2-e34a1aa1-3d3b-39ba-8566-4f200b04c36c","directDownload":"false","deployAsIs":"false","followRedirects":"false"}},"destTO":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"390b9f39-27f6-46c1-b00e-9886d354303b","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"8456ae93-49f3-35aa-a6c3-c48b3c3a05f1","name":"PS100T_MUSTERI_NVME","id":"9","poolType":"PreSetup","host":"ist-vc01.flexapp360.cloud","path":"/ISTDC01/PS100T_MUSTERI_NVME","port":"0","url":"PreSetup://ist-vc01.flexapp360.cloud/ISTDC01/PS100T_MUSTERI_NVME/?ROLE=Primary&STOREUUID=8456ae93-49f3-35aa-a6c3-c48b3c3a05f1","fullCloneFlag":"true","diskProvisioningStrictnessFlag":"false","isManaged":"false"}},"name":"ROOT-1238","size":"(4.88 GB) 5242880000","volumeId":"5886","vmName":"r-1238-VM","accountId":"491","format":"OVA","provisioningType":"THIN","poolId":"9","id":"5886","deviceId":"0","hypervisorType":"VMware","directDownload":"false","deployAsIs":"false","followRedirects":"false"}},"executeInSequence":"true","options":{},"options2":{},"wait":"0","bypassHostMaintenance":"false"}}] } 2025-07-30 13:06:20,233 DEBUG [c.c.a.m.D.Task] (DirectAgent-15:[ctx-87b99334]) (logid:7bdd528c) Seq 37-4204391727127069459: Executing request 2025-07-30 13:06:20,233 DEBUG [c.c.h.v.r.VmwareResource] (DirectAgent-15:[ctx-87b99334]) (logid:615fb440) Executing resource command CopyCommand: [{"srcTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"645a8e530fe4380394fe96e26bc91e9a","origUrl":"https://download.cloudstack.org/systemvm/4.20/systemvmtemplate-4.20.1-x86_64-vmware.ova","uuid":"fd35b75d-3c51-47ff-bef2-93ee4a9170b5","id":289,"format":"OVA","accountId":2,"checksum":"90076ec77bd987a7e8f27756b116ebb8","hvm":true,"displayText":"SystemVM Template v4.20 (vSphere)","imageDataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"8456ae93-49f3-35aa-a6c3-c48b3c3a05f1","name":"PS100T_MUSTERI_NVME","id":9,"poolType":"PreSetup","host":"ist-vc01.flexapp360.cloud","path":"/ISTDC01/PS100T_MUSTERI_NVME","port":0,"url":"PreSetup://ist-vc01.flexapp360.cloud/ISTDC01/PS100T_MUSTERI_NVME/?ROLE=Primary&STOREUUID=8456ae93-49f3-35aa-a6c3-c48b3c3a05f1","isManaged":false}},"name":"289-2-e34a1aa1-3d3b-39ba-8566-4f200b04c36c","size":5242880000,"hypervisorType":"VMware","bootable":false,"uniqueName":"289-2-e34a1aa1-3d3b-39ba-8566-4f200b04c36c","directDownload":false,"deployAsIs":false,"followRedirects":false}},"destTO":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"390b9f39-27f6-46c1-b00e-9886d354303b","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"8456ae93-49f3-35aa-a6c3-c48b3c3a05f1","name":"PS100T_MUSTERI_NVME","id":9,"poolType":"PreSetup","host":"ist-vc01.flexapp360.cloud","path":"/ISTDC01/PS100T_MUSTERI_NVME","port":0,"url":"PreSetup://ist-vc01.flexapp360.cloud/ISTDC01/PS100T_MUSTERI_NVME/?ROLE=Primary&STOREUUID=8456ae93-49f3-35aa-a6c3-c48b3c3a05f1","fullCloneFlag":true,"diskProvisioningStrictnessFlag":false,"isManaged":false}},"name":"ROOT-1238","size":5242880000,"volumeId":5886,"vmName":"r-1238-VM","accountId":491,"format":"OVA","provisioningType":"THIN","poolId":9,"id":5886,"deviceId":0,"hypervisorType":"VMware","directDownload":false,"deployAsIs":false,"followRedirects":false}},"executeInSequence":true,"options":{},"options2":{},"wait":0,"bypassHostMaintenance":false}]. 2025-07-30 13:06:20,234 DEBUG [c.c.s.r.VmwareStorageProcessor] (DirectAgent-15:[ctx-87b99334, ist-esx08.flexapp360.cloud, job-46562/job-46566, cmd: CopyCommand]) (logid:615fb440) VmwareProcessor instance - create full clone = TRUE 2025-07-30 13:06:20,234 DEBUG [c.c.s.r.VmwareStorageProcessor] (DirectAgent-15:[ctx-87b99334, ist-esx08.flexapp360.cloud, job-46562/job-46566, cmd: CopyCommand]) (logid:615fb440) VmwareProcessor instance - diskProvisioningStrictness = FALSE 2025-07-30 13:06:20,234 INFO [c.c.h.v.r.VmwareResource] (DirectAgent-15:[ctx-87b99334, ist-esx08.flexapp360.cloud, job-46562/job-46566, cmd: CopyCommand]) (logid:615fb440) VmwareStorageProcessor and VmwareStorageSubsystemCommandHandler successfully reconfigured 2025-07-30 13:06:20,234 DEBUG [c.c.s.r.VmwareStorageSubsystemCommandHandler] (DirectAgent-15:[ctx-87b99334, ist-esx08.flexapp360.cloud, job-46562/job-46566, cmd: CopyCommand]) (logid:615fb440) Executing command CopyCommand: [{"srcTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"645a8e530fe4380394fe96e26bc91e9a","origUrl":"https://download.cloudstack.org/systemvm/4.20/systemvmtemplate-4.20.1-x86_64-vmware.ova","uuid":"fd35b75d-3c51-47ff-bef2-93ee4a9170b5","id":289,"format":"OVA","accountId":2,"checksum":"90076ec77bd987a7e8f27756b116ebb8","hvm":true,"displayText":"SystemVM Template v4.20 (vSphere)","imageDataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"8456ae93-49f3-35aa-a6c3-c48b3c3a05f1","name":"PS100T_MUSTERI_NVME","id":9,"poolType":"PreSetup","host":"ist-vc01.flexapp360.cloud","path":"/ISTDC01/PS100T_MUSTERI_NVME","port":0,"url":"PreSetup://ist-vc01.flexapp360.cloud/ISTDC01/PS100T_MUSTERI_NVME/?ROLE=Primary&STOREUUID=8456ae93-49f3-35aa-a6c3-c48b3c3a05f1","isManaged":false}},"name":"289-2-e34a1aa1-3d3b-39ba-8566-4f200b04c36c","size":5242880000,"hypervisorType":"VMware","bootable":false,"uniqueName":"289-2-e34a1aa1-3d3b-39ba-8566-4f200b04c36c","directDownload":false,"deployAsIs":false,"followRedirects":false}},"destTO":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"390b9f39-27f6-46c1-b00e-9886d354303b","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"8456ae93-49f3-35aa-a6c3-c48b3c3a05f1","name":"PS100T_MUSTERI_NVME","id":9,"poolType":"PreSetup","host":"ist-vc01.flexapp360.cloud","path":"/ISTDC01/PS100T_MUSTERI_NVME","port":0,"url":"PreSetup://ist-vc01.flexapp360.cloud/ISTDC01/PS100T_MUSTERI_NVME/?ROLE=Primary&STOREUUID=8456ae93-49f3-35aa-a6c3-c48b3c3a05f1","fullCloneFlag":true,"diskProvisioningStrictnessFlag":false,"isManaged":false}},"name":"ROOT-1238","size":5242880000,"volumeId":5886,"vmName":"r-1238-VM","accountId":491,"format":"OVA","provisioningType":"THIN","poolId":9,"id":5886,"deviceId":0,"hypervisorType":"VMware","directDownload":false,"deployAsIs":false,"followRedirects":false}},"executeInSequence":true,"options":{},"options2":{},"wait":0,"bypassHostMaintenance":false}]. 2025-07-30 13:06:20,338 INFO [c.c.s.r.VmwareStorageProcessor] (DirectAgent-15:[ctx-87b99334, ist-esx08.flexapp360.cloud, job-46562/job-46566, cmd: CopyCommand]) (logid:615fb440) creating full clone from template 2025-07-30 13:06:20,658 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-438ecfa3]) (logid:76917c12) Found 11 inactive management server node based on timestamp 2025-07-30 13:06:20,658 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-438ecfa3]) (logid:76917c12) management server node msid: 2886785035, name: cs01.flexapp360.cloud, service ip: 172.16.216.11, version: 4.19.0.0 2025-07-30 13:06:20,658 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-438ecfa3]) (logid:76917c12) management server node msid: 2886785036, name: cs02.flexapp360.cloud, service ip: 172.16.216.12, version: 4.19.0.0 2025-07-30 13:06:20,658 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-438ecfa3]) (logid:76917c12) management server node msid: 2886785037, name: cs03.flexapp360.cloud, service ip: 172.16.216.13, version: 4.19.0.0 2025-07-30 13:06:20,658 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-438ecfa3]) (logid:76917c12) management server node msid: 2887440395, name: acs01.flexapp360.cloud, service ip: 172.26.216.11, version: 4.19.0.0 2025-07-30 13:06:20,658 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-438ecfa3]) (logid:76917c12) management server node msid: 2130706433, name: localhost, service ip: 172.16.216.11, version: 4.19.0.0 2025-07-30 13:06:20,658 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-438ecfa3]) (logid:76917c12) management server node msid: 345050211425, name: cs02.flexapp360.cloud, service ip: 172.16.216.12, version: 4.20.1.0 2025-07-30 13:06:20,658 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-438ecfa3]) (logid:76917c12) management server node msid: 345050226781, name: cs03.flexapp360.cloud, service ip: 172.16.216.13, version: 4.20.1.0 2025-07-30 13:06:20,658 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-438ecfa3]) (logid:76917c12) management server node msid: 345048713423, name: acs01.flexapp360.cloud, service ip: 172.26.216.11, version: 4.20.0.0 2025-07-30 13:06:20,658 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-438ecfa3]) (logid:76917c12) management server node msid: 345050203477, name: demo.flexapp360.cloud, service ip: 172.16.216.14, version: 4.20.1.0 2025-07-30 13:06:20,658 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-438ecfa3]) (logid:76917c12) management server node msid: 345050189711, name: cs04, service ip: 172.16.216.15, version: 4.20.1.0 2025-07-30 13:06:20,658 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-438ecfa3]) (logid:76917c12) management server node msid: 345050211517, name: csui, service ip: 172.16.216.19, version: 4.20.1.0 2025-07-30 13:06:20,658 DEBUG [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-438ecfa3]) (logid:76917c12) Peer scan is finished. profiler: Done. Duration: 2ms , profilerQueryActiveList: Done. Duration: 0ms, , profilerSyncClusterInfo: Done. Duration: 0ms, profilerInvalidatedNodeList: Done. Duration: 0ms, profilerRemovedList: Done. Duration: 0ms,, profilerNewList: Done. Duration: 0ms, profilerInactiveList: Done. Duration: 0ms 2025-07-30 13:06:20,856 DEBUG [c.c.a.ApiServlet] (qtp939199469-5376:[ctx-479237d5]) (logid:509a0bb3) ===START=== 172.17.250.135 -- GET listall=true&details=group,nics,secgrp,tmpl,servoff,diskoff,iso,volume,affgrp,backoff&isvnf=false&page=1&pagesize=20&showIcon=true&command=listVirtualMachines&response=json&sessionkey=tT5zr5t-kh9cjokdeBn__S6GA_w 2025-07-30 13:06:20,856 DEBUG [c.c.a.ApiServlet] (qtp939199469-5376:[ctx-479237d5]) (logid:509a0bb3) Two factor authentication is already verified for the user 507, so skipping 2025-07-30 13:06:20,862 DEBUG [c.c.a.ApiServer] (qtp939199469-5376:[ctx-479237d5, ctx-51e15bad]) (logid:509a0bb3) CIDRs from which account 'Account [{"accountName":"omur.ozlu","id":491,"uuid":"24ded954-9f50-4e6b-a332-6c58088d84c4"}]' is allowed to perform API calls: 0.0.0.0/0,::/0 2025-07-30 13:06:20,869 DEBUG [o.a.c.a.StaticRoleBasedAPIAccessChecker] (qtp939199469-5376:[ctx-479237d5, ctx-51e15bad]) (logid:509a0bb3) RoleService is enabled. We will use it instead of StaticRoleBasedAPIAccessChecker. 2025-07-30 13:06:20,869 DEBUG [o.a.c.r.ApiRateLimitServiceImpl] (qtp939199469-5376:[ctx-479237d5, ctx-51e15bad]) (logid:509a0bb3) API rate limiting is disabled. We will not use ApiRateLimitService. 2025-07-30 13:06:20,904 INFO [a.c.c.a.ApiServlet] (qtp939199469-5376:[ctx-479237d5, ctx-51e15bad]) (logid:509a0bb3) (userId=507 accountId=491 sessionId=node0ri1fbmg3kgudzfs62oxq5v7t8) 172.17.250.135 -- GET listall=true&details=group,nics,secgrp,tmpl,servoff,diskoff,iso,volume,affgrp,backoff&isvnf=false&page=1&pagesize=20&showIcon=true&command=listVirtualMachines&response=json&sessionkey=tT5zr5t-kh9cjokdeBn__S6GA_w 200 {"listvirtualmachinesresponse":{"count":2,"virtualmachine":[{"id":"912630d6-5aa8-4289-89f8-f0242da07cbd","name":"Test01","displayname":"Test01","account":"omur.ozlu","userid":"910a89cf-5640-48d4-bbe4-6eec6c145ba8","username":"omur.ozlu","domainid":"omurozlu.com","domain":"omurozlu.com","domainpath":"/omurozlu.com/","created":"2025-07-30T13:03:31+0300","lastupdated":"2025-07-30T13:05:53+0300","state":"Running","haenable":false,"zoneid":"36a59d65-2c25-403c-997b-3b3f7997cc8a","zonename":"IST01","hostcontrolstate":"Enabled","templateid":"66d273c6-85da-43b4-901b-ae667ef1819e","templatename":"Windows Server 2022 [ENG]","templatetype":"USER","templateformat":"ISO","templatedisplaytext":"Windows Server 2022 [ENG]","passwordenabled":false,"isoid":"66d273c6-85da-43b4-901b-ae667ef1819e","isoname":"Windows Server 2022 [ENG]","isodisplaytext":"Windows Server 2022 [ENG]","serviceofferingid":"cdfe7ddf-8554-485e-9a4c-ec66f99a844e","serviceofferingname":"Custom","diskofferingid":"f9a05132-1a9b-4408-8ce7-d7962c420b97","diskofferingname":"Custom-NVME-3","cpunumber":8,"cpuspeed":1000,"memory":16384,"guestosid":"0e6a048d-e76c-11ee-89f3-00505698c91f","rootdeviceid":0,"rootdevicetype":"ROOT","securitygroup":[],"nic":[{"id":"ad3fbb9c-308d-4166-b457-d8e1733c9101","networkid":"2525d51c-052e-429f-8e6d-52b66d324a62","networkname":"OM-LAN","isolationuri":"vlan://1007","broadcasturi":"vlan://1007","traffictype":"Guest","type":"L2","isdefault":true,"macaddress":"02:01:02:f8:00:04","secondaryip":[],"extradhcpoption":[],"deviceid":"0"}],"hypervisor":"VMware","details":{"cpuNumber":"8","dataDiskController":"osdefault","memory":"16384","cpuSpeed":"1000","rootDiskController":"ide"},"readonlydetails":"dataDiskController, rootDiskController","affinitygroup":[],"isdynamicallyscalable":false,"deleteprotection":false,"ostypeid":"0e6a048d-e76c-11ee-89f3-00505698c91f","osdisplayname":"Windows Server 2022 (64-bit)","pooltype":"PreSetup","receivedbytes":0,"sentbytes":0,"tags":[],"hasannotations":false},{"id":"5865e9a8-c4f1-4760-a345-c9f3eeb0146a","name":"Test02","displayname":"Test02","account":"omur.ozlu","userid":"910a89cf-5640-48d4-bbe4-6eec6c145ba8","username":"omur.ozlu","domainid":"omurozlu.com","domain":"omurozlu.com","domainpath":"/omurozlu.com/","created":"2025-07-30T13:06:17+0300","lastupdated":"2025-07-30T13:06:18+0300","state":"Starting","haenable":false,"zoneid":"36a59d65-2c25-403c-997b-3b3f7997cc8a","zonename":"IST01","hostcontrolstate":"Enabled","templateid":"66d273c6-85da-43b4-901b-ae667ef1819e","templatename":"Windows Server 2022 [ENG]","templatetype":"USER","templateformat":"ISO","templatedisplaytext":"Windows Server 2022 [ENG]","passwordenabled":false,"isoid":"66d273c6-85da-43b4-901b-ae667ef1819e","isoname":"Windows Server 2022 [ENG]","isodisplaytext":"Windows Server 2022 [ENG]","serviceofferingid":"cdfe7ddf-8554-485e-9a4c-ec66f99a844e","serviceofferingname":"Custom","diskofferingid":"f9a05132-1a9b-4408-8ce7-d7962c420b97","diskofferingname":"Custom-NVME-3","cpunumber":8,"cpuspeed":1000,"memory":8192,"guestosid":"0e6a048d-e76c-11ee-89f3-00505698c91f","rootdeviceid":0,"rootdevicetype":"ROOT","securitygroup":[],"nic":[{"id":"f1b53625-f4ea-4f70-ac24-4f26253083d3","networkid":"34c6b263-a9f2-4d19-8d42-b390166f09a6","networkname":"omur.ozlu-network","netmask":"255.255.255.0","gateway":"10.1.1.1","ipaddress":"10.1.1.60","traffictype":"Guest","type":"Isolated","isdefault":true,"macaddress":"02:01:03:1e:00:01","secondaryip":[],"extradhcpoption":[],"deviceid":"0"}],"hypervisor":"VMware","ipaddress":"10.1.1.60","details":{"cpuNumber":"8","deployvm":"true","dataDiskController":"osdefault","memory":"8192","cpuSpeed":"1000","rootDiskController":"ide"},"readonlydetails":"dataDiskController, rootDiskController","affinitygroup":[],"isdynamicallyscalable":false,"deleteprotection":false,"ostypeid":"0e6a048d-e76c-11ee-89f3-00505698c91f","osdisplayname":"Windows Server 2022 (64-bit)","receivedbytes":0,"sentbytes":0,"tags":[],"hasannotations":false,"jobid":"615fb440-0f6e-4ca7-af8d-3069603698ff","jobstatus":0}]}} 2025-07-30 13:06:20,904 DEBUG [c.c.a.ApiServlet] (qtp939199469-5376:[ctx-479237d5, ctx-51e15bad]) (logid:509a0bb3) ===END=== 172.17.250.135 -- GET listall=true&details=group,nics,secgrp,tmpl,servoff,diskoff,iso,volume,affgrp,backoff&isvnf=false&page=1&pagesize=20&showIcon=true&command=listVirtualMachines&response=json&sessionkey=tT5zr5t-kh9cjokdeBn__S6GA_w 2025-07-30 13:06:20,908 DEBUG [c.c.a.ApiServlet] (qtp939199469-4882:[ctx-a28a8617]) (logid:88e3e4bc) ===START=== 172.17.250.135 -- GET listall=true&details=group,nics,secgrp,tmpl,servoff,diskoff,iso,volume,affgrp,backoff&isvnf=false&page=1&pagesize=20&showIcon=true&command=listVirtualMachines&response=json&sessionkey=tT5zr5t-kh9cjokdeBn__S6GA_w 2025-07-30 13:06:20,908 DEBUG [c.c.a.ApiServlet] (qtp939199469-4882:[ctx-a28a8617]) (logid:88e3e4bc) Two factor authentication is already verified for the user 507, so skipping 2025-07-30 13:06:20,913 DEBUG [c.c.a.ApiServer] (qtp939199469-4882:[ctx-a28a8617, ctx-77065433]) (logid:88e3e4bc) CIDRs from which account 'Account [{"accountName":"omur.ozlu","id":491,"uuid":"24ded954-9f50-4e6b-a332-6c58088d84c4"}]' is allowed to perform API calls: 0.0.0.0/0,::/0 2025-07-30 13:06:20,918 DEBUG [o.a.c.a.StaticRoleBasedAPIAccessChecker] (qtp939199469-4882:[ctx-a28a8617, ctx-77065433]) (logid:88e3e4bc) RoleService is enabled. We will use it instead of StaticRoleBasedAPIAccessChecker. 2025-07-30 13:06:20,918 DEBUG [o.a.c.r.ApiRateLimitServiceImpl] (qtp939199469-4882:[ctx-a28a8617, ctx-77065433]) (logid:88e3e4bc) API rate limiting is disabled. We will not use ApiRateLimitService. 2025-07-30 13:06:20,948 INFO [a.c.c.a.ApiServlet] (qtp939199469-4882:[ctx-a28a8617, ctx-77065433]) (logid:88e3e4bc) (userId=507 accountId=491 sessionId=node0ri1fbmg3kgudzfs62oxq5v7t8) 172.17.250.135 -- GET listall=true&details=group,nics,secgrp,tmpl,servoff,diskoff,iso,volume,affgrp,backoff&isvnf=false&page=1&pagesize=20&showIcon=true&command=listVirtualMachines&response=json&sessionkey=tT5zr5t-kh9cjokdeBn__S6GA_w 200 {"listvirtualmachinesresponse":{"count":2,"virtualmachine":[{"id":"912630d6-5aa8-4289-89f8-f0242da07cbd","name":"Test01","displayname":"Test01","account":"omur.ozlu","userid":"910a89cf-5640-48d4-bbe4-6eec6c145ba8","username":"omur.ozlu","domainid":"omurozlu.com","domain":"omurozlu.com","domainpath":"/omurozlu.com/","created":"2025-07-30T13:03:31+0300","lastupdated":"2025-07-30T13:05:53+0300","state":"Running","haenable":false,"zoneid":"36a59d65-2c25-403c-997b-3b3f7997cc8a","zonename":"IST01","hostcontrolstate":"Enabled","templateid":"66d273c6-85da-43b4-901b-ae667ef1819e","templatename":"Windows Server 2022 [ENG]","templatetype":"USER","templateformat":"ISO","templatedisplaytext":"Windows Server 2022 [ENG]","passwordenabled":false,"isoid":"66d273c6-85da-43b4-901b-ae667ef1819e","isoname":"Windows Server 2022 [ENG]","isodisplaytext":"Windows Server 2022 [ENG]","serviceofferingid":"cdfe7ddf-8554-485e-9a4c-ec66f99a844e","serviceofferingname":"Custom","diskofferingid":"f9a05132-1a9b-4408-8ce7-d7962c420b97","diskofferingname":"Custom-NVME-3","cpunumber":8,"cpuspeed":1000,"memory":16384,"guestosid":"0e6a048d-e76c-11ee-89f3-00505698c91f","rootdeviceid":0,"rootdevicetype":"ROOT","securitygroup":[],"nic":[{"id":"ad3fbb9c-308d-4166-b457-d8e1733c9101","networkid":"2525d51c-052e-429f-8e6d-52b66d324a62","networkname":"OM-LAN","isolationuri":"vlan://1007","broadcasturi":"vlan://1007","traffictype":"Guest","type":"L2","isdefault":true,"macaddress":"02:01:02:f8:00:04","secondaryip":[],"extradhcpoption":[],"deviceid":"0"}],"hypervisor":"VMware","details":{"cpuNumber":"8","dataDiskController":"osdefault","memory":"16384","cpuSpeed":"1000","rootDiskController":"ide"},"readonlydetails":"dataDiskController, rootDiskController","affinitygroup":[],"isdynamicallyscalable":false,"deleteprotection":false,"ostypeid":"0e6a048d-e76c-11ee-89f3-00505698c91f","osdisplayname":"Windows Server 2022 (64-bit)","pooltype":"PreSetup","receivedbytes":0,"sentbytes":0,"tags":[],"hasannotations":false},{"id":"5865e9a8-c4f1-4760-a345-c9f3eeb0146a","name":"Test02","displayname":"Test02","account":"omur.ozlu","userid":"910a89cf-5640-48d4-bbe4-6eec6c145ba8","username":"omur.ozlu","domainid":"omurozlu.com","domain":"omurozlu.com","domainpath":"/omurozlu.com/","created":"2025-07-30T13:06:17+0300","lastupdated":"2025-07-30T13:06:18+0300","state":"Starting","haenable":false,"zoneid":"36a59d65-2c25-403c-997b-3b3f7997cc8a","zonename":"IST01","hostcontrolstate":"Enabled","templateid":"66d273c6-85da-43b4-901b-ae667ef1819e","templatename":"Windows Server 2022 [ENG]","templatetype":"USER","templateformat":"ISO","templatedisplaytext":"Windows Server 2022 [ENG]","passwordenabled":false,"isoid":"66d273c6-85da-43b4-901b-ae667ef1819e","isoname":"Windows Server 2022 [ENG]","isodisplaytext":"Windows Server 2022 [ENG]","serviceofferingid":"cdfe7ddf-8554-485e-9a4c-ec66f99a844e","serviceofferingname":"Custom","diskofferingid":"f9a05132-1a9b-4408-8ce7-d7962c420b97","diskofferingname":"Custom-NVME-3","cpunumber":8,"cpuspeed":1000,"memory":8192,"guestosid":"0e6a048d-e76c-11ee-89f3-00505698c91f","rootdeviceid":0,"rootdevicetype":"ROOT","securitygroup":[],"nic":[{"id":"f1b53625-f4ea-4f70-ac24-4f26253083d3","networkid":"34c6b263-a9f2-4d19-8d42-b390166f09a6","networkname":"omur.ozlu-network","netmask":"255.255.255.0","gateway":"10.1.1.1","ipaddress":"10.1.1.60","traffictype":"Guest","type":"Isolated","isdefault":true,"macaddress":"02:01:03:1e:00:01","secondaryip":[],"extradhcpoption":[],"deviceid":"0"}],"hypervisor":"VMware","ipaddress":"10.1.1.60","details":{"cpuNumber":"8","deployvm":"true","dataDiskController":"osdefault","memory":"8192","cpuSpeed":"1000","rootDiskController":"ide"},"readonlydetails":"dataDiskController, rootDiskController","affinitygroup":[],"isdynamicallyscalable":false,"deleteprotection":false,"ostypeid":"0e6a048d-e76c-11ee-89f3-00505698c91f","osdisplayname":"Windows Server 2022 (64-bit)","receivedbytes":0,"sentbytes":0,"tags":[],"hasannotations":false,"jobid":"615fb440-0f6e-4ca7-af8d-3069603698ff","jobstatus":0}]}} 2025-07-30 13:06:20,948 DEBUG [c.c.a.ApiServlet] (qtp939199469-4882:[ctx-a28a8617, ctx-77065433]) (logid:88e3e4bc) ===END=== 172.17.250.135 -- GET listall=true&details=group,nics,secgrp,tmpl,servoff,diskoff,iso,volume,affgrp,backoff&isvnf=false&page=1&pagesize=20&showIcon=true&command=listVirtualMachines&response=json&sessionkey=tT5zr5t-kh9cjokdeBn__S6GA_w 2025-07-30 13:06:20,992 DEBUG [c.c.a.ApiServlet] (qtp939199469-5376:[ctx-3eb79165]) (logid:d99ae818) ===START=== 172.17.250.135 -- GET jobId=615fb440-0f6e-4ca7-af8d-3069603698ff&command=queryAsyncJobResult&response=json&sessionkey=tT5zr5t-kh9cjokdeBn__S6GA_w 2025-07-30 13:06:20,992 DEBUG [c.c.a.ApiServlet] (qtp939199469-5376:[ctx-3eb79165]) (logid:d99ae818) Two factor authentication is already verified for the user 507, so skipping 2025-07-30 13:06:20,998 DEBUG [c.c.a.ApiServer] (qtp939199469-5376:[ctx-3eb79165, ctx-bc84051d]) (logid:d99ae818) CIDRs from which account 'Account [{"accountName":"omur.ozlu","id":491,"uuid":"24ded954-9f50-4e6b-a332-6c58088d84c4"}]' is allowed to perform API calls: 0.0.0.0/0,::/0 2025-07-30 13:06:21,004 DEBUG [o.a.c.a.StaticRoleBasedAPIAccessChecker] (qtp939199469-5376:[ctx-3eb79165, ctx-bc84051d]) (logid:d99ae818) RoleService is enabled. We will use it instead of StaticRoleBasedAPIAccessChecker. 2025-07-30 13:06:21,004 DEBUG [o.a.c.r.ApiRateLimitServiceImpl] (qtp939199469-5376:[ctx-3eb79165, ctx-bc84051d]) (logid:d99ae818) API rate limiting is disabled. We will not use ApiRateLimitService. 2025-07-30 13:06:21,010 DEBUG [c.c.u.AccountManagerImpl] (qtp939199469-5376:[ctx-3eb79165, ctx-bc84051d]) (logid:d99ae818) Access to Account [{"accountName":"omur.ozlu","id":491,"uuid":"24ded954-9f50-4e6b-a332-6c58088d84c4"}] granted to Account [{"accountName":"omur.ozlu","id":491,"uuid":"24ded954-9f50-4e6b-a332-6c58088d84c4"}] by DomainChecker on behalf of user omur.ozlu 2025-07-30 13:06:21,027 INFO [a.c.c.a.ApiServlet] (qtp939199469-5376:[ctx-3eb79165, ctx-bc84051d]) (logid:d99ae818) (userId=507 accountId=491 sessionId=node0ri1fbmg3kgudzfs62oxq5v7t8) 172.17.250.135 -- GET jobId=615fb440-0f6e-4ca7-af8d-3069603698ff&command=queryAsyncJobResult&response=json&sessionkey=tT5zr5t-kh9cjokdeBn__S6GA_w 200 {"queryasyncjobresultresponse":{"accountid":"24ded954-9f50-4e6b-a332-6c58088d84c4","account":"omur.ozlu","domainid":"omurozlu.com","domainpath":"ROOT/omurozlu.com","userid":"910a89cf-5640-48d4-bbe4-6eec6c145ba8","cmd":"org.apache.cloudstack.api.command.user.vm.DeployVMCmd","jobstatus":0,"jobprocstatus":0,"jobresultcode":0,"jobinstancetype":"VirtualMachine","jobinstanceid":"5865e9a8-c4f1-4760-a345-c9f3eeb0146a","managementserverid":345050216744,"created":"2025-07-30T13:06:17+0300","jobid":"615fb440-0f6e-4ca7-af8d-3069603698ff"}} 2025-07-30 13:06:21,027 DEBUG [c.c.a.ApiServlet] (qtp939199469-5376:[ctx-3eb79165, ctx-bc84051d]) (logid:d99ae818) ===END=== 172.17.250.135 -- GET jobId=615fb440-0f6e-4ca7-af8d-3069603698ff&command=queryAsyncJobResult&response=json&sessionkey=tT5zr5t-kh9cjokdeBn__S6GA_w 2025-07-30 13:06:21,801 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] (AgentManager-Handler-8:[]) (logid:) SeqA 45-131789: Seq 45-131789: { Cmd , MgmtId: -1, via: 45, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":"4","_loadInfo":"{ "connections": [], "removedSessions": [] }","wait":"0","bypassHostMaintenance":"false"}}] } 2025-07-30 13:06:21,817 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] (AgentManager-Handler-8:[]) (logid:) SeqA 45-: Sending 131789 2025-07-30 13:06:22,159 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-f434b937]) (logid:48a85965) Found 11 inactive management server node based on timestamp 2025-07-30 13:06:22,159 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-f434b937]) (logid:48a85965) management server node msid: 2886785035, name: cs01.flexapp360.cloud, service ip: 172.16.216.11, version: 4.19.0.0 2025-07-30 13:06:22,159 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-f434b937]) (logid:48a85965) management server node msid: 2886785036, name: cs02.flexapp360.cloud, service ip: 172.16.216.12, version: 4.19.0.0 2025-07-30 13:06:22,159 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-f434b937]) (logid:48a85965) management server node msid: 2886785037, name: cs03.flexapp360.cloud, service ip: 172.16.216.13, version: 4.19.0.0 2025-07-30 13:06:22,159 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-f434b937]) (logid:48a85965) management server node msid: 2887440395, name: acs01.flexapp360.cloud, service ip: 172.26.216.11, version: 4.19.0.0 2025-07-30 13:06:22,159 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-f434b937]) (logid:48a85965) management server node msid: 2130706433, name: localhost, service ip: 172.16.216.11, version: 4.19.0.0 2025-07-30 13:06:22,159 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-f434b937]) (logid:48a85965) management server node msid: 345050211425, name: cs02.flexapp360.cloud, service ip: 172.16.216.12, version: 4.20.1.0 2025-07-30 13:06:22,159 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-f434b937]) (logid:48a85965) management server node msid: 345050226781, name: cs03.flexapp360.cloud, service ip: 172.16.216.13, version: 4.20.1.0 2025-07-30 13:06:22,159 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-f434b937]) (logid:48a85965) management server node msid: 345048713423, name: acs01.flexapp360.cloud, service ip: 172.26.216.11, version: 4.20.0.0 2025-07-30 13:06:22,159 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-f434b937]) (logid:48a85965) management server node msid: 345050203477, name: demo.flexapp360.cloud, service ip: 172.16.216.14, version: 4.20.1.0 2025-07-30 13:06:22,159 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-f434b937]) (logid:48a85965) management server node msid: 345050189711, name: cs04, service ip: 172.16.216.15, version: 4.20.1.0 2025-07-30 13:06:22,159 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-f434b937]) (logid:48a85965) management server node msid: 345050211517, name: csui, service ip: 172.16.216.19, version: 4.20.1.0 2025-07-30 13:06:22,159 DEBUG [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-f434b937]) (logid:48a85965) Peer scan is finished. profiler: Done. Duration: 3ms , profilerQueryActiveList: Done. Duration: 0ms, , profilerSyncClusterInfo: Done. Duration: 0ms, profilerInvalidatedNodeList: Done. Duration: 0ms, profilerRemovedList: Done. Duration: 0ms,, profilerNewList: Done. Duration: 0ms, profilerInactiveList: Done. Duration: 1ms 2025-07-30 13:06:23,659 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-f7399341]) (logid:065fb090) Found 11 inactive management server node based on timestamp 2025-07-30 13:06:23,660 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-f7399341]) (logid:065fb090) management server node msid: 2886785035, name: cs01.flexapp360.cloud, service ip: 172.16.216.11, version: 4.19.0.0 2025-07-30 13:06:23,660 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-f7399341]) (logid:065fb090) management server node msid: 2886785036, name: cs02.flexapp360.cloud, service ip: 172.16.216.12, version: 4.19.0.0 2025-07-30 13:06:23,660 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-f7399341]) (logid:065fb090) management server node msid: 2886785037, name: cs03.flexapp360.cloud, service ip: 172.16.216.13, version: 4.19.0.0 2025-07-30 13:06:23,660 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-f7399341]) (logid:065fb090) management server node msid: 2887440395, name: acs01.flexapp360.cloud, service ip: 172.26.216.11, version: 4.19.0.0 2025-07-30 13:06:23,660 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-f7399341]) (logid:065fb090) management server node msid: 2130706433, name: localhost, service ip: 172.16.216.11, version: 4.19.0.0 2025-07-30 13:06:23,660 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-f7399341]) (logid:065fb090) management server node msid: 345050211425, name: cs02.flexapp360.cloud, service ip: 172.16.216.12, version: 4.20.1.0 2025-07-30 13:06:23,660 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-f7399341]) (logid:065fb090) management server node msid: 345050226781, name: cs03.flexapp360.cloud, service ip: 172.16.216.13, version: 4.20.1.0 2025-07-30 13:06:23,660 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-f7399341]) (logid:065fb090) management server node msid: 345048713423, name: acs01.flexapp360.cloud, service ip: 172.26.216.11, version: 4.20.0.0 2025-07-30 13:06:23,660 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-f7399341]) (logid:065fb090) management server node msid: 345050203477, name: demo.flexapp360.cloud, service ip: 172.16.216.14, version: 4.20.1.0 2025-07-30 13:06:23,660 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-f7399341]) (logid:065fb090) management server node msid: 345050189711, name: cs04, service ip: 172.16.216.15, version: 4.20.1.0 2025-07-30 13:06:23,660 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-f7399341]) (logid:065fb090) management server node msid: 345050211517, name: csui, service ip: 172.16.216.19, version: 4.20.1.0 2025-07-30 13:06:23,660 DEBUG [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-f7399341]) (logid:065fb090) Peer scan is finished. profiler: Done. Duration: 3ms , profilerQueryActiveList: Done. Duration: 0ms, , profilerSyncClusterInfo: Done. Duration: 0ms, profilerInvalidatedNodeList: Done. Duration: 0ms, profilerRemovedList: Done. Duration: 0ms,, profilerNewList: Done. Duration: 0ms, profilerInactiveList: Done. Duration: 1ms 2025-07-30 13:06:23,978 DEBUG [o.a.c.h.H.HAManagerBgPollTask] (BackgroundTaskPollManager-6:[ctx-bd69a0b0]) (logid:a10da5e2) HA health check task is running... 2025-07-30 13:06:24,034 DEBUG [c.c.a.ApiServlet] (qtp939199469-4882:[ctx-fba9425f]) (logid:83b1ec8c) ===START=== 172.17.250.135 -- GET jobId=615fb440-0f6e-4ca7-af8d-3069603698ff&command=queryAsyncJobResult&response=json&sessionkey=tT5zr5t-kh9cjokdeBn__S6GA_w 2025-07-30 13:06:24,035 DEBUG [c.c.a.ApiServlet] (qtp939199469-4882:[ctx-fba9425f]) (logid:83b1ec8c) Two factor authentication is already verified for the user 507, so skipping 2025-07-30 13:06:24,041 DEBUG [c.c.a.ApiServer] (qtp939199469-4882:[ctx-fba9425f, ctx-cf534236]) (logid:83b1ec8c) CIDRs from which account 'Account [{"accountName":"omur.ozlu","id":491,"uuid":"24ded954-9f50-4e6b-a332-6c58088d84c4"}]' is allowed to perform API calls: 0.0.0.0/0,::/0 2025-07-30 13:06:24,046 DEBUG [o.a.c.a.StaticRoleBasedAPIAccessChecker] (qtp939199469-4882:[ctx-fba9425f, ctx-cf534236]) (logid:83b1ec8c) RoleService is enabled. We will use it instead of StaticRoleBasedAPIAccessChecker. 2025-07-30 13:06:24,046 DEBUG [o.a.c.r.ApiRateLimitServiceImpl] (qtp939199469-4882:[ctx-fba9425f, ctx-cf534236]) (logid:83b1ec8c) API rate limiting is disabled. We will not use ApiRateLimitService. 2025-07-30 13:06:24,053 DEBUG [c.c.u.AccountManagerImpl] (qtp939199469-4882:[ctx-fba9425f, ctx-cf534236]) (logid:83b1ec8c) Access to Account [{"accountName":"omur.ozlu","id":491,"uuid":"24ded954-9f50-4e6b-a332-6c58088d84c4"}] granted to Account [{"accountName":"omur.ozlu","id":491,"uuid":"24ded954-9f50-4e6b-a332-6c58088d84c4"}] by DomainChecker on behalf of user omur.ozlu 2025-07-30 13:06:24,072 INFO [a.c.c.a.ApiServlet] (qtp939199469-4882:[ctx-fba9425f, ctx-cf534236]) (logid:83b1ec8c) (userId=507 accountId=491 sessionId=node0ri1fbmg3kgudzfs62oxq5v7t8) 172.17.250.135 -- GET jobId=615fb440-0f6e-4ca7-af8d-3069603698ff&command=queryAsyncJobResult&response=json&sessionkey=tT5zr5t-kh9cjokdeBn__S6GA_w 200 {"queryasyncjobresultresponse":{"accountid":"24ded954-9f50-4e6b-a332-6c58088d84c4","account":"omur.ozlu","domainid":"omurozlu.com","domainpath":"ROOT/omurozlu.com","userid":"910a89cf-5640-48d4-bbe4-6eec6c145ba8","cmd":"org.apache.cloudstack.api.command.user.vm.DeployVMCmd","jobstatus":0,"jobprocstatus":0,"jobresultcode":0,"jobinstancetype":"VirtualMachine","jobinstanceid":"5865e9a8-c4f1-4760-a345-c9f3eeb0146a","managementserverid":345050216744,"created":"2025-07-30T13:06:17+0300","jobid":"615fb440-0f6e-4ca7-af8d-3069603698ff"}} 2025-07-30 13:06:24,072 DEBUG [c.c.a.ApiServlet] (qtp939199469-4882:[ctx-fba9425f, ctx-cf534236]) (logid:83b1ec8c) ===END=== 172.17.250.135 -- GET jobId=615fb440-0f6e-4ca7-af8d-3069603698ff&command=queryAsyncJobResult&response=json&sessionkey=tT5zr5t-kh9cjokdeBn__S6GA_w 2025-07-30 13:06:25,159 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-76a19f62]) (logid:933ffa7e) Found 11 inactive management server node based on timestamp 2025-07-30 13:06:25,159 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-76a19f62]) (logid:933ffa7e) management server node msid: 2886785035, name: cs01.flexapp360.cloud, service ip: 172.16.216.11, version: 4.19.0.0 2025-07-30 13:06:25,159 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-76a19f62]) (logid:933ffa7e) management server node msid: 2886785036, name: cs02.flexapp360.cloud, service ip: 172.16.216.12, version: 4.19.0.0 2025-07-30 13:06:25,159 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-76a19f62]) (logid:933ffa7e) management server node msid: 2886785037, name: cs03.flexapp360.cloud, service ip: 172.16.216.13, version: 4.19.0.0 2025-07-30 13:06:25,159 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-76a19f62]) (logid:933ffa7e) management server node msid: 2887440395, name: acs01.flexapp360.cloud, service ip: 172.26.216.11, version: 4.19.0.0 2025-07-30 13:06:25,159 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-76a19f62]) (logid:933ffa7e) management server node msid: 2130706433, name: localhost, service ip: 172.16.216.11, version: 4.19.0.0 2025-07-30 13:06:25,159 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-76a19f62]) (logid:933ffa7e) management server node msid: 345050211425, name: cs02.flexapp360.cloud, service ip: 172.16.216.12, version: 4.20.1.0 2025-07-30 13:06:25,159 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-76a19f62]) (logid:933ffa7e) management server node msid: 345050226781, name: cs03.flexapp360.cloud, service ip: 172.16.216.13, version: 4.20.1.0 2025-07-30 13:06:25,159 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-76a19f62]) (logid:933ffa7e) management server node msid: 345048713423, name: acs01.flexapp360.cloud, service ip: 172.26.216.11, version: 4.20.0.0 2025-07-30 13:06:25,159 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-76a19f62]) (logid:933ffa7e) management server node msid: 345050203477, name: demo.flexapp360.cloud, service ip: 172.16.216.14, version: 4.20.1.0 2025-07-30 13:06:25,159 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-76a19f62]) (logid:933ffa7e) management server node msid: 345050189711, name: cs04, service ip: 172.16.216.15, version: 4.20.1.0 2025-07-30 13:06:25,159 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-76a19f62]) (logid:933ffa7e) management server node msid: 345050211517, name: csui, service ip: 172.16.216.19, version: 4.20.1.0 2025-07-30 13:06:25,159 DEBUG [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-76a19f62]) (logid:933ffa7e) Peer scan is finished. profiler: Done. Duration: 3ms , profilerQueryActiveList: Done. Duration: 1ms, , profilerSyncClusterInfo: Done. Duration: 0ms, profilerInvalidatedNodeList: Done. Duration: 0ms, profilerRemovedList: Done. Duration: 0ms,, profilerNewList: Done. Duration: 0ms, profilerInactiveList: Done. Duration: 1ms 2025-07-30 13:06:26,092 DEBUG [c.c.a.ApiServlet] (qtp939199469-5740:[ctx-4526b54c]) (logid:161dbce0) ===START=== 172.17.250.135 -- POST 2025-07-30 13:06:26,092 DEBUG [c.c.a.ApiServlet] (qtp939199469-5740:[ctx-4526b54c]) (logid:161dbce0) Two factor authentication is already verified for the user 507, so skipping 2025-07-30 13:06:26,097 DEBUG [c.c.a.ApiServer] (qtp939199469-5740:[ctx-4526b54c, ctx-3d036f41]) (logid:161dbce0) CIDRs from which account 'Account [{"accountName":"omur.ozlu","id":491,"uuid":"24ded954-9f50-4e6b-a332-6c58088d84c4"}]' is allowed to perform API calls: 0.0.0.0/0,::/0 2025-07-30 13:06:26,102 DEBUG [o.a.c.a.StaticRoleBasedAPIAccessChecker] (qtp939199469-5740:[ctx-4526b54c, ctx-3d036f41]) (logid:161dbce0) RoleService is enabled. We will use it instead of StaticRoleBasedAPIAccessChecker. 2025-07-30 13:06:26,103 DEBUG [o.a.c.r.ApiRateLimitServiceImpl] (qtp939199469-5740:[ctx-4526b54c, ctx-3d036f41]) (logid:161dbce0) API rate limiting is disabled. We will not use ApiRateLimitService. 2025-07-30 13:06:26,174 INFO [a.c.c.a.ApiServlet] (qtp939199469-5740:[ctx-4526b54c, ctx-3d036f41]) (logid:161dbce0) (userId=507 accountId=491 sessionId=node0d8ifg11oub291cpyh3c0672bm6) 172.17.250.135 -- POST 200 {"listnetworksresponse":{"count":3,"network":[{"id":"34c6b263-a9f2-4d19-8d42-b390166f09a6","name":"omur.ozlu-network","displaytext":"omur.ozlu-network","broadcastdomaintype":"Vlan","traffictype":"Guest","gateway":"10.1.1.1","netmask":"255.255.255.0","cidr":"10.1.1.0/24","zoneid":"36a59d65-2c25-403c-997b-3b3f7997cc8a","zonename":"IST01","networkofferingid":"cc37a489-d755-4abe-809f-283850ca1f3f","networkofferingname":"DefaultIsolatedNetworkOfferingWithSourceNatService","networkofferingdisplaytext":"Offering for Isolated networks with Source Nat service enabled","networkofferingconservemode":true,"networkofferingavailability":"Required","issystem":false,"state":"Implementing","related":"34c6b263-a9f2-4d19-8d42-b390166f09a6","dns1":"8.8.8.8","dns2":"1.1.1.1","type":"Isolated","acltype":"Account","account":"omur.ozlu","domainid":"omurozlu.com","domain":"omurozlu.com","domainpath":"/omurozlu.com/","service":[{"name":"Vpn","provider":[{"name":"VirtualRouter"}],"capability":[{"name":"VpnTypes","value":"remoteaccessvpn","canchooseservicecapability":false},{"name":"SupportedVpnTypes","value":"pptp,l2tp,ipsec","canchooseservicecapability":false}]},{"name":"Lb","provider":[{"name":"VirtualRouter"}],"capability":[{"name":"SupportedProtocols","value":"tcp, udp, tcp-proxy","canchooseservicecapability":false},{"name":"SupportedStickinessMethods","value":"[{\"methodname\":\"LbCookie\",\"paramlist\":[{\"paramname\":\"cookie-name\",\"required\":false,\"isflag\":false,\"description\":\" \"},{\"paramname\":\"mode\",\"required\":false,\"isflag\":false,\"description\":\" \"},{\"paramname\":\"nocache\",\"required\":false,\"isflag\":true,\"description\":\" \"},{\"paramname\":\"indirect\",\"required\":false,\"isflag\":true,\"description\":\" \"},{\"paramname\":\"postonly\",\"required\":false,\"isflag\":true,\"description\":\" \"},{\"paramname\":\"domain\",\"required\":false,\"isflag\":false,\"description\":\" \"}],\"description\":\"This is loadbalancer cookie based stickiness method.\"},{\"methodname\":\"AppCookie\",\"paramlist\":[{\"paramname\":\"cookie-name\",\"required\":false,\"isflag\":false,\"description\":\" \"},{\"paramname\":\"length\",\"required\":false,\"isflag\":false,\"description\":\" \"},{\"paramname\":\"holdtime\",\"required\":false,\"isflag\":false,\"description\":\" \"},{\"paramname\":\"request-learn\",\"required\":false,\"isflag\":true,\"description\":\" \"},{\"paramname\":\"prefix\",\"required\":false,\"isflag\":true,\"description\":\" \"},{\"paramname\":\"mode\",\"required\":false,\"isflag\":false,\"description\":\" \"}],\"description\":\"This is App session based sticky method. Define session stickiness on an existing application cookie. It can be used only for a specific http traffic\"},{\"methodname\":\"SourceBased\",\"paramlist\":[{\"paramname\":\"tablesize\",\"required\":false,\"isflag\":false,\"description\":\" \"},{\"paramname\":\"expire\",\"required\":false,\"isflag\":false,\"description\":\" \"}],\"description\":\"This is source based Stickiness method, it can be used for any type of protocol.\"}]","canchooseservicecapability":false},{"name":"VmAutoScaling","value":"true","canchooseservicecapability":false},{"name":"SupportedLBIsolation","value":"dedicated","canchooseservicecapability":true},{"name":"SupportedLbAlgorithms","value":"roundrobin,leastconn,source","canchooseservicecapability":false},{"name":"LbSchemes","value":"Public","canchooseservicecapability":false},{"name":"AutoScaleCounters","value":"[{\"methodname\":\"CPU\",\"paramlist\":[]},{\"methodname\":\"MEMORY\",\"paramlist\":[]},{\"methodname\":\"VIRTUALROUTER\",\"paramlist\":[]}]","canchooseservicecapability":false},{"name":"ElasticLb","value":"false","canchooseservicecapability":false},{"name":"InlineMode","value":"false","canchooseservicecapability":false}]},{"name":"StaticNat","provider":[{"name":"VirtualRouter"}],"capability":[{"name":"ElasticIp","value":"false","canchooseservicecapability":false},{"name":"AssociatePublicIP","value":"true","canchooseservicecapability":false}]},{"name":"UserData","provider":[{"name":"VirtualRouter"}],"capability":[]},{"name":"Firewall","provider":[{"name":"VirtualRouter"}],"capability":[{"name":"SupportedEgressProtocols","value":"tcp,udp,icmp, all","canchooseservicecapability":false},{"name":"SupportedProtocols","value":"tcp,udp,icmp","canchooseservicecapability":false},{"name":"MultipleIps","value":"true","canchooseservicecapability":false},{"name":"SupportedTrafficDirection","value":"ingress, egress","canchooseservicecapability":false},{"name":"TrafficStatistics","value":"per public ip","canchooseservicecapability":false}]},{"name":"SourceNat","provider":[{"name":"VirtualRouter"}],"capability":[{"name":"SupportedSourceNatTypes","value":"peraccount","canchooseservicecapability":true},{"name":"RedundantRouter","value":"false","canchooseservicecapability":true}]},{"name":"Dns","provider":[{"name":"VirtualRouter"}],"capability":[{"name":"AllowDnsSuffixModification","value":"true","canchooseservicecapability":false}]},{"name":"Dhcp","provider":[{"name":"VirtualRouter"}],"capability":[{"name":"DhcpAccrossMultipleSubnets","value":"true","canchooseservicecapability":false}]},{"name":"PortForwarding","provider":[{"name":"VirtualRouter"}],"capability":[{"name":"SupportedProtocols","value":"tcp,udp","canchooseservicecapability":false}]}],"networkdomain":"omurozlu.com","physicalnetworkid":"8f9709ad-b952-44c0-9323-024bfcd67dc2","restartrequired":false,"specifyvlan":false,"specifyipranges":false,"canusefordeploy":true,"ispersistent":false,"tags":[],"strechedl2subnet":false,"redundantrouter":false,"supportsvmautoscaling":true,"created":"2025-07-30T13:06:17+0300","receivedbytes":0,"sentbytes":0,"egressdefaultpolicy":false,"publicmtu":1500,"privatemtu":1500,"hasannotations":false},{"id":"2525d51c-052e-429f-8e6d-52b66d324a62","name":"OM-LAN","displaytext":"OM-LAN","broadcastdomaintype":"Vlan","traffictype":"Guest","zoneid":"36a59d65-2c25-403c-997b-3b3f7997cc8a","zonename":"IST01","networkofferingid":"60441bb1-3ec3-4e21-90f5-da1371f93fb0","networkofferingname":"FA360 - L2Network","networkofferingdisplaytext":"FA360 - L2Network","networkofferingconservemode":true,"networkofferingavailability":"Optional","issystem":false,"state":"Implemented","related":"2525d51c-052e-429f-8e6d-52b66d324a62","dns1":"8.8.8.8","dns2":"1.1.1.1","type":"L2","acltype":"Account","account":"omur.ozlu","domainid":"omurozlu.com","domain":"omurozlu.com","domainpath":"/omurozlu.com/","service":[],"physicalnetworkid":"8f9709ad-b952-44c0-9323-024bfcd67dc2","restartrequired":false,"specifyvlan":false,"specifyipranges":false,"canusefordeploy":true,"ispersistent":false,"tags":[],"strechedl2subnet":false,"redundantrouter":false,"supportsvmautoscaling":false,"created":"2025-07-17T14:32:19+0300","receivedbytes":0,"sentbytes":0,"publicmtu":1500,"privatemtu":1500,"hasannotations":false},{"id":"aa4909fa-28fe-49e4-a882-6fe81a4c0546","name":"OM-WAN","displaytext":"OM-WAN","broadcastdomaintype":"Vlan","traffictype":"Guest","zoneid":"36a59d65-2c25-403c-997b-3b3f7997cc8a","zonename":"IST01","networkofferingid":"6b014d45-bc43-4637-9b9a-5a7ce98c3983","networkofferingname":"FA360 - L2NetworkVlan","networkofferingdisplaytext":"FA360 - L2NetworkVlan","networkofferingconservemode":true,"networkofferingavailability":"Optional","issystem":false,"state":"Setup","related":"aa4909fa-28fe-49e4-a882-6fe81a4c0546","dns1":"8.8.8.8","dns2":"1.1.1.1","type":"L2","acltype":"Account","account":"omur.ozlu","domainid":"omurozlu.com","domain":"omurozlu.com","domainpath":"/omurozlu.com/","service":[],"physicalnetworkid":"8f9709ad-b952-44c0-9323-024bfcd67dc2","restartrequired":false,"specifyvlan":true,"specifyipranges":false,"canusefordeploy":true,"ispersistent":false,"tags":[],"strechedl2subnet":false,"redundantrouter":false,"supportsvmautoscaling":false,"created":"2025-07-17T14:31:40+0300","receivedbytes":0,"sentbytes":0,"publicmtu":1500,"privatemtu":1500,"hasannotations":false}]}} 2025-07-30 13:06:26,174 DEBUG [c.c.a.ApiServlet] (qtp939199469-5740:[ctx-4526b54c, ctx-3d036f41]) (logid:161dbce0) ===END=== 172.17.250.135 -- POST 2025-07-30 13:06:26,282 DEBUG [c.c.a.ApiServlet] (qtp939199469-4259:[ctx-cacbca31]) (logid:deea9b39) ===START=== 172.17.250.135 -- GET command=readyForShutdown&response=json&sessionkey=-ecDVe2Rw4U_E6NIABSQznRKU18 2025-07-30 13:06:26,282 DEBUG [c.c.a.ApiServlet] (qtp939199469-4259:[ctx-cacbca31]) (logid:deea9b39) Two factor authentication is already verified for the user 2, so skipping 2025-07-30 13:06:26,288 DEBUG [c.c.a.ApiServer] (qtp939199469-4259:[ctx-cacbca31, ctx-00cd2ea8]) (logid:deea9b39) CIDRs from which account 'Account [{"accountName":"admin","id":2,"uuid":"20322fb1-e76c-11ee-89f3-00505698c91f"}]' is allowed to perform API calls: 0.0.0.0/0,::/0 2025-07-30 13:06:26,289 DEBUG [c.c.a.ApiServlet] (qtp939199469-4258:[ctx-257378da]) (logid:063f2491) ===START=== 172.17.250.135 -- GET managementserverid=&command=readyForShutdown&response=json&sessionkey=c1uEm-jJxWn58Xp0ED8jE9WOnxw 2025-07-30 13:06:26,289 DEBUG [c.c.a.ApiServlet] (qtp939199469-4258:[ctx-257378da]) (logid:063f2491) Two factor authentication is already verified for the user 2, so skipping 2025-07-30 13:06:26,291 INFO [o.a.c.a.DynamicRoleBasedAPIAccessChecker] (qtp939199469-4259:[ctx-cacbca31, ctx-00cd2ea8]) (logid:deea9b39) Account for user id 20343ff1-e76c-11ee-89f3-00505698c91f is Root Admin or Domain Admin, all APIs are allowed. 2025-07-30 13:06:26,291 DEBUG [o.a.c.a.StaticRoleBasedAPIAccessChecker] (qtp939199469-4259:[ctx-cacbca31, ctx-00cd2ea8]) (logid:deea9b39) RoleService is enabled. We will use it instead of StaticRoleBasedAPIAccessChecker. 2025-07-30 13:06:26,291 DEBUG [o.a.c.r.ApiRateLimitServiceImpl] (qtp939199469-4259:[ctx-cacbca31, ctx-00cd2ea8]) (logid:deea9b39) API rate limiting is disabled. We will not use ApiRateLimitService. 2025-07-30 13:06:26,293 DEBUG [c.c.a.ApiServer] (qtp939199469-4258:[ctx-257378da, ctx-37e69f4b]) (logid:063f2491) CIDRs from which account 'Account [{"accountName":"admin","id":2,"uuid":"20322fb1-e76c-11ee-89f3-00505698c91f"}]' is allowed to perform API calls: 0.0.0.0/0,::/0 2025-07-30 13:06:26,294 INFO [a.c.c.a.ApiServlet] (qtp939199469-4259:[ctx-cacbca31, ctx-00cd2ea8]) (logid:deea9b39) (userId=2 accountId=2 sessionId=node0zw6v998yuqizkda6e1aneimo4) 172.17.250.135 -- GET command=readyForShutdown&response=json&sessionkey=-ecDVe2Rw4U_E6NIABSQznRKU18 200 {"readyforshutdownresponse":{"readyforshutdown":{"readyforshutdown":false,"shutdowntriggered":false,"pendingjobscount":1}}} 2025-07-30 13:06:26,294 DEBUG [c.c.a.ApiServlet] (qtp939199469-4259:[ctx-cacbca31, ctx-00cd2ea8]) (logid:deea9b39) ===END=== 172.17.250.135 -- GET command=readyForShutdown&response=json&sessionkey=-ecDVe2Rw4U_E6NIABSQznRKU18 2025-07-30 13:06:26,294 INFO [o.a.c.a.DynamicRoleBasedAPIAccessChecker] (qtp939199469-4258:[ctx-257378da, ctx-37e69f4b]) (logid:063f2491) Account for user id 20343ff1-e76c-11ee-89f3-00505698c91f is Root Admin or Domain Admin, all APIs are allowed. 2025-07-30 13:06:26,295 DEBUG [o.a.c.a.StaticRoleBasedAPIAccessChecker] (qtp939199469-4258:[ctx-257378da, ctx-37e69f4b]) (logid:063f2491) RoleService is enabled. We will use it instead of StaticRoleBasedAPIAccessChecker. 2025-07-30 13:06:26,295 DEBUG [o.a.c.r.ApiRateLimitServiceImpl] (qtp939199469-4258:[ctx-257378da, ctx-37e69f4b]) (logid:063f2491) API rate limiting is disabled. We will not use ApiRateLimitService. 2025-07-30 13:06:26,296 DEBUG [c.c.a.d.ParamProcessWorker] (qtp939199469-4258:[ctx-257378da, ctx-37e69f4b]) (logid:063f2491) Object entity uuid = does not exist in the database. 2025-07-30 13:06:26,296 INFO [c.c.a.ApiServer] (qtp939199469-4258:[ctx-257378da, ctx-37e69f4b]) (logid:063f2491) Unable to execute API command readyforshutdown due to invalid value. Invalid parameter managementserverid value= due to incorrect long value format, or entity does not exist or due to incorrect parameter annotation for the field in api cmd class. 2025-07-30 13:06:26,296 INFO [a.c.c.a.ApiServlet] (qtp939199469-4258:[ctx-257378da, ctx-37e69f4b]) (logid:063f2491) (userId=2 accountId=2 sessionId=node01xrkl642f2gm24hs557oykiu7) 172.17.250.135 -- GET managementserverid=&command=readyForShutdown&response=json&sessionkey=c1uEm-jJxWn58Xp0ED8jE9WOnxw 431 Unable to execute API command readyforshutdown due to invalid value. Invalid parameter managementserverid value= due to incorrect long value format, or entity does not exist or due to incorrect parameter annotation for the field in api cmd class. 2025-07-30 13:06:26,296 DEBUG [c.c.a.ApiServlet] (qtp939199469-4258:[ctx-257378da, ctx-37e69f4b]) (logid:063f2491) ===END=== 172.17.250.135 -- GET managementserverid=&command=readyForShutdown&response=json&sessionkey=c1uEm-jJxWn58Xp0ED8jE9WOnxw 2025-07-30 13:06:26,298 DEBUG [c.c.a.ApiServlet] (qtp939199469-5274:[ctx-01a1fd05]) (logid:83d8a49d) ===START=== 172.17.250.135 -- GET command=readyForShutdown&response=json&sessionkey=-ecDVe2Rw4U_E6NIABSQznRKU18 2025-07-30 13:06:26,298 DEBUG [c.c.a.ApiServlet] (qtp939199469-5274:[ctx-01a1fd05]) (logid:83d8a49d) Two factor authentication is already verified for the user 2, so skipping 2025-07-30 13:06:26,303 DEBUG [c.c.a.ApiServer] (qtp939199469-5274:[ctx-01a1fd05, ctx-b56f7ab3]) (logid:83d8a49d) CIDRs from which account 'Account [{"accountName":"admin","id":2,"uuid":"20322fb1-e76c-11ee-89f3-00505698c91f"}]' is allowed to perform API calls: 0.0.0.0/0,::/0 2025-07-30 13:06:26,304 INFO [o.a.c.a.DynamicRoleBasedAPIAccessChecker] (qtp939199469-5274:[ctx-01a1fd05, ctx-b56f7ab3]) (logid:83d8a49d) Account for user id 20343ff1-e76c-11ee-89f3-00505698c91f is Root Admin or Domain Admin, all APIs are allowed. 2025-07-30 13:06:26,304 DEBUG [o.a.c.a.StaticRoleBasedAPIAccessChecker] (qtp939199469-5274:[ctx-01a1fd05, ctx-b56f7ab3]) (logid:83d8a49d) RoleService is enabled. We will use it instead of StaticRoleBasedAPIAccessChecker. 2025-07-30 13:06:26,304 DEBUG [o.a.c.r.ApiRateLimitServiceImpl] (qtp939199469-5274:[ctx-01a1fd05, ctx-b56f7ab3]) (logid:83d8a49d) API rate limiting is disabled. We will not use ApiRateLimitService. 2025-07-30 13:06:26,313 INFO [a.c.c.a.ApiServlet] (qtp939199469-5274:[ctx-01a1fd05, ctx-b56f7ab3]) (logid:83d8a49d) (userId=2 accountId=2 sessionId=node0zw6v998yuqizkda6e1aneimo4) 172.17.250.135 -- GET command=readyForShutdown&response=json&sessionkey=-ecDVe2Rw4U_E6NIABSQznRKU18 200 {"readyforshutdownresponse":{"readyforshutdown":{"readyforshutdown":false,"shutdowntriggered":false,"pendingjobscount":1}}} 2025-07-30 13:06:26,315 DEBUG [c.c.a.ApiServlet] (qtp939199469-5274:[ctx-01a1fd05, ctx-b56f7ab3]) (logid:83d8a49d) ===END=== 172.17.250.135 -- GET command=readyForShutdown&response=json&sessionkey=-ecDVe2Rw4U_E6NIABSQznRKU18 2025-07-30 13:06:26,658 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-0a8b026b]) (logid:cad4b015) Found 11 inactive management server node based on timestamp 2025-07-30 13:06:26,658 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-0a8b026b]) (logid:cad4b015) management server node msid: 2886785035, name: cs01.flexapp360.cloud, service ip: 172.16.216.11, version: 4.19.0.0 2025-07-30 13:06:26,658 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-0a8b026b]) (logid:cad4b015) management server node msid: 2886785036, name: cs02.flexapp360.cloud, service ip: 172.16.216.12, version: 4.19.0.0 2025-07-30 13:06:26,658 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-0a8b026b]) (logid:cad4b015) management server node msid: 2886785037, name: cs03.flexapp360.cloud, service ip: 172.16.216.13, version: 4.19.0.0 2025-07-30 13:06:26,658 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-0a8b026b]) (logid:cad4b015) management server node msid: 2887440395, name: acs01.flexapp360.cloud, service ip: 172.26.216.11, version: 4.19.0.0 2025-07-30 13:06:26,658 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-0a8b026b]) (logid:cad4b015) management server node msid: 2130706433, name: localhost, service ip: 172.16.216.11, version: 4.19.0.0 2025-07-30 13:06:26,658 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-0a8b026b]) (logid:cad4b015) management server node msid: 345050211425, name: cs02.flexapp360.cloud, service ip: 172.16.216.12, version: 4.20.1.0 2025-07-30 13:06:26,658 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-0a8b026b]) (logid:cad4b015) management server node msid: 345050226781, name: cs03.flexapp360.cloud, service ip: 172.16.216.13, version: 4.20.1.0 2025-07-30 13:06:26,658 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-0a8b026b]) (logid:cad4b015) management server node msid: 345048713423, name: acs01.flexapp360.cloud, service ip: 172.26.216.11, version: 4.20.0.0 2025-07-30 13:06:26,658 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-0a8b026b]) (logid:cad4b015) management server node msid: 345050203477, name: demo.flexapp360.cloud, service ip: 172.16.216.14, version: 4.20.1.0 2025-07-30 13:06:26,658 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-0a8b026b]) (logid:cad4b015) management server node msid: 345050189711, name: cs04, service ip: 172.16.216.15, version: 4.20.1.0 2025-07-30 13:06:26,658 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-0a8b026b]) (logid:cad4b015) management server node msid: 345050211517, name: csui, service ip: 172.16.216.19, version: 4.20.1.0 2025-07-30 13:06:26,659 DEBUG [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-0a8b026b]) (logid:cad4b015) Peer scan is finished. profiler: Done. Duration: 3ms , profilerQueryActiveList: Done. Duration: 0ms, , profilerSyncClusterInfo: Done. Duration: 0ms, profilerInvalidatedNodeList: Done. Duration: 0ms, profilerRemovedList: Done. Duration: 0ms,, profilerNewList: Done. Duration: 0ms, profilerInactiveList: Done. Duration: 1ms 2025-07-30 13:06:27,080 DEBUG [c.c.a.ApiServlet] (qtp939199469-5184:[ctx-79837434]) (logid:3c99412b) ===START=== 172.17.250.135 -- GET jobId=615fb440-0f6e-4ca7-af8d-3069603698ff&command=queryAsyncJobResult&response=json&sessionkey=tT5zr5t-kh9cjokdeBn__S6GA_w 2025-07-30 13:06:27,080 DEBUG [c.c.a.ApiServlet] (qtp939199469-5184:[ctx-79837434]) (logid:3c99412b) Two factor authentication is already verified for the user 507, so skipping 2025-07-30 13:06:27,086 DEBUG [c.c.a.ApiServer] (qtp939199469-5184:[ctx-79837434, ctx-28643cec]) (logid:3c99412b) CIDRs from which account 'Account [{"accountName":"omur.ozlu","id":491,"uuid":"24ded954-9f50-4e6b-a332-6c58088d84c4"}]' is allowed to perform API calls: 0.0.0.0/0,::/0 2025-07-30 13:06:27,091 DEBUG [o.a.c.a.StaticRoleBasedAPIAccessChecker] (qtp939199469-5184:[ctx-79837434, ctx-28643cec]) (logid:3c99412b) RoleService is enabled. We will use it instead of StaticRoleBasedAPIAccessChecker. 2025-07-30 13:06:27,091 DEBUG [o.a.c.r.ApiRateLimitServiceImpl] (qtp939199469-5184:[ctx-79837434, ctx-28643cec]) (logid:3c99412b) API rate limiting is disabled. We will not use ApiRateLimitService. 2025-07-30 13:06:27,097 DEBUG [c.c.u.AccountManagerImpl] (qtp939199469-5184:[ctx-79837434, ctx-28643cec]) (logid:3c99412b) Access to Account [{"accountName":"omur.ozlu","id":491,"uuid":"24ded954-9f50-4e6b-a332-6c58088d84c4"}] granted to Account [{"accountName":"omur.ozlu","id":491,"uuid":"24ded954-9f50-4e6b-a332-6c58088d84c4"}] by DomainChecker on behalf of user omur.ozlu 2025-07-30 13:06:27,115 INFO [a.c.c.a.ApiServlet] (qtp939199469-5184:[ctx-79837434, ctx-28643cec]) (logid:3c99412b) (userId=507 accountId=491 sessionId=node0ri1fbmg3kgudzfs62oxq5v7t8) 172.17.250.135 -- GET jobId=615fb440-0f6e-4ca7-af8d-3069603698ff&command=queryAsyncJobResult&response=json&sessionkey=tT5zr5t-kh9cjokdeBn__S6GA_w 200 {"queryasyncjobresultresponse":{"accountid":"24ded954-9f50-4e6b-a332-6c58088d84c4","account":"omur.ozlu","domainid":"omurozlu.com","domainpath":"ROOT/omurozlu.com","userid":"910a89cf-5640-48d4-bbe4-6eec6c145ba8","cmd":"org.apache.cloudstack.api.command.user.vm.DeployVMCmd","jobstatus":0,"jobprocstatus":0,"jobresultcode":0,"jobinstancetype":"VirtualMachine","jobinstanceid":"5865e9a8-c4f1-4760-a345-c9f3eeb0146a","managementserverid":345050216744,"created":"2025-07-30T13:06:17+0300","jobid":"615fb440-0f6e-4ca7-af8d-3069603698ff"}} 2025-07-30 13:06:27,115 DEBUG [c.c.a.ApiServlet] (qtp939199469-5184:[ctx-79837434, ctx-28643cec]) (logid:3c99412b) ===END=== 172.17.250.135 -- GET jobId=615fb440-0f6e-4ca7-af8d-3069603698ff&command=queryAsyncJobResult&response=json&sessionkey=tT5zr5t-kh9cjokdeBn__S6GA_w 2025-07-30 13:06:27,979 DEBUG [o.a.c.h.H.HAManagerBgPollTask] (BackgroundTaskPollManager-2:[ctx-9e28b0aa]) (logid:81f62d25) HA health check task is running... 2025-07-30 13:06:28,159 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-db7ca436]) (logid:5e8b3bd8) Found 11 inactive management server node based on timestamp 2025-07-30 13:06:28,159 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-db7ca436]) (logid:5e8b3bd8) management server node msid: 2886785035, name: cs01.flexapp360.cloud, service ip: 172.16.216.11, version: 4.19.0.0 2025-07-30 13:06:28,159 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-db7ca436]) (logid:5e8b3bd8) management server node msid: 2886785036, name: cs02.flexapp360.cloud, service ip: 172.16.216.12, version: 4.19.0.0 2025-07-30 13:06:28,159 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-db7ca436]) (logid:5e8b3bd8) management server node msid: 2886785037, name: cs03.flexapp360.cloud, service ip: 172.16.216.13, version: 4.19.0.0 2025-07-30 13:06:28,159 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-db7ca436]) (logid:5e8b3bd8) management server node msid: 2887440395, name: acs01.flexapp360.cloud, service ip: 172.26.216.11, version: 4.19.0.0 2025-07-30 13:06:28,159 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-db7ca436]) (logid:5e8b3bd8) management server node msid: 2130706433, name: localhost, service ip: 172.16.216.11, version: 4.19.0.0 2025-07-30 13:06:28,159 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-db7ca436]) (logid:5e8b3bd8) management server node msid: 345050211425, name: cs02.flexapp360.cloud, service ip: 172.16.216.12, version: 4.20.1.0 2025-07-30 13:06:28,159 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-db7ca436]) (logid:5e8b3bd8) management server node msid: 345050226781, name: cs03.flexapp360.cloud, service ip: 172.16.216.13, version: 4.20.1.0 2025-07-30 13:06:28,159 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-db7ca436]) (logid:5e8b3bd8) management server node msid: 345048713423, name: acs01.flexapp360.cloud, service ip: 172.26.216.11, version: 4.20.0.0 2025-07-30 13:06:28,159 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-db7ca436]) (logid:5e8b3bd8) management server node msid: 345050203477, name: demo.flexapp360.cloud, service ip: 172.16.216.14, version: 4.20.1.0 2025-07-30 13:06:28,159 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-db7ca436]) (logid:5e8b3bd8) management server node msid: 345050189711, name: cs04, service ip: 172.16.216.15, version: 4.20.1.0 2025-07-30 13:06:28,159 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-db7ca436]) (logid:5e8b3bd8) management server node msid: 345050211517, name: csui, service ip: 172.16.216.19, version: 4.20.1.0 2025-07-30 13:06:28,159 DEBUG [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-db7ca436]) (logid:5e8b3bd8) Peer scan is finished. profiler: Done. Duration: 2ms , profilerQueryActiveList: Done. Duration: 0ms, , profilerSyncClusterInfo: Done. Duration: 0ms, profilerInvalidatedNodeList: Done. Duration: 0ms, profilerRemovedList: Done. Duration: 0ms,, profilerNewList: Done. Duration: 0ms, profilerInactiveList: Done. Duration: 1ms 2025-07-30 13:06:29,659 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-0780b6d0]) (logid:0caa0444) Found 11 inactive management server node based on timestamp 2025-07-30 13:06:29,659 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-0780b6d0]) (logid:0caa0444) management server node msid: 2886785035, name: cs01.flexapp360.cloud, service ip: 172.16.216.11, version: 4.19.0.0 2025-07-30 13:06:29,659 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-0780b6d0]) (logid:0caa0444) management server node msid: 2886785036, name: cs02.flexapp360.cloud, service ip: 172.16.216.12, version: 4.19.0.0 2025-07-30 13:06:29,659 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-0780b6d0]) (logid:0caa0444) management server node msid: 2886785037, name: cs03.flexapp360.cloud, service ip: 172.16.216.13, version: 4.19.0.0 2025-07-30 13:06:29,659 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-0780b6d0]) (logid:0caa0444) management server node msid: 2887440395, name: acs01.flexapp360.cloud, service ip: 172.26.216.11, version: 4.19.0.0 2025-07-30 13:06:29,659 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-0780b6d0]) (logid:0caa0444) management server node msid: 2130706433, name: localhost, service ip: 172.16.216.11, version: 4.19.0.0 2025-07-30 13:06:29,659 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-0780b6d0]) (logid:0caa0444) management server node msid: 345050211425, name: cs02.flexapp360.cloud, service ip: 172.16.216.12, version: 4.20.1.0 2025-07-30 13:06:29,659 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-0780b6d0]) (logid:0caa0444) management server node msid: 345050226781, name: cs03.flexapp360.cloud, service ip: 172.16.216.13, version: 4.20.1.0 2025-07-30 13:06:29,659 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-0780b6d0]) (logid:0caa0444) management server node msid: 345048713423, name: acs01.flexapp360.cloud, service ip: 172.26.216.11, version: 4.20.0.0 2025-07-30 13:06:29,659 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-0780b6d0]) (logid:0caa0444) management server node msid: 345050203477, name: demo.flexapp360.cloud, service ip: 172.16.216.14, version: 4.20.1.0 2025-07-30 13:06:29,659 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-0780b6d0]) (logid:0caa0444) management server node msid: 345050189711, name: cs04, service ip: 172.16.216.15, version: 4.20.1.0 2025-07-30 13:06:29,659 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-0780b6d0]) (logid:0caa0444) management server node msid: 345050211517, name: csui, service ip: 172.16.216.19, version: 4.20.1.0 2025-07-30 13:06:29,659 DEBUG [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-0780b6d0]) (logid:0caa0444) Peer scan is finished. profiler: Done. Duration: 3ms , profilerQueryActiveList: Done. Duration: 0ms, , profilerSyncClusterInfo: Done. Duration: 0ms, profilerInvalidatedNodeList: Done. Duration: 0ms, profilerRemovedList: Done. Duration: 0ms,, profilerNewList: Done. Duration: 0ms, profilerInactiveList: Done. Duration: 1ms 2025-07-30 13:06:30,123 DEBUG [c.c.a.ApiServlet] (qtp939199469-5274:[ctx-6cc8aa09]) (logid:537e07de) ===START=== 172.17.250.135 -- GET jobId=615fb440-0f6e-4ca7-af8d-3069603698ff&command=queryAsyncJobResult&response=json&sessionkey=tT5zr5t-kh9cjokdeBn__S6GA_w 2025-07-30 13:06:30,123 DEBUG [c.c.a.ApiServlet] (qtp939199469-5274:[ctx-6cc8aa09]) (logid:537e07de) Two factor authentication is already verified for the user 507, so skipping 2025-07-30 13:06:30,129 DEBUG [c.c.a.ApiServer] (qtp939199469-5274:[ctx-6cc8aa09, ctx-d66088fa]) (logid:537e07de) CIDRs from which account 'Account [{"accountName":"omur.ozlu","id":491,"uuid":"24ded954-9f50-4e6b-a332-6c58088d84c4"}]' is allowed to perform API calls: 0.0.0.0/0,::/0 2025-07-30 13:06:30,134 DEBUG [o.a.c.a.StaticRoleBasedAPIAccessChecker] (qtp939199469-5274:[ctx-6cc8aa09, ctx-d66088fa]) (logid:537e07de) RoleService is enabled. We will use it instead of StaticRoleBasedAPIAccessChecker. 2025-07-30 13:06:30,134 DEBUG [o.a.c.r.ApiRateLimitServiceImpl] (qtp939199469-5274:[ctx-6cc8aa09, ctx-d66088fa]) (logid:537e07de) API rate limiting is disabled. We will not use ApiRateLimitService. 2025-07-30 13:06:30,139 DEBUG [c.c.u.AccountManagerImpl] (qtp939199469-5274:[ctx-6cc8aa09, ctx-d66088fa]) (logid:537e07de) Access to Account [{"accountName":"omur.ozlu","id":491,"uuid":"24ded954-9f50-4e6b-a332-6c58088d84c4"}] granted to Account [{"accountName":"omur.ozlu","id":491,"uuid":"24ded954-9f50-4e6b-a332-6c58088d84c4"}] by DomainChecker on behalf of user omur.ozlu 2025-07-30 13:06:30,156 INFO [a.c.c.a.ApiServlet] (qtp939199469-5274:[ctx-6cc8aa09, ctx-d66088fa]) (logid:537e07de) (userId=507 accountId=491 sessionId=node0ri1fbmg3kgudzfs62oxq5v7t8) 172.17.250.135 -- GET jobId=615fb440-0f6e-4ca7-af8d-3069603698ff&command=queryAsyncJobResult&response=json&sessionkey=tT5zr5t-kh9cjokdeBn__S6GA_w 200 {"queryasyncjobresultresponse":{"accountid":"24ded954-9f50-4e6b-a332-6c58088d84c4","account":"omur.ozlu","domainid":"omurozlu.com","domainpath":"ROOT/omurozlu.com","userid":"910a89cf-5640-48d4-bbe4-6eec6c145ba8","cmd":"org.apache.cloudstack.api.command.user.vm.DeployVMCmd","jobstatus":0,"jobprocstatus":0,"jobresultcode":0,"jobinstancetype":"VirtualMachine","jobinstanceid":"5865e9a8-c4f1-4760-a345-c9f3eeb0146a","managementserverid":345050216744,"created":"2025-07-30T13:06:17+0300","jobid":"615fb440-0f6e-4ca7-af8d-3069603698ff"}} 2025-07-30 13:06:30,156 DEBUG [c.c.a.ApiServlet] (qtp939199469-5274:[ctx-6cc8aa09, ctx-d66088fa]) (logid:537e07de) ===END=== 172.17.250.135 -- GET jobId=615fb440-0f6e-4ca7-af8d-3069603698ff&command=queryAsyncJobResult&response=json&sessionkey=tT5zr5t-kh9cjokdeBn__S6GA_w 2025-07-30 13:06:31,159 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-25e5ad6d]) (logid:373746fa) Found 11 inactive management server node based on timestamp 2025-07-30 13:06:31,159 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-25e5ad6d]) (logid:373746fa) management server node msid: 2886785035, name: cs01.flexapp360.cloud, service ip: 172.16.216.11, version: 4.19.0.0 2025-07-30 13:06:31,159 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-25e5ad6d]) (logid:373746fa) management server node msid: 2886785036, name: cs02.flexapp360.cloud, service ip: 172.16.216.12, version: 4.19.0.0 2025-07-30 13:06:31,159 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-25e5ad6d]) (logid:373746fa) management server node msid: 2886785037, name: cs03.flexapp360.cloud, service ip: 172.16.216.13, version: 4.19.0.0 2025-07-30 13:06:31,159 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-25e5ad6d]) (logid:373746fa) management server node msid: 2887440395, name: acs01.flexapp360.cloud, service ip: 172.26.216.11, version: 4.19.0.0 2025-07-30 13:06:31,159 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-25e5ad6d]) (logid:373746fa) management server node msid: 2130706433, name: localhost, service ip: 172.16.216.11, version: 4.19.0.0 2025-07-30 13:06:31,159 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-25e5ad6d]) (logid:373746fa) management server node msid: 345050211425, name: cs02.flexapp360.cloud, service ip: 172.16.216.12, version: 4.20.1.0 2025-07-30 13:06:31,160 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-25e5ad6d]) (logid:373746fa) management server node msid: 345050226781, name: cs03.flexapp360.cloud, service ip: 172.16.216.13, version: 4.20.1.0 2025-07-30 13:06:31,160 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-25e5ad6d]) (logid:373746fa) management server node msid: 345048713423, name: acs01.flexapp360.cloud, service ip: 172.26.216.11, version: 4.20.0.0 2025-07-30 13:06:31,160 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-25e5ad6d]) (logid:373746fa) management server node msid: 345050203477, name: demo.flexapp360.cloud, service ip: 172.16.216.14, version: 4.20.1.0 2025-07-30 13:06:31,160 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-25e5ad6d]) (logid:373746fa) management server node msid: 345050189711, name: cs04, service ip: 172.16.216.15, version: 4.20.1.0 2025-07-30 13:06:31,160 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-25e5ad6d]) (logid:373746fa) management server node msid: 345050211517, name: csui, service ip: 172.16.216.19, version: 4.20.1.0 2025-07-30 13:06:31,160 DEBUG [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-25e5ad6d]) (logid:373746fa) Peer scan is finished. profiler: Done. Duration: 3ms , profilerQueryActiveList: Done. Duration: 0ms, , profilerSyncClusterInfo: Done. Duration: 0ms, profilerInvalidatedNodeList: Done. Duration: 0ms, profilerRemovedList: Done. Duration: 0ms,, profilerNewList: Done. Duration: 0ms, profilerInactiveList: Done. Duration: 1ms 2025-07-30 13:06:31,803 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] (AgentManager-Handler-10:[]) (logid:) SeqA 45-131790: Seq 45-131790: { Cmd , MgmtId: -1, via: 45, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":"4","_loadInfo":"{ "connections": [], "removedSessions": [] }","wait":"0","bypassHostMaintenance":"false"}}] } 2025-07-30 13:06:31,817 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] (AgentManager-Handler-10:[]) (logid:) SeqA 45-: Sending 131790 2025-07-30 13:06:31,981 DEBUG [o.a.c.h.H.HAManagerBgPollTask] (BackgroundTaskPollManager-1:[ctx-910225b6]) (logid:144d5847) HA health check task is running... 2025-07-30 13:06:32,658 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-9d71c51f]) (logid:ca7380a9) Found 11 inactive management server node based on timestamp 2025-07-30 13:06:32,658 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-9d71c51f]) (logid:ca7380a9) management server node msid: 2886785035, name: cs01.flexapp360.cloud, service ip: 172.16.216.11, version: 4.19.0.0 2025-07-30 13:06:32,658 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-9d71c51f]) (logid:ca7380a9) management server node msid: 2886785036, name: cs02.flexapp360.cloud, service ip: 172.16.216.12, version: 4.19.0.0 2025-07-30 13:06:32,658 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-9d71c51f]) (logid:ca7380a9) management server node msid: 2886785037, name: cs03.flexapp360.cloud, service ip: 172.16.216.13, version: 4.19.0.0 2025-07-30 13:06:32,658 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-9d71c51f]) (logid:ca7380a9) management server node msid: 2887440395, name: acs01.flexapp360.cloud, service ip: 172.26.216.11, version: 4.19.0.0 2025-07-30 13:06:32,658 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-9d71c51f]) (logid:ca7380a9) management server node msid: 2130706433, name: localhost, service ip: 172.16.216.11, version: 4.19.0.0 2025-07-30 13:06:32,658 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-9d71c51f]) (logid:ca7380a9) management server node msid: 345050211425, name: cs02.flexapp360.cloud, service ip: 172.16.216.12, version: 4.20.1.0 2025-07-30 13:06:32,658 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-9d71c51f]) (logid:ca7380a9) management server node msid: 345050226781, name: cs03.flexapp360.cloud, service ip: 172.16.216.13, version: 4.20.1.0 2025-07-30 13:06:32,658 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-9d71c51f]) (logid:ca7380a9) management server node msid: 345048713423, name: acs01.flexapp360.cloud, service ip: 172.26.216.11, version: 4.20.0.0 2025-07-30 13:06:32,658 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-9d71c51f]) (logid:ca7380a9) management server node msid: 345050203477, name: demo.flexapp360.cloud, service ip: 172.16.216.14, version: 4.20.1.0 2025-07-30 13:06:32,658 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-9d71c51f]) (logid:ca7380a9) management server node msid: 345050189711, name: cs04, service ip: 172.16.216.15, version: 4.20.1.0 2025-07-30 13:06:32,658 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-9d71c51f]) (logid:ca7380a9) management server node msid: 345050211517, name: csui, service ip: 172.16.216.19, version: 4.20.1.0 2025-07-30 13:06:32,658 DEBUG [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-9d71c51f]) (logid:ca7380a9) Peer scan is finished. profiler: Done. Duration: 2ms , profilerQueryActiveList: Done. Duration: 0ms, , profilerSyncClusterInfo: Done. Duration: 0ms, profilerInvalidatedNodeList: Done. Duration: 0ms, profilerRemovedList: Done. Duration: 0ms,, profilerNewList: Done. Duration: 0ms, profilerInactiveList: Done. Duration: 1ms 2025-07-30 13:06:33,162 DEBUG [c.c.a.ApiServlet] (qtp939199469-4851:[ctx-4dc26dea]) (logid:4a7ed824) ===START=== 172.17.250.135 -- GET jobId=615fb440-0f6e-4ca7-af8d-3069603698ff&command=queryAsyncJobResult&response=json&sessionkey=tT5zr5t-kh9cjokdeBn__S6GA_w 2025-07-30 13:06:33,162 DEBUG [c.c.a.ApiServlet] (qtp939199469-4851:[ctx-4dc26dea]) (logid:4a7ed824) Two factor authentication is already verified for the user 507, so skipping 2025-07-30 13:06:33,168 DEBUG [c.c.a.ApiServer] (qtp939199469-4851:[ctx-4dc26dea, ctx-abc4d57f]) (logid:4a7ed824) CIDRs from which account 'Account [{"accountName":"omur.ozlu","id":491,"uuid":"24ded954-9f50-4e6b-a332-6c58088d84c4"}]' is allowed to perform API calls: 0.0.0.0/0,::/0 2025-07-30 13:06:33,174 DEBUG [o.a.c.a.StaticRoleBasedAPIAccessChecker] (qtp939199469-4851:[ctx-4dc26dea, ctx-abc4d57f]) (logid:4a7ed824) RoleService is enabled. We will use it instead of StaticRoleBasedAPIAccessChecker. 2025-07-30 13:06:33,174 DEBUG [o.a.c.r.ApiRateLimitServiceImpl] (qtp939199469-4851:[ctx-4dc26dea, ctx-abc4d57f]) (logid:4a7ed824) API rate limiting is disabled. We will not use ApiRateLimitService. 2025-07-30 13:06:33,180 DEBUG [c.c.u.AccountManagerImpl] (qtp939199469-4851:[ctx-4dc26dea, ctx-abc4d57f]) (logid:4a7ed824) Access to Account [{"accountName":"omur.ozlu","id":491,"uuid":"24ded954-9f50-4e6b-a332-6c58088d84c4"}] granted to Account [{"accountName":"omur.ozlu","id":491,"uuid":"24ded954-9f50-4e6b-a332-6c58088d84c4"}] by DomainChecker on behalf of user omur.ozlu 2025-07-30 13:06:33,199 INFO [a.c.c.a.ApiServlet] (qtp939199469-4851:[ctx-4dc26dea, ctx-abc4d57f]) (logid:4a7ed824) (userId=507 accountId=491 sessionId=node0ri1fbmg3kgudzfs62oxq5v7t8) 172.17.250.135 -- GET jobId=615fb440-0f6e-4ca7-af8d-3069603698ff&command=queryAsyncJobResult&response=json&sessionkey=tT5zr5t-kh9cjokdeBn__S6GA_w 200 {"queryasyncjobresultresponse":{"accountid":"24ded954-9f50-4e6b-a332-6c58088d84c4","account":"omur.ozlu","domainid":"omurozlu.com","domainpath":"ROOT/omurozlu.com","userid":"910a89cf-5640-48d4-bbe4-6eec6c145ba8","cmd":"org.apache.cloudstack.api.command.user.vm.DeployVMCmd","jobstatus":0,"jobprocstatus":0,"jobresultcode":0,"jobinstancetype":"VirtualMachine","jobinstanceid":"5865e9a8-c4f1-4760-a345-c9f3eeb0146a","managementserverid":345050216744,"created":"2025-07-30T13:06:17+0300","jobid":"615fb440-0f6e-4ca7-af8d-3069603698ff"}}```@omurozlu I tried a vm deployment with an iso and used custom compute offering and disk offering , but couldn't reproduce the issue.
Do you have screen recording that you can share?
@omurozlu
full logs of jobjob-46562?
maybe networkid/networkids are not passed in the deployvirtualmachine API- locked and limited conversation to collaborators
on Jan 5, 2026 - moved this from Todo to Done in Apache CloudStack BugFest - Issues
on Jan 5, 2026
problem
When deploying a VM using an ISO image, CloudStack automatically creates an isolated guest network using the default offering
DefaultIsolatedNetworkOfferingWithSourceNatService— even though an L2 network is explicitly selected during deployment.In a clean system, this behavior doesn't happen and the selected L2 network is honored without creating a new one.
After comparing the configurations of two identical CloudStack environments (one working, one problematic), we found extra or differing entries in
network_offering_details— particularly involving parameters likeinternetProtocol,domainid, etc.This seems to trigger the system into thinking it needs a network with DHCP capabilities, which leads to the automatic L3 network creation.
versions
CloudStack version: 4.20.1.0
Hypervisor: VMware
The steps to reproduce the bug
DefaultIsolatedNetworkOfferingWithSourceNatService.What to do about it?
No response