Skip to content

Cloudstack wizard is getting stuck storage traffic on version 4.20 #10520

Description

@verendrakalsi

Ubuntu 22.04.5 LTS
Cloustack version :- 4.20

we have install cloudstack agent on 4 hosts and 1 hosts with cloudstack mgmt. After installing when we are trying to run the cloudstack mgmt wizard, it is getting stuck on the storage traffic section.

The Section creates the zone, pod, cluster, add the host, & Primary and secondary storage but after that nothing and it keep spinnig on the wizard at storage traffic section.

Activity

  1. changed the title [-]Cloudstack wizard is getting stuck storage traffice on version 4.20[/-] [+]Cloudstack wizard is getting stuck storage traffic on version 4.20[/+] on Mar 6, 2025
  2. verendrakalsi commented on Mar 6, 2025

    @verendrakalsi
    Author

    its getting stuck here.

    Image

  3. verendrakalsi commented on Mar 6, 2025

    @verendrakalsi
    Author

    looks like some issue with monuting the secondary storage
    Failed to create netfs mount: 10.10.10.12:/KVMSecondary1/template/tmpl/1/3 org.libvirt.LibvirtException: internal error: Child process (/usr/bin/mount -o nodev,nosuid,noexec 10.10.10.12:/KVMSecondary1/template/tmpl/1/3 /mnt/d702e2f4-ecde-318b-b04e-a3cf1bab9afd) unexpected exit status 32: mount.nfs: mounting 10.10.10.12:/KVMSecondary1/template/tmpl/1/3 failed, reason given by server: No such file or directory

  4. Pearl1594 commented on Mar 10, 2025

    @Pearl1594
    Contributor

    @verendrakalsi Does /KVMSecondary1/ path exist on the secondary store: 10.10.10.12?

  5. verendrakalsi commented on Mar 10, 2025

    @verendrakalsi
    Author

    yes, it does. now this issue is resolved.

    but now i am getting this error

    2025-03-10 20:32:02,961 ERROR [cloud.agent.AgentShell] (main:[]) (logid:) Unable to start agent: javax.naming.ConfigurationException: Unable to configure LibvirtComputingResource
    at com.cloud.agent.Agent.(Agent.java:196)
    at com.cloud.agent.AgentShell.launchNewAgent(AgentShell.java:453)
    at com.cloud.agent.AgentShell.launchAgentFromClassInfo(AgentShell.java:432)
    at com.cloud.agent.AgentShell.launchAgent(AgentShell.java:416)
    at com.cloud.agent.AgentShell.start(AgentShell.java:512)
    at com.cloud.agent.AgentShell.main(AgentShell.java:542)

  6. Pearl1594 commented on Mar 10, 2025

    @Pearl1594
    Contributor

    Can you please share the entire stacktrace. Thanks

  7. DaanHoogland commented on Mar 11, 2025

    @DaanHoogland
    Contributor

    @verendrakalsi , the stacktrace as a "Cause", this is what @Pearl1594 is interested in.

    Also can you add the log lines leading up to this stacktrace. Especially the ones containing LibvirtComputingResource or AgentShell?

  8. verendrakalsi commented on Mar 11, 2025

    @verendrakalsi
    Author

    this is what you are looking for ?

    2025-03-11 14:11:17,825 INFO [cloud.agent.AgentShell] (main:[]) (logid:) Agent started
    2025-03-11 14:11:17,830 INFO [cloud.agent.AgentShell] (main:[]) (logid:) Implementation Version is 4.20.0.0
    2025-03-11 14:11:17,831 INFO [cloud.agent.AgentShell] (main:[]) (logid:) agent.properties found at /etc/cloudstack/agent/agent.properties
    2025-03-11 14:11:17,870 INFO [cloud.agent.AgentShell] (main:[]) (logid:) Defaulting to using properties file for storage
    2025-03-11 14:11:17,871 INFO [cloud.agent.AgentShell] (main:[]) (logid:) Defaulting to the constant time backoff algorithm
    2025-03-11 14:11:17,895 INFO [cloud.utils.LogUtils] (main:[]) (logid:) log4j configuration found at /etc/cloudstack/agent/log4j-cloud.xml
    2025-03-11 14:11:17,895 INFO [cloud.agent.AgentShell] (main:[]) (logid:) Using default Java settings for IPv6 preference for agent connection
    2025-03-11 14:11:17,948 INFO [cloud.agent.Agent] (main:[]) (logid:) id is 0
    2025-03-11 14:11:17,953 WARN [kvm.resource.LibvirtComputingResource] (main:[]) (logid:) Incorrect details for private Nic during initialization of ServerResourceBase
    2025-03-11 14:11:17,953 ERROR [cloud.agent.AgentShell] (main:[]) (logid:) Unable to start agent: javax.naming.ConfigurationException: Unable to configure LibvirtComputingResource
    at com.cloud.agent.Agent.(Agent.java:196)
    at com.cloud.agent.AgentShell.launchNewAgent(AgentShell.java:453)
    at com.cloud.agent.AgentShell.launchAgentFromClassInfo(AgentShell.java:432)
    at com.cloud.agent.AgentShell.launchAgent(AgentShell.java:416)
    at com.cloud.agent.AgentShell.start(AgentShell.java:512)
    at com.cloud.agent.AgentShell.main(AgentShell.java:542)

  9. verendrakalsi commented on Mar 11, 2025

    @verendrakalsi
    Author

    2025-03-11T20:53:36,178 WARN [cloud.agent.Agent] (agentRequest-Handler-1:[]) Caught: com.cloud.utils.exception.CloudRuntimeException: Failed to get root directory from secondary storage URL [nfs://10.10.10.12/KVMSecondary1], using NFS version [null], due to [Unable to mount 10.10.10.12:/KVMSecondary1 at /mnt/SecStorage/bd7fe518-f806-3eee-92f9-0819535406ae due to mount.nfs: Connection timed out].
    at org.apache.cloudstack.storage.resource.NfsSecondaryStorageResource.getRootDir(NfsSecondaryStorageResource.java:2675)
    at org.apache.cloudstack.storage.resource.NfsSecondaryStorageResource.execute(NfsSecondaryStorageResource.java:2407)
    at org.apache.cloudstack.storage.resource.NfsSecondaryStorageResource.executeRequest(NfsSecondaryStorageResource.java:298)
    at com.cloud.storage.resource.PremiumSecondaryStorageResource.defaultAction(PremiumSecondaryStorageResource.java:62)
    at com.cloud.storage.resource.PremiumSecondaryStorageResource.executeRequest(PremiumSecondaryStorageResource.java:58)
    at com.cloud.agent.Agent.processRequest(Agent.java:686)
    at com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:1109)
    at com.cloud.utils.nio.Task.call(Task.java:83)
    at com.cloud.utils.nio.Task.call(Task.java:29)
    at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
    at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
    at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
    at java.base/java.lang.Thread.run(Thread.java:829)
    Caused by: com.cloud.utils.exception.CloudRuntimeException: Unable to mount 10.10.10.12:/KVMSecondary1 at /mnt/SecStorage/bd7fe518-f806-3eee-92f9-0819535406ae due to mount.nfs: Connection timed out
    at org.apache.cloudstack.storage.resource.NfsSecondaryStorageResource.attemptMount(NfsSecondaryStorageResource.java:3081)
    at org.apache.cloudstack.storage.resource.NfsSecondaryStorageResource.mount(NfsSecondaryStorageResource.java:3032)
    at org.apache.cloudstack.storage.resource.NfsSecondaryStorageResource.mountUri(NfsSecondaryStorageResource.java:3020)
    at org.apache.cloudstack.storage.resource.NfsSecondaryStorageResource.getRootDir(NfsSecondaryStorageResource.java:2671)
    ... 12 more

    2025-03-11T20:54:36,351 INFO [storage.resource.NfsSecondaryStorageResource] (agentRequest-Handler-2:[]) Determined host 10.10.10.12 corresponds to IP 10.10.10.12

  10. DaanHoogland commented on Mar 12, 2025

    @DaanHoogland
    Contributor

    @verendrakalsi , there still seems to be an issue with your NFS mount ; "Unable to mount 10.10.10.12:/KVMSecondary1 at /mnt/SecStorage/bd7fe518-f806-3eee-92f9-0819535406ae due to mount.nfs: Connection timed out"

  11. locked and limited conversation to collaborators on Mar 12, 2025
  12. converted this issue into a discussion #10550 on Mar 12, 2025
  13. added this to the unplanned milestone on Sep 20, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions