ZStack Cloud 4.4.0>Product Manuals>Technical Whitepaper>Product Profiles>ZStack Cloud Functional Architecture

Product Profiles

ZStack Cloud Functional Architecture

The functional architecture of ZStack Cloud is shown in Figure 1.

ZStack Cloud helps enterprises better manage their infrastructure resources, such as the compute, storage, and network resources, in their data centers. The bottom layer of ZStack Cloud supports both KVM and VMware virtualization technologies. In addition, ZStack Cloud supports various storage types, such as DAS, NAS, SAN, and DFS. To be more specific, local storage, NFS storage, SAN storage, and distributed block storage are supported. ZStack Cloud also supports various network models, such as VLAN and VXLAN.

ZStack Cloud communicates with the MariaDB database and other service modules by using a message bus, providing diversified features such as VM instance management, host management, storage management, network management, billing management, and real-time monitoring. In addition, ZStack Cloud provides Java SDKs and Python SDKs, and allows you to schedule and manage resources by using RESTful APIs. With ZStack Cloud, you can build a private cloud that is simple, strong, scalable, and smart.

Highlights of ZStack Cloud functional architecture:

Asynchronous Architecture: asynchronous message, asynchronous method, and asynchronous HTTP call
- ZStack Cloud connects various services by using a message bus. When a service calls another service, the source service sends a message to the destination service, registers a callback function, and then returns back immediately. Once the destination service finishes the task, it gives a feedback on the task result by triggering the callback function that was registered by the source service. Asynchronous messages can be processed in parallel.
- Services in ZStack Cloud communicate with each other through asynchronous messages. The components and plugins inside each service are also called by using the asynchronous method, which is the same as calling asynchronous messages.
- Every plugin in ZStack Cloud has a corresponding agent. ZStack Cloud puts a callback URL in the HTTP header of every request. Therefore, agents can send responses to the URL of the caller when tasks are finished.
- Based on the asynchronous message, asynchronous method, and asynchronous HTTP call, ZStack Cloud builds a layered architecture to ensure that asynchronous operations can be performed on all components.
- Based on the asynchronous architecture, ZStack Cloud with a single management node can process tens of thousands of concurrent API requests per second, and simultaneously manage tens of thousands of servers and hundreds of thousands of VM instances.
Stateless Service: A single request does not rely on other requests.
- In ZStack Cloud, requests sent by compute node agents, storage agents, network services, console proxy services, and configuration services can be processed without relying on other requests. The sent requests contain all the required information, and related nodes do not need to maintain or store any information.
- ZStack Cloud authenticates resources such as management nodes and compute nodes through consistent hashing ring by using their UUIDs as the unique ID. Because of the consistent hashing ring, a message sender does not need to know which service instance is about to handle the message. Services do not need to maintain or exchange information about what resources they are managing. All the services need to do is to handle the incoming messages.
- Little information is shared among ZStack Cloud management nodes. Therefore, a minimum of two management nodes can meet the requirements of high availability and scalability.
- The stateless service mechanism makes the system more robust. Restarting the server will not lose any state information. This also simplifies the scaling out and scaling in of a data center.
Lock-free Architecture: consistent hashing algorithm
- The consistent hashing algorithm guarantees all messages of the same resource are always handled by the same service instance. In this way, messages are congregated to a specified node, reducing the complexity of synchronization and concurrency.
- ZStack Cloud uses work queue to avoid lock contention. Serial tasks are stored in memory as work queues. Work queues can process any operation of any resource in parallel to improve system concurrency.
- The queue-based lock-free architecture enables tasks to run in parallel, thereby improving the system performance.
In-Process Microservices Architecture: microservices decoupling
- ZStack Cloud uses a message bus to isolate and control various services, such as VM instance services, identity authentication services, snapshot services, volume services, network services, and storage services. All microservices are enclosed in the same process of a management node. These services communicate with each other through the message bus. After all messages are sent to the message bus, the destination service is selected by the consistent hashing ring for message forwarding.
- In-process microservices provide a star-like architecture, ensuring every service in microservices to run independently. This architecture also decouples the highly centralized control business, and achieves a high degree of autonomy and isolation of the system. Failure of any service does not affect other components. This effectively guarantees the system reliability and stability.
Versatile Plugin System: supports horizontal expansion of plugins
- In ZStack Cloud, every plugin provides services independently. Any newly added plugin has no impact on other existing plugins.
- ZStack Cloud concludes plugins into two patterns: strategy pattern and observer pattern. Strategy pattern plugins will inherit parent-class interfaces and then perform specific implementations. Observer pattern plugins will register a listener to monitor event changes of the internal business logic in an application. Once an event is detected inside the application, the observer pattern plugins will respond to this event automatically and execute a piece of code to affect the corresponding business flow.
- ZStack Cloud supports horizontal expansion of plugins. The Cloud can be quickly upgraded, and the overall system architecture still remains robust.
Workflow Engine: sequence-based management, rollback on errors
- ZStack Cloud clearly defines every workflow by using XML files. Every flow can be rolled back on errors. A workflow can roll back all prior executed steps and clean up the garbage resources during the execution when an error happens in a step.
- Each workflow can contain a sub-flow to decouple the business logic further.
Tag System: extends the business logic and adds resource properties
- ZStack Cloud uses system tags and plugins to extend the original business logic.
- You can use tags to group your resources and search for resources with specific tags.
Cascade Framework: supports cascading operations on resources
- ZStack Cloud uses a cascade framework to perform cascading operations on resources. The cascade framework allows an operation to be cascaded from one resource to other resources. For example, the operation of uninstalling or deleting a resource can be cascaded to the descendant resources.
- Resources can join in a cascade framework through a plugin. Joining or quitting the cascade framework will not affect other resources.
- The cascading mechanism makes the configuration of ZStack Cloud more flexible and simple, meeting the requirements of resource configuration changes.
Full Automation By Ansible: automated deployment by agentless Ansible
- Being seamlessly integrated with Ansible (which is agentless), ZStack Cloud can automatically install dependencies, configure physical resources, and deploy agents. This whole process is transparent to users and requires no additional intervention. You can upgrade your agents simply by reconnecting the agents.
Comprehensive Query API: Every property of every resource can be queried.
- ZStack Cloud supports millions of query conditions, comprehensive query APIs, and any way of condition combinations.

Next Chapter:ZStack Cloud Resource Model