{"id":42258,"date":"2024-05-27T11:53:25","date_gmt":"2024-05-27T11:53:25","guid":{"rendered":"https:\/\/accuweb.cloud\/resource\/?post_type=faq&p=42258"},"modified":"2026-02-19T04:51:23","modified_gmt":"2026-02-19T04:51:23","slug":"tomcat-cluster","status":"publish","type":"faq","link":"https:\/\/accuweb.cloud\/resource\/articles\/tomcat-cluster","title":{"rendered":"Tomcat Cluster in the Cloud"},"content":{"rendered":"

Tomcat Cluster in the Cloud<\/h2>\n

The platform uses multicast to send and redirect requests to each server with a load balancer<\/a>, providing session replication between server node pairs. This ensures sessions are shared between nodes over the local network without needing extra software like Memcached. This setup supports hosting large clustered applications.<\/p>\n

This guide explains how clustering works in the platform using Tomcat as an example.<\/p>\n

\"Server<\/a><\/p>\n

The diagram shows a Tomcat cluster with two servers and one load balancer. The balancer distributes requests to different nodes based on availability and server load.<\/p>\n

If one server fails, users are automatically switched to the other server. Thanks to session replication, the other server already has all the sessions from the failed node, so users don\u2019t notice any difference.<\/p>\n

To set up Tomcat clustering in the platform, follow these steps:<\/p>\n

Step 1:<\/strong> Log into your platform dashboard.<\/p>\n

Step 2:<\/strong> Click “New Environment<\/a>“.<\/p>\n

\"Create<\/a><\/p>\n

Step 3:<\/strong> Select Tomcat<\/a> as your application server, set the cloudlet limits, and enable Auto-clustering<\/a> (High Availability) as shown below. Name the environment and click “Create<\/strong>“.<\/p>\n

\"Enable<\/a><\/p>\n

\nNote:<\/strong> Horizontal scaling<\/a> and Auto-Clustering (High Availability) are different features. Horizontal scaling uses multiple servers to evenly distribute the load, while High Availability sets up session replication between server pairs using multicast.<\/div>\n
<\/div>\n

When you enable High Availability, the system generates a special Tomcat configuration file<\/a> (tomcat-cluster.xml) for each node. Here is an example:<\/p>\n

\"Tomcat-cluster.xml\"<\/a><\/p>\n

\r\n<Cluster className=\"org.apache.catalina.ha.tcp.SimpleTcpCluster\"\r\nchannelSendOptions=\"4\">\r\n\r\n<Manager className=\"org.apache.catalina.ha.session.DeltaManager\"\r\nexpireSessionsOnShutdown=\"false\"\r\nnotifyListenersOnReplication=\"true\"\/>\r\n\r\n<Channel className=\"org.apache.catalina.tribes.group.GroupChannel\">\r\n\r\n<Membership className=\"org.apache.catalina.tribes.membership.McastService\"\r\naddress=\"10.100.2.55\"\r\nport=\"${MagicPort}\"\r\nfrequency=\"500\"\r\ndropTime=\"3000\"\/>\r\n\r\n<Receiver className=\"org.apache.catalina.tribes.transport.nio.NioReceiver\"\r\naddress=\"${ReceiverIp}\"\r\nport=\"4000\"\r\nautoBind=\"100\"\r\nselectorTimeout=\"5000\"\r\nmaxThreads=\"6\"\/>\r\n\r\n<Sender className=\"org.apache.catalina.tribes.transport.ReplicationTransmitter\">\r\n<Transport className=\"org.apache.catalina.tribes.transport.nio.PooledParallelSender\"\/>\r\n<\/Sender>\r\n\r\n<Interceptor className=\"org.apache.catalina.tribes.group.interceptors.TcpFailureDetector\"\/>\r\n<Interceptor className=\"org.apache.catalina.tribes.group.interceptors.MessageDispatch15Interceptor\"\/>\r\n<\/Channel>\r\n\r\n<Valve className=\"org.apache.catalina.ha.tcp.ReplicationValve\"\r\nfilter=\"\"\/>\r\n<Valve className=\"org.apache.catalina.ha.session.JvmRouteBinderValve\"\/>\r\n\r\n<ClusterListener className=\"org.apache.catalina.ha.session.JvmRouteSessionIDBinderListener\"\/>\r\n<ClusterListener className=\"org.apache.catalina.ha.session.ClusterSessionListener\"\/>\r\n<\/Cluster><\/code><\/pre>\n
Let’s look at this file in detail:<\/p>\n
1. This is the main element where all other cluster elements are configured.<\/p>\n
\r\n<Cluster className=\"org.apache.catalina.ha.tcp.SimpleTcpCluster\"\r\nchannelSendOptions=\"4\"><\/code><\/pre>\n
The channelSendOptions flag is attached to every message sent by the SimpleTcpCluster class or any object using the SimpleTcpCluster.send method.<\/p>\n
2. The DeltaManager uses the SimpleTcpCluster.send method to send information through the channel.<\/p>\n
\r\n<Manager className=\"org.apache.catalina.ha.session.DeltaManager\"\r\nexpireSessionsOnShutdown=\"false\"\r\nnotifyListenersOnReplication=\"true\"\/><\/code><\/pre>\n
3. The group communication framework inside Tomcat is called Tribes. It is used here as the channel element. It handles membership, logic, and communication.<\/p>\n
\r\n<Channel className=\"org.apache.catalina.tribes.group.GroupChannel\"><\/code><\/pre>\n
4. Membership is done using multicast. Tomcat clusters use a multicast address and port number. Communication between nodes happens over TCP.<\/p>\n
\r\n<Membership className=\"org.apache.catalina.tribes.membership.McastService\"\r\naddress=\"228.0.0.4\"\r\nport=\"${MagicPort}\"\r\nfrequency=\"500\"\r\ndropTime=\"3000\"\/>\r\n{MagicPort} is a unique port number for the cluster, generated automatically.<\/code><\/pre>\n
5. Tribes’ data sending and receiving logic includes two parts: sender and receiver. The Receiver handles data receiving and has a thread pool with maxThreads and minThreads settings. The address attribute is the host address broadcasted to other nodes.<\/p>\n
\r\n<Receiver className=\"org.apache.catalina.tribes.transport.nio.NioReceiver\"\r\naddress=\"${ReceiverIp}\"\r\nport=\"4000\"\r\nautoBind=\"100\"\r\nselectorTimeout=\"5000\"\r\nmaxThreads=\"6\"\/><\/code><\/pre>\n
6. The Sender sends messages to other nodes. It includes the ReplicationTransmitter and Transport sub-component. Messages can be sent concurrently with NIO and a pool of senders.<\/p>\n
\r\n<Sender className=\"org.apache.catalina.tribes.transport.ReplicationTransmitter\">\r\n<Transport className=\"org.apache.catalina.tribes.transport.nio.PooledParallelSender\"\/>\r\n<\/Sender><\/code><\/pre>\n
7. The elements of the Tribes stack interceptors are:<\/p>\n