IT评测·应用市场-qidao123.com技术社区

标题: 学技术学英文：Tomcat的线程模型&调优 [打印本页]

作者: 鼠扑 时间: 2025-1-4 10:53
标题: 学技术学英文：Tomcat的线程模型&调优
导读：
tomcat 线程调优关键必要理解下面这几个参数：
1. maxConnections

描述：指定服务器能够同时担当和处置惩罚的最大毗连数。也就是说，服务器在任何时候都能处置惩罚的最大并发毗连数。
作用：限礼服务器在任何给定时间点能够处置惩罚的最大毗连数量，以防止资源耗尽和系统过载。

2. acceptCount

描述：指定当所有处置惩罚哀求的线程都在忙碌时，可以排队等待处置惩罚的最大哀求数。一旦这个队列满了，新进来的哀求将会被拒绝。
作用：控制在所有线程都忙碌时可以排队等待处置惩罚的最大哀求数，避免服务器过载。

3. maxThreads

描述：指定服务器能够创建的最大哀求处置惩罚线程数。这些线程用于实际处置惩罚客户端的哀求。
作用：确保服务器在高负载情况下有足够的线程来处置惩罚并发哀求，从而提高处置惩罚本领和相应速度。

4. minSpareThreads

描述：指定保持空闲状态的最小哀求处置惩罚线程数。这些空闲线程始终可用，以便快速相应新的哀求。
作用：确保在任何时候都有足够的空闲线程来处置惩罚突然增长的哀求量，从而提供更好的相应时间。

Tomcat is a popular open source servlet container in the Java ecosystem. Tomcat is the default container for spring boot web applications (spring boot also supports other containers). In this post I will describe the tomcat threading model.

Tomcat follows the thread per request model, which means tomcat will assign a thread to each incoming request. Tomcot will maintain a thread pool, a free thread will be picked from the thread and assigned to the request. If there are no free threads available in the pool, tomcat will create a new thread if the thread pool size is below the maximum allowed. If the pool size has already reached maximum size, then the request will be queued.

What is the optimal thread pool size

Tomcat default values for max pool size 200, The optimal pool size depends on the application characteristics. One can profile the application with various pool sizes and pick the one which gives best performance.

If the application is CPU intensive, then the number of concurrent requests that can be served will be limited by the number of CPU cores available in the system. Increasing the thread count for CPU intensive applications will not result in increased throughput, the system will spend most of the time in context switching than doing the actual work.

If the application is mostly doing calls to DB and serving the results to clients, then the max pool size can be much more than the number of CPU cores of the system. For spingboot deployments, following properties can be used to control the worker pool size.

For versions older than 2.3.x

server.tomcat.min-spare-threads=10

server.tomcat.max-threads=200

From 2.3.x, they became

server.tomcat.threads.min-spare=10

server.tomcat.threads.max=200

If the applications have endpoints with different characteristics, it might be a good idea to group these endpoints based on characteristics and have different deployments. For example if the application has analytic end points that take 1 second to respond, clubbing them together with endpoints that have 10ms response time may result in queue building and idle CPU ( this happens because the analytics endpoint will hold the thread until the response comes back from the DB). Large queue build up will cause spikes in latencies for clients and may also cause timeouts. The queue size can be controlled with max-connections and accept-count parameters. Tomcat will keep accepting the new connections until max-connections limit is reached, once this limit is reached connections will not be accepted by tomcat, hence they will be queued at OS level. OS will queue the connection until accept-count is reached, then connections will be refused.

server.tomcat.max-connections=8192

server.tomcat.accept-count=100

If requests takes on an average T milliseconds (when the thread pool is at its max size), then RPM that can handled by the system can be computed by the following formula

RPM = (60000/ (Tavg)) * thread_pool_size

If each request takes 100ms, and we have 10 threads, then we can serve up to 6K RPM. If more requests come in then tomcat will start queuing the requests.

免责声明：如果侵犯了您的权益，请联系站长，我们会及时删除侵权内容，谢谢合作！更多信息从访问主页：qidao123.com:ToB企服之家，中国第一个企服评测及商务社交产业平台。

欢迎光临 IT评测·应用市场-qidao123.com技术社区 (https://dis.qidao123.com/)