2023-08-16  阅读(246)
原文作者:Ressmix 原文地址:https://www.tpvlog.com/article/372

我在《透彻理解Apache Dubbo(八)——dubbo-remoting模块:核心接口》中,对dubbo-remoting 模块的整体结构及核心接口进行过介绍。Remoting 层,包括了 Exchange、Transport和 Serialize 三个子层。本章,我就来对Transport子层中的核心接口的实现进行分析。

202308162141392421.png

一、AbstractPeer

我们首先来看 AbstractPeer 这个抽象类,它同时实现了 Endpoint 接口和 ChannelHandler 接口,是 AbstractChannel、AbstractEndpoint 抽象类的父类。

202308162141407472.png

1.1 核心字段

AbstractPeer 中有四个字段:

    public abstract class AbstractPeer implements Endpoint, ChannelHandler {
    
        // 内部的ChannelHandler对象,AbstractPeer对ChannelHandler接口的所有实现,都委托给了该对象
        private final ChannelHandler handler;
    
        // 表示该端点自身的URL
        private volatile URL url;
    
        // 记录当前端点的状态
        private volatile boolean closing;
        // 记录当前端点的状态
        private volatile boolean closed;
    }

二、AbstractEndpoint

AbstractEndpoint 继承了 AbstractPeer 抽象类,它是AbstractClient和AbstractServer的父类:

202308162141418753.png

2.1 核心字段

它的内部维护了一个 Codec2 对象和两个超时时间(timeout 字段和 connectTimeout 字段),AbstractEndpoint 的构造方法根据传入的 URL 来初始化这三个字段:

    public abstract class AbstractEndpoint extends AbstractPeer implements Resetable {
    
        private Codec2 codec;
    
        private int timeout;
        private int connectTimeout;
    
        public AbstractEndpoint(URL url, ChannelHandler handler) {
            super(url, handler);
    
            // 根据URL中的codec参数值,确定具体的Codec2实现类
            this.codec = getChannelCodec(url);
    
            // 根据URL中的timeout参数,确定timeout字段值,默认1000
            this.timeout = url.getPositiveParameter(TIMEOUT_KEY, DEFAULT_TIMEOUT);
    
            // 根据URL中的connect.timeout参数,确定connectTimeout字段值,默认3000
            this.connectTimeout = url.getPositiveParameter(Constants.CONNECT_TIMEOUT_KEY, Constants.DEFAULT_CONNECT_TIMEOUT);
        }
        //...
    }

Codec2是一个SPI扩展点,上述的AbstractEndpoint.getChannelCodec() 方法就是基于 Dubbo SPI 选择其扩展实现的:

    // AbstractEndpoint.java
    
    protected static Codec2 getChannelCodec(URL url) {
        // 根据URL的codec参数获取扩展名
        String codecName = url.getParameter(Constants.CODEC_KEY, "telnet");
        if (ExtensionLoader.getExtensionLoader(Codec2.class).hasExtension(codecName)) {
            return ExtensionLoader.getExtensionLoader(Codec2.class).getExtension(codecName);
        } else {
            // Codec2接口不存在相应的扩展名,就尝试从Codec这个老接口的扩展名中查找,目前Codec接口已经废弃
            return new CodecAdapter(ExtensionLoader.getExtensionLoader(Codec.class)
                                    .getExtension(codecName));
        }
    }

另外,AbstractEndpoint 还实现了 Resetable 接口(只有一个 reset() 方法),AbstractEndpoint 的 reset() 方法逻辑非常简单,就是根据传入的 URL 参数重置 AbstractEndpoint 的三个字段:

    // AbstractEndpoint.java
    
    public void reset(URL url) {
        // 检测当前AbstractEndpoint是否已经关闭(略)
        if (isClosed()) {
            throw new IllegalStateException("Failed to reset parameters "
                                            + url + ", cause: Channel closed. channel: " + getLocalAddress());
        }
        // 重置timeout
        try {
            if (url.hasParameter(TIMEOUT_KEY)) {
                int t = url.getParameter(TIMEOUT_KEY, 0);
                if (t > 0) {
                    this.timeout = t;
                }
            }
        } catch (Throwable t) {
            logger.error(t.getMessage(), t);
        }
        // 重置connectTimeout
        try {
            if (url.hasParameter(Constants.CONNECT_TIMEOUT_KEY)) {
                int t = url.getParameter(Constants.CONNECT_TIMEOUT_KEY, 0);
                if (t > 0) {
                    this.connectTimeout = t;
                }
            }
        } catch (Throwable t) {
            logger.error(t.getMessage(), t);
        }
        try {
            if (url.hasParameter(Constants.CODEC_KEY)) {
                this.codec = getChannelCodec(url);
            }
        } catch (Throwable t) {
            logger.error(t.getMessage(), t);
        }
    }

三、AbstractChannel

AbstractChannel 也继承了 AbstractPeer 抽象类,同时还继承了 Channel 接口:

202308162141427094.png

AbstractChannel 的实现非常简单,只是在 send() 方法中检测底层连接的状态,没有实现具体发送消息的逻辑:

    public abstract class AbstractChannel extends AbstractPeer implements Channel {
    
        public AbstractChannel(URL url, ChannelHandler handler) {
            super(url, handler);
        }
    
        @Override
        public void send(Object message, boolean sent) throws RemotingException {
            if (isClosed()) {
                // ...抛出异常
            }
        }
    }

3.1 NettyChannel

这里我以 Netty 4 的实现—— NettyChannel 为例,分析它对 AbstractChannel 的实现:

    final class NettyChannel extends AbstractChannel {
        // Netty Channel 与 Dubbo Channel 对象一一对应
        private static final ConcurrentMap<Channel, NettyChannel> CHANNEL_MAP = new ConcurrentHashMap<Channel, NettyChannel>();
    
        // 底层的Netty Channel
        private final Channel channel;
    
        // 当前 Channel 中的附加属性,都会记录到该 Map 中
        private final Map<String, Object> attributes = new ConcurrentHashMap<String, Object>();
    
        // 标识当前 Channel 是否可用
        private final AtomicBoolean active = new AtomicBoolean(false);
    
        public void send(Object message, boolean sent) throws RemotingException {
            // 调用AbstractChannel的send()方法,检测连接是否可用
            super.send(message, sent);
    
            boolean success = true;
            int timeout = 0;
            try {
                // 依赖Netty框架的Channel发送数据
                ChannelFuture future = channel.writeAndFlush(message);
                if (sent) {    // 等待发送结束,有超时时间
                    timeout = getUrl().getPositiveParameter(TIMEOUT_KEY, DEFAULT_TIMEOUT);
                    success = future.await(timeout);
                }
                // 异常
                Throwable cause = future.cause();
                if (cause != null) {
                    throw cause;
                }
            } catch (Throwable e) {
                // 在底层连接断开时,删除缓存的底层Channel
                removeChannelIfDisconnected(channel);
                throw new RemotingException(this, "Failed to send message " + PayloadDropper.getRequestWithoutData(message) + " to " + getRemoteAddress() + ", cause: " + e.getMessage(), e);
            }
            if (!success) {
                throw new RemotingException(this, "Failed to send message " + PayloadDropper.getRequestWithoutData(message) + " to " + getRemoteAddress() + "in timeout(" + timeout + "ms) limit");
            }
        }
    }

四、AbstractServer

AbstractServer 是对服务端的抽象,实现了服务端的公共逻辑 。它继承了 AbstractEndpoint 抽象类,同时还实现了 RemotingServer 接口,如下图所示:

202308162141435145.png

4.1 核心字段

AbstractServer 的核心字段:

    public abstract class AbstractServer extends AbstractEndpoint implements RemotingServer {
    
        // Server的本地地址
        private InetSocketAddress localAddress;
    
        // Server的绑定地址
        private InetSocketAddress bindAddress;
    
        // Server能接收的最大连接数,从URL的 accepts 参数中获取,默认值0,表示没有限制
        private int accepts;
    
        // 连接空闲时间
        private int idleTimeout;
    
        // 负责管理线程池,ExecutorRepository是一个SPI扩展点
        private ExecutorRepository executorRepository = ExtensionLoader.getExtensionLoader(ExecutorRepository.class).getDefaultExtension();
    
        // 当前Server关联的线程池,由ExecutorRepository创建并管理
        ExecutorService executor;
    
        protected static final String SERVER_THREAD_POOL_NAME = "DubboServerHandler";
    }

在 AbstractServer 的构造方法中,会根据传入的 URL初始化上述字段,并调用 doOpen() 这个抽象方法完成 Server 的启动:

    // AbstractServer.java
    
    public AbstractServer(URL url, ChannelHandler handler) throws RemotingException {
        super(url, handler);
    
        localAddress = getUrl().toInetSocketAddress();
        String bindIp = getUrl().getParameter(Constants.BIND_IP_KEY, getUrl().getHost());
        int bindPort = getUrl().getParameter(Constants.BIND_PORT_KEY, getUrl().getPort());
        if (url.getParameter(ANYHOST_KEY, false) || NetUtils.isInvalidLocalHost(bindIp)) {
            bindIp = ANYHOST_VALUE;
        }
        bindAddress = new InetSocketAddress(bindIp, bindPort);
        this.accepts = url.getParameter(ACCEPTS_KEY, DEFAULT_ACCEPTS);
        this.idleTimeout = url.getParameter(IDLE_TIMEOUT_KEY, DEFAULT_IDLE_TIMEOUT);
        try {
            // 启动Server,抽象方法,由子类实现
            doOpen();
        } catch (Throwable t) {
            throw new RemotingException(url.toInetSocketAddress(), null, "Failed to bind " + getClass().getSimpleName() + " on " + getLocalAddress() + ", cause: " + t.getMessage(), t);
        }
        // 获取该Server关联的线程池
        executor = executorRepository.createExecutorIfAbsent(url);
    }

4.2 Server启停

以NettyServer为例,我们来看看doOpen方法,其实就是基于Netty API完成Server的启动:

    // NettyServer.java
    
    public class NettyServer extends AbstractServer {
    
        private Map<String, Channel> channels;
    
        private ServerBootstrap bootstrap;
    
        private io.netty.channel.Channel channel;
    
        private EventLoopGroup bossGroup;
        private EventLoopGroup workerGroup;
    
        protected void doOpen() throws Throwable {
            // 创建ServerBootstrap
            bootstrap = new ServerBootstrap();
            // 创建boss EventLoopGroup
            bossGroup = NettyEventLoopFactory.eventLoopGroup(1, "NettyServerBoss");
            // 创建worker EventLoopGroup
            workerGroup = NettyEventLoopFactory.eventLoopGroup(
                getUrl().getPositiveParameter(IO_THREADS_KEY, Constants.DEFAULT_IO_THREADS),
                "NettyServerWorker");
    
            // 创建NettyServerHandler,它是一个Netty中的ChannelHandler实现
            // 注意这里将NettyServer作为Dubbo ChannelHandler
            final NettyServerHandler nettyServerHandler = new NettyServerHandler(getUrl(), this);
    
            // 获取当前NettyServer创建的所有Netty Channel
            channels = nettyServerHandler.getChannels();
    
            // 初始化ServerBootstrap
            bootstrap.group(bossGroup, workerGroup)
                .channel(NettyEventLoopFactory.serverSocketChannelClass())
                .option(ChannelOption.SO_REUSEADDR, Boolean.TRUE)
                .childOption(ChannelOption.TCP_NODELAY, Boolean.TRUE)
                .childOption(ChannelOption.ALLOCATOR, PooledByteBufAllocator.DEFAULT)
                .childHandler(new ChannelInitializer<SocketChannel>() {
                    @Override
                    protected void initChannel(SocketChannel ch) throws Exception {
                        // 连接空闲超时时间
                        int idleTimeout = UrlUtils.getIdleTimeout(getUrl());
                        // NettyCodecAdapter中会创建Decoder和Encoder
                        NettyCodecAdapter adapter = new NettyCodecAdapter(getCodec(), getUrl(), NettyServer.this);
                        if (getUrl().getParameter(SSL_ENABLED_KEY, false)) {
                            ch.pipeline().addLast("negotiation",
                                                  SslHandlerInitializer.sslServerHandler(getUrl(), nettyServerHandler));
                        }
    
                        ch.pipeline()
                            // 注册Decoder
                            .addLast("decoder", adapter.getDecoder())    
                            // 注册Encoder
                            .addLast("encoder", adapter.getEncoder())
                            // 注册IdleStateHandler,用于心跳和空闲长连接处理
                            .addLast("server-idle-handler", new IdleStateHandler(0, 0, idleTimeout, MILLISECONDS))
                            // 注册NettyServerHandler
                            .addLast("handler", nettyServerHandler);
                    }
                });
    
            // 绑定本地Server地址并启动
            ChannelFuture channelFuture = bootstrap.bind(getBindAddress());
            channelFuture.syncUninterruptibly();
            channel = channelFuture.channel();
        }
    }

上述Server的启动过程中,关键是在Netty Channel中注册的四个ChannelHandler:

202308162141440526.png

我来逐个讲解下这四个 ChannelHandler 的核心功能。

InternalEncoder

InternalEncoder,是 NettyCodecAdapter 的内部类,它继承了 Netty 中的 MessageToByteEncoder。InternalEncoder 会将真正的编码功能委托给 NettyServer 内部的 Codec2 对象去处理:

    // NettyCodecAdapter.InternalEncoder.java
    
    private class InternalEncoder extends MessageToByteEncoder {
    
        @Override
        protected void encode(ChannelHandlerContext ctx, Object msg, ByteBuf out) throws Exception {
            // 将Netty ByteBuf封装成统一的ChannelBuffer
            org.apache.dubbo.remoting.buffer.ChannelBuffer buffer = new NettyBackedChannelBuffer(out);
    
            // 拿到关联的Netty Channel
            Channel ch = ctx.channel();
    
            NettyChannel channel = NettyChannel.getOrAddChannel(ch, url, handler);
    
            // 编码
            codec.encode(channel, buffer, msg);
        }
    }

InternalDecoder

InternalDecoder,也是 NettyCodecAdapter 的内部类,它继承了 Netty 中的 ByteToMessageDecoder。InternalDecoder 会将真正的解码功能委托给 NettyServer 内部的 Codec2 对象去处理:

    private class InternalDecoder extends ByteToMessageDecoder {
    
        @Override
        protected void decode(ChannelHandlerContext ctx, ByteBuf input, List<Object> out) throws Exception {
    
            // 将Netty ByteBuf封装成统一的ChannelBuffer
            ChannelBuffer message = new NettyBackedChannelBuffer(input);
    
            // 拿到关联的Netty Channel
            NettyChannel channel = NettyChannel.getOrAddChannel(ctx.channel(), url, handler);
    
            do {
                // 记录当前readerIndex的位置
                int saveReaderIndex = message.readerIndex();
                // 委托给Codec2进行解码
                Object msg = codec.decode(channel, message);
                // 当前接收到的数据不足一个消息的长度,会返回NEED_MORE_INPUT
                if (msg == Codec2.DecodeResult.NEED_MORE_INPUT) {
                    // 重置readerIndex
                    message.readerIndex(saveReaderIndex);
                    break;
                } else {
                    if (saveReaderIndex == message.readerIndex()) {
                        throw new IOException("Decode without read data.");
                    }
                    // 将读取到的消息传递给后面的Handler处理
                    if (msg != null) {
                        out.add(msg);
                    }
                }
            } while (message.readable());
        }
    }

IdleStateHandler

IdleStateHandler,是 Netty 提供的一个工具 ChannelHandler,用于定时心跳以及关闭空闲长连接,源码我就不赘述了,读者可以参考我的专栏《透彻理解Java网络编程》。我这里简单介绍下IdleStateHandler的工作流程:

  1. 首先,IdleStateHandler 会通过 lastReadTimelastWriteTime 等几个字段,记录了最近一次读/写事件的时间;
  2. IdleStateHandler 初始化时,会创建一个定时任务,定时检测当前时间与最后一次读/写时间的差值,如果超过我们设置的阈值(也就是上面 AbstractServer 中设置的 idleTimeout),就会触发 IdleStateEvent 事件;
  3. IdleStateEvent 事件会根据Netty Channel传播链,传递给后续的 ChannelHandler 进行处理,后续 ChannelHandler 的 userEventTriggered()方法会根据接收到的 IdleStateEvent 事件,决定是关闭空闲长连接,还是发送心跳探活。

NettyServerHandler

最后来看NettyServerHandler,它继承了Netty中的 ChannelDuplexHandler,也就是说可以同时处理 Inbound 数据和 Outbound 数据。在 NettyServerHandler 中有 channelshandler 两个核心字段:

    @io.netty.channel.ChannelHandler.Sharable
    public class NettyServerHandler extends ChannelDuplexHandler {
    
        // 保存了当前Server创建的所有 Channel
        private final Map<String, Channel> channels = new ConcurrentHashMap<String, Channel>();
    
        // 这个handler就是NettyServer
        // NettyServerHandler中的几乎所有方法都会触发该对象的方法执行
        private final ChannelHandler handler;
    
        public NettyServerHandler(URL url, ChannelHandler handler) {
            if (url == null) {
                throw new IllegalArgumentException("url == null");
            }
            if (handler == null) {
                throw new IllegalArgumentException("handler == null");
            }
            this.url = url;
            // handler是在NettyServer.doOpen()方法中创建的
            this.handler = handler;
        }
        //...
    }

我这里以 write() 方法为例,对NettyServerHandler的处理流程进行简单分析:

    // NettyServerHandler.java
    
    public void write(ChannelHandlerContext ctx, Object msg, ChannelPromise promise) throws Exception {
        // 将发送的数据继续向下传递
        super.write(ctx, msg, promise);
        NettyChannel channel = NettyChannel.getOrAddChannel(ctx.channel(), url, handler);
        handler.sent(channel, msg);
    }

从 AbstractPeer 开始往下,一路继承下来,NettyServer 拥有了 Endpoint、ChannelHandler 以及RemotingServer多个接口的能力,关联了一个 ChannelHandler 对象以及 Codec2 对象,并最终将数据委托给这两个对象进行处理。

202308162141446367.png

4.3 ExecutorRepository

AbstractServer中有一个ExecutorRepository类,它负责创建并管理 Dubbo 中的线程池,该接口虽然是个 SPI 扩展点,但是只有一个默认实现—— DefaultExecutorRepository

    @SPI("default")
    public interface ExecutorRepository {
    
        // 根据 URL 参数,创建相应的线程池
        ExecutorService createExecutorIfAbsent(URL url);
    
        // 根据 URL 参数,查询相应的线程池
        ExecutorService getExecutor(URL url);
    
        // 根据 URL 参数,更新线程池的属性,比如coreSize, maxSize, ...
        void updateThreadpool(URL url, ExecutorService executor);
    
        // 获取调度线程池
        ScheduledExecutorService nextScheduledExecutor();
    
        // 获取调度线程池
        ScheduledExecutorService getServiceExporterExecutor();
    
        // 获取默认的共享线程池
        ExecutorService getSharedExecutor();
    }

DefaultExecutorRepository中维护了一个 ConcurrentMap<String, ConcurrentMap<Integer, ExecutorService>> 集合,缓存了已有的线程池:

  • 第一层 Key 值:表示线程池属于 Provider 端还是 Consumer 端;
  • 第二层 Key 值:表示线程池关联服务的端口。
    public class DefaultExecutorRepository implements ExecutorRepository {
        // 根据CPU核数,计算默认的线程数
        private int DEFAULT_SCHEDULER_SIZE = Runtime.getRuntime().availableProcessors();
    
        private final ExecutorService SHARED_EXECUTOR = Executors.newCachedThreadPool(new NamedThreadFactory("DubboSharedHandler", true));
    
        private Ring<ScheduledExecutorService> scheduledExecutors = new Ring<>();
    
        private ScheduledExecutorService serviceExporterExecutor;
    
        private ScheduledExecutorService reconnectScheduledExecutor;
    
        // 缓存已有的线程池
        private ConcurrentMap<String, ConcurrentMap<Integer, ExecutorService>> data = new ConcurrentHashMap<>();
        //...
    }

DefaultExecutorRepository.createExecutorIfAbsent() 方法会根据 URL 参数,创建相应的线程池并缓存在合适的位置:

    // DefaultExecutorRepository.java
    
    public synchronized ExecutorService createExecutorIfAbsent(URL url) {
        // 根据URL中的side参数值决定第一层key,即判断是Consumer还是Provider
        String componentKey = EXECUTOR_SERVICE_COMPONENT_KEY;
        if (CONSUMER_SIDE.equalsIgnoreCase(url.getParameter(SIDE_KEY))) {
            componentKey = CONSUMER_SIDE;
        }
    
        Map<Integer, ExecutorService> executors = data.computeIfAbsent(componentKey, k -> new ConcurrentHashMap<>());
    
        // 根据URL中的port值确定第二层key
        Integer portKey = url.getPort();
        ExecutorService executor = executors.computeIfAbsent(portKey, k -> createExecutor(url));
        // 如果缓存中相应的线程池已关闭,则同样需要调用createExecutor()方法创建新的线程池,并替换掉缓存中已关闭的线程持
        if (executor.isShutdown() || executor.isTerminated()) {
            executors.remove(portKey);
            executor = createExecutor(url);
            executors.put(portKey, executor);
        }
        return executor;
    }

4.4 ThreadPool

在上述的 DefaultExecutorRepository.createExecutor() 方法中,会通过 Dubbo SPI 查找 ThreadPool 接口的扩展实现,并调用其 getExecutor() 方法创建线程池:

    // DefaultExecutorRepository.java
    
    private ExecutorService createExecutor(URL url) {
        return (ExecutorService) ExtensionLoader.getExtensionLoader(ThreadPool.class).getAdaptiveExtension().getExecutor(url);
    }

ThreadPool 接口被 @SPI 注解修饰,默认使用 FixedThreadPool 实现。同时,ThreadPool 接口中的 getExecutor() 方法被 @Adaptive 注解修饰,动态生成的适配器类会优先根据 URL 中的 threadpool 参数选择 ThreadPool 的扩展实现:

    @SPI("fixed")
    public interface ThreadPool {
        @Adaptive({THREADPOOL_KEY})
        Executor getExecutor(URL url);
    }

ThreadPool 有很多实现类,如下图,不同实现会根据 URL 参数创建不同特性的线程池:

202308162141454498.png

CacheThreadPool 为例:

    public class CachedThreadPool implements ThreadPool {
    
        @Override
        public Executor getExecutor(URL url) {
            String name = url.getParameter(THREAD_NAME_KEY, DEFAULT_THREAD_NAME);
            // 核心线程数
            int cores = url.getParameter(CORE_THREADS_KEY, DEFAULT_CORE_THREADS);
            // 最大线程数
            int threads = url.getParameter(THREADS_KEY, Integer.MAX_VALUE);
            // 队列深度
            int queues = url.getParameter(QUEUES_KEY, DEFAULT_QUEUES);
            // 非核心线程的最大空闲时长,当非核心线程空闲时间超过该值时,会被回收
            int alive = url.getParameter(ALIVE_KEY, DEFAULT_ALIVE);、
            // 创建线程池
            return new ThreadPoolExecutor(cores, threads, alive, TimeUnit.MILLISECONDS,
                    queues == 0 ? new SynchronousQueue<Runnable>() :
                            (queues < 0 ? new LinkedBlockingQueue<Runnable>()
                                    : new LinkedBlockingQueue<Runnable>(queues)),
                    new NamedInternalThreadFactory(name, true), new AbortPolicyWithReport(name, url));
        }
    }

在 ThreadPool 的子类中, LimitedThreadPoolFixedThreadPoolCacheThreadPool 均基于 JDK ThreadPoolExecutor 线程池实现,在核心线程全部被占用时,会优先将任务放到缓冲队列中缓存,在缓冲队列满了之后,才会尝试创建新线程来处理任务。

最特殊的是 EagerThreadPool ,底层是一个EagerThreadPoolExecutor线程池,它是Dubbo自己实现的一个特殊线程池(继承了ThreadPoolExecutor):

    public class EagerThreadPool implements ThreadPool {
    
        @Override
        public Executor getExecutor(URL url) {
            String name = url.getParameter(THREAD_NAME_KEY, DEFAULT_THREAD_NAME);
            int cores = url.getParameter(CORE_THREADS_KEY, DEFAULT_CORE_THREADS);
            int threads = url.getParameter(THREADS_KEY, Integer.MAX_VALUE);
            int queues = url.getParameter(QUEUES_KEY, DEFAULT_QUEUES);
            int alive = url.getParameter(ALIVE_KEY, DEFAULT_ALIVE);
    
            // TaskQueue继承自LinkedBlockingQueue
            TaskQueue<Runnable> taskQueue = new TaskQueue<Runnable>(queues <= 0 ? 1 : queues);
            EagerThreadPoolExecutor executor = new EagerThreadPoolExecutor(cores,
                    threads,
                    alive,
                    TimeUnit.MILLISECONDS,
                    taskQueue,
                    new NamedInternalThreadFactory(name, true),
                    new AbortPolicyWithReport(name, url));
            taskQueue.setExecutor(executor);
            return executor;
        }
    }

EagerThreadPoolExecutor的特点是: 在线程数没有达到最大线程数的前提下,EagerThreadPoolExecutor 会优先创建线程来执行任务,而不是放到缓冲队列中;当线程数达到最大值时,EagerThreadPoolExecutor 会将任务放入缓冲队列,等待空闲线程

EagerThreadPoolExecutor 覆盖了 ThreadPoolExecutor 中的两个方法:execute() 方法和 afterExecute() 方法,具体实现如下:

    public class EagerThreadPoolExecutor extends ThreadPoolExecutor {
        // 当前在线程池中的任务总数:正在线执行的任务数 + 缓冲队列中等待的任务数
        private final AtomicInteger submittedTaskCount = new AtomicInteger(0);
    
        public EagerThreadPoolExecutor(int corePoolSize,
                                       int maximumPoolSize,
                                       long keepAliveTime,
                                       TimeUnit unit, TaskQueue<Runnable> workQueue,
                                       ThreadFactory threadFactory,
                                       RejectedExecutionHandler handler) {
            super(corePoolSize, maximumPoolSize, keepAliveTime, unit, workQueue, threadFactory, handler);
        }
    
        @Override
        protected void afterExecute(Runnable r, Throwable t) {
            // 任务执行结束,递减submittedTaskCount
            submittedTaskCount.decrementAndGet();
        }
    
        @Override
        public void execute(Runnable command) {
            if (command == null) {
                throw new NullPointerException();
            }
            // 任务提交前,递增submittedTaskCount
            submittedTaskCount.incrementAndGet();
            try {
                // 提交任务
                super.execute(command);
            } catch (RejectedExecutionException rx) {    // 任务被拒绝
                final TaskQueue queue = (TaskQueue) super.getQueue();
                try {
                    // 尝试再次放入队列中缓存,等待空闲线程执行
                    if (!queue.retryOffer(command, 0, TimeUnit.MILLISECONDS)) {
                        // 再次入队被拒绝,则队列已满,无法执行任务
                        submittedTaskCount.decrementAndGet();
                        throw new RejectedExecutionException("Queue capacity is full.", rx);
                    }
                } catch (InterruptedException x) {    // 再次入队列异常
                    submittedTaskCount.decrementAndGet();
                    throw new RejectedExecutionException(x);
                }
            } catch (Throwable t) {    // 任务提交异常
                submittedTaskCount.decrementAndGet();
                throw t;
            }
        }
    }

优先创建线程执行任务的逻辑其实是包含在TaskQueue中,它覆写了 LinkedBlockingQueue.offer() 方法,会判断线程池的 submittedTaskCount 值是否已经达到最大线程数,如果未超过,则会返回 false,迫使线程池创建新线程来执行任务:

    public class TaskQueue<R extends Runnable> extends LinkedBlockingQueue<Runnable> {
    
        private EagerThreadPoolExecutor executor;
    
        @Override
        public boolean offer(Runnable runnable) {
            if (executor == null) {
                throw new RejectedExecutionException("The task queue does not have executor!");
            }
    
            // 获取当前线程池中的活跃线程数
            int currentPoolThreadSize = executor.getPoolSize();
    
            // 有线程空闲,直接将任务提交到队列中,空闲线程会直接从队列中获取任务执行
            if (executor.getSubmittedTaskCount() < currentPoolThreadSize) {
                return super.offer(runnable);
            }
    
            // 没有空闲线程,但还可以创建新线程,则返回false,迫使线程池创建新线程来执行任务
            if (currentPoolThreadSize < executor.getMaximumPoolSize()) {
                return false;
            }
    
            // 当前线程数已经达到上限,只能放到队列中缓存了
            return super.offer(runnable);
        }
    }

EagerThreadPoolExecutor线程池最后一个相关的小细节是 AbortPolicyWithReport ,它继承了 ThreadPoolExecutor.AbortPolicy,覆写的 rejectedExecution 方法会输出包含线程池相关信息的 WARN 级别日志,然后执行 dumpJStack() 方法输出堆栈信息,最后再抛出RejectedExecutionException 异常:

    // AbortPolicyWithReport.java
    
    public void rejectedExecution(Runnable r, ThreadPoolExecutor e) {
        String msg = String.format("Thread pool is EXHAUSTED!" +
                                   " Thread Name: %s, Pool Size: %d (active: %d, core: %d, max: %d, largest: %d), Task: %d (completed: "
                                   + "%d)," +
                                   " Executor status:(isShutdown:%s, isTerminated:%s, isTerminating:%s), in %s://%s:%d!",
                                   threadName, e.getPoolSize(), e.getActiveCount(), e.getCorePoolSize(), e.getMaximumPoolSize(),
                                   e.getLargestPoolSize(),
                                   e.getTaskCount(), e.getCompletedTaskCount(), e.isShutdown(), e.isTerminated(), e.isTerminating(),
                                   url.getProtocol(), url.getIp(), url.getPort());
        logger.warn(msg);
        dumpJStack();
        dispatchThreadPoolExhaustedEvent(msg);
        throw new RejectedExecutionException(msg);
    }

五、总结

本章,我对dubbo-remoting模块中的transport子层的核心抽象类进行了分析,并重点介绍了 Server 相关的实现。Dubbo在抽象transport子层的Server实现时,是按照AbstractPeer -> AbstractEndpoint -> AbstractServer -> 具体Server实现类的顺序进行设计的。

阅读全文
  • 点赞