Examples of OrderedMemoryAwareThreadPoolExecutor

com.facebook.presto.jdbc.internal.netty.handler.execution.OrderedMemoryAwareThreadPoolExecutor
default implementation returns a special ConcurrentMap that // uses identity comparison only (see {@link IdentityHashMap}). // Because SocketAddress does not work with identity comparison, // we need to employ more generic implementation. return new ConcurrentHashMap<Object, Executor> } protected Object getChildExecutorKey( {@link ChannelEvent} e) {// Use the IP of the remote peer as a key. return ((InetSocketAddress) e.getChannel().getRemoteAddress()).getAddress(); } // Make public so that you can call from anywhere. public boolean removeChildExecutor(Object key) { super.removeChildExecutor(key); } } Please be very careful of memory leak of the child executor map. You must call {@link #removeChildExecutor(Object)} when the life cycle of the keyends (e.g. all connections from the same IP were closed.) Also, please keep in mind that the key can appear again after calling {@link #removeChildExecutor(Object)}(e.g. a new connection could come in from the same old IP after removal.) If in doubt, prune the old unused or stall keys from the child executor map periodically:
```
 RemoteAddressBasedOMATPE executor = ...; on every 3 seconds: for (Iterator<Object> i = executor.getChildExecutorKeySet().iterator; i.hasNext();) { InetAddress ip = (InetAddress) i.next(); if (there is no active connection from 'ip' now && there has been no incoming connection from 'ip' for last 10 minutes) { i.remove(); } } 
```
If the expected maximum number of keys is small and deterministic, you could use a weak key map such as ConcurrentWeakHashMap or synchronized {@link WeakHashMap} instead of managing the life cycle of thekeys by yourself. @apiviz.landmark
io.netty.handler.execution.OrderedMemoryAwareThreadPoolExecutor
default implementation returns a special ConcurrentMap that // uses identity comparison only (see {@link IdentityHashMap}). // Because SocketAddress does not work with identity comparison, // we need to employ more generic implementation. return new ConcurrentHashMap<Object, Executor> } protected Object getChildExecutorKey( {@link ChannelEvent} e) {// Use the IP of the remote peer as a key. return ((InetSocketAddress) e.getChannel().getRemoteAddress()).getAddress(); } // Make public so that you can call from anywhere. public boolean removeChildExecutor(Object key) { super.removeChildExecutor(key); } } Please be very careful of memory leak of the child executor map. You must call {@link #removeChildExecutor(Object)} when the life cycle of the keyends (e.g. all connections from the same IP were closed.) Also, please keep in mind that the key can appear again after calling {@link #removeChildExecutor(Object)}(e.g. a new connection could come in from the same old IP after removal.) If in doubt, prune the old unused or stall keys from the child executor map periodically:
```
 RemoteAddressBasedOMATPE executor = ...; on every 3 seconds: for (Iterator<Object> i = executor.getChildExecutorKeySet().iterator; i.hasNext();) { InetAddress ip = (InetAddress) i.next(); if (there is no active connection from 'ip' now && there has been no incoming connection from 'ip' for last 10 minutes) { i.remove(); } } 
```
If the expected maximum number of keys is small and deterministic, you could use a weak key map such as ConcurrentWeakHashMap or synchronized {@link WeakHashMap} instead of managing the life cycle of thekeys by yourself. @apiviz.landmark
org.jboss.netty.handler.execution.OrderedMemoryAwareThreadPoolExecutor
A {@link MemoryAwareThreadPoolExecutor} which maintains the{@link ChannelEvent} order for the same {@link Channel}.
Although {@link OrderedMemoryAwareThreadPoolExecutor} guarantees the orderof {@link ChannelEvent}s. It does not guarantee that the invocation will be made by the same thread for the same channel, but it does guarantee that the invocation will be made sequentially for the events of the same channel. For example, the events can be processed as depicted below:
```
 -----------------------------------> Timeline -----------------------------------> Thread X: --- Channel A (Event 1) --.   .-- Channel B (Event 2) --- Channel B (Event 3) ---> \ / X / \ Thread Y: --- Channel B (Event 1) --'   '-- Channel A (Event 2) --- Channel A (Event 3) ---> 
```
Please note that the events of different channels are independent from each other. That is, an event of Channel B will not be blocked by an event of Channel A and vice versa, unless the thread pool is exhausted. @author The Netty Project (netty-dev@lists.jboss.org) @author Trustin Lee (tlee@redhat.com) @author David M. Lloyd (david.lloyd@redhat.com) @version $Rev: 990 $, $Date: 2009-03-06 15:52:26 +0900 (Fri, 06 Mar 2009) $ @apiviz.landmark

Examples of org.jboss.netty.handler.execution.OrderedMemoryAwareThreadPoolExecutor

        pipeline.addLast( "encoder", new StringEncoder() );
        // Note that outbound mode requires the decoder to treat many 'headers' as body lines
        pipeline.addLast( "decoder", new EslFrameDecoder( 8092, true ) );
        // Add an executor to ensure separate thread for each upstream message from here
        pipeline.addLast( "executor", new ExecutionHandler( 
            new OrderedMemoryAwareThreadPoolExecutor( 16, 1048576, 1048576 ) ) );


        // now the outbound client logic
        pipeline.addLast( "clientHandler", makeHandler() );
        
        return pipeline;

View Full Code Here

Examples of org.jboss.netty.handler.execution.OrderedMemoryAwareThreadPoolExecutor

        ChannelPipeline pipeline = Channels.pipeline(); 
        pipeline.addLast( "encoder", new StringEncoder() );
        pipeline.addLast( "decoder", new EslFrameDecoder( 8192 ) );
        // Add an executor to ensure separate thread for each upstream message from here
        pipeline.addLast( "executor", new ExecutionHandler( 
            new OrderedMemoryAwareThreadPoolExecutor( 16, 1048576, 1048576 ) ) );


        // now the inbound client logic
        pipeline.addLast( "clientHandler", handler );
        
        return pipeline;

View Full Code Here

Examples of org.jboss.netty.handler.execution.OrderedMemoryAwareThreadPoolExecutor

        this.timer = new HashedWheelTimer(daemonThreadsNamed(namePrefix + "-timer-%s"));


        ChannelFactory channelFactory = new NioClientSocketChannelFactory(ioPool.getBossPool(), ioPool.getWorkerPool());


        ThreadFactory workerThreadFactory = daemonThreadsNamed(namePrefix + "-worker-%s");
        this.executor = new OrderedMemoryAwareThreadPoolExecutor(asyncConfig.getWorkerThreads(), 0, 0, 30, TimeUnit.SECONDS, workerThreadFactory);
        this.executorMBean = new ThreadPoolExecutorMBean(executor);


        ClientBootstrap bootstrap;
        if (config.getSocksProxy() == null) {
            bootstrap = new ClientBootstrap(channelFactory);

View Full Code Here

Examples of org.jboss.netty.handler.execution.OrderedMemoryAwareThreadPoolExecutor

    };


    // Thread pool of max size = MAX_HANDLER_THREADS and will reject new tasks by throwing exceptions
    // The pipeline should have handler to catch the exception and response with status 503.
    ThreadPoolExecutor threadPoolExecutor =
      new OrderedMemoryAwareThreadPoolExecutor(MAX_HANDLER_THREADS, 0, 0, 60L, TimeUnit.SECONDS,
                                               threadFactory);
    threadPoolExecutor.setRejectedExecutionHandler(new ThreadPoolExecutor.AbortPolicy());
    return new ExecutionHandler(threadPoolExecutor);
  }

View Full Code Here

Examples of org.jboss.netty.handler.execution.OrderedMemoryAwareThreadPoolExecutor

      }
    };


    //Create ExecutionHandler
    ThreadPoolExecutor threadPoolExecutor =
      new OrderedMemoryAwareThreadPoolExecutor(threadPoolSize, 0, 0,
                                               threadKeepAliveSecs, TimeUnit.SECONDS, threadFactory);
    threadPoolExecutor.setRejectedExecutionHandler(rejectedExecutionHandler);
    return new ExecutionHandler(threadPoolExecutor);
  }

View Full Code Here

Examples of org.jboss.netty.handler.execution.OrderedMemoryAwareThreadPoolExecutor

    @Override
    public Executor create() {
        LoggerFactory.getLogger(getClass()).info(
                "Creating an OMATPE with maxmemperchannel= {} and maxmemperexecutor= {}", maxMemoryPerChannel,
                maxMemoryPerExecutor);
        return new OrderedMemoryAwareThreadPoolExecutor(1, maxMemoryPerChannel, maxMemoryPerExecutor, 60,
                TimeUnit.SECONDS, new ThreadFactoryBuilder().setNameFormat("listener-deserializer-%d").build());
    }

View Full Code Here

Examples of org.jboss.netty.handler.execution.OrderedMemoryAwareThreadPoolExecutor

            // replies in the expected order. eg this is required by TCP.
            // and use a Camel thread factory so we have consistent thread namings
            String pattern = consumer.getContext().getExecutorServiceManager().getThreadNamePattern();
            ThreadFactory factory = new CamelThreadFactory(pattern, "NettyOrderedWorker", true);
            final ExecutionHandler executionHandler = new ExecutionHandler(
                    new OrderedMemoryAwareThreadPoolExecutor(consumer.getConfiguration().getMaximumPoolSize(),
                            0L, 0L, 30, TimeUnit.SECONDS, factory));
            // this must be added just before the ServerChannelHandler
            addToPipeline("executionHandler", channelPipeline, executionHandler);
            LOG.debug("Using OrderedMemoryAwareThreadPoolExecutor with core pool size: {}", consumer.getConfiguration().getMaximumPoolSize());
        }

View Full Code Here

Examples of org.jboss.netty.handler.execution.OrderedMemoryAwareThreadPoolExecutor

        bootstrap.getPipeline().addLast("encoder", new Encoder());
        bootstrap.getPipeline().addLast("decoder", new Decoder());
        bootstrap.getPipeline().addLast("handler", new NetworkManager());
        bootstrap.getPipeline().addLast("pipelineExecutor", new ExecutionHandler
                (
                        new OrderedMemoryAwareThreadPoolExecutor(
                                200,
                                1048576,
                                1073741824,
                                100,
                                TimeUnit.MILLISECONDS,

View Full Code Here

0 1 2 3

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.