OwlCyberSecurity - MANAGER
Edit File: threadpool.pyc
� `��ac @` s� d Z d d l m Z m Z d d l Z d d l m Z d d l m Z m Z d d l m Z d d l m Z e � Z e d d d � � Y� Z d S( s� twisted.python.threadpool: a pool of threads to which we dispatch tasks. In most cases you can just use C{reactor.callInThread} and friends instead of creating a thread pool directly. i ( t divisiont absolute_importN( t pool( t logt context( t Failure( t _oldStylet ThreadPoolc B` s e Z d Z d Z d Z e Z e Z d Z d Z e j Z e e j � Z e e � Z d d d d � Z e d � � Z e d � � Z e d � � Z e d � � Z e Z d � Z d � Z d � Z d � Z d � Z d � Z d � Z d � Z d � Z d d d � Z d � Z! RS( s� This class (hopefully) generalizes the functionality of a pool of threads to which work can be dispatched. L{callInThread} and L{stop} should only be called from a single thread. @ivar started: Whether or not the thread pool is currently running. @type started: L{bool} @ivar threads: List of workers currently running in this thread pool. @type threads: L{list} @ivar _pool: A hook for testing. @type _pool: callable compatible with L{_pool} i i i c ` s� | d k s t d � � | | k s0 t d � � | � _ | � _ | � _ g � _ � f d � } � f d � } � j | | � � _ d S( sc Create a new threadpool. @param minthreads: minimum number of threads in the pool @type minthreads: L{int} @param maxthreads: maximum number of threads in the pool @type maxthreads: L{int} @param name: The name to give this threadpool; visible in log messages. @type name: native L{str} i s minimum is negatives minimum is greater than maximumc ` s2 � j d � j � | | � } � j j | � | S( Nt name( t threadFactoryt _generateNamet threadst append( t at kwt thread( t self( s\ /opt/cpanel-ccs/.develop/virtualenv/lib/python2.7/site-packages/twisted/python/threadpool.pyt trackingThreadFactoryJ s c ` s � j s d S� j S( Ni ( t startedt max( ( R ( s\ /opt/cpanel-ccs/.develop/virtualenv/lib/python2.7/site-packages/twisted/python/threadpool.pyt currentLimitO s N( t AssertionErrort minR R R t _poolt _team( R t minthreadst maxthreadsR R R ( ( R s\ /opt/cpanel-ccs/.develop/virtualenv/lib/python2.7/site-packages/twisted/python/threadpool.pyt __init__6 s c C` s | j j � } | j | j S( s For legacy compatibility purposes, return a total number of workers. @return: the current number of workers, both idle and busy (but not those that have been quit by L{ThreadPool.adjustPoolsize}) @rtype: L{int} ( R t statisticst idleWorkerCountt busyWorkerCount( R t stats( ( s\ /opt/cpanel-ccs/.develop/virtualenv/lib/python2.7/site-packages/twisted/python/threadpool.pyt workersW s c C` s d g | j j � j S( s� For legacy compatibility purposes, return the number of busy workers as expressed by a list the length of that number. @return: the number of workers currently processing a work item. @rtype: L{list} of L{None} N( t NoneR R R ( R ( ( s\ /opt/cpanel-ccs/.develop/virtualenv/lib/python2.7/site-packages/twisted/python/threadpool.pyt workingd s c C` s d g | j j � j S( s, For legacy compatibility purposes, return the number of idle workers as expressed by a list the length of that number. @return: the number of workers currently alive (with an allocated thread) but waiting for new work. @rtype: L{list} of L{None} N( R! R R R ( R ( ( s\ /opt/cpanel-ccs/.develop/virtualenv/lib/python2.7/site-packages/twisted/python/threadpool.pyt waitersp s c ` s# d t f � f d � � Y} | � S( s� For legacy compatibility purposes, return an object with a C{qsize} method that indicates the amount of work not yet allocated to a worker. @return: an object with a C{qsize} method. t NotAQueuec ` s e Z � f d � Z RS( c ` s � j j � j S( s Pretend to be a Python threading Queue and return the number of as-yet-unconsumed tasks. @return: the amount of backlogged work not yet dispatched to a worker. @rtype: L{int} ( R R t backloggedWorkCount( t q( R ( s\ /opt/cpanel-ccs/.develop/virtualenv/lib/python2.7/site-packages/twisted/python/threadpool.pyt qsize� s ( t __name__t __module__R' ( ( R ( s\ /opt/cpanel-ccs/.develop/virtualenv/lib/python2.7/site-packages/twisted/python/threadpool.pyR$ � s ( t object( R R$ ( ( R s\ /opt/cpanel-ccs/.develop/virtualenv/lib/python2.7/site-packages/twisted/python/threadpool.pyt _queue} s c C` sK t | _ t | _ | j � | j j � j } | rG | j j | � n d S( s' Start the threadpool. N( t Falset joinedt TrueR t adjustPoolsizeR R R% t grow( R t backlog( ( s\ /opt/cpanel-ccs/.develop/virtualenv/lib/python2.7/site-packages/twisted/python/threadpool.pyt start� s c C` s | j j d � d S( s� Increase the number of available workers for the thread pool by 1, up to the maximum allowed by L{ThreadPool.max}. i N( R R0 ( R ( ( s\ /opt/cpanel-ccs/.develop/virtualenv/lib/python2.7/site-packages/twisted/python/threadpool.pyt startAWorker� s c C` s d | j p t | � | j f S( s� Generate a name for a new pool thread. @return: A distinctive name for the thread. @rtype: native L{str} s PoolThread-%s-%s( R t idR ( R ( ( s\ /opt/cpanel-ccs/.develop/virtualenv/lib/python2.7/site-packages/twisted/python/threadpool.pyR � s c C` s | j j d � d S( sn Decrease the number of available workers by 1, by quitting one as soon as it's idle. i N( R t shrink( R ( ( s\ /opt/cpanel-ccs/.develop/virtualenv/lib/python2.7/site-packages/twisted/python/threadpool.pyt stopAWorker� s c C` s- t | d | � t j | | j | j � d S( Nt __dict__( t setattrR R R R ( R t state( ( s\ /opt/cpanel-ccs/.develop/virtualenv/lib/python2.7/site-packages/twisted/python/threadpool.pyt __setstate__� s c C` s$ i } | j | d <| j | d <| S( NR R ( R R ( R R9 ( ( s\ /opt/cpanel-ccs/.develop/virtualenv/lib/python2.7/site-packages/twisted/python/threadpool.pyt __getstate__� s c O` s | j d | | | � d S( s Call a callable object in a separate thread. @param func: callable object to be called in separate thread @param args: positional arguments to be passed to C{func} @param kw: keyword args to be passed to C{func} N( t callInThreadWithCallbackR! ( R t funct argsR ( ( s\ /opt/cpanel-ccs/.develop/virtualenv/lib/python2.7/site-packages/twisted/python/threadpool.pyt callInThread� s c ` sj | j r d St j j � j d � � f d � � � � � � f d � � _ | � _ | j j � � d S( s$ Call a callable object in a separate thread and call C{onResult} with the return value, or a L{twisted.python.failure.Failure} if the callable raises an exception. The callable is allowed to block, but the C{onResult} function must not block and should perform as little work as possible. A typical action for C{onResult} for a threadpool used with a Twisted reactor would be to schedule a L{twisted.internet.defer.Deferred} to fire in the main reactor thread using C{.callFromThread}. Note that C{onResult} is called inside the separate thread, not inside the reactor thread. @param onResult: a callable with the signature C{(success, result)}. If the callable returns normally, C{onResult} is called with C{(True, result)} where C{result} is the return value of the callable. If the callable throws an exception, C{onResult} is called with C{(False, failure)}. Optionally, C{onResult} may be L{None}, in which case it is not called at all. @param func: callable object to be called in separate thread @param args: positional arguments to be passed to C{func} @param kw: keyword arguments to be passed to C{func} Ni����c ` s} y � j � } t } Wn t � } t } n Xd � _ � j d k rc � j | | � d � _ n | sy t j | � n d S( N( t theWorkR. R R, R! t onResultR t err( t resultt ok( t inContext( s\ /opt/cpanel-ccs/.develop/virtualenv/lib/python2.7/site-packages/twisted/python/threadpool.pyRE � s c ` s t j � � � � � S( N( R t call( ( R> t ctxR= R ( s\ /opt/cpanel-ccs/.develop/virtualenv/lib/python2.7/site-packages/twisted/python/threadpool.pyt <lambda> t ( R- R t theContextTrackert currentContextt contextsR@ RA R t do( R RA R= R> R ( ( R> RG R= RE R s\ /opt/cpanel-ccs/.develop/virtualenv/lib/python2.7/site-packages/twisted/python/threadpool.pyR< � s c C` sA t | _ t | _ | j j � x | j D] } | j � q) Wd S( s9 Shutdown the threads in the threadpool. N( R. R- R, R R t quitR t join( R R ( ( s\ /opt/cpanel-ccs/.develop/virtualenv/lib/python2.7/site-packages/twisted/python/threadpool.pyt stop s c C` s� | d k r | j } n | d k r0 | j } n | d k sH t d � � | | k s` t d � � | | _ | | _ | j s d S| j | j k r� | j j | j | j � n | j | j k r� | j j | j | j � n d S( s� Adjust the number of available threads by setting C{min} and C{max} to new values. @param minthreads: The new value for L{ThreadPool.min}. @param maxthreads: The new value for L{ThreadPool.max}. i s minimum is negatives minimum is greater than maximumN( R! R R R R R R R5 R0 ( R R R ( ( s\ /opt/cpanel-ccs/.develop/virtualenv/lib/python2.7/site-packages/twisted/python/threadpool.pyR/ s c C` sI t j d | j f � t j d | j f � t j d | j f � d S( sw Dump some plain-text informational messages to the log about the state of this L{ThreadPool}. s waiters: %ss workers: %ss total: %sN( R t msgR# R" R ( R ( ( s\ /opt/cpanel-ccs/.develop/virtualenv/lib/python2.7/site-packages/twisted/python/threadpool.pyt dumpStats9 s N(" R( R) t __doc__R R R, R- R R R! R t threadingt ThreadR t staticmethodt currentThreadR R t propertyR" R# R+ R& R2 R3 R R6 R: R; R? R< RP R/ RR ( ( ( s\ /opt/cpanel-ccs/.develop/virtualenv/lib/python2.7/site-packages/twisted/python/threadpool.pyR s6 ! : ( ( RS t __future__R R RT t twisted._threadsR R t twisted.pythonR R t twisted.python.failureR t twisted.python._oldstyleR R* t WorkerStopR ( ( ( s\ /opt/cpanel-ccs/.develop/virtualenv/lib/python2.7/site-packages/twisted/python/threadpool.pyt <module> s