OwlCyberSecurity - MANAGER
Edit File: pool.pyc
� �t�ac @ sk d d d g Z d d l Z d d l Z d d l m Z d d l m Z d d l m Z d d l m Z d d l m Z m Z m Z d d l m Z m Z m Z d d l m Z d d l m Z d d l m Z d d l m Z m Z d d l m Z d d l m Z d e f d � � YZ d e! f d � � YZ" i Z# d e$ d � Z% d � Z& d e$ d � Z' d � Z( d S( t installPoolst installPoolt getHTTPClientPooli����N( t Logger( t GAIEndpoint( t connect( t ChainingOpenSSLContextFactory( t Deferredt inlineCallbackst returnValue( t ConnectionLostt ConnectionDonet ConnectError( t ClientFactory( t responsecode( t HTTPClientProtocol( t StatusResponset HTTPError( t allDataFromStream( t MemoryStreamt PooledHTTPClientFactoryc B sG e Z d Z e � Z e Z d Z d � Z d � Z d � Z d � Z RS( sT A client factory for HTTPClient that notifies a pool of it's state. It the connection fails in the middle of a request it will retry the request. @ivar protocol: The current instance of our protocol that we pass to our connectionPool. @ivar connectionPool: A managing connection pool that we notify of events. c C s. | | _ d | _ t � | _ t � | _ d S( N( t reactort Nonet instanceR t onConnectt afterConnect( t selfR ( ( s, /opt/cpanel-ccs/twistedcaldav/client/pool.pyt __init__9 s c C sH t | d � r4 | j j d | j j | � | ` n | j j rD d Sd S( sK Notify the connectionPool that we've lost our connection. R i N( t hasattrR t callLaterR t errbackt connectionPoolt shutdown_requested( R t connectort reason( ( s, /opt/cpanel-ccs/twistedcaldav/client/pool.pyt clientConnectionLost? s c C sl t | d � r4 | j j d | j j | � | ` n4 t | d � rh | j j d | j j | � | ` n d S( sH Notify the connectionPool that we're unable to connect R i R N( R R R R R R ( R R! R" ( ( s, /opt/cpanel-ccs/twistedcaldav/client/pool.pyt clientConnectionFailedL s c C s; | j � | _ | j j d | j j | j � | ` | j S( Ni ( t protocolR R R R t callback( R t addr( ( s, /opt/cpanel-ccs/twistedcaldav/client/pool.pyt buildProtocolW s N( t __name__t __module__t __doc__R t logR R% R R R R# R$ R( ( ( ( s, /opt/cpanel-ccs/twistedcaldav/client/pool.pyR + s t HTTPClientPoolc B s� e Z d Z e � Z e Z d Z d d d � Z d � Z d � Z d � Z d � Z e d � � Z d � Z d � Z d � Z d � Z d � Z d � Z d � Z RS( s� A connection pool for HTTPClientProtocol instances. @ivar clientFactory: The L{ClientFactory} implementation that will be used for each protocol. @ivar _maxClients: A C{int} indicating the maximum number of clients. @ivar _endpoint: An L{IStreamClientEndpoint} provider indicating the server to connect to. @ivar _reactor: The L{IReactorTCP} provider used to initiate new connections. @ivar _busyClients: A C{set} that contains all currently busy clients. @ivar _freeClients: A C{set} that contains all currently free clients. @ivar _pendingConnects: A C{int} indicating how many connections are in progress. i i c C s� | | _ | | _ | | _ | | _ | | _ | d k rL d d l m } n | | _ d | _ t | _ | j d d | j � t g � | _ t g � | _ d | _ g | _ d S( s @param endpoint: An L{IStreamClientEndpoint} indicating the server to connect to. @param maxClients: A C{int} indicating the maximum number of clients. @param reactor: An L{IReactorTCP} provider used to initiate new connections. i����( R t beforet shutdowni N( t _namet _schemet _endpointt _secureEndpointt _maxClientsR t twisted.internetR t _reactort shutdown_deferredt FalseR t addSystemEventTriggert _shutdownCallbackt sett _busyClientst _freeClientst _pendingConnectst _pendingRequests( R t namet schemet endpointt secureEndpointt maxClientsR ( ( s, /opt/cpanel-ccs/twistedcaldav/client/pool.pyR y s c C s7 t | j � d k o6 t | j � d k o6 | j d k S( Ni ( t lenR< R? R> ( R ( ( s, /opt/cpanel-ccs/twistedcaldav/client/pool.pyt _isIdle� s c C s, t | _ | j � r d St � | _ | j S( N( t TrueR RF R R R7 ( R ( ( s, /opt/cpanel-ccs/twistedcaldav/client/pool.pyR: � s c s� � j d 7_ � j j d d � j �� j � � j � j � � � � _ � j d k ro t � j � � n. � j d k r� t � j � � n t d � � � � f d � } � f d � } � j } | j | | � | S( s| Create a new client connection. @return: A L{Deferred} that fires with the L{IProtocol} instance. i s1 Initiating new client connection to: {endpoint!r}RB t httpst https( URL scheme for client pool not supportedc s; � j d 8_ � f d � } � j } | j | | � | S( Ni c s$ | j t t t � � j | � d S( N( t trapR R R t clientGone( t ft client( R ( s, /opt/cpanel-ccs/twistedcaldav/client/pool.pyt _goneClientAfterError� s ( R> R t addErrback( RM RN t d2( t factoryR ( s, /opt/cpanel-ccs/twistedcaldav/client/pool.pyt _doneOK� s c s � j d 8_ | S( Ni ( R> ( t result( R ( s, /opt/cpanel-ccs/twistedcaldav/client/pool.pyt _doneError� s ( R> R, t debugR2 t _logClientStatst clientFactoryR6 R R1 R R3 t ValueErrorR t addCallbacks( R RR RT t d( ( RQ R s, /opt/cpanel-ccs/twistedcaldav/client/pool.pyt _newClientConnection� s" c sZ � � f d � } � � f d � } � j � � � j | d t �} | j | | � | S( s Perform the given request on the given client. @param client: A L{PooledMemCacheProtocol} that will be used to perform the given request. @param command: A C{str} representing an attribute of L{MemCacheProtocol}. @parma args: Any positional arguments that should be passed to C{command}. @param kwargs: Any keyword arguments that should be passed to C{command}. @return: A L{Deferred} that fires with the result of the given command. c s � j � � | S( N( t clientFree( RS ( RM R ( s, /opt/cpanel-ccs/twistedcaldav/client/pool.pyt _freeClientAfterRequest� s c s � j � � | S( N( RK ( RS ( RM R ( s, /opt/cpanel-ccs/twistedcaldav/client/pool.pyRN � s t closeAfter( t clientBusyt submitRequestRG RY ( R RM t requestt argst kwargsR] RN RZ ( ( RM R s, /opt/cpanel-ccs/twistedcaldav/client/pool.pyt _performRequestOnClient� s c o s% t | j � V} xt | j d � D]� } yG t | d k rB | n d � | _ d | j _ | j | | | � V} Wnw t t t f k r� } | j j d d | d d | �q$ q$ t f k r� } | j j d d | d d | �q$ q$ Xt | � q$ W| j j d � t t t j d � � � d S( s� Select an available client and perform the given request on it. @param command: A C{str} representing an attribute of L{MemCacheProtocol}. @parma args: Any positional arguments that should be passed to C{command}. @param kwargs: Any keyword arguments that should be passed to C{command}. @return: A L{Deferred} that fires with the result of the given command. i t sE HTTP pooled client connection error (attempt: {ctr}) - retrying: {ex}t ctrt exsO HTTP pooled client connection assertion error (attempt: {ctr}) - retrying: {ex}s? HTTP pooled client connection error - exhausted retry attempts.s- Could not connect to HTTP pooled client host.N( R t streamt xranget maxRetriesR R t doStartReadingt _submitRequestR R R R, t errort AssertionErrorR R R R t BAD_GATEWAY( R Ra Rb Rc t dataRf t responset e( ( s, /opt/cpanel-ccs/twistedcaldav/client/pool.pyR` � s ! c O s� t | j � d k r9 | j | j j � | | | � } n� t | j � | j | j k r� t � } | j j | | | | f � | j j d d | d | d | �| j � n% | j � } | j | j | | | � | S( s� Select an available client and perform the given request on it. @param command: A C{str} representing an attribute of L{MemCacheProtocol}. @parma args: Any positional arguments that should be passed to C{command}. @param kwargs: Any keyword arguments that should be passed to C{command}. @return: A L{Deferred} that fires with the result of the given command. i s+ Request queued: {req}, {args!r}, {kwargs!r}t reqRb Rc ( RE R= Rd t popR< R> R4 R R? t appendR, RU RV R[ t addCallback( R Ra Rb Rc RZ ( ( s, /opt/cpanel-ccs/twistedcaldav/client/pool.pyRl s $ " c C sJ | j j d d t | j � d t | j � d | j d t | j � �d S( NsL Clients #free: {free}, #busy: {busy}, #pending: {pending}, #queued: {queued}t freet busyt pendingt queued( R, RU RE R= R< R> R? ( R ( ( s, /opt/cpanel-ccs/twistedcaldav/client/pool.pyRV 8 s c C sr | | j k r" | j j | � n" | | j k rD | j j | � n | j j d d | �| j � | j � d S( s� Notify that the given client is to be removed from the pool completely. @param client: An instance of L{PooledMemCacheProtocol}. s Removed client: {client!r}RM N( R< t removeR= R, RU RV t _processPending( R RM ( ( s, /opt/cpanel-ccs/twistedcaldav/client/pool.pyRK A s c C sV | | j k r" | j j | � n | j j | � | j j d d | �| j � d S( s� Notify that the given client is being used to complete a request. @param client: An instance of C{self.clientFactory} s Busied client: {client!r}RM N( R= R{ R< t addR, RU RV ( R RM ( ( s, /opt/cpanel-ccs/twistedcaldav/client/pool.pyR_ R s c C s� | | j k r" | j j | � n | j j | � | j rZ | j � rZ | j j d � n | j j d d | �| j � | j � d S( s� Notify that the given client is free to handle more requests. @param client: An instance of C{self.clientFactory} s Freed client: {client!r}RM N( R< R{ R= R} R7 RF R& R R, RU RV R| ( R RM ( ( s, /opt/cpanel-ccs/twistedcaldav/client/pool.pyR\ a s c C s� t | j � d k r� | j j d � \ } } } } | j j d d | d | d | �| j � | j | | | � } | j | j | j � n d S( Ni s6 Performing Queued Request: {req}, {args!r}, {kwargs!r}Rs Rb Rc ( RE R? Rt R, RU RV Rl RY R& R ( R RZ Ra Rb Rc t _ign_d( ( s, /opt/cpanel-ccs/twistedcaldav/client/pool.pyR| t s c C s | | _ d S( s� Suggest the maximum number of concurrently connected clients. @param maxClients: A C{int} indicating how many client connections we should keep open. N( R4 ( R RD ( ( s, /opt/cpanel-ccs/twistedcaldav/client/pool.pyt suggestMaxClients� s N( R) R* R+ R R, R RW Rj R R RF R: R[ Rd R R` Rl RV RK R_ R\ R| R ( ( ( s, /opt/cpanel-ccs/twistedcaldav/client/pool.pyR- ^ s" , + i c C s. x' | D] \ } } t | | | | � q Wd S( N( R ( t hostsRD R R@ t url( ( s, /opt/cpanel-ccs/twistedcaldav/client/pool.pyR � s c C sD d d l m } t d d d d d d d t t j | j � d | �S( s> Get a client context factory from the configuration. i����( t configRe t certificateChainFilet keychainIdentityt sslmethodt peerName( t twistedcaldav.configR� R t getattrt OpenSSLt SSLt SSLMethod( t hostnameR� ( ( s, /opt/cpanel-ccs/twistedcaldav/client/pool.pyt _configuredClientContextFactory� s c C s� | d k r d d l m } n t j | � } t | j � } t | | j t | | j | j � t | | j | j | � | | � } | t | <d S( Ni����( R ( R R5 R t urlparseR� R� R- RA R t portt _clientPools( R@ R� RD R t parsedURLt ctxft pool( ( s, /opt/cpanel-ccs/twistedcaldav/client/pool.pyR � s c C s t | S( N( R� ( R@ ( ( s, /opt/cpanel-ccs/twistedcaldav/client/pool.pyR � s () t __all__R� R� t twext.python.logR t twext.internet.gaiendpointR t twext.internet.adaptendpointR t twext.internet.sslR t twisted.internet.deferR R R t twisted.internet.errorR R R t twisted.internet.protocolR t txweb2R t txweb2.client.httpR t txweb2.httpR R t txweb2.dav.utilR t txweb2.streamR R t objectR- R� R R R� R R ( ( ( s, /opt/cpanel-ccs/twistedcaldav/client/pool.pyt <module> s0 3� .