OwlCyberSecurity - MANAGER
Edit File: caldav.pyc
� �mec @ sE d d l m Z d d d g Z d d l Z d d l m Z d d l m Z m Z m Z m Z m Z m Z m Z m Z m Z d d l m Z m Z d d l Z d d l Z d d l m Z d d l Z d d l m Z m Z d d l m Z m Z d d l m Z d d l Z d d l m! Z" d d l# m$ Z$ d d l% m& Z& d d l' m( Z( d d l) m* Z* d d l+ m, Z, m- Z- d d l. m/ Z/ m0 Z0 d d l1 m2 Z2 d d l3 m4 Z4 m5 Z5 m6 Z6 m7 Z7 d d l8 m9 Z9 m: Z: d d l; m< Z< d d l= m> Z> d d l= m? Z? d d l@ mA ZA mB ZB d d lC mD ZD mE ZE d d lC mF ZF d d lG mH ZH d d lI mJ ZJ d d lK mL ZL d d lM mN ZN d d! lO mP ZP mQ ZQ d d" lR mS ZS d d# lT mU ZU d d$ lV mW ZW d d% lX mY ZY d d& lZ m[ Z[ m\ Z\ d d' l] m^ Z^ d d( l_ m` Z` ma Za mb Zb d d) lc md Zd d d* lc me Ze d d+ lc mf Zg d d, lh mi Zi d d- lj mk Zk d d. ll mm Zm d d/ ln mo Zo d d0 lp mq Zq mr Zr ms Zs d d1 lt mu Zu mv Zv d d2 lw mx Zx d d3 ly mz Zz d d4 l{ m| Z| d d5 l{ m} Z} d d6 l~ m Z d d7 l� m� Z� m� Z� m� Z� m� Z� m� Z� m� Z� m� Z� d d8 l� m� Z� d d9 l� m� Z� d d: lj m� Z� d d; l� m� Z� d d< l� m� Z� d d= l� m� Z� d d> l� m� Z� d d? l% m� Z� m� Z� d d@ l� m� Z� m� Z� d dA l� m� Z� d dB l� m� Z� d dC l� m� Z� d dD l� m� Z� d dE l� m� Z� d dF l� m� Z� d dG l� m� Z� m� Z� d dH l� m� Z� m� Z� d dI l� m� Z� d dJ l� m� Z� m� Z� m� Z� m� Z� m� Z� m� Z� m� Z� m� Z� m� Z� m� Z� m� Z� m� Z� m� Z� m� Z� y d dK l� m� Z� Wnn e� k rUd dL l� m� Z� e j� j� dM e� e� � j� j� j� dN � j� � d dK l� m� Z� dO j� e� � � Z� n Xd dP lw m� Z� dQ j� e� j� dR dS � e� � Z� eN � Z� dT Z� dU Z� dV Z� dW � Z� dX � Z� dY � Z� dZ � Z� e� e � Z� d[ eD e� f d\ � � YZ� d e� f d] � � YZ� d e, f d^ � � YZ� d_ eB e� f d` � � YZ� da eF f db � � YZ� dc eF f dd � � YZ� de eF f df � � YZ� dg e� f dh � � YZ� di e� f dj � � YZ� d e� f dk � � YZ� dl e� f dm � � YZ� dn eA f do � � YZ� dp eF e� f dq � � YZ� dr e� f ds � � YZ� dt e> f du � � YZ� dv � Z� dw e� f dx � � YZ� d S(y i����( t print_functiont CalDAVServicet CalDAVOptionst CalDAVServiceMakerN( t OrderedDict( t getuidt getgidt geteuidt umaskt removet environt statt chownt W_OK( t existst basename( t S_ISSOCK( t Popent PIPE( t getpwuidt getpwnam( t getgrnam( t Error( t implements( t config( t ILogObserver( t LogFile( t Optionst UsageError( t uidFromStringt gidFromString( t IPlugin( t gatherResultst Deferredt inlineCallbackst succeed( t UNIXClientEndpointt TCP4ClientEndpoint( t ProcessExitedAlready( t ProcessProtocol( t Factory( t TCPServert UNIXServer( t MultiServicet IServiceMaker( t Service( t AMP( t LogLevel( t CachingFilePath( t Logger( t DirectoryChangeListenert IDirectoryChangeListenee( t ChainingOpenSSLContextFactory( t SNIMap( t FilePath( t certificateOptionsFromPileOfPEM( t MaxAcceptTCPServert MaxAcceptSSLServer( t ConnectionPool( t POSTGRES_DIALECTt ORACLE_DIALECTt DatabaseType( t NonPerformingQueuer( t ControllerQueue( t WorkerFactory( t ReExecService( t GroupCacherPollingWork( t PrincipalPurgePollingWork( t checkDirectory( t LimitingHTTPFactoryt SSLRedirectRequestt HTTPChannel( t ConnectionLimitert ReportingHTTPService( t Site( t DBAPIConnector( t MailRetriever( t scheduleNextMailPoll( t UpgradeToDatabaseStep( t UpgradeDatabaseCalendarDataStept UpgradeDatabaseOtherStept UpgradeDatabaseSchemaStept" UpgradeDatabaseAddressBookDataStept UpgradeAcquireLockStept UpgradeReleaseLockStept# UpgradeDatabaseNotificationDataStep( t InboxCleanupWork( t FindMinValidRevisionWork( t GroupCacher( t memcachepool( t MemcacheURLPatternChangeNotifier( t ConfigurationError( t processLocalizationFiles( t DEFAULT_CONFIGt DEFAULT_CONFIG_FILE( t UpgradeFileSystemFormatStept PostDBImportStep( t AMPCommonAccessLoggingObserver( t AMPLoggingFactory( t! RotatingFileAccessLoggingObserver( t ControlSocket( t ControlSocketConnectingService( t DashboardServer( t AMPPushMastert AMPPushForwarder( t ApplePushNotifierServicet APNPurgingWork( t PushDistributor( t ConnectionDispensert Steppert checkDirectoriest getRootResourcet pgServiceFromConfigt getDBPoolt MemoryLimitServicet storeFromConfigt getSSLPassphraset preFlightCheckst storeFromConfigWithDPSClientt storeFromConfigWithoutDPSt serverRootLocationt AlertPoster( t version( t getModulei t supports {} ({}*)( t VERSIONs CalendarServer/{} {}t t t logt queuet controlc C s@ | d k r t | � } n | d k r6 t | � } n | | f S( N( t NoneR R ( t uidt gid( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyt getid� s c C s] d } z< y t j t j t j � } t SWn t j k r@ t SXWd | rX | j � n Xd S( N( R� t sockett AF_INET6t SOCK_STREAMt Truet errort Falset close( t s6( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyt systemSupportsIPv6� s c C s� t j t j t j � } t j t j t j � } z� | j t j t j d � | j t j t j d � | j d � | j d � | j � d } y | j d | f � Wn t j k r� t SXt SWd | j � | j � Xd S( sB Is there a conflict between binding an IPv6 and an IPv4 port? Return True if there is, False if there isn't. This is a temporary workaround until maybe Twisted starts setting C{IPPROTO_IPV6 / IPV6_V6ONLY} on IPv6 sockets. @return: C{True} if listening on IPv4 conflicts with listening on IPv6. i R i s ::N( R i ( R� t AF_INETR� R� t setsockoptt SOL_SOCKETt SO_REUSEADDRt bindt listent getsocknameR� R� R� R� ( t s4R� t usedport( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyt conflictBetweenIPv4AndIPv6� s c C s� i } d d d d d d g } d d d d g } x$ | D] } | j | d � | | <q7 Wx+ | D]# } | | k r^ | | | | <q^ q^ Wt j j p� d | d <| S( sL Compute environment variables to be propagated to child processes. t PATHt PYTHONPATHt LD_LIBRARY_PATHt LD_PRELOADt DYLD_LIBRARY_PATHt DYLD_INSERT_LIBRARIESt PYTHONHASHSEEDt KRB5_KTNAMEt ORACLE_HOMEt VERSIONER_PYTHON_PREFER_32_BITR s UTF-8t PYTHONIOENCODING( t gett syst stdoutt encoding( t parentt resultt requiredVarst optionalVarst varname( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyt _computeEnvVars� s$ t ErrorLoggingMultiServicec B s e Z d Z d � Z d � Z RS( s` Registers a rotating file logger for error logging, if config.ErrorLogEnabled is True. c C sG t j | � | | _ | | _ | | _ | | _ | | _ d | _ d S( s� @param logEnabled: Whether to write to a log file @type logEnabled: C{boolean} @param logPath: the full path to the log file @type logPath: C{str} @param logRotateLength: rotate when files exceed this many bytes @type logRotateLength: C{int} @param logMaxFiles: keep at most this many files @type logMaxFiles: C{int} @param logRotateOnStart: rotate when service starts @type logRotateOnStart: C{bool} t elmsN( R+ t __init__t logEnabledt logPatht logRotateLengtht logMaxFilest logRotateOnStartt name( t selfR� R� R� R� R� ( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyR� � s c C s� t j | | � | j r\ t j | j d | j d | j �} | j rS | j � n d } n t j } t j j } t j o� t j d k } t j | d | �} | | j d _ | j t | � d S( Nt rotateLengtht maxRotatedFiless utf-8t Slavet DPSt withTimei ( R� R� ( R+ t setServiceParentR� R t fromFullPathR� R� R� R� t rotateR� R� R� R t ErrorLogFilet ProcessTypeR1 t makeFilteredFileLogObservert _observerst _encodingt setComponentR ( R� t appt errorLogFileR� R� t errorLogObserver( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyR� s ( t __name__t __module__t __doc__R� R� ( ( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyR� � s c B s/ e Z d Z d � Z d � Z e d � � Z RS( t csc C sI | | _ t j | t j t j t j d d t j t j � d | _ d S( Ni t cds( t logObserverR� R� R t ErrorLogEnabledR� t ErrorLogRotateMBt ErrorLogMaxRotatedFilest ErrorLogRotateOnStartR� ( R� R� ( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyR� 5 s c C s t j | � | j j � d S( N( R+ t privilegedStartServiceR� t start( R� ( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyR� A s c c sE | j | j � } | j | � Vt t | � j � V| j j � d S( s� Wait for outstanding requests to finish @return: a Deferred which fires when all outstanding requests are complete N( t getServiceNamedt connectionServiceNamet removeServicet superR t stopServiceR� t stop( R� t connectionService( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyR� E s ( R� R� R� R� R� R" R� ( ( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyR . s c B s� e Z e � Z d d e d g g Z i d d 6Z d � Z e d � � Z e d � � Z d � Z e Z d � Z d � Z d � Z d � Z d � Z RS( R t fs Path to configuration file.s _files -g '*.plist'c O s& t t | � j | | � i | _ d S( N( R� R R� t overrides( R� t argst kwargs( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyR� ^ s c C s� | | k r� t | | t � r. | d k } q� t | | t t t f � rc t | | � | � } q� t | | t t f � r� | j d � } q� t | | t � r� t d � � q� | d k r� d } q� n | S( sG Coerce the given C{val} to type of C{configDict[key]} R� t ,s. Dict options not supported on the command lineR� N( t isinstancet boolt intt floatt longt typet listt tuplet splitt dictR R� ( t configDictt keyt value( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyt coerceOptionc s c C s� | d } t | � d k r9 | j | | | � | | <d S| | k r� t | | t � sg t d � � n | | k r� i | | <n | j | | | d | | | � n d S( s5 Set the value at path in configDict i i Ns8 Found intermediate path element that is not a dictionary( t lenR� R� R� R t setOverride( t clsR� t pathR� t overrideDictR� ( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyR� | s c C s` d | k rF | j d � \ } } | j t | j d � | | j � n | j d j | � � d S( s Set an option to override a value in the config file. True, False, int, and float options are supported, as well as comma separated lists. Only one option may be given for each --option flag, however multiple --option flags may be specified. t =t /s {}=TrueN( R� R� R] R� t opt_optiont format( R� t optionR� R� ( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyR� � s c C sh y4 t � d k r | j � n | j � | j � Wn- t k rc } t d | � t j d � n Xd S( Ni s Invalid configuration:i ( R t waitForServerRoott loadConfigurationt checkConfigurationR[ t printR� t exit( R� t e( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyt postOptions� s c C s/ t � } | r+ t | d d t d t �n d S( s@ Block until server root directory is available s Server roott accesst waitN( Rx RD R R� ( R� t serverRootPath( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyR� � s c C s� t | d � s, t d j | d � � � n t d | d � t j | d � x$ t j � j D] } t d | � q^ Wx$ t j � j D] } t d | � q� Wx$ t j � j D] } t d | � q� Wt j | j � d S( NR s" Config file {} not found. Exiting.s Reading configuration from file:s! Imported configuration from file:s Adding configuration from file:s Missing configuration file:( R R[ R� R� R t loadt getProvidert importedFilest includedFilest missingFilest updateDefaultsR� ( R� R� ( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyR� � s c C s t | � d S( N( Rn ( R� R ( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyRn � s c C s d \ } } | j d s& | j d rL t | j d | j d � \ } } n d � } | rt | t � k rt | � n | r� | t � k r� | � n t j | j d <| j t � t t j � } | t j k r� | j j d d | d t j �n t j | j d <d S( NR� R� c S s= t � d k r9 t t � � j } t d j | � � � n d S( Ni s+ Only root can drop privileges. You are: {}( R R t pw_nameR R� ( t username( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyt gottaBeRoot� s t pidfiles6 WARNING: changing umask from: 0{old:03o} to 0{new:03o}t oldt newR ( NN( R� R� R� R R R t PIDFileRn R R� t info( R� R� R� R t oldmask( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyR� � s & ( R� R� R1 R� R^ t optParameterst zsh_actionsR� t staticmethodR� t classmethodR� R� t opt_oR R� R� Rn R� ( ( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyR U s t GroupOwnedUNIXServerc B s e Z d Z d � Z d � Z RS( s� A L{GroupOwnedUNIXServer} is a L{UNIXServer} which changes the group ownership of its socket immediately after binding its port. @ivar gid: the group ID which should own the socket after it is bound. c O s& t t | � j | | � | | _ d S( N( R� R R� R� ( R� R� R� t kw( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyR� s c C s9 t t | � j � | j j } t | t � | j � d S( sA Bind the UNIX socket and then change its group. N( R� R R� t _portt portR R R� ( R� t fileName( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyR� s ( R� R� R� R� R� ( ( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyR � s t SlaveSpawnerServicec B s& e Z d Z d d d � Z d � Z RS( s� Service to add all Python subprocesses that need to do work to a L{DelayedStartupProcessMonitor}: - regular slave processes (CalDAV workers) c C sL | | _ | | _ | | _ | | _ | | _ | | _ | | _ | | _ d S( N( t makert monitort dispensert dispatchert statst configPatht inheritFDst inheritSSLFDs( R� R R R R! R" R# R$ R% ( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyR� s c C s t j j r t j d � t j t j d g } t j rQ | j d t j f � n t j rs | j d t j f � n t j j r� | j d j t j j d � � | j d � n | j d j t j j � d d d | j d d d d d d f � | j j d | d t �n t j d � x� t d t j j � D]� } t j rZt d | j j | � � } n t d | j d | j � } | j d k r�| j d | j � n t! t j d | j" j# | j | t j$ | � } | j j% | t � q-W| j& d k r | j j' j( d | j& j) � n d S( Ns Adding directory proxy servicei s -us -gs --profile={}/{}.pstatst dpss --savestatss --profilers cprofile-cpus --reactor={}s -nt caldav_directoryproxys -fs -os ProcessType=DPSs ErrorLogFile=Nones ErrorLogEnabled=Falset directoryproxyt envs& Directory proxy service is not enabledt metaSocketR$ R% t ampSQLDispenseri ( s --savestatss --profilers cprofile-cpu(* R t DirectoryProxyt EnabledR� R R� t executablet argvt UserNamet extendt GroupNamet Profilingt appendR� t BaseDirectoryt Twistedt reactorR# R t addProcesst PARENT_ENVIRONMENTt xranget MultiProcesst ProcessCountt UseMetaFDR� R! t addSocketR$ R% R R� t updatet TwistdSlaveProcessR t tapnamet BindAddressest addProcessObjectR" t _reactort callLatert makeDirectoryProxyClient( R� t dpsArgvt slaveNumbert extraArgst process( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyt startService& sH N( R� R� R� R� R� RK ( ( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyR s t WorkSchedulingServicec B s8 e Z d Z e � Z d � Z d � Z e d � � Z RS( sN A Service to kick off the initial scheduling of periodic work items. c C s( | | _ | | _ | | _ | | _ d S( s� @param store: the Store to use for enqueuing work @param doImip: whether to schedule imip polling @type doImip: boolean @param doGroupCaching: whether to schedule group caching @type doImip: boolean N( t storet doImipt doGroupCachingt doPrincipalPurging( R� RM RN RO RP ( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyR� b s c C s$ d d l m } | j | j � d S( Ni����( R7 ( t twisted.internetR7 t callWhenRunningt initializeWork( R� R7 ( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyRK o s c c s- | j r5 t | j t j r* t t j � n d � Vn | j rm t j | j t j rb t t j � n d � Vn | j r� t j | j t j r� t t j � n d � Vn t j | j t j r� t t j � n d � Vt j | j t j r� t t j � n d � Vt j | j t j r!t t j � n d � Vd S( Ni ( RN RM RM R t LogIDR� RO RB t initialScheduleRP RC RW RV Rj ( R� ( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyRS t s* # # # ( R� R� R� R1 R� R� RK R" RS ( ( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyRL \ s t PreProcessingServicec B s> e Z d Z d d � Z d � Z d � Z d � Z d � Z RS( s� A Service responsible for running any work that needs to be finished prior to the main service starting. Once that work is done, it instantiates the main service and adds it to the Service hierarchy (specifically to its parent). If the final work step does not return a Failure, that is an indication the store is ready and it is passed to the main service. Otherwise, None is passed to the main service in place of a store. This is mostly useful in the case of command line utilities that need to do something different if the store is not available (e.g. utilities that aren't allowed to upgrade the database). c C se | | _ | | _ | | _ | | _ | | _ t � | _ | d k rX d d l m } n | | _ d S( s� @param serviceCreator: callable which will be passed the connection pool, store, and log observer, and should return a Service @param connectionPool: connection pool to pass to serviceCreator @param store: the store object being processed @param logObserver: log observer to pass to serviceCreator @param storageService: the service responsible for starting/stopping the data store i����( R7 N( t serviceCreatort connectionPoolRM R� t storageServiceRm t stepperR� RQ R7 ( R� RW RX RM R� RY R7 ( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyR� � s c C s\ | j | j | j | j | j � } | j d k rR | j j d | j | j � n t d � S( s� The final "step"; if we get here we know our store is ready, so we create the main service and pass in the store. i N( RW RX RM R� RY R� R� R7 RE R� R# ( R� R� t service( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyt stepWithResult� s c C s� yS | j | j d | j | j � } | j d k rR | j j d | j | j � n Wn� t k r� t j d � t j r� t t j � r� t j d d t j �t d t j g d t d t � j � t j d � q� n | j j � n Xt d � S( s� The final "step", but if we get here we know our store is not ready, so we create the main service and pass in a None for the store. i s' Data store not available; shutting downs Disabling service via {exe}t exeR� R� t stderri< N( RW RX R� R� RY R� R7 RE R� t StoreNotAvailableR� R� R t ServiceDisablingProgramR R R t communicatet timet sleepR� R# ( R� t failureR[ ( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyt stepWithFailure� s* c C s | j j | � | S( sm Hand the step to our Stepper @param step: an object implementing stepWithResult( ) ( RZ t addStep( R� t step( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyRf � s c C s | j | � | j j � d S( s� Add ourself as the final step, and then tell the coordinator to start working on each step one at a time. N( Rf RZ R� ( R� ( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyRK � s N( R� R� R� R� R� R\ Re Rf RK ( ( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyRV � s ' R_ c B s e Z d Z RS( sK Raised when we want to give up because the store is not available ( R� R� R� ( ( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyR_ s t SSLDirectoryMapc B s e Z d � Z d � Z RS( c C s | | _ | | _ d S( N( t directoryPatht defaultBundle( R� Ri Rj ( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyR� s c C s� | j } | d k r3 | j j | � j d � } n | j � rO t | j � � S| j j � r� t | j j � � Sd d l m } t d | d | | � d � � n d S( Ns .pemi����( t pformats No pem file found for s when looking in 't '( Rj R� Ri t childt siblingExtensiont isfileR7 t getContentt pprintRk t KeyError( R� t hostnamet filePathRk ( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyt __getitem__ s ( R� R� R� Ru ( ( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyRh s c B s� e Z e � Z e e e � d Z d Z e Z d � Z d � Z d � Z d � Z d � Z d � Z e d � Z e e d � Z d � Z d � Z d � Z e e d � Z d � Z d � Z RS( t caldavs Calendar and Contacts Serverc C s | j j d d t d t �y d d l m } Wn t k rC no Xt t j d � } t j ru d j t j � } n d } t j d k r� d } n | d j t t j | | � � t | d j t j � d � } | s� t d j t j � � � nd d l m } | j � t j t j j t j j � t j d k rFt t j � n y | | � } Wn9 t k r�} t j j d j | � � t j d � n Xd � } t j j r t i | | j 6� } x' | j! j" � D] \ } } | | | <q�W| j# d | d | � n | Sd S( s/ Create the top-level service. sK {log_source.description} {version} starting {config.ProcessType} process...Rz R i����( t setproctitlei s #{}R t Utilitys CalendarServer {} [{}{}] {}s makeService_{}s@ Unknown server type {}. Please choose: Slave, Single or Combined( R7 t Combinedt Singles Configuration error: {} i c S s$ | d k r d Sd j d | � Sd S( Nt Unknowns( {frame.f_code.co_name}: {frame.f_lineno}t frame( R� R� ( R| ( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyt locationv s t namespaceR� N( Ry Rz ($ R� R Rz R Rw t ImportErrorR R� R/ RT R� R� t getattrR� R RQ R7 t getThreadPoolRY t installPoolst Memcachedt Poolst MaxClientsR\ t LocalizationR[ R^ t writeR� t ManholeR- R� R� t namedServicest iteritemst _makeManhole( R� t optionsRw t execNamet logIDt serviceMethodR7 R[ R� R} R~ t nt s( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyt makeService( sR c C s� t j r. t t t t j � t t j � � � St t j t j d t j d t d t j d t t j t j � d t j j � d t j j j d t j j j d t j j j d t j j j � S( sk Create an SSL context factory for use with any SSL socket talking to this server. t certificateChainFilet passwdCallbackt keychainIdentityt sslmethodt cipherst verifyClientt requireClientCertificatet clientCACertFileNamest sendCAsToClient( R t SNIModeR5 Rh R6 t SSLDirt DefaultSSLBundleR4 t SSLPrivateKeyt SSLCertificatet SSLAuthorityChainRt t SSLKeychainIdentityR� t OpenSSLt SSLt SSLMethodt SSLCipherst stript Authenticationt ClientCertificateR- t Requiredt CAFilest SendCAsToClient( R� ( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyt createContextFactory� s % c s� t t � \ } } t j j r0 t t | � � n t t | � � � j � � t � � | j | � � � � � f d � } t j t j | � | d k r� | j d � | j � � n t j r� t j � | j j d d � �� f d � } n4 t t j � � | j j d d � �� f d � } t � } d t f � � f d � � Y� t � } � | _ | j t | � d d l m } t � | � r�� f d � } t � j | � } | j t | � n t | | � } | j d � | j � � d � t j j r�g } t j j j! j rWt" j# t j j j! � � } | j$ | � | j d � | j � � n t j j j j r�t% | � } | j$ | � n | r�t& | � � q�n t j' j( j r�t) � � t j' j( j* � � � j d � � j � � n d � t j+ j rht j, rt- d d d �n d } t. � d t j+ j/ d t j+ j0 d t j+ j1 d t j+ j2 d t j+ j3 d | �� n d � t4 j5 | � � � � � f d � } � j6 | � � S( s� Create a "slave" service, a subprocess of a service created with L{makeService_Combined}, which does the work of actually handling CalDAV and CardDAV requests. c s t j r � j � n d S( N( R t EnableControlAPIt flush( t signalNumt ignored( t directory( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyt flushDirectoryCache� s t dbs Control via AF_UNIX: {id}t idc s t | � � S( N( R$ ( R7 ( R� ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyt <lambda>� s s Control via AF_INET: {id}c s t | d � � S( Ns 127.0.0.1( R% ( R7 ( R� ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyR� � s t LogClientc s e Z � � f d � Z RS( c s' t � | � j | � � j | � d S( N( R� t startReceivingBoxest addClient( R� t sender( R� R� ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyR� � s ( R� R� R� ( ( R� R� ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyR� � s i����( t CommonDataStorec s | � _ d S( N( t queuer( t connectionFromMaster( RM ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyt queueMasterAvailable� s R� t APNSRL s /principals/__uids__/{token}/t cacheHandlet PrincipalTokent updateSecondst initialSchedulingDelaySecondst batchSizet batchSchedulingIntervalSecondst useDirectoryBasedDelegatest cacheNotifierc s+ � | _ � j | _ � | _ � | _ d S( N( t _pushDistributort rootResourcet _rootResourcet _mailRetrievert _groupCacher( t txn( t groupCachert mailRetrievert pushDistributorR� ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyt decorateTransaction s N(7 Rq R R, R- Rv Rw t directoryServiceRa t requestProcessingServicet signalt SIGUSR1R� t setNameR� Rd R� R R� t ControlPortR. R( t protocolt addFactoryt _LOG_ROUTEt txdav.common.datastore.sqlR� R� t QueueWorkerFactoryt newTransactiont _QUEUE_ROUTERe t Notificationst ServicesR� Ri R� R4 Rh Rk t Schedulingt iMIPRL t Receivingt GroupCachingt EnableResponseCacheRZ RX t UpdateSecondst InitialSchedulingDelaySecondst BatchSizet BatchSchedulingIntervalSecondst UseDirectoryBasedDelegatesRy t setupForWorkert callWithNewTransactions( R� R� t poolt txnFactoryR� t endpointFactoryt controlSocketClientR� t SQLStoreR� t queueFactoryt controlClientt observerst pushSubServiceR� R� ( ( R� R� R� R� R� R� R� R� RM s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyt makeService_Slave� s� ! c s� t j � j d � } t j � j d t j � g } | j j d � | j j d d | �t | � } t t | | � } | | _ t | � � t j � _ t j � _ t j � _ t j � _ � } t j s� t j r t j r | j j d d t j �� f d � } n t j t _ t j t _ t j t _ t j t _ t j t _ t j rf| � � f d � } n t | d t j d t j d t j d t �� t! � f d � } t j" | f � t# � } | j$ t j% � | j& | � t' | t j( j) j* t j+ j* t j, j* � j& | � � | _- t j. s't j/ r�t j r�x{ t j/ D]m } y | j0 � } Wn& t1 k rx} t j2 d d | �q:Xt3 t4 | � � | d t j5 d t �j& | � q:Wn x2t j. D]1 } t6 t4 | � � d t j5 d t �j& | � q�Wn�t j7 r�t j8 j* rd } nB y | j0 � } Wn/ t1 k rO} | j j2 d d | �d } n Xt9 | t4 t j7 � | d t j8 j* �} | j$ d j: t4 t j7 � � � | j& | � n=x:| j; � D],} | j< � t j r�x� t j D]� } | j j d d | d | �y | j0 � } Wn/ t1 k r9} | j j2 d d | d | �q�Xt3 t4 | � � | d | d t j5 d t! �} | j$ d j: | t4 | � � � | j& | � q�Wn xB t j= D]7 } t6 t4 | � � d | d t j5 d t! �j& | � q�Wq�Wt j � j d | � | S( s+ Make a service that will actually process HTTP requests. This may be a 'Slave' service, which runs as a worker subprocess of the 'Combined' configuration, or a 'Single' service, which is a stand-alone process that answers CalDAV/CardDAV requests by itself. s Setting up services+ Configuring access log observer: {observer}t observers Redirecting to HTTPS port {port}R c s t d � | | � S( Nt site( RF ( R� R ( t underlyingSite( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyt requestFactoryB s c s8 � | | � � � f d � } t | _ � j | � � S( Nc sD � j j � \ } } | r@ | j j d d j d t j � � n | S( Ns Strict-Transport-Securitys max-age={max_age:d}t max_age( t chanRequestt getHostInfot headerst addRawHeaderR� R t StrictTransportSecuritySeconds( R� t responset secure( t request( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyt responseFilterT s ( R� t handleErrorst addResponseFilter( R� R R ( t previousRequestFactory( R s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyR� Q s t maxRequestst maxAcceptst betweenRequestsTimeOutt varyc s | j � _ | j � _ d S( N( t MaxRequestsR t MaxAcceptsR ( R� t reloading( t httpFactory( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyt updateFactoryk s s- Unable to set up SSL context factory: {error}R� t backlogt inheritt usingSocketFiles http-{}s% Adding SSL server at {address}:{port}t addresssG Unable to set up SSL context factory: {error}Disabling SSL port: {port}t interfaces https-{}:{}N(> R� t levelst logLevelForNamespaceR� t setLogLevelForNamespaceR/ R R Ro R R� RJ t EnableSSLt BehindTLSProxyt SSLPortt BindSSLPortst RedirectHTTPToHTTPSt EnableKeepAliveRG t allowPersistentConnectionst PipelineIdleTimeOutR t IncomingDataTimeOutt inputTimeOutt IdleConnectionTimeOutt idleTimeOutt CloseConnectionTimeOutt closeTimeOutR RE R R R� R� t addPostUpdateHooksR+ R� R� R� RL R� R� R- R� t AutomaticPurgingR� t InheritFDst InheritSSLFDsR� t SSLErrorR� R9 R� t ListenBacklogR8 t MetaFDt SocketFilesRI R� t _allBindAddressest _validatePortConfigt BindHTTPPorts( R� R� RM R� t oldLogLevelt additionalR[ R� R� R R� t fdAsStrt contextFactoryR� t reportingServicet bindAddressR t httpsService( ( R R R� s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyR� s� c C s� t j r* t j d k rK t d � � qK n! t j d k rK t j g t _ n t j ru t j d k r� t d � � q� n! t j d k r� t j g t _ n d S( s� If BindHTTPPorts is specified, HTTPPort must also be specified to indicate which is the preferred port (the one to be used in URL generation, etc). If only HTTPPort is specified, BindHTTPPorts should be set to a list containing only that port number. Similarly for BindSSLPorts/SSLPort. @raise UsageError: if configuration is not valid. i s/ HTTPPort required if BindHTTPPorts is not emptys- SSLPort required if BindSSLPorts is not emptyN( R R1 t HTTPPortR R R ( R� ( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyR0 � s c C sd t j s] t t d t � rN t � rN t � r< d g t _ qZ d d g t _ q] d g t _ n t j S( s An empty array for the config value of BindAddresses should be equivalent to an array containing two BindAddresses; one with a single empty string, and one with "::", meaning "bind everything on both IPv4 and IPv6". t has_ipv6s ::R ( R RB R� R� R� R� R� ( R� ( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyR/ � s c C s< x5t j j j � D]!\ } } | j r t j j d d g } | j d � rk | j d t | j � g � n% | j d t | j � d | j g � t j j d k r� | j d t t j j � g � n t j r� | j d t j g � n | j t j j � | d k r'| j d j | � | d t �q4t | � q q Wd S( s| Optionally start memcached through the specified ProcessMonitor, or if monitor is None, use Popen. s -Ut 0t MemcacheSockets -ss -ps -li s -ms -us memcached-{}R) N( R R� R� t itemst ServerEnabledt memcachedR� R1 t strR< t Portt BindAddresst MaxMemoryR0 R R� R8 R� R9 R ( R� R R� R� t memcachedArgv( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyt _spawnMemcached s* c C s� y d d l } d d l } Wn t k r/ n Xypd t � k rO | | d <n d t � k rk | | d <n d d l m } | j i | d 6t d 6� d d l m } t j d k r� d n t t j � d } d j t j j | � } | i t j j d 6t j j t k r| n d d 6t j j t k r1| n d d 6t j d 6t j j d 6t j j d 6| d 6� } | j d � | d k r�| j | � n t d | � WnU t k r�t d � d d l } | j � d k r�t j j r�t d � q�q�n Xd S( Ni����t inspectt inst objgrapht og( Rq t ppt cfg( R� R i i s tcp:{:d}:interface=127.0.0.1t passwdt telnetPortt sshPortt sshKeyDirt sshKeyNamet sshKeySizeR~ t manholes Manhole access enabled:sK Manhole access could not enabled because manhole_tap could not be imported.t DarwinsX Set Manhole.UseSSH to false or rebuild CS with the USE_OPENSSL environment variable set.( RF RH R t localsRq R? R t twisted.conch.manhole_tapR� RT R� R� R� t StartingPortNumbert PasswordFilePatht UseSSHR� R� R� t DataRootRP RQ R� R� R� t platformt system( R� R~ R� RF RH Rq t manholeMakeServicet portOffsett portStringt manholeServiceRZ ( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyR� 3 sL ( c su � � � f d � } t t j t j � \ } � � j � t t j � } � j d d � � j | | d | d � �S( s� Create a service to be used in a single-process, stand-alone configuration. Memcached will be spawned automatically. c s' | d k r t � � n � j � | | � � d � t j j rg } t j j j j r� t j t j j j | � } | j | � | j d � | j � � n t j j j j r� t d � t j j j j t j j j j t j j j j � } | j | � n | rt | � � qn | j � } d d l m } t | | j d t d t j �} | | _ | _ | j � � t j j j r�t | | t j j j � � � j d � � j � � n d � d } t j j! r t" | d � } | | _# t$ � t j j% | d d �} | j d � | j � � n t j j& rzt" | d � } | | _# t' t j j( | d d �} | j d � | j � � n t j) j r�t j* r�t+ d d d �n d } t, | d t j) j- d t j) j. d t j) j/ d t j) j0 d t j) j1 d | �� n d � � � � � f d � } | j2 | � � S( NR� i����( R7 t useWorkerPoolt disableWorkProcessingR� t modei� s unix-statsR R s tcp-statss /principals/__uids__/{token}/R� R� R� R� R� R� R� R� c s+ � | _ � j | _ � | _ � | _ d S( N( R� R� R� R� R� ( R� ( R� R� R� R� ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyR� � s (3 R� R_ R� R R� R- R� R� Ri R� R4 R� R� R. Rg RA t EnableStaggeringt StaggerSecondsRk R� RQ R7 R? R� R� t MigrationOnlyR� R� R� R� RL R� t Statst EnableUnixStatsSocketRf RM R t UnixStatsSockett EnableTCPStatsSocketR) t TCPStatsPortR� R� RZ RX R� R� R� R� R� R� ( R� RM R� RY R� R� R� R7 R" t statsServiceR� R� ( R� R� R� ( R� R� R� R� s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyt slaveSvcCreatorl s� ! R R� R� N( t getSystemIDsR R0 R2 t deleteStaleSocketFilesRc t AccessLogFileRE R� RY ( R� R� Rl R� R� ( ( R� R� R� s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyt makeService_Singleg s a c C s@ d � } t t j t j � \ } } | j | d d | d | �S( s� Create a service to be used in a command-line utility Specify the actual utility service class in config.UtilityServiceClass. When created, that service will have access to the storage facilities. c S s t j | � S( N( R t UtilityServiceClass( R� RM R� RY ( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyt toolServiceCreator� s R� R� N( Rm R R0 R2 RY R� ( R� R� Rr R� R� ( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyt makeService_Utility� s c C s� t d � } t j | f � t j � t t j d d t d t �t t _ t _ d � } t t j t j � \ } } | j | d d | d | �} t t j t j t j d d t j t j � } | j d � | j | � | S( sR Create an agent service which listens for configuration requests c S s t | j j j _ d S( N( R� R� R� t Defaultt ClientEnabled( R� R ( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyt agentPostUpdateHook� s s Server rootR R c S s| d d l m } | d k rW d d l m } t | t j t | | � � } | j � n | d k rr t � | _ n | | � S( Ni����( t makeAgentService( R7 ( t calendarserver.tools.agentRw R� RQ R7 R2 R RY t DataStoreMonitort startListeningR> R� ( R� RM R� RY Rw R7 t dataStoreWatcher( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyt agentServiceCreator s R� R� i t agentN( R� R R' t reloadRD t ServerRootR R� t EnableCalDAVt EnableCardDAVRm R0 R2 RY R� R� R� t AgentLogFileR� R� R� R� R� ( R� R� Rv R| R� R� t svct agentLoggingService( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyt makeService_Agent� s, c s� d � � � � � f d � } t j r� t � d k rE | � | � n d � d � t j d k r� t t | d t j � d � d � �} | S| t j t j � t j t j t j � j d � Sn% t t d d � } � d | � d � Sd S( s! If necessary, create a service to be started used for storage; for example, starting a database backend. This service will then start the main service. This has the effect of delaying any child process spawning or stand alone port-binding until the backing for the selected data store implementation is ready to process requests. @param createMainService: This is the service that will be doing the main work of the current process. If the configured storage mode does not require any particular setup, then this may return the C{mainService} argument. @type createMainService: C{callable} that takes C{(connectionPool, store)} and returns L{IService} @param uid: the user ID to run the backend as, if this process is running as root (also the uid to chown Attachments to). @type uid: C{int} @param gid: the user ID to run the backend as, if this process is running as root (also the gid to chown Attachments to). @type gid: C{int} @param directory: The directory service to use. @type directory: L{IStoreDirectoryService} or None @return: the appropriate a service to start. @rtype: L{IService} c sy | d k r t � d � n6 | d k r6 t � d � n | d k rQ t � d � n � � � � � � � � f d � } | S( NR t pyformatt postgrest oraclet numericc s� t � } t | d t � � � � d t j �} | j d � | j | � t t | j � } t � | | � | � } | j t | � � | j t t | � � | j t | d � d � d t j d t j �� | j t | d � d � �� | j t | d � d � �� | j t | d � d � �� | j t t j t t j � � | d � d � d t j �� | j t | d � d � �� | j t | t t � d t � � � | j t | � � | j d � | j | � | S( Nt dbtypet maxConnectionsR� R� R� t failIfUpgradeNeededt checkExistingSchemat merget doPostImportt pre( R+ R: R= R t MaxDBConnectionsPerPoolR� R� Rw t connectionRV Rf RS R_ RQ t FailIfUpgradeNeededt CheckExistingSchemaRR RO RU RN t fileStoreFromPathR0 t DocumentRoott MergeUpgradesRP R` R� R� RT ( t connectionFactoryRY t mst cpRM t pps( t createMainServicet dbfeaturest dialectR� t overrideGIDt overrideUIDt paramstyleR� ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyt subServiceFactoryR sZ ( R; R< ( R� R� R� ( R� R� R� R� R� ( R� R� R� s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyt createSubServiceFactoryG s $Ui R R� R� N( ( R t UseDatabaseR R� t DBTypeRp t DBFeaturesRK t connectorFort DatabaseConnectiont connectRs ( R� R� R� R� R� R� t pgservRM ( ( R� R� R� R� R� s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyRY % s" " g "c s� t t j t j t j d d t j t j � � t t � s? � St t j � j � � � j � t t t j � � } t j r� y t t j � j } Wq� t k r� t d j t j � � � q� Xn t � } t j ry t t j � j } Wq"t k rt d j t j � � � q"Xn t � } t � � � j t | � t j � � t j j r�t j j! j" j r�t j j! j" } t# � � | d | d | d � n t j r�t$ | t j � d d �} n t% t j& � d d �} | j' t( � | j � � t) � � � � _* � j' d � � j � � � f d � } t+ j+ t+ j, | � t j- j r�t. � t j- j/ t j- j0 t j- j1 � } | j' d � | j � � n � j2 d � � g � g � t j3 r�t4 t j5 t j6 t j7 j8 � � � j9 � n g � _: d � t j< j rUt j< j= r'� j> d t j< j= t j? � n t j< j@ r�� j> d t j< j@ t j? � q�n5x2� jA � D]$} � jB � t j3 r�t jC d f g } t jD r�| jE t jF d f � n x� | D]6 \ } } x' | D] } � jG | | | t j? � q�Wq�Wqb� f d � } x9 t jC D]. } | | tH | � � } � jE | jI � � q Wt jD rbx< t jF D]. } | | tH | � � } � jE | jI � � qQWqbqbWd � t jJ jK r�tL | jM t j3 r�� n d � � t$ | t jJ jN � d d �} | j' d � | j � � ne t jJ jO r]tL | jM t j3 r � n d � � tP t jJ jQ � d d �} | j' d � | j � � n � � � � � � � � � f d � } � jR | d | | � } | j' d � | j � � � S( s� Create a master service to coordinate a multi-process configuration, spawning subprocesses that use L{makeService_Slave} to perform work. i s Invalid group name: {}s Invalid user name: {}RA Rc Rd Rb i� R s 127.0.0.1t pmc s# t j r � j | d d �n d S( Nt startswithnameRv ( R R� t signalAll( R� R� ( R ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyt forwardSignalToWorkers( s t mlR R� t TCPc s� t j d d | d | �t j t j t j � } | j d � | j t j t j d � | j | | f � | j t j � � j j | � | S( Ns2 Opening socket for inheritance at {address}:{port}R R i i ( R� R R� R� R� t setblockingR� R� R� R� R� R R, t _inheritedSocketsR4 ( t addrR t sock( R� ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyt _openSocket` s s unix-statsR s tcp-statsc sV | d k r t � � n � d k r0 | � _ n d d l m } t | | j d t j �} t � | _ | | _ � j t | j � � | d k r� t j r� � j j d � t | � } n d } t � } | j d � | j | � t � � | � � � d d � d � �} | j d � | j | � t j rA� j | � n | j � } t t | g � � t j j j r�t | | t j j j � � � j d � � j | � n d � t j j r*t j r�t! d d d �n d } t" | d t j j# d t j j$ d t j j% d t j j& d t j j' d | �� n d � � � � f d � } | j( | � | S( Ni����( R7 Ra s Using Shared Connection Poolt multiR R$ R% t spawnerRL s /principals/__uids__/{token}/R� R� R� R� R� R� R� R� c s( d | _ � | _ � | _ � | _ d S( N( R� R� R� R� R� ( R� ( R� R� R� ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyR� � s () R� R_ RM RQ R7 R? R� R Re R> R� R� R� R� t workerListenerFactoryt SharedConnectionPoolR� t warnRl R+ R� R� R R= R� Ro R� R� R- RL R� R� R� RZ RX R� R� R� R� R� R� ( R� RM R� RY R7 R R� R� R� R� R� ( t clt controlSocketR! R$ R% R R� R� R" ( R� R� R� s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyt spawnerSvcCreator� s` ! t ssvcN(S R� R R� R� R� R� R� Ru RA R R� Rn Rb Rc Ro R2 R t gr_gidRr R[ R� R R0 R t pw_uidR Rd R� R� Ry t setupForMasterR� R- R� R. Rg R t ControlPortTCPServerR� R� t _CONTROL_SERVICE_NAMEt DelayedStartupProcessMonitort processMonitorR� R� t MemoryLimiterRr t Secondst Bytest ResidentOnlyRE R= RH R R R; R< R! R� R� R. t Securedt addSocketFileServiceR, t UnsecuredR/ R0 R1 R R4 R t addPortServiceR� t filenoRf Rg Rf R� Rh Ri R) Rj RY ( R� R� t loggerR� R� t ampSettingst controlSocketServiceR� t memoryLimiterR7 t portsListt portst descriptionR R� t portNumR� Rk R� R� ( ( R� R� R! R$ R% R R� R� R� R" s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyt makeService_Combined� s� ! ! 'P c C s xt j t j j g D]� } t | � r t t | � j � s` | j j d d | �t | � qt j t j t j � } d } t j t j g } xF | D]> } y$ | j d | f � | j d � Wq� | d } q� Xq� W| t | � k r| j j d d | �t | � qq q Wd S( Ns3 Deleting stale socket file (not a socket): {socket}R� i s 127.0.0.1i i s@ Deleting stale socket file (not accepting connections): {socket}( R Rd Rf Rh R R R t st_modeR� R� R R� R� R� R9 R R� t shutdownR� ( R� t checkSockett tmpSockett numConnectFailurest testPortst testPort( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyRn � s. ( R� R� R1 R� R R R, RA R� R R� R� R� R� R� R0 R/ R� RE R� Rp Rs R� RY R� Rn ( ( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyR s( ] w � %4 w 8� � R@ c B sV e Z d Z d Z d d d d d � Z d � Z d � Z d � Z d � Z d � Z RS( st A L{TwistdSlaveProcess} is information about how to start a slave process running a C{twistd} plugin, to be used by L{DelayedStartupProcessMonitor.addProcessObject}. @ivar twistd: The path to the twistd executable to launch. @type twistd: C{str} @ivar tapname: The name of the twistd plugin to launch. @type tapname: C{str} @ivar id: The instance identifier for this slave process. @type id: C{int} @ivar interfaces: A sequence of interface addresses which the process will be configured to bind to. @type interfaces: sequence of C{str} @ivar inheritFDs: File descriptors to be inherited for calling accept() on in the subprocess. @type inheritFDs: C{list} of C{int}, or C{None} @ivar inheritSSLFDs: File descriptors to be inherited for calling accept() on in the subprocess, and speaking TLS on the resulting sockets. @type inheritSSLFDs: C{list} of C{int}, or C{None} @ivar metaSocket: an AF_UNIX/SOCK_DGRAM socket (initialized from the dispatcher passed to C{__init__}) that is to be inherited by the subprocess and used to accept incoming connections. @type metaSocket: L{socket.socket} @ivar ampSQLDispenser: a factory for AF_UNIX/SOCK_STREAM sockets that are to be inherited by subprocesses and used for sending AMP SQL commands back to its parent. Rv c C ss | | _ | | _ | | _ | | _ d � } | | � | _ | | � | _ | | _ | | _ | | _ d | _ d S( Nc S s | d k r g S| Sd S( N( R� ( t x( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyt emptyIfNoneB s ( t twistdRA t configFileR� R$ R% R* t interfacesR+ R� t ampDBSocket( R� R� RA R� R� R� R$ R% R* R+ R� ( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyR� 6 s c C s# | j d k r | j j � n d S( sn Called when the process is being started (or restarted). Allows for various initialization operations to be done. The child process will itself signal back to the master when it is ready to accept sockets - until then the master socket is marked as "starting" which means it is not active and won't be dispatched to. N( R* R� R� ( R� ( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyt startingO s c C s# | j d k r | j j � n d S( s� Called when the process has stopped (died). The socket is marked as "stopped" which means it is not active and won't be dispatched to. N( R* R� R� ( R� ( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyt stopped] s c C s d j | j | j � S( Ns {}-{}( R� t prefixR� ( R� ( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyt getNameh s c C s� i } g } | j d k r: | j | j j � j � � n | j d k rt | j j � | _ | j | j j � � n x& | j | j | D] } | | | <q� W| S( s6 Get the file descriptors that will be passed to the subprocess, as a mapping that will be used with L{IReactorProcess.spawnProcess}. If this server is configured to use a meta FD, pass the client end of the meta FD. If this server is configured to use an AMP database connection pool, pass a pre-connected AMP socket. Note that, contrary to the documentation for L{twext.internet.sendfdport.InheritedSocketDispatcher.addSocket}, this does I{not} close the added child socket; this method (C{getFileDescriptors}) is called repeatedly to start a new process with the same C{LogID} if the previous one exits. Therefore we consistently re-use the same file descriptor and leave it open in the master, relying upon process-exit notification rather than noticing the meta-FD socket was closed in the subprocess. @return: a mapping of file descriptor numbers for the new (child) process to file descriptor numbers in the current (master) process. N( R* R� R4 t childSocketR� R+ t dispenseR� R% R$ ( R� t fdst extraFDst fd( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyt getFileDescriptorsk s c C s8 t j | j g } t j r4 | j d t j f � n t j rV | j d t j f � n t j j r� | j d j t j j | j � � � | j d � n | j d j t j j � d | j d | j d d d d j d j | j � � d d j | j | j � d d d d d d j | j � d d j t j j � d d j t j � g � | j r�| j d d j d j t t | j � � � g � n | j r�| j d d j d j t t | j � � � g � n | j d k r�| j d d j | j j � j � � g � n | j d k r4| j d d j | j j � � g � n | S( s� @return: a list of command-line arguments, including the executable to be used to start this subprocess. @rtype: C{list} of C{str} s -us -gs --profile={}/{}.pstatss --savestatss --profilers cprofile-cpus --reactor={}s -ns -fs -os ProcessType=Slaves BindAddresses={}R� s PIDFile={}-instance-{}.pids ErrorLogFile=Nones ErrorLogEnabled=Falses LogID={}s MultiProcess/ProcessCount={:d}s ControlPort={:d}s InheritFDs={}s InheritSSLFDs={}s MetaFD={}s DBAMPFD={}( s --savestatss --profilers cprofile-cpuN( R� R. R� R R0 R1 R2 R3 R- R4 R� R5 R� R6 R7 RA R� t joinR� R� R; R< R� R$ t mapR@ R% R* R� R� R� R� ( R� R� ( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyt getCommandLine� sL % % "N( R� R� R� R� R� R� R� R� R� R� R� ( ( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyR@ s # R� c B s e Z d Z d � Z RS( s� This TCPServer retrieves the port number that was actually assigned when the service was started, and stores that into config.ControlPort c C s& t j | � | j j � j t _ d S( N( R) RK R t getHostR R R� ( R� ( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyRK � s ( R� R� R� RK ( ( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyR� � s R� c B s� e Z d Z d Z d Z d Z d Z d d � Z d d i d � Z d d d � Z d � Z d � Z d � Z d � Z d � Z d � Z d d � Z d � Z d � Z d Z d � Z d � Z d � Z RS( sO A L{DelayedStartupProcessMonitor} is a L{procmon.ProcessMonitor} that defers building its command lines until the service is actually ready to start. It also specializes process-starting to allow for process objects to determine their arguments as they are started up rather than entirely ahead of time. Also, unlike L{procmon.ProcessMonitor}, its C{stopService} returns a L{Deferred} which fires only when all processes have shut down, to allow for a clean service shutdown. @ivar reactor: an L{IReactorProcess} for spawning processes, defaulting to the global reactor. @ivar delayInterval: the amount of time to wait between starting subsequent processes. @ivar stopping: a flag used to determine whether it is time to fire the Deferreds that track service shutdown. i i i c C s� t t | � j � | d k r2 d d l m } n | | _ t � | _ i | _ i | _ i | _ i | _ i | _ t | _ t j j j r� t j j j | _ n d | _ d S( Ni����( R7 i ( R� R� R� R� RQ R7 RD R t processest protocolst delayt timeStartedt murdert restartR� t stoppingR R; t StaggeredStartupR- t Intervalt delayInterval( R� R7 ( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyR� � s c s< d t f � � f d � � Y} | j | � | | | � d S( sO Add a new monitored process and start it immediately if the L{DelayedStartupProcessMonitor} service is running. Note that args are passed to the system call, not to the shell. If running the shell is desired, the common idiom is to use C{ProcessMonitor.addProcess("name", ['/bin/sh', '-c', shell_script])} @param name: A name for this process. This value must be unique across all processes added to this monitor. @type name: C{str} @param args: The argv sequence for the process to launch. @param uid: The user ID to use to run the process. If C{None}, the current UID is used. @type uid: C{int} @param gid: The group ID to use to run the process. If C{None}, the current GID is used. @type uid: C{int} @param env: The environment to give to the launched process. See L{IReactorProcess.spawnProcess}'s C{env} parameter. @type env: C{dict} @raises: C{KeyError} if a process with the given name already exists t SimpleProcessObjectc sA e Z d � Z d � Z � f d � Z � f d � Z d � Z RS( c S s d S( N( ( R� ( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyR� s c S s d S( N( ( R� ( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyR� s c s � S( N( ( R� ( R� ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyR� # s c s � S( N( ( R� ( R� ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyR� & s c S s g S( N( ( R� ( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyR� ) s ( R� R� R� R� R� R� R� ( ( R� R� ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyR� s N( t objectRC ( R� R� R� R� R� R) R� ( ( R� R� s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyR8 s c C sR | j � } | | | | f | j | <| j | j | <| j rN | j | � n d S( s� Add a process object to be run when this service is started. @param env: a dictionary of environment variables. @param process: a L{TwistdSlaveProcesses} object to be started upon service startup. N( R� R� t minRestartDelayR� t runningt startProcess( R� RJ R) R� R� R� ( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyRC . s c C s8 t t | � j � x | j D] } | j | � q Wd S( N( R� R� RK R� R ( R� R� ( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyRK = s c C s� t | _ i | _ x! | j D] } t � | j | <q Wt t | � j � x6 | j j � D]% \ } } | j � rY | j � qY qY Wx$ t | j � D] } | j | � q� Wt | j j � � S( sS Return a deferred that fires when all child processes have ended. ( R� R� t deferredsR� R! R� R� R� R� R= t activet cancelt reversedt stopProcessR t values( R� R� t delayedCall( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyR� F s c C s | j | � | j | =d S( s� Stop the named process and remove it from the list of monitored processes. @type name: C{str} @param name: A string that uniquely identifies the process. N( R R� ( R� R� ( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyt removeProcess[ s c C s� | | j k r' t d j | � � � n | j j | d � } | d k r� | j } y | j d � Wn t k ru q� X| j j | j | j | � | j | <n d S( sD @param name: The name of the process to be stopped s Unrecognized process name: {}t TERMN( R� Rr R� R� R� R� t transportt signalProcessR& RD RE t killTimet _forceStopProcessR� ( R� R� t protot proc( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyR f s c C sM | | j k rC | j | j � r6 | j | j � n | j | =n | j | d j � | j | =| j j � | j | | j k r� | j | } t | j | d | j � | j | <n d } | j | j | <| j r | | j k r | j j | | j | � | j | <n | j rI| j j | d � } | d k rI| j d � qIn d S( s� When a child process has ended it calls me so I can fire the appropriate deferred which was created in stopService. Also make sure to signal the dispatcher so that the socket is marked as inactive. i i N( R� R R R� R� R� RD t secondsR� t thresholdR� t mint maxRestartDelayR� R RE R R� R� R t popR� t callback( R� R� t nextDelayt deferred( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyt processEndedy s& # ' c C s) y | j d � Wn t k r$ n Xd S( s? @param proc: An L{IProcessTransport} provider t KILLN( R R& ( R� R ( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyR � s c C sL xE | j j � D]4 } | d k s1 | j | � r | j | | � q q Wd S( s Send a signal to all child processes. @param signal: the signal to send @type signal: C{int} @param startswithname: is set only signal those processes whose name starts with this string @type signal: C{str} N( R� t keysR� t startswithR ( R� R� R� R� ( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyR� � s c C sL | | j k r d S| j | j } y | j | � Wn t k rG n Xd S( s Send a signal to a single monitored process, by name, if that process is running; otherwise, do nothing. @param signal: the signal to send @type signal: C{int} @param name: the name of the process to signal. @type signal: C{str} N( R� R R R& ( R� R� R� R ( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyR � s c C s� | | j k r d St � } | j | <| | _ | | _ | j | \ } } } } t j � | j | <i d d 6d d 6d d 6} | j | j � � | j � | j � } | j j | | d | d | d | d | d | �d S( s� Actually start a process. (Re-implemented here rather than just using the inherited implementation of startService because ProcessMonitor doesn't allow customization of subprocess environment). Nt wi t ri i R� R� R) t childFDs( R� t DelayedStartupLoggingProtocolR[ R� R� Rb R� R? R� R� R� RD t spawnProcess( R� R� t pt procObjR) R� R� R R� ( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyt reallyStartProcess� s "i c sH � j � j } � j d 7_ � � f d � } � j j | | � d S( s� Start process named 'name'. If another process has started recently, wait until some time has passed before actually starting this process. @param name: the name of the process to start. i c s � j d 8_ � j � � d S( Ni ( t _pendingStartsR$ ( ( R� R� ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyt delayedStart� s N( R� R% RD RE ( R� R� t intervalR& ( ( R� R� s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyR � s c C s% x | j D] } | j | � q Wd S( s� Restart all processes. This is useful for third party management services to allow a user to restart servers because of an outside change in circumstances -- for example, a new version of a library is installed. N( R� R ( R� R� ( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyt restartAll� s c C s� g } x� | j j � D]� \ } \ } } } } d } | d k rO t | � } n | d k rr | d t | � 7} n | r� d | d } n | j d j | | | � � q Wd j d | d d j | � � S( NR t :t (t )s {}{}: {}s <{self.__class__.__name__} {l}>R� t lR~ ( R� R= R� R@ R4 R� R� ( R� R, R� R# R� R� t _ignore_envt uidgid( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyt __repr__ s ( N( R� R� R� R R R� R R� R� R8 RC RK R� R R R R R� R R$ R% R R( R/ ( ( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyR� � s* , ( t DelayedStartupLineLoggerc B sY e Z d Z d Z d Z d Z e Z d Z d � Z d � Z d � Z d � Z d � Z RS( s8 A line logger that can handle very long lines. i s (truncated, continued)R c C s d S( sO Ignore this IProtocol method, since I don't need a transport. N( ( R� R ( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyt makeConnection s c C s� | j | j d � } xy t | � d k r� | j d � } t | � | j k r_ | j | � q | j r� | j | � t | _ q | j | � q W| j d � } t | � | j k r� | j | � t | _ d | _ n | | _ d S( Ns i i R ( t _bufferR� R� R t MAX_LENGTHt lineLengthExceededt exceededR� t lineReceivedR� ( R� t datat linest linet lastLine( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyt dataReceived& s c C s& t j d d | d | j d t �d S( Ns {msg}t msgt log_systemt isError( R� t criticalt tagR� ( R� R9 ( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyR6 9 s c C s1 | j | � } x | D] } | j | � q Wd S( sp A very long line is being received. Log it immediately and forget about buffering it. N( t _breakLineIntoSegmentsR6 ( R� R9 t segmentst segment( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyR4 > s c C s� t | � } | | j | | j r) d n d } g } x` t | � D]R } | | | j | d | j !} | | d k r� | | j 7} n | j | � qC W| S( s, Break a line into segments no longer than self.MAX_LENGTH. Each segment (except for the final one) has self.CONTINUED_TEXT appended. Returns the array of segments. @param line: The line to break up @type line: C{str} @return: array of C{str} i i ( R� R3 t ranget CONTINUED_TEXTR4 ( R� R9 t lengtht numSegmentsRB t iR< ( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyRA G s N( R� R� R� R3 RE R� R@ R� R5 R2 R1 R; R6 R4 RA ( ( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyR0 s R c B sA e Z d Z d Z d Z d Z d � Z d � Z e Z d � Z RS( sA Logging protocol that handles lines which are too long. i c C s2 t � | _ | j j | j � | j | j _ d S( sw Replace the superclass's output monitoring logic with one that can handle lineLengthExceeded. N( R0 t outputR1 R R� R@ ( R� ( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyt connectionMadem s c C s' | j j | � | d d k | _ d S( Ni����s ( RI R; t empty( R� R7 ( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyt outReceivedv s c C s3 | j s | j j d � n | j j | j � d S( sH Let the service know that this child process has ended s N( RK RI R; R[ R R� ( R� t reason( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyR | s N( R� R� R� R� R[ R� RK RJ RL t errReceivedR ( ( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyR d s c C s� | rE y t | � j } WqN t k rA t d j | � � � qN Xn t � } | r� y t | � j } Wq� t k r� t d j | � � � q� Xn t � } | | f S( s, Return the system ID numbers corresponding to either: A) the userName and groupName if non-empty, or B) the real user ID and group ID of the process @param userName: The name of the user to look up the ID of. An empty value indicates the real user ID of the process should be returned instead. @type userName: C{str} @param groupName: The name of the group to look up the ID of. An empty value indicates the real group ID of the process should be returned instead. @type groupName: C{str} s Invalid user name: {}s Invalid group name: {}( R R� Rr R[ R� R R R� R ( t userNamet groupNameR� R� ( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyRm � s Ry c B s? e Z e e � d � Z d � Z d � Z d � Z d � Z RS( c C s | | _ | | _ d S( s� @param storageService: the service making use of the DataStore directory; we send it a hardStop() to shut it down N( RD t _storageService( R� R7 RY ( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyR� � s c C s | j j � | j j � d S( N( RQ t hardStopRD R� ( R� ( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyt disconnected� s c C s | j j � | j j � d S( N( RQ RR RD R� ( R� ( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyt deleted� s c C s | j j � | j j � d S( N( RQ RR RD R� ( R� ( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyt renamed� s c C s d S( N( ( R� RM ( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyt connectionLost� s ( R� R� R R3 R� RS RT RU RV ( ( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyRy � s (� t __future__R t __all__R� t collectionsR t osR R R R R R R R R t os.pathR R R� R� R Rb t subprocessR R t pwdR R t grpR R� t OpenSSL.SSLR R+ t zope.interfaceR t twistedcaldav.stdconfigR t twisted.python.logR t twisted.python.logfileR t twisted.python.usageR R t twisted.python.utilR R t twisted.pluginR t twisted.internet.deferR R! R" R# t twisted.internet.endpointsR$ R% t twisted.internet.processR& t twisted.internet.protocolR' R( t twisted.application.internetR) R* t twisted.application.serviceR+ R, R- t twisted.protocols.ampR. t twisted.loggerR/ t twext.python.filepathR0 t twext.python.logR1 t twext.internet.fswatchR2 R3 t twext.internet.sslR4 t txsni.snimapR5 t twisted.python.filepathR6 t. txsni.only_noticed_pypi_pem_after_i_wrote_thisR7 t twext.internet.tcpR8 R9 t twext.enterprise.adbapi2R: t twext.enterprise.ienterpriseR; R< R= t twext.enterprise.jobs.queueR> R? R@ R� t twext.application.serviceRA t txdav.who.groupsRB t calendarserver.tools.purgeRC t calendarserver.tools.utilRD t txweb2.channel.httpRE RF RG t txweb2.metafdRH RI t txweb2.serverRJ t txdav.base.datastore.dbapiclientRK t. txdav.caldav.datastore.scheduling.imip.inboundRL RM t& txdav.common.datastore.upgrade.migrateRN t* txdav.common.datastore.upgrade.sql.upgradeRO RP RQ RR RS RT RU t) txdav.common.datastore.work.inbox_cleanupRV t, txdav.common.datastore.work.revision_cleanupRW RX t twistedcaldavRY t twistedcaldav.cacheRZ t twistedcaldav.configR[ t twistedcaldav.localizationR\ R] R^ t twistedcaldav.upgradeR_ R` t calendarserver.accesslogRa Rb Rc t calendarserver.controlsocketRd Re t calendarserver.dashboard_serviceRf t calendarserver.push.amppushRg Rh t calendarserver.push.applepushRi Rj t calendarserver.push.notifierRk t calendarserver.tap.utilRl Rm Rn Ro Rp Rq Rr Rs Rt Ru Rv Rw Rx Ry t calendarserver.versionRz R t twisted.python.modulesR{ R� t insertR� t pathEntryRt Rm t getVersionR� R} t TWISTED_VERSIONt replaceR� R� R� R� R� R� R� R� R9 R� R� R R R R RL RV t ExceptionR_ Rh R R@ R� R� R0 R Rm Ry ( ( ( s, /opt/cpanel-ccs/calendarserver/tap/caldav.pyt <module> s� @ " 4^ " ! 8'�K<k� � � � �� � @O! %