OwlCyberSecurity - MANAGER
Edit File: sql.pyc
� �t�ac @ s d Z d d d g Z d d l m Z d d l m Z d d l m Z d d l m Z m Z m Z m Z m Z m Z m Z m Z m Z m Z m Z m Z m Z m Z m Z d d l m Z d d l m Z d d l m Z d d l m Z d d l m! Z! d d l" m# Z# d d l$ m% Z% d d l& m' Z' d d l( m) Z) m* Z* m+ Z+ d d l, m- Z- d d l. m/ Z/ d d l0 m1 Z1 d d l2 m3 Z3 d d l4 m5 Z5 m6 Z6 d d l7 m8 Z8 d d l9 m: Z; d d l< m: Z: d d l= m> Z> m? Z? d d l@ mA ZA d d lB mC ZC d d lD mE ZE d d lF mG ZG d d lH mI ZI d d lJ mK ZK mL ZL mM ZM d d lN mO ZO d d! lP mQ ZQ d d" lR mS ZS d d# lT mU ZU mV ZV mW ZW mX ZX mY ZY mZ ZZ m[ Z[ m\ Z\ m] Z] d d$ l^ m_ Z_ d d% l` ma Za mb Zb d d& lc md Zd me Ze mf Zf mg Zg mh Zh mi Zi d d' lc mj Zj mk Zk ml Zl mm Zm mn Zn mo Zo mp Zp mq Zq mr Zr ms Zs d d( lt mu Zu mv Zv d d) lw mx Zx d d* ly mz Zz m{ Z{ m| Z| d d+ l} m~ Z~ m Z d d, l� m� Z� d d- l� Z� d d- l� Z� d d- l� Z� d d- l� Z� d d- l� Z� d d- l� Z� d d. l� m� Z� e/ e� � j� j� d/ � j� d0 � j� � Z� e# � Z� d e% e� f d1 � � YZ� d2 e� f d3 � � YZ� d4 e� f d5 � � YZ� d eL eM eK eQ eI f d6 � � YZ� d ea f d7 � � YZ� d8 e1 e e_ eC eb f d9 � � YZ� d: e1 e� f d; � � YZ� d- S(< s SQL data store. t CommonDataStoret CommonStoreTransactiont CommonHomei����( t StringIO( t DateTime( t splitSQLString( t Deletet utcNowSQLt Uniont Insertt Lent Maxt Parametert SavepointActiont Selectt Updatet Countt ALL_COLUMNSt Sumt DatabaseLockt DatabaseUnlock( t AlreadyFinishedError( t LocalQueuer( t parseSQLTimestamp( t Memoizable( t classproperty( t Logger( t Service( t reactor( t inlineCallbackst returnValuet succeed( t Failure( t getModule( t FancyEqMixin( t config( t datetimeMktimet pyCalendarToSQLTimestamp( t QueryCacher( t PropertyStore( t ICalendarTransactiont ICalendarStore( t IAddressBookTransaction( t HomeChildBase( t PoddingConduit( t MigratedHomeCleanupWork( t APNSubscriptionsMixin( t DelegatesAPIMixint GroupsAPIMixint GroupCacherAPIMixin( t dumpSchema( t imipAPIMixin( t NotificationCollection( t _BIND_MODE_OWNt _BIND_STATUS_ACCEPTEDt _HOME_STATUS_EXTERNALt _HOME_STATUS_NORMALt _HOME_STATUS_PURGINGt schemat _HOME_STATUS_MIGRATINGt _HOME_STATUS_DISABLEDt _CHILD_TYPE_NORMAL( t _SharedSyncLogic( t SharingHomeMixInt SharingMixIn( t ConcurrentModificationt RecordNotAllowedErrort ShareNotAllowedt IndexedSearchExceptiont EADDRESSBOOKTYPEt ECALENDARTYPE( t HomeChildNameNotAllowedErrort HomeChildNameAlreadyExistsErrort NoSuchHomeChildErrort! ObjectResourceNameNotAllowedErrort$ ObjectResourceNameAlreadyExistsErrort NoSuchObjectResourceErrort AllRetriesFailedt TooManyObjectResourcesErrort SyncTokenValidExceptiont AlreadyInTrashError( t IStoreDirectoryServicet DirectoryRecordNotFoundError( t ChangeCategory( t displayNameForCollectiont getEventDetailst agoString( t implementst directlyProvides( t defaultdictN( t uuid4t sql_schemas current.sqlc B s e Z d Z e e � e e e d d e e d e d d e d d d � Z d � Z d � Z d � Z d � Z e e d � � Z d e d � Z d e d � Z d e d d � Z e d d � � Z d � Z d � Z e d � � Z d � Z e d � � Z e d � � Z RS( s� Shared logic for SQL-based data stores, between calendar and addressbook storage. @ivar sqlTxnFactory: A 0-arg factory callable that produces an L{IAsyncTransaction}. @ivar _notifierFactories: a C{dict} of L{IStoreNotifierFactory} objects from which the store can create notifiers for store objects. The keys are "tokens" that determine the type of notifier. @ivar attachmentsPath: a L{FilePath} indicating a directory where attachments may be stored. @ivar enableCalendars: a boolean, C{True} if this data store should provide L{ICalendarStore}, C{False} if not. @ivar enableAddressBooks: a boolean, C{True} if this data store should provide L{IAddressbookStore}, C{False} if not. @ivar label: A string, used for tagging debug messages in the case where there is more than one store. (Useful mostly for unit tests.) @ivar quota: the amount of space granted to each calendar home (in bytes) for storing attachments, or C{None} if quota should not be enforced. @type quota: C{int} or C{NoneType} @ivar queuer: An object with an C{enqueueWork} method, from L{twext.enterprise.jobs.queue}. Initially, this is a L{LocalQueuer}, so it is always usable, but in a properly configured environment it will be upgraded to a more capable object that can distribute work throughout a cluster. t unlabeledi i i t Defaulti c C sM | s | s t � | | _ | d k r- | n i | _ | d k rN t | � n d | _ | | _ | | _ | | _ | | _ | | _ | | _ | | _ | | _ | | _ | | _ | | _ | | _ | | _ t | j � | _ t | _ t | _ t � | _ | r t d | d | � | _ n d | _ t | � | _ t d � t d � d S( Nt cachePoolt cacheExpireSecondss txdav.caldav.datastore.sqls txdav.carddav.datastore.sql(! t AssertionErrort sqlTxnFactoryt Nonet _notifierFactoriesRQ t _directoryServicet attachmentsPatht attachmentsURIPatternt enableCalendarst enableAddressBookst enableManagedAttachmentst labelt quotat logLabelst logStatst logStatsLogFilet logSQLt logTransactionWaitst timeoutTransactionsR t newTransactiont queuert Falset _migratingt Truet _enableNotificationst sett _newTransactionCallbacksR& t queryCacherR, t conduitt __import__( t selfRa t notifierFactoriest directoryServiceRe Rf Rg Rh Ri Rj Rk Rl Rm Rn Ro Rp Rq t cacheQueriesR^ R_ ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt __init__� s: ! c C s t t f S( s9 The list of store home types supported. ( RF RE ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt availablePrimaryStoreTypes� s c C s | j S( N( Rd ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR � s c C s | | _ d S( N( Rd ( R} R ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt setDirectoryService� s c C s | j j | � d S( s� Registers a method to be called whenever a new transaction is created. @param callback: callable taking a single argument, a transaction N( Ry t add( R} t callback( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt callWithNewTransactions� s c c s� | j d d � V} y{ t | j g d | �j | � V} xR | D]J \ } | | | � V} | rq | j � rq q? n | | | | | � V� Vq? WWn3 t j � \ } } } | j � V| | | � n X| j � Vd S( s� Implementation of L{ICalendarStore.withEachCalendarHomeDo} and L{IAddressbookStore.withEachAddressbookHomeDo}. Rj s CommonDataStore._withEachHomeDot FromN( Rr R t OWNER_UIDt ont externalt syst exc_infot abortt commit( R} t homeTablet homeFromTxnt actiont batchSizet processExternalt txnt allUIDst uidt homet at bt c( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt _withEachHomeDo� s " c C s | j t j d � | | | � S( sM Implementation of L{ICalendarStore.withEachCalendarHomeDo}. c S s | j | � S( N( t calendarHomeWithUID( R� R� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt <lambda>� t ( R� R: t CALENDAR_HOME( R} R� R� R� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt withEachCalendarHomeDo� s c C s | j t j d � | | | � S( sS Implementation of L{IAddressbookStore.withEachAddressbookHomeDo}. c S s | j | � S( N( t addressbookHomeWithUID( R� R� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� R� ( R� R: t ADDRESSBOOK_HOME( R} R� R� R� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt withEachAddressbookHomeDo� s c C s� t | | j d | � | j | j | j r3 | j n i | | j | | � } | j s] | j rv t | | j | j � n x | j D] } | | � q� W| S( s4 @see: L{IDataStore.newTransaction} Rj ( R Ra Rg Rh Rw Rc Ru Rp Rq t CommonStoreTransactionMonitorRy ( R} Rj t disableCachet authz_uidR� R� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyRr s c c sy | d k r | j } n | d | � } y | | � V} Wn% t � } | j � Vt | � n X| j � Vt | � d S( sU Perform the given operation in a transaction, committing or aborting as required. @param label: the label to pass to the transaction creator @param operation: a 1-arg callable that takes an L{IAsyncTransaction} and returns a value. @param transactionCreator: a 1-arg callable that takes a "label" arg and returns a transaction @return: a L{Deferred} that fires with C{operation}'s result or fails with its error, unless there is an error creating, aborting or committing the transaction. Rj N( Rb Rr R R� R R� ( R} Rj t operationt transactionCreatorR� t resultt f( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt inTransaction s c C s | | _ | | _ d S( s+ Set the "migrating" state N( Ru Rw ( R} t state( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt setMigrating> s c C s | | _ d S( s+ Set the "upgrading" state N( Rw ( R} R� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt setUpgradingE s c c sH t | d � s7 | j d d t �V} | d k | _ n t | j � d S( s� Determine whether dropbox attachments are allowed. Once we have migrated to managed attachments, we should never allow dropbox-style attachments to be created. t _dropbox_oks MANAGED-ATTACHMENTSt raiseIfMissingN( t hasattrt calendarserverValueRt Rb R� R ( R} R� t already_migrated( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt dropboxAllowedK s c C s | j d k S( s� Indicate whether SQL statement query caching is enabled. Also controls whether propstore caching is done. @return: C{True} if enabled, else C{False} @rtype: C{bool} N( Rz Rb ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt queryCachingEnabledV s c c s| xu | j � D]W } | j | | � V} | d k r | j � rQ t t d f � qd t t d f � q q Wt t d f � d S( s� Indicate whether the specified user UID is hosted in the current store, or possibly in another pod. @param txn: transaction to use @type txn: L{CommonStoreTransaction} @param uid: the user UID to test @type uid: L{str} @return: a tuple of L{bool}, L{str} - the first indicates whether the user is hosted, the second the serviceNodeUID of the pod hosting the user or C{None} if on this pod. @rtype: L{tuple} t unknownN( R� t homeWithUIDRb R� R Rv Rt ( R} R� R� t storeTypeR� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt uidInStore_ s c c s� | j d d � V} yg t | d | � V} | j | � } | | j _ | rl t j d j d j | � � � n t j d � Wn4 t k r� } t j d j | � � | j � Vn X| j � Vd S( s� Check the schema actually in the database against the one in the supplied schema file. @param expected_schema: the expected schema @type expected_schema: L{Schema} Rj s CommonDataStore.checkSchemat actuals Schema comparison mismatch: {}s s Schema comparison matchs" Schema comparison match failed: {}N( Rr R2 t comparet __class__t checkSchemaResultst logt warnt formatt joint Exceptiont errorR� R� ( R} t expected_schemat schema_nameR� t actual_schemat resultst e( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt checkSchema| s "i N( t __name__t __module__t __doc__RW R) Rv Rt Rb R� R� R R� R� R R� R� R� Rr R� R� R� R� R� R� R� ( ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR g sB ! ( ! t TransactionStatsCollectorc B s5 e Z d Z d d � Z d � Z d � Z d � Z RS( s� Used to log each SQL query and statistics about that query during the course of a single transaction. Results can be printed out where ever needed at the end of the transaction. c C s. | | _ | | _ g | _ t j � | _ d S( N( Rj t logFileNamet statementst timet startTime( R} Rj R� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� � s c C s� g | D] } d | f ^ q } g | D], } t | � d k rM | d d n | ^ q' } | j j d | | f d d d g � t | j � d t j � f S( sN Called prior to an SQL query being run. @param sql: the SQL statement to execute @type sql: C{str} @param args: the arguments (binds) to the SQL statement @type args: C{list} @return: C{tuple} containing the index in the statement list for this statement, and the start time s %si( i s ...s %s %si i ( t lenR� t appendR� ( R} t sqlt argst arg( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt startStatement� s 9&c C se | \ } } t j � } | r* t | � n d | j | d <| | | j | d <| | j | d <d S( s� Called after an SQL query has executed. @param context: the tuple returned from startStatement @type context: C{tuple} @param rows: number of rows returned from the query @type rows: C{int} i i i i N( R� R� R� ( R} t contextt rowst indext tstampt t( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt endStatement� s #c C sS t | j � } t g | j D] } | d ^ q � } t g | j D] } | d ^ qB � d } t � } | j d � | j d � | j d | j f � | j d t t g | j D] } | d ^ q� � � f � | j d | f � | j d | f � | j d | f � | j } x� | j D]� \ } } } } | j d � | j d | f � | j d | f � | j d | d f � | j d | | | d f � | j d | | j d f � | } q"W| j d t j � | d f � | j d � | j r3t | j d � � } | j | j � � Wd QXn t j | j � � | | | f S( sL Print a report of all the SQL statements executed to date. i i g @�@s *** SQL Stats *** s s Label: %s s Unique statements: %d i s Total statements: %d s Total rows: %d s Total time (ms): %.3f s SQL: %s s Rows: %s s Time (ms): %.3f s Idle (ms): %.3f s Elapsed (ms): %.3f s Commit (ms): %.3f s *** R� N( R� R� t sumR t writeRj Rx R� R� R� t opent getvalueR� R� ( R} t total_statementst statementt total_rowst total_timet toFilet t_last_endR� R� t t_takent t_endR� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt printReport� s6 &* : " N( R� R� R� Rb R� R� R� R� ( ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� � s R� c B s; e Z d Z e j Z d � Z d � Z d � Z d � Z RS( sn Object that monitors the state of a transaction over time and logs or times out the transaction. c C sk | | _ d | _ d | _ | | _ | | _ | j j | j � | j j | j � | j � | j � d S( N( R� Rb t delayedLogt delayedTimeoutt logTimerSecondst timeoutSecondst postCommitt _cleanTxnt postAbortt _installLogTimert _installTimeout( R} R� R� R� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� � s c C sW d | _ | j r+ | j j � d | _ n | j rM | j j � d | _ n t d � S( N( Rb R� R� t cancelR� R ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� � s c s: � � f d � � � j r6 � j � j � � � _ n d S( Nc sA � j d k r= t j d d � �� j � j � � � _ n d S( Ns� Transaction wait: {me.txn}, Statements: {me.txn.statementCount:d}, IUDs: {me.txn.iudCount:d}, Statement: {me.txn.currentStatement}t me( R� Rb R� R� t callLaterR� R� ( ( t _logTransactionWaitR} ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� s ( R� R� R� ( R} ( ( R� R} s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� s c s7 � f d � } � j r3 � j � j | � � _ n d S( Nc sa � j d k r] t j d d � �d � _ � j rM � j j � d � _ n � j j � n d S( Ns� Transaction abort too long: {me.txn}, Statements: {me.txn.statementCount:d}, IUDs: {me.txn.iudCount:d}, Statement: {me.txn.currentStatement}R� ( R� Rb R� R� R� R� R� t timeout( ( R} ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt _forceAbort s ( R� R� R� ( R} R� ( ( R} s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� s ( R� R� R� R R� R� R� R� R� ( ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� � s c B s� e Z d Z i Z d Z e e d6 d � Z d � Z d � Z d � Z d � Z e d � � Z e e d � � Z e d � � Z e d � � Z d � Z e d � � Z e d6 e d6 d � � Z d6 e d6 d � Z d6 e d6 d � Z e d � � Z d � Z d � Z d � Z d � Z e d6 e d � � Z e d � � Z d � Z d � Z d � Z! d � Z" d � Z# d � Z$ d � Z% d � Z& d Z' d � Z( e d e d! � � Z) e d" � � Z* e d# � � Z+ d$ � Z, d% � Z- d& � Z. d' � Z/ d( � Z0 e d6 d) � � Z1 e d6 d* � � Z2 d6 d6 d+ � Z3 e d6 d6 d, � � Z4 d- � Z5 e d6 d. � � Z6 d/ � Z7 e d6 d0 � � Z8 d1 � Z9 d2 � Z: e d3 � � Z; e d4 � � Z< e d5 � � Z= RS(7 s6 Transaction implementation for SQL database. i c C sH | d k s | rO t j t j � j j � } d j | j | j | j � } n | | _ | j j | _ i i t t � d 6t t � d 6t 6i t t � d 6t t � d 6t 6| _ i t t � d 6t t � d 6| _ | | _ t � | _ t � | _ | | _ | | _ t | _ d | _ | p*| j � | _ | rBd | _ n | j | _ | | _ t j! d 7_! t j! | _" g } | r�| j# t$ � t | _ n | r�| j# t% � | j d k r�t | _ q�n t& | | � | | _' | j( | _( | j j) rt* | j | j j+ � n d | _, d | _- d | _. d | _/ t | _0 i | _1 d S( NR\ s {}#{}${}t byUIDt byIDi i (2 t inspectt getframeinfot currentframet f_backR� t filenamet linenot functiont _storeRs t _queuerRY t dictRF RE t _cachedHomest _notificationHomesRc Rx t _notifiedAlreadyt _bumpedRevisionAlreadyt _labelRu Rt t _allowDisabledRb t _primaryHomeTypeR� t _disableCachet _queryCacherRz t _authz_uidR t idt _txidR� R( R* RX t _sqlTxnt dbtypeRm R� Rn t _statst statementCountt iudCountt currentStatementt timedoutt logItems( R} t storet sqlTxnRg Rh R~ Rj t migratingR� R� t trt extraInterfaces( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� 9 s\ ! - c K s | j j j | | | � S( s� Enqueue a L{twext.enterprise.jobs.workitem.WorkItem} for later execution. For example:: yield (txn.enqueue(MyWorkItem, workDescription="some work to do")) ( R Rs t enqueueWork( R} t workItemt kw( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt enqueue| s c C s | j S( N( R ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR � s c C s | j j � S( N( R R ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR � s c C s d | j f S( Ns PG-TXN<%s>( R ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt __repr__� s c C s4 t j } t | j g d | d | j t d � k �S( NR� t Wheret name( R: t CALENDARSERVERR t VALUEt NAMER ( t clst cs( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt _calendarserver� s c c sp | j j | d | �V} | rF t | � d k rF t | d d � n | rb t d | f � � n t d � d S( NR% i i s% Database key %s cannot be determined.( R+ R� R� R t RuntimeErrorRb ( R} t keyR� R� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� � s c c s5 t j } t i | | j 6| | j 6� j | � Vd S( N( R: R& R R( R' R� ( R} R- t valueR* ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt setCalendarserverValue� s c c s: t j } t i | | j 6d | j | k �j | � Vd S( NR$ ( R: R& R R' R( R� ( R} R- R. R* ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt updateCalendarserverValue� s c C s | j | | | S( sG Determine the memo dictionary to use for homeWithUID. ( R ( R} R� t lookupModet status( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt _determineMemo� s c c s� | j | j | � V} x% | D] } | j | | d t �Vq Wt g t | j | d t � j � d d � �D] } | d ^ qm � d S( s9 Load all calendar or addressbook homes. t createR� R- c S s | d S( Ni ( ( t x( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� � R� i N( t _homeClasst listHomesR� Rt R t sortedR3 R8 t items( R} R� t uidsR� t kv( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt homes� s c c s | t t f k r! t d � � n | d k rx xf t t t f D]4 } | j | d | � j | � } | d k r= Pq= q= Wn | j | d | � j | � } | d k r| j | j | | | | | � V} | r| | j | d | j � � | <| | j | d d � | j � <qn t | � d S( s$ We need to distinguish between various different users "looking" at a home and its child resources because we have per-user properties that depend on which user is "looking". By default the viewer is set to the authz_uid on the transaction, or the owner if no authz, but it can be overridden using L{authzUID}. This is useful when the store needs to get to other user's homes with the viewer being the owner of that home as opposed to authz_uid. That often happens when manipulating shares. s Unknown home type.R� R� N( RF RE R, Rb R8 R< R7 R3 t getR6 R� R2 R R ( R} R� R� R2 R4 t authzUIDt possible_statusR� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� � s # %c C s" | j t | d | d | d | �S( NR2 R4 R> ( R� RF ( R} R� R2 R4 R> ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� � s c C s" | j t | d | d | d | �S( NR2 R4 R> ( R� RE ( R} R� R2 R4 R> ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� � s c c s� | t t f k r! t d � � n | j | d d � j | � } | d k r� | j | j | | � V} | r� | | j | d d � | <| | j | d | j � � | j � <q� n t | � d S( sQ Load a calendar or addressbook home by its integer resource ID. s Unknown home type.R� R� N( RF RE R, R3 Rb R= R6 t homeWithResourceIDR2 R� R ( R} R� t ridR� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR@ � s +c C s | j t | � S( N( R@ RF ( R} RA ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt calendarHomeWithResourceID� s c C s | j t | � S( N( R@ RE ( R} RA ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt addressbookHomeWithResourceID� s c C sr i i t t � d 6t t � d 6t 6i t t � d 6t t � d 6t 6| _ i t t � d 6t t � d 6| _ d S( s� Initialize the home caches, wiping any that existed before. This is only used in testing when we want to be sure all cached objects have been removed. R� R� N( RY R RF RE R R ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt resetHomeCache� s c C s~ | j | j d d � } | j � | k r: | | j � =n | j | j d | j � � } | j � | k rz | | j � =n d S( s� Remove the specified home from the home cache. @param home: home to remove @type home: L{CommonHome} R� R� N( R3 t _homeTypeRb R R2 R� ( R} R� t rid_memot uid_memo( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt cleanHomeCache s c c s� | j d | j | � } | d k r� t j | | d | d | �V} | r� | | j d | | <| | j d d | j � <q� n t | � d S( s1 Implement notificationsWithUID. R� R2 R4 R� N( R R= Rb R4 t notificationsWithUIDR R ( R} R� R2 R4 R� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyRI s !c c s� | j d d j | � } | d k r{ t j | | � V} | r{ | | j d d | <| | j d | j � | j � <q{ n t | � d S( s8 Implement notificationsWithResourceID. R� R� N( R Rb R= R4 t notificationsWithResourceIDR2 R� R ( R} RA R� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyRJ . s 'c C s t j | t j d | �S( s This pod is being told that user data migration to another pod has been completed, and the old data now needs to be removed. @param ownerUID: directory UID of the user whose data has been migrated @type ownerUID: L{str} t ownerUID( R- t reschedulet notBeforeDelay( R} RK ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt migratedHome< s c C s | j j | � S( s� Run things before C{commit}. (Note: only provided by SQL implementation, used only for cleaning up database state.) ( R t preCommit( R} R� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyRO L s c C s | j j | � S( s- Run things after C{commit}. ( R R� ( R} R� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� S s c C s | j j | � S( s, Run things after C{abort}. ( R R� ( R} R� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� Y s c C s | j � | j k S( N( R R ( R} t obj( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt isNotifiedAlready_ s c C s | j j | j � � d S( N( R R� R ( R} RP ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt notificationAddedForObjectb s c C s | j � | j k S( s� Indicates whether or not bumpRevisionForObject has already been called for the given object, in order to facilitate changing the revision only once per object. ( R R ( R} RP ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt isRevisionBumpedAlreadye s c C s | j j | j � � d S( sX Records the fact that a revision token for the object has been bumped. N( R R� R ( R} RP ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt bumpRevisionForObjectm s c C s# | j d 7_ t d | j f � S( sZ Generate a new SavepointAction whose name is unique in this transaction. i s sp%d( t _savepointCounterR ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt _savepointu s i c # s& | j j � � | j � } g � � � f d � } | } y� x� t r| j � � Vy | � � V} Wny t � } | s� � j | � n | j � � V| r� | d 8} | j j � } � j � | � | j � } q| � q? X| j � � V� j � t | � q? WWn t k r!| � n Xd S( s Create a limited transaction object, which provides only SQL execution, and run a function in a sub-transaction (savepoint) context, with that object to execute SQL on. @param thunk: a 1-argument callable which returns a Deferred when it is done. If this Deferred fails, the sub-transaction will be rolled back. @type thunk: L{callable} @param retries: the number of times to re-try C{thunk} before deciding that it's legitimately failed. @type retries: L{int} @param failureOK: it is OK if this subtransaction fails so do not log. @type failureOK: L{bool} @return: a L{Deferred} which fires or fails according to the logic in C{thunk}. If it succeeds, it will return the value that C{thunk} returned. If C{thunk} fails or raises an exception more than C{retries} times, then the L{Deferred} resulting from C{subtransaction} will fail with L{AllRetriesFailed}. c s; � j � x! � D] } t j d d | �q Wt � � d S( Ns in subTransaction()t failure( t endR� R� RM ( R� ( t blockt failuresToMaybeLog( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyRX � s i N( R t commandBlockRV Rv t acquireR R� t rollbackRX t releaseR R ( R} t thunkt retriest failureOKt spRX t triesLeftR� R� t newBlock( ( RY RZ s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt subtransaction| s6 c o sa | j rA | j j | d t | � d k r5 | d n d � } n | d | _ | j j r� | d j d d � d j � d k r� | j d 7_ n | j d 7_ | j j r� d | j j d d � f | d f | d } n | j j rt j d d | d | �n d } z | j j | | � V} Wd d | _ | j rR| j j | | � n Xt | � d S( sF Execute some SQL (delegate to L{IAsyncTransaction}). i i t t insertt updatet deletes -- Label: %s t %s %%s SQL: {a!r} {kw!r}R� R! N( ( Rg Rh Ri ( R R� R� R R Rp t splitt lowerR R Rl R t replaceRo R� R� Rb R t execSQLR� R ( R} R� R! t statsContextR� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyRn � s" 8 2 2 c c sp xi t | � D][ } | j d � s y | j | � VWqh t t f k rd } d j | � | _ � qh Xq q Wd S( s� Execute SQL statements parsed by splitSQLString. FIXME: temporary measure for handling large schema upgrades. This should NOT be used for regular SQL operations - only upgrades. s --s SQLBlock statement failed: {}N( R t startswithRn R, t StandardErrorR� t stmt( R} R� Rr R� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt execSQLBlock� s c C s) | j r | j | j � n | j j � S( sK Commit the transaction and execute any post-commit hooks. ( R R� t statsReportR R� ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� � s c C s | j j � S( s( Abort the transaction. ( R R� ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� s c C s t | _ | j � S( s8 Abort the transaction due to time out. ( Rv R R� ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� s c C sV | j j � \ } } } t | � | j d <t | � | j d <d | f | j d <d S( s= Print the stats report and record log items s sql-ss sql-rs %.1fs sql-tN( R R� t strR ( R} t sql_statementst sql_rowst sql_time( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyRt s c C s t j } t j } t j } t j } i } | r= | | d <n t | j | j | j t | j � g d | j | � j | � j | � d | j | j k j | j | j k � j | j | j k � j | j t k � d | j | j | j f d t | j � t d � k d t | j � | �S( Nt LimitR� R$ t GroupByt Havingt CutOfft OrderBy( R: R� t CALENDAR_OBJECTt CALENDAR_BINDt TIME_RANGER R� t CALENDAR_RESOURCE_NAMEt RESOURCE_NAMER t END_DATER� t RESOURCE_IDt CALENDAR_HOME_RESOURCE_IDt Andt CALENDAR_OBJECT_RESOURCE_IDt CALENDAR_RESOURCE_IDt BIND_MODER5 R ( R} t limitt cht cot cbR t kwds( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt _oldEventsBase s. ! c c s� t j rQ t j � } | j t j � | | k rQ t d | j � f � � qQ n i t | � d 6} | j | � j | | � V} t g | D]. } | d | d | d t | d � g ^ q� � d S( s� Return up to the oldest batchSize events which exist completely earlier than "cutoff" (DateTime) Returns a deferred to a list of (uid, calendarName, eventName, maxDate) tuples. s! Cannot query events older than %sR| i i i i N( R# t FreeBusyIndexLowerLimitDaysR t getTodayt offsetDayt ValueErrort getTextR% R� R� R R ( R} t cutoffR� t truncateLowerLimitR� R� t row( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt eventsOlderThan6 s c c s� t j rQ t j � } | j t j � | | k rQ t d | j � f � � qQ n | j | d | �V} d } xe | D]] \ } } } } | j | � V} | j | � V} | j | � V} | j d t � V| d 7} qt Wt | � d S( sm Remove up to batchSize events older than "cutoff" and return how many were removed. s! Cannot query events older than %sR� i t implicitlyi N( R# R� R R� R� R� R� R� R� t childWithNamet objectResourceWithNamet purgeRt R ( R} R� R� R� R� t countR� t calendarNamet eventNamet _ignore_maxDateR� t calendart resource( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt removeOldEventsK s c C sD i } | r | | d <n i } | r2 | | d <n t j } t j } t j } t j } | j d k j | j d k � } | r� | j | j t d � k � } n t | j | j t | j � t | j � g d | j | | j | j k d � j | | j | j k � j | | j | j k � d | d | j | j f | �j | | � S( s� Find attachments no longer referenced by any events. Returns a deferred to a list of (calendar_home_owner_uid, quota used, total orphan size, total orphan count) tuples. t uuidRy t .R� s left outerR$ Rz N( R: R� t CALENDAR_HOME_METADATAR~ t ATTACHMENTt DROPBOX_IDRb R� R� R R t QUOTA_USED_BYTESR t SIZER R� R� R� R� ( R} R� R� R� t optionsR� t chmR� t att where( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt orphanedAttachmentsc s. !!* c c sn d d l m } i } | r) | | d <n i } | rB | | d <n t j } t j } t j } | j | | j | j k d � } | j d k j | j d k � } | r� | j | | j | j k � } | j | j t d � k � } n t | j | j g d | d | | �j | | � V} d } x? | D]7 \ } } | j | | | � V} | j � V| d 7} q%Wt | � d S( sO Remove attachments that no longer have any references to them i����( t DropBoxAttachmentR� Ry s left outerR� R� R$ i i N( t txdav.caldav.datastore.sqlR� R: R� R~ R� R� R� Rb R� R� R� R� R R t PATHR� t loadt removeR ( R} R� R� R� R� R� R� R� R� t sfromR� R� R� t dropboxIDt patht attachment( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt removeOrphanedAttachments� s6 !! ! c C s� i t | � d 6} | r& | | d <n t j } t j } t j } t j } t j } | j j t | j g d | j | | j | j k d � j | | j | j k � d | j f d t | j � t d � k �� } | r� | j | j t d � k � } n t | j | j t | j � t | j � g d | j | | j | j k � j | | j | j k � d | d | j | j f �j | | � S( s� Find managed attachments attached to only events whose last instance is older than the specified cut-off. Returns a deferred to a list of (calendar_home_owner_uid, quota used, total old size, total old count) tuples. R| R� R� t innerRz R{ R$ ( R% R: R� R� R~ R� R� R� t InR R� R� R� R R� R R� R� R� R R� R R� R� ( R} R� R� R� R� R� R� R R� R� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt oldDropboxAttachments� s0 ! !!*c c s� d d l m } i t | � d 6} | r6 | | d <n i } | rO | | d <n t j } t j } t j } t j } | j | | j | j k d � j | | j | j k � } d } | r� | j | | j | j k � } | j t d � k } n t | j | j g d | d | d | j | j f d t | j � t d � k | �j | | � V} d } x? | D]7 \ } } | j | | | � V} | j � V| d 7} q\Wt | � d S( sL Remove dropbox attachments attached to events in the past. i����( R� R| R� Ry R� R� R$ Rz R{ i i N( R� R� R% R: R� R~ R� R� R� R� R� R� Rb R� R� R R R� R R� R� R� R� R ( R} R� R� R� R� R� R� R� R� R R� R� R� R� R� R� R� R� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt removeOldDropboxAttachments� s@ c C s� i t | � d 6} | r& | | d <n t j } t j } t j } t j } t j } | j j t | j g d | j | | j | j k d � j | | j | j k � d | j f d t | j � t d � k �� } | r� | j | j t d � k � } n t | j | j t | j � t | j � g d | j | | j | j k � j | | j | j k � d | d | j | j f �j | | � S( s� Find managed attachments attached to only events whose last instance is older than the specified cut-off. Returns a deferred to a list of (calendar_home_owner_uid, quota used, total old size, total old count) tuples. R| R� R� R� Rz R{ R$ ( R% R: R� R� R� R� t ATTACHMENT_CALENDAR_OBJECTt ATTACHMENT_IDR� R R� R� R R� R R� R� R� R R� R R� R� R� ( R} R� R� R� R� R� R R� t atcoR� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt oldManagedAttachments s2 !!*c c s� d d l m } i t | � d 6} | r6 | | d <n i } | rO | | d <n t j } t j } t j } t j } | j | | j | j k d � j | | j | j k � } d } | r� | j | | j | j k � } | j t d � k } n t | j | j g d | d | d | j | j f d t | j � t d � k | �j | | � V} d } x? | D]7 \ } } | j | d | � V} | j � V| d 7} q\Wt | � d S( sD Remove attachments attached to events in the past. i����( t ManagedAttachmentR| R� Ry R� R� R$ Rz R{ i i N( R� R� R% R: R� R� R� R� R� R� R� Rb R� R� R� R R t MANAGED_IDR R� R� R� R� R ( R} R� R� R� R� R� R� R� R R� R� R� R� R� R� t _ignoret managedIDR� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt removeOldManagedAttachments+ s@ c C s t � j | � S( N( R R� ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt acquireUpgradeLockZ s c C s t � j | � S( N( R R� ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt releaseUpgradeLock] s c c s� xF t j t j t j f D], } t d | d | j | k � j | � Vq Wt j } t | j | j | j | j g d | �j | � V} i } x | D]w } | \ } } } } | | g } | | k r� i | | <n | | } | | k r� g | | <n | | } | j | � q� Wx�| j � D]t\ } } xe| j � D]W\ } } g } g } x; | D]3 } | d | k ry| j | � qS| j | � qSW| r�t | � t | � k r�t | d d � �} | j | � | j | � n | rt | d d � �d r| | 7} n | r4g | D] } | d ^ q} t | d | j | k j | j | k � j | j j t d t | � � � � �j | d | �Vq4q4WqWd S( s5 Delete revisions before minRevision R� R$ i R- c S s | d S( Ni ( ( t info( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� � R� c S s | d S( Ni ( ( R� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� � R� i t revisionsToRemoveN( R: t CALENDAR_OBJECT_REVISIONSt NOTIFICATION_OBJECT_REVISIONSt ADDRESSBOOK_OBJECT_REVISIONSR t REVISIONR� t ABO_MEMBERSR t GROUP_IDt MEMBER_IDt REMOVEDR� t iteritemsR� t maxR� R� R� R ( R} t minRevisiont tablet aboMemberst groupRowst groupIDToMemberIDMapt groupRowt groupIDt memberIDt removedt revisiont revisionInfot memberIDToRevisionsMapt revisionInfoListt revisionInfosToRemovet revisionInfosToSavet maxRevisionInfoToRemovet revisionInfoToRemoveR� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt deleteRevisionsBefore` sb 'c C s� t j } t j } t | j g d | j | � d | j t d � k j | j | j k � j | j t k � j | j d k � j | j t d � k � �S( sN DAL query to select inbox items created before a given date. R� R$ t homeIDt inboxR� ( R: R~ R R R� R� R� R R� R� R� R5 R� t CREATED( R) R� R� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt+ _inboxItemsInHomeIDCreatedBeforeCutoffQuery� s c c sJ | j j | d | d | �V} g | D] } | d ^ q& } t | � d S( s� return a list of inbox item names that created before a given date in a given home. Returns a deferred to a list of orphaned inbox item names R� R� i N( R� R� R ( R} R� R� R� R� t names( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt! listInboxItemsInHomeCreatedBefore� s N(> R� R� R� R6 R Rt Rb R� R" R R R# R R+ R Rv R� R/ R0 R3 R< R� R� R� R@ RB RC RD RH RI RJ RN RO R� R� RQ RR RS RT RU RV Re Rn Rs R� R� R� Rt R� R� R� R� R� R� R� R� R� R� R� R� R� R� ( ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR . s� ? R #( &. '. Fc B su e Z e � Z da Z da Z da Z da Z da Z da Z da Z da Z da Z da Z da Z da Z e da d � � Z da d � Z e d � � Z d � Z e d � � Z e d � � Z e d � � Z e d � � Z e d � � Z e d � � Z e d � � Z e d � � Z e d � � Z d � Z! d � Z" e e d � � � Z# e da e$ da d � � Z% e d � � Z& e e da e$ da d � � � Z' d � Z( d � Z) d � Z* d � Z+ d � Z, d � Z- d � Z. d � Z/ d � Z0 d � Z1 d � Z2 d � Z3 d � Z4 e d � � Z5 e d! � � Z6 e d" � � Z7 e d# � � Z8 e d$ � � Z9 d% � Z: d& � Z; d' � Z< e d( � � Z= e d) � � Z> e d* � � Z? d+ � Z@ e e$ d, � � ZA d- � ZB e d. � � ZC e e$ d/ � � ZD e e$ d0 � � ZE e$ d1 � ZF e e$ d2 � � ZG e$ d3 � ZH e$ d4 � ZI e da d5 � � ZJ e eK d6 � � ZL e e$ d7 � � ZM e d8 � � ZN d9 � ZO e d: � � ZP e d; � � ZQ e d< � � ZR e d= � � ZS d> � ZT e d? � � ZU e d@ � � ZV e dA � � ZW dB � ZX dC � ZY dD � ZZ dE � Z[ dF � Z\ dG � Z] e dH � � Z^ e dI � � Z_ e dJ � � Z` e g eK dK � � Za e dL � � Zb e dM � � Zc e dN � � Zd e dO � � Ze e dP � � Zf e dQ � � Zg e dR � � Zh e dS � � Zi dT � Zj dU � Zk dV � Zl e em jn dW � � Zo e dX � � Zp e dY � � Zq e dZ � � Zr e d[ � � Zs e d\ � � Zt e d] e$ d^ � � Zu e d_ � � Zv e d` � � Zw RS(b c C s_ | | j � j | j j � } | t k r@ | j | | � } n | | | d | �} | j � S( sJ Build the actual home class taking into account the possibility that we might need to switch in the external version of the class. @param transaction: transaction @type transaction: L{CommonStoreTransaction} @param homeData: home table column data @type homeData: C{list} R> ( t homeColumnsR� t _homeSchemat STATUSR7 t _externalClasst initFromStore( R) t transactiont homeDataR> R2 R� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt makeClass� s c C s� | | _ x3 t | j � | � D] \ } } t | | | � q W| | _ | j d k r� | j j d k r{ | j j | _ q� | j | _ n d | _ t | _ t t � | _ d | _ d | _ d | _ d | _ d | _ t | _ d S( N( t _txnt zipt homeAttributest setattrt _authzUIDRb R t _ownerUIDt _dataVersionRt t _childrenLoadedRY R t _childrent _notifierst _quotaUsedBytest _createdt _modifiedt _syncTokenRevisionRv t _internalRequest( R} R� R� R> t attrR. ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� � s" " c C s | | _ | t j | j <d S( s� Register a L{CommonHome} subclass as its respective home type constant with L{CommonStoreTransaction}. N( RE R R6 ( R) t homeType( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt _register s c C s | j j � j S( N( R� R Rk ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt quotaAllowedBytes s c C sL | j } t | j � d | d | j t d � k j | j t d � k � �S( NR� R$ RK R2 ( R� R R� R� R R� R� ( R) R� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt _homeColumnsFromOwnerQuery s c C s: | j } t | j | j g d | d | j t d � k �S( NR� R$ t resourceID( R� R R� R� R� R ( R) R� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt _ownerFromResourceID# s c C s4 | j } t | j � d | d | j t d � k �S( NR� R$ R ( t _homeMetaDataSchemaR t metadataColumnsR� R ( R) t metadata( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt _metaDataQuery* s c C s | j j | j j | j j f S( s` Return a list of column names to retrieve when doing an ownerUID->home lookup. ( R� R� R� R� ( R) ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� 1 s c C s d S( sM Return a list of attributes names to map L{homeColumns} to. t _resourceIDR� t _status( R R� R ( ( R) ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� ? s c C s | j j | j j f S( s� Return a list of column name for retrieval of metadata. This allows different child classes to have their own type specific data, but still make use of the common base logic. ( R R� t MODIFIED( R) ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR M s c C s d S( s� Return a list of attribute names for retrieval of metadata. This allows different child classes to have their own type specific data, but still make use of the common base logic. R R ( R R ( ( R) ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt metadataAttributes\ s c c s` | j � V| j � Vx9 | j j j � D]% \ } } | j | | j | � � q) Wt | � d S( s� Initialize this object from the store. We read in and cache all the extra meta-data from the DB to avoid having to do DB queries for those individually later. N( t initMetaDataFromStoret _loadPropertyStoreR� Rc R9 t addNotifiert newNotifierR ( R} t factory_typet factory( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� k s c c s� | j j } | r7 | j | j � } | j | � V} n d } | d k r� | j j | j d | j �Vd } | r� | j | j | | � Vq� n x3 t | j � | � D] \ } } t | | | � q� Wt | j � | _ t | j � | _ d S( s9 Load up the metadata and property store R i N( R� R t keyForHomeMetaDataR R= Rb R R� t setAfterCommitR� R R� R R R ( R} Rz t cacheKeyt dataR R. ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR { s # "c C sm t g | j � D]" } | d t | | d � f ^ q � } | d j d � | d <| d j d � | d <| S( s- Create a dictionary mapping metadata attributes so this object can be sent over a cross-pod call and reconstituted at the other end. Note that the other end may have a different schema so the attributes may not match exactly and will need to be processed accordingly. i t createdRf t modifiedN( R R t getattrRb t isoformat( R} R R ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt serialize� s ;c C s\ x1 | j � D]# } t | | | j | d � � q Wt | j � | _ t | j � | _ d S( sm Given a mapping generated by L{serialize}, convert the values to attributes on this object. i N( R R� R= R R R ( R} t mappingR ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt deserialize� s !c c sS t | j j g d | j �j | � V} g | D] } | d ^ q/ } t | � d S( sj Retrieve the owner UIDs of all existing homes. @return: an iterable of C{str}s. R� i N( R R� R� R� R ( R) R� R� R� t rids( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR7 � s c C s" | j | d | | d | d | �S( NR4 R> ( t homeWithRb ( R) R� R� R2 R4 R> ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� � s c C s | j | | d � S( N( R% Rb ( R) R� RA ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR@ � s c c s | j } g } | d k rX | j j | k } | rV| j | j | j | | � � qVn� | d k rJ| j j | k } | d k r� | j | j j | k � } | rG| j | j | j | | � � qGqVt t t f } | j r� | t f 7} n | j | j j j | � � } | rVx0 | D]% } | j | j | j | | � � qWqVn t d � � x4 | D]& } | j | � V} | d k r]Pq]q]Wd } | d k r�t | j � d | j d | �j | � V} t | � d k rbt g | D]+ } | | j � j | j j � | f ^ q�� } | j t � } | d k rA| j t � } n | d k r{| j t � } q{n | ru| d } n d } | r�| r�| d k r�| d } n@ | d k r�| j | j | | | j � j | j j � � } n | j | | � Vq�n | r#| j | | d | �V} t | � n�| s6| d k rCt d � n | j � j | j d � � V} | d k r�t d j | � � � n | d k r�| j! � r�t n t } | j" � d k rI| j" � j# rIt$ d j | � � � qInc | t% k r| j! � r t$ d � � n | } n3 | t t f k r1| } n t$ d j | | � � � t& d � } | j' | � V| j( d k r�| j) | j* � V| _( n yy t+ i | | j j 6| | j j 6| j( | j j, 6d | j j �j | � Vd d } t+ i | | j- j 6� j | � VWn} t. k r�| j/ | � Vt | j � d | j d | �j | � V} | r}| j | | d d | �V} t | � q � n� X| j0 | � Vt | j � d | j d | j j | k �j | � V} | j | | d d | �V} | j1 � r | j2 � Vn t | � d S( s� Lookup or create a home based in either its resource id or uid. If a status is given, return only the one matching that status. If status is L{None} we lookup any regular status type (normal, external or purging). When creating with status L{None} we create one with a status matching the current directory record thisServer() value. The only other status that can be directly created is migrating. s One of rid or uid must be setR� R$ i i R> s utf-8s? Cannot create home for UID since no directory record exists: {}s2 Cannot create external home for user on v5 pod: {}sA Cannot migrate user data for a user already hosted on this servers% Cannot create home with status {}: {}R� t ReturnN(3 R Rb R� R� R� t keyForHomeWithIDRE R� R� R� t keyForHomeWithUIDR8 R7 R9 R R< R� R` R= R R� R� R� R R� Rx R� R R t recordWithUIDt decodeRR R� t thisServert servert v5RB R; R R\ t _dataVersionValueR� t _dataVersionKeyR t DATAVERSIONR R� R] R^ t normalt createdHome( R) R� RA R� R2 R4 R> Rz t cacheKeyst queryt statusSett itemR R� R� t byStatust homeObjectt recordt createStatust savepointt resourceid( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR% � s� % % ) > 4 ! % c C s d | j j | j | j f S( Ns <%s: %s, %s>( R� R� R R� ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR# Q s c C s d j | j | j � S( Ns {}-{}( R� R R� ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR T s c C s | j S( sy Retrieve the store identifier for this home. @return: store identifier. @rtype: C{int} ( R ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR W s c C s | j S( s[ Retrieve the unique identifier for this home. @return: a string. ( R� ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� ` s c C s | j S( sy Retrieve the unique identifier of the user accessing the data in this home. @return: a string. ( R� ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt authzuidh s c C s | j S( N( R ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR2 p s c C s | j t k S( sQ Is this an normal (internal) home. @return: a L{bool}. ( R R8 ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR1 s s c C s | j t k S( sH Is this an external home. @return: a L{bool}. ( R R7 ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� { s c C s | j t k o | j S( s� Is this an external home which also needs to have any requests directed to a remote pod via the external (conduit using) implementation of this class @return: a L{bool}. ( R R7 R ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt externalClass� s c C s | j t k S( sG Is this an external home. @return: a string. ( R R9 ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt purging� s c C s | j t k S( sG Is this an external home. @return: a string. ( R R; ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR � s c C s | j t � S( s1 Mark this home as being purged. ( t setStatusR9 ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� � s c C s | j t � S( s1 Mark this home as being purged. ( R@ R; ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt migrate� s c c s� | j | k r� t i | | j j 6d | j j | j k �j | j � V| j j r� | j j j | j j j | j | j � | j � � V| j j j | j j j | j | j � | j � � Vn | | _ n d S( s1 Mark this home as being purged. R$ N( R R R� R� R� R R� R� R Ri R( RE R� R' R ( R} t newStatus( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR@ � s c c s | j � V| j j } t d | d | j | j k � j | j � V| j } t d | d | j | j k � j | j � V| j � j � V| j j r| j j j | j j j | j | j � | j � � V| j j j | j j j | j | j � | j � � Vn d S( NR� R$ ( t removeAllChildrent _childClasst _revisionsSchemaR t HOME_RESOURCE_IDR R� R� R� R� t propertiest _removeResourceR Ri R( RE R� R R' R ( R} t rt h( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� � s* c c s_ | j � V} xK | D]C } | j � V| j j | j � d � | j j | j � d � q Wd S( s$ Remove each child. N( t loadChildrenR� R� t popR% Rb R ( R} t childrent child( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyRC � s c c s | j � V| j j } t d | d | j | j k � j | j � V| j } t d | d | j | j k � j | j � V| j � j � V| j j r| j j j | j j j | j | j � | j � � V| j j j | j j j | j | j � | j � � Vn d S( s0 Do a complete purge of all data associated with this calendar home. For now this will assume a "silent" non-implicit behavior. In the future we will want to build in some of the options the current set of "purge" CLI tools have to allow for cancels of future events etc. R� R$ N( t purgeAllChildrenRD RE R RF R R� R� R� R� RG RH R Ri R( RE R� R R' R ( R} RI RJ ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt purgeAll� s* c c s� | j � V} xe | D]] } | j � V| j � r? | j � Vn | j j | j � d � | j j | j � d � q W| j � Vd S( s2 Purge each child (non-implicit). N( RK t unsharet ownedR� R� RL R% Rb R t removeUnacceptedShares( R} RM RN ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyRO s c C s | j S( N( R� ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� $ s c C s | j j � j � S( N( R� R R ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR ' s c C s" | j � j | j � j d � � S( Ns utf-8( R R) R� R* ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt directoryRecord* s c c sE | j j } | d k rA | j | j � } | j | j | � Vn d S( N( R� R Rb R R t invalidateAfterCommit( R} Rz R ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt invalidateQueryCache- s c C s4 | j } t | j g d | d | j t d � k �S( NR� R$ R ( R� R R0 R� R ( R) R� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt _dataVersionQuery4 s c c sM | j d k r< | j j | j d | j �Vd d | _ n t | j � d S( NR i ( R� Rb RW R� R� R R ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt dataVersion< s $c C s | j � S( sG Implement L{IDataStoreObject.name} to return the uid. ( R� ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR% C s c c sU g } | j d | � V} x+ | D]# } | j | j | d | �V� q Wt | � d S( s; Retrieve children contained in this home. t onlyInTrashN( t listChildrenR� R� R ( R} RY R5 R� R% ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyRM I s !c C s | r d Sd S( Nt TRASHEDt NOTTRASHED( ( R} RY ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt _childrenKeyT s c c s� | j j | � V} x� | D]� } t j s> | j � r> q q> n | j | j � � } | j � | j | k r | | j | | j � <| | j | | j <q q Wt | _ t | � d S( sD Load and cache all children - Depth:1 optimization N( RD t loadAllObjectsR# t ExposeTrashCollectiont isTrashR] t isInTrashR% R� R Rv R� R ( R} R� R� R- ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyRK W s c c sc | j s | j � Vn g | j | j | � j � D] } t | t � s4 | ^ q4 } t | � d S( sl Retrieve the names of the children in this home. @return: an iterable of C{str}s. N( R� RK R� R] t keyst isinstancet intR ( R} RY t kR� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyRZ h s >c c s� | j | � } | | j | k rx | j j | | d | �V} | d k rx | | j | | <| | j | | j � <qx n t | j | j | d � � d S( s� Retrieve the child with the given C{name} contained in this home. @param name: a string. @return: an L{ICalendar} or C{None} if no such child exists. RY N( R] R� RD t objectWithNameRb R R R= ( R} R% RY t childrenKeyRN ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� u s c C s | j j | | d d d | �S( s� Retrieve the child accepted or otherwise with the given bind identifier contained in this home. @param name: a string. @return: an L{ICalendar} or C{None} if no such child exists. t acceptedRY N( RD Rf Rb ( R} t shareUIDRY ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt anyObjectWithShareUID� s c c s� | j | � } | | j | k rx | j j | | d | �V} | d k rx | | j | | <| | j | | j � <qx n t | j | j | d � � d S( s� Retrieve the child with the given C{resourceID} contained in this home. @param name: a string. @return: an L{ICalendar} or C{None} if no such child exists. RY N( R] R� RD t objectWithIDRb R% R R= ( R} R RY Rg RN ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt childWithID� s c C s | j j | | d | �S( s� Retrieve the child with the given C{bindUID} contained in this home. @param name: a string. @return: an L{ICalendar} or C{None} if no such child exists. RY ( RD t objectWithBindUID( R} t bindUIDRY ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt childWithBindUID� s c C s | j j | | d d d | �S( s� Retrieve the child with the given C{resourceID} contained in this home. @param name: a string. @return: an L{ICalendar} or C{None} if no such child exists. Rh RY N( RD Rk Rb ( R} R RY ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt allChildWithID� s c c s� | j d � r t | � � n | j j | | d | �V} | d k r� | j t � } | | j | | <| | j | | j � <n t | � d S( NR� Rn ( Rp RG RD R4 Rb R] Rt R� R R ( R} R% Rn RN R- ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt createChildWithName� s c c s� | j | � V} | d k r( t � � n | j | j � � } | j } | rZ | j � Vn | j � V| j | j | d � | j | j | d � d S( N( R� Rb RI R] Ra R R� R� R� RL ( R} R% t useTrashRN R- R ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt removeChildWithName� s c c s� d } t | d � r! | j } njt | d � r�| j r^ | j j | | j � V} | | _ q�| r�| j } t d | d | j | j � k d t � j | j � Vt | j g d | d | j | j � k �j | j � Vd d | _ | j r | j j | | j � V} np | j j | t t � � � V} | j � | _ | j } t i | j | j 6d | j | j � k �j | j � V| | _ q�n t | � d S( Nt _trashObjectt _trashR� R$ t ForUpdatei ( Rb R� Rt Ru RD Rk R R R� R Rv R� R� t TRASHt _trashClassR4 Ru RZ R R ( R} R4 RN R: ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt getTrash� s< c C s� | j } | j } t t | j � g d t | j g d | d | j j t | j g d | d | j t d � k �� d t t | j g d | d | j t d � k j | j d k � �d t j ���S( s� DAL Select statement to find the sync token. This is the max(REVISION) from the union of: 1) REVISION's for all object resources in all home child collections in the targeted home 2) REVISION's for all child collections in the targeted home Note the later is needed to track changes directly to the home child themselves (e.g. property changes, deletion etc). R� R$ R t SetExpressiont optypeN( RE t _bindSchemaR R R� R� R� RF R R R� Rb t OPTYPE_ALL( R) t revt bind( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt _syncTokenQuery� s$ *c C sI | d k r d St | t � rA | j d d � \ } } t | � S| Sd S( Ni t _i ( Rb Rc Ru Rk Rd ( R} t tokent _ignore_uuidR� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt revisionFromToken s c c s@ | j d k r" | j � V| _ n t d | j | j f � d S( s Return the current sync token for the home. This is an aggregate of sync tokens for child collections. We will cache this value to avoid doing the query more than necessary. Care must be taken to invalid the cached value properly. s %s_%sN( R Rb t syncTokenRevisionR R ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt syncToken( s c c s] | j j | j d | j �Vd d } | d k rO t | j j d � V� } n t | � d S( NR i s MIN-VALID-REVISION( R� R� R� R Rb Rd R� R ( R} R� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� 3 s ' c C s� | j } | j } t | j | j | j | j g d | j | | j t d � k j | j | j k � d � d | j t d � k j | j t d � k � �S( NR� R s left outerR$ R� ( R| RE R R� t COLLECTION_NAMEt DELETEDR� RF R R� R� R� ( R) R R~ ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt _changesQuery: s c c s3 | j j | j d | j d | �V} t | � d S( sP Do the changes query. Subclasses may override. R R� N( R� R� R� R R ( R} R� R� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt doChangesQueryO s c C s | j | j | � | � S( s" Return the changed and deleted resources since a particular sync-token. This simply extracts the revision from from the token then calls L{resourceNamesSinceRevision}. @param revision: the revision to determine changes since @type revision: C{int} ( t resourceNamesSinceRevisionR� ( R} R� t depth( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt resourceNamesSinceToken[ s c c s� | r7 | j j d � V} | t | � k rQ t � qQ n | j | � V} t | � g | j | � VD]E \ } } } } | r� | n | r� | n d | r� | n d | f ^ qb } t j s� | j d t � V} | r� | j � n d } n d } t � } t � } t � } t � } x� | D]� \ } } } | r<| | k r<qn | r�| r�| d k rk| j d | f � q�| j d | | f � q�| j d | f � | j | � n | | k r| j d | f � | r�| d k r�| j d | | f � q�qqWxr | j � VD]c } | j � s | j | | � V\ } } } | | O} | | 8} | | O} | | 8} | | O} q q Wt | � } t | � } t | � } t | | | f � d S( s� Determine the list of child resources that have changed since the specified sync revision. We do the same SQL query for both depth "1" and "infinity", but filter the results for "1" to only account for a collection change. Now that we are truncating the revision table, we need to handle the full sync (revision == 0) case a little differently as the revision table will not contain data for resources that exist, but were last modified before the revision cut-off. Instead for revision == 0 we need to list all existing child resources. We need to handle shared collection a little differently from owned ones. When a shared collection is bound into a home we record a revision for it using the sharee home id and sharee collection name. That revision is the "starting point" for changes: so if sync occurs with a revision earlier than that, we return the list of all resources in the shared collection since they are all "new" as far as the client is concerned since the shared collection has just appeared. For a later revision, we just report the changes since that one. When a shared collection is removed from a home, we again record a revision for the sharee home and sharee collection name with the "deleted" flag set. That way the shared collection can be reported as removed. For external shared collections we need to report them as invalid as we cannot aggregate the sync token for this home with the sync token from the external share which is under the control of the other pod. Reporting it as invalid means that clients should do requests directly on the share itself to sync it. @param revision: the sync revision to compare to @type revision: C{str} @param depth: depth for determine what changed @type depth: C{str} s MIN-VALID-REVISIONR� R4 t 1s %s/s %s/%sN( R� R� Rd RO t resourceNamesSinceRevisionZeroR R� R# R_ Ry Rt R% Rb Rx R� RM RR t% sharedChildResourceNamesSinceRevisionR8 ( R} R� R� t minValidRevisionR� R� t collectionR% t wasdeletedt trasht trashNamet changedt deletedt invalidt deleted_collectionst sharet sharedChangedt sharedDeletedt sharedInvalid( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� f sT Y ! c c s& t � } t � } t � } x� | j � VD]� } | j � r� | j � } | j d | f � | d k r� x/ | j � VD] } | j d | | f � qu Wq� q) | j | � V\ } } } | | O} | | 8} | | O} | | 8} | | O} q) Wt | � } t | � } t | � } t | | | f � d S( s� Revision == 0 specialization of L{resourceNamesSinceRevision} . @param depth: depth for determine what changed @type depth: C{str} s %s/R� s %s/%sN( Rx RM RR R% R� t listObjectResourcest) sharedChildResourceNamesSinceRevisionZeroR8 R ( R} R� R� R� R� RN R� R% R� R� R� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� � s( ! c c sJ t j | j � | j � | j � | j | j d | j �V} | | _ d S( Nt notifyCallback( R' R� R� R= R� R t notifyChangedt _propertyStore( R} t props( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR � s c C s | j S( N( R� ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyRG s c C s d S( s- The content type of objects N( Rb ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt contentType s c C s d S( N( Rb ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt md5 s c C s d S( Ni ( ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt size s c C s | j r t | j � Sd S( N( R R$ Rb ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR s c C s | j r t | j � Sd S( N( R R$ Rb ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR s c C s� | j } | j } | j t d � k j | j t d � k � } | rf | j | j t d � k � } n t | j | j g d | j | | j | j k � d | �S( NR� R t bindModeR� R$ ( t _objectSchemaR| t UIDR R� RF R� R t PARENT_RESOURCE_IDR� R� ( R) t checkBindModeRP R R� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt _objectResourceQuery s ! c C s | j d t � S( NR� ( R� Rt ( R) ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt _resourceByUIDQuery% s c C s | j d t � S( NR� ( R� Rv ( R) ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt _resourceByUIDBindQuery) s c c s� g } | r4 | j j | j d | d | j �V} n+ | j j | j d | d | j d t �V} | r� x_ | D]T \ } } | j | � V} | rl | j � | k rl | j | � V} | j | � ql ql Wn t | � d S( s� Return all child object resources with the specified UID, ignoring any in the named child collections. R� R R� N( R� R� R� R R� R5 Rl R% t objectResourceWithIDR� R ( R} R� t ignore_childrent allowSharedR� R� t childIDt objectIDRN t objectResource( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt objectResourcesWithUID- s c C s4 | j } t | j g d | d | j t d � k �S( NR� R$ R ( R� R R� R� R ( R) RP ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt _objectResourceIDQueryH s c c sz | j � j | j d | �V} | rl t | � d k rl | j | d d � V} | j | � V} t | � n t d � d S( sS Return all child object resources with the specified resource-ID. R i i N( R� R� R� R� Rl R� R Rb ( R} RA R� RN R� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� Q s c C s4 | j } t | j g d | d | j t d � k �S( NR� R$ R ( R R R� R� R ( R) t meta( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt _quotaQueryb s c c sM | j d k r< | j j | j d | j �Vd d | _ n t | j � d S( NR i ( R� Rb R� R� R� R R ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt quotaUsedBytesj s $c C s1 | j } t d | d | j t d � k d t � S( NR� R$ R Rv ( R R R� R Rv ( R) R� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt _preLockResourceIDQueryq s c C sH | j } t i | j t d � | j 6d | j t d � k d | j �S( Nt deltaR$ R R& ( R R R� R R� ( R) R� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt _increaseQuotaQueryx s c C s2 | j } t i d | j 6d | j t d � k �S( Ni R$ R ( R R R� R� R ( R) R� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt _resetQuotaQuery� s c c s� | j j | j d | j �V| j j | j d | d | j �Vd d | _ | j d k r� t j d d | j d | �| j j | j d | j �Vd | _ n d S( s Adjust quota used. We need to get a lock on the row first so that the adjustment is done atomically. It is import to do the 'select ... for update' because a race also exists in the 'update ... x = x + 1' case as seen via unit tests. R R� i sC Fixing quota adjusted below zero to {used} by change amount {delta}t usedN( R� R� R� R R� R� R� R� R� ( R} R� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt adjustQuotaUsedBytes� s ' c C s, | j d k r i | _ n | | j | <d S( N( R� Rb ( R} t factory_namet notifier( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR � s c C s | j r | j j | � Sd S( N( R� R= Rb ( R} R� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt getNotifier� s c C s | j | j � f S( N( t _notifierPrefixR� ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt notifierID� s c c s� | j j | � r t d � n | j j | � | j rF | j � Vn | j r� | j j d d � } | r� | j j | j � n | j j d d � } | r� | j | j d | j �Vq� n d S( s� Send notifications, change sync token and bump last modified because the resource has changed. We ensure we only do this once per object per transaction. t cachet pusht priorityN( R� RQ R Rb RR R t bumpModifiedR� R= R� t notifyR. ( R} t categoryR� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� � s c C s7 | j } t d | d | j t d � k d t d t � S( NR� R$ R Rv t NoWait( R R R� R Rv ( R) R� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt _lockLastModifiedQuery� s c C s; | j } t i t | j 6d | j t d � k d | j �S( NR$ R R& ( R R R R R� R ( R) R� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt _changeLastModifiedQuery� s c # s� d � _ t � f d � � } y? t � j j | d d d t �Vd d � � _ � j � VWn t k r} t j d � n Xd S( s� Bump the MODIFIED value. A possible deadlock could happen here if two or more simultaneous changes are happening. In that case it is OK for the MODIFIED change to fail so long as at least one works. We will use SAVEPOINT logic to handle ignoring the deadlock error. We use SELECT FOR UPDATE NOWAIT to ensure we do not delay the transaction whilst waiting for deadlock detection to kick in. c 3 sD � j j | d � j �V� j j | d � j �V} t | � d S( NR ( R� R� R R� R ( t subtxnR� ( R} ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt _bumpModified� s R` i Ra s CommonHome.bumpModified failedN( Rb R R R R� Re Rv R RV RM R� t debug( R} R� ( ( R} s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� � s c c sa | j } i | j d 6} t d | d | j t d � k j | j t k � � j | j | � Vd S( s� Unbinds any collections that have been shared to this home but not yet accepted. Associated invite entries are also removed. t homeResourceIDR� R$ N( R| R R RF R R� t BIND_STATUSR6 R� R� ( R} R R� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyRS � s *c c so | j j j | j d | �V} | ra | d \ } } | j j | j | � V} t | | f � n t d � d S( s� Get the owner home for a shared child ID and the owner's name for that bound child. Subclasses may override. R i N( NN( RD t _ownerHomeWithResourceIDR� R� R@ RE R Rb ( R} R R� t ownerHomeIDt ownerNamet ownerHome( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt ownerHomeAndChildNameForChildID s i c c s� | j � V} | d k rB | r5 d } t j | � n t d � n t j j � t j d | � } | j d t � V} x� | D]� } t | � } | j | j d | �V} t | � d k r� q{ n | r� d j | j d � � } t j | � n xi | D]a } | rC| j � V} | j � j d d � } d j | � } t j | � n | j d t � Vq� W| r{ d GHq{ q{ W| j d t � V} x)| D]!} t | � } | j | j d | �V} | r�d j | j d � � } t j | � n xi | D]a } | r4| j � V} | j � j d d � } d j | � } t j | � n | j d t � Vq�W| rWd GHn | j � | k r�| r�d j | j d � � } t j | � n | j � Vq�q�Wd S( Ns! No trash collection for principalt daysRY RX i s Collection "{}":s utf-8t SUMMARYs <no title>s Removing "{}"...R� R� s Removing collection "{}"...( Ry Rb R� R� R t datetimet utcnowt timedeltaRM Rt RT t trashForCollectionR R� R� t encodet componentt mainComponentt propertyValueR� Rv t whenTrashed( R} R� t verboseR� t msgt endTimet untrashedCollectionsR� t displayNameRM RN R� t summaryt trashedCollections( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt emptyTrash s` c c s� i g d 6g d 6} | j � V} | d k r: t | � n t j j � } | j d t � V} x� | D]� } | j � } i t | � d 6| j d 6t | | � d 6g d 6} | t j d d � } | j | j d | �V} xD | D]< } | j � V} | j � j d d � } | d j | � q� W| d j | � qc W| j d t � V} x� | D]� } | j | j � V} t | � d k r�qOn i t | � d 6g d 6} x, | D]$ } t | � V} | d j | � q�W| d j | � qOWt | � d S( Nt trashedcollectionst untrashedcollectionsRY R� t recoveryIDR� RM t minutesi t startR� s <no title>i ( Ry Rb R R� R� RM Rv R� RT R RV R� R� R� R� R� R� Rt R� RU ( R} R� R� t nowDTR� R� R� t detailR� RM RN R� R� R� t childDetail( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt getTrashContentsM sH c c s; | j � V} | d k r7| d k r� | rX | j | � V} | d k r� | j � Vq� q4| j d t � V} x� | D]5 } | j | j � V} x | D] } | j � Vq� Wqr Wq7| r� | j | d t �V} | d k r4| j d t d t j d d � � Vq4q7| j d t � V} x" | D] } | j d t � VqWn d S( Nt eventRY t restoreChildrenR� R� i ( Ry Rb R� t fromTrashRM Rt R� R Rl Rv R� R� ( R} t modeR� R� RN R� R� RM R� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt recoverTrash} s* N(x R� R� R R� Rb RE R� R R� RD Rx R| RE R� R� R/ R. t classmethodR� R� R R R R R R R� R� R R R R� R R! R# R7 Rt R� R@ R% R# R R R� R= R2 R1 R� R> R? R R� RA R@ R� RC RP RO R� R RT RV RW RX R% RM R] RK RZ R� Rj Rl Ro Rp Rq Rv Rs Ry R� R� R� R� R� R� R� R� R� R RG R� R� R� R R R� R� R� R� R� R� R� R� R� R� R� R� R R� R� RS t defaultR� R� R� R� RS R� R� R� R� ( ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR � s� � ! & %( h$ " 90t CommonHomeChildc B s� e Z d Z e � Z dX Z dY Z dY Z dY Z dY Z dY Z dY Z dY Z dY Z dY Z dY Z dY Z dY Z dY Z e Z e e dY dY d � � � Z e e d � � � Z d dY dY dY dY d � Z d � Z d � Z d � Z e e d � � � Z e e e d � � Z! e e e d � � Z" e e e d � � Z# e e dY dY dY e e d � � � Z$ e% d � � Z& e% d � � Z' e e dY d � � � Z( e% d � � Z) d � Z* d � Z+ d � Z, d � Z- e e d � � � Z. e/ d � � Z0 d � Z1 d � Z2 d � Z3 d � Z4 e% d � � Z5 e d � � Z6 e% d � � Z7 e d! � � Z8 e d" � � Z9 e% d# � � Z: e d$ � � Z; e e e< j= d% d& � e d' � � Z> d( � Z? d) � Z@ d* � ZA d+ � ZB d, � ZC e% d- � � ZD e d. � � ZE e d/ � � ZF e d0 � � ZG e d1 � � ZH d2 � ZI d3 � ZJ d4 � ZK e dY dY dY d5 � � ZL e d6 � � ZM e d7 � � ZN e dY d8 � � ZO e d9 � � ZP e d: � � ZQ e% e d; � � ZR d< � ZS e dY d= � � ZT e dY d> � � ZU e dY d? � � ZV e d@ � � ZW e dY dA � � ZX dB � ZY dC � ZZ e dD � � Z[ e dE � � Z\ e dY dF � � Z] dG � Z^ dH � Z_ dI � Z` dJ � Za dK � Zb dL � Zc dM � Zd dN � Ze dO � Zf dP � Zg dQ � Zh ei jj dR � Zk dS � Zl e e ei jj dT � � Zm e% dU � � Zn e% dV � � Zo e dW � � Zp RS(Z s> Common ancestor class of AddressBooks and Calendars. t _namet _homeR c c s� | \ } } } } } } } } | d k r^ | t k rE | } | } qd | j | � V\ } } n d } | r | j � r | j n | } | d | d | d | d | d | d | d | d | d | d | � } | r x6 t | j � | � D] \ } } t | | | � q� Wn | rlx3 t | j � | � D] \ } } t | | | � q%Wt | j � | _ t | j � | _ n | r�| r�| t k r�| j | j � � n | j | � Vt | � d S( s Given the various database rows, build the actual class. @param home: the parent home object @type home: L{CommonHome} @param bindData: the standard set of bind columns @type bindData: C{list} @param additionalBindData: additional bind data specific to sub-classes @type additionalBindData: C{list} @param metadataData: metadata data @type metadataData: C{list} @param propstore: a property store to use, or C{None} to load it automatically @type propstore: L{PropertyStore} @param ownerHome: the home of the owner, or C{None} to figure it out automatically @type ownerHome: L{CommonHome} @return: the constructed child class @rtype: L{CommonHomeChild} R� R% R R� R2 R� t messageR� R� Rn N( Rb R5 R� R> R� R� t additionalBindAttributesR� R R R R t _setDefaultUserUIDR� R R ( R) R� t bindDatat additionalBindDatat metadataDatat propstoreR� t _ignore_homeIDR R% R� t bindStatust bindRevisionRn t bindMessageR� R� RN R R. ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� � s> ! ""c c s� d } | j j } | r� | r6 | j | j | � } n< | rT | j | j | � } n | rr | j | j | � } n | j | � V} n | d k r4| r� | j j | j d | d | j �V} n\ | r� | j j | j d | d | j �V} n. | r| j j | j d | d | j �V} n | r+| d n d } n | sGt d � n | r�| j | j | j | j | � | � | j | j | j | j | � | � | j | j | j | j | � | � n | | j } | | j | j t | j � � !} | | j � j | j j � } d } | r<| j | � } | j | � V} n | d k r�| j j | j d | �Vd } | r�| j | j | | � Vq�n t | | | f � d S( s Given a set of identifying information, load the data rows for the object. Only one of L{name}, L{resourceID} or L{bindUID} is specified - others are C{None}. @param home: the parent home object @type home: L{CommonHome} @param name: the resource name @type name: C{str} @param resourceID: the resource ID @type resourceID: C{int} @param bindUID: the unique ID of the external (cross-pod) referenced item @type bindUID: C{int} R% R� R Rn i N( Rb R� R t keyForObjectWithNameR t keyForObjectWithResourceIDt keyForObjectWithBindUIDR= t _bindForNameAndHomeIDR� t _bindForResourceIDAndHomeIDt _bindForBindUIDAndHomeIDR R t bindColumnCountR� t additionalBindColumnst bindColumnsR� R| R� t keyForHomeChildMetaDatat _metadataByIDQuery( R) R� R% R Rn R� Rz R R� R R R ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt _getDBData� sH ((( %%( # i c C s | | _ | | _ | | _ | | _ | | _ | | _ | | _ | | _ | d k rZ | n | | _ | d k ru | n | | _ d | _ d | _ i | _ d | _ d | _ | j j r� t g | j j j � D]! \ } } | | j | � f ^ q� � | _ n d | _ d S( N( R� R� R t _bindModet _bindStatust _bindRevisiont _bindUIDt _bindMessageRb t _ownerHomet _ownerNameR R t _objectst _objectNamesR R� R R9 t clone( R} R� R% R R� R2 R� R� R� R� Rn R� R� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� C s$ Fc C s t S( N( Rt ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR` ^ s c C s t | j � S( N( R t _parentCollection( R} R� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt originalParentForResourcea s c C s | | | j <| | | j <d S( s Add this object to the memo dictionary in whatever fashion is appropriate. @param key: key used for lookup @type key: C{object} (typically C{str} or C{int}) @param memo: the dict to store to @type memo: C{dict} N( R� R ( R} R- t memo( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt memoMed s c c sj g } | j j | j d | j �V} | j � j | j j � } | r� g | D] } | | ^ qM } t j | j � d | j � | j | � V} | j | | � V} n x� | D]� } | | j } | | } | | j | j t | j � � !} | | j t | j � � } | j | d � } | j | | | | | � V} | j | d � | _ | j | � q� Wt | � d S( sy Load all L{CommonHomeChild} instances which are children of a given L{CommonHome} and return a L{Deferred} firing a list of them. This must create the child classes and initialize them using "batched" SQL operations to keep this constant wrt the number of children. This is an optimization for Depth:1 operations on the home. R� N( t _childrenAndMetadataForHomeIDR� R� R R R� R| R� R' t# forMultipleResourcesWithResourceIDsR� Rb R= t childSyncTokenRevisionsR R� R R= R� R R� R ( R) R� R� t dataRowst resourceID_indext dataRowt childResourceIDst propertyStorest revisionsR R R R R RN ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR^ p s$ % # c C s | j | d | d | d | �S( NR% Rh RY ( t objectWith( R) R� R% Rh RY ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyRf � s c C s | j | d | d | d | �S( NR Rh RY ( R, ( R) R� R Rh RY ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyRk � s c C s | j | d | d | d | �S( NRn Rh RY ( R, ( R) R� Rn Rh RY ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyRm � s c c s* | j | | | | � V} | d k r2 t d � n | \ } } } | | j � j | j j � } | d k r� | t k t | � k r� t d � n y# | | j � j | j j � } Wn t t f k r� t } n X| r� | st d � qn | rt d � n | j | | | | � V} t | � d S( s� Create the object using one of the specified arguments as the key to load it. One and only one of the keyword arguments must be set. @param home: home @type home: L{CommonHome} @param name: name of the resource, or C{None} @type name: C{str} @param uid: resource data UID, or C{None} @type uid: C{str} @param resourceID: resource id @type resourceID: C{int} @param accepted: if C{True} only load owned or accepted share items @type accepted: C{bool} @return: the new object or C{None} if not found @rtype: C{CommonHomeChild} N( R Rb R R R� R| R� R6 t boolR t _homeChildMetaDataSchemat IS_IN_TRASHt AttributeErrorR� Rt R� ( R) R� R% R Rn Rh RY t dbDataR R R R Ra RN ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR, � s$ $ # c C s) | j } t i t j | j 6d | j �S( sO DAL statement to create a home child with all default values. R& ( t _homeChildSchemaR R: t RESOURCE_ID_SEQR� ( R) RN ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt _insertHomeChild� s c C sE | j } t i t d � | j 6t d � | j 6d | j | j f �S( sO DAL statement to create a home child with all default values. R t childTypeR& ( R. R R R� t CHILD_TYPER� R ( R) RN ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt _insertHomeChildMetaData� s c c s | j j | j d | d | j �Vr4 t | � � n | j d � rR t | � � n | j j | j � Vd d } | j j | j d | d | j �V| j j | j d | j d | d | d | d t d t d d �V| j | | � V} | j � V| j � V| j � Vt | � d S( NR% R� R� i R R5 Rn R� R R� ( R R� R� R RH Rp RG R4 R7 t _childTypet _bindInsertQueryR5 R6 Rb Rk t _initSyncTokenR� t notifyPropertyChangedR ( R) R� R% Rn R RN ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR4 � s % c C s4 | j } t | j � d | d | j t d � k �S( sV DAL query to retrieve created/modified dates based on a resource ID. R� R$ R ( R. R R R� R ( R) RN ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR s c C s | j S( s Retrieve the store identifier for this collection. @return: store identifier. @rtype: C{int} ( R ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR s c C s | j � j � S( sG Is this an external home. @return: a string. ( R� R� ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� " s c C s | j � j � S( sG Is this an external home. @return: a string. ( R� R> ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR> * s c C s i } t g | j � D]" } | d t | | d � f ^ q � | d <t g | j � D]" } | d t | | d � f ^ qU � | d <t g | j � D]" } | d t | | d � f ^ q� � | d <| d d j d � | d d <| d d j d � | d d <| S( s( Create a dictionary mapping key attributes so this object can be sent over a cross-pod call and reconstituted at the other end. Note that the other end may have a different schema so the attributes may not match exactly and will need to be processed accordingly. i R R R R Rf R N( R t bindAttributesR Rb R� R R ( R} R R ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR! 2 s ??? c c s� g | j � D] } | d j | d � ^ q } g | j � D] } | d j | d � ^ q= } g | j � D] } | d j | d � ^ qm } | j | | | | � V} t | � d S( s[ Given a mapping generated by L{serialize}, convert the values into an array of database like items that conforms to the ordering of L{_allColumns} so it can be fed into L{makeClass}. Note that there may be a schema mismatch with the external data, so treat missing items as C{None} and ignore extra items. R i R R N( R< R= R� R R� R ( R) t parentR" R� R R R RN ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR# @ s 000c C s | j j S( N( R� R� ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� R s c C s | j j � j � S( N( R� R R ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR V s c C s d | j j | j f S( Ns <%s: %s>( R� R� R ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR# Y s c C s | j d k S( sV An empty resource-id means this object does not yet exist in the DB. N( R Rb ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt exists\ s c C s | j S( N( R� ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR% b s c C sP | j } t i t d � | j 6d | j t d � k j | j t d � k � �S( s> DAL statement to rename a L{CommonHomeChild} R% R$ R R� ( R| R R R� R� R� RF ( R) R ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt _renameQuerye s c c s� | j � s | j � r( t d � � n | j } | j � V| j j | j d | d | j d | j j �V| | _ | j j | j � � } | j j | | =| | j j | | <| j � V| j � V| j j � Vd S( s� Change the name of this L{CommonHomeChild} and update its sync token to reflect that change. @return: a L{Deferred} which fires when the modification is complete. s! Cannot rename a shared collectionR% R R� N( RR R� RC R� RV R? R� R� R R� R] Ra R� t _renameSyncTokenR; R� ( R} R% t oldNameR- ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt renameo s c C s( | j } t | d | j t d � k �S( sR DAL statement to delete a L{CommonHomeChild} by its resource ID. R$ R ( R2 R R� R ( R) RN ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt _deleteQuery� s c c sA t j r2 | j � } | r$ t � q= | j � Vn | j � Vd S( sg If trash is enabled, move the collection to trash, otherwise fully delete it. N( R# t EnableTrashCollectionRa RP t toTrasht _reallyRemove( R} Ra ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� � s c c s� | j � V| j � V| j � V| j � V| j j | j t d | j �V| j � j � Vd | _ d | _ d | _ i | _ | j j � Vd S( s� Actually remove this collection from the database. All the child resources will be automatically removed by virtue of an on delete cascade. Note that means no implicit scheduling cancels will occur. R N( t ownerDeleteShareR; RV t _deletedSyncTokenRC R� R� RI R RG RH Rb R R R R� R� ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyRF � s c C sH | j } t i t d � | j 6t d � | j 6d | j t d � k �S( NRa t trashedR$ R ( R. R R R/ R[ R� ( R) R� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt _updateIsInTrashQuery� s &c c sm | j � Vx | j � VD] } | j � Vq Wt j j � } | j j | j d t d | d | j �V| j � Vd j | j d t t � � � } | j | � Vy! | j j | j j t � | =Wn t k r� n Xy$ | j j | j j t � | j =Wn t k r n X| | j j | j j t � | <| | j j | j j t � | j <t | _ t | � | _ d S( NRa RI R s {}-{}i$ ( RG t objectResourcesRE R� R� RJ R� R� Rv R RH R� R� Ru RZ RB R� R� R] Rt t KeyErrort _isInTrasht _trashed( R} R� R� t newName( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyRE � s* "! $ # R� i c c s/ | j s t d � n | j � } | d k r; | | } n | j j | j d t d d d | j �V| j � V| j � V| j � V| j j � Vt | _ d | _ y$ | j j | j j t � | j =Wn t k r� n Xy$ | j j | j j t � | j =Wn t k rn X| | j j | j j t � | j <| | j j | j j t � | j <| r+| j j � V} | d k r+| j | j d | �V} x� | D]� } | r�| j � V} | j � j d d � } d j | � GHn y | j � VWq�t k r } d j | j � t | � � GHq�Xq�Wq+n d S( NRa RI R R� R� s <no title>s Recovering "{}"s Failed to restore "{}" due to {}( RM R Rb R� RJ R� R� Rt R R: R; RV R� R� RN R� R] Rv R� RL Ry R� R� R� R� R� R� R� R% Ru ( R} R� R� R� R� R� t childrenToRestoreRN R� R� R� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� � sJ $ $ ## c C s t | d t � S( NRM ( R Rt ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyRa s c C s | j d k r d St | j � S( N( RN Rb R ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� s c C s | j � S( s6 Do a "silent" removal of this child. ( RF ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� $ s c C s | j S( sh @see: L{ICalendar.ownerCalendarHome} @see: L{IAddressbook.ownerAddessbookHome} ( R ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� * s c C s | j S( sk @see: L{ICalendar.viewerCalendarHome} @see: L{IAddressbook.viewerAddressbookHome} ( R� ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt viewerHome1 s c C sL | j } t | j | j g d | d | j t d � k j | j t k � �S( s� DAL query to retrieve the home resource ID and resource name of the owner from the bound home-child ID. R� R$ R ( R| R RF R� R� R R� R� R5 ( R) R ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� 8 s c c s� | j j | � V} xG | D]? } | | j | j � <| | j | j � <| | j | j � <q Wt g | D] } | j � ^ qg � | _ t | � d S( sD Load and cache all children - Depth:1 optimization N( t _objectResourceClassR^ R R% R� R R8 R R ( R} R� R� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyRK F s (c c s� | j j | | � V} xG | D]? } | | j | j � <| | j | j � <| | j | j � <q Wt g | D] } | j � ^ qj � | _ t | � d S( sO Load and cache all named children - set of names optimization N( RR t loadAllObjectsWithNamesR R% R� R R8 R R ( R} R� R� R� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt objectResourcesWithNamesS s (c c s9 | j d k r( | j j | � V| _ n t | j � d S( sP Returns a list of names of object resources in this collection N( R Rb RR t listObjectsR ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� ` s c c sF | j d k r/ | j j | � V} t | � n t t | j � � d S( N( R Rb RR t countObjectsR R� ( R} R� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt countObjectResourcesi s c C s4 | | j k r t | j | � S| j d | � Sd S( NR% ( R R t _makeObjectResource( R} R% ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� p s c C s4 | | j k r t | j | � S| j d | � Sd S( NR� ( R R RX ( R} R� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt objectResourceWithUIDv s c C s4 | | j k r t | j | � S| j d | � Sd S( NR ( R R RX ( R} R ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� | s c c s� | j j | d | d | d | �V} | rg | | j | j � <| | j | j � <| | j | j � <n/ | r} d | j | <n d | j | r� | n | <t | � d S( si We create the empty object first then have it initialize itself from the store. R% R� R N( RR R, R R% R� R Rb R ( R} R% R� R R� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyRX � s %c c s� y- | j | } t | r% | j � n d � Wn t k r@ n X| j j | | � V} | rj t | � n d | j | <t d � d S( N( R R R% Rb RL RR t resourceNameForUID( R} R� R� R% ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyRZ � s c c s� y- | j | } t | r% | j � n d � Wn t k r@ n X| j j | | � V} | rj t | � n d | j | <t d � d S( N( R R R� Rb RL RR t resourceUIDForName( R} R% R� R� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR[ � s c c s� | | j k r( | j | r( t � � n t j r\ | j � V} | t j k r\ t � � q\ n | j j | | | | � V} | | j | j � <| | j | j � <| | j | j � <d | _ t | � d S( s� Create a new resource with component data and optional metadata. We create the python object using the metadata then create the actual store object with setComponent. N( R RK R# t MaxResourcesPerCollectionRW RN RR R4 R% R� R Rb R R ( R} R% R� R� t child_countR� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt createObjectResourceWithName� s c c sQ | | j | j � <| | j | j � <| | j | j � <d | _ | j � Vd S( s� When a resource is put back from the trash to the original collection, this method updates/invalidates caches and triggers a notification. N( R R% R� R Rb R R� ( R} RN ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt addedObjectResource� s c c s� | j j | j � d � | j j | j � d � | j j | j � d � | j r� | j � | j k r� | j j | j � � n | j | j � � V| j d | j � � Vd S( NR� ( R RL R% Rb R� R R R� t _deleteRevisionR� t removeNotifyCategory( R} RN ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt removedObjectResource� s c C sZ | j } i t d � | j 6} | r; t d � | | j <n t | d | j t d � k �S( sD DAL query to update a child to be in a new parent. t newParentIDRO R$ R ( R� R R� R� R R� ( R) t adjustNameRP t cols( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt _moveParentUpdateQuery� s c C s t t � S( su Method that subclasses can override to do an extra DB adjustments when a resource is moved. ( R Rv ( R} RN t newparent( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt _movedObjectResource� s c c s� | j � } | d k r! | } n | j d � r? t | � � n | j | � Vd k rd t | � � n t j r� | j � V} | t j k r� t � � q� n t | � d S( s� Check that the move operation is valid TODO: check that the resource name does not exist in the new parent, or that the UID does not exist there too. @param child: the child resource to move @type child: L{CommonObjectResource} @param newparent: the parent to move to @type newparent: L{CommonHomeChild} @param newname: new name to use in new parent @type newname: C{str} or C{None} for existing name R� N( R% Rb Rp RJ R� RK R# R\ RW RN R ( R} RN Rg t newnameR% R] ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt _validObjectResource� s c c s� | j � } | j | | | � V} | j � } | j j | d � | j j | d � | j j | j � d � | j | � V| j � V| j } i } | j | j k r� t d � | | j <n | | k r� t d � | | j <n t | d | j t d � k �j | j d | j d | j d | �V| j | j k rI| j | | � Vn | | _ | j j | d � | j j | d � | j j | j � d � | j | � V| j � Vd S( sq Move a child of this collection into another collection without actually removing/re-inserting the data. Make sure sync and cache details for both collections are updated. TODO: check that the resource name does not exist in the new parent, or that the UID does not exist there too. @param child: the child resource to move @type child: L{CommonObjectResource} @param newparent: the parent to move to @type newparent: L{CommonHomeChild} @param newname: new name to use in new parent @type newname: C{str} or C{None} for existing name Rc RO R$ R N( R% Rj R� R RL Rb R R` R� R� R R R� R� R R� R� R� Rh R t _insertRevision( R} RN Rg Ri R% R� RP Re ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt moveObjectResource# s: c c s[ | j � } | j | | | � V} | j � V} | j | | � V| j | j � | � Vd S( s Move a child of this collection into another collection by doing a create/delete. TODO: check that the resource name does not exist in the new parent, or that the UID does not exist there too. @param child: the child resource to move @type child: L{CommonObjectResource} @param newparent: the parent to move to @type newparent: L{CommonHomeChild} @param newname: new name to use in new parent @type newname: C{str} or C{None} for existing name N( R% Rj R� t moveObjectResourceHeret moveObjectResourceAwayR ( R} RN Rg Ri R% R� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt moveObjectResourceCreateDelete^ s c c s | j | | � Vd S( s| Create a new child in this collection as part of a move operation. This needs to be split out because behavior differs for sub-classes and cross-pod operations. @param name: new name to use in new parent @type name: C{str} or C{None} for existing name @param component: data for new resource @type component: L{Component} N( R^ ( R} R% R� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyRm v s c c s. | d k r | j | � V} n | j � Vd S( sw Remove the child as the result of a move operation. This needs to be split out because behavior differs for sub-classes and cross-pod operations. @param rid: the child resource-id to move @type rid: C{int} @param child: the child resource to move - might be C{None} for cross-pod @type child: L{CommonObjectResource} N( Rb R� R� ( R} RA RN ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyRn � s c C s t S( N( Rt ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt objectResourcesHaveProperties� s c C s t � � d S( s� Do a query of the contents of this collection. @param filter: the query filter to use @type filter: L{Filter} @return: the names of the matching resources @rtype: C{list} N( RD ( R} t filter( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt search� s c c s� t � } t � } t � } | j � rP | d k r6 q�| j | j � d � n|| d k r� | | j k r� | d k r� t � q� | j | � V} t | � n | j } g t | j | j g d | d | j | k j | j | j k � �j | j � VD]3 \ } } | r� | j � | r | n d | f ^ q� } x� | D]� \ } } } | r�| d k rn| j d | f � q�| j d | | f � n | j d | f � | r6| d k r6| j d | | f � q6q6Wt | | | f � d S( s� Determine the list of child resources that have changed since the specified sync revision. We do the same SQL query for both depth "1" and "infinity", but filter the results for "1" to only account for a collection change. We need to handle shared collection a little differently from owned ones. When a shared collection is bound into a home we record a revision for it using the sharee home id and sharee collection name. That revision is the "starting point" for changes: so if sync occurs with a revision earlier than that, we return the list of all resources in the shared collection since they are all "new" as far as the client is concerned since the shared collection has just appeared. For a later revision, we just report the changes since that one. When a shared collection is removed from a home, we again record a revision for the sharee home and sharee collection name with the "deleted" flag set. That way the shared collection can be reported as removed. @param revision: the sync revision to compare to @type revision: C{str} @param depth: depth for determine what changed @type depth: C{str} R� t /i R� R$ R� s %s/s %s/%sN( Rx R� R� R% R RO R� R RE R R� R� R� R� R� R R� R� ( R} R� R� R� R� R� R� R~ R% R� R� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� � s< - c c s� t � } t � } t � } | j � } | j � rq | d k rX | j d j | � � q� | j d j | � � n[ | j � } | j | d � | d k r� x/ | j � VD] } | j d | | f � q� Wn t | | | f � d S( s Revision == 0 specialization of L{sharedChildResourceNamesSinceRevision}. We report on all existing resources -= this collection and children (if depth == infinite). @param depth: depth for determine what changed @type depth: C{str} R� s {}/Rs s %s/%sN( Rx R% R� R� R� R� R ( R} R� R� R� R� R� R% ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� � s c c sx | d k r^ t j | j � j � | j � j � | j � j � | j | j d | j �V} n | j | � | | _ d S( NR� ( Rb R' R� R� R� RQ R= R� R R; t initPropertyStoret _properties( R} R� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR s c C s | j S( N( Ru ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyRG s c C s d S( s� A hook for subclasses to override in order to set up their property store after it's been created. @param props: the L{PropertyStore} from C{properties()}. N( ( R} R� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyRt s c C s t � � d S( N( t NotImplementedError( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� * s c C s d S( N( Rb ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� - s c C s d S( Ni ( ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� 0 s c C s | j r t | j � Sd S( N( R R$ Rb ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR 3 s c C s | j r t | j � Sd S( N( R R$ Rb ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR 6 s c C s, | j d k r i | _ n | | j | <d S( N( R� Rb ( R} R� R� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR 9 s c C s | j r | j j | � Sd S( N( R� R= Rb ( R} R� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� > s c C s, | j � j d | j � j � | j f f S( Ns %s/%s( R� R� R� R ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� A s c C s | j � j � S( N( R� R� ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt parentNotifierIDD s c C s | j d t d | � S( sF Send notifications when a child resource is changed. t property_changeR� ( t _notifyChangedRt ( R} R� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� G s c C s | j d t � S( sK Send notifications when properties on this object change. Rx ( Ry Rv ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR; M s c c s� | j j | � r t d � n | j j | � | j rZ | j � V| rZ | j � VqZ n | j r� | j j d d � } | r� | j j | j � n | j j d d � } | r� | j | j d | j �Vq� n | j � s� | j | � Vn d S( s� Send notifications, change sync token and bump last modified because the resource has changed. We ensure we only do this once per object per transaction. Note that we distinguish between property changes and child resource changes. For property changes we need to bump the collections revision token, but we must not do that for child changes because that can cause a deadlock (plus it is not needed as the overall revision token includes the child token via the max() construct in the query). @param property_change: indicates whether this is the result of a property change as opposed to a child resource being added, changed or removed. @type property_change: C{bool} R� R� R� N( R� RQ R Rb RR R R� t _bumpSyncTokenR� R= R� R� R. R� t notifyExternalShare( R} Rx R� R� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyRy S s c C s7 | j } t d | d | j t d � k d t d t � S( NR� R$ R Rv R� ( R. R R� R Rv ( R) R: ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� } s c C s; | j } t i t | j 6d | j t d � k d | j �S( NR$ R R& ( R. R R R R� R ( R) R: ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� � s c # s� t � f d � � } yu t � j j | d d d t �Vd d � � _ � j j } | d k r� | j � j � } | j � j | � Vn Wn t k r� t j d � n Xd S( s� Bump the MODIFIED value. A possible deadlock could happen here if two or more simultaneous changes are happening. In that case it is OK for the MODIFIED change to fail so long as at least one works. We will use SAVEPOINT logic to handle ignoring the deadlock error. We use SELECT FOR UPDATE NOWAIT to ensure we do not delay the transaction whilst waiting for deadlock detection to kick in. c 3 sD � j j | d � j �V� j j | d � j �V} t | � d S( NR ( R� R� R R� R ( R� R� ( R} ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� � s R` i Ra s# CommonHomeChild.bumpModified failedN( R R R� Re Rv R R Rb R R RU RM R� R� ( R} R� Rz R ( ( R} s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� � s ( R� R� R N(q R� R� R� R R� t compareAttributesRb R� t _homeRecordClasst _metadataRecordClasst _bindRecordClasst _bindHomeIDAttributeNamet _bindResourceIDAttributeNameRR R| R� R2 R. RE R� R= R8 R� R R� R R� R` R R" R^ Rv Rt Rf Rk Rm R, R R4 R7 R4 R R R� R> R! R# t propertyR� R R# R> R% R? RB RC R� RF RJ RE R� R� R� Ra R� R� R� RQ R� RK RT R� RW R� RY R� RX RZ R[ R^ R_ Rb Rf Rh Rj Rl Ro Rm Rn Rp Rr R� R� R RG Rt R� R� R� R R R R� R� Rw RS R� R� R; Ry R� R� R� ( ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� � s� @E ( , ! 1 $: J ) t CommonObjectResourcec B s1 e Z d Z e � Z dK Z dL Z dL Z dL Z d Z d Z e e dL d � � � Z e e d � � � Z dL dL d � Z e d � � Z e e d � � � Z e e d � � � Z e e d � � � Z e e d � � � Z e e d � � � Z e d � � Z e e d � � � Z e e d � � � Z e d � � Z e d � � Z e d � � Z e e dL dL dL d � � � Z e e d � � � Z e e d � � � Z e e dL d � � � Z! e d � � Z" e d � � Z# e d � � Z$ e d � � Z% e d � � Z& e d � � Z' e d � � Z( d � Z) e e d � � � Z* e dL e+ d! � � Z, d" � Z- d# � Z. d$ � Z/ d% � Z0 e1 d& � � Z2 e1 d' � � Z3 d( � Z4 d) � Z5 d* � Z6 d+ � Z7 d, � Z8 d- � Z9 e d. � � Z: e e; dL d/ � � Z< e+ dL d0 � Z= d1 � Z> e d2 � � Z? e d3 � � Z@ e dL d4 � � ZA d5 � ZB d6 � ZC e d7 � � ZD e d8 � � ZE e d9 � � ZF e d: � � ZG e d; � � ZH e d< � � ZI e d= � � ZJ d> � ZK d? � ZL d@ � ZM dA � ZN dB � ZO dC � ZP dD � ZQ dE � ZR dF � ZS dG � ZT dH � ZU e dI � � ZV e dJ � � ZW RS(M s* Base class for object resources. R� R i i2 c c s� | j � r | j n | } | | | | j � j | j j � | | j � j | j j � � } x3 t | j � | � D] \ } } t | | | � qu Wt | j � | _ t | j � | _ | j | � Vt | � d S( s� Given the various database rows, build the actual class. @param parent: the parent collection object @type parent: L{CommonHomeChild} @param objectData: the standard set of object columns @type objectData: C{list} @param propstore: a property store to use, or C{None} to load it automatically @type propstore: L{PropertyStore} @return: the constructed child class @rtype: L{CommonHomeChild} N( R> R� t _allColumnsR� R� R� R� R� t _rowAttributesR� R R R R R ( R) R= t objectDataR R� RN R R. ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� � s ""c c s� d } | j } | r: | j j | j d | d | �V} nV | re | j j | j d | d | �V} n+ | r� | j j | j d | d | �V} n t | r� | d n d � d S( s� Given a set of identifying information, load the data rows for the object. Only one of L{name}, L{uid} or L{resourceID} is specified - others are C{None}. @param parent: the parent collection object @type parent: L{CommonHomeChild} @param name: the resource name @type name: C{str} @param uid: the UID of the data @type uid: C{str} @param resourceID: the resource ID @type resourceID: C{int} R% t parentIDR� R i N( Rb R t _allColumnsWithParentAndNameR� R� t _allColumnsWithParentAndUIDt _allColumnsWithParentAndIDR ( R) R= R% R� R R� R� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR � s$ c C sp | | _ | | _ | | _ | | _ d | _ d | _ d | _ d | _ d | _ d | _ d | _ t | _ d S( N( R R R� t _uidRb t _md5t _sizeR R t _dataversiont _textDatat _cachedComponentRt t _locked( R} R= R% R� R R� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� s c C s4 | j } t | j � d | d | j t d � k �S( NR� R$ R� ( R� R R� R� R ( R) RP ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt _allColumnsWithParentQuery% s c c s' t | j j | j d | j �V� d S( NR� ( R R� R� R� R ( R) R= ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt _allColumnsWithParent+ s c c s� g } | j | � V} | r� | j � r� t j | j � j � | j � j � | j j � | j | j j | j j | j � V} q� i } n xe | D]] } | | j � j | j j � } | j | d � } | j | | d | �V} | j | � q� Wt | � d S( s% Load all child objects and return a list of them. This must create the child classes and initialize them using "batched" SQL operations to keep this constant wrt the number of children. This is an optimization for Depth:1 operations on the collection. R N( R� Rp R' t forMultipleResourcesR� R� RQ R� R= R� R� R� R� R R� R� R= Rb R� R� R ( R) R= R� R& R* R� R R RN ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR^ 1 s& c c sg t | � } g } xD t | � rX | j | | | j � V} | j | � | | j } q Wt | � d S( s� Load all child objects with the specified names, doing so in batches (because we need to match using SQL "resource_name in (...)" where there might be a character length limit on the number of items in the set). N( t tupleR� t _loadAllObjectsWithNamest BATCH_LOAD_SIZEt extendR ( R) R= R� R� t result_batch( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyRS Y s c c sz | j } t | j g d | d | j t d � k �j | j d | j � �V} t t g | D] } | d ^ q\ � � d S( sK Query to load all object resource names for a home child. R� R$ R� i N( R� R R� R� R R� R� R R R8 ( R) R= RP R� R� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyRU j s c c sh | j } t t t � g d | d | j t d � k �j | j d | j � �V} t | d d � d S( NR� R$ R� i ( R� R R R R� R R� R� R R ( R) R= RP R� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyRV x s c C sX | j } t | j � d | d | j t d � k j | j j t d t | � � � � �S( NR� R$ R� R� ( R� R R� R� R R� R� R� R� ( R) R� RP ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt" _allColumnsWithParentAndNamesQuery� s c c s3 t | j | � j | j d | j d | �V� d S( NR� R� ( R R� R� R� R ( R) R= R� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt _allColumnsWithParentAndNames� s c c sR t | � d k rE | j | | d � V} t | r; | g n g � n g } | j | | � V} | r� | j � r� t j | j � j � | j � j � | j � j � | j t g | D] } | d ^ q� � � V} q� i } n xe | D]] } | | j � j | j j � } | j | d � } | j | | d | �V} | j | � q� Wt | � d S( s$ Load all child objects with the specified names. This must create the child classes and initialize them using "batched" SQL operations to keep this constant wrt the number of children. This is an optimization for Depth:1 operations on the collection. i i R N( R� Rf R R� Rp R' R$ R� R� RQ R= R� R� R� R� R� R� R= Rb R� R� ( R) R= R� RP R� R& R� R* R R RN ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� � s( * c C s | j | d | �S( NR% ( R, ( R) R= R% ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyRf � s c C s | j | d | �S( NR� ( R, ( R) R= R� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt objectWithUID� s c C s | j | d | �S( NR ( R, ( R) R= R ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyRk � s c c sM | j | | | | � V} | r? | j | | � V} t | � n t d � d S( s7 Create the object using one of the specified arguments as the key to load it. One and only one of the keyword arguments must be set. @param parent: parent collection @type parent: L{CommonHomeChild} @param name: name of the resource, or C{None} @type name: C{str} @param uid: resource data UID, or C{None} @type uid: C{str} @param resourceID: resource id @type resourceID: C{int} @return: the new object or C{None} if not found @rtype: C{CommonObjectResource} N( R R� R Rb ( R) R= R% R� R R� RN ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR, � s c c s� | j } t | j g d | d | j t d � k j | j t d � k � �j | j d | d | j � �V} t | r� | d d n d � d S( sm Query to retrieve the resource name for an object resource based on its UID column. R� R$ R� R� i R� N( R� R R� R� R R� R� R� R� R R ( R) R= R� RP R� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyRZ � s c c s� | j } t | j g d | d | j t d � k j | j t d � k � �j | j d | d | j � �V} t | r� | d d n d � d S( sm Query to retrieve the UID for an object resource based on its resource name column. R� R$ R% R� i R� N( R� R R� R� R R� R� R� R� R R ( R) R= R% RP R� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR[ � s c c s� | j | � V} | r% t | � � n | j d � rC t | � � n t | � d k rd t | � � n | j � ry | j n | } | | | d d d | �} | j | d t �V| j d t � Vt | � d S( NR� i� R� t insertingR ( R� RK Rp RJ R� R> R� Rb t setComponentRv R R ( R) R= R% R� R� RN R� R� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR4 s c C sF t | j � d | j d | t | � k j | j j t d � k � �S( s� DAL query for all columns where PARENT_RESOURCE_ID matches a parentID parameter and a given instance column matches a given parameter name. R� R$ R� ( R R� R� R R� R� ( R) t columnt paramName( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt _allColumnsWithParentAnd s c C s | j | j j d � S( NR% ( R� R� R� ( R) ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� & s c C s | j | j j d � S( NR� ( R� R� R� ( R) ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� * s c C s | j | j j d � S( NR ( R� R� R� ( R) ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� . s c C sC | j } | j | j | j | j t | j � | j | j | j g S( s� Full set of columns in the object table that need to be loaded to initialize the object resource state. ( R� R� R� R� t MD5R t TEXTR� R R0 ( R) RP ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� 2 s c C s d S( s� Object attributes used to store the column values from L{_allColumns}. This used to create a mapping when serializing the object for cross-pod requests. R R� R� R� R� R R R� ( R R� R� R� R� R R R� ( ( R) ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� D s c C s d S( sA Other object attributes used for serialization. t _componentChanged( R� ( ( R) ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt _otherSerializedAttributesU s c C s� t g t j | j � | j � � D]" } | d t | | d � f ^ q" � } | d rq | d j d � | d <n | d j d � | d <| d j d � | d <| S( s( Create a dictionary mapping key attributes so this object can be sent over a cross-pod call and reconstituted at the other end. Note that the other end may have a different schema so the attributes may not match exactly and will need to be processed accordingly. i RI Rf R R N( R t itertoolst chainR� R� R Rb R ( R} R R ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR! ^ s M c c s{ | j | g | j � D] } | j | d � ^ q � V} x1 | j � D]# } t | | | j | d � � qF Wt | � d S( s[ Given a mapping generated by L{serialize}, convert the values into an array of database like items that conforms to the ordering of L{_allColumns} so it can be fed into L{makeClass}. Note that there may be a schema mismatch with the external data, so treat missing items as C{None} and ignore extra items. i N( R� R� R= R� R� R ( R) R= R" R� RN R ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR# k s 9!c c s� | d k r� | j j � rs t j | j j � j � | j j � j � | j j � j � | j | j d | �V} q� t | j j � j � � } n | j | � | | _ d S( NR ( Rb R Rp R' R� R� R� RQ R= R� R t NonePropertyStoreRt R� ( R} R� R ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR z s c C s | j S( N( R� ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyRG � s c C s d S( s� A hook for subclasses to override in order to set up their property store after it's been created. @param props: the L{PropertyStore} from C{properties()}. N( ( R} R� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyRt � s c C s d | j j | j f S( Ns <%s: %s>( R� R� R ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR# � s c C s | j S( s� Retrieve the store identifier for this object resource. @return: store identifier. @rtype: C{int} ( R ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR � s c C s | j j S( N( R R� ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� � s c C s | j j S( N( R R� ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� � s c C s | j j S( N( R R� ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� � s c C s | j j � j � S( N( R� R R ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR � s c C s | j S( N( R ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt parentCollection� s c C s | j j � S( N( R RR ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyRR � s c C s | j j � S( N( R R� ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� � s c C s | j j � S( N( R RQ ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyRQ � s c C s4 t d | j d t d | d | j j t d � k � S( sU DAL statement to lock a L{CommonObjectResource} by its resource ID. R� Rv R� R$ R ( R R� Rv R� R ( R) t nowait( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt _selectForUpdateQuery� s c c sL | d k r | n | j } | j | � j | t d | j �Vt | _ d S( s� Attempt to obtain a row lock on the object resource. 'wait' determines whether the DB call will block on any existing lock held by someone else. Lock will remain until transaction is complete, or fail if resource is missing, or it is already locked and wait=False is used. Occasionally we need to lock via a separate transaction so we pass that in too. @param wait: whether or not to wait on someone else's lock @type wait: C{bool} @param txn: alternative transaction to use @type txn: L{CommonStoreTransaction} @raise: L{NoSuchObjectResourceError} if resource does not exist, other L{Exception} if already locked and NOWAIT is used. R N( Rb R� R� R� RL R Rv R� ( R} t waitR� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt lock� s $c C s t � d S( N( Rv ( R} R� R� R� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� � s c C s t � d S( N( Rv ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� � s c c s t | j � Vj � � d S( N( R R� t mainType( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt componentType� s c C s% t | j d | j j t d � k �S( sW DAL statement to delete a L{CommonObjectResource} by its resource ID. R$ R ( R R� R� R ( R) ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyRC � s c c sc | j | | � V| j j � rH | j � rH | j j | | | � Vn | j j | | | � Vd S( s Move object to another collection. @param destination: parent collection to move to @type destination: L{CommonHomeChild} @param name: new name in destination @type name: C{str} or C{None} to use existing name N( t moveValidationR R� Rl Ro ( R} t destinationR% ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt moveTo� s c C s t � d S( N( Rv ( R} R� R% ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� � s c C s< t j r. | j j � r! t � q8 | j � Sn | j � Sd S( s] If trash is enabled move the object to the trash, otherwise fully delete it N( R# RD R R` RP RE RF ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� s c c s� | j j | j t d | j �V| j � j � V| j j | � Vd | _ d | _ d | _ d | _ d | _ d | _ d | _ d | _ d | _ d S( s- Remove, bypassing the trash R N( RC R� R� RL R RG RH R Rb Rb R� R� R� R� R R R� R� ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyRF s c C sH | j } t i t d � | j 6t d � | j 6d | j t d � k �S( Nt originalCollectionRI R$ R ( R� R R t ORIGINAL_COLLECTIONR[ R� ( R) RP ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt _updateToTrashQuery% s &c C s< | j } t i d | j 6d | j 6d | j t d � k �S( NR$ R ( R� R Rb R� R[ R� R ( R) RP ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt _updateFromTrashQuery- s c C s: | j } t | j | j f d | d | j t d � k �S( NR� R$ R ( R� R R� R[ R� R ( R) RP ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt _selectTrashDataQuery5 s c c sM | j j | j d | j �Vd \ } } | j j j | � V} t | � d S( NR i ( R� R� R� R R R� Rl R ( R} t originalCollectionIDt _ignore_whenTrashedR� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� : s c c s� t t � � t j j | j � � d } | j j } | j j � j d t � V} | j | d | �V| | _ t j j � | _ | j j | j d | j d | j d | j �Vt | � d S( Ni R4 R% R� RI R ( Ru RZ t osR� t splitextR% R R R� Ry Rv R� t _original_collectionR� R� RN R� R� R� R ( R} RO R� R� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyRE D s ) &c c s[ | j � V} | j | � Vd | _ d | _ | j j | j d | j �Vt | j � d S( NR ( R� R� Rb R� RN R� R� R� R R R� ( R} R� ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� U s c C s( t | d d � d k p' t | d t � S( NR� RM ( R Rb Rt ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyRa a s c C s | j d k r d St | j � S( N( RN Rb R ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� d s c C s | j � S( s5 Delete this object, bypassing trash ( RF ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� i s c C s t j S( s Indicates what category to use when determining the priority of push notifications when this object is removed. @returns: The "default" category (but should be overridden to return values such as "inbox") @rtype: L{ChangeCategory} ( RS R� ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyRa o s c C s | j S( N( R� ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� z s c C s | j S( N( R� ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR% } s c C s t � � d S( N( Rv ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� � s c C s | j S( N( R� ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� � s c C s | j S( N( R� ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� � s c C s t | j � S( N( R$ R ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR � s c C s t | j � S( N( R$ R ( R} ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR � s c C s4 | j } t | j g d | d | j t d � k �S( sU DAL query to load iCalendar/vCard text via an object's resource ID. R� R$ R ( R� R R� R� R ( R) RP ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt _textByIDQuery� s c c su | j d k rd | j j | j d | j �V} | rX | d d } | | _ t | � qq t � � n t | j � d S( NR i ( R� Rb R� R� R� R R RA ( R} t textst text( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt _text� s ( R� R N(X R� R� R� R R� R| Rb R� R� t _componentClasst _currentDataVersionR� R� R R� R R� R R� R� R^ RS RU RV R� R� R� Rf R� Rk R, RZ R[ R4 R� R� R� R� R� R� R� R! R# Rt R RG Rt R# R R� R� R� R� R R� RR R� RQ R� Rv R� R� R� R� RC R� R� R� RF R� R� R� R� RE R� Ra R� R� Ra R� R% R� R� R� R R R� R� ( ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyR� � s� "'' * (� R� t __all__t cStringIOR t pycalendar.datetimeR t twext.enterprise.dal.parseschemaR t twext.enterprise.dal.syntaxR R R R R R R R R R R R R R R t twext.enterprise.ienterpriseR t twext.enterprise.jobs.queueR t twext.enterprise.utilR t twext.internet.decorateR t twext.python.clspropR t twext.python.logR t twisted.application.serviceR t twisted.internetR t twisted.internet.deferR R R t twisted.python.failureR t twisted.python.modulesR! t twisted.python.utilR" t twistedcaldav.configR# t twistedcaldav.dateopsR$ R% t txdav.base.datastore.utilR& t txdav.base.propertystore.noneR' R� t txdav.base.propertystore.sqlt txdav.caldav.icalendarstoreR( R) t txdav.carddav.iaddressbookstoreR* t txdav.common.datastore.commonR+ t& txdav.common.datastore.podding.conduitR, t- txdav.common.datastore.podding.migration.workR- t txdav.common.datastore.sql_apnR. t$ txdav.common.datastore.sql_directoryR/ R0 R1 t txdav.common.datastore.sql_dumpR2 t txdav.common.datastore.sql_imipR3 t' txdav.common.datastore.sql_notificationR4 t! txdav.common.datastore.sql_tablesR5 R6 R7 R8 R9 R: R; R< R= t txdav.common.datastore.sql_utilR> t" txdav.common.datastore.sql_sharingR? R@ t txdav.common.icommondatastoreRA RB RC RD RE RF RG RH RI RJ RK RL RM RN RO RP t txdav.common.idirectoryserviceRQ RR t txdav.idavRS t calendarserver.tools.utilRT RU RV t zope.interfaceRW RX t collectionsRY R� R� R� R� R� R� R� RZ R� t filePatht siblingRN t getContentt current_sql_schemaR� t objectR R� R� R R R� R� ( ( ( s- /opt/cpanel-ccs/txdav/common/datastore/sql.pyt <module> s� d @.F ' � /QH � � � �� � � � � �"� � � � �