OwlCyberSecurity - MANAGER
Edit File: purge.pyc
� �t�ac @ sa d d l m Z d d l Z d d l Z d d l m Z m Z d d l Z d d l Z d d l m Z d d l m Z m Z d d l m Z d d l m Z d d l m Z m Z m Z m Z m Z d d l m Z m Z d d l m Z d d l m Z m Z m Z d d l m! Z! d d l" m# Z# d d l$ m% Z% m& Z& d d l' m( Z( m) Z) d d l* m+ Z+ d d l, m- Z- m. Z. m/ Z/ e � Z0 d Z1 d Z2 d e e e- j3 � f d � � YZ4 d e e e- j5 � f d � � YZ6 d e e e- j7 � f d � � YZ8 d e e e- j9 � f d � � YZ: d e f d � � YZ; d e f d � � YZ< d e f d! � � YZ= d S(" i����( t print_functionN( t getoptt GetoptError( t tables( t utilityMaint WorkerService( t DateTime( t fromTable( t Deletet Selectt Uniont Parametert Max( t WorkItemt RegeneratingWorkItem( t Logger( t inlineCallbackst returnValuet succeed( t caldavxml( t config( t parseSQLDateToPyCalendart pyCalendarToSQLTimestamp( t Componentt InvalidICalendarDataError( t Filter( t schemat _HOME_STATUS_NORMALt _BIND_MODE_OWNid im t PrincipalPurgePollingWorkc B s; e Z d Z d Z e d � � Z d � Z e d � � Z RS( s� A work item that scans the existing set of provisioned homes in the store and creates a work item for each to be checked against the directory to see if they need purging. t principal_purge_pollingc s9 � f d � } t j j r+ | j d | � St d � Sd S( Nc s t j | � � S( N( R t reschedule( t txn( t seconds( s- /opt/cpanel-ccs/calendarserver/tools/purge.pyt _enqueueC s s) PrincipalPurgePollingWork.initialSchedule( R t AutomaticPurgingt Enabledt inTransactionR t None( t clst storeR! R" ( ( R! s- /opt/cpanel-ccs/calendarserver/tools/purge.pyt initialScheduleA s c C s t j j r t j j Sd S( sP Return the interval in seconds between regenerating instances. N( R R# R$ t PollingIntervalSecondsR& ( t self( ( s- /opt/cpanel-ccs/calendarserver/tools/purge.pyt regenerateIntervalK s c c s� t j j s t d � n t � } xi t j t j f D]U } xL t | j g d | d | j t k �j | j � VD] \ } | j | � qp Wq5 Wd } xZ | D]R } t j j � t j d t j j � } | d 7} | j j t d | d | �Vq� Wd S( Nt Fromt Wherei R! i t uidt notBefore( R R# R$ R R& t setR t CALENDAR_HOMEt ADDRESSBOOK_HOMER t OWNER_UIDt STATUSR t ont transactiont addt datetimet utcnowt timedeltat CheckStaggerSecondst enqueuet PrincipalPurgeCheckWork( R+ t allUIDst homeR/ R! R0 ( ( s- /opt/cpanel-ccs/calendarserver/tools/purge.pyt doWorkQ s( ( t __name__t __module__t __doc__t groupt classmethodR) R, R RA ( ( ( s- /opt/cpanel-ccs/calendarserver/tools/purge.pyR 5 s R> c B s, e Z d Z e d � � Z e d � � Z RS( s� Work item for checking for the existence of a UID in the directory. This work item is created by L{PrincipalPurgePollingWork} - one for each unique user UID to check. c C s | j j | j k S( N( t tablet UIDR/ ( R+ ( ( s- /opt/cpanel-ccs/calendarserver/tools/purge.pyt <lambda>} t c c s t d | j d | j � j | j � Vt j j s? t d � n t j d d | j �| j j � j � } | j | j � V} | d k r� t j j � t j d t j j � } t j d d | j d | �| j j t d | j d | �Vn t j d d | j �d S( NR- R. s, Checking for existence of {uid} in directoryR/ R! sL Principal {uid} is no longer in the directory; scheduling clean-up at {when}t whenR0 s {uid} is still in the directory( R RG RE R6 R7 R R# R$ R R& t logt debugR/ R( t directoryServicet recordWithUIDR9 R: R; t PurgeIntervalSecondst warnR= t PrincipalPurgeWork( R+ t directoryt recordR0 ( ( s- /opt/cpanel-ccs/calendarserver/tools/purge.pyRA s( ( RB RC RD t propertyRE R RA ( ( ( s- /opt/cpanel-ccs/calendarserver/tools/purge.pyR> s s RR c B s, e Z d Z e d � � Z e d � � Z RS( s, Work item for purging a UID's data c C s | j j | j k S( N( RG RH R/ ( R+ ( ( s- /opt/cpanel-ccs/calendarserver/tools/purge.pyRI � RJ c c s t d | j d | j � j | j � Vt j j s? t d � n t j d d | j �| j j � j � } | j | j � V} | d k r� t | j j � � } t j d d | j �| j | j j � | | j g d t d d �Vn t j d d | j �d S( NR- R. s" One last existence check for {uid}R/ sS Cleaning up future events for principal {uid} since they are no longer in directoryt proxiesRK s& {uid} has re-appeared in the directory( R RG RE R6 R7 R R# R$ R R& RL RM R/ R( RN RO t PurgePrincipalServiceRQ t purgeUIDst True( R+ RS RT t service( ( s- /opt/cpanel-ccs/calendarserver/tools/purge.pyRA � s* ( RB RC RD RU RE R RA ( ( ( s- /opt/cpanel-ccs/calendarserver/tools/purge.pyRR � s t PrincipalPurgeHomeWorkc B s, e Z d Z e d � � Z e d � � Z RS( s- Work item for removing a UID's home c C s | j j | j k S( N( RG t HOME_RESOURCE_IDt homeResourceID( R+ ( ( s- /opt/cpanel-ccs/calendarserver/tools/purge.pyRI � RJ c c sf t d | j d | j � j | j � Vt j } t j } t j } t | j g d | d | j | j k d t t | j g d | d | j | j k d t t | j g d | d | j | j k �� �� �j | j � V} | r2t | � r2t j j � t j d t j j � } | j j t d | j d | �Vn0 | j j | j � V} | j � rb| j � Vn d S( NR- R. t SetExpressionR! R] R0 ( R RG RE R6 R7 R t SCHEDULE_ORGANIZER_WORKt SCHEDULE_ORGANIZER_SEND_WORKt SCHEDULE_REPLY_WORKR R\ R] R t lenR9 R: R; R R# t HomePurgeDelaySecondsR= R[ t calendarHomeWithResourceIDt purgingt remove( R+ t sowt soswt srwt rowsR0 R@ ( ( s- /opt/cpanel-ccs/calendarserver/tools/purge.pyRA � s@ ! ( RB RC RD RU RE R RA ( ( ( s- /opt/cpanel-ccs/calendarserver/tools/purge.pyR[ � s t PurgeOldEventsServicec B s� e Z d Z d Z d Z e Z e Z e d d � � Z e d � � Z e e e e d � � � Z e d � � Z e d � � Z e j d d � Z e d � � Z e d � � Z d � Z e d � � Z e d � � Z e d � � Z RS( c C s� t j j t j d � } t d | f � t d � t d � t d � t d � t d � t d � t d � t d t f � t d � t d � t d � t d � | r� t j j d | f � t j d � n t j d � d S( Ni s usage: %s [options]RJ s, Remove old events from the calendar servers options:s% -h --help: print this help and exits> -f --config <path>: Specify caldavd.plist configuration paths8 -u --uuid <uuid>: Only process this user(s) [REQUIRED]sN -d --days <number>: specify how many days in the past to retain (default=%d)sI -n --dry-run: calculate how many events to purge, but do not purge datas* -v --verbose: print progress informations -D --debug: debug loggings %s i@ ( t ost patht basenamet syst argvt printt DEFAULT_RETAIN_DAYSt stderrt writet exit( R' t et name( ( s- /opt/cpanel-ccs/calendarserver/tools/purge.pyt usage s$ c C s� y; t t j d d d d d d d d d d g � \ } } Wn t k r] } | j | � n Xd } d } t } t } t } t } t } xH| D]@\ } } | d k r� | j � q� | d k ry t | � } Wq�t k r} t d | f � | j | � q�Xq� | d! k rZy t | � } Wq�t k rV} t d | f � | j | � q�Xq� | d" k rot } q� | d# k r�t } q� | d$ k r�t } q� | d% k r�| } q� | d& k r�| } q� t | � � q� W| r�| j d | f � n | d k r | j d � n | | _ | r$t } n t j � } | j t � | j | � | | _ | | _ | | _ | | _ t | | d | �d S(' Ni s Dd:b:f:hnu:vs days=s batch=s dry-runs config=s uuid=t helpt verboseRM s -hs --helps -ds --dayss Invalid value for --days: %ss -bs --batchs Invalid value for --batch: %ss -vs --verboses -Ds --debugs -ns --dry-runs -fs --configs -us --uuids Too many arguments: %ss uuid must be specified( s -hs --help( s -ds --days( s -bs --batch( s -vs --verbose( s -Ds --debug( s -ns --dry-run( s -fs --config( s -us --uuid( R Ro Rp R Rx R& Rr t DEFAULT_BATCH_SIZEt Falset intt ValueErrorRq RY t NotImplementedErrort uuidR t getTodayt setDateOnlyt offsetDayt cutofft batchSizet dryrunRM R ( R' t optargst argsRv t configFileNameR� t daysR� R� Rz RM t optt argR� ( ( s- /opt/cpanel-ccs/calendarserver/tools/purge.pyt main1 s� c c sT | | � } | | _ | | _ | | _ | | _ | | _ | j � V} t | � d S( N( R� R� R� R� RM RA R ( R' R( R� R� R� RM R� RZ t result( ( s- /opt/cpanel-ccs/calendarserver/tools/purge.pyt purgeOldEvents� s c c s� t j d d | j �| j j d d � } t j } | j r� i | j d 6} t | j | j g d | d | j j t d � � �j | | � V} n( t | j | j g d | �j | � V} | j � Vt j d d t | � �t t | d d � �� d S( sO Find all the calendar homes that match the uuid cli argument. s. Searching for calendar homes matching: '{uid}'R/ t labels Find matching homesR� R- R. s Found {len} calendar homesRb t keyc S s | d S( Ni ( ( t x( ( s- /opt/cpanel-ccs/calendarserver/tools/purge.pyRI � RJ N( RL RM R� R( t newTransactionR R2 R t RESOURCE_IDR4 t StartsWithR R6 t commitRb R t sorted( R+ R t cht kwdsRj ( ( s- /opt/cpanel-ccs/calendarserver/tools/purge.pyt getMatchingHomeUIDs� s" c c s� t j d d | d | �| j j d d � } t j } i | d 6} t | j | j g d | d | j t d � k j | j t k � �j | | � V} | j � Vt j d d t | � �t | � d S( s Find all the owned calendars for the specified calendar home. @param home_id: resource-id of calendar home to check @type home_id: L{int} @param owner_uid: owner UUID of home to check @type owner_uid: L{str} s$ Checking calendar home: {id} '{uid}'t idR/ R� s Find matching calendarst home_idR- R. s Found {len} calendarsRb N( RL RM R( R� R t CALENDAR_BINDR t CALENDAR_RESOURCE_IDt CALENDAR_RESOURCE_NAMEt CALENDAR_HOME_RESOURCE_IDR t Andt BIND_MODER R6 R� Rb R ( R+ R� t owner_uidR t cbR� Rj ( ( s- /opt/cpanel-ccs/calendarserver/tools/purge.pyt getMatchingCalendarIDs� s t PurgeEventR@ t calendart resourcec c s� t j d d | d | �t � } | j j d d � } t j } t j } i | d 6} t | j | j | j t | j � g d | j | d | j | j k �d | j t d � k j | j d k � d | j | j | j f d | j d k j t | j � t | j � k � j | j d k j | j t | j � k � � �j | | � V} t j d d t | � �x%| D] \ } } } } | r�t | � n d } | r�t | � n d } | r�t | � n d } | d k s�| | j k r7| d k r | | j k rj| j | j | | | � � qjqjq7| | j k r7qjq7n | j | | � V} | d k rj| j | � r�| j | j | | | � � q�qjqjW| j � Vt j d d t | � �t | � d S( s� For the given calendar find which calendar objects are older than the cut-off and return the resource-ids of those. @param home_id: resource-id of calendar home @type home_id: L{int} @param calendar_id: resource-id of the calendar to check @type calendar_id: L{int} @param calendar_name: name of the calendar to check @type calendar_name: L{str} s" Checking calendar: {id} '{name}'R� Rw R� s Find matching resourcest calendar_idR- R6 R. t VEVENTt GroupByt Havings" Found {len} resources to checkRb s" Found {len} resources to purgeN(! RL RM R1 R( R� R t CALENDAR_OBJECTt TIME_RANGER R� t RECURRANCE_MAXt RECURRANCE_MINR t END_DATEt joint CALENDAR_OBJECT_RESOURCE_IDR� R R� t ICALENDAR_TYPER& R R� t OrR6 Rb R R8 R� t getCalendart checkLastInstanceR� R ( R+ R� R� t calendar_namet purgeR t cot trR� Rj t resource_idt recurrence_maxt recurrence_mint max_end_dateR� ( ( s- /opt/cpanel-ccs/calendarserver/tools/purge.pyt getResourceIDsToPurge� sD $!00 & c c s� t j } i | d 6} t | j g d | d | j t d � k �j | | � V} y' | rp t j | d d � n d } Wn t k r� t d � n Xt | � d S( s� Get the calendar data for a calendar object resource. @param resid: resource-id of the calendar object resource to load @type resid: L{int} t ResourceIDR- R. i N( R R� R t ICALENDAR_TEXTR� R R6 R t fromStringR& R R ( R+ R t residR� R� Rj t caldata( ( s- /opt/cpanel-ccs/calendarserver/tools/purge.pyR� s ' c C s2 | j � } | j � s% | d k rq x| j � D]4 } | j � d k r2 | j � | j k rf t Sq2 q2 Wt Sn� | j � r� t SxB | j � D]4 } | j � d k r� | j � | j k r� t Sq� q� Wt | j d � � } t | � r.| d j � j � r| d j � j � | j k S| j | j � Sn t S( s Determine the last instance of a calendar event. Try a "static" analysis of the data first, and only if needed, do an instance expansion. @param calendar: the calendar object to examine @type calendar: L{Component} R� t RRULEi N( t masterComponentt isRecurringR& t subcomponentsRw t getEndDateUTCR� R| RY t isRecurringUnboundedt tuplet propertiesRb t valuet getUseUntilt getUntilt hasInstancesAfter( R+ R� t mastert compt rrules( ( s- /opt/cpanel-ccs/calendarserver/tools/purge.pyR� $ s& c c s^ t � } | j | | � V} x1 | D]) \ } } | j | j | | | � V� q# Wt | � d S( s) Find all the resource-ids of calendar object resources that need to be purged in the specified home. @param home_id: resource-id of calendar home to check @type home_id: L{int} @param owner_uid: owner UUID of home to check @type owner_uid: L{str} N( R1 R� t updateR� R ( R+ R� R� R� t calendarsR� R� ( ( s- /opt/cpanel-ccs/calendarserver/tools/purge.pyt getResourcesToPurgeL s !c c s< | j j d d � } d } d } d } x� | D]� } | j | k rb | j | j � V} | j } n | j | k r� | j | j � V} | j } n | j | j � V} | j d t � Vt j d d | j � d | j � d | j � j � d | j � j � d | j � j � j � �| d 7} q. W| j � Vt | � d S( sY Remove up to batchSize events and return how many were removed. R� s Remove old eventsi t implicitlysU Removed resource {id} '{name}' from calendar {pid} '{pname}' of calendar home '{uid}'R� Rw t pidt pnameR/ i N( R( R� R& R@ Rd R� t childWithIDt objectResourceWithIDR� R� R| RL RM R� Rw t parentCollectiont ownerHomeR/ R� R ( R+ t eventsR t countt last_homet last_calendart eventR@ R� R� ( ( s- /opt/cpanel-ccs/calendarserver/tools/purge.pyt purgeResources^ s. c c sU | j r d t j t <n d t j t <t j � | j � V} | s] t j d � t d � n | j rv t j d � n t j d � t � } | j � V} x. | D]& \ } } | j | j | | � V� q� W| j rRt | � } | d k rt j d d | j �nA | d k r)t j d d | j �n t j d d | d | j �t | � n t | � } | j � t | � } t j d d t | � d | j �d } d } xW | r�| j | | j � V} | r�| | 7} t j d d | d | �| | } q�q�W| d k rt j d � n/ | d k r4t j d � n t j d d | �t | � d S( NRM t infos No homes to processi s Purge dry run onlys Searching for old events...s! No events are older than {cutoff}R� i s 1 event is older than {cutoff}s& {count} events are older than {cutoff}R� s, Removing {len} events older than {cutoff}...Rb i����s( Removed {removed} of {total} events...t removedt totals No events were removeds 1 event was removed in totals$ {total} events were removed in total( RM R t LogLevelsRB R� R� RL R� R R� R1 R� Rb R� t listt sortR� R� ( R+ t homesR� R� R� t eventCountt totalEventst numEventsRemovedt totalRemoved( ( s- /opt/cpanel-ccs/calendarserver/tools/purge.pyRA ~ sR " N( R@ R� R� ( RB RC R& R� R� R� R| R� RM RF Rx R� R R� R� R� t collectionst namedtupleR� R� R� R� R� R� RA ( ( ( s- /opt/cpanel-ccs/calendarserver/tools/purge.pyRk s( Z @ ( t PurgeAttachmentsServicec B s� e Z d Z d Z d Z e Z e Z e d d � � Z e d � � Z e e d � � � Z e d � � Z e d � � Z e d � � Z e d � � Z d � Z e d � � Z e d � � Z e d � � Z RS( c C s� t j j t j d � } t d | f � t d � t d � t d � t d � t d � t d � t d � t d t f � t d � t d � t d � t d � | r� t j j d | f � t j d � n t j d � d S( Ni s usage: %s [options]RJ s= Remove old or orphaned attachments from the calendar servers options:s% -h --help: print this help and exits> -f --config <path>: Specify caldavd.plist configuration paths3 -u --uuid <owner uid>: target a specific user UIDsw -d --days <number>: specify how many days in the past to retain (default=%d) zero means no removal of old attachmentssN -n --dry-run: calculate how many attachments to purge, but do not purge datas* -v --verbose: print progress informations -D --debug: debug loggings %s i@ ( Rl Rm Rn Ro Rp Rq Rr Rs Rt Ru ( R' Rv Rw ( ( s- /opt/cpanel-ccs/calendarserver/tools/purge.pyRx � s$ c C s� y; t t j d d d d d d d d d d g � \ } } Wn t k r] } | j | � n Xd } d } t } t } t } t } t } xH| D]@\ } } | d k r� | j � q� | d k r� | } q� | d! k r y t | � } Wq�t k r} t d | f � | j | � q�Xq� | d" k roy t | � } Wq�t k rk} t d | f � | j | � q�Xq� | d# k r�t } q� | d$ k r�t } q� | d% k r�t } q� | d& k r�| } q� t | � � q� W| r�| j d | f � n | r�t } n | | _ | d k rGt j � } | j t � | j | � | | _ n d | _ | | _ | | _ | | _ t | | d | �d S(' Ni s Dd:b:f:hnu:vs uuid=s days=s batch=s dry-runs config=Ry Rz RM s -hs --helps -us --uuids -ds --dayss Invalid value for --days: %ss -bs --batchs Invalid value for --batch: %ss -vs --verboses -Ds --debugs -ns --dry-runs -fs --configs Too many arguments: %si ( s -hs --help( s -us --uuid( s -ds --days( s -bs --batch( s -vs --verbose( s -Ds --debug( s -ns --dry-run( s -fs --config( R Ro Rp R Rx R& Rr R{ R| R} R~ Rq RY R R� R R� R� R� R� R� R� Rz R ( R' R� R� Rv R� R� R� R� R� Rz RM R� R� R� ( ( s- /opt/cpanel-ccs/calendarserver/tools/purge.pyR� � s� c c s� | | � } | | _ | d k rT t j � } | j t � | j | � | | _ n d | _ | | _ | | _ | | _ | j � V} t | � d S( Ni ( R� R R� R� R| R� R� R& R� R� Rz RA R ( R' R( R� R� t limitR� Rz RZ R� R� ( ( s- /opt/cpanel-ccs/calendarserver/tools/purge.pyt purgeAttachments5 s c c s� | j rj | j � V} | j d k rB | j � V} | j � V} n d } d } t | j | | | � � nK | j � V} | j d k r� | | j � V7} | | j � V7} n t | � d S( N( ( ( R� t _orphansDryRunR� R& t _dropboxDryRunt _managedDryRunR t _dryRunSummaryt _orphansPurget _dropboxPurget _managedPurge( R+ t orphanst dropboxt managedR� ( ( s- /opt/cpanel-ccs/calendarserver/tools/purge.pyRA H s c c sL | j r t d � n | j j d d � } | j | j � V} t | � d S( Ns/ (Dry run) Searching for orphaned attachments...R� s Find orphaned attachments( Rz Rq R( R� t orphanedAttachmentsR� R ( R+ R R� ( ( s- /opt/cpanel-ccs/calendarserver/tools/purge.pyR� \ s c c s] | j r t d � n | j j d d � } | j | j | j � V} | j � Vt | � d S( Ns2 (Dry run) Searching for old dropbox attachments...R� s Find old dropbox attachments( Rz Rq R( R� t oldDropboxAttachmentsR� R� R� R ( R+ R t cutoffs( ( s- /opt/cpanel-ccs/calendarserver/tools/purge.pyR� e s c c s] | j r t d � n | j j d d � } | j | j | j � V} | j � Vt | � d S( Ns2 (Dry run) Searching for old managed attachments...R� s Find old managed attachments( Rz Rq R( R� t oldManagedAttachmentsR� R� R� R ( R+ R R ( ( s- /opt/cpanel-ccs/calendarserver/tools/purge.pyR� p s c C sA | j r�i } t j d d d d d d d d g � } xQ | D]I \ } } } } | d | d | d | d d d d d d d d � | | <q= Wx� | D]x \ } } } } | | k r� | | j d | d | � | | <q� | d | d d d d d | d | d d d d � | | <q� Wx� | D]x \ } } } } | | k rU| | j d | d | � | | <q| d | d d d d d d d d d | d | � | | <qWt j � } | j d � | j t j j d t j j j � t j j d t j j j � t j j d t j j j � t j j d t j j j � t j j d t j j j � t j j d t j j j � t j j d t j j j � t j j d t j j j � t j j d t j j j � t j j d t j j j � f � d g d } x� t | j � d d � �D]� \ } } | j | j | j | j | j | j | j | j | j | j | j | j f } | j | | j f | � x* t | � D] \ } } | | c | 7<qrWq�W| j d t | � � | d } t d � t d � | j � ne t g | D] } | d ^ q�� t g | D] } | d ^ q� t g | D] } | d ^ q#� } | S(! Nt ByUserDatat quotat orphanSizet orphanCountt dropboxSizet dropboxCountt managedSizet managedCounti t Users Current Quotas Orphan Sizes Orphan Counts Dropbox Sizes Dropbox Counts Managed Sizes Managed Counts Total Sizes Total Counts %ss %di R� c S s | d S( Ni ( ( R� ( ( s- /opt/cpanel-ccs/calendarserver/tools/purge.pyRI � RJ s Total:RJ i s s" Orphaned/Old Attachments by User: i ( R s Current Quotas Orphan Sizes Orphan Counts Dropbox Sizes Dropbox Counts Managed Sizes Managed Counts Total Sizes Total Count( s Total:RJ ( Rz R� R� t _replaceR t Tablet addHeadert setDefaultColumnFormatst ColumnFormatt LEFT_JUSTIFYt RIGHT_JUSTIFYR� t itemsR R R R R R t addRowR t enumeratet addFooterR� Rq t printTablet sum( R+ R� R� R� t byuserR t userR t sizeR� RG t totalst datat colst ctrR� R� R� ( ( s- /opt/cpanel-ccs/calendarserver/tools/purge.pyR� { s` ; #; #; " ( ec c s | j r t d � n d } d } x� | r� | j j d d � } | j | j d | j �V} | j � V| r� | | 7} | j r� t d | f � q� q% | j r% t d � q% q% W| j r | d k r� t d � n* | d k r� t d � n t d | f � t d � n t | � d S( Ns Removing orphaned attachments...i����i R� s Remove orphaned attachmentsR� s %d,RJ s$ No orphaned attachments were removedi s* 1 orphaned attachment was removed in totals- %d orphaned attachments were removed in total( Rz Rq R( R� t removeOrphanedAttachmentsR� R� R� R ( R+ t numOrphansRemovedR� R ( ( s- /opt/cpanel-ccs/calendarserver/tools/purge.pyR� � s, c c s | j r t d � n d } d } x� | r� | j j d d � } | j | j | j d | j �V} | j � V| r� | | 7} | j r� t d | f � q� q% | j r% t d � q% q% W| j r| d k r� t d � n* | d k r� t d � n t d | f � t d � n t | � d S( Ns# Removing old dropbox attachments...i����i R� s Remove old dropbox attachmentsR� s %d,RJ s' No old dropbox attachments were removedi s- 1 old dropbox attachment was removed in totals0 %d old dropbox attachments were removed in total( Rz Rq R( R� t removeOldDropboxAttachmentsR� R� R� R� R ( R+ t numOldRemovedR� R ( ( s- /opt/cpanel-ccs/calendarserver/tools/purge.pyR� � s, " c c s | j r t d � n d } d } x� | r� | j j d d � } | j | j | j d | j �V} | j � V| r� | | 7} | j r� t d | f � q� q% | j r% t d � q% q% W| j r| d k r� t d � n* | d k r� t d � n t d | f � t d � n t | � d S( Ns# Removing old managed attachments...i����i R� s Remove old managed attachmentsR� s %d,RJ s' No old managed attachments were removedi s- 1 old managed attachment was removed in totals0 %d old managed attachments were removed in total( Rz Rq R( R� t removeOldManagedAttachmentsR� R� R� R� R ( R+ R# R� R ( ( s- /opt/cpanel-ccs/calendarserver/tools/purge.pyR� � s, " N( RB RC R& R� R� R� R| R� Rz RF Rx R� R R� RA R� R� R� R� R� R� R� ( ( ( s- /opt/cpanel-ccs/calendarserver/tools/purge.pyR� � s$ Z ? RW c B s� e Z d Z d Z d Z e Z e Z e Z d Z e d d � � Z e d � � Z e e e e e d d � � � Z e d � � Z e d � � Z e d � � Z e d � � Z e d � � Z e d � � Z e d � � Z RS( c C s� t j j t j d � } t d | f � t d � t d � t d � t d � t d � t d � t d � t d � t d � t d � t d � | r� t j j d | f � t j d � n t j d � d S( Ni s usage: %s [options]RJ sC Remove a principal's events and contacts from the calendar servers) Future events are declined or cancelleds options:s% -h --help: print this help and exits> -f --config <path>: Specify caldavd.plist configuration pathsV -n --dry-run: calculate how many events and contacts to purge, but do not purge datas* -v --verbose: print progress informations -D --debug: debug loggings %s i@ ( Rl Rm Rn Ro Rp Rq Rs Rt Ru ( R' Rv Rw ( ( s- /opt/cpanel-ccs/calendarserver/tools/purge.pyRx s" c C s/ y2 t t j d d d d d d d g � \ } } Wn t k rT } | j | � n Xd } t } t } t } x� | D]� \ } } | d k r� | j � qt | d k r� t } qt | d k r� t } qt | d k r� t } qt | d k r� | } qt t | � � qt W| | _ | | _ | | _ t | | d | �d S( Ni s Df:hnvs dry-runs config=Ry Rz RM s -hs --helps -vs --verboses -Ds --debugs -ns --dry-runs -fs --config( s -hs --help( s -vs --verbose( s -Ds --debug( s -ns --dry-run( s -fs --config( R Ro Rp R Rx R& R| RY R t uidsR� Rz R ( R' R� R� Rv R� R� Rz RM R� R� ( ( s- /opt/cpanel-ccs/calendarserver/tools/purge.pyR� 6 sB c c s] | | � } | | _ | | _ | | _ | | _ | | _ | | _ | j � V} t | � d S( N( RS R% Rz R� RV RK RA R ( R' R( RS R% Rz R� RV RK RZ R� ( ( s- /opt/cpanel-ccs/calendarserver/tools/purge.pyRX l s c c s� | j d k r$ | j j � | _ n d } x+ | j D] } | j | � V} | | 7} q4 W| j r� d | | d k ry d n d f } | j r� t d | f � q� t d | f � n t | � d S( Ni s %d event%si t sRJ s! Would have modified or deleted %ss Modified or deleted %s( RS R& R( RN R% t _purgeUIDRz R� Rq R ( R+ R� R/ R� t amount( ( s- /opt/cpanel-ccs/calendarserver/tools/purge.pyRA { s " c c s* | j d k r! t j � | _ n t d j | � d j | � f � } | j j � } | j | � V} | d k } | r� | j | | � Vn | j � Vd } | r� | j | | | � V} n | j | � V| | j | � V7} | j r | j r | j rt d � n | j | j | � Vn t | � d S( Ns urn:uuid:{}s urn:x-uid:{}i s Deleting any proxy assignments( RK R& R t getNowUTCR1 t formatR( R� t calendarHomeWithUIDt _cleanHomeR� t _cancelEventst _removeCalendarHomet _removeAddressbookHomeRV R� Rz Rq t _purgeProxyAssignmentsR ( R+ R/ t cuasR t storeCalHomet calHomeProvisionedR� ( ( s- /opt/cpanel-ccs/calendarserver/tools/purge.pyR' � s* c c s� t | j � V� } xk | D]c } | j rf | j rL t d | j � f � qf t d | j � f � n | j s | j � Vq q W| j s� | j � V| j | j � � V} | d k r� | j � Vq� n d S( Ns Would unshare: %ss Unsharing: %s( R� t childrenRz R� Rq Rw t unsharet removeUnacceptedSharest notificationsWithUIDR/ R& R� ( R+ R R2 R4 t childt notificationHome( ( s- /opt/cpanel-ccs/calendarserver/tools/purge.pyR, � s c c s] | j j � } t j t j t j t j d | � d d �d d �� } t | � } d } | j j � } | j | � V} | j � V} | j � Vx�| D]�} | j j d | � } | j | � V} | j | � V} g } t � } | j � rGx" | j � VD] } | j | � q� Wx1 | j | � VD] \ } } } | j | � q$Wn | j � Vx�| D]�} | j j d | � } | j | � V} | j | � V} | | k } y�| j | � V} d | j � | j � | f } | j } | j r3| j rt d | r�d n d | f � q3t d | r"d n d | f � n | j st } y | j d | � Vt } Wn3 t k r�} t d | t | � f � t } n X| r| rt d | f � y | j d t � Vt } Wq�t k r�} t d | t | � f � q�Xqn | r| d 7} n | j � VWqYt k rF} | j � V| � qYXqYWq� Wt | � d S( Nt startRw R� t VCALENDARi t authz_uids /calendars/__uids__/%s/%s/%ss Would delete%s: %ss with schedulingRJ s Deleting%s: %sR� s Exception deleting %s: %ss2 Retrying deletion of %s with scheduling turned offs< Still couldn't delete %s even with scheduling turned off: %si ( R� ( RK t getTextR R t ComponentFiltert TimeRangeR( R� R+ t listCalendarsR� t calendarWithNameR1 t ownedt listCalendarObjectst appendt searchR8 t calendarObjectWithNameR/ Rw R� Rz Rq R| R� RY t Exceptiont strt abortR ( R+ R R/ R1 t whenStringt query_filterR� R2 t calendarNamest calendarNameR� t allChildNamest futureChildNamest childNamet _ignore_childUidt _ignore_childTypet doSchedulingt childResourcet urit incrementCountt retryRv ( ( s- /opt/cpanel-ccs/calendarserver/tools/purge.pyR- � sx ## $ c c s� y�| j j d | � } | j | � V} | d k r�t | j � V� } | j t | j d t � V� � t | � } x� | D]� } t t | j � V� � d k rz | d 8} | j � } | j r� | j r� t d | f � q� t d | f � n | j s,| j � r| j | d t �Vq)| j � Vq,qz qz W| s�| j rb| j rUt d � qbt d � n | j s�t j j � t j d t j j � } | j t d | j � d | �V| j � Vq�q�n | j � VWn$ t k r�} | j � V| � n Xd S( NR< t onlyInTrashi i s Would delete calendar: %ss Deleting calendar: %st useTrashs Would delete calendar homes Deleting calendar homeR! R] R0 ( R( R� R+ R& R� R� t extendRY Rb t calendarObjectsRw Rz R� Rq RB t removeChildWithNameR| R5 R9 R: R; R R# Rc R= R[ R� R� R� RG RI ( R+ R/ R R2 R� t remainingCalendarst calCollRM R0 Rv ( ( s- /opt/cpanel-ccs/calendarserver/tools/purge.pyR. ' sH c c s� d } | j j d | � } y�| j | � V} | d k r�x9t | j � V� D]$} x� t | j � V� D]� } | j � } | j r� d | | j � | f } | j r� t d | f � q� t d | f � n | j s� | j � Vn | d 7} qh W| j � } | j r8| j r$t d | f � q8t d | f � n | j sN | j � rd| j | d t �Vqr| j � VqN qN W| j r�| j r�t d � q�t d � n | j s�| j � Vq�n | j � VWn$ t k r�} | j � V| � n Xt | � d S( Ni R< s /addressbooks/__uids__/%s/%s/%ss Would delete: %ss Deleting: %si s Would delete addressbook: %ss Deleting addressbook: %sRY s Would delete addressbook homes Deleting addressbook home( R( R� t addressbookHomeWithUIDR& R� t addressbookst addressbookObjectsRw Rz R� Rq Rf RB R\ R| R5 R� RG RI R ( R+ R/ R� R t storeAbHomet abCollt cardt cardNameRU t abNameRv ( ( s- /opt/cpanel-ccs/calendarserver/tools/purge.pyR/ b sH c c sT | j � } x6 t t f D]( } | j | | � V| j | | � Vq W| j � Vd S( N( R� RY R| t removeDelegatest removeDelegateGroupsR� ( R+ R( R/ R t readWrite( ( s- /opt/cpanel-ccs/calendarserver/tools/purge.pyR0 � s N( RB RC R& t rootRS R% R| R� Rz RY RV RK RF Rx R� R RX RA R' R, R- R. R/ R0 ( ( ( s- /opt/cpanel-ccs/calendarserver/tools/purge.pyRW s* 6 )Z;5(> t __future__R R� R9 R R Rl Ro t calendarserver.toolsR t calendarserver.tools.cmdlineR R t pycalendar.datetimeR t twext.enterprise.dal.recordR t twext.enterprise.dal.syntaxR R R R R t twext.enterprise.jobs.workitemR R t twext.python.logR t twisted.internet.deferR R R t twistedcaldavR t twistedcaldav.configR t twistedcaldav.dateopsR R t twistedcaldav.icalR R t# txdav.caldav.datastore.query.filterR t! txdav.common.datastore.sql_tablesR R R RL R{ Rr t PRINCIPAL_PURGE_POLLING_WORKR t PRINCIPAL_PURGE_CHECK_WORKR> t PRINCIPAL_PURGE_WORKRR t PRINCIPAL_PURGE_HOME_WORKR[ Rk R� RW ( ( ( s- /opt/cpanel-ccs/calendarserver/tools/purge.pyt <module> sN ( < . , >� �� \