OwlCyberSecurity - MANAGER
Edit File: records.cpython-38.pyc
U �p�]y � @ sZ d Z ddlmZmZmZ ddlZddlZddlZddlm Z m Z ddl m Z ddl mZ ddlmZmZmZmZmZmZ dd lmZ dd lmZ d d d gZe j Z ddddddddddddddd�Z ej Z G dd� de e �Z dd� Z!ed�G dd � d e"��Z#G dd � d ej$�Z%G dd � d e �Z&d*d d �Z'd+d d �Z(d,d!d"�Z)d#d$� Z*d-d%d&�Z+d.d(d)�Z,dS )/a� Record Arrays ============= Record arrays expose the fields of structured arrays as properties. Most commonly, ndarrays contain elements of a single type, e.g. floats, integers, bools etc. However, it is possible for elements to be combinations of these using structured types, such as:: >>> a = np.array([(1, 2.0), (1, 2.0)], dtype=[('x', np.int64), ('y', np.float64)]) >>> a array([(1, 2.), (1, 2.)], dtype=[('x', '<i8'), ('y', '<f8')]) Here, each element consists of two fields: x (and int), and y (a float). This is known as a structured array. The different fields are analogous to columns in a spread-sheet. The different fields can be accessed as one would a dictionary:: >>> a['x'] array([1, 1]) >>> a['y'] array([2., 2.]) Record arrays allow us to access fields as properties:: >>> ar = np.rec.array(a) >>> ar.x array([1, 1]) >>> ar.y array([2., 2.]) � )�division�absolute_import�print_functionN)�Counter� OrderedDict� )�numeric)� numerictypes)� isfileobj�bytes�long�unicode� os_fspath�contextlib_nullcontext)� set_module)�get_printoptions�record�recarray� format_parser�>�<�=�s�|)�b�l�n�B�L�N�Sr r r r r �I�ic @ s e Zd ZdZdd� Zdd� ZdS )�_OrderedCounterz?Counter that remembers the order elements are first encounteredc C s d| j jt| �f S )Nz%s(%r))� __class__�__name__r ��self� r( �4/usr/lib/python3/dist-packages/numpy/core/records.py�__repr__T s z_OrderedCounter.__repr__c C s | j t| �ffS �N)r$ r r& r( r( r) � __reduce__W s z_OrderedCounter.__reduce__N)r% � __module__� __qualname__�__doc__r* r, r( r( r( r) r# Q s r# c C s dd� t | ��� D �S )z@Find duplication in a list, return a list of duplicated elementsc S s g | ]\}}|d kr|�qS �r r( )�.0�itemZcountsr( r( r) � <listcomp>] s �z"find_duplicate.<locals>.<listcomp>)r# �items)�listr( r( r) �find_duplicate[ s �r6 �numpyc @ s4 e Zd ZdZd dd�Zddd�Zd d � Zd d � ZdS )r a� Class to convert formats, names, titles description to a dtype. After constructing the format_parser object, the dtype attribute is the converted data-type: ``dtype = format_parser(formats, names, titles).dtype`` Attributes ---------- dtype : dtype The converted data-type. Parameters ---------- formats : str or list of str The format description, either specified as a string with comma-separated format descriptions in the form ``'f8, i4, a5'``, or a list of format description strings in the form ``['f8', 'i4', 'a5']``. names : str or list/tuple of str The field names, either specified as a comma-separated string in the form ``'col1, col2, col3'``, or as a list or tuple of strings in the form ``['col1', 'col2', 'col3']``. An empty list can be used, in that case default field names ('f0', 'f1', ...) are used. titles : sequence Sequence of title strings. An empty list can be used to leave titles out. aligned : bool, optional If True, align the fields by padding as the C-compiler would. Default is False. byteorder : str, optional If specified, all the fields will be changed to the provided byte-order. Otherwise, the default byte-order is used. For all available string specifiers, see `dtype.newbyteorder`. See Also -------- dtype, typename, sctype2char Examples -------- >>> np.format_parser(['<f8', '<i4', '<a5'], ['col1', 'col2', 'col3'], ... ['T1', 'T2', 'T3']).dtype dtype([(('T1', 'col1'), '<f8'), (('T2', 'col2'), '<i4'), (('T3', 'col3'), 'S5')]) `names` and/or `titles` can be empty lists. If `titles` is an empty list, titles will simply not appear. If `names` is empty, default field names will be used. >>> np.format_parser(['f8', 'i4', 'a5'], ['col1', 'col2', 'col3'], ... []).dtype dtype([('col1', '<f8'), ('col2', '<i4'), ('col3', '<S5')]) >>> np.format_parser(['<f8', '<i4', '<a5'], [], []).dtype dtype([('f0', '<f8'), ('f1', '<i4'), ('f2', 'S5')]) FNc C s. | � ||� | �||� | �|� | j| _d S r+ )� _parseFormats�_setfieldnames� _createdescr�_descr�dtype)r' �formats�names�titles�aligned� byteorderr( r( r) �__init__� s zformat_parser.__init__r c s� |dkrt d��t|t�r6t�dd� t|�D �|�}n t�||�}|j� � dkrht�d|fg|�}|j� |j}� fdd�|D �| _� fdd�|D �| _ t |�| _ dS )z Parse the field formats NzNeed formats argumentc S s g | ]\}}d � |�|f�qS )zf{})�format)r1 r" Zformat_r( r( r) r3 � s z/format_parser._parseFormats.<locals>.<listcomp>�f1c s g | ]}� | d �qS �r r( �r1 �key��fieldsr( r) r3 � s c s g | ]}� | d �qS r0 r( rF rH r( r) r3 � s ) � ValueError� isinstancer5 �sbr< � enumeraterI r> � _f_formats�_offsets�len�_nfields)r' r= r@ r< �keysr( rH r) r8 � s � zformat_parser._parseFormatsc C s� |r\t |�ttfkrn*t|ttf�r0|�d�}ntdt|� ��dd� |d| j � D �| _ ng | _ | j dd� t t | j �| j �D �7 _ t | j �}|r�td| ��|r�dd� |d| j � D �| _n g | _g }| j t |�kr�| jdg| j t |� 7 _dS ) zQconvert input field names into a list and assign to the _names attribute �,zillegal input names %sc S s g | ] }|� � �qS r( ��strip�r1 r r( r( r) r3 � s z0format_parser._setfieldnames.<locals>.<listcomp>Nc S s g | ] }d | �qS )zf%dr( �r1 r" r( r( r) r3 � s zDuplicate field names: %sc S s g | ] }|� � �qS r( rT rV r( r( r) r3 � s )�typer5 �tuplerK �strr �split� NameError�reprrQ �_names�rangerP r6 rJ �_titles)r' r> r? Z_dupr( r( r) r9 � s( � z format_parser._setfieldnamesc C sD t �| j| j| j| jd��}|d k r:t|d }|�|�}|| _d S )N)r> r= Zoffsetsr? r ) rL r< r^ rN rO r` �_byteorderconvZ newbyteorderr; )r' rA �descrr( r( r) r: � s � zformat_parser._createdescr)FN)r )r% r- r. r/ rB r8 r9 r: r( r( r( r) r d s : $c sT e Zd ZdZd Z dZ� fdd�Z� fdd�Zdd� Zd d � Zd d � Zd d� Z � Z S )r zEA data-type scalar that allows field access as attribute lookup. r7 c s$ t � d dkr| �� S tt| ��� S �N�legacy�1.13)r �__str__�superr r* r& �r$ r( r) r* � s zrecord.__repr__c s( t � d dkrt| �� �S tt| ��� S rc )r rZ r2 rg r rf r& rh r( r) rf � s zrecord.__str__c C s� |dkrt j�| |�S zt j�| |�W S tk r: Y nX t j�| d�j}|�|d �}|r�| j|d d� � }z |j}W n tk r� | Y S X |jd k r�|� | j |jf�S |S td| ��d S )N��setfield�getfieldr< r< � �%'record' object has no attribute '%s') �nt�void�__getattribute__�AttributeErrorrI �getrk r< r> �viewr$ )r' �attr� fielddict�res�objZdtr( r( r) rp � s( �zrecord.__getattribute__c C sx |dkrt d| ��tj�| d�j}|�|d �}|rL| j|f|d d� �� S t| |d �rhtj�| ||�S t d| ��d S )Nri zCannot set '%s' attributer< rl rm ) rq rn ro rp rI rr rj �getattr� __setattr__)r' rt �valru rv r( r( r) ry s �zrecord.__setattr__c C s@ t j�| |�}t|t j�r8|jjd k r8|�| j|jf�S |S d S r+ )rn ro � __getitem__rK r< r> rs r$ �r' Zindxrw r( r( r) r{ $ s zrecord.__getitem__c s@ �j j}tdd� |D ��}d| � � �fdd�|D �}d�|�S )zPretty-print all fields.c s s | ]}t |�V qd S r+ )rP �r1 �namer( r( r) � <genexpr>2 s z record.pprint.<locals>.<genexpr>z %% %ds: %%sc s g | ]}� |t �|�f �qS r( )rx r} ��fmtr' r( r) r3 4 s z!record.pprint.<locals>.<listcomp>� )r< r> �max�join)r' r> �maxlenZrowsr( r� r) �pprint. s z record.pprint) r% r- r. r/ r* rf rp ry r{ r� � __classcell__r( r( rh r) r � s c s\ e Zd ZdZd Z dZddd�Zd d � Zd d � Zd d� Z� fdd�Zdd� Z ddd�Z � Z S )r a$ Construct an ndarray that allows field access using attributes. Arrays may have a data-types containing fields, analogous to columns in a spread sheet. An example is ``[(x, int), (y, float)]``, where each entry in the array is a pair of ``(int, float)``. Normally, these attributes are accessed using dictionary lookups such as ``arr['x']`` and ``arr['y']``. Record arrays allow the fields to be accessed as members of the array, using ``arr.x`` and ``arr.y``. Parameters ---------- shape : tuple Shape of output array. dtype : data-type, optional The desired data-type. By default, the data-type is determined from `formats`, `names`, `titles`, `aligned` and `byteorder`. formats : list of data-types, optional A list containing the data-types for the different columns, e.g. ``['i4', 'f8', 'i4']``. `formats` does *not* support the new convention of using types directly, i.e. ``(int, float, int)``. Note that `formats` must be a list, not a tuple. Given that `formats` is somewhat limited, we recommend specifying `dtype` instead. names : tuple of str, optional The name of each column, e.g. ``('x', 'y', 'z')``. buf : buffer, optional By default, a new array is created of the given shape and data-type. If `buf` is specified and is an object exposing the buffer interface, the array will use the memory from the existing buffer. In this case, the `offset` and `strides` keywords are available. Other Parameters ---------------- titles : tuple of str, optional Aliases for column names. For example, if `names` were ``('x', 'y', 'z')`` and `titles` is ``('x_coordinate', 'y_coordinate', 'z_coordinate')``, then ``arr['x']`` is equivalent to both ``arr.x`` and ``arr.x_coordinate``. byteorder : {'<', '>', '='}, optional Byte-order for all fields. aligned : bool, optional Align the fields in memory as the C-compiler would. strides : tuple of ints, optional Buffer (`buf`) is interpreted according to these strides (strides define how many bytes each array element, row, column, etc. occupy in memory). offset : int, optional Start reading buffer (`buf`) from this offset onwards. order : {'C', 'F'}, optional Row-major (C-style) or column-major (Fortran-style) order. Returns ------- rec : recarray Empty array of the given shape and type. See Also -------- rec.fromrecords : Construct a record array from data. record : fundamental data-type for `recarray`. format_parser : determine a data-type from formats, names, titles. Notes ----- This constructor can be compared to ``empty``: it creates a new record array but does not fill it with data. To create a record array from data, use one of the following methods: 1. Create a standard ndarray and convert it to a record array, using ``arr.view(np.recarray)`` 2. Use the `buf` keyword. 3. Use `np.rec.fromrecords`. Examples -------- Create an array with two fields, ``x`` and ``y``: >>> x = np.array([(1.0, 2), (3.0, 4)], dtype=[('x', '<f8'), ('y', '<i8')]) >>> x array([(1., 2), (3., 4)], dtype=[('x', '<f8'), ('y', '<i8')]) >>> x['x'] array([1., 3.]) View the array as a record array: >>> x = x.view(np.recarray) >>> x.x array([1., 3.]) >>> x.y array([2, 4]) Create a new, empty record array: >>> np.recarray((2,), ... dtype=[('x', int), ('y', float), ('z', int)]) #doctest: +SKIP rec.array([(-1073741821, 1.2249118382103472e-301, 24547520), (3471280, 1.2134086255804012e-316, 0)], dtype=[('x', '<i4'), ('y', '<f8'), ('z', '<i4')]) r7 Nr F�Cc C sf |d k rt �|�} nt|||| | �j} |d krFtj| |t| f| d�} n tj| |t| f|||| d�} | S )N)�order)�buffer�offset�stridesr� )rL r< r r; �ndarray�__new__r )Zsubtype�shaper< �bufr� r� r= r> r? rA r@ r� rb r' r( r( r) r� � s �zrecarray.__new__c C s$ | j jtk r | j jd k r | j | _ d S r+ )r< rX r r> )r' rw r( r( r) �__array_finalize__� s zrecarray.__array_finalize__c C s� zt �| |�W S tk r" Y nX t�| d�j}z|| d d� }W n$ ttfk rj td| ��Y nX | j|� }|jj d k r�t |jj t j �r�|j| jj |jfd�S |S |�t�S d S )Nr< rl z recarray has no attribute %s�r< )�objectrp rq r� rI � TypeError�KeyErrorrk r< r> � issubclassrX rn ro rs )r' rt ru rv rw r( r( r) rp � s zrecarray.__getattribute__c C s. |dkr.t |jtj�r.|jd k r.t�t|f�}|| jk}zt � | ||�}W nJ t k r� t � | d�jpji }||kr�t�� d d� \}}||��Y nNX t � | d�jp�i }||kr�|S |r�zt �| |� W n t k r� | Y S X z|| d d� }W n& ttfk �r td| ��Y nX | j|f|�� S )Nr< rl z record array has no attribute %s)r� rX rn ro r> rL r< r �__dict__r� ry � Exceptionr� rp rI �sys�exc_info� __delattr__r� r� rq rj ) r' rt rz ZnewattrZretru �exctype�valuerv r( r( r) ry � s. zrecarray.__setattr__c st t t| ��|�}t|t�rl|jjd k r^|�t| ��}t |jjt j �rZ|j| jj|jfd�S |S |jtd�S n|S d S )Nr� )rX ) rg r r{ rK r� r< r> rs rX r� rn ro r| rh r( r) r{ s zrecarray.__getitem__c C s� | j }| j jtks"t| j jtj�sF|jtkr<t� tj|f�}d}d}nd}d}| jdksb| jdkrvtj | d|dd �}nd t | j�f }d d t |� }t � d dkr�d | }||||f S )Nz rec.array(zrec.array(%s,%sdtype=%s)zarray(z)array(%s,%sdtype=%s).view(numpy.recarray)r rE z, rS )Z separator�prefix�suffixz [], shape=%sr� � rd re ) r< rX r r� rn ro rL �sizer� Z array2stringr] rP r )r' Z repr_dtyper� r� ZlstZlfr( r( r) r* s, � �zrecarray.__repr__c C s~ t |t�r t�| d�j}|| }t�| d�j}|| d d� }|d krj| j|� }|jjd k r`|S |�t�S | j |f|�� S d S )Nr< rl ) rK �intr� rp r> rI rk r< rs rj )r' rt rz r> ru rv rw r( r( r) �field9 s zrecarray.field) NNr NNNNNFr� )N) r% r- r. r/ r� r� rp ry r{ r* r� r� r( r( rh r) r ? s" j � " "Fc C sN dd� | D �} |dks |dkr(| d j }t|t�r8|f}|dkrb|dkrbg }| D ]}|�|j� qP|dk r|t�|�} | j} n t|||||�} | j} | j } t | �t | �kr�t d��| d j } t | �} | dkr�|d| � }t | �D ]:\}}| | j } |j d|j | � }||kr�t d| ��q�t|| �}tt | ��D ]}| | || | < �q2|S )aL create a record array from a (flat) list of arrays >>> x1=np.array([1,2,3,4]) >>> x2=np.array(['a','dd','xyz','12']) >>> x3=np.array([1.1,2,3,4]) >>> r = np.core.records.fromarrays([x1,x2,x3],names='a,b,c') >>> print(r[1]) (2, 'dd', 2.0) # may vary >>> x1[1]=34 >>> r.a array([1, 2, 3, 4]) c S s g | ]}t �|��qS r( )rL Zasarray)r1 �xr( r( r) r3 Z s z fromarrays.<locals>.<listcomp>Nr z>mismatch between the number of fields and the number of arraysz array-shape mismatch in array %d)r� rK r� �appendr< rL r> r r^ r; rP rJ rM �ndimr r_ )Z arrayListr< r� r= r> r? r@ rA rw rb r^ ZparsedZd0Znn�kZ testshape�_arrayr" r( r( r) � fromarraysK s< r� c sP |dkrP|dkrPt j| td�� � fdd�t� jd �D �}t|||||||d�S |dk rht �t|f�} nt|||||�j } zt j| | d�} W n� t t fk �r$ |dks�|dkr�t | �}t |ttf�r�|f}t |�dkr�t d ��t|| �} t| j�D ]} t| | �| | < q�tjd td d � | Y S X |dk �rB| j|k�rB|| _| �t�} | S ) a� create a recarray from a list of records in text form The data in the same field can be heterogeneous, they will be promoted to the highest data type. This method is intended for creating smaller record arrays. If used to create large array without formats defined r=fromrecords([(2,3.,'abc')]*100000) it can be slow. If formats is None, then this will auto-detect formats. Use list of tuples rather than list of lists for faster processing. >>> r=np.core.records.fromrecords([(456,'dbe',1.2),(2,'de',1.3)], ... names='col1,col2,col3') >>> print(r[0]) (456, 'dbe', 1.2) >>> r.col1 array([456, 2]) >>> r.col2 array(['dbe', 'de'], dtype='<U3') >>> import pickle >>> pickle.loads(pickle.dumps(r)) rec.array([(456, 'dbe', 1.2), ( 2, 'de', 1.3)], dtype=[('col1', '<i8'), ('col2', '<U3'), ('col3', '<f8')]) Nr� c s" g | ]}t �� d |f �� ��qS ).)rL �array�tolistrW �rw r( r) r3 � s z fromrecords.<locals>.<listcomp>���)r= r� r> r? r@ rA r r z Can only deal with 1-d array.zxfromrecords expected a list of tuples, may have received a list of lists instead. In the future that will raise an errorrl )� stacklevel)rL r� r� r_ r� r� r< r r r; r� rJ rP rK r� r r r� rY �warnings�warn� FutureWarningrs )ZrecListr< r� r= r> r? r@ rA Zarrlistrb Zretvalr� r� rv r( r� r) � fromrecords� sB � � r� c C s� |dkr|dkrt d��|dk r,t�|�} nt|||||�j} | j} |dks\|dks\|dkrlt| �| | }t|| | |d�} | S )zM create a (read-only) record array from binary data contained in a stringNz2fromstring() needs a 'dtype' or 'formats' argumentr r� )r� r� )r� rL r< r r; �itemsizerP r ) Z datastringr< r� r� r= r> r? r@ rA rb r� r� r( r( r) � fromstring� s r� c C sT z | � � }W n* tk r6 tj�| j�| �� Y S X t�|�}|j| �� }|S r+ ) �filenorq �os�path�getsizer~ �tell�fstat�st_size)�fd�fn�str� r( r( r) �get_remaining_size� s r� c C s^ |dkr|dkrt d��|dks(|dkr.d}nt|ttf�rB|f}t| �rTt| �} ntt| �d�} | ��} |dkr|| �|d� t | �} |dk r�t � |�} nt |||||�j } | j} t �|�jtjd�} | | }|dk �rt|�}| | ||�d�< t|�}t �|�jtjd�} | | }|| k�r(td ��t|| �}| �|j�}||k�rPtd ��W 5 Q R X |S ) a� Create an array from binary file data If file is a string or a path-like object then that file is opened, else it is assumed to be a file object. The file object must support random access (i.e. it must have tell and seek methods). >>> from tempfile import TemporaryFile >>> a = np.empty(10,dtype='f8,i4,a5') >>> a[5] = (0.5,10,'abcde') >>> >>> fd=TemporaryFile() >>> a = a.newbyteorder('<') >>> a.tofile(fd) >>> >>> _ = fd.seek(0) >>> r=np.core.records.fromfile(fd, formats='f8,i4,a5', shape=10, ... byteorder='<') >>> print(r[5]) (0.5, 10, 'abcde') >>> r.shape (10,) Nz0fromfile() needs a 'dtype' or 'formats' argumentr )r� �rbr r� r� z:Not enough bytes left in file for specified shape and typez%Didn't read as many bytes as expected)r� rK r� r r r �openr �seekr� rL r< r r; r� r� Zprodrn Zintpr5 �indexrY rJ r �readinto�data�IOError)r� r< r� r� r= r> r? r@ rA Zctxr� rb r� Z shapeprodZ shapesize�nbytesr� Z nbytesreadr( r( r) �fromfile� sD � r� Tc C s t | td�tf�st| �r2|dkr2|dkr2td��i } |dk rJt�|�}n,|dk rft||||| �j}n||||| d�} | dkr�|dkr�td��t ||| ||d�S t | t �r�t | |f||d�| ��S t | t t f��rt | d t t f�� r�t| f||d�| ��S t| f||d�| ��S �nt | t ��rZ|dk �rD| j|k�rD| �|�} n| } | �rV| �� } | S t| ��rtt| |||d �S t | t��r�|dk �r�| j|k�r�| �|�} n| } | �r�| �� } | �t �S t| d d�} | dk�s�t | t��s�td ��t�| �} |dk �r| j|k�r| �|�} | �t �S dS ) z=Construct a record array from a wide-variety of objects. NzIMust define formats (or dtype) if object is None, string, or an open file)r= r> r? r@ rA z"Must define a shape if obj is None)r� r� r� )r� r� r )r< r� )r< r� r� Z__array_interface__zUnknown input type)rK rX rZ r rJ rL r< r r; r r r� r5 rY r� r� rs �copyr� r� rx �dictr� )rw r< r� r� r� r= r> r? r@ rA r� �kwds�newZ interfacer( r( r) r� 5 sj �� �� r� )NNNNNFN)NNNNNFN)NNr NNNFN)NNr NNNFN) NNr NNNNFNT)-r/ Z __future__r r r r� r� r� � collectionsr r � r rL r rn Z numpy.compatr r r r r r Znumpy.core.overridesr Z arrayprintr �__all__r� ra ZtypeDictZnumfmtr# r6 r� r ro r r r� r� r� r� r� r� r( r( r( r) �<module> s� # � U � > � E � � J �