OwlCyberSecurity - MANAGER
Edit File: req_file.cpython-38.pyc
U ^5H � @ sZ d Z ddlmZ ddlZddlZddlZddlZddlZddlm Z ddl m Z ddl mZ ddlmZmZ ddlmZ dd lmZmZ dd lmZ dd lmZ dd lm Z e�r<dd lm Z ddl m Z m Z m!Z!m"Z"m#Z#m$Z$m%Z%m&Z& ddl'm(Z( ddl)m*Z* ddl+m,Z, ddl-m.Z. e!e&e/e%f Z0e e%ge&e1e f f Z2dgZ3e�4dej5�Z6e�4d�Z7e�4d�Z8ej9ej:ej;ej<ej=ej>ej?ej@ejAejBejCejDejEg ZFejGejHejIgZJdd� eJD �ZKG dd� deL�ZMd6d d�ZNd d � ZOd7d d �ZPG d!d"� d"eL�ZQd#d$� ZRd%d&� ZSG d'd(� d(eT�ZUd)d*� ZVd+d,� ZWd-d.� ZXd/d0� ZYd1d2� ZZd8d3d4�Z[e�4d5ej5�Z\dS )9z Requirements file parsing � )�absolute_importN)� filterfalse)�parse)� cmdoptions)�InstallationError�RequirementsFileParseError)� SearchScope)�install_req_from_editable�install_req_from_line)� auto_decode)�MYPY_CHECK_RUNNING)�get_url_scheme)�Values)�Any�Callable�Iterator�List�NoReturn�Optional�Text�Tuple)�InstallRequirement)� WheelCache)� PackageFinder)� PipSession�parse_requirementsz^(http|https|file):z (^|\s+)#.*$z#(?P<var>\$\{(?P<name>[A-Z0-9_]+)\})c C s g | ]}t |� j��qS � )�str�dest)�.0�or r �</usr/lib/python3/dist-packages/pip/_internal/req/req_file.py� <listcomp>T s r" c @ s e Zd Zdd� ZdS )� ParsedLinec C s( || _ || _|| _|| _|| _|| _d S �N)�filename�lineno� comes_from�args�opts� constraint)�selfr% r& r' r( r) r* r r r! �__init__X s zParsedLine.__init__N��__name__� __module__� __qualname__r, r r r r! r# W s r# Fc c sZ |r |j nd}t|�} t|| ||�} | �| |�D ]$} t| |||||�} | dk r0| V q0dS )a! Parse a requirements file and yield InstallRequirement instances. :param filename: Path or url of requirements file. :param session: PipSession instance. :param finder: Instance of pip.index.PackageFinder. :param comes_from: Origin description of requirements. :param options: cli options. :param constraint: If true, parsing a constraint file rather than requirements file. :param wheel_cache: Instance of pip.wheel.WheelCache :param use_pep517: Value of the --use-pep517 option. N)�skip_requirements_regex�get_line_parser�RequirementsFileParserr � handle_line) r% �session�finderr' �optionsr* � wheel_cache� use_pep517r1 � line_parser�parserZ parsed_lineZreqr r r! r j s( � � �c C s: t | �� dd�}t|�}t|�}|r.t||�}t|�}|S )z�Split, filter, and join lines, and return a line iterator :param content: the content of the requirements file :param options: cli options � )�start)� enumerate� splitlines� join_lines�ignore_comments� skip_regex�expand_env_variables)�contentr1 � lines_enumr r r! � preprocess� s rF c C s� d| j r dnd| j| jf }| jr�|r,|jnd}|rBt�|| j� i }tD ],} | | jj krJ| jj | rJ| jj | || < qJd� | j| j�} t | j|||||| j | d�S | jj r�|r�|jnd}t | jj d ||| j ||d�S | jjr�| jj|_�n|�r�|j} |j} | jj�r| jjg} | jjd k�r&g } | jj�r>| �| jj� | jj�r�| jjd } tj�tj�| j��}tj�|| �}tj�|��r�|} | �| � t | | d �}||_ | jj �r�|� � |�r�| jj �p�g D ]$}d� | j| j�}|j!||d � �q�d S ) a� Handle a single parsed requirements line; This can result in creating/yielding requirements, or updating the finder. For lines that contain requirements, the only options that have an effect are from SUPPORTED_OPTIONS_REQ, and they are scoped to the requirement. Other options from SUPPORTED_OPTIONS may be present, but are ignored. For lines that do not contain requirements, the only options that have an effect are from SUPPORTED_OPTIONS. Options from SUPPORTED_OPTIONS_REQ may be present, but are ignored. These lines may contain multiple options (although our docs imply only one is supported), and all our parsed and affect the finder. z%s %s (line %s)z-cz-rFz line {} of {})r' r9 �isolatedr7 r8 r* � line_sourcer )r' r9 r* rG r8 T)� find_links� index_urls)�sourceN)"r* r% r& r( Z isolated_moder Zcheck_install_build_globalr) �SUPPORTED_OPTIONS_REQ_DEST�__dict__�formatr � editablesr �require_hashesrI rJ � index_url�no_indexZextra_index_urls�extend�os�path�dirname�abspath�join�exists�appendr � search_scope�preZset_allow_all_prereleasesZ trusted_hostsZadd_trusted_host)�liner6 r7 r5 r8 r9 Zline_comes_fromrG Z req_optionsr rH rI rJ �valueZreq_dirZrelative_to_reqs_filer[ ZhostrK r r r! r4 � s� �� � � r4 c @ s, e Zd Zdd� Zdd� Zdd� Zdd� Zd S ) r3 c C s || _ || _|| _|| _d S r$ )�_session� _line_parser� _comes_from�_skip_requirements_regex)r+ r5 r: r' r1 r r r! r, s z RequirementsFileParser.__init__c c s | � ||�D ] }|V q dS )z3Parse a given file, yielding parsed lines. N)�_parse_and_recurse)r+ r% r* r] r r r! r s z RequirementsFileParser.parsec c s� | � ||�D ]�}|js�|jjs�|jjs.|jjr�|jjrH|jjd }d}n|jjd }d}t�|�rpt� ||�}n t�|�s�t j � t j � |�|�}| �||�D ] }|V q�q |V q d S )Nr FT)� _parse_filer( r) rO � requirements� constraints� SCHEME_RE�search� urllib_parseZurljoinrT rU rX rV rc )r+ r% r* r] Zreq_pathZnested_constraintZ inner_liner r r! rc s6 ���� � � z)RequirementsFileParser._parse_and_recursec c s� t || j| jd�\}}t|| j�}|D ]j\}}z| �|�\}} W n8 tk rx } zd|| jf } t| ��W 5 d } ~ X Y nX t ||| j|| |�V q&d S )N)r' zInvalid requirement: %s %s) �get_file_contentr_ ra rF rb r` �OptionParsingError�msgr r# ) r+ r% r* �_rD rE � line_numberr] �args_strr) �erl r r r! rd ? s( � �z"RequirementsFileParser._parse_fileN)r. r/ r0 r, r rc rd r r r r! r3 s "r3 c s � fdd�}|S )Nc s^ t � }|�� }d |_� r � j|_t| �\}}tjdk r@|�d�}|�t � |�|�\}}||fS )N)� � � �utf8) � build_parserZget_default_valuesrQ Zformat_control�break_args_options�sys� version_info�encode� parse_args�shlex�split)r] r; �defaultsro Z options_strr) rm �r6 r r! � parse_line[ s �z#get_line_parser.<locals>.parse_liner )r6 r r r~ r! r2 Y s r2 c C sf | � d�}g }|dd� }|D ]2}|�d�s6|�d�r< qRq |�|� |�d� q d�|�d�|�fS )z�Break up the line into an args and options string. We only want to shlex (and then optparse) the options, not the args. args can contain markers which are corrupted by shlex. � N�-z--r )r| � startswithrZ �poprX )r] �tokensr( r7 �tokenr r r! rv t s rv c @ s e Zd Zdd� ZdS )rk c C s || _ d S r$ )rl �r+ rl r r r! r, � s zOptionParsingError.__init__Nr- r r r r! rk � s rk c C s@ t jdd�} tt }|D ]}|� }| �|� qdd� }|| _| S )z7 Return a parser for parsing requirement lines F)Zadd_help_optionc S s t |��d S r$ )rk r� r r r! � parser_exit� s z!build_parser.<locals>.parser_exit)�optparseZ OptionParser�SUPPORTED_OPTIONS�SUPPORTED_OPTIONS_REQZ add_option�exit)r; Zoption_factoriesZoption_factoryZoptionr� r r r! ru � s ru c c s� d}g }| D ]v\}}|� d�r(t�|�rjt�|�r:d| }|r^|�|� |d�|�fV g }q�||fV q |sr|}|�|�d�� q |r�|d�|�fV dS )z�Joins a line ending in '' with the previous line (except when following comments). The joined line takes on the index of the first line. N�\r� � )�endswith� COMMENT_RE�matchrZ rX �strip)rE Zprimary_line_numberZnew_linern r] r r r! r@ � s r@ c c s4 | D ]*\}}t �d|�}|�� }|r||fV qdS )z1 Strips comments and filter empty lines. r� N)r� �subr� )rE rn r] r r r! rA � s rA c s t �|�� t� fdd�| �} | S )zd Skip lines that match the provided pattern Note: the regex pattern is only built once c s � � | d �S )Nr< )rh )rp �Zmatcherr r! �<lambda>� � z skip_regex.<locals>.<lambda>)�re�compiler )rE �patternr r� r! rB � s rB c c sL | D ]B\}}t �|�D ]$\}}t�|�}|s.q|�||�}q||fV qdS )a� Replace all environment variables that can be retrieved via `os.getenv`. The only allowed format for environment variables defined in the requirement file is `${MY_VARIABLE_1}` to ensure two things: 1. Strings that contain a `$` aren't accidentally (partially) expanded. 2. Ensure consistency across platforms for requirement files. These points are the result of a discussion on the `github pull request #3514 <https://github.com/pypa/pip/pull/3514>`_. Valid characters in variable names follow the `POSIX standard <http://pubs.opengroup.org/onlinepubs/9699919799/>`_ and are limited to uppercase letter, digits and the `_` (underscore). N)� ENV_VAR_RE�findallrT �getenv�replace)rE rn r] Zenv_varZvar_namer^ r r r! rC � s rC c C s& t | �}|dkr.|�| �}|�� |j|jfS |dkr�|rT|�d�rTtd|| f ��| �dd�d }|�dd�}t � |�}|r�|� d�d |�d d�d }t � |�}|�d�r�d|�d� }|} z&t| d ��}t|�� �}W 5 Q R X W n4 tk �r } ztd t| � ��W 5 d } ~ X Y nX | |fS ) aZ Gets the content of a file; it may be a filename, file: URL, or http: URL. Returns (location, content). Content is unicode. Respects # -*- coding: declarations on the retrieved files. :param url: File path or url. :param session: PipSession instance. :param comes_from: Origin description of requirements. )�httpZhttps�filer� z6Requirements file %s references URL %s, which is local�:r< r� �/�|�rbz$Could not open requirements file: %sN)r �getZraise_for_status�url�textr� r r| r� �_url_slash_drive_rer� �groupri Zunquote�lstrip�openr �read�IOErrorr ) r� r5 r' ZschemeZresprU r� �frD �excr r r! rj � s: �� �rj z /*([a-z])\|)NNNFNN)NNNNN)N)]�__doc__Z __future__r r� rT r� r{ rw Zpip._vendor.six.movesr Z pip._vendor.six.moves.urllibr ri Zpip._internal.clir Zpip._internal.exceptionsr r Z!pip._internal.models.search_scoper Z pip._internal.req.constructorsr r Z pip._internal.utils.encodingr Zpip._internal.utils.typingr Zpip._internal.utils.urlsr r �typingr r r r r r r r Zpip._internal.reqr Zpip._internal.cacher Z"pip._internal.index.package_finderr Z pip._internal.network.sessionr �intZ ReqFileLinesr Z LineParser�__all__r� �Irg r� r� rQ Zextra_index_urlrR rf re ZeditablerI Z no_binaryZ only_binaryrP r\ Z trusted_hostZ always_unzipr� Zinstall_optionsZglobal_options�hashr� rL �objectr# r rF r4 r3 r2 rv � Exceptionrk ru r@ rA rB rC rj r� r r r r! �<module> s� ( �� � ' � gQ ,