OXIESEC PANEL
- Current Dir:
/
/
opt
/
gsutil
/
gslib
/
utils
/
__pycache__
Server IP: 2a02:4780:11:1594:0:ef5:22d7:a
Upload:
Create Dir:
Name
Size
Modified
Perms
📁
..
-
02/11/2025 08:19:48 AM
rwxr-xr-x
📄
__init__.cpython-39.pyc
126 bytes
02/11/2025 08:19:48 AM
rw-r--r--
📄
acl_helper.cpython-39.pyc
9.38 KB
02/11/2025 08:19:49 AM
rw-r--r--
📄
arg_helper.cpython-39.pyc
1.01 KB
02/11/2025 08:19:48 AM
rw-r--r--
📄
boto_util.cpython-39.pyc
16.46 KB
02/11/2025 08:19:48 AM
rw-r--r--
📄
cat_helper.cpython-39.pyc
4.21 KB
02/11/2025 08:19:49 AM
rw-r--r--
📄
cloud_api_helper.cpython-39.pyc
3.29 KB
02/11/2025 08:19:48 AM
rw-r--r--
📄
constants.cpython-39.pyc
2.88 KB
02/11/2025 08:19:48 AM
rw-r--r--
📄
copy_helper.cpython-39.pyc
101.64 KB
02/11/2025 08:19:49 AM
rw-r--r--
📄
encryption_helper.cpython-39.pyc
5.84 KB
02/11/2025 08:19:49 AM
rw-r--r--
📄
execution_util.cpython-39.pyc
1.06 KB
02/11/2025 08:19:48 AM
rw-r--r--
📄
hashing_helper.cpython-39.pyc
15.71 KB
02/11/2025 08:19:48 AM
rw-r--r--
📄
iam_helper.cpython-39.pyc
8.61 KB
02/11/2025 08:19:49 AM
rw-r--r--
📄
ls_helper.cpython-39.pyc
12.4 KB
02/11/2025 08:19:49 AM
rw-r--r--
📄
metadata_util.cpython-39.pyc
3.1 KB
02/11/2025 08:19:48 AM
rw-r--r--
📄
parallelism_framework_util.cpython-39.pyc
11.79 KB
02/11/2025 08:19:48 AM
rw-r--r--
📄
posix_util.cpython-39.pyc
12.46 KB
02/11/2025 08:19:49 AM
rw-r--r--
📄
retention_util.cpython-39.pyc
8.77 KB
02/11/2025 08:19:49 AM
rw-r--r--
📄
retry_util.cpython-39.pyc
2.5 KB
02/11/2025 08:19:49 AM
rw-r--r--
📄
rsync_util.cpython-39.pyc
1.6 KB
02/11/2025 08:19:49 AM
rw-r--r--
📄
shim_util.cpython-39.pyc
19.8 KB
02/11/2025 08:19:49 AM
rw-r--r--
📄
signurl_helper.cpython-39.pyc
4.21 KB
02/11/2025 08:19:49 AM
rw-r--r--
📄
stet_util.cpython-39.pyc
3.35 KB
02/11/2025 08:19:49 AM
rw-r--r--
📄
system_util.cpython-39.pyc
7.9 KB
02/11/2025 08:19:48 AM
rw-r--r--
📄
temporary_file_util.cpython-39.pyc
915 bytes
02/11/2025 08:19:49 AM
rw-r--r--
📄
text_util.cpython-39.pyc
12.62 KB
02/11/2025 08:19:48 AM
rw-r--r--
📄
translation_helper.cpython-39.pyc
25.67 KB
02/11/2025 08:19:48 AM
rw-r--r--
📄
unit_util.cpython-39.pyc
7.01 KB
02/11/2025 08:19:48 AM
rw-r--r--
📄
update_util.cpython-39.pyc
3.39 KB
02/11/2025 08:19:49 AM
rw-r--r--
📄
user_agent_helper.cpython-39.pyc
1.49 KB
02/11/2025 08:19:48 AM
rw-r--r--
📄
version_check.cpython-39.pyc
1.39 KB
02/11/2025 08:19:48 AM
rw-r--r--
📄
wrapped_credentials.cpython-39.pyc
5.81 KB
02/11/2025 08:19:49 AM
rw-r--r--
Editing: text_util.cpython-39.pyc
Close
a +(Wg�3 � @ s� d Z ddlmZ ddlmZ ddlmZ ddlmZ ddlZddlZddlZddl Z ddl Z ddl Z ddl Z ddl Z ddlZddlZddlZddlmZ ddlmZ dd lmZ dd lmZ dd lmZ dd lmZ dd lm Z ej r�e Z ddddddd�Z edd� �Z!dd� Z"dd� Z#dd� Z$d d � Z%d d � Z&d d!� Z'd"d#� Z(d$d%� Z)d&d'� Z*d(d)� Z+d*d+� Z,d,d-� Z-d.d/� Z.d0d1� Z/d2d3� Z0d4d5� Z1d8d6d7�Z2dS )9z<Shared utility structures and methods for manipulating text.� )�absolute_import)�print_function)�division)�unicode_literalsN)�urllib)�range��CommandException)� LazyWrapper)�UTF8)� WINDOWS_1252)� IS_CP1252ZCOLDLINEZ DURABLE_REDUCED_AVAILABILITYZNEARLINEZSTANDARDZARCHIVE)ZCLZDRA�NL�SZSTD�Ac C s t �d�S )Nz,^(?P<maj>\d+)(\.(?P<min>\d+)(?P<suffix>.*))?)�re�compile� r r �$/opt/gsutil/gslib/utils/text_util.py�<lambda>8 � r c C sb t j�| �\}}}}}t jj|dd�}|�||f� d�dd� |D ��} t j�|||| |f�} | S )a� Adds a query parameter to a URL string. Appends a query parameter to the query string portion of a url. If a parameter with the given name was already present, it is not removed; the new name/value pair will be appended to the end of the query string. It is assumed that all arguments will be of type `str` (either ASCII or UTF-8 encoded) or `unicode`. Note that this method performs no URL-encoding. It is the caller's responsibility to ensure proper URL encoding of the entire URL; i.e. if the URL is already URL-encoded, you should pass in URL-encoded values for param_name and param_value. If the URL is not URL-encoded, you should not pass in URL-encoded parameters; instead, you could perform URL-encoding using the URL string returned from this function. Args: url_str: (str or unicode) String representing the URL. param_name: (str or unicode) String key of the query parameter. param_value: (str or unicode) String value of the query parameter. Returns: (str or unicode) A string representing the modified url, of type `unicode` if the url_str argument was a `unicode`, otherwise a `str` encoded in UTF-8. T)�keep_blank_values�&c S s g | ]\}}d ||f �qS )z%s=%sr )�.0�k�vr r r � <listcomp>W r z&AddQueryParamToUrl.<locals>.<listcomp>)r �parse�urlsplit� parse_qsl�append�join� urlunsplit) �url_strZ param_nameZ param_value�scheme�netloc�pathZ query_str�fragmentZ query_paramsZ new_query_strZnew_urlr r r �AddQueryParamToUrl; s �r( c C s� t � �t| ��}t � �t|��}|r(|s,dS t|�d��}|�d�rRt|�d��nd}|�d�}t|�d��}|�d�r�t|�d��nd}|�d�} ||kr�dS ||kr�||kr�dS ||kr�t| �o�| dfS dS ) al Compares the first and second gsutil version strings. For example, 3.33 > 3.7, and 4.1 is a greater major version than 3.33. Does not handle multiple periods (e.g. 3.3.4) or complicated suffixes (e.g., 3.3RC4 vs. 3.3RC5). A version string with a suffix is treated as less than its non-suffix counterpart (e.g. 3.32 > 3.32pre). Args: first: First gsutil version string. second: Second gsutil version string. Returns: (g, m): g is True if first known to be greater than second, else False. m is True if first known to be greater by at least 1 major version, else False. )FFZmaj�minr �suffix)TT)TFF)�VERSION_MATCHER�match�str�int�group�bool) �first�secondZm1Zm2Z major_ver1Z minor_ver1Z suffix_ver1Z major_ver2Z minor_ver2Z suffix_ver2r r r �CompareVersions^ s$ r3 c c s | D ]}d| V qdS )z:A generator that adds '**' to each url string in url_strs.z%s**Nr )Zurl_strsr# r r r � ConvertRecursiveToFlatWildcard� s r4 c C s& t �t| �dd� �d��}t�|�S )a8 Decodes an encoded python long into an ASCII string. This is used for modeling S3 version_id's as apitools generation. Args: long_to_convert: long to convert to ASCII string. If this is already a string, it is simply returned. Returns: String decoded from the input long. � N�L)�binascii� unhexlify�hex�rstrip�six� ensure_str)Zlong_to_convertZunhexedr r r �DecodeLongAsString� s r= c C s t �t�| �d�}t|d�S )a) Encodes an ASCII string as a python long. This is used for modeling S3 version_id's as apitools generation. Because python longs can be arbitrarily large, this works. Args: string_to_convert: ASCII string to convert to a long. Returns: Long that represents the input string. � hex_codec� )�codecs�encoder; � ensure_binary�long)Zstring_to_convertZ hex_bytestrr r r �EncodeStringAsLong� s rD c C s t rt�| t�S t�| t�S dS )a� Attempts to detect Windows CP1252 encoding and convert to UTF8. Windows doesn't provide a way to set UTF-8 for string encodings; you can set the system locale (see http://windows.microsoft.com/en-us/windows/change-system-locale#1TC=windows-7) but that takes you to a "Change system locale" dropdown that just lists languages (e.g., "English (United States)". Instead, we're forced to check if a encoding as UTF8 raises an exception and if so, try converting from CP1252 to Unicode. Args: input_str: (str or bytes) The input string. Returns: (unicode) The converted string or the original, if conversion wasn't needed. N)r r; � ensure_textr r �Z input_strr r r �FixWindowsEncodingIfNeeded� s rG c C s t �| ��t�pt �| j�S )z8Returns a short Unicode string describing the exception.)r; � text_typerA r � __class__)�excr r r �GetPrintableExceptionString� s rK c C s t dd� | D ��st|��dS )ae Ensures that the string passed in consists of only ASCII values. Args: string: Union[str, unicode, bytes] Text that will be checked for ASCII values. message: Union[str, unicode, bytes] Error message, passed into the exception, in the event that the check on `string` fails. Returns: None Raises: CommandException c s s | ]}t |�d k V qdS )� N)�ord)r �cr r r � <genexpr>� r z InsistAscii.<locals>.<genexpr>N)�allr )�string�messager r r � InsistAscii� s rS c C s t | d| � dS )z�Checks for ASCII-only characters in `header`. Also constructs an error message using `header` if the check fails. Args: header: Union[str, binary, unicode] Text being checked for ASCII values. Returns: None z Invalid non-ASCII header (%s).N)rS )�headerr r r �InsistAsciiHeader� s rU c C s t |dt|�| f � dS )a; Checks for ASCII-only characters in `value`. Also constructs an error message using `header` and `value` if the check fails. Args: header: Header name, only used in error message in case of an exception. value: Union[str, binary, unicode] Text being checked for ASCII values. Returns: None z�Invalid non-ASCII value (%s) was provided for header %s. Only ASCII characters are allowed in headers other than x-goog-meta- and x-amz-meta- headersN)rS �repr)rT �valuer r r �InsistAsciiHeaderValue� s ��rX c C s | dkr| dkrt |��dS )aO Ensures that the value passed in consists of only "on" or "off" Args: value: (unicode) Unicode string that will be checked for correct text. message: Union[str, unicode, bytes] Error message passed into the exception in the event that the check on value fails. Returns: None Raises: CommandException �on�offNr )rW rR r r r � InsistOnOrOff s r[ c C s | � � } | tv rt| } | S )a� Returns a normalized form of the given storage class name. Converts the given string to uppercase and expands valid abbreviations to full storage class names (e.g 'std' would return 'STANDARD'). Note that this method does not check if the given storage class is valid. Args: sc: (str) String representing the storage class's full name or abbreviation. Returns: (str) A string representing the full name of the given storage class. )�upper�$STORAGE_CLASS_SHORTHAND_TO_FULL_NAME)Zscr r r �NormalizeStorageClass s r^ c C s | S )a� Return an UTF8-encoded string type, or None if `input_val` is None. Args: input_val: (unicode, str, or None) A string-like object or None. This method simply calls encode() on `input_val` if it is not None; if `input_val` is not of type "unicode", this will implicitly call decode() with the default encoding for strings (for Python 2, this is ASCII), then call encode(). Returns: (str) A UTF-8 encoded string, or None. r )Z input_valr r r � PrintableStr' s r_ c O s` dd� }dd� }|f i |��\}}}t �|�}t �|�}|| � }|�|�}||7 }t||� dS )a A Python 2/3 compatible analogue to the print function. This function writes text to a file descriptor as the builtin print function would, favoring unicode encoding. Aguments and return values are the same as documented in the Python 2 print function. c [ s` t �dddtjfg�}| �� D ]8\}}||vrNd}t|�|d�|�� ����q |||< q |� � S )a Validates keyword arguments that would be used in Print Valid keyword arguments, mirroring print(), are 'sep', 'end', and 'file'. These must be of types string, string, and file / file interface respectively. Returns the above kwargs of the above types. )�sep� )�end� �filez9{} is not a valid keyword argument. Please use one of: {}ra ) � collections� OrderedDict�sys�stdout�items�KeyError�formatr! �keys�values)�kwargsZexpected_keywords�keyrW Z error_msgr r r � _get_argsA s � � z print_to_fd.<locals>._get_argsc W sT g }| D ]F}t |tjtjf�s&t|�}t |tj�r>|�|� q|�t�|�� q|S )zCGets a `bytes` string for each item in a list of printable objects.)� isinstancer; � binary_typerH r- r rB )�objectsZ byte_objects�itemr r r �_get_byte_stringsX s z&print_to_fd.<locals>._get_byte_stringsN)r; rB r! � write_to_fd)rs rn rp ru r` rb rd �datar r r � print_to_fd7 s rx c C s� t jr| �|� dS t|t�rtt| d�r2d| jv s>t| tj�rJ| �|� q�t| d�rb| j �|� q�| �t � |�� n&d| jv r�| �t � |�� n | �|� dS )zGWrite given data to given file descriptor, doing any conversions neededN�mode�b�buffer) r; �PY2�writerq �bytes�hasattrry �io�BytesIOr{ rE rB )�fdrw r r r rv r s rv c C s t �dd| �S )z4Returns the input string with all \n and \r removed.z[\r\n]� )r �subrF r r r �RemoveCRLFFromString� s r� c C s6 t �|� tdd� t| �D ��}t�|�}t �� |S )af Generates binary string representation of a list of ASCII characters. Args: size: Integer quantity of characters to generate. seed: A seed may be specified for deterministic behavior. Int 0 is used as the default value. Returns: Binary encoded string representation of a list of characters of length equal to size argument. c S s g | ]}t �tj��qS r )�random�choicerQ � ascii_letters)r �_r r r r � r z*get_random_ascii_chars.<locals>.<listcomp>)r� �seedr- r r; rB )�sizer� �contentsr r r �get_random_ascii_chars� s r� )r )3�__doc__� __future__r r r r r7 r@ �osrg r� r �localere r� r; rQ � six.movesr r �gslib.exceptionr Zgslib.lazy_wrapperr �gslib.utils.constantsr r Zgslib.utils.system_utilr �PY3r. rC r] r+ r( r3 r4 r= rD rG rK rS rU rX r[ r^ r_ rx rv r� r� r r r r �<module> sf � �#*;