OXIESEC PANEL
- Current Dir:
/
/
opt
/
gsutil
/
gslib
/
utils
/
__pycache__
Server IP: 2a02:4780:11:1594:0:ef5:22d7:a
Upload:
Create Dir:
Name
Size
Modified
Perms
📁
..
-
02/11/2025 08:19:48 AM
rwxr-xr-x
📄
__init__.cpython-39.pyc
126 bytes
02/11/2025 08:19:48 AM
rw-r--r--
📄
acl_helper.cpython-39.pyc
9.38 KB
02/11/2025 08:19:49 AM
rw-r--r--
📄
arg_helper.cpython-39.pyc
1.01 KB
02/11/2025 08:19:48 AM
rw-r--r--
📄
boto_util.cpython-39.pyc
16.46 KB
02/11/2025 08:19:48 AM
rw-r--r--
📄
cat_helper.cpython-39.pyc
4.21 KB
02/11/2025 08:19:49 AM
rw-r--r--
📄
cloud_api_helper.cpython-39.pyc
3.29 KB
02/11/2025 08:19:48 AM
rw-r--r--
📄
constants.cpython-39.pyc
2.88 KB
02/11/2025 08:19:48 AM
rw-r--r--
📄
copy_helper.cpython-39.pyc
101.64 KB
02/11/2025 08:19:49 AM
rw-r--r--
📄
encryption_helper.cpython-39.pyc
5.84 KB
02/11/2025 08:19:49 AM
rw-r--r--
📄
execution_util.cpython-39.pyc
1.06 KB
02/11/2025 08:19:48 AM
rw-r--r--
📄
hashing_helper.cpython-39.pyc
15.71 KB
02/11/2025 08:19:48 AM
rw-r--r--
📄
iam_helper.cpython-39.pyc
8.61 KB
02/11/2025 08:19:49 AM
rw-r--r--
📄
ls_helper.cpython-39.pyc
12.4 KB
02/11/2025 08:19:49 AM
rw-r--r--
📄
metadata_util.cpython-39.pyc
3.1 KB
02/11/2025 08:19:48 AM
rw-r--r--
📄
parallelism_framework_util.cpython-39.pyc
11.79 KB
02/11/2025 08:19:48 AM
rw-r--r--
📄
posix_util.cpython-39.pyc
12.46 KB
02/11/2025 08:19:49 AM
rw-r--r--
📄
retention_util.cpython-39.pyc
8.77 KB
02/11/2025 08:19:49 AM
rw-r--r--
📄
retry_util.cpython-39.pyc
2.5 KB
02/11/2025 08:19:49 AM
rw-r--r--
📄
rsync_util.cpython-39.pyc
1.6 KB
02/11/2025 08:19:49 AM
rw-r--r--
📄
shim_util.cpython-39.pyc
19.8 KB
02/11/2025 08:19:49 AM
rw-r--r--
📄
signurl_helper.cpython-39.pyc
4.21 KB
02/11/2025 08:19:49 AM
rw-r--r--
📄
stet_util.cpython-39.pyc
3.35 KB
02/11/2025 08:19:49 AM
rw-r--r--
📄
system_util.cpython-39.pyc
7.9 KB
02/11/2025 08:19:48 AM
rw-r--r--
📄
temporary_file_util.cpython-39.pyc
915 bytes
02/11/2025 08:19:49 AM
rw-r--r--
📄
text_util.cpython-39.pyc
12.62 KB
02/11/2025 08:19:48 AM
rw-r--r--
📄
translation_helper.cpython-39.pyc
25.67 KB
02/11/2025 08:19:48 AM
rw-r--r--
📄
unit_util.cpython-39.pyc
7.01 KB
02/11/2025 08:19:48 AM
rw-r--r--
📄
update_util.cpython-39.pyc
3.39 KB
02/11/2025 08:19:49 AM
rw-r--r--
📄
user_agent_helper.cpython-39.pyc
1.49 KB
02/11/2025 08:19:48 AM
rw-r--r--
📄
version_check.cpython-39.pyc
1.39 KB
02/11/2025 08:19:48 AM
rw-r--r--
📄
wrapped_credentials.cpython-39.pyc
5.81 KB
02/11/2025 08:19:49 AM
rw-r--r--
Editing: translation_helper.cpython-39.pyc
Close
a +(Wg�� � @ s> d Z ddlmZ ddlmZ ddlmZ ddlmZ ddlZddlZddlZddl Z ddl Z ddl m Z ddlZddlmZ dd lmZ ddlZdd lmZ dd lmZ dd lmZ dd lmZ ddlmZ ddlmZ ddlmZ ddlm Z ddlm Z ddlm Z ddl m Z ddl m!Z! ddl"m#Z# ddl"m$Z$ ddl"m%Z% ddl"m&Z& ddl'm(Z( ddl)m*Z+ dd l,m-Z- dd l,m.Z. ej/�r�e0Z1e�2d ej3�Z4e�2d ej3�Z5e�2d ej3�Z6e�2d!ej3�Z7e�2d"ej3�Z8e�2d#ej3�Z9e�2d$ej3�Z:e�2d%ej3�Z;e�2d&ej3�Z<e�2d'ej3�Z=e�2d(ej3�Z>e�2d)ej3�Z?e�2d*ej3�Z@eAe4e5e6e7e8e9e:e;e<e=e>e?h �ZBd+ZCd,ZDe+jEjFd-d.gd/�gZGe+jHd0d1�ZId2d3� ZJd4d5� ZKd6d7� ZLdUd9d:�ZMdVd;d<�ZNd=d>� ZOdWd?d@�ZPdAdB� ZQdXdCdD�ZRdEdF� ZSG dGdH� dHeT�ZUG dIdJ� dJeT�ZVdKdL� ZWdMdN� ZXdOdP� ZYG dQdR� dReT�ZZG dSdT� dTeT�Z[dS )YzDUtility module for translating XML API objects to/from JSON objects.� )�absolute_import)�print_function)�division)�unicode_literalsN)� ParseError)�decode_datetime)�encoding)�ACL)�ALL_AUTHENTICATED_USERS)� ALL_USERS)�Entries)�Entry)�GROUP_BY_DOMAIN)�GROUP_BY_EMAIL)� GROUP_BY_ID)� USER_BY_EMAIL)� USER_BY_ID)�Tags)�TagSet)�ArgumentException��BucketNotFoundException)�NotFoundException)� Preconditions)�CommandException)�storage_v1_messages)�S3_ACL_MARKER_GUID)�S3_MARKER_GUIDSz^cache-controlz^content-dispositionz^content-encodingz^content-languagez ^content-md5z ^content-typez ^custom-timez^x-goog-api-versionz^x-goog-if-generation-matchz ^x-goog-if-metageneration-matchz ^x-goog-meta-(?P<header_key>.*)z ^x-amz-meta-(?P<header_key>.*)z^x-amz-(?P<header_key>.*)zcustom-amz-headerzapplication/octet-stream����REMOVE_CORS_CONFIG)� maxAgeSeconds�method�PRIVATE_DEFAULT_OBJ_ACL)�idc s8 i }| � � D ]&\� }t� fdd�tD ��s ||� < q |S )Nc 3 s | ]}|� � �V qd S �N)�match)�.0�regex��header� �-/opt/gsutil/gslib/utils/translation_helper.py� <genexpr>y � z(GetNonMetadataHeaders.<locals>.<genexpr>)�items�any�metadata_header_regexes)�headersZarbitrary_headers�valuer* r( r+ �GetNonMetadataHeadersv s r3 c C s� t �� }| �� D �]�\}}t�|�r0|�� |_qt�|�rF|�� |_qt �|�r\|�� |_ qt �|�rr|�� |_ qt �|�r�|�� |_qt�|�r�|s�t|_n |�� |_qt�|�r�t|�� �|_qt�|�r�qqt�|�r�qqt�|�r�qqt�|�}t�|�}t�|�}d}|�r"|�d�}n&|�r4|�d�}n|�rHt |�d� }|r|� � dk�r\q|j �spt j� � |_ |j j �s�g |j _ |j j �!t jj j"||d�� q|S )a� Creates object metadata according to the provided headers. gsutil -h allows specifiying various headers (originally intended to be passed to boto in gsutil v3). For the JSON API to be compatible with this option, we need to parse these headers into gsutil_api Object fields. Args: headers: Dict of headers passed via gsutil -h Raises: ArgumentException if an invalid header is encountered. Returns: apitools Object with relevant fields populated from headers. N� header_keyzx-goog-content-language��keyr2 )#�apitools_messages�Objectr. �CACHE_CONTROL_REGEXr% �strip� cacheControl�CONTENT_DISPOSITION_REGEX�contentDisposition�CONTENT_ENCODING_REGEX�contentEncoding�CONTENT_MD5_REGEX�md5Hash�CONTENT_LANGUAGE_REGEX�contentLanguage�CONTENT_TYPE_REGEX�DEFAULT_CONTENT_TYPE� contentType�CUSTOM_TIME_REGEXr � customTime�GOOG_API_VERSION_REGEX�GOOG_GENERATION_MATCH_REGEX� GOOG_METAGENERATION_MATCH_REGEX�CUSTOM_GOOG_METADATA_REGEX�CUSTOM_AMZ_METADATA_REGEX�CUSTOM_AMZ_HEADER_REGEX�group�S3_HEADER_PREFIX�lower�metadata� MetadataValue�additionalProperties�append�AdditionalProperty)r1 � obj_metadatar) r2 Zcustom_goog_metadata_matchZcustom_amz_metadata_matchZcustom_amz_header_matchr4 r* r* r+ �ObjectMetadataFromHeaders~ sb � ��rX c C s2 i }| s dS | j dur4| j s&d|d< n| j �� |d< | jrX| jsJd|d< n| j�� |d< | jr|| jsnd|d< n| j�� |d< | jr�| js�d|d< n| j�� |d< | jr�| js�d|d< n| j�� |d< | jdur�| js�d|d< n| j�� |d< | jdu�r| j�s d|d< n| j�� |d< | j�rfd }|d k�r8d | }n |d k�rLd | }n t d| ��| j�� ||< | j �r.| j j �r.| j j D ]�}|j dk�r��q�|j t v �r��q�|d k�r�d|j }nH|d k�r�|j �t��r�d |j tt�d� }n d|j }n t d| ��|jdu�r |j�s d||< n |j||< �q�|S )z�Creates a header dictionary based on existing object metadata. Args: dst_obj_metadata: Object metadata to create the headers from. provider: Provider string ('gs' or 's3'). Returns: Headers dictionary. Nz cache-controlzcontent-dispositionzcontent-encodingzcontent-languagez Content-MD5z content-typez custom-timez storage-class�gszx-goog-�s3zx-amz-z Invalid provider specified: %sz x-goog-meta-z x-amz-meta-)r; r: r= r? rC rA rF rH � storageClassr rR rT r6 r � startswithrP �lenr2 )�dst_obj_metadata�providerr1 � header_nameZadditional_propertyr* r* r+ �HeadersFromObjectMetadata� s~ � � � � ra Fc C s� |s |j s| j |_ |s |js$| j|_|s.|js6| j|_|s@|jsH| j|_|sR|jsZ| j|_|sd|jsl| j|_|sv|js~| j|_t| ||d� dS )ab Copies metadata from src_obj_metadata to dst_obj_metadata. Args: src_obj_metadata: Metadata from source object. dst_obj_metadata: Initialized metadata for destination object. override: If true, will overwrite metadata in destination object. If false, only writes metadata for values that don't already exist. )�overrideN)r; r= r? rC rF rH rA �CopyCustomMetadata)�src_obj_metadatar^ rb r* r* r+ �CopyObjectMetadata s re c C s� | j r�| j jr�|j s tj�� |_ |j js0g |j _i }|j jD ]}|j||j< q<| j jD ]R}|j|v r�|r�|jdur�|js�d||j< q�|j||j< qV|jdkrV|j||j< qVg |j _t�|�D ]$\}}|j j� tjjj ||d�� q�dS )ai Copies custom metadata from src_obj_metadata to dst_obj_metadata. Args: src_obj_metadata: Metadata from source object. dst_obj_metadata: Initialized metadata for destination object. override: If true, will overwrite metadata in destination object. If false, only writes metadata for values that don't already exist. N� r5 ) rR rT r7 r8 rS r2 r6 �six� iteritemsrU rV )rd r^ rb Zdst_metadata_dictZdst_propZsrc_prop�k�vr* r* r+ rc 9 s2 � ��rc c C sv t � }z>| �� D ]0\}}t�|�r,t|�|_t�|�rt|�|_qW n, typ } zt d��W Y d}~n d}~0 0 |S )a Creates bucket or object preconditions acccording to the provided headers. Args: headers: Dict of headers passed via gsutil -h Returns: gsutil Cloud API Preconditions object fields populated from headers, or None if no precondition headers are present. z�Invalid precondition header specified. x-goog-if-generation-match and x-goog-if-metageneration match must be specified with a positive integer value.N) r r. rJ r% �long� gen_matchrK �meta_gen_match� ValueErrorr )r1 Zreturn_preconditionsr) r2 �_r* r* r+ �PreconditionsFromHeadersc s rp c C sR d| |f }|rF|rFd|||f }|r6|dt |� 7 }td||f �S td| �S )a� Creates a NotFoundException for an object upload or copy. This is necessary because 404s don't necessarily specify which resource does not exist. Args: dst_provider: String abbreviation of destination provider, e.g., 'gs'. dst_bucket_name: Destination bucket name for the write operation. src_provider: String abbreviation of source provider, i.e. 'gs', if any. src_bucket_name: Source bucket name, if any (for the copy case). src_object_name: Source object name, if any (for the copy case). src_generation: Source object generation, if any (for the copy case). Returns: NotFoundException with appropriate message. z%s://%s� %s://%s/%s�#%szAThe source object %s or the destination bucket %s does not exist.zZThe destination bucket %s does not exist or the write to the destination must be restarted��strr )Z dst_provider�dst_bucket_name� src_provider�src_bucket_name�src_object_name�src_generationZdst_url_stringZsrc_url_stringr* r* r+ �%CreateNotFoundExceptionForObjectWrite| s" �����rz c C s t d||f || d�S )Nz %s://%s bucket does not exist.��statusr )�coder_ � bucket_namer* r* r+ � CreateBucketNotFoundException� s ��r c C s2 d|||f }|r"|dt |� 7 }td| | d�S )Nrq rr z%s does not exist.r{ rs )r} r_ r~ � object_name� generation� uri_stringr* r* r+ � CreateObjectNotFoundException� s r� c C s^ z6t jj�t|�� td�t�d� | | � � �����W n t yH Y n0 td| |f ��dS )z=Checks a JSON parse exception for provided XML configuration.� a XML {0} data provided; Google Cloud Storage {0} configuration now uses JSON format. To convert your {0}, set the desired XML ACL using 'gsutil {1} set ...' with gsutil version 3.x. Then use 'gsutil {1} get ...' with gsutil version 4 or greater to get the corresponding JSON {0}.z)JSON %s data could not be loaded from: %sN) �xml�etree� ElementTreeZ fromstringrt r �join�textwrap�wrap�formatrQ � XmlParseError)Zconfig_type_string�json_txtr* r* r+ � CheckForXmlConfigurationAndRaise� s ��� �r� c @ sL e Zd ZdZedd� �Zedd� �Zedd� �Zedd � �Zed d � �Z d S ) �LifecycleTranslationz�Functions for converting between various lifecycle formats. This class handles conversation to and from Boto Cors objects, JSON text, and apitools Message objects. c C sN t jj�� }|�rJ|jD �].}t jj�� }|jr||jjr||jj�� dkrVt jjj |_n&|jj�� dkr|t jjj |_|jj |_ |j �r>|j jdur�t|j j�|jt jjj< |j jr�t|j j�|jt jjj< |j jdur�t|j j��� |jt jjj< |j j�rdd� |j jD �|jt jjj< |j jdu�r>t|j j�|jt jjj< |�|� q|S )z:Translates an apitools message to a boto lifecycle object.�deleteZsetstorageclassNc S s g | ] }t |��qS r* )rt )r& �scr* r* r+ � <listcomp>� s zALifecycleTranslation.BotoLifecycleFromMessage.<locals>.<listcomp>)�botorY � lifecycle�LifecycleConfig�rule�Rule�action�typerQ �DELETE�SET_STORAGE_CLASSr[ � action_text� condition�agert � conditions�AGE� createdBefore�CREATED_BEFORE�isLive�IS_LIVE�matchesStorageClass�MATCHES_STORAGE_CLASS�numNewerVersions�NUM_NEWER_VERSIONSrU )�cls�lifecycle_message�boto_lifecycleZ rule_message� boto_ruler* r* r+ �BotoLifecycleFromMessage� s@ �� � �� z-LifecycleTranslation.BotoLifecycleFromMessagec C s� d}|�r�t j�� }|D �]�}t jj�� }t jjj�� |_|jr�|jtjj j krft jjjj dd�|_n(|jtjj j kr�t jjjj d|j d�|_tjj j|jv r�t|jtjj j �|j_tjj j|jv r�t�|jtjj j �|j_tjj j|jv �rF|jtjj j �� }|dk�rd|j_n,|dk�r.d |j_ntd |jtjj j ��tjj j|jv �r~|jtjj j D ]}|jj� |� �qhtjj j |jv �r�t|jtjj j �|j_ |j � |� q|S ) z:Translates a boto lifecycle object to an apitools message.N�Delete)r� �SetStorageClass)r� r[ �trueT�falseFzRGot an invalid Boto value for IsLive condition ("%s"), expected "true" or "false".) r7 �Bucket�LifecycleValue�RuleValueListEntry�ConditionValuer� r� r� rY r� r� � ActionValuer� r� r� r� �intr� r� r� � TranslateBotoLifecycleTimestampr� r� rQ r� r r� r� rU r� r� r� )r� r� r� r� Zlifecycle_ruleZboto_is_live_str� storage_classr* r* r+ �BotoLifecycleToMessage� s` � � ����� ����z+LifecycleTranslation.BotoLifecycleToMessagec C s t t�|��d S )z1Translates an apitools message to lifecycle JSON.r� )rt r � MessageToJson)r� r� r* r* r+ �JsonLifecycleFromMessage! s z-LifecycleTranslation.JsonLifecycleFromMessagec C sV z4t �|�}d|v r |d }t�|p&i tjj�}|W S tyP td|� Y n0 dS )z1Translates lifecycle JSON to an apitools message.r� N) �json�loadsr � DictToMessager7 r� r� rn r� )r� r� Zdeserialized_lifecycler� r* r* r+ �JsonLifecycleToMessage& s � z+LifecycleTranslation.JsonLifecycleToMessagec C s t j �|d��� S )zDParses the timestamp from the boto lifecycle into a datetime object.z%Y-%m-%d)�datetime�strptime�date)r� Zlifecycle_datetimer* r* r+ r� 8 s z4LifecycleTranslation.TranslateBotoLifecycleTimestampN) �__name__� __module__� __qualname__�__doc__� classmethodr� r� r� r� r� r* r* r* r+ r� � s " 1 r� c @ s@ e Zd ZdZedd� �Zedd� �Zedd� �Zedd � �Zd S ) �CorsTranslationz�Functions for converting between various CORS formats. This class handles conversation to and from Boto Cors objects, JSON text, and apitools Message objects. c C s t jj�� }g |_|D ]�}g }|jr>|�t jjjt|j�f� |jr|g }|jD ]}|�t jjj |f� qN|�t jjj |f� |j r�g }|j D ]}|�t jjj |f� q�|�t jjj |f� |jr�g } |jD ]} | �t jjj| f� q�|�t jjj| f� |j�|� q|S )z5Translates an apitools message to a boto Cors object.)r� rY �cors�Corsr rU � MAXAGESECrt r! �METHOD�METHODS�origin�ORIGIN�ORIGINS�responseHeader�HEADER�HEADERS) r� � cors_messager� �collection_messageZcollection_elementsZmethod_elementsr! Zorigin_elementsr� Zheader_elementsr) r* r* r+ �BotoCorsFromMessageE s2 � z#CorsTranslation.BotoCorsFromMessagec C s� g }|j r�|j D ]�}|rtj�� }|D ]�}|d tjj jkrJt|d �|_|d tjj j krz|d D ]}|j � |d � qd|d tjj j kr�|d D ]}|j � |d � q�|d tjj jkr&|d D ]}|j� |d � q�q&|� |� q|S )z5Translates a boto Cors object to an apitools message.r � )r� r7 r� �CorsValueListEntryr� rY r� r� r r� r! rU r� r� r� r� ) r� � boto_corsZ message_corsZcors_collectionr� Z element_tupleZ method_tupleZ origin_tupleZ header_tupler* r* r+ �BotoCorsToMessagea s& z!CorsTranslation.BotoCorsToMessagec C sj d}zt �|�}W n ty. td|� Y n0 t|t�sBtd��g }|D ]}|�t� |t j j �� qJ|S )a0 Translates CORS JSON to an apitools message. Args: json_cors: JSON string representing CORS configuration. Raises: ArgumentException on invalid CORS JSON data. Returns: List of apitools Bucket.CorsValueListEntry. An empty list represents no CORS configuration. N�CORSzdCORS JSON should be formatted as a list containing one or more JSON objects. See "gsutil help cors".) r� r� rn r� � isinstance�listr rU r r� r7 r� r� )r� Z json_corsZdeserialized_corsr� � cors_entryr* r* r+ �JsonCorsToMessageEntriesx s" ���z(CorsTranslation.JsonCorsToMessageEntriesc C sF d}|d7 }d}|D ]$}|r&|d7 }nd}|t �|�7 }q|d7 }|S )z,Translates an apitools message to CORS JSON.rf �[F�,Tz] )r r� )r� r� Z json_textZ printed_oner� r* r* r+ �MessageEntriesToJson� s z$CorsTranslation.MessageEntriesToJsonN) r� r� r� r� r� r� r� r� r� r* r* r* r+ r� > s r� c C s8 | r4| j r4| j jr4| j jD ]}|jtkr|j S qdS )z�Retrieves GUID-marked S3 ACL from object metadata, if present. Args: object_metadata: Object metadata to check. Returns: S3 ACL text, if present, None otherwise. N)rR rT r6 r r2 )�object_metadata�propr* r* r+ � S3MarkerAclFromObjectMetadata� s � r� c C sB | j stj�� | _ | j js"g | j _| j j�tjjjt|d�� dS )z�Adds a GUID-marked S3 ACL to the object metadata. Args: object_metadata: Object metadata to add the acl to. acl_text: S3 ACL text to add. r5 N)rR r7 r8 rS rT rU rV r )r� �acl_textr* r* r+ � AddS3MarkerAclToObjectMetadata� s ��r� c C st t | �dkr tdt | � ��| �� d \}}tjj�|�}t|�� �D ] \}}tjj�||�}||_ qFtjj� |�S )a~ Generates XML representation of a nested dict. This dict contains exactly one top-level entry and an arbitrary number of 2nd-level entries, e.g. capturing a WebsiteConfiguration message. Args: message: The dict encoding the message. Returns: XML string representation of the input dict. Raises: Exception: if dict contains more than one top-level entry. r� z$Expected dict of size 1, got size %dr ) r] � Exceptionr. r� r� r� �Element�sortedZ SubElement�textZtostring)�message�name�contentZ element_typeZelement_propertyr2 �noder* r* r+ �UnaryDictToXml� s r� c @ sB e Zd ZdZedd� �Zedd� �Zed dd��Zed d � �Zd S ) �LabelTranslationz�Functions for converting between various Label(JSON)/Tags(XML) formats. This class handles conversion to and from Boto Tags objects, JSON text, and apitools LabelsValue message objects. c C s8 i }|D ] }|� tdd� |D ��� q|r4| �|�S d S )Nc s s | ]}|j |jfV qd S r$ r5 )r& �ir* r* r+ r, � r- z5LabelTranslation.BotoTagsToMessage.<locals>.<genexpr>)�update�dictr� )r� �tags� label_dict�tag_setr* r* r+ �BotoTagsToMessage� s z"LabelTranslation.BotoTagsToMessagec C sN t �| �|��}t� }t�|�D ]\}}|r |�||� q t� }|�|� |S r$ ) r� r� �JsonFromMessager rg rh �add_tagr � add_tag_set)r� r� r� r� r6 r2 r� r* r* r+ �BotoTagsFromMessage� s z$LabelTranslation.BotoTagsFromMessageFc C s* t �|�}|r&tjt�|�dddd�S |S )NT� �r� z: �� sort_keys�indent� separators)r r� r� �dumpsr� )r� r� Z pretty_print�json_strr* r* r+ r� � s �z LabelTranslation.JsonFromMessagec C s t �|tjj�S r$ )r r� r7 r� � LabelsValue)r� r� r* r* r+ r� s �z LabelTranslation.DictToMessageN)F) r� r� r� r� r� r� r� r� r� r* r* r* r+ r� � s r� c @ s� e Zd ZdZdddd�Zdddd �Zed d � �Zed d � �Zedd� �Z edd� �Z edd� �Z edd� �Z edd� �Z edd� �Zedd� �Zed d � �Zed d � �Zd S )!�AclTranslationz�Functions for converting between various ACL formats. This class handles conversion to and from Boto ACL objects, JSON text, and apitools Message objects. �READ�WRITE� FULL_CONTROL)�READER�WRITER�OWNERr r r )r r r c C s t � }d |_| �||�|_|S r$ )r �parent�BotoEntriesFromJson�entries)r� �acl_json�aclr* r* r+ �BotoAclFromJson s z AclTranslation.BotoAclFromJsonc C s4 g }|D ] }|t kr q*|�t�|�� q| �|�S r$ )r" rU r � MessageToDictr )r� Z acl_messageZ acl_dictsr� r* r* r+ �BotoAclFromMessage& s z!AclTranslation.BotoAclFromMessagec C s t |d�r| �|j�S g S )Nr )�hasattr�BotoEntriesToJsonr )r� r r* r* r+ � BotoAclToJson2 s z AclTranslation.BotoAclToJsonc c s. | � |�D ] }t�|tj�}d|_|V q d S )N�storage#objectAccessControl)r r r� r7 �ObjectAccessControl�kind�r� r �entryr� r* r* r+ �BotoObjectAclToMessage8 s �z%AclTranslation.BotoObjectAclToMessagec c s. | � |�D ] }t�|tj�}d|_|V q d S )Nzstorage#bucketAccessControl)r r r� r7 �BucketAccessControlr r r* r* r+ �BotoBucketAclToMessage@ s �z%AclTranslation.BotoBucketAclToMessagec s& t |�}||_� fdd�|D �|_|S )Nc s g | ]}� � |��qS r* )�BotoEntryFromJson)r& � entry_json�r� r* r+ r� L s z6AclTranslation.BotoEntriesFromJson.<locals>.<listcomp>)r r � entry_list)r� r r r r* r# r+ r H s �z"AclTranslation.BotoEntriesFromJsonc s � fdd�|j D �S )Nc s g | ]}� � |��qS r* )�BotoEntryToJson)r& r r# r* r+ r� S r- z4AclTranslation.BotoEntriesToJson.<locals>.<listcomp>)r$ )r� r r* r# r+ r Q s z AclTranslation.BotoEntriesToJsonc C s |d }| j |d }|�� t�� kr2tt|d�S |�� t�� krNtt|d�S |�d�rbtd��n�d|v r�|�d�rzt}n|�d�r�t}t||d |d �S d |v r�|�d�r�t }n|�d�r�t }t||d |d �S d |v � r�|�d �r�t }t||d |d �S td��dS )z,Converts a JSON entry into a Boto ACL entry.�entity�role)r� � permission�projectz>XML API does not support project scopes, cannot translate ACL.�email�userrO )r� � email_addressr( �entityId)r� r# r( �domain)r� r. r( z$Failed to translate JSON ACL to XML.N) �JSON_TO_XML_ROLESrQ r r r r\ r r r r r r )r� r" r& r( Z scope_typer* r* r+ r! U sD � � �z AclTranslation.BotoEntryFromJsonc C s0 i }|j j�� }|t�� kr&d|d< n�|t�� kr<d|d< n�|t�� krfd|j j |d< |j j|d< n�|t�� kr�d|j j |d< |j j|d< n�|t �� kr�d|j j |d< |j j|d< nb|t �� kr�d|j j |d< |j j|d< n8|t �� k�rd|j j |d< |j j |d < n t d | ��| j|j |d < |S ) z5Converts a Boto ACL entry to a valid JSON dictionary.ZallUsersr& ZallAuthenticatedUserszuser-%sr* r- zgroup-%sz domain-%sr. z#ACL contains invalid scope type: %sr' )�scoper� rQ r r r r, r r# r r r r. r �XML_TO_JSON_ROLESr( )r� r Zacl_entry_jsonZscope_type_lowerr* r* r+ r% y s4 �z AclTranslation.BotoEntryToJsonc C sR z0t �|�}g }|D ]}|�t�||�� q|W S tyL td|� Y n0 dS )a� Converts the input JSON data into list of Object/BucketAccessControls. Args: json_data: String of JSON to convert. message_type: Which type of access control entries to return, either ObjectAccessControl or BucketAccessControl. Raises: ArgumentException on invalid JSON data. Returns: List of ObjectAccessControl or BucketAccessControl elements. r N)r� r� rU r r� rn r� )r� � json_data� message_typeZdeserialized_aclr � acl_entryr* r* r+ � JsonToMessage� s z AclTranslation.JsonToMessagec C sl g }|durZ|D ]H}|j dkr*d|_d|_d|_ d|_d|_d|_d|_|�t� |�� qt j |dddd�S )z�Strips unnecessary fields from an ACL message and returns valid JSON. Args: acl: iterable ObjectAccessControl or BucketAccessControl Returns: ACL JSON string. Nr Tr� r� r ) r �objectr� �bucketr# �selfLink�etagrU r r r� r )r� r Zserializable_aclr4 r* r* r+ r� � s" �z AclTranslation.JsonFromMessageN)r� r� r� r� r/ r1 r� r r r r r r r r! r% r5 r� r* r* r* r+ r s> �� # r )F)F)NNNN)N)\r� � __future__r r r r r� r� �rer� Zxml.etree.ElementTreer� r r� rg Z apitools.base.protorpclite.utilr �apitools.base.pyr r� � boto.gs.aclr r r r r r r r r r �boto.s3.taggingr r �gslib.cloud_apir r r r �gslib.exceptionr �"gslib.third_party.storage_apitoolsr r7 �gslib.utils.constantsr r �PY3r� rk �compile�Ir9 r< r> rB r@ rD rG rI rJ rK rL rM rN � frozensetr0 rP rE r� r� r r r" r3 rX ra re rc rp rz r r� r� r6 r� r� r� r� r� r� r r* r* r* r+ �<module> s� ��� �� �IW * � % � yk)