OXIESEC PANEL
- Current Dir:
/
/
opt
/
gsutil
/
gslib
/
vendored
/
boto
/
boto
/
s3
/
__pycache__
Server IP: 2a02:4780:11:1594:0:ef5:22d7:a
Upload:
Create Dir:
Name
Size
Modified
Perms
📁
..
-
02/11/2025 08:19:48 AM
rwxr-xr-x
📄
__init__.cpython-39.pyc
1.66 KB
02/11/2025 08:19:48 AM
rw-r--r--
📄
acl.cpython-39.pyc
4.58 KB
02/11/2025 08:19:48 AM
rw-r--r--
📄
bucket.cpython-39.pyc
60.9 KB
02/11/2025 08:19:48 AM
rw-r--r--
📄
bucketlistresultset.cpython-39.pyc
4.54 KB
02/11/2025 08:19:48 AM
rw-r--r--
📄
bucketlogging.cpython-39.pyc
2.23 KB
02/11/2025 08:19:48 AM
rw-r--r--
📄
connection.cpython-39.pyc
19.94 KB
02/11/2025 08:19:48 AM
rw-r--r--
📄
cors.cpython-39.pyc
7.01 KB
02/11/2025 08:19:48 AM
rw-r--r--
📄
deletemarker.cpython-39.pyc
1.12 KB
02/11/2025 08:19:48 AM
rw-r--r--
📄
key.cpython-39.pyc
58.73 KB
02/11/2025 08:19:48 AM
rw-r--r--
📄
keyfile.cpython-39.pyc
3.78 KB
02/11/2025 08:19:48 AM
rw-r--r--
📄
lifecycle.cpython-39.pyc
9.59 KB
02/11/2025 08:19:48 AM
rw-r--r--
📄
multidelete.cpython-39.pyc
3.9 KB
02/11/2025 08:19:48 AM
rw-r--r--
📄
multipart.cpython-39.pyc
9.75 KB
02/11/2025 08:19:48 AM
rw-r--r--
📄
prefix.cpython-39.pyc
978 bytes
02/11/2025 08:19:48 AM
rw-r--r--
📄
tagging.cpython-39.pyc
2.71 KB
02/11/2025 08:19:48 AM
rw-r--r--
📄
user.cpython-39.pyc
1.17 KB
02/11/2025 08:19:48 AM
rw-r--r--
📄
website.cpython-39.pyc
9.92 KB
02/11/2025 08:19:48 AM
rw-r--r--
Editing: connection.cpython-39.pyc
Close
a sFg h � @ s8 d dl Zd dlZd dlZd dlmZmZ d dlmZ d dl Z d dl m Z d dl m Z d dlmZ d dlmZ d dlmZ d d lmZmZ d d l mZ d d � Zd d� ZG dd� de�ZG dd� de�Z G dd� de�Z G dd� de�Z G dd� de �Z G dd� de�Z G dd � d e�Z!G d d � d e�Z"G d d � d e �Z#dS )!� N)�six�urllib)�detect_potential_s3sigv4)�AWSAuthConnection)�handler)�Bucket)�Key)� ResultSet)�BotoClientError�S3ResponseError)�get_utf8able_strc C s | d � � std��dS )aJ Bucket names must not contain uppercase characters. We check for this by appending a lowercase character and testing with islower(). Note this also covers cases like numeric bucket names with dashes. >>> check_lowercase_bucketname("Aaaa") Traceback (most recent call last): ... BotoClientError: S3Error: Bucket names cannot contain upper-case characters when using either the sub-domain or virtual hosting calling format. >>> check_lowercase_bucketname("1234-5678-9123") True >>> check_lowercase_bucketname("abcdefg1234") True �azuBucket names cannot contain upper-case characters when using either the sub-domain or virtual hosting calling format.T)�islowerr )�n� r �5/opt/gsutil/gslib/vendored/boto/boto/s3/connection.py�check_lowercase_bucketname) s r c s � fdd�}|S )Nc s& t | �dkrt| d �r� | i |��S )N� � )�lenr )�args�kwargs��fr r �wrapperC s z(assert_case_insensitive.<locals>.wrapperr )r r r r r �assert_case_insensitiveB s r c @ s: e Zd Zdd� Zd dd�Zdd� Zddd �Zdd d �Zd S )�_CallingFormatc C s dS �N� r ��self�server�bucketr r r �get_bucket_serverL s z _CallingFormat.get_bucket_serverr c C s8 dt �|� }|| �||�7 }||�| �||��7 }|S )Nz%s://)r � ensure_text� build_host�get_path�build_path_base�r � connection�protocolr! r" �keyZurl_baser r r �build_url_baseO s z _CallingFormat.build_url_basec C s |dkr |S | � ||�S d S r )r# r r r r r% U s z_CallingFormat.build_hostc C s> t j|dd�}t|�}d}|dkr*d| }|dtj�|� S )N�utf-8)�encodingr �/�/%s)r r$ r r �parse�quote)r r" r+ �pathr r r �build_auth_path[ s z _CallingFormat.build_auth_pathc C s t |�}dtj�|� S )Nr0 �r r r1 r2 )r r" r+ r r r r' c s z _CallingFormat.build_path_baseN)r )r )r )�__name__� __module__� __qualname__r# r, r% r4 r' r r r r r J s r c @ s e Zd Zedd� �ZdS )�SubdomainCallingFormatc C s d||f S )Nz%s.%sr r r r r r# j s z(SubdomainCallingFormat.get_bucket_serverN�r6 r7 r8 r r# r r r r r9 h s r9 c @ s e Zd Zedd� �ZdS )�VHostCallingFormatc C s |S �Nr r r r r r# q s z$VHostCallingFormat.get_bucket_serverNr: r r r r r; o s r; c @ s e Zd Zdd� Zddd�ZdS )�OrdinaryCallingFormatc C s |S r< r r r r r r# x s z'OrdinaryCallingFormat.get_bucket_serverr c C s, t |�}d}|r |d| 7 }|tj�|� S )Nr/ z%s/r5 )r r" r+ Z path_baser r r r' { s z%OrdinaryCallingFormat.build_path_baseN)r )r6 r7 r8 r# r' r r r r r= v s r= c @ s e Zd Zddd�ZdS )�(ProtocolIndependentOrdinaryCallingFormatr c C s. d}|| � ||�7 }||�| �||��7 }|S )Nz//)r% r& r' r( r r r r, � s z7ProtocolIndependentOrdinaryCallingFormat.build_url_baseN)r )r6 r7 r8 r, r r r r r> � s r> c @ s4 e Zd ZdZdZdZdZdZdZdZ dZ d Z d Z d S ) �Locationr �EUz eu-central-1z us-west-1z us-west-2z sa-east-1zap-northeast-1zap-southeast-1zap-southeast-2z cn-north-1N) r6 r7 r8 �DEFAULTr@ Z EUCentral1ZUSWestZUSWest2ZSAEastZ APNortheastZ APSoutheastZ APSoutheast2ZCNNorth1r r r r r? � s r? c @ s e Zd ZdS )�NoHostProvidedN�r6 r7 r8 r r r r rB � s rB c @ s e Zd ZdS )�HostRequiredErrorNrC r r r r rD � s rD c s� e Zd ZdZdZdZddddddddedddddedddddf� fd d � Ze d d � �Z d d� Z dd� Z dd� Z dd� Zd0dd�Zd1d d �Zd2d d �Zd3d d!�Zd4d"d#�Zd5d$d%�Zd6d&d'�Zd7d(d)�Zdejdfd*d+�Zd8d,d-�Zd9� fd.d/� Z� Z S ):� S3Connectionzs3.amazonaws.comz)boto.s3.connection.SubdomainCallingFormatz)Signature=%s&Expires=%d&AWSAccessKeyId=%sNTr r/ �awsc s� || _ | d u r tj�dd| j�} t| tj�r:tj� | �� } | | _ |d u rXtj� ddd�}|| _ | t u r�tj�dd�} | d u r�| j} tt| �j| ||||||||| | | |||||d� d S )N�s3�calling_formatZno_sign_requestF�host)�debug�https_connection_factoryr3 �provider�security_token�suppress_consec_slashes�validate_certs� profile_name)� bucket_class�boto�config�get�DefaultCallingFormat� isinstancer � string_types�utils� find_classrH �getbool�anonrB � DefaultHost�superrE �__init__)r �aws_access_key_id�aws_secret_access_key� is_secure�port�proxy� proxy_port� proxy_user� proxy_passrI rJ rK rH r3 rL rQ rM rN r[ rO rP �� __class__r r r^ � s. � �zS3Connection.__init__c C s | j r dgS dgS d S )Nr[ rG )r[ )r r r r �_required_auth_capability� s z&S3Connection._required_auth_capabilityc c s | � � D ] }|V qd S r< )�get_all_buckets)r r" r r r �__iter__� s zS3Connection.__iter__c C s | � |�d uS r< )�lookup)r � bucket_namer r r � __contains__� s zS3Connection.__contains__c C s || _ dS )aX Set the Bucket class associated with this bucket. By default, this would be the boto.s3.key.Bucket class but if you want to subclass that for some reason this allows you to associate your new class. :type bucket_class: class :param bucket_class: A subclass of Bucket that can be more specific N)rQ )r rQ r r r �set_bucket_class� s z S3Connection.set_bucket_classc C s2 t |tj�sJ d��dt�tjj|�d�|�f S )zX Taken from the AWS book Python examples and modified for use with boto z;Policy document must include a valid expiration Time objectz({"expiration": "%s", "conditions": [%s]}�,)rV �time� struct_time�strftimerR rX �ISO8601�join)r Zexpiration_time� conditionsr r r �build_post_policy� s ��z S3Connection.build_post_policy�p �http�STANDARDc C s� |du r g }| du rg } t �tt � � | ��} | �d| � |�d�rd| �d|dtd� � � n| �d| � |r�| �d| � |�d|d�� |r�| �d | � |�d |d�� |r�| �d | � | jjr�|�d | jjd�� | �d | jj � | �r|�d| d�� | �d| � | �r>|�d| d�� | �d| � | �| | �} t � | �}|�d|d�� |�d| j d�� | j � |�}|�d|d�� |�d|d�� d|| j�| �� |�f }||d�S )a� Taken from the AWS book Python examples and modified for use with boto This only returns the arguments required for the post form, not the actual form. This does not return the file input field which also needs to be added :type bucket_name: string :param bucket_name: Bucket to submit to :type key: string :param key: Key name, optionally add ${filename} to the end to attach the submitted filename :type expires_in: integer :param expires_in: Time (in seconds) before this expires, defaults to 6000 :type acl: string :param acl: A canned ACL. One of: * private * public-read * public-read-write * authenticated-read * bucket-owner-read * bucket-owner-full-control :type success_action_redirect: string :param success_action_redirect: URL to redirect to on success :type max_content_length: integer :param max_content_length: Maximum size for this file :type http_method: string :param http_method: HTTP Method to use, "http" or "https" :type storage_class: string :param storage_class: Storage class to use for storing the object. Valid values: STANDARD | REDUCED_REDUNDANCY :type server_side_encryption: string :param server_side_encryption: Specifies server-side encryption algorithm to use when Amazon S3 creates an object. Valid values: None | AES256 :rtype: dict :return: A dictionary containing field names/values as well as a url to POST to .. code-block:: python Nz{"bucket": "%s"}z ${filename}z ["starts-with", "$key", "%s"]z {"key": "%s"}z {"acl": "%s"}�acl)�name�valuez!{"success_action_redirect": "%s"}�success_action_redirectz ["content-length-range", 0, %i]�x-amz-security-tokenz {"x-amz-security-token": "%s"}zx-amz-storage-classz {"x-amz-storage-class": "%s"}z x-amz-server-side-encryptionz&{"x-amz-server-side-encryption": "%s"}�policy�AWSAccessKeyId� signaturer+ z%s://%s/)�action�fields)rq �gmtime�int�append�endswithr rL rM rw �base64� b64encoder_ � _auth_handler� sign_stringrH r% � server_name)r rm r+ � expires_inr{ r~ Zmax_content_lengthZ http_methodr� rv � storage_classZserver_side_encryption� expirationr� Z policy_b64r� �urlr r r �build_post_form_args� s^ : ��� � ��z!S3Connection.build_post_form_argsr Fc C s� | j �||�} | j �||�} | j �| �� |�} | �d�rD| d d� } i } |d urX|| d< |d urj| �|� | j|| | || | d�}| jj ||| d�S )Nz:443���� VersionId)�headersrI �params)�iso_date) rH r' r4 r% r� r� �updateZbuild_base_http_requestr� �presign)r r� �methodr" r+ r� � force_http�response_headers� version_idr� r3 � auth_pathrI r� � http_requestr r r �generate_url_sigv4l s" � �z S3Connection.generate_url_sigv4c C s | j jd dkr.|r.| j|||||||| d�S |p4i }| rDt|�} ntt�� | �} | j�||�} | �| �} g } | d ur�| �d| � |r�|� � D ]"\}}| �d|t j � |�f � q�| j jr�| j j|d< | r�d| vr�dnd}| |d�| � 7 } | j�||� |�rV| j�sVtj�|| || | j �}| j �|�}t j j |d d �}d| j|| | jf }nd }|�r�| j j}|� � D ]0\}}|�|��rp| �d|t j � |�f � �qp| �r�|�s�dnd}||d�| � 7 }|�r�d }d }n | j}| j}| j� | || � |�||�| S ) Nr z hmac-v4-s3)r" r+ r� r� r� r� z versionId=%sz%s=%sr �?�&r )�safery �P ) r� � capabilityr� r� rq rH r4 r& r� �itemsr r1 r2 rL rM ru r' r[ rR rX �canonical_stringr� � QueryStringr_ � header_prefix� startswithr* rb r, r� )r r� r� r" r+ r� � query_authr� r� �expires_in_absoluter� �expiresr� Zextra_qp�k�v� delimiterZc_string�b64_hmacZencoded_canonicalZ query_partZ hdr_prefixr* rb r r r � generate_url� sh � � � ��zS3Connection.generate_urlc C sv | j d|d�}|�� }|jdkr4| j�|j|j|��td| jfg�}t� || �}t |t �sd|� d�}t j�||� |S )N�GET�r� i, r r- )� make_request�read�statusrL �storage_response_error�reasonr rQ r � XmlHandlerrV �bytes�encode�xml�sax� parseString)r r� �response�body�rs�hr r r rj � s � z S3Connection.get_all_bucketsc C s | j |d�}|jjS )a Convenience method that returns the "CanonicalUserID" of the user who's credentials are associated with the connection. The only way to get this value is to do a GET request on the service which returns all buckets associated with the account. As part of that response, the canonical userid is returned. This method simply does all of that and then returns just the user id. :rtype: string :return: A string containing the canonical user id. r� )rj �owner�id)r r� r� r r r �get_canonical_user_id� s z"S3Connection.get_canonical_user_idc C s" |r| j ||d�S | �| |�S dS )a� Retrieves a bucket by name. If the bucket does not exist, an ``S3ResponseError`` will be raised. If you are unsure if the bucket exists or not, you can use the ``S3Connection.lookup`` method, which will either return a valid bucket or ``None``. If ``validate=False`` is passed, no request is made to the service (no charge/communication delay). This is only safe to do if you are **sure** the bucket exists. If the default ``validate=True`` is passed, a request is made to the service to ensure the bucket exists. Prior to Boto v2.25.0, this fetched a list of keys (but with a max limit set to ``0``, always returning an empty list) in the bucket (& included better error messages), at an increased expense. As of Boto v2.25.0, this now performs a HEAD request (less expensive but worse error messages). If you were relying on parsing the error message before, you should call something like:: bucket = conn.get_bucket('<bucket_name>', validate=False) bucket.get_all_keys(maxkeys=0) :type bucket_name: string :param bucket_name: The name of the bucket :type headers: dict :param headers: Additional headers to pass along with the request to AWS. :type validate: boolean :param validate: If ``True``, it will try to verify the bucket exists on the service-side. (Default: ``True``) r� N)� head_bucketrQ )r rm �validater� r r r � get_bucket� s %zS3Connection.get_bucketc C s� | j d||d�}|�� }|jdkr.| �| |�S |jdkr^| j�|j|j|�}d|_d|_|�nD|jdkr�| j�|j|j|�}d|_d |_|�n| j�|j|j|��d S ) a| Determines if a bucket exists by name. If the bucket does not exist, an ``S3ResponseError`` will be raised. :type bucket_name: string :param bucket_name: The name of the bucket :type headers: dict :param headers: Additional headers to pass along with the request to AWS. :returns: A <Bucket> object �HEADr� �� i� Z AccessDeniedz Access Deniedi� Z NoSuchBucketz#The specified bucket does not existN) r� r� r� rQ rL r� r� � error_code� error_message)r rm r� r� r� �errr r r r� s2 � � �zS3Connection.head_bucketc C s* z| j |||d�}W n d}Y n0 |S )aR Attempts to get a bucket from S3. Works identically to ``S3Connection.get_bucket``, save for that it will return ``None`` if the bucket does not exist instead of throwing an exception. :type bucket_name: string :param bucket_name: The name of the bucket :type headers: dict :param headers: Additional headers to pass along with the request to AWS. :type validate: boolean :param validate: If ``True``, it will try to fetch all keys within the given bucket. (Default: ``True``) r� N)r� )r rm r� r� r" r r r rl 5 s zS3Connection.lookupc C s� t |� |r*|r ||| jj< n | jj|i}|tjkr:d}n d| d }| jd|||d�}|�� }|jdkr~| j�|j|j |��|jdkr�| � | |�S | j� |j|j |��dS ) a Creates a new located bucket. By default it's in the USA. You can pass Location.EU to create a European bucket (S3) or European Union bucket (GCS). :type bucket_name: string :param bucket_name: The name of the new bucket :type headers: dict :param headers: Additional headers to pass along with the request to AWS. :type location: str :param location: The location of the new bucket. You can use one of the constants in :class:`boto.s3.connection.Location` (e.g. Location.EU, Location.USWest, etc.). :type policy: :class:`boto.s3.acl.CannedACLStrings` :param policy: A canned ACL policy that will be applied to the new key in S3. r z/<CreateBucketConfiguration><LocationConstraint>z1</LocationConstraint></CreateBucketConfiguration>�PUT)r� �datai� r� N) r rL � acl_headerr? rA r� r� r� �storage_create_errorr� rQ r� )r rm r� �locationr� r� r� r� r r r � create_bucketN s2 �� � � �zS3Connection.create_bucketc C s: | j d||d�}|�� }|jdkr6| j�|j|j|��dS )a� Removes an S3 bucket. In order to remove the bucket, it must first be empty. If the bucket is not empty, an ``S3ResponseError`` will be raised. :type bucket_name: string :param bucket_name: The name of the bucket :type headers: dict :param headers: Additional headers to pass along with the request to AWS. �DELETEr� �� N)r� r� r� rL r� r� )r r" r� r� r� r r r � delete_bucket} s �zS3Connection.delete_bucketc s� t || j�r|j}t |t�r"|j}| j�||�} tj�d| � | j� ||�} tj�d| � | j� | � � |�} |r�| d| 7 } tj�d| � | d| 7 } tj�d| � t t | �j|| ||| | ||| d� S )Nzpath=%sz auth_path=%sr� )�override_num_retries� retry_handler)rV rQ r| r rH r' rR �logrJ r4 r% r� r] rE r� ) r r� r" r+ r� r� � query_args�senderr� r� r3 r� rI rg r r r� � s( �zS3Connection.make_request) rx NNNry NNrz N)r r NFNNN)r r NTFNFN)N)N)TN)N)TN)N)r r Nr NNNN) r6 r7 r8 r\ rU r� rB r r^ r ri rk rn ro rw r� r� r� rj r� r� r� rl r? rA r� r� r� � __classcell__r r rg r rE � s^ �( � u � � ; * - � / �rE )$�xml.saxr� r� rq � boto.compatr r � boto.authr � boto.utilsrR Zboto.connectionr r �boto.s3.bucketr � boto.s3.keyr �boto.resultsetr �boto.exceptionr r r r r �objectr r9 r; r= r> r? rB rD rE r r r r �<module> s.