OXIESEC PANEL
- Current Dir:
/
/
lib
/
python3.9
/
site-packages
/
S3
/
__pycache__
Server IP: 2a02:4780:11:1594:0:ef5:22d7:a
Upload:
Create Dir:
Name
Size
Modified
Perms
📁
..
-
10/22/2025 07:58:12 AM
rwxr-xr-x
📄
ACL.cpython-39.opt-1.pyc
8.44 KB
12/15/2023 11:05:18 AM
rw-r--r--
📄
ACL.cpython-39.pyc
8.44 KB
12/15/2023 11:05:18 AM
rw-r--r--
📄
AccessLog.cpython-39.opt-1.pyc
3.26 KB
12/15/2023 11:05:18 AM
rw-r--r--
📄
AccessLog.cpython-39.pyc
3.26 KB
12/15/2023 11:05:18 AM
rw-r--r--
📄
BaseUtils.cpython-39.opt-1.pyc
8.33 KB
12/15/2023 11:05:18 AM
rw-r--r--
📄
BaseUtils.cpython-39.pyc
8.33 KB
12/15/2023 11:05:18 AM
rw-r--r--
📄
BidirMap.cpython-39.opt-1.pyc
1.82 KB
12/15/2023 11:05:18 AM
rw-r--r--
📄
BidirMap.cpython-39.pyc
1.82 KB
12/15/2023 11:05:18 AM
rw-r--r--
📄
CloudFront.cpython-39.opt-1.pyc
24.28 KB
12/15/2023 11:05:18 AM
rw-r--r--
📄
CloudFront.cpython-39.pyc
24.28 KB
12/15/2023 11:05:18 AM
rw-r--r--
📄
Config.cpython-39.opt-1.pyc
16.61 KB
12/15/2023 11:05:18 AM
rw-r--r--
📄
Config.cpython-39.pyc
16.61 KB
12/15/2023 11:05:18 AM
rw-r--r--
📄
ConnMan.cpython-39.opt-1.pyc
8.11 KB
12/15/2023 11:05:18 AM
rw-r--r--
📄
ConnMan.cpython-39.pyc
8.11 KB
12/15/2023 11:05:18 AM
rw-r--r--
📄
Crypto.cpython-39.opt-1.pyc
9.2 KB
12/15/2023 11:05:18 AM
rw-r--r--
📄
Crypto.cpython-39.pyc
9.2 KB
12/15/2023 11:05:18 AM
rw-r--r--
📄
Custom_httplib27.cpython-39.opt-1.pyc
4.91 KB
12/15/2023 11:05:18 AM
rw-r--r--
📄
Custom_httplib27.cpython-39.pyc
4.91 KB
12/15/2023 11:05:18 AM
rw-r--r--
📄
Custom_httplib3x.cpython-39.opt-1.pyc
6.04 KB
12/15/2023 11:05:18 AM
rw-r--r--
📄
Custom_httplib3x.cpython-39.pyc
6.04 KB
12/15/2023 11:05:18 AM
rw-r--r--
📄
Exceptions.cpython-39.opt-1.pyc
4.65 KB
12/15/2023 11:05:18 AM
rw-r--r--
📄
Exceptions.cpython-39.pyc
4.65 KB
12/15/2023 11:05:18 AM
rw-r--r--
📄
ExitCodes.cpython-39.opt-1.pyc
1.65 KB
12/15/2023 11:05:18 AM
rw-r--r--
📄
ExitCodes.cpython-39.pyc
1.65 KB
12/15/2023 11:05:18 AM
rw-r--r--
📄
FileDict.cpython-39.opt-1.pyc
2.1 KB
12/15/2023 11:05:18 AM
rw-r--r--
📄
FileDict.cpython-39.pyc
2.1 KB
12/15/2023 11:05:18 AM
rw-r--r--
📄
FileLists.cpython-39.opt-1.pyc
14.46 KB
12/15/2023 11:05:18 AM
rw-r--r--
📄
FileLists.cpython-39.pyc
14.5 KB
12/15/2023 11:05:18 AM
rw-r--r--
📄
HashCache.cpython-39.opt-1.pyc
2.33 KB
12/15/2023 11:05:18 AM
rw-r--r--
📄
HashCache.cpython-39.pyc
2.33 KB
12/15/2023 11:05:18 AM
rw-r--r--
📄
MultiPart.cpython-39.opt-1.pyc
7.93 KB
12/15/2023 11:05:18 AM
rw-r--r--
📄
MultiPart.cpython-39.pyc
7.93 KB
12/15/2023 11:05:18 AM
rw-r--r--
📄
PkgInfo.cpython-39.opt-1.pyc
593 bytes
12/15/2023 11:05:18 AM
rw-r--r--
📄
PkgInfo.cpython-39.pyc
593 bytes
12/15/2023 11:05:18 AM
rw-r--r--
📄
Progress.cpython-39.opt-1.pyc
5.67 KB
12/15/2023 11:05:18 AM
rw-r--r--
📄
Progress.cpython-39.pyc
5.67 KB
12/15/2023 11:05:18 AM
rw-r--r--
📄
S3.cpython-39.opt-1.pyc
55.27 KB
12/15/2023 11:05:18 AM
rw-r--r--
📄
S3.cpython-39.pyc
55.29 KB
12/15/2023 11:05:18 AM
rw-r--r--
📄
S3Uri.cpython-39.opt-1.pyc
8.04 KB
12/15/2023 11:05:18 AM
rw-r--r--
📄
S3Uri.cpython-39.pyc
8.04 KB
12/15/2023 11:05:18 AM
rw-r--r--
📄
SortedDict.cpython-39.opt-1.pyc
3.08 KB
12/15/2023 11:05:18 AM
rw-r--r--
📄
SortedDict.cpython-39.pyc
3.08 KB
12/15/2023 11:05:18 AM
rw-r--r--
📄
Utils.cpython-39.opt-1.pyc
9.02 KB
12/15/2023 11:05:18 AM
rw-r--r--
📄
Utils.cpython-39.pyc
9.02 KB
12/15/2023 11:05:18 AM
rw-r--r--
📄
__init__.cpython-39.opt-1.pyc
138 bytes
12/15/2023 11:05:18 AM
rw-r--r--
📄
__init__.cpython-39.pyc
138 bytes
12/15/2023 11:05:18 AM
rw-r--r--
Editing: MultiPart.cpython-39.pyc
Close
a �9peQ5 � @ s� d dl mZ d dlZd dlmZmZmZmZ ddlm Z ddl m Z ddl m Z ddlmZmZmZmZ dd lmZ d ZG d d � d e�ZdS ) � )�absolute_importN)�debug�info�warning�error� )�calculateChecksum)�ParameterError)�S3UriS3)�getTextFromXml�getTreeFromXml�s3_quote� parseNodes)� formatSizei c @ sl e Zd ZdZdZdZdZddd�Zdd � Zd d � Z d d � Z ddd�Z ddd�Z d dd�Z dd� Zdd� ZdS ) �MultiPartUploadz<Supports MultiPartUpload and MultiPartUpload(Copy) operation� i i P Nc C s� || _ d | _d | _|| _|| _i | _|p*i | _t|t�rZ|| _|sJt d��| j j j t }n|| _| j j j t }|| _| �� | _d S )Nz8Source size is missing for MultipartUploadCopy operation)�s3� file_stream�src_uri�src_size�dst_uri�parts�headers_baseline� isinstancer r �configZ multipart_copy_chunk_size_mb�SIZE_1MBZmultipart_chunk_size_mb� chunk_size�initiate_multipart_upload� upload_id)�selfr �srcr r r Zc_size� r! �0/usr/lib/python3.9/site-packages/S3/MultiPart.py�__init__ s zMultiPartUpload.__init__c C sX | j �||�}t� }|D ]:}z"|d |d d�|t|d �< W q tyP Y q0 q|S )N�ETagZSize)�checksum�sizeZ PartNumber)r Zlist_multipart�dict�int�KeyError)r �urir Z part_listr �elemr! r! r" �get_parts_information3 s � z%MultiPartUpload.get_parts_informationc C s� d}| j �|�}|D ]l}zT|d }|d }td||�� f � ||�� krj|rftd|tjd |f ��|}W q ty~ Y q0 q|S )N� �UploadIdZKeyzmp_path: %s, object: %sz�More than one UploadId for URI %s. Disable multipart upload, or use %s multipart %s to list the Ids, then pass a unique --upload-id into the put command.r )r Z get_multipartr �object� ValueError�sys�argvr) )r r* r Zmultipart_listZmpuploadZ mp_upload_idZmp_pathr! r! r" �get_unique_upload_idB s$ �� z$MultiPartUpload.get_unique_upload_idc C s� | j jjr| j jj| _n | j jjr2| �| j�| _nd| _| jsz| j jd| j| jddid�}| j �|�}|d }t |d�| _| jS )z� Begin a multipart upload http://docs.amazonwebservices.com/AmazonS3/latest/API/index.html?mpUploadInitiate.html r- � OBJECT_POSTZuploadsN�r* �headers� uri_params�datar. ) r r r � put_continuer3 r �create_requestr � send_requestr )r �request�responser8 r! r! r" r W s � z)MultiPartUpload.initiate_multipart_uploadr- c C sT | j std��i }| jr$| j�� }n| jj}| jjjrF| � | j | j �}|rRd| }|| j �� d�}d}| j �r�| j }| j | j | j | j o�d }t d||f � |dk�rz| j |d }t| j | | j �} || 8 }d||dt| d d � |f |d < zB| j�r| j||| ||�|�d � n| j||| ||�|�d � W n: td ||tjd | j | j tjd | j f � � Y n0 |d7 }q�t d|d � dS t d| � | j�| j �} d}t| �} d|dt| d d � |f |d < | �sڐqBz | j||| || |�|�d � W n: td||tjd | j | j tjd | j f � � Y n0 |d7 }�q�t d|d � dS )z� Execute a full multipart upload on a file Returns the seq/etag dict TODO use num_processes to thread it zAAttempting to use a multipart upload that has not been initiated.� )�sourceZ destinationr z#MultiPart: Uploading %s in %d partsr z[part %d of %d, %s]%sz%d%sBT)Zhuman_readableZextra)� remote_statusz� Upload of '%s' part %d failed. Use %s abortmp %s %s to abort the upload, or %s --upload-id %s put ... to continue the upload.z$MultiPart: Upload finished: %d partsNz MultiPart: Uploading from %sz[part %d of -, %s]%szw Upload of '%s' part %d failed. Use %s abortmp %s %s to abort, or %s --upload-id %s put ... to continue the upload.)r r r r* r Z stream_namer r r9 r, r r r r �minr � upload_part�get� copy_partr r1 r2 �read�len) r Z extra_labelZremote_statuses�filename�labels�seqZ size_leftZnr_parts�offsetZcurrent_chunk_size�bufferr! r! r" �upload_all_partsm s� �� � � �� �� �� �� � �� z MultiPartUpload.upload_all_partsc C s t d|| j|f � |dur�t|d �|kr�t|| j||| jjj�}|d �d�}||kr~t d| j |f � |d | j |< dS t d||| j |f � n t dt|d �|| j |f � d t |�i} d | | jd �} | jj d | j | | d �} | jj| | j||||d�} | d �dd��d�| j |< | S )z� Upload a file chunk http://docs.amazonwebservices.com/AmazonS3/latest/API/index.html?mpUploadUploadPart.html z"Uploading part %i of %r (%s bytes)Nr& r% z"'z:MultiPart: size and md5sum match for %s part %d, skipping.zJMultiPart: checksum (%s vs %s) does not match for %s part %d, reuploading.zFMultiPart: size (%d vs %d) does not match for %s part %d, reuploading.�content-length�%s�Z partNumber�uploadId� OBJECT_PUTr5 )rJ r r6 �etagr- )r r r( r r r r Z send_chunk�stripr r r �strr: Z send_filerC ) r rI rJ r rH rK r@ r% Zremote_checksumr6 �query_string_paramsr< r= r! r! r" rB � sJ � �� � �� � �� zMultiPartUpload.upload_partc C s� t d|| j|f � dtd| j�� | j�� f ddd�i}d||| d f |d < d | | jd �}| jjd | j||d �}d|d< | j� |||�} t | d d�p�d| j |< | S )z� Copy a remote file chunk http://docs.amazonwebservices.com/AmazonS3/latest/API/index.html?mpUploadUploadPart.html http://docs.amazonwebservices.com/AmazonS3/latest/API/mpUploadUploadPartCopy.html z Copying part %i of %r (%s bytes)zx-amz-copy-sourcez/%s/%sFT)Zquote_backslashesZunicode_outputz bytes=%d-%dr zx-amz-copy-source-rangerN rO rQ r5 z remote copy�actionr8 r$ r- ) r r r r Zbucketr/ r r: r Zsend_request_with_progressr r ) r rI rJ r rH r@ r6 rU r< r= r! r! r" rD � s2 � ��� �� � �zMultiPartUpload.copy_partc C s� t d| j � g }d}| j�� D ]\}}|�|||f � q dd�|� }dtt|��i}| jj d| j ||d| jid�}| j� |�}|S ) z� Finish a multipart upload http://docs.amazonwebservices.com/AmazonS3/latest/API/index.html?mpUploadComplete.html z MultiPart: Completing upload: %sz7<Part><PartNumber>%i</PartNumber><ETag>%s</ETag></Part>z5<CompleteMultipartUpload>%s</CompleteMultipartUpload>r- rM r4 rP )r* r6 �bodyr7 ) r r r �items�append�joinrT rF r r: r r; ) r Z parts_xmlZpart_xmlrI rR rW r6 r< r= r! r! r" �complete_multipart_upload$ s � � z)MultiPartUpload.complete_multipart_uploadc C s t d| j � d}|S )z� Abort multipart upload http://docs.amazonwebservices.com/AmazonS3/latest/API/index.html?mpUploadAbort.html z MultiPart: Aborting upload: %sN)r r )r r= r! r! r" � abort_upload: s z MultiPartUpload.abort_upload)NN)r- )r- N)N)�__name__� __module__� __qualname__�__doc__ZMIN_CHUNK_SIZE_MBZMAX_CHUNK_SIZE_MBZ MAX_FILE_SIZEr# r, r3 r rL rB rD r[ r\ r! r! r! r" r s" � ` � ) .r )Z __future__r r1 Zloggingr r r r ZCryptor Z Exceptionsr ZS3Urir Z BaseUtilsr r r r ZUtilsr r r/ r r! r! r! r" �<module> s