88 lines
7.6 KiB
Plaintext
88 lines
7.6 KiB
Plaintext
|
B
|
|||
|
|
<00>[<5B>]<5D>3 <00> @ s<> d dl Z d dlZd dlmZ d dlmZ d dlmZ d dlmZ d dlmZ d dlm Z d dlm
|
|||
|
|
Z
|
|||
|
|
d d lm Z G d
|
|||
|
|
d <0B> d e<04>Z G d d
<0A> d
e<03>Z
G dd<0F> de<03>ZdS )<10> N)<01>Task)<01>SubmissionTask)<01>CreateMultipartUploadTask)<01>CompleteMultipartUploadTask)<01>
get_callbacks)<01>calculate_range_parameter)<01>get_filtered_dict)<01>ChunksizeAdjusterc @ s<> e Zd ZdZdddddddd d
|
|||
|
|
<EFBFBD>Zd d d
dddddddd g Zd d d
dddddgZd gZdd<14> Zdd<16> Z dd<18> Z
|
|||
|
|
dd<1A> Z dd <1C> Z d d <1E> Z
d d <20> Zd!S )"<22>CopySubmissionTaskz+Task for submitting tasks to execute a copyZIfMatchZIfModifiedSinceZ IfNoneMatchZIfUnmodifiedSinceZSSECustomerKeyZSSECustomerAlgorithmZSSECustomerKeyMD5<44> RequestPayer)<08>CopySourceIfMatch<63>CopySourceIfModifiedSince<63>CopySourceIfNoneMatch<63>CopySourceIfUnmodifiedSince<63>CopySourceSSECustomerKey<65> CopySourceSSECustomerAlgorithm<68>CopySourceSSECustomerKeyMD5r r r
r r r r r ZMetadataDirectivec C s<> |j jdkrr|j j}| <00>|j<04>}|j}x,|<08><06> D ] \} }
|
|||
|
|
| | jkr0|
|
|||
|
|
|| j| < q0W |jj f |<07>} |j <00>
|
|||
|
|
| d <00> |j j|j k r<>| <00> |||||<05> n| <00>
|||||<05> dS )a<>
|
|||
|
|
:param client: The client associated with the transfer manager
|
|||
|
|
|
|||
|
|
:type config: s3transfer.manager.TransferConfig
|
|||
|
|
:param config: The transfer config associated with the transfer
|
|||
|
|
manager
|
|||
|
|
|
|||
|
|
:type osutil: s3transfer.utils.OSUtil
|
|||
|
|
:param osutil: The os utility associated to the transfer manager
|
|||
|
|
|
|||
|
|
:type request_executor: s3transfer.futures.BoundedExecutor
|
|||
|
|
:param request_executor: The request executor associated with the
|
|||
|
|
transfer manager
|
|||
|
|
|
|||
|
|
:type transfer_future: s3transfer.futures.TransferFuture
|
|||
|
|
:param transfer_future: The transfer future associated with the
|
|||
|
|
transfer request that tasks are being submitted for
|
|||
|
|
NZ
ContentLength)<0E>meta<74>size<7A> call_args<67>)_get_head_object_request_from_copy_source<63> copy_source<63>
|
|||
|
|
extra_args<EFBFBD>items<6D> EXTRA_ARGS_TO_HEAD_ARGS_MAPPINGZ
source_clientZ head_objectZprovide_transfer_sizeZmultipart_threshold<6C>_submit_copy_request<73>_submit_multipart_request) <0C>self<6C>client<6E>config<69>osutil<69>request_executor<6F>transfer_futurer Zhead_object_requestr <00>param<61>value<75>response<73> r& <00>9/tmp/pip-install-u_6_z2pz/s3transfer/s3transfer/copies.py<70>_submitE s"
|
|||
|
|
|
|||
|
|
zCopySubmissionTask._submitc
C sL |j j}t|d<01>}| j<03>|t| j||j|j|j|j ||j j
|
|||
|
|
d<02>dd<04><03> d S )N<>progress)r r <00>bucket<65>keyr <00> callbacksr T)<03>transfer_coordinator<6F> main_kwargs<67>is_final) r r r <00>_transfer_coordinator<6F>submit<69>CopyObjectTaskr r* r+ r r )r r r r r! r" r <00>progress_callbacksr& r& r' r { s
|
|||
|
|
|
|||
|
|
z'CopySubmissionTask._submit_copy_requestc C sr |j j}i }x(|j<02><03> D ]\}} || jkr| ||< qW | j<05>|t| j||j|j |d<01>d<02><02>}
|
|||
|
|
|j
|
|||
|
|
} t <0B> } | <0C> | |j j
<0A>} tt<0F>|j j
t| <0B> <00><01>}
g }t|d<03>}x<>td|
d <00>D ]~}| <00>|j<02>}t| |d |
|j j
<0A>|d< | <00>| |d |
|j j
<0A>}|<0E>| j<05>|t| j||j|j|j ||||d<06>d|
|
|||
|
|
id<08><03><02> q<>W | <00>|j<02>}| j<05>|t| j||j|j |d<01>|
|
|||
|
|
|d <09>d
|
|||
|
|
d <0B><04> d S ) N)r r* r+ r )r- r. r) <00> ZCopySourceRange)r r r* r+ <00> part_numberr r, r <00> upload_id)r- r. <00>pending_main_kwargs)r6 <00>partsT)r- r. r7 r/ ) r r r r <00> CREATE_MULTIPART_ARGS_BLACKLISTr0 r1 r r* r+ Zmultipart_chunksizer Zadjust_chunksizer <00>int<6E>math<74>ceil<69>floatr <00>range<67>_extra_upload_part_argsr <00>_get_transfer_size<7A>append<6E> CopyPartTaskr <00> _extra_complete_multipart_argsr )r r r r r! r" r Zcreate_multipart_extra_argsr# <00>valZcreate_multipart_future<72> part_sizeZadjuster<65> num_partsZ part_futuresr3 r5 Zextra_part_argsr Z complete_multipart_extra_argsr& r& r' r <00> sn
|
|||
|
|
|
|||
|
|
z,CopySubmissionTask._submit_multipart_requestc C s, t |t<01>rt<02>|<01>S td|t|<01>f <00><01>d S )NzZExpecting dictionary formatted: {"Bucket": bucket_name, "Key": key} but got %s or type %s.)<05>
|
|||
|
|
isinstance<EFBFBD>dict<63>copy<70> TypeError<6F>type)r r r& r& r' r <00> s
|
|||
|
|
|
|||
|
|
|
|||
|
|
z<CopySubmissionTask._get_head_object_request_from_copy_sourcec C s t || j<01>S )N)r <00>UPLOAD_PART_COPY_ARGS)r r r& r& r' r? <00> s z*CopySubmissionTask._extra_upload_part_argsc C s t || j<01>S )N)r <00>COMPLETE_MULTIPART_ARGS)r r r& r& r' rC s z1CopySubmissionTask._extra_complete_multipart_argsc C s ||d kr||| S |S )Nr4 r& )r rE Z
|
|||
|
|
part_indexrF Ztotal_transfer_sizer& r& r' r@ s z%CopySubmissionTask._get_transfer_sizeN)<0F>__name__<5F>
|
|||
|
|
__module__<EFBFBD> __qualname__<5F>__doc__r rL r9 rM r( r r r r? rC r@ r& r& r& r' r
|
|||
|
|
sH 6] r
|
|||
|
|
c @ s e Zd ZdZdd<03> ZdS )r2 z Task to do a nonmultipart copyc C s4 |j f |||d<01>|<05><02> x|D ]}||d<02> q W dS )a<>
|
|||
|
|
:param client: The client to use when calling PutObject
|
|||
|
|
:param copy_source: The CopySource parameter to use
|
|||
|
|
:param bucket: The name of the bucket to copy to
|
|||
|
|
:param key: The name of the key to copy to
|
|||
|
|
:param extra_args: A dictionary of any extra arguments that may be
|
|||
|
|
used in the upload.
|
|||
|
|
:param callbacks: List of callbacks to call after copy
|
|||
|
|
:param size: The size of the transfer. This value is passed into
|
|||
|
|
the callbacks
|
|||
|
|
|
|||
|
|
)<03>
|
|||
|
|
CopySource<EFBFBD>Bucket<65>Key)<01>bytes_transferredN)Z copy_object) r r r r* r+ r r, r <00>callbackr& r& r' <00>_main s
|
|||
|
|
zCopyObjectTask._mainN)rN rO rP rQ rW r& r& r& r' r2
s r2 c @ s e Zd ZdZdd<03> ZdS )rB z)Task to upload a part in a multipart copyc
|
|||
|
|
C sJ |j f |||||d<01>|<07><02>}
|
|||
|
|
x|D ]} | | d<02> q"W |
|
|||
|
|
d d } | |d<05>S )a<>
|
|||
|
|
:param client: The client to use when calling PutObject
|
|||
|
|
:param copy_source: The CopySource parameter to use
|
|||
|
|
:param bucket: The name of the bucket to upload to
|
|||
|
|
:param key: The name of the key to upload to
|
|||
|
|
:param upload_id: The id of the upload
|
|||
|
|
:param part_number: The number representing the part of the multipart
|
|||
|
|
upload
|
|||
|
|
:param extra_args: A dictionary of any extra arguments that may be
|
|||
|
|
used in the upload.
|
|||
|
|
:param callbacks: List of callbacks to call after copy part
|
|||
|
|
:param size: The size of the transfer. This value is passed into
|
|||
|
|
the callbacks
|
|||
|
|
|
|||
|
|
:rtype: dict
|
|||
|
|
:returns: A dictionary representing a part::
|
|||
|
|
|
|||
|
|
{'Etag': etag_value, 'PartNumber': part_number}
|
|||
|
|
|
|||
|
|
This value can be appended to a list to be used to complete
|
|||
|
|
the multipart upload.
|
|||
|
|
)rR rS rT ZUploadId<49>
|
|||
|
|
PartNumber)rU ZCopyPartResult<6C>ETag)rY rX )Zupload_part_copy)
r r r r* r+ r6 r5 r r, r r% rV <00>etagr& r& r' rW % s
|
|||
|
|
zCopyPartTask._mainN)rN rO rP rQ rW r& r& r& r' rB # s rB )rI r; Zs3transfer.tasksr r r r Zs3transfer.utilsr r r r r
|
|||
|
|
r2 rB r& r& r& r' <00><module>
s t
|