o ûÇ h÷ã @sZUddlmZgZeeed<dedefdd„Zdeded eeeeeeffd d „Z d S) é)ÚChunkStorageMetadataÚ__all__Úshard1Úshard2cCsdt|jƒ}t|ƒD]&}|j||j||j|krdS|j||j||j|kr/dSq dS)zCheck if two shards overlap.FT)ÚlenÚoffsetsÚrangeÚsizes)rrÚndimsÚi©r ú{/var/www/html/construction_image-detection-poc/venv/lib/python3.10/site-packages/torch/distributed/checkpoint/resharding.pyÚ"_check_shard_metadata_pair_overlap s  ÿrÚ saved_shardÚ current_shardÚreturnc Csˆg}tt|j|j|j|jƒƒD]2\}\}}}}t||||ƒ}|t||ƒ} ||kr2d} ||} n||} d} | || | | f¡q|S)a[ Return the overlapping region between saved_shard and current_shard. There returned list has the same number of elements as the tensor's dimension. For each element, we produce a tuple with the following contents: (dimension, `saved_shard` offset, `current_shard` offset, length) Offsets are relative to each shard. r)Ú enumerateÚziprr ÚminÚmaxÚappend) rrÚnarrowsÚdimÚsaved_shard_offsetÚcurrent_shard_offsetÚsaved_shard_sizeÚcurrent_shard_sizeÚ min_range_endÚlengthÚoffset_for_saved_tensorÚoffset_for_current_tensorr r r Ú+_shards_get_overlap_region_wrt_saved_tensors8 üÿ û þ  ÿr!N) Ú%torch.distributed.checkpoint.metadatarrÚlistÚstrÚ__annotations__rÚtupleÚintr!r r r r Úsÿ ÿÿÿþ