o h @s~ddlZddlZddlZddlZddlmZddlmZddlm Z e dZ GdddeZ dd Z  dd d ZdS)N)MutableMapping)cached_property) url_to_fszfsspec.mappingc@seZdZdZd%ddZeddZdd Zd&d d Zd dZ ddZ ddZ ddZ d'ddZ d'ddZddZddZddZdd Zd!d"Zd#d$ZdS)(FSMapaWrap a FileSystem instance as a mutable wrapping. The keys of the mapping become files under the given root, and the values (which must be bytes) the contents of those files. Parameters ---------- root: string prefix for all the files fs: FileSystem instance check: bool (=True) performs a touch at the location, to check for write access. Examples -------- >>> fs = FileSystem(**parameters) # doctest: +SKIP >>> d = FSMap('my-data/path/', fs) # doctest: +SKIP or, more likely >>> d = fs.get_mapper('my-data/path/') >>> d['loc1'] = b'Hello World' # doctest: +SKIP >>> list(d.keys()) # doctest: +SKIP ['loc1'] >>> d['loc1'] # doctest: +SKIP b'Hello World' FNcCs||_|||_|t|ddd|_|dur tttf}||_ ||_ ||_ |r7|j |s7|j ||rY|j |sGtd|d|j|d|j|ddSdS)NxzPath z9 does not exist. Create with the ``create=True`` keywordz/a)fs_strip_protocolroot posixpathjoin_root_key_to_strFileNotFoundErrorIsADirectoryErrorNotADirectoryErrormissing_exceptionscheckcreateexistsmkdir ValueErrortouchrm)selfr rrrrrb/var/www/html/construction_image-detection-poc/venv/lib/python3.10/site-packages/fsspec/mapping.py__init__)s,     zFSMap.__init__cCsddlm}||j|jdS)z@dirfs instance that can be used with the same keys as the mapper) DirFileSystem)pathr)implementations.dirfsrr r)rrrrrdirfsBs z FSMap.dirfscCs@td|jz|j|jd|j|jWdSYdS)z0Remove all keys below root - empties out mappingzClear mapping at %sTN)loggerinfor rrrrrrrclearIs z FSMap.clearraisec sfdd|D}dkrnd}zjj||dttr%|diWnjy6}zt|d}~wwfdd Dfd d t||DS) aFetch multiple items from the store If the backend is async-able, this might proceed concurrently Parameters ---------- keys: list(str) They keys to be fetched on_error : "raise", "omit", "return" If raise, an underlying exception will be raised (converted to KeyError if the type is in self.missing_exceptions); if omit, keys with exception will simply not be included in the output; if "return", all keys are included in the output, but the value will be bytes or an exception instance. Returns ------- dict(key, bytes|exception) cg|]}|qSr _key_to_str.0kr$rr fz"FSMap.getitems..r&return)on_errorrNcs(i|]\}}|t|jrtn|qSr) isinstancerKeyErrorr+r,vr$rr nsz"FSMap.getitems..csHi|] \}}dkst|ts|dkr|n|t|qS)r/r&)r1 BaseExceptiongetr2)r+keyk2)r0outrrr5rs  )rcatr1bytesrr2itemszip)rkeysr0keys2oeer)r0r:rrgetitemsRs"    zFSMap.getitemscs&fdd|D}j|dS)zSet the values of multiple items in the store Parameters ---------- values_dict: dict(str, bytes) cs i|] \}}|t|qSr)r) maybe_convertr3r$rrr5s z"FSMap.setitems..N)r=rpipe)r values_dictvaluesrr$rsetitemsxszFSMap.setitemscsjfdd|DdS)z#Remove multiple keys from the storecr'rr(r*r$rrr-r.z"FSMap.delitems..N)rr)rr?rr$rdelitemsszFSMap.delitemscCsDt|tstdtt|trt|}t|}|j|dS)zGenerate full path for the keyzAfrom fsspec 2023.5 onward FSMap non-str keys will raise TypeError/) r1strwarningswarnDeprecationWarninglisttupler rstrip)rr8rrrr)s  zFSMap._key_to_strcCs|t|jddS)zStrip path of to leave key nameNrJ)lenr lstrip)rsrrr _str_to_keyszFSMap._str_to_keyc CsZ||}z |j|}W|S|jy,}z|dur#|WYd}~St||d}~ww)z Retrieve dataN)r)rr;rr2)rr8defaultr,resultexcrrr __getitem__s  zFSMap.__getitem__cCs.|||}z||=W|StyY|Sw)zPop data)rYr2)rr8rVrWrrrpops  z FSMap.popcCs8||}|jj|j|dd|j|t|dS)zStore value in keyT)exist_okN)r)rmkdirs_parent pipe_filerD)rr8valuerrr __setitem__s zFSMap.__setitem__csfddjjDS)Nc3s|]}|VqdSN)rU)r+rr$rr sz!FSMap.__iter__..)rfindr r$rr$r__iter__szFSMap.__iter__cCst|j|jSra)rRrrcr r$rrr__len__sz FSMap.__len__c Cs8z |j||WdSty}zt|d}~ww)z Remove keyN)rrr) Exceptionr2)rr8rXrrr __delitem__s zFSMap.__delitem__cCs||}|j|S)zDoes key exist in mapping?)r)risfile)rr8rrrr __contains__s  zFSMap.__contains__cCst|j|jdd|jffS)NF)rr rrr$rrr __reduce__szFSMap.__reduce__)FFN)r&ra)__name__ __module__ __qualname____doc__rrr!r%rCrHrIr)rUrYrZr`rdrergrirjrrrrr s&   &     rcCsFt|tjs t|dr!t|dr|jjdvr|d}tt|}|S)N __array__dtypeMmint64)r1arrayhasattrrpkindviewr< memoryview)r_rrrrDs   rDFc Ks6t|fi|\}}|dur|n|}t|||||dS)aCreate key-value interface for given URL and options The URL will be of the form "protocol://location" and point to the root of the mapper required. All keys will be file-names below this location, and their values the contents of each key. Also accepts compound URLs like zip::s3://bucket/file.zip , see ``fsspec.open``. Parameters ---------- url: str Root URL of mapping check: bool Whether to attempt to read from the location before instantiation, to check that the mapping does exist create: bool Whether to make the directory corresponding to the root before instantiating missing_exceptions: None or tuple If given, these exception types will be regarded as missing keys and return KeyError when trying to read data. By default, you get (FileNotFoundError, IsADirectoryError, NotADirectoryError) alternate_root: None or str In cases of complex URLs, the parser may fail to pick the correct part for the mapper root, so this arg can override Returns ------- ``FSMap`` instance, the dict-like key-value store. N)r)rr) urlrrralternate_rootkwargsrurlpathr rrr get_mappers'r})rxFFNN)rsloggingr rLcollections.abcr functoolsr fsspec.corer getLoggerr"rrDr}rrrrs"    ;