d 6UddlmZddlZddlZddlZddlZddlmZddlm Z m Z m Z ddl Z ddlmZddlmZddlmZddlmZdd lmZmZmZe r dd lmZdd lmZejeZ d Z!d Z"dZ#dZ$dZ%e&ddfdZ'Gddeej(Z)GddZ*GddZ+Gdde*Z,Gdde,Z-GddZ.iZ/d e0d!<dS)") annotationsN)Iterable) TYPE_CHECKINGAnyClassVar) cf_encoder)indexing)get_chunked_array_type)is_chunked_array) FrozenDictNdimSizeLenMixin is_remote_uri)BufferedIOBase)Dataset __values__c"t|tjrtj|}t|trKt |ss !     ;? # # * * *:    * * *K&A-J#bi&7&7 &C&CCJa:aa!OaaHQH\H^H^aa  LL    Jtj( ) ) ) ) ) * * *s(BB10B1ceZdZdZdddZdS) BackendArrayr(Ndtypenp.typing.DTypeLikecftjtdf|jz}||Sr)r BasicIndexerslicendim)selfrLrAs rget_duck_arrayzBackendArray.get_duck_arrayZs+#U4[[NTY$>??Cyrr)rLrM)__name__ __module__ __qualname__ __slots__rSr(rrrKrKWs2IrrKcBeZdZdZdZdZdZdZdZdZ dZ d Z d S) AbstractDataStorer(ctrNotImplementedErrorrRs rget_dimensionsz AbstractDataStore.get_dimensionsb!###rctrr[r]s r get_attrszAbstractDataStore.get_attrser_rctrr[r]s r get_variableszAbstractDataStore.get_variableshr_rciSrr(r]s r get_encodingzAbstractDataStore.get_encodingks rctd|D}t|}||fS)a, This loads the variables and attributes simultaneously. A centralized loading function makes it easier to create data stores that do automatic encoding/decoding. For example:: class SuffixAppendingDataStore(AbstractDataStore): def load(self): variables, attributes = AbstractDataStore.load(self) variables = {'%s_suffix' % k: v for k, v in variables.items()} attributes = {'%s_suffix' % k: v for k, v in attributes.items()} return variables, attributes This function will be called anytime variables or attributes are requested, so care should be taken to make sure its fast. c3>K|]\}}t||fVdSr)r&).0kvs r z)AbstractDataStore.load..sE  .2a "1 % %q )      r)r rcitemsrarR variables attributess rloadzAbstractDataStore.loadnsk*  6:6H6H6J6J6P6P6R6R       0 011 *$$rcdSrr(r]s rclosezAbstractDataStore.closes rc|Srr(r]s r __enter__zAbstractDataStore.__enter__s rc.|dSr)rr)rRexception_typeexception_valuer:s r__exit__zAbstractDataStore.__exit__s rN) rTrUrVrWr^rarcrerprrrtrxr(rrrYrY_sI$$$$$$$$$%%%6   rrYc*eZdZdZddZddZddZdS) ArrayWritersourcestargetsregionslockNc>g|_g|_g|_||_dSrr{)rRrs r__init__zArrayWriter.__init__s"    rct|rP|j||j||j|dS|r|||<dS||d<dS)N.)r r|appendr}r~)rRsourcetargetregions raddzArrayWriter.adds| F # # % L   ' ' ' L   ' ' ' L   ' ' ' ' ' %!'v$s rTc|jrQt|j}|i}|j|j|jf|j|d|jd|}g|_g|_g|_|SdS)NT)rcomputeflushr~)r|r storer}rr~)rRrchunkmanager_store_kwargs chunkmanager delayed_stores rsynczArrayWriter.syncs < !14<@L )0,.).L.  Y ,MDLDLDL - ! !rr)TN)rTrUrVrWrrrr(rrrzrzsU9I % % % %!!!!!!rrzcpeZdZdZdZdZdZdZdZdZ dZ e d d fd Z d Z dd Zdd Zd S)AbstractWritableDataStorer(cfd|D}fd|D}||fS)a Encode the variables and attributes in this store Parameters ---------- variables : dict-like Dictionary of key/value (variable name / xr.Variable) pairs attributes : dict-like Dictionary of key/value (attribute name / attribute) pairs Returns ------- variables : dict-like attributes : dict-like cBi|]\}}||Sr(encode_variablerhrirjrRs r z4AbstractWritableDataStore.encode..-NNNDAqQ,,Q//NNNrcBi|]\}}||Sr(encode_attributers rrz4AbstractWritableDataStore.encode..-QQQdaa..q11QQQr)rlrms` rencodez AbstractWritableDataStore.encodesY"ONNNIOON>N>P>PQQQ *$$rc|S)zencode one variabler()rRrjs rrz)AbstractWritableDataStore.encode_variablerc|S)zencode one attributer()rRas rrz*AbstractWritableDataStore.encode_attributerrctrr[)rRdimlengths r set_dimensionz'AbstractWritableDataStore.set_dimensionr_rctrr[rRrirjs r set_attributez'AbstractWritableDataStore.set_attributer_rctrr[rs r set_variablez&AbstractWritableDataStore.set_variabler_rc<|||jdS)z in stores, variables are all variables AND coordinates in xarray.Dataset variables are variables NOT coordinates, so here we pass the whole dataset in instead of doing dataset.variables N)rattrs)rRdatasets r store_datasetz'AbstractWritableDataStore.store_datasets  7GM*****rNc|t}|||\}}||||||||||dS)a Top level method for putting data on this store, this method: - encodes variables/attributes - sets dimensions - sets variables Parameters ---------- variables : dict-like Dictionary of key/value (variable name / xr.Variable) pairs attributes : dict-like Dictionary of key/value (attribute name / attribute) pairs check_encoding_set : list-like List of variables that should be checked for invalid encoding values writer : ArrayWriter unlimited_dims : list-like List of dimension names that should be treated as unlimited dimensions. Nunlimited_dims)rzrset_attributesset_dimensions set_variables)rRrnrocheck_encoding_setwriterrs rrzAbstractWritableDataStore.stores8 > ]]F $ Iz B B : J''' InEEE  )6.      rcf|D]\}}|||dS)z This provides a centralized method to set the dataset attributes on the data store. Parameters ---------- attributes : dict-like Dictionary of key/value (attribute name / attribute) pairs N)rlr)rRrorirjs rrz(AbstractWritableDataStore.set_attributessF$$&& % %DAq   q! $ $ $ $ % %rc|D]J\}}t|}||v}|||||\} } || | KdS)a This provides a centralized method to set the variables on the data store. Parameters ---------- variables : dict-like Dictionary of key/value (variable name / xr.Variable) pairs check_encoding_set : list-like List of variables that should be checked for invalid encoding values writer : ArrayWriter unlimited_dims : list-like List of dimension names that should be treated as unlimited dimensions. rN)rlr$prepare_variabler) rRrnrrrvnrjr#checkrrs rrz'AbstractWritableDataStore.set_variables's$__&& ' 'EB(,,D,,E!22a~3NFF JJvv & & & & ' 'rc |t}|}i}|D]}d||<|D]<}|t t |j|j=|D]S\}}||vr+|||krtd|d|d||d||vr||v}| |||TdS)au This provides a centralized method to set the dimensions on the data store. Parameters ---------- variables : dict-like Dictionary of key/value (variable name / xr.Variable) pairs unlimited_dims : list-like List of dimension names that should be treated as unlimited dimensions. Nz,Unable to update size for existing dimensionz (z != )) setr^valuesupdatedictzipdimsshaperl ValueErrorr) rRrnr existing_dimsrrjrr is_unlimiteds rrz(AbstractWritableDataStore.set_dimensionsBsH  ! UUN++--   ADGG!!## 4 4A KKS1122 3 3 3 3::<< > >KCm##-2D(D(D BBB &BB,9#,>BBBM))"n4 ""3 === > >rr)rTrUrVrWrrrrrrr frozensetrrrrr(rrrrsI%%%*$$$$$$$$$+++%9;; % % % % N % % %''''6 > > > > > >rrceZdZdZdZdS)WritableCFDataStorer(ct||\}}fd|D}fd|D}||fS)NcBi|]\}}||Sr(rrs rrz.WritableCFDataStore.encode..lrrcBi|]\}}||Sr(rrs rrz.WritableCFDataStore.encode..mrr)rrlrms` rrzWritableCFDataStore.encodehsl!+9j A A :NNNNIOON>N>P>PQQQ *$$rN)rTrUrVrWrr(rrrres(I%%%%%rrc\eZdZUdZdZded<dZded<dZded<dd Zdd ddZ ddZ dS)BackendEntrypointa ``BackendEntrypoint`` is a class container and it is the main interface for the backend plugins, see :ref:`RST backend_entrypoint`. It shall implement: - ``open_dataset`` method: it shall implement reading from file, variables decoding and it returns an instance of :py:class:`~xarray.Dataset`. It shall take in input at least ``filename_or_obj`` argument and ``drop_variables`` keyword argument. For more details see :ref:`RST open_dataset`. - ``guess_can_open`` method: it shall return ``True`` if the backend is able to open ``filename_or_obj``, ``False`` otherwise. The implementation of this method is not mandatory. Attributes ---------- open_dataset_parameters : tuple, default: None A list of ``open_dataset`` method parameters. The setting of this attribute is not mandatory. description : str, default: "" A short string describing the engine. The setting of this attribute is not mandatory. url : str, default: "" A string with the URL to the backend's documentation. The setting of this attribute is not mandatory. NzClassVar[tuple | None]open_dataset_parametersz ClassVar[str] descriptionurlreturnrcdt|jd}|jr |d|jz }|jr |d|jz }|S)N<>z z Learn more at )typerTrr)rRtxts r__repr__zBackendEntrypoint.__repr__s`($t**%(((   - ,$*,, ,C 8 3 222 2C r)drop_variablesfilename_or_obj;str | os.PathLike[Any] | BufferedIOBase | AbstractDataStorerstr | Iterable[str] | Nonekwargsrrc t)` Backend open_dataset method used by Xarray in :py:func:`~xarray.open_dataset`. r[)rRrrrs r open_datasetzBackendEntrypoint.open_datasets "!rboolcdS)rFr()rRrs rguess_can_openz BackendEntrypoint.guess_can_opens ur)rr)rrrrrrrr)rrrr) rTrUrV__doc__r__annotations__rrrrrr(rrrrqs87;::::!#K####C6: " " " " " "rrz5dict[str, tuple[str | None, type[BackendEntrypoint]]]BACKEND_ENTRYPOINTS)1 __future__rloggingrr>r:collections.abcrtypingrrrnumpyr7xarray.conventionsr xarray.corer xarray.core.parallelcompatr xarray.core.pycompatr xarray.core.utilsr r riorxarray.core.datasetr getLoggerrTr<r!rr$r&r1 ExceptionrIExplicitlyIndexedrKrYrzrrrrrr(rrrs""""""" $$$$$$//////////)))))) ======111111IIIIIIIIII,!!!!!!++++++  8 $ $   &/AS****2#X%?11111111h+!+!+!+!+!+!+!+!\a>a>a>a>a> 1a>a>a>H % % % % %3 % % %>>>>>>>>DNPOOOOOOr