d{6ddlmZddlZddlZddlZddlmZddlmZm Z ddl m Z ddl m Z mZmZmZmZddlmZmZddlmZmZmZmZdd lmZmZmZmZmZdd l m!Z!dd l"m#Z#dd l$m%Z%m&Z&m'Z'm(Z(dd l)m*Z*erddlm+Z+ddl m,Z,ddl-m.Z.GddeZ/dZ0dZ1ej2eddddZ3dZ4GddeZ5GddeZ6de6fe d<dS)) annotationsN)Iterable) TYPE_CHECKINGAny)Version)BACKEND_ENTRYPOINTSBackendEntrypointWritableCFDataStore_normalize_pathfind_root_and_group)CachingFileManagerDummyFileManager) HDF5_LOCK combine_locks ensure_lockget_write_lock)BaseNetCDF4Array_encode_nc4_variable_extract_nc4_variable_encoding _get_datatype_nc4_require_group)StoreBackendEntrypoint)indexing) FrozenDict is_remote_uriread_magic_number_from_file'try_read_magic_number_from_file_or_path)Variable)BufferedIOBase)AbstractDataStore)Datasetc"eZdZddZdZdZdS)H5NetCDFArrayWrapperTcZ|j|}|j|jSN) datastore_acquire variables variable_name)self needs_lockdss 9lib/python3.11/site-packages/xarray/backends/h5netcdf_.py get_arrayzH5NetCDFArrayWrapper.get_array-s' ^ $ $Z 0 0|D.//cbtj||jtjj|jSr%)rexplicit_indexing_adaptershapeIndexingSupport OUTER_1VECTOR_getitem)r*keys r- __getitem__z H5NetCDFArrayWrapper.__getitem__1s*1 X5CT]   r/c|jj5|d}||cdddS#1swxYwYdS)NF)r+)r&lockr.)r*r6arrays r-r5zH5NetCDFArrayWrapper._getitem6s ^   NNeN44E:                  s 8<<NT)__name__ __module__ __qualname__r.r7r5r/r-r#r#,sF0000   r/r#cZt|tr|dS|S)Nzutf-8) isinstancebytesdecode)txts r-maybe_decode_bytesrE<s+#uzz'""" r/cxi}|jD]\}}|dvrt|}|||<|S)N) _FillValue missing_value)attrsitemsrE) h5netcdf_varrIkvs r-_read_attributesrNCsT E"((**1 3 3 3"1%%Aa Lr/FTh5netcdf)lsd_okay h5py_okaybackendunlimited_dimsc,||Sr% create_group)datasetnames r-_h5netcdf_create_grouprYXs    % %%r/ceZdZdZdZddedfdZe ddZdd Z e d Z d Z d Z d ZdZdZddZdZdZ ddZdZdZdS) H5NetCDFStorez/Store for reading and writing data via h5netcdf) autocloseformat is_remoter9 _filename_group_manager_modeNFcddl}t||j|jfrK|t |\}}n't ||jurt d|}t|}||_||_ ||_ d|_ t |j dj |_t|j|_t#||_||_dS)Nrz=must supply a h5netcdf.File if the group argument is provided)rOrAFileGroupr type ValueErrorrrar`rbr]r,filenamer_rr^rr9r\)r*managergroupmoder9r\rOroots r-__init__zH5NetCDFStore.__init__js g x~> ? ? -}1':: ee== 55$/&t,,G    -TW55a8A&t~66%% "r/rTc ddl} t|trtdt|tjr6t |} | dst| d|dvrtd|| d} ||| d<|1|d krt}n#ttt|g}t| j ||| } || |||| S) NrzGcan't open netCDF4/HDF5 as bytes try passing a path or file-like objectHDF  z- is not the signature of a valid netCDF4 file)NNETCDF4z#invalid format for h5netcdf backend)invalid_netcdfdecode_vlen_strings phony_dimsrn)rkkwargs)rjrkr9r\) rOrArBrgioIOBaser startswithrrrr rd)clsrhrkr]rjr9r\rrrtrsrO magic_numberruris r-openzH5NetCDFStore.opens4  h & & 9 ") , , 6x@@L**+?@@  #RRR * * *BCC C-#6    !#-F< <s{{ $i1I1I%JKK$X]H4PVWWWs7%dSSSSr/c|j|5}t||j|jt }dddn #1swxYwY|S)NrU)raacquire_contextrr`rbrY)r*r+rlr,s r-r'zH5NetCDFStore._acquires ] * *: 6 6 $#dk4:z.H5NetCDFStore.get_variables..sM  48AqQ((A.. /      r/)rr,r(rJrs`r- get_variableszH5NetCDFStore.get_variablessL    <@GK|]\}}|t|fVdSr%)lenrrLrMs r-rz/H5NetCDFStore.get_dimensions..s0QQdaq#a&&kQQQQQQr/)rOr __version__rr,rrJr*rOs r-get_dimensionszH5NetCDFStore.get_dimensionssb 8' ( (GM,B,B B BQQdg6H6N6N6P6PQQQQQ Q7% %r/cddl}t|jtdkr*dd|jjDiSdd|jjDiS)NrrrSc@h|]\}}||Sr?) isunlimitedrs r- z-H5NetCDFStore.get_encoding..s9###!Q ####r/ch|] \}}|| Sr%r?rs r-rz-H5NetCDFStore.get_encoding..s$###!Q A r/)rOrrr,rrJrs r- get_encodingzH5NetCDFStore.get_encodings 8' ( (GM,B,B B B ##"&'"4":":"<"<### !##"&'"4":":"<"<### r/c|r,d|jj|<|j||dS||jj|<dSr%)r,rresize_dimension)r*rXlength is_unlimiteds r- set_dimensionzH5NetCDFStore.set_dimensionsL  .'+DG t $ G $ $T6 2 2 2 2 2'-DG t $ $ $r/c$||jj|<dSr%)r,rI)r*r6values r- set_attributezH5NetCDFStore.set_attribute s" cr/c t|Sr%)r)r*variables r-encode_variablezH5NetCDFStore.encode_variable s#H---r/cddl}|j}t||}|dd}|t ur|t d|d|t ur|t }t||} i} | dd r>|r&| d d vrtd | d d |r)d| vr%d| vr!| d| dkrtd| dd} | dkr| d| | dd| d<|j rdD]} | | vr | | | | <||j vr|j j|f||j|d| } n |j |} |D]\}}|| j|<t#||}||jfS)Nr)raise_on_invalid_encodingrGzh5netcdf does not yet support setting a fill value for variable-length strings (https://github.com/h5netcdf/h5netcdf/issues/37). Either remove '_FillValue' from encoding on variable zH or set {'dtype': 'S1'} in encoding to use the fixed width NC_CHAR type.r)raise_on_invalidrFr)Nrz+'zlib' and 'compression' encodings mismatchrrrz5'complevel' and 'compression_opts' encodings mismatchrr)rrrrr)rr fillvalue)rrIcopyrpoprNotImplementedError special_dtype_extract_h5nc_encodinggetrg setdefaultr2r,create_variabledimsrJr#r)r*rXrcheck_encodingrSrrIrrrrurr6nc4_varrLrMtargets r-prepare_variablezH5NetCDFStore.prepare_variablesu  ##%%h.QQQIIlD11 C<>    2I > > >%\\,== > 0 0 0(??"*3-F3K tw  -dg-#=#   GGgdmGKKMM ! !DAq GM!  %dD11x}$$r/c8|jdSr%)r,syncrs r-rzH5NetCDFStore.syncZs  r/c *|jjdi|dS)Nr?)raclose)r*rus r-rzH5NetCDFStore.close]s# %%f%%%%%r/)rnNNNFNNTr;)F)FN)r<r=r>__doc__ __slots__rrm classmethodr{r'propertyr,rrrrrrrrrrrr?r/r-r[r[\sk99 I'+IQV####4  +T+T+T[+TZX#;#;#;J   555&&& ....###...DHI%I%I%I%V&&&&&r/r[cHeZdZdZdZdZddZd d d d d d d d d d d d d d ddZd S)H5netcdfBackendEntrypointa Backend for netCDF files based on the h5netcdf package. It can open ".nc", ".nc4", ".cdf" files but will only be selected as the default if the "netcdf4" engine is not available. Additionally it can open valid HDF5 files, see https://h5netcdf.org/#invalid-netcdf-files for more info. It will not be detected as valid backend for such files, so make sure to specify ``engine="h5netcdf"`` in ``open_dataset``. For more information about the underlying library, visit: https://h5netcdf.org See Also -------- backends.H5NetCDFStore backends.NetCDF4BackendEntrypoint backends.ScipyBackendEntrypoint zMOpen netCDF (.nc, .nc4 and .cdf) and most HDF5 files using h5netcdf in XarrayzZhttps://docs.xarray.dev/en/stable/generated/xarray.backends.H5netcdfBackendEntrypoint.htmlfilename_or_obj;str | os.PathLike[Any] | BufferedIOBase | AbstractDataStorereturnboolct|}||dSt|ttjfr&tj|\}}|dvSdS)Nrp>.nc.cdf.nc4F)rrxrArosPathLikepathsplitext)r*rrz_exts r-guess_can_openz(H5netcdfBackendEntrypoint.guess_can_open|so?OO  #**+?@@ @ oR['9 : : 2W%%o66FAs11 1ur/TN) mask_and_scale decode_timesconcat_characters decode_coordsdrop_variables use_cftimedecode_timedeltar]rjr9rrrtrsrstr | Iterable[str] | Noner!c t|}t|| | | | | |}t}|||||||||}|S)N)r]rjr9rrrtrs)rrrrrrr)r r[r{r open_dataset)r*rrrrrrrrr]rjr9rrrtrsstorestore_entrypointr,s r-rz&H5netcdfBackendEntrypoint.open_datasets$*/::"" )! 3#  233  * * )%/')!-+    r/)rrrr)rrrrrr!)r<r=r>r descriptionurlrrr?r/r-rras, X gC    $59  !))))))))r/r)7 __future__r functoolsrvrcollections.abcrtypingrrpackaging.versionrxarray.backends.commonrr r r r xarray.backends.file_managerr rxarray.backends.locksrrrrxarray.backends.netCDF4_rrrrrxarray.backends.storer xarray.corerxarray.core.utilsrrrrxarray.core.variablerrr xarray.core.datasetr!r#rErNpartialrrYr[rr?r/r-rs"""""" $$$$$$%%%%%%%%%%%%%%NMMMMMMMWWWWWWWWWWWW988888  *))))),!!!!!!888888++++++     +       +*"   &&&B&B&B&B&B&'B&B&B&JRRRRR 1RRRj$./H"IJr/