U ]blx@sddlZddlZddlZddlZddlmZd*ddZd+ddZd,d d Z d-d d Z d.ddZ ddZ d/ddZ d0ddZd1ddZddZddZddZd d!Zd"d#Zd$d%Zd&d'Zd(d)ZdS)2N)readfileTc s|rtndd}|r(dd|D}n|r8t|}ntdttjrltj } t | |d<t j |\} } | dkrt j | \} } q|| s| } | } t j t j |} t j | st | |d| | d krt|rdt j |d d krd|d krt|}t|d t|d ft|d fddD} W5QRXng} t| }|ddkrd|krtd|dt j |rt ||d|td|tdd|D}t|df}D]D}|} |dj||t| j t| j|d|j || d|d}qt!| dkrt|dX| D]L}|}|dj||t|j t|j|d|j ||d d d|dqfW5QRX|D]>\}}zt||j"|<Wn t|#d|j"|<YnXq|d k rX|D]>\}}|d k r|||j"d<|d |d!|d"|qW5QRX|d#|nLt}t$}t!||d$<|%d%d&&|d%<|%d'd(|d'<d(d)d*d+}|d'|kr||d'|d'<| d,kr*d(|d'<d&|d%<|d-d.gkr>|d|dg}n| d/krhd(|d'<d&|d%<|%d0d1d2kr>|d|dg}n| d3kr|d)|d'<n| d4krd(|d'<d&|d%<n| d5krd6|d$<d(|d'<d7|d%<n| d8krd(|d'<nn| d9krd |d$<nZ| d:kr,d |d$<d;|d'<|d-d.gkr>|dt'd<|d |d<n| d=kr>d*|d'<d>d*d?d)d(d@dAd;dBg }|d'|krdC| |d'}|dD|7}t|t(|||d'|d%dE|dF|t)||dG|dH|S)Ia$ Write one file. Parameters: datasetDict - dict of dataset, with key = datasetName and value = 2D/3D array, e.g.: {'height' : np.ones(( 200,300), dtype=np.int16), 'incidenceAngle': np.ones(( 200,300), dtype=np.float32), 'bperp' : np.ones((80,200,300), dtype=np.float32), ...} out_file - str, output file name metadata - dict of attributes ref_file - str, reference file to get auxliary info compression - str, compression while writing to HDF5 file, None, "lzf", "gzip" ds_unit_dict - dict, dataset unit definition {dname : dunit, dname : dunit, ... } Returns: out_file - strs Examples: dsDict = dict() dsDict['velocity'] = np.ones((200,300), dtype=np.float32) write(datasetDict=dsDict, out_file='velocity.h5', metadata=atr) c_sdSNargskwargsrrM/home/exouser/operations/rsmas_insar/sources/MintPy/mintpy/utils/writefile.py&zwrite..cSsi|]\}}||qSrr.0keyvaluerrr *szwrite..z$No metadata or reference file input. FILE_TYPE)z.geoz.rdrz.fullz.wgs84zcreate directory: {}z.h5z.he5NLENGTHWIDTHrcsFg|]>}|tkrt|tjr|jddkr|qS)N)listkeys isinstanceh5pyDatasetshaper i datasetDictfrshape2drr Ps zwrite..) timeseries ifgramStackdatez-Can not write {} file without 'date' dataset!zdelete exsited file: {} create HDF5 file: {} with w modecSsg|] }t|qSrlenrrrrr#dswKcreate dataset /{d:<{w}} of {t:<10} in size of {s:<20} with compression={c}dr*tscTdatachunks compressionrzKcreate dataset /{d:<{w}} of {t:<10} in size of {s:<10} with compression={c}zutf-8UNITadd /< attribute: UNIT = finished writing to {}BANDS INTERLEAVEBIL DATA_TYPEfloat32int16int8)floatshortbyte).unw magnitudephase).corz.hgt PROCESSORisceroipacz.dem)z.trans)z .utm_to_rdcBIP)z.mliz.flt.slc.int complex64y?z.mskbooluint8float64 complex32 complex128z0Un-supported file type "{}" with data type "{}"!z Supported data type list: {}) data_type interleavewrite file: {}z.rsc) print_msg)*printitemsrread_attribute ValueErrorrnpndarrayarraydtypedictospathsplitextlowerdirnameabspathisdirmakedirsformatget_hdf5_compressionintrFilerr Exceptionisfileremovemaxstrrcreate_datasetr)attrsencodevaluesgetupperexp write_binarywrite_roipac_rsc)r out_filemetadataref_filer4 ds_unit_dictrXvprintmetar2fbasefextZout_dirZ auxDsNamesdsNamesmaxDigitfdsNamedsr rZkey_list data_listZDATA_TYPE_DICT data_typesmsgrrrwrites        &       *                  rc Cs|rtndd}|d|r0dd|D}nH|rpt|d} dd| jD}W5QRX|d|ntd |d kr|rtj |st d n|d |i}tj |d } t |dt |df} | dkrt|d} t | jdt | jdf} | D]v} | | }t|tjr|jdd | kr\|j|j|d d g|| <n*t|j}| |dd <|jt|d g|| <qW5QRXn0t|}|d}|D]}|t| d g||<qtjtj|}tj|st||d|t|dr}|d|tdd| D}| D]} || d}|| d }|}| dkrjd}t|dkrd |d |df}n|}|dj| |t|t||d|j| |||d|d }t|| dkr<|| dd k r\} }|d k r<||| jd!<|d"| d#|d$|q.2--------------------------------------------------cSsi|]\}}||qSrrr rrrrszlayout_hdf5..rcSsi|]\}}||qSrrr rrrrszgrab metadata from ref_file: {}zNo metadata or ref_file found.Nz"No ds_name_dict or ref_file found!z(grab dataset structure from ref_file: {}rrrrrr=zcrerate directory: {}r*r'cSsg|] }t|qSrr(rrrrr#Oszlayout_hdf5..r)connectComponentlzfrKzOcreate dataset : {d:<{w}} of {t:<25} in size of {s:<20} with compression = {c}r,T)rmaxshaper`r3r4r5r6r7r8zclose HDF5 file: {}) rYrZrrmrtrjr\rbrcroFileNotFoundErrorrdrlrrrrr`rtuplerget_slice_listrfrgrhrirqr)rrrsr]r_)fnameZ ds_name_dictr}rr~r4rXrrr!rr"Z shape2d_origr rZds_shapeZds_namesZds_dtypeds_namefdirr max_digitrU data_shapeZds_compZ max_shaperrrr layout_hdf5s0      $      $  *rac Cs|dkrt|trt|f}n|j}t|dkr>d|dg}n|t|dkr`d|dd|dg}nZt|dkrd|dd|dd|dg}n0t|dkrd|dd|dd|dd|dg}|rtdtd||td ||t||}t|d krH||||d|d|d|d|d|d |d |d f<nt|d kr||||d|d|d|d|d|d f<n^t|dkr||||d|d|d|df<n&t|dkr||||d|d<W5QRX|r td||S)aWrite data to existing HDF5 dataset in disk block by block. Parameters: data - np.ndarray 1/2/3/4D matrix datasetName - str, dataset name block - list of 2/4/6/8 int, for [d1Start, d1End, d2Start, d2End, yStart, yEnd, xStart, xEnd] mode - str, open mode Returns: fname NrrrKrrzopen HDF5 file {} in {} modez!writing dataset /{:<25} block: {}zclose HDF5 file {}.)rrr)rrYrjrrm)rr2 datasetNameblockmoderXrrrrrwrite_hdf5_blocks      "rc s~ttrt|r&td|tjtj|dtj |}td||t |||rtd|td|t |d}t |d}d}td d t|D}fd d |DD]P}||} |rtd j||t| jt| j|d |j|| ddd|dq|jD]\} } t| |j| <q.|||rztd|td||S)aRemove an existing dataset from an HDF5 file. Parameters: fname : str, HDF5 file name/path datasetName : (list of) str, dataset name(s) Returns: fname : str, Example: remove_hdf5_dataset('./inputs/ifgramStack.h5', 'unwrapPhase_phaseClosure') remove_hdf5_dataset('./inputs/ifgramStack.h5', ['unwrapPhase_phaseClosure', 'unwrapPhase_bridging']) zdelete {} from file {}ztmp_{}z move {} to {}z read HDF5 file: {} with r moder'rr*NcSsg|] }t|qSrr(rrrrr#sz'remove_hdf5_dataset..csg|]}|kr|qSrrr datasetNamesrrr#sr+r,Tr1r9z:old file is now saved as: {}. Use rm command to delete it.)rrrrrYrjrbrcjoinrfbasenameshutilmoverrmrqrr`rrsrtrZclose) rrrX temp_filefifor4rrrr rrrrremove_hdf5_datasetsB $   rFc Cs:d}|rBt}tj|r$t|}t|t|rBd}|r6d| kr`|d|d<d| krt t |d|d<t t |d|d<t t |d|d<t t |d|d<|rt d |td d | Dd g}t|d <}t| D](}|dj t ||t ||dqW5QRX|S)aWrite attribute dict into ROI_PAC .rsc file Inputs: metadata : dict, attributes dictionary out_file : rsc file name, to which attribute is writen update_mode : bool, skip writing if 1) output file existed AND 2) no new metadata key/value print_msg : bool, print message Output: out_file TFr FILE_LENGTHX_STEPY_STEPX_FIRSTY_FIRSTrWcSsg|] }t|qSrr()r r rrrr#sz$write_roipac_rsc..rKr*z{k:<{d}} {v} )kr-v)rarbrcrorread_roipac_rscsetrZissubsetrrrrArYrjrqopensortedr) r}r|Z update_moderXrunZrsc_dictrrr rrrr{s2        r{c CsTddddddd}dd d d d d d}t||d }t|dt|d}}t|d}|d}|dkr||||} |} nJ|dkr|||} ||} n,|dkr||} |||} ntd|dj|d|dd} t|D]B} dj||d | dtj|dd| | || d} | | 7} q| d7} t|d}|| W5QRX|S)aWrite GDAL VRT file. !!! This function is NOT RIGHT. DO NOT USE IT. Keep here as a placeholder ONLY. !!! It needs more work. Parameters: meta - dict, dictionary of metadata out_file - str, VRT file name to which attributes are written ZByteZInt16ZFloat32ZFloat64ZCFloat32ZCFloat64)r@r?r>rRrOrT248Z16Z32r=rrr:r;rLr<BSQz&un-recognized band interleave type: {}z1 )r*la; {f} LSB {io} {po} {lo} rN)r-brioZpoloz r*) rlr\rjrangerbrcrrr)rr|Z dtype_dictZpixel_offset_dictZ pixel_offsetlengthwidthnum_bandrV line_offsetZ image_offsetZds_strbandZband_strrrrrwrite_gdal_vrt#sV          rcCsddl}ddl}tj|d}|d}|s6|j}nF|dkrJ|j}n2|dkr^|j}n|dkrr|j}n |j}| || t |d| t |d | d t |d d |_||_|d d|_|||rtd|dtd|ddS)aWrite XML metadata file in ISCE-2 format Parameters: meta - dict, attributes dictionary fname - str, path of data file, not the metadata file print_msg - bool, print out message Examples: write_isce_xml(atr, fname='filt_fine.cor') rNr=rrMrDrNrrREADr:1r;r<z write file: z.xmlz.vrt)rIisceobjrDATA_TYPE_NUMPY2ISCEImageZ createImageZcreateSlcImageZcreateUnwImageZcreateIntImageZ setFilenameZsetWidthrlZ setLengthZ setAccessModerwbandsdataTypeschemeZ renderHdrZ renderVRTrY)rrrXrIrr`Z image_typeimgrrrwrite_isce_xmlls4        risce_unwcCs|dd}|||j\}}||d}|dkrdd|d<d|d<d |d <d |d <t|d|d <n|dkrd|d<d|d<d|d <d |d <nb|dkrd|d<d|d<d |d <d |d <n8|dkrd|d<d|d<d|d <d|d <ntd|t|||S)awrite data to file in ISCE format Parameters: data - 2D np.ndarray, binary data matrix out_file - str, path of output binary data file file_type - str, file type Returns: out_file - str, path of output binary data file -_)rrrrDrrKr:r>r=r<r;rZisce_intrNrrOZisce_corrGZisce_slcrMrLz un-recognized ISCE file type: {})replacetofilerrlr\rjr)r2r|Z file_typerrrrrrwrite_isce_files<       rr<csr,|djkr,fdd|D}|}|dkrLdd|D}n|dkrbdd|D}|d}|dd D]}t||f}qv|||S) a]Write binary file. Parameters: data_list - list of 2D np.ndarray matrices out_file - str, path of the output binary file data_type - str/np.dtype, numpy data type object interleave - str, band interleave type, BSQ, BIL, BIP Returns: out_file - str, path of the output binary file rcsg|]}tj|dqS)r`)r]r_r xrUrrr#sz write_binary..rLcSsg|]}|ddqS)rreshaperrrrr#srcSsg|]}|ddqS)rrrrrrrr#srN)rer`rxr]hstackr)rr|rUrVr2Zdatairrrrzs  rzcGst|dkr&|d}|d}|d}n2t|dkrL|d}|d}|d}n tddSt||f}tj|tjd}|||S)aWrite ROI_PAC rmg format with float32 precision (BIL) Format of the binary file is same as roi_pac unw, cor, or hgt data. should rename to write_rmg_float32() Exmaple: write_float32(phase, out_file) write_float32(amp, phase, out_file) rKrrrz0Error while getting args: support 2/3 args only.Nr)r)rYr]rflattenr_r>r)rampphar|r2rrr write_float32s     rcCstj|tjd}|||S)z$write complex float32 data into filer)r]r_rOrr2r|rrrwrite_complex_float32 s rcCs|j}ttdd|d}ttdd|d}td|dgtj}tt|jtj|df||<tt|j tj|df||<| ||S)zWrite gamma scomplex data, i.e. .slc file. data is complex 2-D matrix real, imagery, real, ... Write in this way, because numpy does not have complex int16 directly. rrKr) sizerrr]zerosr?rr_realimagr)r2r| num_pixelid1id2Frrrwrite_complex_int16s   rcCstj|tjd}|||S)z)write isce float data, i.e. hgt.rdr file.r)r]r_rRrrrrrwrite_real_float64.s rcCstj|tjd}|||S)z'write gamma float data, i.e. .mli file.r)r]r_r>rrrrrwrite_real_float325s rcCstj|tjd}|||SNr)r]r_r?rrrrrwrite_real_int16<s rcCstj|tjd}|||Sr)r]r_rCrrrrr write_byteBs rcCstj|tjd}|||Sr)r]r_bool_rrrrr write_boolHs r)NNNNT)NNNNNT)NrT)T)FF)T)r)Nr<)rbrrnumpyr] mintpy.utilsrrrrrr{rrrrzrrrrrrrrrrrr s.  Q ! D 1 -I ' 9 #