B Qa Y@sddlZddlZddlZddlZddlZddlmZmZm Z m Z m Z dZdZddZdddZd d Zd d Zd dZddZddZejfddZdddZddZdddZedkreejdddS) N)ptimereadfile writefileutils attributea template ## if both yx and lalo are specified, use lalo option unless a) no lookup file AND b) dataset is in radar coord mintpy.subset.yx = auto #[1800:2000,700:800 / no], auto for no mintpy.subset.lalo = auto #[31.5:32.5,130.5:131.0 / no], auto for no aexample: subset.py inputs/ifgramStack.h5 -y 400 1500 -x 200 600 subset.py geo_velocity.h5 -l 30.5 30.8 -L 130.3 130.9 subset.py 030405_090801.unw -t SinabungT495F50AlosA.template # subset to the same coverage as the reference file subset.py geo_incidence.h5 -r subset_geo_velocity.h5 # multiple files input subset.py *velocity*.h5 timeseries*.h5 -y 400 1500 -x 200 600 # crop to larger area with custom fill value subset.py geo_velocity.h5 -l 32.2 33.5 --outfill-nan subset.py Mask.h5 -x 500 3500 --outfill 0 # "tight" subset for geocoded lookup table larger than data file subset.py geomap_4rlks.trans --tight c Cstjdtjtdtd}|jdddd|jdd d d td d d|jddddtd dd|jdddddtd dd|jdddddtd dd|jd d!d"d#d$|jd%d&d'd(|jd)d*d+d,|jd-d.td/d0|jd1d2d3d4d5d6|jd7d8d9d:d$|d;d<}|jd=d>d?d$|S)@Nz#Generate a subset from file/dataset ) descriptionformatter_classepilogfile+zFile(s) to subset/crop)nargshelpz-xz--sub-xz --subset-xsubset_xz.subset range in x/cross-track/column direction)desttyper rz-yz--sub-yz --subset-ysubset_yz+subset range in y/along-track/row directionz-lz--latz --sub-latz --subset-lat subset_latzsubset range in latitudez-Lz--lonz --sub-lonz --subset-lon subset_lonzsubset range in column z-tz --template template_filez}template file with subset setting. i.e. mintpy.subset.yx = 300:800,1000:3500 mintpy.subset.lalo = 30.2:30.5,130.1:131.3)rrz-rz --referencez9reference file, subset to the same lalo as reference file)rz--tight store_truezsubset geomap_*.trans file based on non-zero values. For geocoded file(s) onlyA convenient way to get rid of extra wide space due to "too large" DEM. )actionrz --outfill fill_valuezyfill subset area out of data coverage with input value. i.e. np.nan, 0, 1000, ... By default, it's None for no-outfill.)rrrz --no-parallelparallel store_falseTz=Disable parallel processing. Diabled auto for 1 input file. )rrdefaultrz-oz--outputoutfilezloutput file name add prefix "sub_" if input/output files are in the same directory; same filename otherwise.DatasetszpCreate a subset of entire dataset in radar using y/x or lat/lon option Including *.trans and *.dem in geo coord.z--lookup lookup_filezcalculate bounding box in geo/radar coord from input radar/geo subset range using transformation file, i.e. geomap_4rlks.trans All input radar coord file should be same size/coverage; same for all geo coord files.) argparseArgumentParserRawTextHelpFormatterTEMPLATEEXAMPLE add_argumentintfloatadd_argument_group)parserZ dset_groupr*C/home/centos/operations/rsmas_insar/sources/MintPy/mintpy/subset.py create_parser2s:      r,cCs8t}|j|d}t|j|_t|jdkr4d|_|S)N)args)r, parse_argsut get_file_listr lenr)iargsr)inpsr*r*r+cmd_line_parsebs  r5c Cst|d}t|d}yXt|d}t|d}t|d}t|d}|||}|||}||||f} Wntk rd} YnXy0t|dt|d t|d t|d f} Wntk rd} YnX| | fS) zGet Coverage Box of data in geo and pixel coordinates Inputs: atr - dict, meta data dictionary Outputs: pix_box : 4-tuple of int, defining in (UL_X, UL_Y, LR_X, LR_Y) geo_box : 4-tuple of float in lat/lon LENGTHWIDTHY_STEPX_STEPY_FIRSTX_FIRSTN SUBSET_XMIN SUBSET_YMIN SUBSET_XMAX SUBSET_YMAX)r&r' ValueError) atrlengthwidthlat_steplon_stepZul_latZul_lonZlr_latZlr_longeo_boxpix_boxr*r*r+get_coverage_boxos(             rHc Cst|}yhdd|ddD}tdd|ddD\}}tdd|d dD\}}||||f}Wnd }YnXyhd d|d dD}td d|ddD\}} tdd|d dD\} } | || | f} Wnd } YnX| |fS)ziRead mintpy.subset.lalo/yx option from template file into box type Return None if not specified. cSs$g|]}|ddddqS)[])stripreplace).0ir*r*r+ sz,read_subset_template2box..zmintpy.subset.lalo,cSsg|]}t|qSr*)r'rL)rNrOr*r*r+rPsr:cSsg|]}t|qSr*)r'rL)rNrOr*r*r+rPsr.NcSs$g|]}|ddddqS)rIrJrK)rLrM)rNrOr*r*r+rPszmintpy.subset.yxcSsg|]}t|qSr*)r&rL)rNrOr*r*r+rPscSsg|]}t|qSr*)r&rL)rNrOr*r*r+rPs)r read_templatesplitsorted) rtmploptslat0lat1lon0lon1rFy0y1x0x1rGr*r*r+read_subset_template2boxs        r`cCsp|r*|d|dg|_|d|dg|_n d|_d|_|r`|d|dg|_|d|dg|_n d|_d|_|S)z9Update inps.subset_y/x/lat/lon from pixel_box and geo_boxrrr.N)rrrr)r4rGrFr*r*r+subset_box2inpssrbc Cs t|d|d}t|d|d}t|d|d}t|d|d}||ksX||krd}|d|7}|d|7}t|||||f}|d|d|d|d|d|d|d|df}|d|d|d|d|d|d|d|df} || fS)a[Get index box overlap area of two input boxes Inputs: box1/2 : 4-tuple of int, indicating coverage of box1/2 defining in (x0, y0, x1, y1) Outputs: overlap_idx_box1/2 : 4-tuple of int, indicating index of overlap area in box1/2 defining in (idx_x0, idx_y0, idx_x1, idx_y1) rr.rraz(No overlap between two input box range! z box 1: {} z box 2: {} )maxminformatr@) Zbox1Zbox2r^r\r_r]msgZ overlap_boxZoverlap_idx_box1Zoverlap_idx_box2r*r*r+get_box_overlap_indexs& rgc Cstt|d}tt|d}t|}|ddrJ|j|ddd}n|dr\|d}nd|g}|d dr|j|d d d}n|d r|d }nd|g}t|}t|}|d|d|d |d f}||}||fS) aOConvert subset inputs dict into box in radar and/or geo coord. Inputs: subset_dict : dict, including the following 4 objects: subset_x : list of 2 int, subset in x direction, default=None subset_y : list of 2 int, subset in y direction, default=None subset_lat : list of 2 float, subset in lat direction, default=None subset_lon : list of 2 float, subset in lon direction, default=None meta_dict : dict, including the following items: 'WIDTH' : int 'LENGTH': int 'X_FIRST' : float, optional 'Y_FIRST' : float, optional 'X_STEP' : float, optional 'Y_STEP' : float, optional Outputs: # box defined by 4-tuple of number, defining (left, upper, right, lower) coordinate, # (UL_X, UL_Y, LR_X, LR_Y ) pixel_box : 4-tuple of int, in pixel unit - 1 geo_box : 4-tuple of float, in lat/lon unit - degree None if file is in radar coordinate. example: subset_dict = {'subset_x': None, 'subset_y': None, 'subset_lat': [30.5, 31.0], 'subset_lon': [130.0, 131.0]} subset_dict = {'subset_x': [100, 1100], 'subset_y': [2050, 2550], 'subset_lat': None, 'subset_lon': None} pixel_box = subset_input_dict2box(subset_dict, meta_dict)[0] pixel_box, geo_box = subset_input_dict2box(subset_dict, meta_dict) r7r6rNlatitude) coord_typerrr longituderr.)r&r'r0 coordinategetlalo2yxrU box_pixel2geo) subset_dict meta_dictrCrBcoordsub_ysub_x pixel_boxrFr*r*r+subset_input_dict2boxs$      ruc Cstd|d|dtj|dtj|||ddd}|j}t|}|dkrt |d |d |d|df|j |} || |d |d |d|df<nh|d kr t |d|d |d |d|df|j |} || dd|d |d |d|df<| S) Nzreading z in z from z ...F) datasetNamebox print_msgrrrar.) printospathbasenamerreadshaper2nponesdtype) fnamedsNamerG pix_box4datapix_box4subsetrdatads_shapeds_ndimdata_outr*r*r+subset_dataset"s $ &   *rc Cst|}t|d}t|d}|d}td|d|d|}t||\}} t|} d} d|kr|drd } nd} | s| |}t j |d<| |} d d ||f} td | td |td | | td | || krtd|St| |\} }|sttjtj|krd|krv|drvd tj|d tj|d}ndtj|}n tj|}td|t||}t|}tj|d}|dkr*tj|||dx|D]:}t|d }||}|j}|j}tdj || tj|d|dkr|| d| d| d | df}t |d|d|d|d f|j |d}|||d|d|d |df<t j!||j d}d t|dd t|dg}tj"||||d d|dkrt#j$|d d}xt%|d D]}||| d| d| d | df}t d|d|d|d|d f|j |d}||dd|d|d|d |df<||dd t|dd t|dg}tj"||||dd|j&|dd |d|d d!qW|'td" |WdQRXqWnt(}x*|D]"}t)|||| ||dd#||<q6Wt*||d$<tj+||||d%tj,|d&stj,|d'rt-|||S)(a?Subset file with Parameters: fname : str, path/name of file subset_dict : dict, subsut parameter, including the following items: subset_x : list of 2 int, subset in x direction, default=None subset_y : list of 2 int, subset in y direction, default=None subset_lat : list of 2 float, subset in lat direction, default=None subset_lon : list of 2 float, subset in lon direction, default=None fill_value : float, optional. filled value for area outside of data coverage. default=None None/not-existed to subset within data coverage only. tight : bool, tight subset or not, for lookup table file, i.e. geomap*.trans out_file : str, path/name of output file Outputs: out_file : str, path/name of output file out_file = 'sub_'+fname, if fname is in current directory; out_file = fname, if fname is not in the current directory. r7r6 FILE_TYPEzsubset z file: z ...FrTrz!data range in (x0,y0,x1,y1): {}z!subset range in (x0,y0,x1,y1): {}z data range in (W, N, E, S): {}z subset range in (W, N, E, S): {}z7Subset range == data coverage, no need to subset. Skip.tightz {}_tight{}r.Zsub_z writing >>> )z.h5z.he5)metadataref_filerz cropping {d} in {b} from {f} ...)dbfrra)r)rrvblockrx)maxValueNz{}/{})suffixzfinished writing to file: {})rBANDS)out_filerrz.xmlz.aux.xml).rread_attributer&rycopyrur0rkkeyscheck_box_within_data_coveragernanrnrergrzgetcwdr{dirnameabspathsplitextr|attrupdate_attribute4subsetget_dataset_listr layout_hdf5h5pyFiler~ndimrrarraywrite_hdf5_blockr progressBarrangeupdateclosedictrr2writeisfilewrite_isce_xml)rZsubset_dict_inputrrArCrBkrorGrFrqZoutfilldata_boxrrdsNamesextrfidsrrrrrprog_barrOdsDictr*r*r+ subset_file?s               $ *$(  $ rc Cstdd|j|j|j|jgDr|jrTt|j}t|\}}t d|jnT|j rzt |j \}}t d|j n.|j rt |j|_|jstdt|j}t |}d|krJtj|jddd}tj|d d \}}t||t|k\} } t| d t| d t| d t| d f}||}~nTtj|jd dd} tj|jd dd} t| t| t| t| f}d}~ ~ ntdt|||}|S)Ncss|] }| VqdS)Nr*)rNrOr*r*r+ sz'read_aux_subset2inps..zusing subset info from z s*0 #(<  2