B Qa>x@sddlZddlZddlZddlmZddlmZddl m Z m Z m Z dZ dZdZdUd d ZdVd d Zd dZdWddZddZdXddZddZddZdYddZddZddZd d!ZdZd"d#Zd$d%Zd&d'Zd(d)Zd*ej ej gfd+d,Z!d[d.d/Z"d\d0d1Z#d]d2d3Z$d^d5d6Z%d7d8Z&d9d:Z'd;d<Z(d=d>Z)d_dAdBZ*d`dDdEZ+dadGdHZ,dbdIdJZ-dKdLZ.dMdNZ/dOdPZ0dcdQdRZ1dSdTZ2dS)dN)ndimage)CRSProj TransformeriJxgMXAgHz'D@Tc Csd|kr$|dkr$d}|r$tdt|dt|d}}t|dt|d}}|||d}||d }|rtd |td |td ||dkrt|tjStj|||d } |dkrt| tjSt| |df} t| tjSdS)aCalculate slant range distance from input attribute dict Parameters: atr : dict, including the following ROI_PAC attributes: STARTING_RANGE RANGE_PIXEL_SIZE LENGTH WIDTH dimension : int, choices = [0,1,2] 2 for 2d matrix, vary in range direction, constant in az direction, for radar coord only 1 for 1d matrix, in range direction, for radar coord file 0 for center value Returns: np.array (0, 1 or 2 D) : range distance between antenna and ground target in meters Y_FIRSTrzGinput file is geocoded, return center range distance for the whole areaSTARTING_RANGERANGE_PIXEL_SIZELENGTHWIDTHg@znear range : %.2f mzcenter range : %.2f mzfar range : %.2f m)numN) keysprintfloatintnparrayfloat32linspacetile) atr dimension print_msgrange_ndRlengthwidthrange_fZrange_cZrange_xZrange_xyrI/home/centos/operations/rsmas_insar/sources/MintPy/mintpy/utils/utils0.pyrange_distance s&    r!c Csd|kr$|dkr$d}|r$tdt|d}t|d}t|d}t|d}t|d}|||} tjt|d |d ||d d ||d tj} tjt|d | d ||d d || d tj} | | d } |r$td | td | td| |dkr4| } n|dkrVtj| | |dtj d} n|d krt|d}|dk rt |d dd}tjt||d |d ||d d |||d tj} n"t tj| | |dtj d|df} nt d|| S)aCalculate 2D matrix of incidence angle from ROI_PAC attributes, very accurate. Parameters: atr : dict - ROI_PAC attributes including the following items: STARTING_RANGE RANGE_PIXEL_SIZE EARTH_RADIUS HEIGHT WIDTH LENGTH #for dimension=2 dem : 2D array for height to calculate local incidence angle dimension : int, 2 for 2d matrix 1 for 1d array 0 for one center value print_msg : bool Returns: inc_angle : 2D np.array, incidence angle in degree for each pixel Example: dem = readfile.read('hgt.rdr')[0] atr = readfile.read_attribute('filt_fine.unw') inc_angle = ut.incidence_angle(atr, dem=dem) rrz9input file is geocoded, return center incident angle onlyrr EARTH_RADIUSHEIGHTr rgf@g@z&near incidence angle : {:.4f} degreez¢er incidence angle : {:.4f} degreez&far incidence angle : {:.4f} degreer FALSE)r endpointdtyper NF)rrz un-supported dimension input: {}) rrrrrpiarccosformatrrr!r Exception)rdemrrrrrHrrZ inc_angle_nZ inc_angle_fZ inc_angle_c inc_angler range_distrrr incidence_angleIs>      >>       Hr0cCst|trt|}tj|tjddtj}t|d}t|d}||ttj|}t||}||}|t|}|S)aCalculate the corresponding slant range distance given an incidence angle Law of sines: r + H r range_dist --------------------- = ----------------- = ------------------ = 2R sin(pi - inc_angle) sin(look_angle) sin(range_angle) where range_angle = inc_angle - look_angle R is the radius of the circumcircle. link: http://www.ambrsoft.com/TrigoCalc/Triangle/BasicLaw/BasicTriangle.htm Parameters: atr - dict, metadata including the following items: EARTH_RADIUS HEIGHT inc_angle - float / np.ndarray, incidence angle in degree Returns: slant_range - float, slant range distance )r&r"r#) isinstancestrrrrrr'sinarcsin)rr.r,r-ZR2Z look_angleZ range_angler/rrr $incidence_angle2slant_range_distances   r6FcCsJd|krtddSt|d|d}t|dt|dtj}|S)zkGet range resolution on the ground in meters, from ROI_PAC attributes, for file in radar coord X_FIRSTz5Input file is in geo coord, no range resolution info.Nr)rrr gf@)rrr0rrr4r')rrr.Zrg_steprrr range_ground_resolutions   r8cCsd|krtddSy |d}Wnd}YnX|dkrpt|d}t|d}t|d |||}n|d krt|d }|S) zmGet azimuth resolution on the ground in meters, from ROI_PAC attributes, for file in radar coord r7z7Input file is in geo coord, no azimuth resolution info.N PROCESSORisce)roipacr:r"r#AZIMUTH_PIXEL_SIZEgamma)rrr)rprocReheightZaz_steprrr azimuth_ground_resolutions      rAc Cs|sdSt|tr|g}dd|D}xF|D]>}tj|r,t|dt||td|WdQRXq,Wt|dkr|d}|S)apython equivalent function to Unix utily - touch It sets the modification and access times of files to the current time of day. If the file doesn't exist, it is created with default permissions. Inputs/Output: fname_list - string / list of string NcSsg|]}|dk r|qS)Nr).0xrrr sztouch..aztouch r r) r2r3ospathisfileopenutimerlen)Z fname_listtimesfnamerrr touchs      rNcCs6tdt|dd|ddkd}|d}|S)zConvert UTM Zone string to EPSG code. Parameters: utm_zone - str, atr['UTM_ZONE'] Returns: epsg - str, EPSG code Examples: epsg = utm_zone2epsg_code('11N') ZutmNS)Zprojzonesouthr )rZ from_dictrZ to_authority)Zutm_zoneZcrsZepsgrrr utm_zone2epsg_codes  rSc Cstddlm}||}|}|s<|ddkr<||fSt|}td}t ||}| ||\}}||fS)aConvert x, y in the projection coordinates of the file to lon/lat in degree. Similar functionality also exists in utm.to_latlon() at: https://github.com/Turbo87/utm#utm-to-latitudelongitude Parameters: infile - str, GDAL supported file path x/y - scalar or 1/2D np.ndarray, coordiantes in x and y direction Returns: y/x - scalar or 1/2D np.ndarray, coordinates in latitutde and longitude r)gdalunitdegreez epsg:4326) osgeorTOpenZ GetSpatialRefZ IsProjected GetAttrValuer GetProjectionrZ from_proj transform) infilerCyrTdssrsZp_inZp_outZ transformerrrr to_latlons    r`c Cst|dt|d}}|dkr.dd||f}g}|dk r^t|d}t|}WdQRXd|krt|dV}|d|d|d|d|d f}|d |d|d|d|d f} WdQRXn$d |krt|d } t|d } t|d | |dd} t|d| |dd} |d|d}|d |d}| | |d}| | |d}|d krtj| ||d| ||df\}} n>|dkrtj| ||dd}tj| ||dd} nt d |nd}|d7}t |tj |tj d}tj | tj d} || fS)aExtract precise pixel-wise lat/lon. For meta dict in geo-coordinates OR geom_file with latitude/longitude dataset Returned lat/lon are corresponds to the pixel center Parameters: meta : dict, including LENGTH, WIDTH and Y/X_FIRST/STEP box : 4-tuple of int for (x0, y0, x1, y1) Returns: lats : 2D np.array for latitude in size of (length, width) lons : 2D np.array for longitude in size of (length, width) r r Nrr,latituder r longituderY_STEPX_STEPg?r7y?T)r r%zun-supported dimension = {}zCan not get pixel-wise lat/lon!z] meta dict is not geocoded and/or geometry file does not contains latitude/longitude dataset.)r&) rh5pyFilelistrrrmgridr ValueErrorr)rr)meta geom_fileboxrrrds_listflatslonslat_steplon_steplat0Zlon0Zlat_numZlon_numlat1Zlon1msgrrr get_lat_lonsB  (6    rwc s&dkrtdtdtd}}fdddD}fdddD}tj||ftjd }tj||ftjd }xt|D]}xt|D]}|d ||d |d |||d |d ||||f<|d ||d |d |||d |d ||||f<qWqW||fS) abGet 2D array of lat and lon for metadata dict in radar-coord. WARNING: This is a rough lat/lon value, NOT accurate! Parameters: meta : dict, including LENGTH, WIDTH and LAT/LON_REF1/2/3/4 Returns: lats : 2D np.array for latitude in size of (length, width) lons : 2D np.array for longitude in size of (length, width) rzJInput file is in geo-coordinates, use more accurate get_lat_lon() instead.r r csg|]}td|qS)z LAT_REF{})rr))rBi)rkrr rDasz#get_lat_lon_rdc..)r rrbcsg|]}td|qS)z LON_REF{})rr))rBrx)rkrr rDbs)r&rr r)rr*rrzerosrrange) rkrrrprqlatlonrxjr)rkr get_lat_lon_rdcTs @HrcCs"d|}|t|dd8}|S)aConvert azimuth angle from ISCE los.rdr band2 into satellite orbit heading angle ISCE-2 los.* file band2 is azimuth angle of LOS vector from ground target to the satellite measured from the north in anti-clockwise as positive Below are typical values in deg for satellites with near-polar orbit: ascending orbit: heading angle of -12 and azimuth angle of 102 descending orbit: heading angle of -168 and azimuth angle of -102 Zgv@)rround)az_angle head_anglerrr azimuth2heading_anglens rcCs"d|}|t|dd8}|S)zNConvert satellite orbit heading angle into azimuth angle as defined in ISCE-2.rgv@)rr)rrrrr heading2azimuth_angle}srcCs|dkr|dk rt|}|dkr(td|tjd9}|tjd9}|t|t|d|t|t||t|}|S)a/ Parameters: e - np.ndarray or float, displacement in east-west direction, east as positive n - np.ndarray or float, displacement in north-south direction, north as positive u - np.ndarray or float, displacement in vertical direction, up as positive inc_angle - np.ndarray or float, local incidence angle from vertical head_angle - np.ndarray or float, azimuth angle of the SAR platform along track direction measured from the north with clockwise direction as positive in the unit of degrees az_angle - np.ndarray or float, azimuth angle of the LOS vector from the ground to the SAR platform measured from the north with anti-clockwise direction as positive in the unit of degrees head_angle = 90 - az_angle Returns: v_los - np.ndarray or float, displacement in line-of-sight direction, moving toward satellite as positive Typical values in deg for satellites with near-polar orbit: For AlosA: inc_angle = 34, head_angle = -12.9, az_angle = 102.9 For AlosD: inc_angle = 34, head_angle = -167.2, az_angle = -102.8 For SenD: inc_angle = 34, head_angle = -168.0, az_angle = -102.0 Nzaz_angle can not be None!gf@rO)rrjrr'r4cos)enur.rrZv_losrrr enu2lossBrc Cslt|d}t|d}t|d}t|d}t|d}t|d}|||}|||}||||fS)zReturn 4 corners lat/lonr r rerdr7r)rr) rrrrsrrZwestnorthrReastrrr four_cornerss        rc CsJ|\}}tj| ||| ||f\}}|d|d|dk}|S)z5Get mask of pixels within circle defined by (x, y, r)r)rogrid) rCr]radiusshaperryyxxcmaskrrr get_circular_masks rc Cst|d}t|d}t|tr(|}n t|tr8|}n|dd}dd|D}y>t|d}t|d}tt|d }td |||fWnyt|d}t|d} tt|d }t |t|d t|d }t | t|d t|d}td || |Wn.td|tdtdtddSYnXtj | ||| ||f\} } | d | d |d k} | S)aReturn Index of Elements within a Circle centered at input pixel Parameters: atr : dictionary containging the following attributes: WIDT LENGTH circle_par : string in the format of 'y,x,radius' i.e. '200,300,20' for radar coord '31.0214,130.5699,20' for geo coord Returns: idx : 2D np.array in bool type mask matrix for those pixel falling into the circle defined by circle_par Examples: idx_mat = ut.circle_index(atr, '200,300,20') idx_mat = ut.circle_index(atr, '31.0214,130.5699,20') r r , cSsg|] }t|qSr)r3)rBrxrrr rDsz circle_index..rr rz+Input circle index in y/x coord: %d, %d, %drrdr7rez7Input circle index in lat/lon coord: {:.4f}, {:.4f}, {}z* ERROR: Unrecognized circle index format: zSupported format:z4--circle 200,300,20 for radar coord inputz5--circle 31.0214,130.5699,20 for geo coord input ) rr2tuplerhreplacesplitrrrrintr)r) rZ circle_parrrZcir_parZc_yZc_xrZc_latZc_lonr]rCidxrrr circle_indexs>        ""  &rgcCs.|\}}t|}|t||||}|S)zWrap data into a range. Parameters: data_in : np.array, array to be wrapped wrap_range : list of 2 float, range to be wrapped into Returns: data : np.array, data after wrapping )rrmod)Zdata_inZ wrap_rangeZw0Zw1datarrr wraps r@cCsNt|}g}t|dd}x.t|sH||||N}t|dd}qW|S)aHGet all connected component with number of pixels larger than threshold Parameters: mask_in : 2D np.array with zero as background and non-zero as foreground min_num_pixel : int/float, minimum number of pixels to be identified and output Returns: mask_out : list of 2D np.array in np.bool_ format g@) min_num_pixel)rrget_largest_conn_componentallappend)mask_inrmask_outZmask_ccrrr get_all_conn_componentss   rc Cst|jtj}t|d}tt|dd}||krF|St t|ddd}||k}|rt j ddddgd\}}|d ||d ||d ||At |S) aExtract the largest connected component from an 2D array with zero as background value Parameters: mask_in : 2D np.array with zero as background and non-zero as foreground min_num_pixel : int/float, minimum number of pixels to be identified and output display : bool, display the result or not. Returns: mask_out : 2D np.array in np.bool_ format rr Nrb)nrowsncolsZfigsizer)rrzrbool_rlabelmaxbincountflattenargmaxpltZsubplotsimshowshow) rrdisplayrlabels num_pixel max_labelZfigaxrrr rs rcCsddlm}t|dk\}}t|dd|ddf}||}t|dk\}}t|dd|ddf}||\} } t| } || } || | } | | }|rt t |d|dt | d| dg| d| dgdt | | |fS)atCalculate the min distance between two regions of pixels marked by mask1 and mask2 Parameters: mask1/2 : 2D np.array in size of (length, width) in np.bool_ format Returns: pts1 : tuple of 2 int, bridge point in mask1, in (x, y) pts2 : tuple of 2 int, bridge point in mask2, in (x, y) min_dist : float, min euclidean distance r)cKDTreerOr rz-o) Z scipy.spatialrrwherehstackreshapequeryargminrZfigurerplotr)mask1mask2rrr]rCZpts1treeZpts2distrZidx_minZxy2Zxy1Zmin_distrrr min_region_distance,s"   &rlinearc Csddlm}|j}t|dt|df}ttjd|dd|dddtjd|dd|ddd\}}t|dd|ddf}||||dd||} | S)aaInterpolate input 2D matrix into different shape. Used to get full resolution perp baseline from ISCE coarse grid baseline file. Parameters: inData : 2D array outShape : tuple of 2 int in (length, width) interpMethod : string, choose in [nearest, linear, cubic] Returns: outData : 2D array in outShape r)RegularGridInterpolatorr F)r%rO)methodZ bounds_error) Zscipy.interpolaterrrarangemeshgridrrr) ZinDataZoutShapeZ interpMethodZRGIZinShapeZinPtsrrZoutPtsZoutDatarrr interpolate_dataJs  $rcCsTddlm}m}|\}}|d||fd}||j|dddtj|tjd}|S)arCreate a 2D mask (numpy array in binary) from a polygon. Link: https://stackoverflow.com/questions/3654289/scipy-create-2d-polygon-mask Parameters: polygon - list of tuples of 2 int, e.g. [(x1, y1), (x2, y2), ...] shape - list/tuple of 2 int, for length and width Returns: mask - 2D np.ndarray in bool in size of (length, width) r)Image ImageDrawLr )Zoutlinefill)r&) ZPILrrnewZDrawpolygonrrr)rrrrrrimgmaskrrr polygon2mask]s rcCsDtt|d}|ddkr(dS|ddkr8dStdSdS) zHgarrettdreyfus on Github: https://gist.github.com/garrettdreyfus/8153571z (y/n): rr]TrFzUhhhh... please enter N)r3inputlowerstrip yes_or_no)ZquestionZreplyrrr rqs   rcCshd}x^|D]R}t||}||krB|t||krB|dksV||kr\|dkr\tqd}qW|S)z)Compare new attributes with exsiting onesFNoneT)rr3next)Zatr_newZatr_origupdatekeyvaluerrr update_attribute_or_not|s $rcCsjdd}tj|dr&||rf|Sn@x>tjdtjD](}|d}tj||}||r:|Sq:WdS)zTest if executable existscSstj|ot|tjS)N)rFrGrHaccessX_OK)fpathrrr is_exeszwhich..is_exerPATH"N)rFrGrenvironpathseprjoin)programrrGZexe_filerrr whichs rr cCsd}|dkr(d}|rtdd|ddfSyddlm}m}Wn&tdtd d}d|ddfStt||}|dkrd}td td tn|rtd |y ||||fS||ddfSdS) aECheck parallel option based file num and installed module Link: https://joblib.readthedocs.io/en/latest/parallel.html Examples: num_cores, inps.parallel, Parallel, delayed = ut.check_parallel(len(file_list)) Parallel(n_jobs=num_cores)(delayed(subset_file)(file, vars(inps)) for file in file_list) Tr Fz1parallel processing is diabled for one input fileNr)ParalleldelayedzCan not import joblibzparallel is disabled.zNparallel processing is disabled because min of the following two numbers <= 1:z(available cpu number of the computer: {}z¶llel processing using %d cores ...)rZjoblibrrminrF cpu_countr))Zfile_numrmaxParallelNumZenable_parallelrr num_coresrrr check_parallels0    rLTo l?cCst|}|jdkr*|jd}||d}|dkr@tj|dd}|jdkrht|ddd|jdf}tjt||dd|}|S)aCompute the median absolute deviation of the data along the LAST axis. This function is also included as: scipy.stats.median_abs_deviation() in scipy v1.5.0 https://docs.scipy.org/doc/scipy/reference/generated/scipy.stats.median_abs_deviation.html statsmodels.robust.mad() in statsmodels https://www.statsmodels.org/dev/generated/statsmodels.robust.scale.mad.html The differences are: 1. scipy: out = out / scale while mintpy: out = out * scale 2. scipy propagates nan by default, while mintpy omit nan by default. The following two are equivalent for a 2D np.ndarray X: mintpy.utils.utils0.median_abs_deviation(X) scipy.stats.median_abs_deviation(X, axis=-1, center=np.nanmedian, scale=1./0.67449, nan_policy='omit') Parameters: data - 1/2D np.ndarray, input array center - 0/1D np.ndarray or None scale - float, the normalization constant Returns: mad - 0/1D np.ndarray rrrON)axisr )rrndimrr nanmedianrabs)rcenterscaleZntimemadrrr median_abs_deviations     r@cCs.|dkrt|}t||d}|||}|S)zvcalculate rms_threshold based on the standardised residual Outlier detection with median absolute deviation. N)r)rrr)rrcutoffr thresholdrrr median_abs_deviation_thresholds    rcCs~t|}|dk rLt|}|j|jkrDtd|j|j||8}|t|}tt|d|jd}|S)z5Calculate the root-mean-square error between x and y.Nz+Input x & y have different size: {} vs. {}!rr ) rrrsizerjr)isnansqrtsum)rCr]Zrmserrr root_mean_sq_errors rcCsBtttt|}t|| }||kr2|}n |d|}|S)z@Return the most significant digit of input number and ceiling it )rrfloorlog10rr)rCdigitZx_roundZx_ceilrrr ceil_to_1s   rcCs$tttt|}t|| S)z1Return the most significant digit of input number)rrrrrr)rCrrrr round_to_1sr cCs&tdtt|}t|}|S)z7Given a number x, find the highest power of 2 that <= xr)rpowerrlog2int16)rCresrrr highest_power_of_2s rcCs<ddlm}||}dd||D}|dkr8|d}|S)zReturn the k most common item in the list L. Examples: 5, 8 = most_common([4,5,5,5,5,8,8,8,9], k=2) 'duck' = most_common(['goose','duck','duck','dog']) 'goose' = most_common(['goose','duck','duck','goose']) r)CountercSsg|] }|dqS)rr)rBrxrrr rD)szmost_common..r ) collectionsr most_common)rkrcntZitem_mmrrr r s  rcCs&y t|dStk r dSXdS)a Check string is a number. Not using str.isnumeric() because it can not handle floating point nor negative sign. Link: https://elearning.wsldp.com/python3/python-check-string-is-a-number/ Parameters: string - str, a string Returns: True/False TFN)rrj)stringrrr is_number/s r)rT)NrT)F)N)NNr)NN)r)rF)F)r)r Tr)Nr)Nr)N)r )3rFrfnumpyrZmatplotlib.pyplotZpyplotrscipyrZpyprojrrrSPEED_OF_LIGHTr"Kr!r0r6r8rArNrSr`rwrrrrrrrr'rrrrrrrrrrrrrrr rrrrrrr sT   ) B#   > %  8       * '