7f7U ddlZddlZddlZddlZddlZddlmZmZddlmZddl Z ddl Z ddl Z ddl Z ddl ZddlZddlmZddlZddlmZdZdZdgd gfd Zd Zdd Zdd ZdZdZdZdZ dZ!ddZ"dZ#dZ$ddZ%ddZ&y)N)datetimedate) relativedelta)cm)PATH_JETSTREAMc||tj|ryt|tk(r t j |d}n|}|j }|jj}|dzdk(r|dzdk7s|dzdk(rd}nd }||d z |z z}t|d}|S#t j |d}YvxYw) aN Converts a date string or date object to a decimal year. Parameters: date_str (str or datetime.date): The date string in the format 'YYYY-MM-DD' or a datetime.date object. Returns: float: The decimal year representation of the input date. Example: >>> date_to_decimal_year('2022-01-01') 2022.0 N%Y-%m-%d%Y%m%drdigv@gv@) pdisnatypestrrstrptimeyear timetupletm_ydayround)date_strdate_objr day_of_year days_in_year decimal_years P/home/exouser/operations/rsmas_insar/tools/Precip/src/precip/helper_functions.pydate_to_decimal_yearrs2778, H~ =((:>H  ==D$$&..K qA $*/tczQ  ;?l::Lq)L ' =((8sZ,sJDJJsO4eS""4/2H O ,iies $AAfffff~f|Vc tjtj|d|ddd}tjtj|d|ddd}||fS#tjtj|dddd}tjtj|dddd}Y||fSxYw)a  Generate an array of coordinates based on the given longitude and latitude ranges. Args: longitude (list, optional): A list containing the minimum and maximum longitude values. Defaults to [-179.95]. latitude (list, optional): A list containing the minimum and maximum latitude values. Defaults to [-89.95]. Returns: tuple: A tuple containing the generated longitude and latitude arrays. The default list generated is used to reference the indexes of the precipitation array in the netCDF4 file. rr g?gf@g33333V@)nprarange) longitudelatitudelonlats rgenerate_coordinate_arrayr3Vs>hhryy1y|SA1Ehhryy!hqk3?C 8O >hhryy1vs;Q?hhryy!eS91= 8Os A"A((AC cjt|tst|tr||g}t|tst|tr||g}tt |D]]}t t||dzdz }d|cxkrdkr)n td |dkDrdnd}t ||zd||<Ttd tt |D]]}t t||dzdz }d |cxkrd kr)n td |dkDrdnd}t ||zd||<Ttd ||fS) a Adjusts the latitude and longitude coordinates to ensure they fall within the valid range (GPM dataset resolution). Parameters: latitude (float or str or list): The latitude coordinate(s) to be adjusted. longitude (float or str or list): The longitude coordinate(s) to be adjusted. Returns: tuple: A tuple containing the adjusted latitude and longitude coordinates. Raises: ValueError: If any of the latitude or longitude values are not within the valid range. g$@r*g|V@rg?gr,z*Values not in the Interval (-89.95, 89.95)r)gfffff~f@z*Values not in the Interval (-179.5, 179.5)) isinstancefloatrrangelenr!r ValueError)r0r/ilavallos radapt_coordinatesr?nsQ)U#z)S'A * (E"j3&?h' 3x= ! L x{#r) *d 2 R 5 IK K q&$eCS!,HQKIK K L3y> "L y|$* +t 3 b "F " IK Kq&$uC c1-IaLIK KL Y cgd}t|tr tjj |}n|}|dj t k(rtj|d|d<|jddd|vr|rLtd|j|dj}|jdtd|S|r9td |djj}td|S|sEtd |djjt|z }td|Sy t!d ) a Resamples the precipitation data in the given dictionary by the specified time period. Args: dictionary (dict): A dictionary containing precipitation data. time_period (str): The time period to resample the data by (e.g., 'W' for weekly, 'M' for monthly, 'Y' for yearly). Returns: pandas.DataFrame: The resampled precipitation data. Raises: KeyError: If the 'Precipitation' field is not found in the dictionary. )mDateT)inplace Precipitationz#Averaging the precipitation data...r7-------------------------------------------------------z+Calculating the cumulative precipitation...z(Calculating the average precipitation...z6Error: Precipitation field not found in the dictionaryN)r6dictr DataFrame from_dictdtyper to_datetime set_indexprintresamplemean reset_indexcumsumsumr9KeyError) dictionary time_periodcumulatem_ydf precipitationcumulative_precipitationaverages r#weekly_monthly_yearly_precipitationr`s? C*d# \\ # #J / &z3^^BvJ/6 LLL&"  7 8KK A7<<>M  % %d % 3 K L  ? @')/':'A'A'C'G'G'I $ K L+ + < =)002668R@G K LN OPPr@c |r&t|tst|tr|d}nd}t|tr& t j |dj }n!t|t r |j }t|tr& t j |dj }nt|t r |j }n||dk(rXjdk(r9t |j|jt|j }nH|tdz}n8|dk(r3t j |dj }|td z}t jj k\r/t jj tdz }tj| j }td |d |d t!|dtd|S#t j |dj }YxYw#|}YxYw#t j |dj }YxYw#|}YxYw)a Generate a list of dates based on the given start and end dates. Args: start (str or date): The start date of the date range. Can be a string in the format 'YYYYMMDD' or 'YYYY-MM-DD', or a date object. end (str or date, optional): The end date of the date range. Can be a string in the format 'YYYYMMDD' or 'YYYY-MM-DD', or a date object. If not provided, the current date will be used. average (str or tuple or list, optional): The average period for the date range. Can be 'M' for monthly or 'Y' for yearly. If a tuple or list is provided, the first element will be used as the average period. Defaults to 'M'. Returns: list: A list of dates ranging from the start date to the end date. Raises: ValueError: If the start or end date is not in a valid format. rMr r r rD)daysYrFstartendz Generated date list ranging fromto containingrcrJ)r6tuplelistrrrrr&rr#r(rtodayr date_rangerQr9)rfrgr_sdateedate date_lists rgenerate_date_listrqs * gu %GT)BajG% ?%%eH5::yyA~ U[[-:NOTTV 2 66 ^%%eH5::E  E  =%%c*5::.checkfs r@)targetr5)timeoutyes)rQ threadingThreadrfjoinlower) operationmsgrtrs @rask_userrUs`G> #| F &AGGIFF2F <<>U ""r@c |r t|yyr)rQ)rverboses rvprintros c r@c@|dk(rd}|S|dk(rd}|S|dk(rd}|Sd}|S)z Simple function used for labelling when plotting. Args: color_count: Number of quantiles Return: quantile: string used in plot labelling r,zhalf ztertile r z quartile z quantile ) color_countquantiles r quantile_namertsPa O   O   O Or@ctjdd}|dkDrd|dz z}tj|dz }tj|dz }t |Dcgc]}|d||zz dd}}t |Dcgc]}|d ||zzdd}}|j ||z}|S|d g}|Scc}wcc}w) z Creates a list of colors to use when plotting. Args: color_count: Number of quantiles Return: colors: List of colors viridisr Zr,Nr)rget_cmapmathceilfloorr8reverse) rplasma_colormap color_spacing half_countupp_halfr;yellowsgreenscolorss r color_schemerskk)S1OQ{1}- YY{Q/ ::kAo.GLZGXY!?3=#89"1=YYFKHoV/#-"78!<VV6! M"#&' MZVs !CC c,|dk(r|j}n`|dk(r9||dj|djzj}n"||d|k(|d|k(zj}d|jvr5|jj t |d<|j dg}d|jvr`|dk(r/|jj|d j|d<n,|jj|j|d<|jdg }d |jvr"|dk(r|jj|d <d |jvrtj|d |d <|S)ao Uses lat/lon, date, and rainfall amount to create a new dataframe that includes site specific decimal dates, rolling average rain, and cumulative rain. Args: rainfall: Satellite rain dataframe for volcanos in chosen region. volcanos: A dictionary of sites (eg. sites_dict = {'Wolf': (-91.35, .05, 'Wolf'), 'Fernandina': (-91.45, -.45, 'Fernandina')}). pick: volcano or site at which to collect data. roll_count: Number of days to average rain over. Return: volc_rain: A new dataframe with additional columns for decimal date, rolling average, and cumulative rain. NNaN LongitudeLatitudeDecimal)byrollT)center)rrIrUrG)copyrcolumnsrGapplyr sort_valuesrIrollingrVdropnarUrrO)rainfall roll_countr1r2centeredrU volc_rains rvolcano_rain_framers, d{MMO h{388:x ?S?X?X?Z[\aac h{3s:x ?SWZ?Z[\aac ((((~~334HI )))i[)9  Y&&& t  ) 7 7 ? ? SW ? X \ \ ^If !* 7 7 ? ? K O O QIf    1I)+++ T>"+"9"9"@"@"BIh  """NN9V+<= & r@c|jD]} ||jd||<|S#ttf$rY1wxYw)z Converts a nested list of floats to a flat list of floats. Args: nested: A nested list of floats. Return: flat: A flat list of floats. c*t|dddS)Nr)r7xs rz&from_nested_to_float..sERSTURVWXRYZ[R\L]r@)rr IndexError TypeError) dataframe column_names rfrom_nested_to_floatrsZ!((  %.{%;%A%AB]%^Ik " 9%   s -??c Dt|ts t|}g}tt|D]}t j ||j }tt|D]N} |j||cxkr|j|dzkr#nn |j|j|P|S#||j|kr|j|j|n&tdt|jdYxYw)Nr z Removing z) from the list of eruptions. Out of range) r6rkr8r9r Timestamp normalizeilocappendrQrr)eruption_datesrpvalid_eruption_datesr; eruption_datejs r adapt_eventsrs  nd +n- 3~& 'l ^A%67AAC s9~& lA l>>!$ K qs8KK(// q0AB l l$  l INN1$55(// q0ABIc-*<*<*>&?%@@ijks3A CADc tj}i}t\}}|r|jdt\} } } | j j | jj} | jdD cgc]} | jds| }} |j}n.sX\XbXbcdckckcmXnr@zTINSERT INTO volcanoes (Date, Precipitation, Latitude, Longitude) VALUES (?, ?, ?, ?)cftjjtj|Sr)r-maarrayr loadsrs rrz+sql_extract_precipitation..sbeekk$**UV->Xr@)!rrzr{rpathrrrwriterr}IOErrorsqlite3connectOperationalErroropenrcursorexecutefetchonecommitrread_sql_queryrOdtrr rrqrriterrowsrQ)r0r/rprrsftp temp_file database_pathrdb_pathconnrr2r1queryr\r missing_datesr]indexrow local_files rsql_extract_precipitationr*Qs }}//u=  ^^D  %=$/ *1) * nnGw' V^<  2??=1D[[]F NN[\ ??    a[M8A;- (C q\N!IaL> *CJ3%Obcfbgg{}FGH}I|JJQR[\^R_Q``a bE  5$ 'B6 +..33BvJ'0Sd4r&z?P?P?R3RTSMS&]1-==QSCTU -h 9fVYZ )6)G)M)MNn)o o&(002 GJE3 NNqVc/&:CE G G   ud + YY~6 = +gt$ +  )* + +  JJL_-334XYB "I Iu * *  %=$/ 1    nnG  %"'' 2  $ * * ,??=1D 2BT. + + + +sL+ LL+ M0*N9N9 O  N>9O L(#L++M-M M-M M-,M-0AN65N6>O O  O)NF)Nrb)NNFTr)'rrwiorr rrdateutil.relativedeltarr$rrrznumpyr-pandasr matplotlibrnetCDF4r~ precip.configrrr(r3r?r`rqrrrrrrrrrr*rr@rr2s #0((V0*1 VH0+\7QtM`,^#4 063l* 8@Fer@