vg5\dZddlZddlZddlmZddlmZddlmZddl m Z GddZ y) zmakes feature length countsN)Vemli)Fitli)Sigsi)Folderc<eZdZd dZdZdZd dZdZdZd dZ y) VelopNc||_t|j|_|jj|_||_d|_|j dz|_t|j|_t|j|_ ||}n|jj}||_ i|_ d|_d|_|j!|j"d|_|d|_d|_i|_y|jdz|zdz|_|jdz|zdz|_i|_y)Nz .velop.jsonz.gzrfitli/z_lensu.json.gzz_entsi.json.gz)ervemli do_verbosedo_sigfi ext_no_gzextrfolderrsigsiget_lastsigfilengths count_papids count_lengthsimport_from_fitlidirs entsi_fufi lensu_fufiraw)selferimprrrs !/home/ernad/ernad/python/velop.py__init__zVelop.__init__s!466] &&++  &>>E)TVVn 466]   EJJ'')E    jj) ="DO"DO  #kkC/%7:JJDO"kkC/%7:JJDOcHt|jd|_|jj|_|jj|_|jj |_|jj |_|jj|_y)z,fitli has common routines of dofre and ranfivelopN)rr r fufiget list_sigssigs_availablesig)rs r rzVelop.import_from_fitli5sd4667+ JJOO ::>>--"jj77::>>r"c t|jdk(r|j|_d}i}|jD]}||j|z }|||<i|_i|_|jD]6}|j||z |j|<|||z |j|<8|j r?|jD]/}t |d|j|d|j|1yy)z-> used by the grondr N)lenrr&relatcumulrprint)rtotalcumulslengths r servez Velop.serve?s txx=A xxzDHhhF TXXf% %E"F6N  hhF!%&!1E!9DJJv !'%!7DJJv  ??(($**V"4!5Qtzz&7I6JKL# r"c |j}|jj|}d}|j}t j ||s,|j rtd|d|jy|D]}t j|} | |jvr'|j rtd|zdzdd t j|} |j r td d | D]} | | } |j| | |d z }|||k\rn|j rtd| i} t|jj}|D]}|j|| |<t j | |td|z|t j"|d|j| } | S)z#-> makes update for all vemli files)rrvelop: z needs no renewalFz velop loads u … T)flushenddone)r7zvelop: I work on z velop wrote *.lensu.json.gz)r r out_fufisrfilerdonererr/ run_entsi get_issuedateactive_issuedatesload feed_papidsortedrkeysdumpclear_by_extension)rr max_filesrr vemli_fufis count_filesout_fufi vemli_fufi issuedate papids_vemlispapidr outnumbersr2s r updatez Velop.updateQs< FF jj**H*=  ??||Hk2z):;< NN %J++J7I 3 33nz1G; b*!JJz2MfD)&%e,u-' 1 K$ )A))56 %&***,-F,,v.CK 3! nx'(    $ $X/@ AnnS! r"c|xjdz c_t|jdz }|xj|z c_||jvrd|j|<y|j|xxdz cc<y)Nr:)rr,splitrr)rrOr r2s r rCzVelop.feed_papidsj QU[[]#a' f$  %#$DLL  V!r"cd}|jj|jjd|}|t d|yt j |}|S)z7loads last lensu.json.gz file fit_count --> paper_countr;r Nzvelop has not file )r last_by_mtimer rr/r=rB)rrr%datas r rBz Velop.loadsW {{((W)=sC < 'u- .zz$ r"ctj|j|jgs:|jr-d|jd}|d|jz }t |yd}|tj |j}|D] }|||z } i}d}|jD]*}t|||z }||||<|}|||z||<|},d}|D]^}t||} | dkrd||<| dk\rd||<'d| ztj| zt|z||<|||kDsZ||}`|} |D]}||dk(r ||| ks||} |D]}||dk(s | ||<tj|j||j tj|jd|S) Nr5z needs noz update over Frr:z*.entsi.json.gz)r=r>rrrr/rBrEintfloatmathlog2rFrrG) rlensumr0countentsipreviousfreqmaxir.minis r r?zVelop.run_entsis||DOOdoo->?doo.i8}T__$566a =JJt/EE U5\ !EZZ\EuU|$u,D#e   ?T1E%LH"E%,'Ez e z e ;5)99E%LHE%LU|d"U|EU|q U|d"U|  EU|q #e   4??E* ==  $ $T__6G H r")FN)FNN)N) __name__ __module__ __qualname__r!rr3rRrCrBr?r"r rrs(#J"M$1r " 6r"r) __doc__r=r]r rr rrrrrrrjr"r rls(! IIr"