Application slows down over time - Java + Python -

-

this difficult 1 explain, , not hopeful single, simple answer, thought it's worth shot. interested in might slow down long python job interacts java application.

we have instance of tomcat running complex , robust webapp called fedora commons (not confused fedora os), software storing digital objects. additionally, have python middleware performs long background jobs celery. 1 particular job ingesting 400+ page book, each page of book has large tiff file, smaller pdf, xml, , metadata files. on course of 10-15 minutes, derivatives created these files , added single object in fedora.

our problem: on course of ingesting 1 book, adding files digital object in java app fedora commons slows down consistently , predictably, can't figure out how or why.

i thought graph of ingest speeds might help, perhaps belies common memory management pattern more experienced java might recognize:

enter image description here

the top-left graph timing large tiffs, being converted jp2, ingested fedora commons. bottom-left small xml files, no derivative being made, ingested well. can see, slope of curve slowing down identical. on right, 2 processes graphed together.

i've been on internet trying learn garbage collection in java (gc), trying different configurations, not having effect on slowdown. if helps, here memory configurations we're passing tomcat (where tail-end believe diagnostic):

java_opts='-server -xms1g -xmx1g -xx:+useg1gc -xx:+disableexplicitgc -xx:survivorratio=10 -xx:targetsurvivorratio=90 -verbose:gc -xloggc:/var/log/tomcat7/ggc.log -xx:+printgcdetails -xx:+printgctimestamps -xx:+printheapatgc'

we're working 12gb of ram on vm.

i realize number of factors might result in behavior are, excuse pun, off charts. we've worked fedora commons , our python middleware quite time, , been successful. slow down set watch feels suspiciously java / garbage collection related, though wrong too.

any or advice digging in more appreciated!

you suspect gc problem, show no gc metrics. put program through profiler , see why gc overloaded. hard solve problem without identifying cause.

once have found problem lies, need change code instead of tweaking gc settings.


Comments

Post a Comment

Popular posts from this blog

java - Suppress Jboss version details from HTTP error response -

-
my jboss verson jboss eap 6.3 when kind of error response sent jboss, adds server information response. following sample row response: http/1.1 400 bad request server: apache-coyote/1.1 content-type: text/html;charset=utf-8 content-length: 2391 date: tue, 19 jul 2016 09:30:46 gmt connection: close jboss web/7.4.8.final-redhat-4 - jbweb000064: error report jbweb000065: http status 400 - org.codehaus.jackson.map.jsonmappingexception: can not construct instance of mybean.type string value 'xyz': value not 1 of declared enum instance names @ [source: org.jboss.resteasy.core.interception.messagebodyreadercontextimpl$inputstreamwrapper@5e421c2b; line: 14, column: 26] (through reference chain: requestargs["request"]) jbweb000309: type jbweb000067: status report jbweb000068: message org.codehaus.jackson.map.jsonmappingexception: can not construct instance of mybean.type string value 'xyz': value not 1 of declared enum instance names @ [source: org.jboss...
Read more

gridview - Yii2 DataPorivider $totalSum for a column -

-
i have order , ordersearch models. in order list (actionindex) gridview there filtering , sorting. on of columns in order order_total (sum of products in order). i need implement sum of order_total in gridview. if manually counting activedataprovider->getmodels() array_map spend 3 seconds 3000 orders (localhost). don't want miss time. i see 2 ways make faster: create cache every filter , update lifetime (horrible) the interesting can right in ordersearch->search() method $query method. don't understand how can pass in controller. example of code 2nd way: class ordersearch extends order { public $totalsum; public function search($params) { $query = order::find(); $dataprovider = new activedataprovider([ 'query' => $query, ]); $this->load($params); $this->totalsum = $query->sum('order_total'); // works fast return $dataprovider; } } after i...
Read more

Sass watch command compiles .scss files before full sftp upload -

-
i use winscp download , edit .scss files , sass on linux (on server) compile them .css . after saving file, use: sass scss/style.scss css/style.css , replaces css file compiled sccs. the problem i want skip part return command line after editing scss file, sake of automation , saving time. but, if use watch command: sass --watch scss/style.scss:css/style.css synchronize 2 files, alerts nonexistent css errors pop up: change detected to: scss/style.scss error scss/style.scss (line 232: invalid css after "...ht: bold; line-": expected "{", "") note that when file uploads quicker usual (sometimes happens) watch command job, no errors. this because, when file upload takes time, sass compiles scss file (on server) before uploaded remote folder. thus, compiles part of file, resulting in css errors. is there way set timer watch command waits few seconds after detects changes , before compiling? any other way overcome is, of course, ...
Read more