Recently some of our pylons servers experienced mysql overflow. Pylons app is served via apache 2.2 using worker mpm on gentoo with kernel 3.2. It uses sqlalchemy to access mysql server. The pylons error is:<\/p>\n
>> self.pool.connect(),
\nModule sqlalchemy.pool:210 in connect
\n>> return _ConnectionFairy(self).checkout()
\nModule sqlalchemy.pool:371 in __init__
\n>> rec = self._connection_record = pool._do_get()
\nModule sqlalchemy.pool:685 in _do_get
\n>> (self.size(), self.overflow(), self._timeout))
\nTimeoutError: QueuePool limit of size 5 overflow 5 reached, connection timed out, timeout 30<\/tt><\/p>\n
Simultaneously, RAM hit 100% capacity and swap kicked in. Looking into memory use on the machine, mysql took ~6%, apache ~1%, and everything else was eaten by pylons. My apps use beaker for caching of certain functions. In principle, turning off cache might help, however it would increase system load and slowed down server response.<\/p>\n
The quick workaround was to modify number requests per child in apache controlled by MaxRequestsPerChild global. This basically allows faster recycling of processes and freeing<\/p>\n
Recently some of our pylons servers experienced mysql overflow. Pylons app is served via apache 2.2 using worker mpm on gentoo with kernel 3.2. It uses sqlalchemy to access mysql server. The pylons error is: >> self.pool.connect(), Module sqlalchemy.pool:210 in connect >> return _ConnectionFairy(self).checkout() Module sqlalchemy.pool:371 in __init__ >> rec = self._connection_record = pool._do_get() Module […]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":[],"categories":[37,3,13,20,26,27],"tags":[31,38,30,39,32],"_links":{"self":[{"href":"https:\/\/www.mufljuz.com\/index.php?rest_route=\/wp\/v2\/posts\/100"}],"collection":[{"href":"https:\/\/www.mufljuz.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.mufljuz.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.mufljuz.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.mufljuz.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=100"}],"version-history":[{"count":20,"href":"https:\/\/www.mufljuz.com\/index.php?rest_route=\/wp\/v2\/posts\/100\/revisions"}],"predecessor-version":[{"id":120,"href":"https:\/\/www.mufljuz.com\/index.php?rest_route=\/wp\/v2\/posts\/100\/revisions\/120"}],"wp:attachment":[{"href":"https:\/\/www.mufljuz.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=100"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.mufljuz.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=100"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.mufljuz.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=100"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}\/etc\/apache2\/modules.d\/00_mpm.conf<\/code> was modified to reduce MaxRequestsPerChild:
\n
\n<IfModule mpm_worker_module>
\nStartServers 16
\nMinSpareThreads 85
\nMaxSpareThreads 125
\nThreadsPerChild 48
\nMaxClients 768
\nMaxRequestsPerChild 2000
\n<\/IfModule>
\n<\/tt><\/p>\n","protected":false},"excerpt":{"rendered":"