Conversation
Notices
-
@fontana, I just figured we'd call it the "Fontana/Kuhn Software Freedom dialogues" or something like that. Is that good enough?
Thursday, 10-Nov-11 18:46:13 UTC from web-
Further info on identi.ca problems http://ur1.ca/5ozcm
-
Good luck men. I see how dificult is find the problem... but i have faith on you. Best wishes.
-
Thanks, totally appreciate it!
-
@identica Is it just me? Just this side is unreachable for me.
-
Do you mean "this site"?
-
Yeah, that does make the servers cry a bit.
-
I'd suspect either a memory leak in persistent resources or lots of processes getting stuck at high mem (96mb * 50 procs = 4800mb)
-
@evan if you can set me up with access on the current servers (I think my old VPN setup is lost) I'll see if I can prod them for data
-
@evan I meant the side in https://identi.ca/notice/85026180 and BTW I saw your answer first in a context-line, not in my timeline
-
It looks more like one proc taking a big bite; see http://pastebin.com/YLY59Qk3
-
I'll email you. I don't use the OpenVPN thing anymore; just ssh. Can you still log into storage2?
-
Does setting MaxRequestsPerChild to a low number stop it from exploding? If it does, that would point to a memory leak in our code, no?
-
@evan my keys are on other laptop at home, so I'll try tonight. :)
-
Is there any way to measure how many times per day it's happening? Then we could know if MaxRequestsPerChild makes a diff.
-
@zach Or that you tickle a memory leak within the underlying heap of complexity.
-
True, but I'm guessing that's less likely. :) Most big ass memory leaks are probably known issues in the underlying stack (I'm guessing).
-
@zach I recommend the following solution to "big ass memory leaks" http://identi.ca/url/56505513
-
It seems pretty drastic, could have its own problems, and doesn't solve the issue directly. I'd like to find the problem and fix it.
-
That said, I'm interested in moving to nginx -- but I don't want to make a dramatic change that doesn't fix the immediate issue.
-
That's a pretty useful idea.
-
@identica ouch - sounds like walking in a dense wood with trees exploding all around you... not fun. very on again off again here today
-
@identica ...saying 'here' because I'm wondering if it's (partly) anything to do with different servers in the cluster
-
@evan I've posted a comment (stuck in moderation) on your blog, maybe something in it will be useful...
-
@evan could 'bursty' feeds have anything to do with it? the 'by feed' posts seem to come all in one burst instead of trickling in
-
@evan for Web hosting, nginx does fine, but for load balancing, it sucks. I would check into haproxy instead.
-
If you have the time, the first half of this might interest you http://ur1.ca/5p3mb
-
@evan I thought the php memory_limit was for any one particular running script, not for the whole mod_php process.
-
@zoowar if you have $150M to invest, we'll reinvent the entire system. Until then the Twitter comparison is not appreciated.
Jason Riedy likes this. -
Was meant as a perspective, not a directive. BTW SN only took 2.3M to create.
-
Yeah, that's true! Looks like Twitter was actually $1.16Bn http://identi.ca/url/350013
-
But, OK, point taken in the spirit it was meant.
-
I don't expect that, but I won't rule anything out, since whatever the problem is, it's going to be something I don't expect.
Marjolein Katsma likes this. -
@evan Yeah, but .8b of that raised in last 2 mos. Still, impressive (or not) absolutely and relatively.
-
@evan it just occurred to me you may be grateful for the extra black friday spam flood helping to bring out the problem :p
-
@eightyeight yep, agree for nginx vs. haproxy cc @evan
-
Thanks for keeping us up to date, much appreciated.
-
@jbfavre glad you responded, I think he has me on block, our ignore, or something.
-
@eightyeight don't know, I do not receive each @evan 's updates, even if I'm subscribed to him :-/
-
@fontana, er, I think I double-negatived that or something. My point is: I don't like that we're out of touch for the last few months.
-
-
@bkuhn I for one miss the @bkuhn @fontana dialogs. They were educational and entertaining. Possibly even #edutaining.
-
Yes, sorry about that. I'm too short-handed to keep the Jabber server up and running. Might come soon.
-
Oh, and the servers are fine with your conversations. I was just playing around.
-
@evan,I wasn't complaining. I just need to change my workflow now that Jabber's gone & haven't had time. My only complaint remains: backup!
-
@fontana, Yes,that's correct. But we need to reestablish the Kuhn/Fontana dialogues for our fan(s). Should we just start an oggcast instead?
-
@fontana, frankly, if it wasn't for !FaiFCast, I'd be completely out of touch w/ @kaz b/c we're both too busy w/ #Conservancy & #GNOME.
-
It was definitely an 'or something'.
-
All Identi.ca content and data are available under the