[PageOneX] [dev] PageOneX server is down

Rafael Porres Molina rporres at gmail.com
Tue Dec 10 07:52:13 EST 2013


I code mostly in Perl and I have never used Ruby, so  I don't know if I
could help, but If you need my sysadmin skills for any of this, just give a
shout. This week I'm quite busy but maybe next week I could find time.

Best regards,

Rafa


2013/12/10 Rafael Porres Molina <rporres at gmail.com>

> Hi,
>
> I'm not sure if it would fit in the pageonex workflow, but a common
> pattern is to place outside the web application slow or cpu consuming
> tasks, as resizing images. A queue could be used for that. It can be placed
> in the same server or if you need to scale out, it can be placed in another
> server.
>
> This two queues have a ruby client:
>
> http://kr.github.io/beanstalkd/
> https://github.com/resque/resque
>
> I've used beanstalkd and it works perfectly fine and it is very easy to
> setup. I haven't used resque, but I know people that have used it and it
> works pretty well for them.
>
> Best regards,
>
> Rafa
>
>
>
> 2013/12/10 pablo rey <pablo at basurama.org>
>
>> Great, Ed, how is this CPU throttling working?
>>
>> I added one extra day to the thread
>> http://pageonex.com/numeroteca/corrupcion-espana-diciembre-2013/ and
>> updated:
>>
>> 1st time: internal server error.
>>
>> I reloaded:
>> 2nd time: the newspaper images and overlays were broken.
>>
>> I went back to edit and "updated" the thread
>> 3rd time: it worked fine.
>>
>>
>>
>>
>> On Mon, Dec 9, 2013 at 11:12 PM, Edward Platt <elplatt at media.mit.edu>wrote:
>>
>>> I've added cpu throttling to the imagemagick settings.  Hopefully this
>>> will help stop the crashes, but keep an eye out for any weird behavior!
>>>
>>> -Ed
>>>
>>>
>>> On Sun, Dec 8, 2013 at 12:14 PM, pablo rey <pablo at basurama.org> wrote:
>>>
>>>> Hi Ed,
>>>> Prevent overloading would be great.
>>>> I think the server just went down again when editing the same thread.
>>>>
>>>> Let's talk next week if there is something I can look into also.
>>>> p
>>>>
>>>>
>>>>
>>>> On Fri, Dec 6, 2013 at 11:19 PM, Edward Platt <elplatt at media.mit.edu>wrote:
>>>>
>>>>> Hey Pablo!
>>>>>
>>>>> The server's back up.  We've been getting notifications about cpu and
>>>>> disk usage, probably from resizing images.  Next week I'll look into
>>>>> whether there's an easy fix to prevent overloading the server on long/short
>>>>> threads.
>>>>>
>>>>> -Ed
>>>>>
>>>>>
>>>>> On Fri, Dec 6, 2013 at 5:30 AM, pablo rey <pablo at basurama.org> wrote:
>>>>>
>>>>>> Hi Ed and Rahul,
>>>>>> I was adding a new topic to the thread
>>>>>> http://pageonex.com/numeroteca/corrupcion-espana-diciembre-2013/ and
>>>>>> the server went down.
>>>>>>
>>>>>> I can not ssh.
>>>>>>
>>>>>> Apart from the problem of lack of memory  to calculate the background
>>>>>> image grid for too many or too few images, I think there is another problem
>>>>>> with too many overlays when it has to create the composites.
>>>>>>
>>>>>> Please reboot over-9000 server!
>>>>>>
>>>>>> _______________________________________________
>>>>>> Pageonexdev mailing list
>>>>>> Pageonexdev at mit.edu
>>>>>> http://mailman.mit.edu/mailman/listinfo/pageonexdev
>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Edward L. Platt
>>>>> Civic Technology Programmer
>>>>> MIT Center for Civic Media
>>>>> E15-348
>>>>> http://civic.mit.edu
>>>>> http://elplatt.com
>>>>> @elplatt <http://twitter.com/elplatt>
>>>>>
>>>>> _______________________________________________
>>>>> Pageonexdev mailing list
>>>>> Pageonexdev at mit.edu
>>>>> http://mailman.mit.edu/mailman/listinfo/pageonexdev
>>>>>
>>>>>
>>>>
>>>
>>>
>>> --
>>> Edward L. Platt
>>> Civic Technology Programmer
>>> MIT Center for Civic Media
>>> E15-348
>>> http://civic.mit.edu
>>> http://elplatt.com
>>> @elplatt <http://twitter.com/elplatt>
>>>
>>
>>
>> _______________________________________________
>> Pageonexdev mailing list
>> Pageonexdev at mit.edu
>> http://mailman.mit.edu/mailman/listinfo/pageonexdev
>>
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/pipermail/pageonexdev/attachments/20131210/b00c8462/attachment.htm


More information about the Pageonexdev mailing list