[PageOneX] [dev] PageOneX server is down

[Rafael Porres Molina]

Hi,

I'm not sure if it would fit in the pageonex workflow, but a common pattern
is to place outside the web application slow or cpu consuming tasks, as
resizing images. A queue could be used for that. It can be placed in the
same server or if you need to scale out, it can be placed in another server.

This two queues have a ruby client:

http://kr.github.io/beanstalkd/
https://github.com/resque/resque

I've used beanstalkd and it works perfectly fine and it is very easy to
setup. I haven't used resque, but I know people that have used it and it
works pretty well for them.

Best regards,

Rafa



2013/12/10 pablo rey <pablo at basurama.org>

> Great, Ed, how is this CPU throttling working?
>
> I added one extra day to the thread
> http://pageonex.com/numeroteca/corrupcion-espana-diciembre-2013/ and
> updated:
>
> 1st time: internal server error.
>
> I reloaded:
> 2nd time: the newspaper images and overlays were broken.
>
> I went back to edit and "updated" the thread
> 3rd time: it worked fine.
>
>
>
>
> On Mon, Dec 9, 2013 at 11:12 PM, Edward Platt <elplatt at media.mit.edu>wrote:
>
>> I've added cpu throttling to the imagemagick settings.  Hopefully this
>> will help stop the crashes, but keep an eye out for any weird behavior!
>>
>> -Ed
>>
>>
>> On Sun, Dec 8, 2013 at 12:14 PM, pablo rey <pablo at basurama.org> wrote:
>>
>>> Hi Ed,
>>> Prevent overloading would be great.
>>> I think the server just went down again when editing the same thread.
>>>
>>> Let's talk next week if there is something I can look into also.
>>> p
>>>
>>>
>>>
>>> On Fri, Dec 6, 2013 at 11:19 PM, Edward Platt <elplatt at media.mit.edu>wrote:
>>>
>>>> Hey Pablo!
>>>>
>>>> The server's back up.  We've been getting notifications about cpu and
>>>> disk usage, probably from resizing images.  Next week I'll look into
>>>> whether there's an easy fix to prevent overloading the server on long/short
>>>> threads.
>>>>
>>>> -Ed
>>>>
>>>>
>>>> On Fri, Dec 6, 2013 at 5:30 AM, pablo rey <pablo at basurama.org> wrote:
>>>>
>>>>> Hi Ed and Rahul,
>>>>> I was adding a new topic to the thread
>>>>> http://pageonex.com/numeroteca/corrupcion-espana-diciembre-2013/ and
>>>>> the server went down.
>>>>>
>>>>> I can not ssh.
>>>>>
>>>>> Apart from the problem of lack of memory  to calculate the background
>>>>> image grid for too many or too few images, I think there is another problem
>>>>> with too many overlays when it has to create the composites.
>>>>>
>>>>> Please reboot over-9000 server!
>>>>>
>>>>> _______________________________________________
>>>>> Pageonexdev mailing list
>>>>> Pageonexdev at mit.edu
>>>>> http://mailman.mit.edu/mailman/listinfo/pageonexdev
>>>>>
>>>>>
>>>>
>>>>
>>>> --
>>>> Edward L. Platt
>>>> Civic Technology Programmer
>>>> MIT Center for Civic Media
>>>> E15-348
>>>> http://civic.mit.edu
>>>> http://elplatt.com
>>>> @elplatt <http://twitter.com/elplatt>
>>>>
>>>> _______________________________________________
>>>> Pageonexdev mailing list
>>>> Pageonexdev at mit.edu
>>>> http://mailman.mit.edu/mailman/listinfo/pageonexdev
>>>>
>>>>
>>>
>>
>>
>> --
>> Edward L. Platt
>> Civic Technology Programmer
>> MIT Center for Civic Media
>> E15-348
>> http://civic.mit.edu
>> http://elplatt.com
>> @elplatt <http://twitter.com/elplatt>
>>
>
>
> _______________________________________________
> Pageonexdev mailing list
> Pageonexdev at mit.edu
> http://mailman.mit.edu/mailman/listinfo/pageonexdev
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/pipermail/pageonexdev/attachments/20131210/42ce5f7d/attachment-0001.htm