[StarCluster] ERROR - "Incorrect padding" in listclusters command (github version)

Tue Mar 15 19:04:53 EDT 2011

Hi Justin,

That solved the problem.
Great thanks as always!

Regards,
Joseph

On Tue, Mar 15, 2011 at 10:04 PM, Justin Riley <jtriley at mit.edu> wrote:
> -----BEGIN PGP SIGNED MESSAGE-----
> Hash: SHA1
>
> Hi Kyeong,
>
> Could you please login to the Amazon Console and remove any security
> groups that start with '@sc'? This is likely what's causing the issue.
> The latest github version stores some cluster meta-data in the security
> group's description field for convenience. I've been experimenting with
> the format a bit which causes this issue from time to time for folks
> using the github version.
>
> Let me know if that works...
>
> ~Justin
>
> On 03/15/2011 05:54 PM, Kyeong Soo (Joseph) Kim wrote:
>> Justin,
>>
>> Today I tested this with the newest version from github and
>> encountered exactly the same error (i.e., incorrect padding) as
>> before.
>> To make sure, I started from scratch (including new configure file
>> from the new version of starcluster), but the result was the same.
>>
>> By the way, it doesn't matter whether there is any running cluster or not.
>>
>> Regards,
>> Joseph
>>
>>
>> On Thu, Feb 3, 2011 at 3:06 PM, Justin Riley <justin.t.riley at gmail.com> wrote:
>>> Joseph,
>>>
>>> The version number when using the github version will always be 9999
>>> (because it's the development version).
>>>
>>> ~Justin
>>>
>>> On Wed, Feb 2, 2011 at 6:32 AM, Kyeong Soo (Joseph) Kim
>>> <kyeongsoo.kim at gmail.com> wrote:
>>>> Hi Justin,
>>>> No need to apologize!
>>>> I could understand how busy you were as I myself started classes this week
>>>> here in the UK.
>>>> Per your instruction, I will try it again and report back, if needed.
>>>> Many thanks for your detailed response,
>>>> Joseph
>>>> P.S.
>>>> How can I know the version number?
>>>> I just did 'git pull', installed it ('sudo python setup.py install'), and
>>>> typed 'starcluster --version'.
>>>> The version number returned, however, is '0.9999', exactly the same as
>>>> before.
>>>>
>>>> On Tue, Feb 1, 2011 at 5:20 PM, Justin Riley <justin.t.riley at gmail.com>
>>>> wrote:
>>>>>
>>>>> Hi Kyeong,
>>>>>
>>>>> I apologize for the delay in responding, the last few weeks have been
>>>>> insanely busy as classes are starting at MIT and we've been busy
>>>>> preparing.
>>>>>
>>>>> The error you received is because the latest github code is not
>>>>> compatible with clusters started using the 0.91.2 version of
>>>>> StarCluster. The patch you provided does get around the problem
>>>>> however it prevents the code from working as intended. To properly fix
>>>>> this you need to remove any old clusters you started with the 0.91.2
>>>>> version. You should then be able to use the development version
>>>>> without your patch. I'm working to put in some logistics that will
>>>>> prompt users with an error detailing this issue and how to fix it.
>>>>>
>>>>> Thanks for reporting,
>>>>>
>>>>> ~Justin
>>>>>
>>>>> On Fri, Jan 14, 2011 at 1:55 PM, Kyeong Soo (Joseph) Kim
>>>>> <kyeongsoo.kim at gmail.com> wrote:
>>>>>> After some debugging, I found out the cause of the said problem. Below
>>>>>> is
>>>>>> the output from "git diff":
>>>>>> ================================================
>>>>>> diff --git a/starcluster/cluster.py b/starcluster/cluster.py
>>>>>> index 0e820a7..436ae44 100644
>>>>>> --- a/starcluster/cluster.py
>>>>>> +++ b/starcluster/cluster.py
>>>>>> @@ -544,7 +544,7 @@ class Cluster(object):
>>>>>>          description field.
>>>>>>          """
>>>>>>          try:
>>>>>> -            compressed_data =
>>>>>> base64.b64decode(self.cluster_group.description)
>>>>>> +            compressed_data =
>>>>>> base64.b64encode(self.cluster_group.description)
>>>>>>              pkl_data = zlib.decompress(compressed_data)
>>>>>>              cluster_settings = cPickle.loads(str(pkl_data)).__dict__
>>>>>>              for key in cluster_settings:
>>>>>> ================================================
>>>>>> As you can see, "base64.b64decode" should have been "base64.b64encode"
>>>>>> in
>>>>>> line 547.
>>>>>> Regards,
>>>>>> Joseph
>>>>>>
>>>>>>
>>>>>> On Thu, Jan 13, 2011 at 3:02 PM, Kyeong Soo (Joseph) Kim
>>>>>> <kyeongsoo.kim at gmail.com> wrote:
>>>>>>>
>>>>>>> Hello Justin and All,
>>>>>>> Another bug report for the development version from github.
>>>>>>> Here below is the error message from "listclusters" command:
>>>>>>> =============================================
>>>>>>> ~$ starcluster listclusters
>>>>>>> StarCluster - (http://web.mit.edu/starcluster) (v. 0.9999)
>>>>>>> Software Tools for Academics and Researchers (STAR)
>>>>>>> Please submit bug reports to starcluster at mit.edu
>>>>>>> cli.py:156 - ERROR - failed to load cluster receipt: Incorrect padding
>>>>>>> =============================================
>>>>>>> With the development version, I could go through all the examples in
>>>>>>> the
>>>>>>> documentation -- which means there is no problem with the account
>>>>>>> credentials -- but the listcluster command.
>>>>>>> By the way, the development version seems quite stable and provides
>>>>>>> much
>>>>>>> more information in the configuration template than the stable one
>>>>>>> (e.g.,
>>>>>>> the updated information on the use of AMIs in different zones/regions).
>>>>>>> Regards,
>>>>>>> Joseph
>>>>>>
>>>>>> _______________________________________________
>>>>>> StarCluster mailing list
>>>>>> StarCluster at mit.edu
>>>>>> http://mailman.mit.edu/mailman/listinfo/starcluster
>>>>>>
>>>>>>
>>>>>
>>>>> _______________________________________________
>>>>> StarCluster mailing list
>>>>> StarCluster at mit.edu
>>>>> http://mailman.mit.edu/mailman/listinfo/starcluster
>>>>
>>>>
>>>
>>> _______________________________________________
>>> StarCluster mailing list
>>> StarCluster at mit.edu
>>> http://mailman.mit.edu/mailman/listinfo/starcluster
>>>
>>
>> _______________________________________________
>> StarCluster mailing list
>> StarCluster at mit.edu
>> http://mailman.mit.edu/mailman/listinfo/starcluster
>
> -----BEGIN PGP SIGNATURE-----
> Version: GnuPG v2.0.17 (GNU/Linux)
> Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/
>
> iEYEARECAAYFAk1/4lQACgkQ4llAkMfDcrkelQCeIeHyz4ms+HLDZxAjTZ0Sb57U
> 5Q8Anib5yvYa9+kbnr3WLoMERVmO8ByI
> =1zjl
> -----END PGP SIGNATURE-----
> _______________________________________________
> StarCluster mailing list
> StarCluster at mit.edu
> http://mailman.mit.edu/mailman/listinfo/starcluster
>