<html>
<head>
<meta content="text/html; charset=ISO-8859-1"
http-equiv="Content-Type">
</head>
<body bgcolor="#FFFFFF" text="#000000">
<div class="moz-cite-prefix">I agree with Nik, it seems reasonably
fast in my experience. Note that S3 doesn't have a file system,
it's just an indexed object. So you can write your object once
and read it many times, but there isn't any updating, file
locking, etc. I typically use S3 for storage and archiving or to
provide a static data reference for things that aren't going to
change, but need to be widely available. I know those that use S3
for static webpages, or for storing logs, etc. If your data is
going to change often, you might want to do things a different
way.<br>
<br>
Good Luck.<br>
<br>
Jennifer<br>
<br>
On 10/6/14 9:19 PM, John Readey wrote:<br>
</div>
<blockquote cite="mid:D0588D5F.4B33%25jreadey@hdfgroup.org"
type="cite">
<meta http-equiv="Content-Type" content="text/html;
charset=ISO-8859-1">
<div>Is anyone pulling in data on demand using the S3 API’s? I’m
curious how the performance compares to using NFS.</div>
<div><br>
</div>
<div>John</div>
<div><br>
</div>
<span id="OLK_SRC_BODY_SECTION">
<div style="font-family:Calibri; font-size:11pt;
text-align:left; color:black; BORDER-BOTTOM: medium none;
BORDER-LEFT: medium none; PADDING-BOTTOM: 0in; PADDING-LEFT:
0in; PADDING-RIGHT: 0in; BORDER-TOP: #b5c4df 1pt solid;
BORDER-RIGHT: medium none; PADDING-TOP: 3pt">
<span style="font-weight:bold">From: </span>Jennifer Staab
<<a moz-do-not-send="true" href="mailto:jstaab@cs.unc.edu">jstaab@cs.unc.edu</a>><br>
<span style="font-weight:bold">Date: </span>Monday, October
6, 2014 at 6:08 PM<br>
<span style="font-weight:bold">To: </span>greg <<a
moz-do-not-send="true" href="mailto:margeemail@gmail.com">margeemail@gmail.com</a>>,
"<a moz-do-not-send="true" href="mailto:starcluster@mit.edu">starcluster@mit.edu</a>"
<<a moz-do-not-send="true"
href="mailto:starcluster@mit.edu">starcluster@mit.edu</a>><br>
<span style="font-weight:bold">Subject: </span>Re:
[StarCluster] Possible to bring in data stored on S3?<br>
</div>
<div><br>
</div>
<blockquote id="MAC_OUTLOOK_ATTRIBUTION_BLOCKQUOTE"
style="BORDER-LEFT: #b5c4df 5 solid; PADDING:0 0 0 5; MARGIN:0
0 0 5;">
<div>
<div bgcolor="#FFFFFF" text="#000000">
<div class="moz-cite-prefix">Besides the others mentioned,
AWS has their own "command line interface" CLI see
<a moz-do-not-send="true"
href="http://docs.aws.amazon.com/cli/latest/userguide/cli-chap-getting-set-up.html">here</a>
for installation instructions and <a
moz-do-not-send="true"
href="http://docs.aws.amazon.com/cli/latest/">
here</a> for usage. AWS CLI provides tools for
accessing S3. If you don't want to use AWS CLI, there
are many SDKs available depending on programming
language or platform see
<a moz-do-not-send="true"
href="http://aws.amazon.com/tools/">here</a>.<br>
<br>
Good Luck.<br>
<br>
Jennifer<br>
<br>
On 10/6/14 3:29 PM, greg wrote:<br>
</div>
<blockquote
cite="mid:CAOpDiKyBKR=g673oWfwB3FFQKBuNfiUmRxNiToLWxNgLzTwJgQ@mail.gmail.com"
type="cite">
<pre wrap="">Hi all,
Is it possible to bring data into my cluster from Amazon S3? I didn't
see it in the manual.
Thanks for reading!
Greg
_______________________________________________
StarCluster mailing list
<a moz-do-not-send="true" class="moz-txt-link-abbreviated" href="mailto:StarCluster@mit.edu">StarCluster@mit.edu</a><a moz-do-not-send="true" class="moz-txt-link-freetext" href="http://mailman.mit.edu/mailman/listinfo/starcluster">http://mailman.mit.edu/mailman/listinfo/starcluster</a></pre>
</blockquote>
<br>
</div>
</div>
</blockquote>
</span>
</blockquote>
<br>
</body>
</html>