[ecco-support] Downloading OCCA data -- FTP link broken

Wed Jul 19 23:05:26 EDT 2023

[Resending now that I’m properly subscribed to the ecco-support list.]

From: "admin odyseallc.com" <admin at odyseallc.com>
Date: Thursday, July 13, 2023 at 12:54 AM
To: MIT <gforget at mit.edu>, "ECCO support list, wider membership" <ecco-support at mit.edu>
Subject: Re: [ecco-support] Downloading OCCA data -- FTP link broken

Hello.

The all products page at https://ecco-group.org/products.htm has this URL for the OCCA product issue:

ftp://mit.ecco-group.org/ecco_for_las/OCCA_1x1_v2/2004-6/

mit.ecco-group.org has no local content and only limited redirects, for just the /las folder.  However, that redirect is to harbor.mit.edu which does not seem to be active.

Of the 17 problem links, the categories are:

  *   mit.ecco-group has no content of its own
  *   harbor.mit.edu inactive
  *   icdc.zmaw.de inactive

Are these suitable replacements for the “quicker” fixes:

  *   OCCA Version 2: https://dataverse.harvard.edu/dataset.xhtml?persistentId=doi:10.7910/DVN/RNXA2A
  *   ECCO-V4r2 Release 2: https://dataverse.harvard.edu/dataverse/ECCO?q=&types=dataverses&sort=dateSort&order=desc&page=1

I’d like to clean up this page and correct the broken links.  Please let me know who I can work with.

Thank you.

Daren

Product
Release Name
URL
Error
ECCO-V4r2
Release 2
ftp://mit.ecco-group.org/ecco_for_las/version_4/release2/
Can't open the page, FTP URLs are disabled
ECCO-V4r2
interpolated fields
ftp://mit.ecco-group.org/ecco_for_las/version_4/release2/interp_monthly/
Can't open the page, FTP URLs are disabled
ECCO-V4r2
T-S tendency terms
ftp://mit.ecco-group.org/ecco_for_las/version_4/release2/nctiles_tendencies/
Can't open the page, FTP URLs are disabled
ECCO-V4r2
in-situ profile data sets
ftp://mit.ecco-group.org/ecco_for_las/version_4/release2/profiles/
Can't open the page, FTP URLs are disabled
ECCO-V4r1
Release 1
ftp://mit.ecco-group.org/ecco_for_las/version_4/release1/
Safari can’t connect to the server “harbor.mit.edu”.
GECCO2
Release 1
http://icdc.zmaw.de/1/daten/reanalysis-ocean/gecco2.html
Safari can’t find the server “icdc.zmaw.de”.
OCCA
Version 2
ftp://mit.ecco-group.org/ecco_for_las/OCCA_1x1_v2/2004-6/
Can't open the page, FTP URLs are disabled
ECCO-GODAE
Iteration 73
http://harbor.mit.edu/las/v6/dataset?catitem=91
Safari can’t connect to the server “harbor.mit.edu”.
ECCO-GODAE
gridded observations
http://harbor.mit.edu/las/v6/dataset?catitem=138
Safari can’t connect to the server “harbor.mit.edu”.
ECCO-GODAE
in-situ observations
http://mit.ecco-group.org/opendap/ecco_for_las/obs/contents.html
404 Not Found
ECCO-GODAE
Iteration 177
http://harbor.mit.edu/las/v6/dataset?catitem=333
Safari can’t connect to the server “harbor.mit.edu”.
ECCO-GODAE
Iteration 199
http://harbor.mit.edu/las/v6/dataset?catitem=196
Safari can’t connect to the server “harbor.mit.edu”.
ECCO-GODAE
Iteration 216
http://harbor.mit.edu/las/v6/dataset?catitem=459
Safari can’t connect to the server “harbor.mit.edu”.
GECCO
Iteration 23
http://harbor.mit.edu/las/v6/dataset?catitem=546
Safari can’t connect to the server “harbor.mit.edu”.
ECCO-SIO
Iteration 69
http://harbor.mit.edu/las/v6/dataset?catitem=38
Safari can’t connect to the server “harbor.mit.edu”.
ECCO-SIO
Iteration 21
http://harbor.mit.edu/las/v6/dataset?catitem=14
Safari can’t connect to the server “harbor.mit.edu”.
ECCO-SIO
Iteration 107
http://harbor.mit.edu/las/v6/dataset?catitem=2
Safari can’t connect to the server “harbor.mit.edu”.

From: MIT <gforget at mit.edu>
Date: Wednesday, July 12, 2023 at 10:48 AM
To: "ECCO support list, wider membership" <ecco-support at mit.edu>
Cc: "admin odyseallc.com" <admin at odyseallc.com>
Subject: Re: [ecco-support] Downloading OCCA data -- FTP link broken

Hi Geoff

For OCCA (& ECCOv4r1,2) files you can get them from the dataverse archives. I built convenience functions in OceanStateEstimation.jl to select and download files.

https://github.com/gaelforget/OceanStateEstimation.jl#readme<https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_gaelforget_OceanStateEstimation.jl-23readme&d=DwMFaQ&c=euGZstcaTDllvimEN8b7jXrwqOf-v5A_CdpgnVfiiMM&r=VnUt-Z5Mfl_Yr9KKps4f2FquovWA9LLFl5ESWF_WiMk&m=8nKOJdCBYVyKCS63axlcoUmuAmO1JL8Hb7Q8Th_PAc2BWeZ0bqXViItIEr-KtmeW&s=08adc_3bbSTJv-CwRrybX_HVPQ_2w_IZAYUBuMgtlaI&e=>

(The dataverse urls for occa & eccov4r2 are in the repo)

Under the gdcc org you’ll find dataverse.jl , pydataverse, etc

https://github.com/gdcc/Dataverse.jl#readme<https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_gdcc_Dataverse.jl-23readme&d=DwMFaQ&c=euGZstcaTDllvimEN8b7jXrwqOf-v5A_CdpgnVfiiMM&r=VnUt-Z5Mfl_Yr9KKps4f2FquovWA9LLFl5ESWF_WiMk&m=8nKOJdCBYVyKCS63axlcoUmuAmO1JL8Hb7Q8Th_PAc2BWeZ0bqXViItIEr-KtmeW&s=Jtj5bLIACv8zIuTlnuflXQnBaJquYvGV6qjbOufnPbM&e=>

Sorry about all the broken links on the Ecco site. almost all of the estimates listed under products have been unaccessible for more than 6 months.

 I have been bringing this up to folks on the MIT & ECCO sides about these issues regularly. But not enough as it seems …

Thank you for reporting this & your understanding.

Best,
Gaël
Sent from my iPhone

On Jul 12, 2023, at 15:44, Geoff Stanley <gstanley at uvic.ca> wrote:

Hello,

It seems the FTP link for OCCA data<https://urldefense.proofpoint.com/v2/url?u=ftp-3A__mit.ecco-2Dgroup.org_ecco-5Ffor-5Flas_OCCA-5F1x1-5Fv2_2004-2D6_&d=DwMFaQ&c=euGZstcaTDllvimEN8b7jXrwqOf-v5A_CdpgnVfiiMM&r=VnUt-Z5Mfl_Yr9KKps4f2FquovWA9LLFl5ESWF_WiMk&m=8nKOJdCBYVyKCS63axlcoUmuAmO1JL8Hb7Q8Th_PAc2BWeZ0bqXViItIEr-KtmeW&s=xsdyjrxLn1gj_bxgETmBUA4auHUzdL7exlQpHeViUX4&e=>, provided on the ECCO All Products webpage<https://urldefense.proofpoint.com/v2/url?u=https-3A__www.ecco-2Dgroup.org_products.htm&d=DwMFaQ&c=euGZstcaTDllvimEN8b7jXrwqOf-v5A_CdpgnVfiiMM&r=VnUt-Z5Mfl_Yr9KKps4f2FquovWA9LLFl5ESWF_WiMk&m=8nKOJdCBYVyKCS63axlcoUmuAmO1JL8Hb7Q8Th_PAc2BWeZ0bqXViItIEr-KtmeW&s=J7OaVlZi_22HBruP3NbbIAC8E13eG5TWZWlbW46x4qI&e=>, now requires a password. I have a NASA Earthdata Account (e.g. for accessing ECCOv4r4 data), but I have not found OCCA data on that ECCO Drive<https://urldefense.proofpoint.com/v2/url?u=https-3A__ecco.jpl.nasa.gov_drive_files&d=DwMFaQ&c=euGZstcaTDllvimEN8b7jXrwqOf-v5A_CdpgnVfiiMM&r=VnUt-Z5Mfl_Yr9KKps4f2FquovWA9LLFl5ESWF_WiMk&m=8nKOJdCBYVyKCS63axlcoUmuAmO1JL8Hb7Q8Th_PAc2BWeZ0bqXViItIEr-KtmeW&s=u9qCOhXEkpNCd23vgYd31jMpBCidydP6XhT5E725Fpw&e=>. I use OCCA data myself as a useful test dataset for developing algorithms, and I maintain a Python package that uses OCCA data for running an example calculation: see https://github.com/geoffstanley/neutralocean/blob/main/neutralocean/examples/load_OCCA.py<https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_geoffstanley_neutralocean_blob_main_neutralocean_examples_load-5FOCCA.py&d=DwMFaQ&c=euGZstcaTDllvimEN8b7jXrwqOf-v5A_CdpgnVfiiMM&r=VnUt-Z5Mfl_Yr9KKps4f2FquovWA9LLFl5ESWF_WiMk&m=8nKOJdCBYVyKCS63axlcoUmuAmO1JL8Hb7Q8Th_PAc2BWeZ0bqXViItIEr-KtmeW&s=bgj3yWJ1QySOIwewjK-L_J8X7UI1CK5rIf5vix1AG3c&e=>, which used to automatically download two OCCA files, but now throws an authentication error.

Please let me know if there is still a way to access OCCA data. Is there a password for an anonymous login? Ideally, OCCA data can be downloaded without having to sign up for an account, which makes my script much easier for users to run. If a user does need to create an account to get OCCA data, is it allowed (legal) for me to upload these two OCCA files to a permanent file hosting service like Zenodo or Figshare?

Thanks very much,
Geoff

P.S. Sorry to send this to both emails; not sure who's remit this falls under.

--

Geoff Stanley

Banting Postdoctoral Researcher

School of Earth and Ocean Sciences

University of Victoria

Victoria, BC, Canada
_______________________________________________
ecco-support mailing list
ecco-support at mit.edu
https://mailman.mit.edu/mailman/listinfo/ecco-support
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.mit.edu/pipermail/ecco-support/attachments/20230720/ea3da16f/attachment-0001.htm>