THE PROJECT
DATA SERVICE
DEPLOYMENT		 INSTRUMENTATION
ACQUISIT° FROM RESEARCH VESSELSAPPLICATIONS & PRODUCTS
 
 

argo-bann.jpg (13838 octets)

Data Management Workshop
Brest (France)
3-4-5 Octobre 2000

Data Exchange (Sylvie Pouliquen)

GOAL: Provide in all data centres all the data available within the ARGO Program in order to ease user access

 

2 types of data to Exchange:

Metadata:
exchanged once when a new experiment is settled
occasional additional transfers

The data centre in charge of the experiment/station issues an email to
warn the other centres that new metadata are available
or send the new metadata directly to the other centres

 

Data Exchange

2 steps: Real Time / Delay Mode

Real Time ̃ Mirroring strategy: within 24 hours the newest data have been exchanged between the centres.

I have supposed that all the exchanges are made through the FTP servers

̃ No interconnection between the databases

At least 2 methodologies:
the blind one : every day each data centre update his "latest data " directory with the other centres' "latest data" ̃ Need to eliminate the duplicates artificially created that way
Provider warning: the provider issues a formatted email containing the list of new files on his FTP server: Each centre uses this file to automatically retrieve these data.

 

Data Exchange

Delay Mode ̃ New versions of datasets are exchanged when a complete reprocessing has been done

 

The process " Provider warning" can be used to exchange these sorts of data.

 

Perhaps only some versions of these datasets needs to be exchanged:

 

 

Last update 22/01/2004
© Coriolis