Difference between revisions of "IC 3 Support EISCAT-3D users to reprocess data using user's algorithms"
(Switched categories from Use Case List to Use Cases (in preparation of merging the former into the latter).) |
|||
Line 83: | Line 83: | ||
− | |||
[[Category:Use Cases]] | [[Category:Use Cases]] |
Latest revision as of 14:20, 26 August 2020
Contents
Background[edit]
Short description[edit]
To reprocess environmental data with not default input parameters
Contact[edit]
Background | Contact Person | Organization | Contact email |
RI-ICT | Ingemar Häggström | EISCAT | Ingemar.haggstrom@eiscat.se |
e-Infrastructure_ICT | Leonardo Candela | CNR | leonardo.candela@isti.cnr.it |
Task 5.3/7.2 leader | Zhiming Zhao Paul Martin |
University of Amsterdam (UvA) | z.zhao@uva.nl P.W.Martin@uva.nl |
Use case type[edit]
Implementation case
Scientific domain and communities[edit]
Scientific domain
Atmosphere
Community
Data Service Provision | Data Usage {_}{+}http://confluence.envri.eu:8090/display/ERM/SV+Communities+_ for detailed explanation of those communities.>
Behavior
Detailed description[edit]
Objective and Impact
Most environmental RIs store data in different levels, and between them there is some sort of process. Most users are interested in the derived physical parameters, being the highest level of data. However, these normally depends on default input parameters for the processing of the data. There is often a need to reprocess the basic data with other input parameters, in the simple case to get a different spatial or temporal resolution, for details or statistical reasons. Depending on the data there can be a large number of more parameters to set and possibly alter.
Challenges
The challenge is to set up workflows how to select data and the process to do on it.
Detailed scenarios
Select data and process. Get a list of the default parameters, modify them as wanted. Run the process with the updated parameter list. This involves staging lower level data, processing it and delivering the results.
Technical status and requirements
The data and processes exists as such. One need to provide the basic tools for selection and setting up parameters in a generic way. It's needed to set up storage, several TB, to provide computation capabilities with basic software, here mainly Matlab.
Implementation plan and timetable
M0-3
- decide the site for data, data transfer
- discussions and defining workflows/techniques
M3-9
- Setting up the services with interfaces to the data/metadata
M9-12
- Testing, refining
Expected output and evaluation of output
A basic portal with human/machine interface, that can deliver updated physical parameters for a restricted dataset.