Skip to content

pass user parameters to individual scores in the evaluation pipeline #1475

@s6sebusc

Description

@s6sebusc

Describe the task. It can be a feature, documentation, etc.

Some scores like ets, fbi, pss, etc. depend on external parameters, for example a threshold. Ideally, users should be able to put such parameters in the evaluation config file and the code should propagate them to the appropriate scores. One use case would be users trying to evaluate extreme precipitation, say above 20mm, using ets.

A simple implementation would pass each parameter to every score that accepts a parameter of that name, otherwise one would have to somehow enable parameters for individual scores in the config file.

Hedgedoc URL, if you are keeping notes, plots, logs in hedgedoc.

No response

Area

  • datasets, data readers, data preparation and transfer
  • model
  • science
  • infrastructure and engineering
  • evaluation, export and visualization
  • documentation

Metadata

Metadata

Assignees

Labels

evalanything related to the model evaluation pipelineinitiativeLarge piece of work covering multiple sprint

Type

No type

Projects

Status

No status

Relationships

None yet

Development

No branches or pull requests

Issue actions