Quota issues on databricks

[tjhunter]

Describe the task. It can be a feature, documentation, etc.

Doing a query on databricks leads in the UI to the error:

 "error_code": "RESOURCE_EXHAUSTED",
    "message": "Too many requests. Please wait a moment and try again. If the issue persists, consider adjusting your request frequency or reaching out to support for assistance."
}

Steps that are required:

• Limit the number of metrics being uploaded
• Remove older metric points and just keep the latest metrics
• Clean up the recent runs that uploaded many metrics

Hedgedoc URL, if you are keeping notes, plots, logs in hedgedoc.

No response

Area

• datasets, data readers, data preparation and transfer
• model
• science
• infrastructure and engineering
• evaluation, export and visualization
• documentation

[tjhunter]

This PR reduces the amount of metrics being logged:
https://gitlab.jsc.fz-juelich.de/esde/WeatherGenerator-private/-/merge_requests/108

Thank you Sophie for the review.