Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create a monthly report (web page) with forecasts and validation/stats #56

Open
10 tasks
scotthosking opened this issue Nov 25, 2023 · 6 comments
Open
10 tasks
Assignees

Comments

@scotthosking
Copy link
Collaborator

scotthosking commented Nov 25, 2023

I would like us to automate the creating of a monthly icenet report (web page), looking forward to the next 3 months and a validation over the previous 3 months.

We can also produce running statistics on how accurate IceNet is, and whether there are any anomalous events coming up

  • Produce pipeline action to cover the following steps:
    • Run the existing "production" forecast (this is currently done automatically via run_era5_forecast so don't duplicate if that forecast exists already)
    • Ensure a forecast exists for t - 93 days
    • Download the SEAS data for model comparison
    • Run produce_op_assets for both forecasts if the assets aren't already present. This will plot against SEAS if available, from memory, but needs testing
  • Decide whether to either...
    • ...produce a little static HTML report in the pipeline, or...
    • ...integrate the assets with the icenet-application dashboard, which is designed for this purpose...
    • Both of the ideas above require some deliberation, as the latter involves cloud hosting and the plotting can get quite involved - but it's a cleaner extension to the methodology in place. Discuss with @JimCircadian
  • @JimCircadian extend / plan incorporation for multi-temporal forecasting
@JimCircadian JimCircadian self-assigned this Nov 25, 2023
@JimCircadian
Copy link
Member

@scotthosking Moving this into icenet-project, as we actually have this infrastructure and it spans multiple repositories. Will be better captured there so that we can produce the required stats / plots under icenet-application and in the icenet-etl repositories as well.

@JimCircadian JimCircadian transferred this issue from icenet-ai/icenet-pipeline Nov 25, 2023
@JimCircadian
Copy link
Member

Links to #49 so that we can report on different timescales.

@JimCircadian
Copy link
Member

@scotthosking updated the steps to implementation, can you provide a little feedback on whether you have any preferences, or are you happy for us to stitch this together using the numerous assets we have at our disposal for the daily forecasting?

I'll address the monthly / seasonal forecasting incorporation in due course, working on that in parallel

@bnubald once we get an OK from Scott that the above covers his requirements, are you keen to pick up initial implementation via the pipeline?

@bnubald
Copy link

bnubald commented Feb 12, 2024

@scotthosking updated the steps to implementation, can you provide a little feedback on whether you have any preferences, or are you happy for us to stitch this together using the numerous assets we have at our disposal for the daily forecasting?

I'll address the monthly / seasonal forecasting incorporation in due course, working on that in parallel

@bnubald once we get an OK from Scott that the above covers his requirements, are you keen to pick up initial implementation via the pipeline?

Yes, happy to.

@scotthosking
Copy link
Collaborator Author

Sorry @bnubald - just saw these messages here, they get lost in my inbox so feel free to nudge me on Slack in the future and I can then reply here

@bnubald bnubald self-assigned this Jul 1, 2024
@bnubald bnubald moved this to Todo in IceNet Roadmap Aug 6, 2024
@bnubald
Copy link

bnubald commented Sep 6, 2024

To discuss:

  • SEAS access
  • Discuss integration into icenet-application +- cloud hosting pros/cons. Ideal preference would be to integrate within icenet-application rather than another implementation.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: Todo
Development

No branches or pull requests

3 participants