ecmwf / aviso Goto Github PK

What happened?

Our aviso is being notified of new data from ECPDS - Destination is a s3 bucket in EWC.
Data for a single forecast for lead time = 0 is provided in two different files (one containing constants, the other with variable fields). In real time I aviso receives two events with same request details but different location. eg

Notification received: {'event': 'dissemination', 'request': {'destination': 'X', 'date': '20230704', 'target': 'P1', 'class': 'od', 'expver': '0001', 'domain': 'g', 'time': '12', 'stream': 'oper', 'step': '0'}, 'location': 's3://input/X011111'}
Notification received: {'event': 'dissemination', 'request': {'destination': 'X', 'date': '20230704', 'target': 'P1', 'class': 'od', 'expver': '0001', 'domain': 'g', 'time': '12', 'stream': 'oper', 'step': '0'}, 'location': 's3://input/X022222'}

However when I replay the notifications (aviso listen --from 2020-01-20T00:00:00.0Z) I only get one of the above notifications replayed.

part of aviso config.yaml:

listeners:
  - event: dissemination
    request:
      destination: bucket-in-ewc
      class: od
      expver: 0001
      domain: g
      stream: [oper, scda]

What are the steps to reproduce the bug?

Send two notifications with same event details but different s3 location. Replay the notifications and verify if both are received.

Version

0.11.1

Platform (OS and architecture)

ubuntu-18.04

Relevant log output

No response

Accompanying data

No response

Organisation

MeteoSwiss

Hi,

I was waiting for GH Actions to run the tests for #3 , but only the CLA bot ran. I checked check.yaml, and looks like it's only triggered manually or after it is merged to develop. Is there any reason for not running the CI tests for every pull request?

Thanks
-Bruno