Network identifier about eida-statistics HOT 10 CLOSED

Can someone test this new aggregator ?

1. install the new version with the pipenv method
   (https://github.com/EIDA/eida-statistics/tree/main/aggregator#install-and-execute)
2. parse an existing logfile and look at the result to see if it looks fine
3. send the statistics

@kbouk thank you for volunteering :) Let me know how it goes in this issue.

from eida-statistics.

Hello @jschaeff ,,

I installed the new version (pip3 install eida-statistics-aggregator), however when running it I get the following error (using python 3.6.9):

_eida_stats_aggregator --output-directory aggregates fdsnws_request.log.2022-06-11.bz2
Parsing fdsnws_request.log.2022-06-11.bz2 [------------------------------------] 0%
Traceback (most recent call last):
File "/usr/local/lib/python3.6/dist-packages/fdsnnetextender/fdsnnetextender.py", line 31, in extend
dateparam = date(year=int(date_string), month=1, day=1)
ValueError: invalid literal for int() with base 10: '2013-02-15'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/usr/local/bin/eida_stats_aggregator", line 11, in
load_entry_point('eida-statistics-aggregator==0.6.0', 'console_scripts', 'eida_stats_aggregator')()
File "/usr/local/lib/python3.6/dist-packages/click/core.py", line 1128, in call
return self.main(*args, **kwargs)
File "/usr/local/lib/python3.6/dist-packages/click/core.py", line 1053, in main
rv = self.invoke(ctx)
File "/usr/local/lib/python3.6/dist-packages/click/core.py", line 1395, in invoke
return ctx.invoke(self.callback, **ctx.params)
File "/usr/local/lib/python3.6/dist-packages/click/core.py", line 754, in invoke
return _callback(*args, **kwargs)
File "/usr/local/lib/python3.6/dist-packages/aggregator/aggregator.py", line 235, in cli
statistics.parse_file(f)
File "/usr/local/lib/python3.6/dist-packages/aggregator/aggregator.py", line 193, in parse_file
extended_network = net_extender.extend(trace['net'], trace['start'][0:10])
File "/usr/local/lib/python3.6/dist-packages/fdsnnetextender/fdsnnetextender.py", line 35, in extend
dateparam = date.fromisoformat(date_string)
AttributeError: type object 'datetime.date' has no attribute 'fromisoformat'

from eida-statistics.

The function datetime.date.fromisoformat() has been introduced in Python 3.7

Do you think the program should be python3.6 compatible ?

from eida-statistics.

If it's only this error, it would be nice to make it 3.6 compatible. Probably a simple replacement with strptime could be enough.

from eida-statistics.

It would be enough. It's just soo less fun :)

from eida-statistics.

@kbouk you have to upgrade a dependency of this project : fdsnnetextender == 3.2.0
Can you give it another try ?

from eida-statistics.

https://pypi.org/project/fdsnnetextender/

from eida-statistics.

Hello @jschaeff,

Yes it works fine now with python 3.6. I am attaching some outputs.
2022-06-12_2022-06-12.json.gz
2022-06-12_2022-06-13.json.gz

from eida-statistics.

Thank you @kbouk I was able to ingest the result on my development environment.
There was no temporary network in your example, and I would like to test the aggregator with some usage stats from temporary network.
I validated that there is no regression bug though.

@ALL can someone test the new aggregator whith temporary networks involved ?

from eida-statistics.

I validated also with temporary networks. The fix is ready to hit the production.

from eida-statistics.