Comments (10)
justb4
commented on June 15, 2024
Als voorbeeld: veel waarden worden niet omgezet/gepubliceerd omdat indicatoren buiten de min/max range vallen. Zie bijv log output hieronder voor de Last Values ETL. De validatie wordt gedreven door min/max waarden in https://github.com/Geonovum/smartemission/blob/master/etl/sensordefs.py :
2016-07-21 12:01:01,281 RawSensorAPI WARNING device_id=8 sensor=temperature: invalid input for s_temperatureambient: detail=s_temperatureambient not present
2016-07-21 12:01:01,281 RawSensorAPI WARNING device_id=8 sensor=humidity: invalid input for s_humidity: detail=s_humidity not present
2016-07-21 12:01:01,281 RawSensorAPI WARNING device_id=8 sensor=pressure: invalid input for s_barometer: detail=s_barometer not present
2016-07-21 12:01:01,281 RawSensorAPI WARNING device_id=8 sensor=noiseavg: invalid input for ['v_audio0', 'v_audioplus1', 'v_audioplus2', 'v_audioplus3', 'v_audioplus4', 'v_audioplus5', 'v_audioplus6', 'v_audioplus7', 'v_audioplus8', 'v_audioplus9']: detail=v_audio0 not present
2016-07-21 12:01:01,281 RawSensorAPI WARNING device_id=8 sensor=noiselevelavg: invalid input for noiseavg: detail=noiseavg not present
2016-07-21 12:01:01,282 RawSensorAPI WARNING device_id=8 sensor=co2: invalid input for s_co2: detail=s_co2 not present
2016-07-21 12:01:01,282 RawSensorAPI WARNING device_id=8 sensor=co: invalid input for ['s_o3resistance', 's_no2resistance', 's_coresistance', 's_temperatureambient', 's_temperatureunit', 's_humidity', 's_barometer', 's_lightsensorbottom']: detail=s_o3resistance not present
2016-07-21 12:01:01,282 RawSensorAPI WARNING device_id=8 sensor=no2: invalid input for ['s_o3resistance', 's_no2resistance', 's_coresistance', 's_temperatureambient', 's_temperatureunit', 's_humidity', 's_barometer', 's_lightsensorbottom']: detail=s_o3resistance not present
2016-07-21 12:01:01,282 RawSensorAPI WARNING device_id=8 sensor=o3: invalid input for ['s_o3resistance', 's_no2resistance', 's_coresistance', 's_temperatureambient', 's_temperatureunit', 's_humidity', 's_barometer', 's_lightsensorbottom']: detail=s_o3resistance not present
2016-07-21 12:01:01,282 RawSensorAPI WARNING device_id=8 sensor=coraw: invalid input for ['s_coresistance']: detail=s_coresistance not present
2016-07-21 12:01:01,282 RawSensorAPI WARNING device_id=8 sensor=no2raw: invalid input for ['s_no2resistance']: detail=s_no2resistance not present
2016-07-21 12:01:01,282 RawSensorAPI WARNING device_id=8 sensor=o3raw: invalid input for ['s_o3resistance']: detail=s_o3resistance not present
2016-07-21 12:01:01,305 RawSensorAPI WARNING device_id=9 sensor=co2: invalid input for s_co2: detail=s_co2 not present
2016-07-21 12:01:01,306 RawSensorAPI WARNING device_id=9 sensor=co: invalid input for ['s_o3resistance', 's_no2resistance', 's_coresistance', 's_temperatureambient', 's_temperatureunit', 's_humidity', 's_barometer', 's_lightsensorbottom']: detail=s_o3resistance not present
2016-07-21 12:01:01,306 RawSensorAPI WARNING device_id=9 sensor=no2: invalid input for ['s_o3resistance', 's_no2resistance', 's_coresistance', 's_temperatureambient', 's_temperatureunit', 's_humidity', 's_barometer', 's_lightsensorbottom']: detail=s_o3resistance not present
2016-07-21 12:01:01,306 RawSensorAPI WARNING device_id=9 sensor=o3: invalid input for ['s_o3resistance', 's_no2resistance', 's_coresistance', 's_temperatureambient', 's_temperatureunit', 's_humidity', 's_barometer', 's_lightsensorbottom']: detail=s_o3resistance not present
2016-07-21 12:01:01,306 RawSensorAPI WARNING device_id=9 sensor=coraw: invalid input for ['s_coresistance']: detail=s_coresistance not present
2016-07-21 12:01:01,306 RawSensorAPI WARNING device_id=9 sensor=no2raw: invalid input for ['s_no2resistance']: detail=s_no2resistance not present
2016-07-21 12:01:01,306 RawSensorAPI WARNING device_id=9 sensor=o3raw: invalid input for ['s_o3resistance']: detail=s_o3resistance not present
2016-07-21 12:01:01,306 dboutput INFO query is INSERT INTO last_device_output (name,point,value_raw,altitude,value,label,unit,value_stale,time,device_name,unique_id,device_id) VALUES (%s,%s,%s,%s,%s,%s,%s,%s,%s,%s,%s,%s)
2016-07-21 12:01:01,347 dboutput INFO committed 5 records
2016-07-21 12:01:01,369 RawSensorAPI WARNING device_id=10 sensor=temperature: invalid input for s_temperatureambient: detail=s_temperatureambient not present
2016-07-21 12:01:01,369 RawSensorAPI WARNING device_id=10 sensor=humidity: invalid input for s_humidity: detail=s_humidity not present
2016-07-21 12:01:01,369 RawSensorAPI WARNING device_id=10 sensor=pressure: invalid input for s_barometer: detail=s_barometer not present
2016-07-21 12:01:01,369 RawSensorAPI WARNING device_id=10 sensor=noiseavg: invalid input for ['v_audio0', 'v_audioplus1', 'v_audioplus2', 'v_audioplus3', 'v_audioplus4', 'v_audioplus5', 'v_audioplus6', 'v_audioplus7', 'v_audioplus8', 'v_audioplus9']: detail=v_audio0 not present
2016-07-21 12:01:01,369 RawSensorAPI WARNING device_id=10 sensor=noiselevelavg: invalid input for noiseavg: detail=noiseavg not present
2016-07-21 12:01:01,369 RawSensorAPI WARNING device_id=10 sensor=co2: invalid input for s_co2: detail=s_co2 not present
2016-07-21 12:01:01,370 RawSensorAPI WARNING device_id=10 sensor=co: invalid input for ['s_o3resistance', 's_no2resistance', 's_coresistance', 's_temperatureambient', 's_temperatureunit', 's_humidity', 's_barometer', 's_lightsensorbottom']: detail=s_o3resistance not present
2016-07-21 12:01:01,370 RawSensorAPI WARNING device_id=10 sensor=no2: invalid input for ['s_o3resistance', 's_no2resistance', 's_coresistance', 's_temperatureambient', 's_temperatureunit', 's_humidity', 's_barometer', 's_lightsensorbottom']: detail=s_o3resistance not present
2016-07-21 12:01:01,370 RawSensorAPI WARNING device_id=10 sensor=o3: invalid input for ['s_o3resistance', 's_no2resistance', 's_coresistance', 's_temperatureambient', 's_temperatureunit', 's_humidity', 's_barometer', 's_lightsensorbottom']: detail=s_o3resistance not present
2016-07-21 12:01:01,370 RawSensorAPI WARNING device_id=10 sensor=coraw: invalid input for ['s_coresistance']: detail=s_coresistance not present
2016-07-21 12:01:01,370 RawSensorAPI WARNING device_id=10 sensor=no2raw: invalid input for ['s_no2resistance']: detail=s_no2resistance not present
2016-07-21 12:01:01,370 RawSensorAPI WARNING device_id=10 sensor=o3raw: invalid input for ['s_o3resistance']: detail=s_o3resistance not present
2016-07-21 12:01:01,393 RawSensorAPI WARNING device_id=12 sensor=temperature: invalid input for s_temperatureambient: detail=s_temperatureambient: val(0) < min(233150)
2016-07-21 12:01:01,393 RawSensorAPI WARNING device_id=12 sensor=pressure: invalid input for s_barometer: detail=s_barometer: val(0) < min(20000)
2016-07-21 12:01:01,393 RawSensorAPI WARNING device_id=12 sensor=co: invalid input for ['s_o3resistance', 's_no2resistance', 's_coresistance', 's_temperatureambient', 's_temperatureunit', 's_humidity', 's_barometer', 's_lightsensorbottom']: detail=s_coresistance: val(2204137) > max(1500000)
2016-07-21 12:01:01,394 RawSensorAPI WARNING device_id=12 sensor=no2: invalid input for ['s_o3resistance', 's_no2resistance', 's_coresistance', 's_temperatureambient', 's_temperatureunit', 's_humidity', 's_barometer', 's_lightsensorbottom']: detail=s_coresistance: val(2204137) > max(1500000)
2016-07-21 12:01:01,394 RawSensorAPI WARNING device_id=12 sensor=o3: invalid input for ['s_o3resistance', 's_no2resistance', 's_coresistance', 's_temperatureambient', 's_temperatureunit', 's_humidity', 's_barometer', 's_lightsensorbottom']: detail=s_coresistance: val(2204137) > max(1500000)
2016-07-21 12:01:01,394 RawSensorAPI WARNING device_id=12 sensor=coraw: invalid input for ['s_coresistance']: detail=s_coresistance: val(2204137) > max(1500000)
2016-07-21 12:01:01,405 dboutput INFO committed 6 records
2016-07-21 12:01:02,153 dboutput INFO committed 12 records
2016-07-21 12:01:02,175 RawSensorAPI WARNING device_id=14 sensor=temperature: invalid input for s_temperatureambient: detail=s_temperatureambient: val(0) < min(233150)
2016-07-21 12:01:02,176 RawSensorAPI WARNING device_id=14 sensor=co: invalid input for ['s_o3resistance', 's_no2resistance', 's_coresistance', 's_temperatureambient', 's_temperatureunit', 's_humidity', 's_barometer', 's_lightsensorbottom']: detail=s_temperatureambient: val(0) < min(233150)
2016-07-21 12:01:02,176 RawSensorAPI WARNING device_id=14 sensor=no2: invalid input for ['s_o3resistance', 's_no2resistance', 's_coresistance', 's_temperatureambient', 's_temperatureunit', 's_humidity', 's_barometer', 's_lightsensorbottom']: detail=s_temperatureambient: val(0) < min(233150)
2016-07-21 12:01:02,176 RawSensorAPI WARNING device_id=14 sensor=o3: invalid input for ['s_o3resistance', 's_no2resistance', 's_coresistance', 's_temperatureambient', 's_temperatureunit', 's_humidity', 's_barometer', 's_lightsensorbottom']: detail=s_temperatureambient: val(0) < min(233150)
2016-07-21 12:01:02,196 dboutput INFO committed 8 records
2016-07-21 12:01:02,238 dboutput INFO committed 12 records
2016-07-21 12:01:02,258 RawSensorAPI WARNING device_id=16 sensor=temperature: invalid input for s_temperatureambient: detail=s_temperatureambient: val(0) < min(233150)
2016-07-21 12:01:02,259 RawSensorAPI WARNING device_id=16 sensor=co: invalid input for ['s_o3resistance', 's_no2resistance', 's_coresistance', 's_temperatureambient', 's_temperatureunit', 's_humidity', 's_barometer', 's_lightsensorbottom']: detail=s_temperatureambient: val(0) < min(233150)
2016-07-21 12:01:02,259 RawSensorAPI WARNING device_id=16 sensor=no2: invalid input for ['s_o3resistance', 's_no2resistance', 's_coresistance', 's_temperatureambient', 's_temperatureunit', 's_humidity', 's_barometer', 's_lightsensorbottom']: detail=s_temperatureambient: val(0) < min(233150)
2016-07-21 12:01:02,260 RawSensorAPI WARNING device_id=16 sensor=o3: invalid input for ['s_o3resistance', 's_no2resistance', 's_coresistance', 's_temperatureambient', 's_temperatureunit', 's_humidity', 's_barometer', 's_lightsensorbottom']: detail=s_temperatureambient: val(0) < min(233150)
2016-07-21 12:01:02,272 dboutput INFO committed 8 records
2016-07-21 12:01:02,318 dboutput INFO committed 12 records
2016-07-21 12:01:02,358 dboutput INFO committed 12 records
2016-07-21 12:01:02,440 dboutput INFO committed 12 records
2016-07-21 12:01:02,465 RawSensorAPI WARNING device_id=20 sensor=co2: invalid input for s_co2: detail=s_co2 not present
2016-07-21 12:01:02,495 dboutput INFO committed 11 records
2016-07-21 12:01:02,549 dboutput INFO committed 12 records
2016-07-21 12:01:02,590 dboutput INFO committed 12 records
2016-07-21 12:01:02,638 dboutput INFO committed 12 records
2016-07-21 12:01:02,660 RawSensorAPI WARNING device_id=24 sensor=temperature: invalid input for s_temperatureambient: detail=s_temperatureambient: val(0) < min(233150)
2016-07-21 12:01:02,660 RawSensorAPI WARNING device_id=24 sensor=humidity: invalid input for s_humidity: detail=s_humidity: val(3157) < min(20000)
2016-07-21 12:01:02,660 RawSensorAPI WARNING device_id=24 sensor=co: invalid input for ['s_o3resistance', 's_no2resistance', 's_coresistance', 's_temperatureambient', 's_temperatureunit', 's_humidity', 's_barometer', 's_lightsensorbottom']: detail=s_temperatureambient: val(0) < min(233150)
2016-07-21 12:01:02,661 RawSensorAPI WARNING device_id=24 sensor=no2: invalid input for ['s_o3resistance', 's_no2resistance', 's_coresistance', 's_temperatureambient', 's_temperatureunit', 's_humidity', 's_barometer', 's_lightsensorbottom']: detail=s_temperatureambient: val(0) < min(233150)
2016-07-21 12:01:02,661 RawSensorAPI WARNING device_id=24 sensor=o3: invalid input for ['s_o3resistance', 's_no2resistance', 's_coresistance', 's_temperatureambient', 's_temperatureunit', 's_humidity', 's_barometer', 's_lightsensorbottom']: detail=s_temperatureambient: val(0) < min(233150)
2016-07-21 12:01:02,683 dboutput INFO committed 7 records
2016-07-21 12:01:02,716 RawSensorAPI WARNING device_id=25 sensor=temperature: invalid input for s_temperatureambient: detail=s_temperatureambient: val(0) < min(233150)
2016-07-21 12:01:02,716 RawSensorAPI WARNING device_id=25 sensor=co: invalid input for ['s_o3resistance', 's_no2resistance', 's_coresistance', 's_temperatureambient', 's_temperatureunit', 's_humidity', 's_barometer', 's_lightsensorbottom']: detail=s_temperatureambient: val(0) < min(233150)
2016-07-21 12:01:02,717 RawSensorAPI WARNING device_id=25 sensor=no2: invalid input for ['s_o3resistance', 's_no2resistance', 's_coresistance', 's_temperatureambient', 's_temperatureunit', 's_humidity', 's_barometer', 's_lightsensorbottom']: detail=s_temperatureambient: val(0) < min(233150)
2016-07-21 12:01:02,717 RawSensorAPI WARNING device_id=25 sensor=o3: invalid input for ['s_o3resistance', 's_no2resistance', 's_coresistance', 's_temperatureambient', 's_temperatureunit', 's_humidity', 's_barometer', 's_lightsensorbottom']: detail=s_temperatureambient: val(0) < min(233150)
2016-07-21 12:01:02,738 dboutput INFO committed 8 records
2016-07-21 12:01:02,798 dboutput INFO committed 12 records
2016-07-21 12:01:02,821 RawSensorAPI WARNING device_id=27 sensor=temperature: invalid input for s_temperatureambient: detail=s_temperatureambient: val(0) < min(233150)
2016-07-21 12:01:02,822 RawSensorAPI WARNING device_id=27 sensor=co: invalid input for ['s_o3resistance', 's_no2resistance', 's_coresistance', 's_temperatureambient', 's_temperatureunit', 's_humidity', 's_barometer', 's_lightsensorbottom']: detail=s_temperatureambient: val(0) < min(233150)
2016-07-21 12:01:02,822 RawSensorAPI WARNING device_id=27 sensor=no2: invalid input for ['s_o3resistance', 's_no2resistance', 's_coresistance', 's_temperatureambient', 's_temperatureunit', 's_humidity', 's_barometer', 's_lightsensorbottom']: detail=s_temperatureambient: val(0) < min(233150)
2016-07-21 12:01:02,822 RawSensorAPI WARNING device_id=27 sensor=o3: invalid input for ['s_o3resistance', 's_no2resistance', 's_coresistance', 's_temperatureambient', 's_temperatureunit', 's_humidity', 's_barometer', 's_lightsensorbottom']: detail=s_temperatureambient: val(0) < min(233150)
2016-07-21 12:01:02,843 dboutput INFO committed 8 records
2016-07-21 12:01:02,881 dboutput INFO committed 12 records
2016-07-21 12:01:02,922 dboutput INFO committed 12 records
2016-07-21 12:01:02,960 dboutput INFO committed 12 records
2016-07-21 12:01:02,980 RawSensorAPI WARNING device_id=31 sensor=temperature: invalid input for s_temperatureambient: detail=s_temperatureambient: val(0) < min(233150)
2016-07-21 12:01:02,980 RawSensorAPI WARNING device_id=31 sensor=co: invalid input for ['s_o3resistance', 's_no2resistance', 's_coresistance', 's_temperatureambient', 's_temperatureunit', 's_humidity', 's_barometer', 's_lightsensorbottom']: detail=s_temperatureambient: val(0) < min(233150)
2016-07-21 12:01:02,980 RawSensorAPI WARNING device_id=31 sensor=no2: invalid input for ['s_o3resistance', 's_no2resistance', 's_coresistance', 's_temperatureambient', 's_temperatureunit', 's_humidity', 's_barometer', 's_lightsensorbottom']: detail=s_temperatureambient: val(0) < min(233150)
2016-07-21 12:01:02,980 RawSensorAPI WARNING device_id=31 sensor=o3: invalid input for ['s_o3resistance', 's_no2resistance', 's_coresistance', 's_temperatureambient', 's_temperatureunit', 's_humidity', 's_barometer', 's_lightsensorbottom']: detail=s_temperatureambient: val(0) < min(233150)
2016-07-21 12:01:02,990 dboutput INFO committed 8 records
2016-07-21 12:01:03,022 RawSensorAPI WARNING device_id=32 sensor=temperature: invalid input for s_temperatureambient: detail=s_temperatureambient: val(0) < min(233150)
2016-07-21 12:01:03,023 RawSensorAPI WARNING device_id=32 sensor=co: invalid input for ['s_o3resistance', 's_no2resistance', 's_coresistance', 's_temperatureambient', 's_temperatureunit', 's_humidity', 's_barometer', 's_lightsensorbottom']: detail=s_temperatureambient: val(0) < min(233150)
2016-07-21 12:01:03,023 RawSensorAPI WARNING device_id=32 sensor=no2: invalid input for ['s_o3resistance', 's_no2resistance', 's_coresistance', 's_temperatureambient', 's_temperatureunit', 's_humidity', 's_barometer', 's_lightsensorbottom']: detail=s_temperatureambient: val(0) < min(233150)
2016-07-21 12:01:03,023 RawSensorAPI WARNING device_id=32 sensor=o3: invalid input for ['s_o3resistance', 's_no2resistance', 's_coresistance', 's_temperatureambient', 's_temperatureunit', 's_humidity', 's_barometer', 's_lightsensorbottom']: detail=s_temperatureambient: val(0) < min(233150)
2016-07-21 12:01:03,034 dboutput INFO committed 8 records
2016-07-21 12:01:03,096 dboutput INFO committed 12 records
2016-07-21 12:01:03,116 RawSensorAPI WARNING device_id=35 sensor=temperature: invalid input for s_temperatureambient: detail=s_temperatureambient: val(0) < min(233150)
2016-07-21 12:01:03,117 RawSensorAPI WARNING device_id=35 sensor=co: invalid input for ['s_o3resistance', 's_no2resistance', 's_coresistance', 's_temperatureambient', 's_temperatureunit', 's_humidity', 's_barometer', 's_lightsensorbottom']: detail=s_coresistance: val(5427338) > max(1500000)
2016-07-21 12:01:03,117 RawSensorAPI WARNING device_id=35 sensor=no2: invalid input for ['s_o3resistance', 's_no2resistance', 's_coresistance', 's_temperatureambient', 's_temperatureunit', 's_humidity', 's_barometer', 's_lightsensorbottom']: detail=s_coresistance: val(5427338) > max(1500000)
2016-07-21 12:01:03,117 RawSensorAPI WARNING device_id=35 sensor=o3: invalid input for ['s_o3resistance', 's_no2resistance', 's_coresistance', 's_temperatureambient', 's_temperatureunit', 's_humidity', 's_barometer', 's_lightsensorbottom']: detail=s_coresistance: val(5427338) > max(1500000)
2016-07-21 12:01:03,117 RawSensorAPI WARNING device_id=35 sensor=coraw: invalid input for ['s_coresistance']: detail=s_coresistance: val(5427338) > max(1500000)
2016-07-21 12:01:03,126 dboutput INFO committed 7 records
2016-07-21 12:01:03,165 dboutput INFO committed 12 records
2016-07-21 12:01:03,205 dboutput INFO committed 12 records
2016-07-21 12:01:03,245 dboutput INFO committed 12 records
2016-07-21 12:01:03,297 dboutput INFO committed 12 records
2016-07-21 12:01:03,345 dboutput INFO committed 12 records
2016-07-21 12:01:03,417 dboutput INFO committed 12 records
2016-07-21 12:01:03,482 dboutput INFO committed 12 records
2016-07-21 12:01:03,523 RawSensorAPI WARNING device_id=45 sensor=co: invalid input for ['s_o3resistance', 's_no2resistance', 's_coresistance', 's_temperatureambient', 's_temperatureunit', 's_humidity', 's_barometer', 's_lightsensorbottom']: detail=s_o3resistance: val(2111) < min(3000)
2016-07-21 12:01:03,523 RawSensorAPI WARNING device_id=45 sensor=no2: invalid input for ['s_o3resistance', 's_no2resistance', 's_coresistance', 's_temperatureambient', 's_temperatureunit', 's_humidity', 's_barometer', 's_lightsensorbottom']: detail=s_o3resistance: val(2111) < min(3000)
2016-07-21 12:01:03,523 RawSensorAPI WARNING device_id=45 sensor=o3: invalid input for ['s_o3resistance', 's_no2resistance', 's_coresistance', 's_temperatureambient', 's_temperatureunit', 's_humidity', 's_barometer', 's_lightsensorbottom']: detail=s_o3resistance: val(2111) < min(3000)
2016-07-21 12:01:03,524 RawSensorAPI WARNING device_id=45 sensor=o3raw: invalid input for ['s_o3resistance']: detail=s_o3resistance: val(2111) < min(3000)
2016-07-21 12:01:03,537 dboutput INFO committed 8 records
2016-07-21 12:01:03,593 dboutput INFO committed 12 records
2016-07-21 12:01:03,616 RawSensorAPI WARNING device_id=47 sensor=co: invalid input for ['s_o3resistance', 's_no2resistance', 's_coresistance', 's_temperatureambient', 's_temperatureunit', 's_humidity', 's_barometer', 's_lightsensorbottom']: detail=s_o3resistance: val(2343) < min(3000)
2016-07-21 12:01:03,616 RawSensorAPI WARNING device_id=47 sensor=no2: invalid input for ['s_o3resistance', 's_no2resistance', 's_coresistance', 's_temperatureambient', 's_temperatureunit', 's_humidity', 's_barometer', 's_lightsensorbottom']: detail=s_o3resistance: val(2343) < min(3000)
2016-07-21 12:01:03,616 RawSensorAPI WARNING device_id=47 sensor=o3: invalid input for ['s_o3resistance', 's_no2resistance', 's_coresistance', 's_temperatureambient', 's_temperatureunit', 's_humidity', 's_barometer', 's_lightsensorbottom']: detail=s_o3resistance: val(2343) < min(3000)
2016-07-21 12:01:03,616 RawSensorAPI WARNING id=47-no2raw invalid output for no2raw: detail=no2raw: val(7.868) < min(8)
2016-07-21 12:01:03,616 RawSensorAPI WARNING device_id=47 sensor=o3raw: invalid input for ['s_o3resistance']: detail=s_o3resistance: val(2343) < min(3000)
2016-07-21 12:01:03,630 dboutput INFO committed 7 records
2016-07-21 12:01:03,674 RawSensorAPI WARNING device_id=49 sensor=temperature: invalid input for s_temperatureambient: detail=s_temperatureambient: val(0) < min(233150)
2016-07-21 12:01:03,674 RawSensorAPI WARNING device_id=49 sensor=humidity: invalid input for s_humidity: detail=s_humidity: val(3383) < min(20000)
2016-07-21 12:01:03,674 RawSensorAPI WARNING device_id=49 sensor=pressure: invalid input for s_barometer: detail=s_barometer: val(0) < min(20000)
2016-07-21 12:01:03,675 RawSensorAPI WARNING device_id=49 sensor=co: invalid input for ['s_o3resistance', 's_no2resistance', 's_coresistance', 's_temperatureambient', 's_temperatureunit', 's_humidity', 's_barometer', 's_lightsensorbottom']: detail=s_coresistance: val(4549417) > max(1500000)
2016-07-21 12:01:03,675 RawSensorAPI WARNING device_id=49 sensor=no2: invalid input for ['s_o3resistance', 's_no2resistance', 's_coresistance', 's_temperatureambient', 's_temperatureunit', 's_humidity', 's_barometer', 's_lightsensorbottom']: detail=s_coresistance: val(4549417) > max(1500000)
2016-07-21 12:01:03,675 RawSensorAPI WARNING device_id=49 sensor=o3: invalid input for ['s_o3resistance', 's_no2resistance', 's_coresistance', 's_temperatureambient', 's_temperatureunit', 's_humidity', 's_barometer', 's_lightsensorbottom']: detail=s_coresistance: val(4549417) > max(1500000)
2016-07-21 12:01:03,675 RawSensorAPI WARNING device_id=49 sensor=coraw: invalid input for ['s_coresistance']: detail=s_coresistance: val(4549417) > max(1500000)
2016-07-21 12:01:03,681 dboutput INFO committed 5 records
2016-07-21 12:01:03,917 dboutput INFO committed 12 records
2016-07-21 12:01:03,960 dboutput INFO committed 12 records
2016-07-21 12:01:03,985 RawSensorAPI WARNING device_id=59 sensor=co: invalid input for ['s_o3resistance', 's_no2resistance', 's_coresistance', 's_temperatureambient', 's_temperatureunit', 's_humidity', 's_barometer', 's_lightsensorbottom']: detail=s_o3resistance: val(2843) < min(3000)
2016-07-21 12:01:03,985 RawSensorAPI WARNING device_id=59 sensor=no2: invalid input for ['s_o3resistance', 's_no2resistance', 's_coresistance', 's_temperatureambient', 's_temperatureunit', 's_humidity', 's_barometer', 's_lightsensorbottom']: detail=s_o3resistance: val(2843) < min(3000)
2016-07-21 12:01:03,985 RawSensorAPI WARNING device_id=59 sensor=o3: invalid input for ['s_o3resistance', 's_no2resistance', 's_coresistance', 's_temperatureambient', 's_temperatureunit', 's_humidity', 's_barometer', 's_lightsensorbottom']: detail=s_o3resistance: val(2843) < min(3000)
2016-07-21 12:01:03,986 RawSensorAPI WARNING device_id=59 sensor=o3raw: invalid input for ['s_o3resistance']: detail=s_o3resistance: val(2843) < min(3000)
2016-07-21 12:01:04,027 dboutput INFO committed 8 records
2016-07-21 12:01:04,130 RawSensorAPI WARNING device_id=828231 sensor=noiselevelavg: invalid input for noiseavg: detail=noiseavg not present
2016-07-21 12:01:04,130 RawSensorAPI WARNING device_id=828231 sensor=co2: invalid input for s_co2: detail=s_co2 not present
2016-07-21 12:01:04,130 RawSensorAPI WARNING device_id=828231 sensor=co: invalid input for ['s_o3resistance', 's_no2resistance', 's_coresistance', 's_temperatureambient', 's_temperatureunit', 's_humidity', 's_barometer', 's_lightsensorbottom']: detail=s_o3resistance not present
2016-07-21 12:01:04,130 RawSensorAPI WARNING device_id=828231 sensor=no2: invalid input for ['s_o3resistance', 's_no2resistance', 's_coresistance', 's_temperatureambient', 's_temperatureunit', 's_humidity', 's_barometer', 's_lightsensorbottom']: detail=s_o3resistance not present
2016-07-21 12:01:04,130 RawSensorAPI WARNING device_id=828231 sensor=o3: invalid input for ['s_o3resistance', 's_no2resistance', 's_coresistance', 's_temperatureambient', 's_temperatureunit', 's_humidity', 's_barometer', 's_lightsensorbottom']: detail=s_o3resistance not present
2016-07-21 12:01:04,130 RawSensorAPI WARNING device_id=828231 sensor=coraw: invalid input for ['s_coresistance']: detail=s_coresistance not present
2016-07-21 12:01:04,131 RawSensorAPI WARNING device_id=828231 sensor=no2raw: invalid input for ['s_no2resistance']: detail=s_no2resistance not present
2016-07-21 12:01:04,131 RawSensorAPI WARNING device_id=828231 sensor=o3raw: invalid input for ['s_o3resistance']: detail=s_o3resistance not present
from smartemission.
pietermarsman
commented on June 15, 2024
Gaat het hier om de eenheden/min/max waarden van de ruwe data?
from smartemission.
justb4
commented on June 15, 2024
Beiden: er is validatie van inputs meestal s_ vars en van de outputs/resultaten bijv o3.
Sent from my FairPhone
On Jul 21, 2016 3:36 PM, Pieter Marsman [email protected] wrote:Gaat het hier om de eenheden/min/max waarden van de ruwe data?
—You are receiving this because you authored the thread.Reply to this email directly, view it on GitHub, or mute the thread.
from smartemission.
lindacarton
commented on June 15, 2024
Ik had begrepen dat de sensorspecificatie alleen tussen een bepaalde range een zekere betrouwbaarheid meegeeft (voor testen in labs), maar dat onder een minimumwaarde nog steeds gas-weerstandswaarden geregistreerd worden. Het is dan ook een vraag in hoeverre je de min-max bandbreedte wil aanhouden die op de Jose sensorspecificatie sheet staat. Hier kan Bas, Janus of Antoine het best input over geven. Dit zou per sensing component kunnen verschillen. Misschien is meenemen van de waarde handiger dan bij voorbaat weglaten: je kunt bij historische data-analyses altijd zelf nog absurd lage of hoge waarden wegfilteren. Nu creëer je mogelijk meer 'gaten' in de data dan noodzakelijk. Ook voor burgers is het volgens mij vervelender als er geen data 'doorkomt' op de viewer, dan wanneer die buiten een bandbreedte ligt; ik heb al eens vragen gekregen waarom de sensor soms geen data toont op de SmartApp. In de documentatie zou kunnen komen te staan binnen welke bandbreedte volgens de fabrikant van de betreffende sensing-component een bepaalde nauwkeurigheid (precisie, betrouwbaarheid) verwacht mag worden.
from smartemission.
justb4
commented on June 15, 2024
On 28-07-16 19:24, lindacarton wrote:
Ik had begrepen dat de sensorspecificatie alleen tussen een bepaalde
range een zekere betrouwbaarheid meegeeft (voor testen in labs), maar
dat onder een minimumwaarde nog steeds gas-weerstandswaarden
geregistreerd worden. Het is dan ook een vraag in hoeverre je de min-max
bandbreedte wil aanhouden die op de Jose sensorspecificatie sheet staat.
Hier kan Bas, Janus of Antoine het best input over geven. Dit zou per
sensing component kunnen verschillen. Misschien is meenemen van de
waarde handiger dan bij voorbaat weglaten: je kunt bij historische
data-analyses altijd zelf nog absurd lage of hoge waarden wegfilteren.
Nu creëer je mogelijk meer 'gaten' in de data dan noodzakelijk. Ook voor
burgers is het volgens mij vervelender als er geen data 'doorkomt' op de
viewer, dan wanneer die buiten een bandbreedte ligt; ik heb al eens
vragen gekregen waarom de sensor soms geen data toont op de SmartApp. In
de documentatie zou kunnen komen te staan binnen welke bandbreedte
volgens de fabrikant van de betreffende sensing-component een bepaalde
nauwkeurigheid (precisie, betrouwbaarheid) verwacht mag worden.
Is iets complexer: voor calibratie is bijv temperatuur nodig. Die is op
veel sensoren niet aanwezig (bijv station 25, Lent). Daardoor kunnen
geen gecalibreerde waarden berekend worden. De vraag over min/max ruwe
waarden ligt bij Intemo via dit issue:
#12
De ruwe waarden hebben minder "gaten" en zijn beschikbaar middels de
lagen eindigend op "*raw".—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
#12 (comment),
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAjj5rjLpc7tfKeodEteMYArsXnRLYV9ks5qaOW-gaJpZM4JRpT2.
kind regards / met vriendelijke groet,
--Just
Just van den Broecke [email protected]
Just Objects B.V. tel +31 65 4268627
The Netherlands http://www.justobjects.nl
from smartemission.
pietermarsman
commented on June 15, 2024
Is hier al meer over bekend?
Gebruiken we nu de min/max uit de sensorspecificatie?
Ik ben ervoor om dit iets op te rekken, iig voor de gassensoren want daarbij vind de calibratie zelf wel uit hoe betrouwbaar de metingen zijn. Dus alleen metingen die geen meting zijn (bijv. 2^16=65536 of error codes) eruit halen en alle metingen met een lage betrouwbaarheid erin laten.
from smartemission.
justb4
commented on June 15, 2024
On 25-01-17 14:45, Pieter Marsman wrote:
Is hier al meer over bekend?
Gebruiken we nu de min/max uit de sensorspecificatie?
Ja, heb de mannen van Intemo gevraagd, zij verwezen naar hun spec.
Ik ben ervoor om dit iets op te rekken.
Ja ga je gang, zie sensordefs.py
…
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
<#12 (comment)>,
or mute the thread
<https://github.com/notifications/unsubscribe-auth/AAjj5rOfdL1krhBKC42WosLlyBoH-X2yks5rV1IJgaJpZM4JRpT2>.
from smartemission.
lindacarton
commented on June 15, 2024
Pieter, jij bent als de chief kalibratie degene die het beste kan inschatten of je het meenemen van ruwe meetwaarden laat begrenzen door de vooraf opgegeven min/max bandbreedte uit de fabrieksspecs, of dat je die bandbreedte breder laat en d.m.v. de kalibratieprocedure later een uitspraak te doen over betrouwbaarheid van de metingen, ook de metingen in het lage of hoge spectrum.
Dus jouw voorstel volgen: Alleen metingen die geen meting zijn (bijv. 2^16=65536 of error codes) eruit halen en alle metingen met een lage betrouwbaarheid erin laten.
Overigens is een GI-minor student nu bezig met een klein onderzoekje, analyse van de (ruwe waarden van) Geluid uit de sensordata. Om te kijken of hij een andere aggregatie kan maken voor de historische waarden dan uurgemiddelden voor geluid. Voor emissies werkt het terugkijken van uurgemiddelden goed, voor geluid is dat minder toepasselijk, omdat alle kortstondige geluiden worden uitgemiddeld.
Hij gebruikt de geluidswaarden van de Whale server, dus per episode van 11 seconden het gemiddelde, de minimum en maximumwaarde per frequentieband. En bijvoorbeeld kijkend naar de middelste frequentieband, naar het aantal (count) episodes dat er pieken (max waarden) zijn waargenomen hoger dan 70 dB. En dan kijken of aggregatie in de tijd een beeld oplevert dat correspondeert met eigen waarneming van geluid. Met verschillende aggregaties en varianten van drempelwaarden (definitie van geluidspieken) of waargenomen frequentiebanden (toonhoogten).
Zijn doel is te komen met een advies aan het smart emission projectteam en de burgermeetwerkgroep.
from smartemission.
pietermarsman
commented on June 15, 2024
Okido, dan ga ik kijken of en waar er te strakke restricties op de data zitten.
from smartemission.
pietermarsman
commented on June 15, 2024
Volgens Henk kloppen de restricties op de voorspelde gas waarden (ug/m3).
from smartemission.
Related Issues (20)
- Heron Viewer - replace PDOK GeoCoder widget with PDOK LocatieServer HOT 1
- Add Breukelen-Snelweg RIVM Station to RIVM SOS Harvester HOT 1
- Reconfigure Grafana Dashboard for new AirSensEUR AlphaSense Sensors HOT 1
- Backup/restore InfluxDB datasets in Kubernetes HOT 2
- Notify sensor-user when sensor data is not updated
- Problems with influxdb Kubernetes Service HOT 1
- Spontaneous failures on Azure Kubernetes HOT 7
- SE Docker Images using entry.sh: inspect if env vars are propagated to original CMD HOT 1
- Long rendering/waiting time in Heron Viewer for PM25 history Layer
- AirSensEUR: add InfluxDBLastInput to Last Values Harvesters HOT 1
- CronJobs in Kubernetes suddenly stopped HOT 1
- Add auto VACUUM+ANALYZE settings to Postgres Database HOT 1
- GeoServer GetCapabilities always returns v2 (1.3.0) version doc HOT 1
- Values for "last" not available on CItyGIS Whale server HOT 1
- SOS connection error reported by GeoHealthCheck HOT 1
- SmartApp - filter on projects HOT 1
- InfluxDB write fails within Refiner cron job causing History to lag behind HOT 1
- Integrate Luftdaten.info sensor stations HOT 18
- AirSensEUR calibration and visualization to production HOT 1
- Data Whaleserver HOT 5
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from smartemission.