Failed to parse unix format date field about logtrail HOT 8 CLOSED

@jslusher thanks for using logtrail. Can you paste your logstash conf file and sample document from ES ( use curl to query ES or enable rubydebug in logstash ) ? What is the elasticsearch and logstash version you are using?

from logtrail.

I believe I am having the same issue - getting error

Error! Exception while executing search query :[parse_exception] failed to parse date field [18611693012080] with format [epoch_millis]

This was working fine for a while, I did just recently upgrade elasticsearch to 2.4.1

Conf -

{
"es": {
"default_index": "svcreqlogs-*",
"allow_url_parameter": false,
"timezone": "UTC"
},
"tail_interval_in_seconds": 10,
"max_buckets": 500,
"fields" : {
"mapping" : {
"timestamp" : "@timestamp",
"display_timestamp" : "@timestamp",
"hostname" : "s-computername",
"program": "appName",
"message": "action"
}
}
}

from logtrail.

@kengibous looks like some mapping is not present. Are Kibana views working fine? If you are using logstash, can you paste you logstash config?

from logtrail.

Kibana views appear fine. Yes I am using logstash. This has been working fine for weeks until recently.

Conf for logstash (logstash 2.4.0) - I did blank out some sensitive fields. Thank you!

logstash.conf.txt

from logtrail.

@sivasamyk sorry to waste your time, i think the issue is with the data that was logged - it was logged with timestamp Sat Oct 13 2559 02:43:32, and it appears logtrail uses that timestamp which in epoch time is 18611693012080. Is there away that logtrail could use the system time instead of a time from the logged message data? Hope that makes sense...

from logtrail.

If I am correct, you mean there are messages with timestamp as Sat Oct 13 2559 02:43:32 in Elasticsearch. When you open logtrail first time, it get the latest 500 events from ES. The live tail will use the timestamp of latest event to fetch events. I assume you are seeing logs when you open logtrail for first time. The live tail queries are failing.

from logtrail.

@kengibous Did your issue got resolved? Let me know if I can help.

from logtrail.

Closing this issue. Reopen if still reproducible.

from logtrail.