carwyn / veillance Goto Github PK

https://github.com/vsivsi/meteor-job-collection

http://www.webtempest.com/meteor-background-jobs-tutorial

https://github.com/Differential/meteor-workers

https://atmospherejs.com/percolatestudio/synced-cron

http://tagesanzeiger.ch

after several days running with let the machine sleep between etc, it crashed. last lines:

`{"Id":9370,"Name":"10.0.1.19","Type":"DNS","Text":"ocsp.apple.com"}
Processed 800000 packets (698914339 bytes) in 102h17m52.790857977s (errors: 44, type:2)
{"Id":9371,"Name":"10.0.1.19","Type":"DNS","Text":"configuration.apple.com.edgekey.net"}
{"Id":9372,"Name":"10.0.1.19","Type":"DNS","Text":"p32-ckdevice.icloud.com"}
Processed 801000 packets (699752957 bytes) in 102h17m54.718576344s (errors: 44, type:2)
{"Id":9373,"Name":"10.0.1.19","Type":"DNS","Text":"p32-caldav-current.edge.icloud.apple-dns.net"}
{"Id":9374,"Name":"10.0.1.19","Type":"DNS","Text":"gsp10-ssl.ls-apple.com.akadns.net"}
Processed 802000 packets (700592611 bytes) in 102h17m57.722233964s (errors: 44, type:2)
{"Id":9375,"Name":"10.0.1.19","Type":"DNS","Text":"e.crashlytics.com"}
{"Id":9376,"Name":"10.0.1.19","Type":"DNS","Text":"e6858.dsce9.akamaiedge.net"}
Processed 803000 packets (701393376 bytes) in 102h18m0.726005482s (errors: 44, type:2)
{"Id":9377,"Name":"10.0.1.19","Type":"DNS","Text":"help.apple.com"}
Processed 804000 packets (702233715 bytes) in 102h18m3.729838274s (errors: 44, type:2)
Processed 805000 packets (703042786 bytes) in 102h18m6.735103657s (errors: 44, type:2)
Processed 806000 packets (703854494 bytes) in 102h18m10.737732629s (errors: 44, type:2)
fatal error: HTTP/17.132.5.59->10.0.1.19 80->54767: failed to get body(parsed len:1911140): unexpected EOF
concurrent map read and map writeHTTP/17.132.5.59->10.0.1.19 80->54780: failed to get body(parsed len:1292100): unexpected EOF

https://aws.amazon.com/blogs/security/how-to-add-dns-filtering-to-your-nat-instance-with-squid/

Easy option is to use systemd:

https://www.freedesktop.org/software/systemd/man/systemd.service.html

Also see:

https://www.reddit.com/r/golang/comments/35v5bm/best_way_to_run_go_server_as_a_daemon/

http://www.sueddeutsche.de

Failed to gzip decode: gzip: invalid headerpanic: runtime error: invalid memory address or nil pointer dereference
[signal SIGSEGV: segmentation violation code=0x1 addr=0x288 pc=0x5a9557]

goroutine 25 [running]:
compress/gzip.(*Reader).Read(0x0, 0xc42187d000, 0x1000, 0x1000, 0x411ff2, 0xc4211a6270, 0xd0)
	/usr/lib/golang/src/compress/gzip/gunzip.go:247 +0x37
golang.org/x/net/html.readAtLeastOneByte(0xbcc940, 0x0, 0xc42187d000, 0x1000, 0x1000, 0x7f479c0385c0, 0x0, 0x17f479ebaa000)
	/home/carwyn/src/golang.org/x/net/html/token.go:299 +0x60
golang.org/x/net/html.(*Tokenizer).readByte(0xc4211a6270, 0xc420102770)
	/home/carwyn/src/golang.org/x/net/html/token.go:273 +0x270
golang.org/x/net/html.(*Tokenizer).Next(0xc4211a6270, 0x68)
	/home/carwyn/src/golang.org/x/net/html/token.go:980 +0xef
golang.org/x/net/html.(*parser).parse(0xc42188a000, 0xc420102770, 0xc4211a6270)
	/home/carwyn/src/golang.org/x/net/html/parse.go:2001 +0xb3
golang.org/x/net/html.Parse(0xbcc940, 0x0, 0x7f18e7, 0x19, 0xc42004bcd8)
	/home/carwyn/src/golang.org/x/net/html/parse.go:2026 +0xdd
main.(*httpReader).run(0xc421474400, 0xc421188ce0)
	/home/carwyn/src/github.com/carwyn/veillance/interceptor/main.go:209 +0x11c2
created by main.(*tcpStreamFactory).New
	/home/carwyn/src/github.com/carwyn/veillance/interceptor/main.go:295 +0xb9e

Split the history from the prototype branch:

https://git-scm.com/2010/03/17/replace.html