Ad Schellevis
01d8fb296e
Insight, catch struct.unpack errors instead od rashing out when flow record doesn't match standards. closes https://github.com/opnsense/core/issues/3715
2019-09-23 18:07:41 +02:00
Ad Schellevis
d8ef93932b
netflow: netflow aggregator, skip illegal flow records. https://forum.opnsense.org/index.php?topic=13711
2019-08-17 19:09:11 +02:00
Ad Schellevis
fabaef0a43
Insights, small optimalisation for flowd_aggregate.py, pass last received timestamp to flowparser, so we can skip a bit of processing when the data isn't relevant. for https://github.com/opnsense/core/issues/3587
2019-07-19 17:44:44 +02:00
Franco Fichtner
4175a45f4b
system: fix netflow lib permission
2019-05-20 13:24:38 +02:00
Ad Schellevis
8aecf38f2e
netflow, log parser. for backwards compatibility add copy of recv_sec field in recv
2019-05-16 18:29:16 +02:00
Ad Schellevis
5eef7248a8
netflow, flow log parser improvements
...
- faster / cleaner ipv4 conversion
- ipv6 conversion in compressed format, which equals flowd previous output
- unpack source and dest ports
2019-05-16 16:20:34 +02:00
Ad Schellevis
0bdbdf7d21
netflow, improve log parser performance, cache some calculations.
...
In theory we could probably increase performance even more by limitting the number of calls to struct.unpack, but this will make it more difficult to read.
This version is about 30% faster then the original C version shipped with flowd.
Some more testing todo, but preliminary results look good.
2019-05-16 13:54:24 +02:00
Ad Schellevis
93f7cff3d8
netflow, flowparser.py performance improvement in parsing ipv4/ipv6 addresses.
2019-05-15 22:01:27 +02:00
Ad Schellevis
a99d1ecf8e
netflow, minor type issue in previous
2019-05-14 22:08:52 +02:00
Ad Schellevis
7e55ef5218
netflow, work in progress pure python replacement to parse /var/log/flowd.log files
2019-05-14 22:06:53 +02:00
