lucaspalomodevelop/core
1
0
Fork 0
mirror of https://github.com/lucaspalomodevelop/core.git synced 2026-03-18 10:35:27 +00:00
Code Issues Packages Projects Releases Wiki Activity
9,936 Commits 1 Branch 0 Tags
Commit Graph

60 Commits

Author SHA1 Message Date
Ad Schellevis
813595af4f fix previous, https://github.com/opnsense/core/issues/2964 2018-11-27 12:50:45 +01:00
Ad Schellevis
8fdaf264de Network insight, support custom configuration in flowd_aggregate_metadata.py for https://github.com/opnsense/core/issues/2964 2018-11-27 10:43:16 +01:00
Ad Schellevis
4e69e5923b Network insight, cleanup. -c vs --config for https://github.com/opnsense/core/issues/2964 2018-11-27 10:30:06 +01:00
Franco Fichtner
3ad1be040c src: style and whitespace sweep 2018-11-25 12:10:03 +01:00
Ad Schellevis
1680c1e1b0 Network insight, aggregator support single_pass (exit when there's no new data left), for https://github.com/opnsense/core/issues/2964 2018-11-24 21:40:13 +01:00
Ad Schellevis
c7660ca43f Network insight, another minor side affect of https://github.com/opnsense/core/issues/2964 export misses timestamp convert. 2018-11-24 16:10:09 +01:00
Ad Schellevis
9222f5e4de fix regression in previous, for https://github.com/opnsense/core/issues/2964 2018-11-24 16:03:06 +01:00
Ad Schellevis
02c5bb692d Network insight, missing import for https://github.com/opnsense/core/issues/2964 2018-11-24 15:47:50 +01:00
Ad Schellevis
dc38875202 Network insight, cleanups and restructures for https://github.com/opnsense/core/issues/2964 
Adds configuration yaml support, using a simple config yaml containing the previously hardcoded values:

```
library_path:  /path/to/core/src/opnsense/site-python
flowd_source: /path/to/flowd.log
database_dir: /path/to/netflow
pid_filename: /path/to/netflow.pid
```

Startup using local config, using:

```
flowd_aggregate.py -c my_config.yaml --console
```

Further then path relocations, this commit should not contain any new features. The other scripts, not related to the daemon have not been altered (yet)
 2018-11-24 15:44:22 +01:00
Ad Schellevis
bb90be17c7 Network insight, possible division by zero, closes https://github.com/opnsense/core/issues/2928 2018-11-18 18:20:13 +01:00
Ad Schellevis
8f060d4a7a Netflow/insight and the endless UFS instability... in some cases sqlite can't figure out database inconsistencies by itself. In these cases it is practical to force a repair (rebuild) of the underlaying files manually. 
This commit adds an option in reporting_settings.php to request a dump/import from https://github.com/opnsense/core/blob/18.1.9/src/opnsense/site-python/sqlite3_helper.py#L69
 2018-06-15 10:31:00 +02:00
Ad Schellevis
ad528c6d89 insight, log long running cleanup steps to ease troubleshooting 2018-05-06 15:53:43 +02:00
Ad Schellevis
15e2d55d77 insight, default sqlite timeout can be a bit low at 5 seconds, which can result in a failed commit (and daemon exit). 2017-10-24 21:13:12 +02:00
Franco Fichtner
0c2fefab03 src: transform Ad's copyrights, add e-mail everywhere 2017-08-06 11:19:35 +02:00
Ad Schellevis
5ec2101ac2 (insight) check database integrity before start, repair if broken 2016-08-07 16:10:19 +02:00
Ad Schellevis
0c42941315 (reporting/settings) option to flush all local netflow data. closes https://github.com/opnsense/core/issues/983 2016-07-25 17:33:49 +02:00
Ad Schellevis
88a0b222ca (network insight) check if target table exists before fetching data 2016-05-08 09:49:29 +02:00
Ad Schellevis
b9aec139a5 (netflow, export) remove dependency 2016-04-22 17:31:10 +02:00
Ad Schellevis
60b543e5ee (network insight) fix previous 2016-04-22 16:27:19 +02:00
Ad Schellevis
bd70ec1132 (network insight) export in local time 2016-04-22 16:25:48 +02:00
Ad Schellevis
2bc8e64bb0 (network insight) add (raw) data export 2016-04-21 18:57:43 +02:00
Ad Schellevis
9cc65c1965 (netflow, flowd agg) lesser commits 2016-04-21 15:06:37 +02:00
Ad Schellevis
aa86307484 (netflow, flowd agg) skip 30 seconds aggregation for ports and sources (unused) 2016-04-21 15:03:43 +02:00
Ad Schellevis
3ee2d30366 (netflow, flowd agg) set FlowSourceAddrDetails to max 62 days 2016-04-20 16:30:20 +02:00
Ad Schellevis
8adc1d83bf (netflow, flowd aggregate) add profile support, replace deepcopy for cheaper copy 2016-04-20 15:47:34 +02:00
Ad Schellevis
8872e1c783 (netflow, flowd agg) use ifconfig for interface numbering 2016-04-20 14:22:29 +02:00
Ad Schellevis
77944999a0 (netflow, flowd agg) add FlowSourceAddrDetails class for more detailed statistics 2016-04-19 17:17:19 +02:00
Ad Schellevis
e930cc479f (netflow, flowd agg) add last_seen (within timeslot) to aggregates 2016-04-19 17:14:32 +02:00
Ad Schellevis
fc72bf27f7 (network insight) utc in get_timeseries.py 2016-04-19 14:39:49 +02:00
Ad Schellevis
0468bfd1d0 (netflow, flowd agg) store dates in utc, accept multiple filters in get_top_data 2016-04-19 14:06:49 +02:00
Ad Schellevis
5e10c0d190 (netflow, flowd agg) add direction to source aggregate 2016-04-18 09:54:29 +02:00
Ad Schellevis
8336e27bec (netflow, flowd agg) add data starting point if not found 2016-04-15 17:32:09 +02:00
Ad Schellevis
3f9c8f323c (network insight) add aggregation for source addresses and destination ports + add ui template 2016-04-15 16:57:07 +02:00
Ad Schellevis
0b198f7e02 (netflow, flowd agg) some error handling, pass flow data by value to BaseFlowAggregator type 2016-04-15 15:54:33 +02:00
Ad Schellevis
eb49b1aade (netflow, flowd agg) correct start timestamp for resolution in get_top_data 2016-04-15 15:44:28 +02:00
Ad Schellevis
63168e1b19 (netflow, flowd aggregation) fix interface aggregation, remove copy_reverse_flow 2016-04-15 14:46:08 +02:00
Ad Schellevis
158f0532af (netflow, flowd aggregation) add request for top(X) from given dataset, small cleanups 2016-04-13 18:15:03 +02:00
Ad Schellevis
d3b29af438 (netflow, flowd agg) choose different field seperator for sample (test) data 2016-04-13 10:22:20 +02:00
Ad Schellevis
aaf2cd1d1f (netflow, flowd aggregate) change interface aggregate, split up/down 2016-04-12 20:04:46 +02:00
Ad Schellevis
9d1e6656a0 (netflow, flowd aggregate) add copy/reverse flow method 2016-04-12 20:03:26 +02:00
Ad Schellevis
9811931682 (netflow, flowd agg) add vacuum, change poll interval 2016-04-08 13:51:24 +02:00
Ad Schellevis
78069d8fe4 (netflow, flowd agg) optimize number of samples to keep 2016-04-08 11:27:41 +02:00
Ad Schellevis
a00e519483 (netflow / flow aggregator) fetch timeseries from data provider 2016-04-07 19:51:11 +02:00
Ad Schellevis
b2edba92a4 (netflow / flowd aggregation) fix cleanup 2016-04-07 10:47:53 +02:00
Ad Schellevis
23f1408270 (trafficshaper) add quick tab navigation 2016-04-05 15:32:01 +02:00
Ad Schellevis
344e04f9a7 (netflow/flowd) add hourly totals to FlowInterfaceTotals 2016-04-01 16:39:20 +02:00
Ad Schellevis
4a3a693f46 (netflow) add rc script flowd_aggregate, finish initial flowd aggregator version 2016-04-01 16:37:00 +02:00
Ad Schellevis
a818fb3f1f (netflow/flowd) validate connection in BaseFlowAggregator 2016-04-01 12:15:11 +02:00
Ad Schellevis
62362038aa (netflow/flowd) get data from aggregator 2016-04-01 12:06:49 +02:00
Ad Schellevis
a72fda79e0 (netflow/flowd) move resolution to BaseFlowAggregator, add cleanup() to expire old data 2016-04-01 09:54:22 +02:00