883 Commits

Author SHA1 Message Date
Franco Fichtner
2573b7325a firmware: do not show subscription key on firmware status page #4500 2021-02-04 12:02:03 +01:00
Ad Schellevis
0101becd99 IDPS: make sure rule overwrites use unique config sections. closes https://github.com/opnsense/core/issues/4667
We might consider a unique constraint as well, but since duplicates themselves don't hurt that much, this might be good enough.
2021-02-03 16:25:47 +01:00
Franco Fichtner
c05df172aa firmware: add information page #4500 2021-02-03 14:21:20 +01:00
Franco Fichtner
1c8e3a3a47 firmware: update text and make notes for later #4500 2021-01-29 19:38:12 +01:00
Franco Fichtner
f2ca74384a firmware: fix fetch of changelogs on dvd images 2021-01-28 09:16:25 +01:00
kulikov-a
58a966bcd6
Diagnostics->pfTables: display zeros, sort columns (#4579) 2021-01-24 19:43:48 +01:00
Franco Fichtner
d91e308001 firmware: allow to run audits from firmware upgrade console option #4500
Type "s" for security audit, or "h" for health audit.

We don't add it to the option prompt to not clutter the menu flow.
This is mostly for debug and development purposes.
2021-01-16 16:25:33 +01:00
Franco Fichtner
7d5b8bc24e firmware: oops, to bring stderr into pipe move redirect here #4500 2021-01-16 13:37:56 +01:00
Franco Fichtner
62948343fe console: ignore first backup, same as current 2021-01-16 13:14:35 +01:00
Franco Fichtner
6a65666a1c firmware: support console-based audit output 2021-01-16 12:55:41 +01:00
Franco Fichtner
c5521fecac firmware: do not allow plugin install if remote repo version differs #4500
We need the matching mirror version for the plugins to install so
simply block the update and let the user update first (instead of
only checking for updates and then installing later versions of
plugins).

This was a larger problem in past years but it is good practice to
require an up-to-date system anyway.
2021-01-16 10:14:46 +01:00
kulikov-a
bc215cbc91
download_blacklists.py: fix broken lines in large files (#4606) 2021-01-15 16:14:26 +01:00
Franco Fichtner
93be19f402 firmware; show repository in overview; closes #4578 2021-01-12 11:20:14 +01:00
Franco Fichtner
3bb2b4eb14 firmware: print core package name, database checkup first or return 2021-01-09 21:29:17 +01:00
Franco Fichtner
952637011e console: makes more sense #4572 2021-01-08 09:54:47 +01:00
Franco Fichtner
fb49c70e10 console: more questions, more recovery #4572
I see no easy way to untangle this for now.  At least make sure
the user is asked for the defaults to be restored making this
a little better than before.
2021-01-08 09:50:34 +01:00
Ad Schellevis
41eefdd105 IDPS: revert content part of 09f74fe1ce7b4805c1bb8354e5d0c5b98955497b until ETPro telemetry ships new content. 2021-01-07 20:32:21 +01:00
Franco Fichtner
92c019b913 firmware: pretty sure parsing REMOVED was working in pkg 1.12 2021-01-05 17:02:31 +01:00
Ad Schellevis
d9891b1ff9 filter/aliases: minor regression in maintaining target alias file (/var/db/aliastables/%s.txt). when it's either changed, expired or simply not there, it should dump the contents before loading it with pfctl 2021-01-05 14:52:44 +01:00
Franco Fichtner
7216e3a241 system: allow self-signed renew for web GUI; closes #4567
The command to issue a reset is:

  # configctl webgui restart renew
2021-01-04 11:28:30 +01:00
Franco Fichtner
a69351722c firmware: proper path to pkg-static 2021-01-01 20:04:25 +01:00
Ad Schellevis
4186f2bbe5 Reporting / traffic: add "top talkers" tab which shows the current (and max) bandwith usage per ip address sorted by total (in+out).
some people seem to miss the numbers, since the top host graph uses the same information over time, it wouldn't hurt to add a tab containting the raw numbers for the selected interfaces.
The current version doesn't limit the number of results, we might need to add a limit at some point in time, depending on how many results iftop samples.

general remarks:

o total amount of traffic is not being displayed, although we could count the "cumulative" from iftop, the numbers would always be flawed (since sampled with an interval)
o no reverse lookups, maybe for a future version, let's first see if this helps.
o hosts not seen for 120 seconds will automatically be removed from the list (fixed ttl)
2020-12-25 15:14:13 +01:00
Franco Fichtner
d6f32818b9 firmware: add version output to audit logs; closes #4375 2020-12-17 10:57:35 +01:00
Franco Fichtner
b515105e12 firmware: -d will for install, but we just want to check 2020-12-16 10:20:21 +01:00
Franco Fichtner
b206ad8443 firmware: fix some issues with missing repository on server 2020-12-13 11:40:13 +01:00
Ad Schellevis
be13b6f9e3 IDPS: minor fixes and improvements for new policy feature (https://github.com/opnsense/core/issues/4445).
o feedback matched policy so we can easily find affective choice in the rule tab
o remove installed_action, installed_status since these values aren't valid anymore
o while here, set <pre/> tag width to a maximum to avoid overflow in alert page

Since values need to be persisted in order to return on query requests, single rule edits can lead to a bit odd behaviour (not toggling until after apply), since modifications are advised to be performed using policies, we will keep this for now.
(the alternative is to hook apply after these changes, which also isn't a great solution)
2020-12-08 17:20:06 +01:00
Ad Schellevis
0841c5a877 Logging: add "step into" icon on log lines. Since we always read the complete file, we can know the actual row number of a search result.
When investigating log files it's often practical to see the context of a message after searching for it. This feature offers the ability to go to the page in question by clicking on a filtered result.
2020-11-25 18:04:24 +01:00
Ad Schellevis
74a64ce187 IDPS: bug in policy parser preventing ruleset filter to function. for https://github.com/opnsense/core/issues/4445 2020-11-23 17:48:10 +01:00
Ad Schellevis
1221542a43 IDPS: deprecate filter option on file downloads in favour of new policy option. migrates exsting filters to policies while there. for https://github.com/opnsense/core/issues/4445 2020-11-23 16:42:41 +01:00
Franco Fichtner
6e2375b044 src: fix a couple of copyright header misalignments 2020-11-19 16:26:23 +01:00
Ad Schellevis
bb8c58a3a8 system/logging: simplify log format parsing 2020-11-13 22:28:37 +01:00
Ad Schellevis
a0c043e693 IDS: work in progress policy editor for https://github.com/opnsense/core/issues/4445
With this commit policies functionally work, but there's still some refactoring todo.
o migrate download filters to a policy
o remove download filter option
o point to policies in the download section
o (maybe) move single rule overwrites to policies as well.
2020-11-09 15:02:14 +01:00
Ad Schellevis
5ea5f94b49 core / mvc: add new config changed event using syshook structure
o in order for this to work properly we need to change when a config backup is made, previously we performed a backup before the fact, now we backup afterwards. which means the top level always represents the current change (and can thus be signaled to an event handler). After upgrade one might lose a single backup file due to this change, but that should be a small price to pay for progress.
o config backup count was defined incorrect (60 instead of 100 according to the gui)
o the syslog-ng event structure is using the existing configd handler and filters relevant events within a small time frame (which prevents flooding configd)

Since the event is loosely coupled, the risk for releasing this into an existing environment should be rather low.

For https://github.com/opnsense/core/issues/4388

sponsored by : Modirum (https://www.modirum.com/)
2020-10-02 18:07:11 +02:00
Ad Schellevis
e5e9e92290 Unbound: rebuild unbound blacklist download, fix previous (.conf files are being imported by unbound so we need to use another suffix for our config files) 2020-09-29 17:31:34 +02:00
Ad Schellevis
f16b67232c Unbound: rebuild unbound blacklist download
o move all templates into one standard ini file containing all required info for the blacklists
o add syslog output (in unbound log view) about processing and error handling
o validate "whitelist" regexp entries before usage
o lock process while performing download task
o don't try to download in parallel, the gain is relatively small and adds complexity.
o remove last unboundplus action, migrate cron jobs if they exist
2020-09-29 16:46:55 +02:00
Ad Schellevis
84ce802b16 Unbound / blacklists: remove unmaintained lists and add the other lists from https://github.com/blocklistproject/Lists while here. 2020-09-28 22:10:18 +02:00
Ad Schellevis
496c4bbc0e interfaces: list mac addresses, phase out netaddr.eui.ieee.OUI_REGISTRY_PATH. closes https://github.com/opnsense/core/issues/4364 2020-09-21 16:28:33 +02:00
Ad Schellevis
cfd5949995 IDPS: re-create rule cache after rule deployment, used update_local_changes() before, but this has the downside of missing the database changes, although create() is slower, it simplifies code to just rebuild after depolym
ent. ref a222eda2c7 (commitcomment-42320374)
2020-09-15 11:50:45 +02:00
kulikov-a
7ac50f9f8d
Add "Nat" tab to Firewall->Diagnostics->pfInfo menu (#4330) 2020-09-14 14:29:16 +02:00
Franco Fichtner
c8ad3c8b54 system: use different shell gateway name to appease wizard
PR: https://github.com/opnsense/core/issues/4347
2020-09-14 11:31:45 +02:00
Ad Schellevis
fe25f69a07 Firewall / Aliases: add support for network exclusions in network alias type. for https://github.com/opnsense/core/issues/4318 2020-09-05 15:40:02 +02:00
Ad Schellevis
d7279fba60 Reporting / Traffic: ditch status_graph.php and replace with new mvc statistics page. 2020-09-04 18:40:25 +02:00
Ad Schellevis
6cc719a507 Reporting / Traffic: hook iftop stats script into configd, sort by top usage and add address tag (local, private) 2020-09-04 17:10:55 +02:00
Ad Schellevis
abcb23703f Filter: alias - add aliasname to error message 2020-09-04 12:56:10 +02:00
Ad Schellevis
cff284e6e7 find_table_references.py unused variable, the IPAddress() call is only there for validation purposes now. 2020-09-04 08:28:30 +02:00
Ad Schellevis
5e94485c91 missed a spot 2020-09-03 22:03:58 +02:00
Ad Schellevis
d105d35cf8 cleanup previous 2020-09-03 22:01:01 +02:00
kulikov-a
d6bfe637da
find_table_references.py: use pfctl for IP check (#4320) 2020-09-03 21:59:17 +02:00
Ad Schellevis
37ad98237b Reporting / Traffic: add iftop stats script 2020-09-03 21:54:43 +02:00
Ad Schellevis
222f8c41c9 Reporting / Traffic: proof of concept code for a traffic view replacement using chart.js (part 2)
o refactor data collection action, use interface unique names (lan, wan, opt1, ...)
o reduce data fetch calls, update both graphs in the same poll
o hook in color labels from chartjs-plugin-colorschemes.js
2020-09-02 21:40:30 +02:00