Commit graph

410 commits

Author SHA1 Message Date
Ana Custura
4dd0c4ed22 feat: add prometheus flask metrics 2024-12-04 16:14:20 +00:00
Ana Custura
c50d341c26 feat: move from gunicorn to waitress
Waitress, unlike unicorn, is multi-threaded. As it does not do access logs
by default, the app needs to be wrapped in TransLogger before being passed to
Waitress.

To make the switch, a custom registry is now also used instead of the global REGISTRY
as the default registry for the app. As part of this change, the default
prometheus metrics are then also registered with this new registry.

Closes: #72
2024-12-04 16:14:01 +00:00
irl
ffe097b24f lint: line breaks 2024-12-03 16:13:00 +00:00
irl
173eea2625 feat: metrics collectors don't depend on database being ready
also adds new "database_collector" metric to show current collector status
2024-12-03 14:55:53 +00:00
Ana Custura
0867b13f8f feat: run with gunicorn instead of flask
Each worker now uses its own registry instead of the global REGISTRY
to avoid duplicate metric registration, since metrics are served
from the database.
2024-12-03 10:40:09 +00:00
irl
24cac76f70 feat: create new onion services via api 2024-12-02 00:29:45 +00:00
irl
192dacf760 fix: remove unsafe default list for list_resources 2024-12-01 14:10:21 +00:00
irl
cdbf152f40 fix: revert use of dt.UTC to dt.tz.UTC
some instance still on python 3.9
2024-11-29 18:53:46 +00:00
irl
905bdd1a58 feat(cli): mark block_ooni job as safe 2024-11-29 18:44:29 +00:00
irl
d854d52ab9 feat(block): tweak blocky timing, mark job safe 2024-11-29 18:43:56 +00:00
irl
8449a5a8c8 feat(api): dont list proxies destroyed over 24 hours ago 2024-11-29 18:39:08 +00:00
irl
1bc2960278 fix: don't create missing proxies for hotspare
* also fixes setting creation time for pools
* improves logging in proxy creation pipeline
2024-11-29 16:08:33 +00:00
irl
b91e078e22 fix: initialise new terraform state to avoid NOT NULL constraint violation 2024-11-29 15:36:50 +00:00
irl
be111b9dde lint: resolve mypy issues in app.cli.db 2024-11-18 09:56:48 +00:00
irl
3b223f2c1a lint: app.api passes pylint 2024-11-16 19:57:10 +00:00
irl
3610707495 lint: app.cli.db passes pylint 2024-11-16 19:47:41 +00:00
irl
9674cb4293 feat: remove block_bridge_dnsc
no longer used
2024-11-16 19:38:57 +00:00
irl
5c0170bdef fix: do not rotate hotspare proxies on max age
closes: #42
2024-11-16 19:26:23 +00:00
90575b076e fix: extend timeout for blocky, fix db query 2024-11-16 13:27:29 +00:00
779d5cb8d2 feat: new block plugin for blocky 2024-11-16 13:17:39 +00:00
irl
cce5c307ee lint: ignore "circular import" that isn't real 2024-11-10 21:54:56 +00:00
irl
04f5a0345b feat: adds onions list to api 2024-11-10 21:41:54 +00:00
irl
2ca4ddffb0 fix: import Origin at time of use in models.base
was previously removed to prevent circ import
2024-11-10 18:28:35 +00:00
irl
75b2c1adf0 refactor: moving more models to mapped_column 2024-11-10 15:13:29 +00:00
irl
ae905c6d80 feat: initial api implementation 2024-11-10 13:38:51 +00:00
a482d5bba8 feat: upgrade python version and install frontend in container 2024-11-09 17:12:34 +00:00
75ea0b22d7 feat: add settings as a bridge distribution method 2024-11-09 13:07:40 +00:00
9caf1deb74 fix: switch hcloud instances to CX22 (CX11 doesn't exist anymore) 2024-11-09 13:07:08 +00:00
0aa41b303d fix: ignore destroyed proxies in risk score calculation 2024-11-09 12:53:53 +00:00
b49e527bf6 fix: remove unnecessary and wrong asserts 2024-11-09 12:41:46 +00:00
73439a8121 feat: adds block_external to safe jobs list 2024-11-09 11:10:05 +00:00
4693e994ba fix: typing fixes since moving to Mapped types in models 2024-11-09 11:09:44 +00:00
d08388c339 feat: remove pydantic from list generation 2024-11-09 11:08:48 +00:00
6e691257f7 lint: type annotations, ignoring report for now 2024-07-12 15:35:04 +01:00
Ana Custura
08bba74c34 Follow the redirects for AA 2024-05-10 11:15:41 +01:00
Ana Custura
1fac7e6b4f A horrible hack for enabling AA first-party 2024-04-17 15:27:45 +01:00
Ana Custura
07416771f0 Comment out some of the AA config, make AA load directly 3rd party 2024-04-03 13:20:24 +01:00
Ana Custura
93ed07d52d Ensure gifs URLs are also rewritten, as AA loads gifs 2024-04-02 15:16:01 +01:00
Ana Custura
4bba71fbf7 Add support for loading Adobe Analytis first-party on the mirrors 2024-04-02 13:56:15 +01:00
Ana Custura
dbe8a5d869 Extract normalised domain names with tldextract 2024-04-01 15:46:55 +01:00
Ana Custura
7d4233c9e8 Add workaround in place for sites that load tags locally first 2024-03-12 12:19:38 +00:00
Ana Custura
e8f0f01ddf Add substitution rule for tags.* in all locations 2024-03-12 11:23:49 +00:00
Ana Custura
4383c4f08d Add resolver directive for tags.tiqcdn.com 2024-03-08 12:02:44 +00:00
Ana Custura
3430e65742 Refine rewriting rules for tealium 2024-02-20 11:48:59 +00:00
Ana Custura
c43dcd36c4 Formatting fixes 2024-02-19 12:21:50 +00:00
Ana Custura
92a746c515 Add support for smart proxying of Tealium tag requests 2024-02-19 12:21:42 +00:00
Ana Custura
fd206f702e Remove unused import 2024-02-19 12:18:11 +00:00
Ana Custura
84f4bbb60f Explain why we do not verify roskomsvoboda certificate 2024-02-19 12:17:49 +00:00
Ana Custura
51341c31e5 Add support for normalised domain names 2024-02-19 12:15:54 +00:00
Ana Custura
96d159ae56 Allow disabling auto-rotation for asset origins 2024-02-19 11:40:51 +00:00