Andre Medeiros
5eabaebf45
batch size wants to be smaller for less lockign time, not higher
2022-11-05 21:13:05 -04:00
Andre Medeiros
b18ae59207
increase scheduler batch size
2022-11-05 21:08:49 -04:00
Andre Medeiros
42aa9e594c
bump locks again
2022-11-05 20:59:22 -04:00
Andre Medeiros
e241f67888
make pool sizes customized
2022-11-05 20:35:09 -04:00
Andre Medeiros
447a21ba60
increase prefetch
2022-11-05 20:31:55 -04:00
Andre Medeiros
ebf6ac47bb
[skip render] remove old redis from infra
2022-11-05 20:26:55 -04:00
Andre Medeiros
194feb312c
increase poolsize a bit
2022-11-05 20:25:41 -04:00
Andre Medeiros
5c850bc66d
bring new redis up to line in blueprints
2022-11-05 20:18:25 -04:00
Andre Medeiros
6627fd4102
reduce pool size
2022-11-05 20:16:45 -04:00
Andre Medeiros
b05532e2fd
bump pg client count
2022-11-05 20:13:28 -04:00
Andre Medeiros
ded67f570d
tweak pool sizes and consumer count
2022-11-05 20:10:05 -04:00
Andre Medeiros
275bcec3f0
double the amount of consumers
2022-11-05 20:02:51 -04:00
Andre Medeiros
77a6f67c7b
small tweaks
2022-11-05 20:01:35 -04:00
Andre Medeiros
288c7dc3ec
[ci skip] update pgbouncer github url
2022-11-05 16:38:19 -04:00
Andre Medeiros
c1b2dd56f1
clean allow lists
2022-11-05 16:35:50 -04:00
Andre Medeiros
46697cd3c4
add new redis instances
2022-11-05 16:33:55 -04:00
Andre Medeiros
70f48c87da
make connections to the correct redis url envs
2022-11-05 16:28:27 -04:00
Andre Medeiros
11f5f4df51
add new env variables
2022-11-05 16:18:25 -04:00
Andre Medeiros
4f200fd26a
spam prevention
2022-11-05 16:15:04 -04:00
Andre Medeiros
af538e6f42
update reddit http client
2022-11-05 16:08:00 -04:00
André Medeiros
9341e08123
feat(ops): add distributed tracing ( #109 )
...
* tracing
* instrument redis
* add instrumentation around queue acks
* adjust backoff schedules for reddit
* set proper http client on reddit
* populate account last message ID on upsert
* pass last message id on upsert
* schedule accounts in a predictable order
2022-11-05 15:59:33 -04:00
Andre Medeiros
ee1d1d32d4
try again with a queue specific redis connection
2022-11-03 10:30:50 -04:00
Andre Medeiros
164652e2e4
explicitly use http2
2022-11-02 19:05:23 -04:00
Andre Medeiros
c6903d2b5f
Revert "each consumer gets their reddit client"
...
This reverts commit 5714fbaad7
2022-11-02 19:02:25 -04:00
Andre Medeiros
5714fbaad7
each consumer gets their reddit client
2022-11-02 18:51:16 -04:00
Andre Medeiros
710443830b
easy on the histograms
2022-11-02 18:44:42 -04:00
Andre Medeiros
31de625d04
reduce prefetch
2022-11-02 18:29:52 -04:00
Andre Medeiros
b1aac725aa
try reddit without verifyign certificates
2022-11-01 19:41:49 -04:00
Andre Medeiros
0b81d4c9d3
add runtime profile rates
2022-11-01 19:36:40 -04:00
Andre Medeiros
c7a57121b6
change prefetch limit for notifications worker
2022-11-01 19:08:10 -04:00
Andre Medeiros
6cf7c54c86
upgrade rmq to v5
2022-11-01 19:02:25 -04:00
Andre Medeiros
420499c9bb
update scheduler
2022-11-01 13:14:33 -04:00
Andre Medeiros
646dc0dd34
implement account soft delete
2022-11-01 12:45:11 -04:00
Andre Medeiros
98cafdfaed
make things better for the golang scheduler
2022-11-01 11:25:38 -04:00
Andre Medeiros
00ea87b0a8
adjust infra
2022-11-01 10:43:47 -04:00
Andre Medeiros
873b9eb4db
reduce logger allocations
2022-11-01 10:16:17 -04:00
Andre Medeiros
484876adab
revert queue redis
2022-11-01 09:53:09 -04:00
Andre Medeiros
61dc3b558f
get a separate redis connection for the queue itself
2022-10-31 22:41:41 -04:00
Andre Medeiros
a441d2723e
better use of context
2022-10-31 22:33:11 -04:00
Andre Medeiros
f01d305c57
explicitly pass context
2022-10-31 21:49:34 -04:00
Andre Medeiros
d9f7689d27
one context per goroutine
2022-10-31 21:48:47 -04:00
Andre Medeiros
eb1d904f86
change query
2022-10-31 21:32:43 -04:00
Andre Medeiros
d468a6e88b
change how we iterate over accounts
2022-10-31 21:30:12 -04:00
dependabot[bot]
f2b270a3de
Bump github.com/bugsnag/bugsnag-go/v2 from 2.1.2 to 2.2.0 ( #104 )
...
Bumps [github.com/bugsnag/bugsnag-go/v2](https://github.com/bugsnag/bugsnag-go ) from 2.1.2 to 2.2.0.
- [Release notes](https://github.com/bugsnag/bugsnag-go/releases )
- [Changelog](https://github.com/bugsnag/bugsnag-go/blob/master/CHANGELOG.md )
- [Commits](https://github.com/bugsnag/bugsnag-go/compare/v2.1.2...v2.2.0 )
---
updated-dependencies:
- dependency-name: github.com/bugsnag/bugsnag-go/v2
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-10-31 21:05:53 -04:00
dependabot[bot]
eee5bafdfc
Bump github.com/gofrs/uuid from 4.0.0+incompatible to 4.3.0+incompatible ( #105 )
...
Bumps [github.com/gofrs/uuid](https://github.com/gofrs/uuid ) from 4.0.0+incompatible to 4.3.0+incompatible.
- [Release notes](https://github.com/gofrs/uuid/releases )
- [Commits](https://github.com/gofrs/uuid/compare/v4.0.0...v4.3.0 )
---
updated-dependencies:
- dependency-name: github.com/gofrs/uuid
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-10-31 21:05:38 -04:00
dependabot[bot]
46fc9e6635
Bump go.uber.org/zap from 1.21.0 to 1.23.0 ( #106 )
...
Bumps [go.uber.org/zap](https://github.com/uber-go/zap ) from 1.21.0 to 1.23.0.
- [Release notes](https://github.com/uber-go/zap/releases )
- [Changelog](https://github.com/uber-go/zap/blob/master/CHANGELOG.md )
- [Commits](https://github.com/uber-go/zap/compare/v1.21.0...v1.23.0 )
---
updated-dependencies:
- dependency-name: go.uber.org/zap
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-10-31 21:05:13 -04:00
dependabot[bot]
228cc24cac
Bump github.com/jackc/pgx/v4 from 4.16.1 to 4.17.2 ( #107 )
...
Bumps [github.com/jackc/pgx/v4](https://github.com/jackc/pgx ) from 4.16.1 to 4.17.2.
- [Release notes](https://github.com/jackc/pgx/releases )
- [Changelog](https://github.com/jackc/pgx/blob/v4.17.2/CHANGELOG.md )
- [Commits](https://github.com/jackc/pgx/compare/v4.16.1...v4.17.2 )
---
updated-dependencies:
- dependency-name: github.com/jackc/pgx/v4
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-10-31 21:03:01 -04:00
Andre Medeiros
683edbb091
dial down live activities
2022-10-31 20:58:02 -04:00
Andre Medeiros
0e342803a1
don't go crazy on emitting stats
2022-10-31 18:04:01 -04:00
Andre Medeiros
df0860dd05
increase consumers and make choice more direct
2022-10-31 17:33:41 -04:00
