Commit graph

631 commits

Author SHA1 Message Date
dependabot[bot]
9304c5c894 Bump go.uber.org/zap from 1.23.0 to 1.24.0 (#112)
Bumps [go.uber.org/zap](https://github.com/uber-go/zap) from 1.23.0 to 1.24.0.
- [Release notes](https://github.com/uber-go/zap/releases)
- [Changelog](https://github.com/uber-go/zap/blob/master/CHANGELOG.md)
- [Commits](https://github.com/uber-go/zap/compare/v1.23.0...v1.24.0)

---
updated-dependencies:
- dependency-name: go.uber.org/zap
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-03-16 11:10:51 -04:00
dependabot[bot]
31307defb3 Bump github.com/go-co-op/gocron from 1.17.1 to 1.18.1 (#122)
Bumps [github.com/go-co-op/gocron](https://github.com/go-co-op/gocron) from 1.17.1 to 1.18.1.
- [Release notes](https://github.com/go-co-op/gocron/releases)
- [Commits](https://github.com/go-co-op/gocron/compare/v1.17.1...v1.18.1)

---
updated-dependencies:
- dependency-name: github.com/go-co-op/gocron
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-03-16 11:10:32 -04:00
Andre Medeiros
4735cdee44 update render.yaml 2023-03-16 10:54:43 -04:00
Andre Medeiros
f878a463b7 make logs less chatty 2023-03-16 10:44:09 -04:00
Andre Medeiros
74a87fce34 update dequeue metric 2023-03-16 10:34:15 -04:00
Andre Medeiros
8dd6242bff mark workgroups as done 2023-03-16 10:13:26 -04:00
Andre Medeiros
88223e6155 fix logging names 2023-03-16 10:07:36 -04:00
Andre Medeiros
f9fd53610f handle empty candidate set for scheduling 2023-03-16 10:06:51 -04:00
Andre Medeiros
73e7927d3f update scheduler to split account work 2023-03-16 10:01:58 -04:00
Andre Medeiros
b0f7f6fccb have errors for too many requests too 2023-03-16 09:33:51 -04:00
Andre Medeiros
9b0a884245 update gitignore 2023-02-23 11:40:45 -05:00
Andre Medeiros
4ec7338090 [render skip] log median score 2022-12-16 13:38:42 -05:00
Andre Medeiros
b78a2df159 [render skip] fix api live activities 2022-11-18 08:58:40 -05:00
André Medeiros
fc0a0e2010 [render skip] bump workflow versions (#111)
* [render skip] bump golang lint

* bump golang

* bump other actions

* simplify workflow

* simplify some more

* specify golang version
2022-11-16 13:29:25 -05:00
Andre Medeiros
60eb5db5f0 [render skip] add .envrc to gitignore 2022-11-15 09:31:28 -05:00
Andre Medeiros
3b9da79e6e [render skip] add development in favour of sandbox 2022-11-13 09:08:55 -05:00
Andre Medeiros
fd648cad3a [render skip] notif tester 2022-11-11 12:03:39 -05:00
Andre Medeiros
7582c90468 change notification interval to 10 seconds 2022-11-10 12:05:57 -05:00
Andre Medeiros
d6b967188c things 2022-11-09 14:19:14 -05:00
Andre Medeiros
0ca21ffcb4 handle oauth revoked errors in watchers 2022-11-09 14:10:45 -05:00
Andre Medeiros
e23d47f815 switch to oauth in subredddit about 2022-11-09 13:59:04 -05:00
Andre Medeiros
038db61798 switch subreddit posts url 2022-11-09 13:54:03 -05:00
Andre Medeiros
fc449fd7cf [render skip] set last message id on api properly 2022-11-05 21:25:06 -04:00
Andre Medeiros
5eabaebf45 batch size wants to be smaller for less lockign time, not higher 2022-11-05 21:13:05 -04:00
Andre Medeiros
b18ae59207 increase scheduler batch size 2022-11-05 21:08:49 -04:00
Andre Medeiros
42aa9e594c bump locks again 2022-11-05 20:59:22 -04:00
Andre Medeiros
e241f67888 make pool sizes customized 2022-11-05 20:35:09 -04:00
Andre Medeiros
447a21ba60 increase prefetch 2022-11-05 20:31:55 -04:00
Andre Medeiros
ebf6ac47bb [skip render] remove old redis from infra 2022-11-05 20:26:55 -04:00
Andre Medeiros
194feb312c increase poolsize a bit 2022-11-05 20:25:41 -04:00
Andre Medeiros
5c850bc66d bring new redis up to line in blueprints 2022-11-05 20:18:25 -04:00
Andre Medeiros
6627fd4102 reduce pool size 2022-11-05 20:16:45 -04:00
Andre Medeiros
b05532e2fd bump pg client count 2022-11-05 20:13:28 -04:00
Andre Medeiros
ded67f570d tweak pool sizes and consumer count 2022-11-05 20:10:05 -04:00
Andre Medeiros
275bcec3f0 double the amount of consumers 2022-11-05 20:02:51 -04:00
Andre Medeiros
77a6f67c7b small tweaks 2022-11-05 20:01:35 -04:00
Andre Medeiros
288c7dc3ec [ci skip] update pgbouncer github url 2022-11-05 16:38:19 -04:00
Andre Medeiros
c1b2dd56f1 clean allow lists 2022-11-05 16:35:50 -04:00
Andre Medeiros
46697cd3c4 add new redis instances 2022-11-05 16:33:55 -04:00
Andre Medeiros
70f48c87da make connections to the correct redis url envs 2022-11-05 16:28:27 -04:00
Andre Medeiros
11f5f4df51 add new env variables 2022-11-05 16:18:25 -04:00
Andre Medeiros
4f200fd26a spam prevention 2022-11-05 16:15:04 -04:00
Andre Medeiros
af538e6f42 update reddit http client 2022-11-05 16:08:00 -04:00
André Medeiros
9341e08123 feat(ops): add distributed tracing (#109)
* tracing

* instrument redis

* add instrumentation around queue acks

* adjust backoff schedules for reddit

* set proper http client on reddit

* populate account last message ID on upsert

* pass last message id on upsert

* schedule accounts in a predictable order
2022-11-05 15:59:33 -04:00
Andre Medeiros
ee1d1d32d4 try again with a queue specific redis connection 2022-11-03 10:30:50 -04:00
Andre Medeiros
164652e2e4 explicitly use http2 2022-11-02 19:05:23 -04:00
Andre Medeiros
c6903d2b5f Revert "each consumer gets their reddit client"
This reverts commit 5714fbaad7.
2022-11-02 19:02:25 -04:00
Andre Medeiros
5714fbaad7 each consumer gets their reddit client 2022-11-02 18:51:16 -04:00
Andre Medeiros
710443830b easy on the histograms 2022-11-02 18:44:42 -04:00
Andre Medeiros
31de625d04 reduce prefetch 2022-11-02 18:29:52 -04:00