Commit graph

629 commits

Author SHA1 Message Date
Andre Medeiros 4735cdee44 update render.yaml 2023-03-16 10:54:43 -04:00
Andre Medeiros f878a463b7 make logs less chatty 2023-03-16 10:44:09 -04:00
Andre Medeiros 74a87fce34 update dequeue metric 2023-03-16 10:34:15 -04:00
Andre Medeiros 8dd6242bff mark workgroups as done 2023-03-16 10:13:26 -04:00
Andre Medeiros 88223e6155 fix logging names 2023-03-16 10:07:36 -04:00
Andre Medeiros f9fd53610f handle empty candidate set for scheduling 2023-03-16 10:06:51 -04:00
Andre Medeiros 73e7927d3f update scheduler to split account work 2023-03-16 10:01:58 -04:00
Andre Medeiros b0f7f6fccb have errors for too many requests too 2023-03-16 09:33:51 -04:00
Andre Medeiros 9b0a884245 update gitignore 2023-02-23 11:40:45 -05:00
Andre Medeiros 4ec7338090 [render skip] log median score 2022-12-16 13:38:42 -05:00
Andre Medeiros b78a2df159 [render skip] fix api live activities 2022-11-18 08:58:40 -05:00
André Medeiros fc0a0e2010 [render skip] bump workflow versions (#111)
* [render skip] bump golang lint

* bump golang

* bump other actions

* simplify workflow

* simplify some more

* specify golang version
2022-11-16 13:29:25 -05:00
Andre Medeiros 60eb5db5f0 [render skip] add .envrc to gitignore 2022-11-15 09:31:28 -05:00
Andre Medeiros 3b9da79e6e [render skip] add development in favour of sandbox 2022-11-13 09:08:55 -05:00
Andre Medeiros fd648cad3a [render skip] notif tester 2022-11-11 12:03:39 -05:00
Andre Medeiros 7582c90468 change notification interval to 10 seconds 2022-11-10 12:05:57 -05:00
Andre Medeiros d6b967188c things 2022-11-09 14:19:14 -05:00
Andre Medeiros 0ca21ffcb4 handle oauth revoked errors in watchers 2022-11-09 14:10:45 -05:00
Andre Medeiros e23d47f815 switch to oauth in subredddit about 2022-11-09 13:59:04 -05:00
Andre Medeiros 038db61798 switch subreddit posts url 2022-11-09 13:54:03 -05:00
Andre Medeiros fc449fd7cf [render skip] set last message id on api properly 2022-11-05 21:25:06 -04:00
Andre Medeiros 5eabaebf45 batch size wants to be smaller for less lockign time, not higher 2022-11-05 21:13:05 -04:00
Andre Medeiros b18ae59207 increase scheduler batch size 2022-11-05 21:08:49 -04:00
Andre Medeiros 42aa9e594c bump locks again 2022-11-05 20:59:22 -04:00
Andre Medeiros e241f67888 make pool sizes customized 2022-11-05 20:35:09 -04:00
Andre Medeiros 447a21ba60 increase prefetch 2022-11-05 20:31:55 -04:00
Andre Medeiros ebf6ac47bb [skip render] remove old redis from infra 2022-11-05 20:26:55 -04:00
Andre Medeiros 194feb312c increase poolsize a bit 2022-11-05 20:25:41 -04:00
Andre Medeiros 5c850bc66d bring new redis up to line in blueprints 2022-11-05 20:18:25 -04:00
Andre Medeiros 6627fd4102 reduce pool size 2022-11-05 20:16:45 -04:00
Andre Medeiros b05532e2fd bump pg client count 2022-11-05 20:13:28 -04:00
Andre Medeiros ded67f570d tweak pool sizes and consumer count 2022-11-05 20:10:05 -04:00
Andre Medeiros 275bcec3f0 double the amount of consumers 2022-11-05 20:02:51 -04:00
Andre Medeiros 77a6f67c7b small tweaks 2022-11-05 20:01:35 -04:00
Andre Medeiros 288c7dc3ec [ci skip] update pgbouncer github url 2022-11-05 16:38:19 -04:00
Andre Medeiros c1b2dd56f1 clean allow lists 2022-11-05 16:35:50 -04:00
Andre Medeiros 46697cd3c4 add new redis instances 2022-11-05 16:33:55 -04:00
Andre Medeiros 70f48c87da make connections to the correct redis url envs 2022-11-05 16:28:27 -04:00
Andre Medeiros 11f5f4df51 add new env variables 2022-11-05 16:18:25 -04:00
Andre Medeiros 4f200fd26a spam prevention 2022-11-05 16:15:04 -04:00
Andre Medeiros af538e6f42 update reddit http client 2022-11-05 16:08:00 -04:00
André Medeiros 9341e08123 feat(ops): add distributed tracing (#109)
* tracing

* instrument redis

* add instrumentation around queue acks

* adjust backoff schedules for reddit

* set proper http client on reddit

* populate account last message ID on upsert

* pass last message id on upsert

* schedule accounts in a predictable order
2022-11-05 15:59:33 -04:00
Andre Medeiros ee1d1d32d4 try again with a queue specific redis connection 2022-11-03 10:30:50 -04:00
Andre Medeiros 164652e2e4 explicitly use http2 2022-11-02 19:05:23 -04:00
Andre Medeiros c6903d2b5f Revert "each consumer gets their reddit client"
This reverts commit 5714fbaad7.
2022-11-02 19:02:25 -04:00
Andre Medeiros 5714fbaad7 each consumer gets their reddit client 2022-11-02 18:51:16 -04:00
Andre Medeiros 710443830b easy on the histograms 2022-11-02 18:44:42 -04:00
Andre Medeiros 31de625d04 reduce prefetch 2022-11-02 18:29:52 -04:00
Andre Medeiros b1aac725aa try reddit without verifyign certificates 2022-11-01 19:41:49 -04:00
Andre Medeiros 0b81d4c9d3 add runtime profile rates 2022-11-01 19:36:40 -04:00