Commit Graph

648 Commits

Author SHA1 Message Date
Andre Medeiros ded67f570d tweak pool sizes and consumer count 2022-11-05 20:10:05 -04:00
Andre Medeiros 275bcec3f0 double the amount of consumers 2022-11-05 20:02:51 -04:00
Andre Medeiros 77a6f67c7b small tweaks 2022-11-05 20:01:35 -04:00
Andre Medeiros 288c7dc3ec [ci skip] update pgbouncer github url 2022-11-05 16:38:19 -04:00
Andre Medeiros c1b2dd56f1 clean allow lists 2022-11-05 16:35:50 -04:00
Andre Medeiros 46697cd3c4 add new redis instances 2022-11-05 16:33:55 -04:00
Andre Medeiros 70f48c87da make connections to the correct redis url envs 2022-11-05 16:28:27 -04:00
Andre Medeiros 11f5f4df51 add new env variables 2022-11-05 16:18:25 -04:00
Andre Medeiros 4f200fd26a spam prevention 2022-11-05 16:15:04 -04:00
Andre Medeiros af538e6f42 update reddit http client 2022-11-05 16:08:00 -04:00
André Medeiros 9341e08123 feat(ops): add distributed tracing (#109)
* tracing

* instrument redis

* add instrumentation around queue acks

* adjust backoff schedules for reddit

* set proper http client on reddit

* populate account last message ID on upsert

* pass last message id on upsert

* schedule accounts in a predictable order
2022-11-05 15:59:33 -04:00
Andre Medeiros ee1d1d32d4 try again with a queue specific redis connection 2022-11-03 10:30:50 -04:00
Andre Medeiros 164652e2e4 explicitly use http2 2022-11-02 19:05:23 -04:00
Andre Medeiros c6903d2b5f Revert "each consumer gets their reddit client"
This reverts commit 5714fbaad7.
2022-11-02 19:02:25 -04:00
Andre Medeiros 5714fbaad7 each consumer gets their reddit client 2022-11-02 18:51:16 -04:00
Andre Medeiros 710443830b easy on the histograms 2022-11-02 18:44:42 -04:00
Andre Medeiros 31de625d04 reduce prefetch 2022-11-02 18:29:52 -04:00
Andre Medeiros b1aac725aa try reddit without verifyign certificates 2022-11-01 19:41:49 -04:00
Andre Medeiros 0b81d4c9d3 add runtime profile rates 2022-11-01 19:36:40 -04:00
Andre Medeiros c7a57121b6 change prefetch limit for notifications worker 2022-11-01 19:08:10 -04:00
Andre Medeiros 6cf7c54c86 upgrade rmq to v5 2022-11-01 19:02:25 -04:00
Andre Medeiros 420499c9bb update scheduler 2022-11-01 13:14:33 -04:00
Andre Medeiros 646dc0dd34 implement account soft delete 2022-11-01 12:45:11 -04:00
Andre Medeiros 98cafdfaed make things better for the golang scheduler 2022-11-01 11:25:38 -04:00
Andre Medeiros 00ea87b0a8 adjust infra 2022-11-01 10:43:47 -04:00
Andre Medeiros 873b9eb4db reduce logger allocations 2022-11-01 10:16:17 -04:00
Andre Medeiros 484876adab revert queue redis 2022-11-01 09:53:09 -04:00
Andre Medeiros 61dc3b558f get a separate redis connection for the queue itself 2022-10-31 22:41:41 -04:00
Andre Medeiros a441d2723e better use of context 2022-10-31 22:33:11 -04:00
Andre Medeiros f01d305c57 explicitly pass context 2022-10-31 21:49:34 -04:00
Andre Medeiros d9f7689d27 one context per goroutine 2022-10-31 21:48:47 -04:00
Andre Medeiros eb1d904f86 change query 2022-10-31 21:32:43 -04:00
Andre Medeiros d468a6e88b change how we iterate over accounts 2022-10-31 21:30:12 -04:00
dependabot[bot] f2b270a3de Bump github.com/bugsnag/bugsnag-go/v2 from 2.1.2 to 2.2.0 (#104)
Bumps [github.com/bugsnag/bugsnag-go/v2](https://github.com/bugsnag/bugsnag-go) from 2.1.2 to 2.2.0.
- [Release notes](https://github.com/bugsnag/bugsnag-go/releases)
- [Changelog](https://github.com/bugsnag/bugsnag-go/blob/master/CHANGELOG.md)
- [Commits](https://github.com/bugsnag/bugsnag-go/compare/v2.1.2...v2.2.0)

---
updated-dependencies:
- dependency-name: github.com/bugsnag/bugsnag-go/v2
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-10-31 21:05:53 -04:00
dependabot[bot] eee5bafdfc Bump github.com/gofrs/uuid from 4.0.0+incompatible to 4.3.0+incompatible (#105)
Bumps [github.com/gofrs/uuid](https://github.com/gofrs/uuid) from 4.0.0+incompatible to 4.3.0+incompatible.
- [Release notes](https://github.com/gofrs/uuid/releases)
- [Commits](https://github.com/gofrs/uuid/compare/v4.0.0...v4.3.0)

---
updated-dependencies:
- dependency-name: github.com/gofrs/uuid
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-10-31 21:05:38 -04:00
dependabot[bot] 46fc9e6635 Bump go.uber.org/zap from 1.21.0 to 1.23.0 (#106)
Bumps [go.uber.org/zap](https://github.com/uber-go/zap) from 1.21.0 to 1.23.0.
- [Release notes](https://github.com/uber-go/zap/releases)
- [Changelog](https://github.com/uber-go/zap/blob/master/CHANGELOG.md)
- [Commits](https://github.com/uber-go/zap/compare/v1.21.0...v1.23.0)

---
updated-dependencies:
- dependency-name: go.uber.org/zap
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-10-31 21:05:13 -04:00
dependabot[bot] 228cc24cac Bump github.com/jackc/pgx/v4 from 4.16.1 to 4.17.2 (#107)
Bumps [github.com/jackc/pgx/v4](https://github.com/jackc/pgx) from 4.16.1 to 4.17.2.
- [Release notes](https://github.com/jackc/pgx/releases)
- [Changelog](https://github.com/jackc/pgx/blob/v4.17.2/CHANGELOG.md)
- [Commits](https://github.com/jackc/pgx/compare/v4.16.1...v4.17.2)

---
updated-dependencies:
- dependency-name: github.com/jackc/pgx/v4
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-10-31 21:03:01 -04:00
Andre Medeiros 683edbb091 dial down live activities 2022-10-31 20:58:02 -04:00
Andre Medeiros 0e342803a1 don't go crazy on emitting stats 2022-10-31 18:04:01 -04:00
Andre Medeiros df0860dd05 increase consumers and make choice more direct 2022-10-31 17:33:41 -04:00
Andre Medeiros 62df908b33 increase maxprocs 2022-10-31 16:09:03 -04:00
Andre Medeiros 3750374aa0 increase maxprocs 2022-10-31 16:04:08 -04:00
Andre Medeiros 00bd99b60e add logging to the scheduler 2022-10-31 15:49:27 -04:00
Andre Medeiros 16eeaae3ad poll twice as much for jobs 2022-10-31 15:22:42 -04:00
Andre Medeiros fbd3ff617a fix subreddit watcher 2022-10-31 15:12:27 -04:00
Andre Medeiros a467b08878 set dismissal for live activity in lock screen 2022-10-31 13:35:01 -04:00
Andre Medeiros 6e668e538c omit live activity fields when they're empty 2022-10-27 21:54:30 -04:00
Andre Medeiros 2352e146c3 address an edge case where threads without comments will never stop 2022-10-27 21:52:06 -04:00
Andre Medeiros c9877879da same timezone everywhere 2022-10-27 15:47:26 -04:00
Andre Medeiros 11ccf632c3 only use the production apns server for notifications 2022-10-27 15:24:28 -04:00