Commit graph

57 commits

Author SHA1 Message Date
Andre Medeiros
bb2f709259 fix batches 2022-07-31 15:12:31 -04:00
Andre Medeiros
1617bf88e1 less mutations on the accounts table 2022-07-31 15:07:14 -04:00
Andre Medeiros
f4fea41435 remove some load 2022-07-13 18:43:27 -04:00
Andre Medeiros
ae764077b4 increase batch size on scheduler 2022-07-13 17:01:04 -04:00
Andre Medeiros
80bae7ff9f get string slice straight from command result 2022-07-13 16:24:51 -04:00
Andre Medeiros
a00e4405c7 tweak redis conns 2022-07-13 15:02:38 -04:00
Andre Medeiros
a3e69954c8 up the batch sizes 2022-07-13 12:39:37 -04:00
Andre Medeiros
2fe34ecc99 run in singleton mode 2022-07-13 12:21:12 -04:00
Andre Medeiros
e80579ed35 tweak batch sizes 2022-07-13 12:19:11 -04:00
André Medeiros
e8a8e5a5b3 chore: use reddit ids when enqueueing accounts (#87) 2022-07-13 11:50:13 -04:00
Andre Medeiros
ce944f92f7 lets prune accounts again 2022-06-30 09:56:38 -04:00
Andre Medeiros
8ae426a4de do not prune accounts 2022-06-25 14:45:05 -04:00
Andre Medeiros
221de1d2b6 back to no singleton mode, now that we're stable 2022-06-04 10:29:33 -04:00
Andre Medeiros
d243cebab6 better iteration 2022-06-04 10:24:22 -04:00
Andre Medeiros
084407a5f2 calculate batch size properly 2022-06-04 10:23:45 -04:00
Andre Medeiros
b23a158471 parallelize scheduler better 2022-06-04 10:21:29 -04:00
Andre Medeiros
6ece4c784a no singleton 2022-05-27 16:12:50 -04:00
Andre Medeiros
0938400dd7 Revert "try enqueue accounts in a loop instead"
This reverts commit 9b5829f549.
2022-05-27 15:02:57 -04:00
Andre Medeiros
01ad9f3d1e Revert "another experiment for scheduling"
This reverts commit c8dd76e1ab.
2022-05-27 15:02:47 -04:00
Andre Medeiros
c8dd76e1ab another experiment for scheduling 2022-05-27 14:55:59 -04:00
Andre Medeiros
9b5829f549 try enqueue accounts in a loop instead 2022-05-27 14:47:59 -04:00
Andre Medeiros
fb3f2d1433 more scheduler tweaks 2022-05-27 14:40:40 -04:00
Andre Medeiros
356402d631 Revert "tweak scheduler"
This reverts commit 38fef3c852.
2022-05-27 14:39:12 -04:00
Andre Medeiros
38fef3c852 tweak scheduler 2022-05-27 14:33:46 -04:00
Andre Medeiros
eb853710c4 Add profiling to scheduler 2022-05-27 13:27:28 -04:00
Andre Medeiros
079cc9a5c5 better variable name 2022-05-23 18:54:38 -04:00
Andre Medeiros
34e050daad tweak scheduler 2022-05-23 18:51:30 -04:00
Andre Medeiros
b1ed5fb71a Revert "optimize scheduler to reduce memory allocations"
This reverts commit f41dd925e4.
2022-05-23 18:46:39 -04:00
Andre Medeiros
f41dd925e4 optimize scheduler to reduce memory allocations 2022-05-23 18:43:53 -04:00
Andre Medeiros
bcce102388 more logging things 2022-05-23 14:29:15 -04:00
André Medeiros
b1f266bf91 migrate out of logrus (#76) 2022-05-23 14:17:25 -04:00
Andre Medeiros
6f8f93f3ab reduce account updates by half 2022-05-22 19:57:29 -04:00
Andre Medeiros
b92e3fc374 tweak scheduler 2022-05-22 19:35:03 -04:00
Andre Medeiros
fc94bef379 optimize queries 2022-05-21 17:15:24 -04:00
André Medeiros
f9b9c595cf Better testing (#62)
* some tests

* more tests

* tidy up go.mod

* more tests

* add postgres

* beep

* again

* Set up schema

* fix device test
2022-05-07 12:37:21 -04:00
Andre Medeiros
dbcda74ab8 Changes to schema 2022-03-28 17:05:01 -04:00
Andre Medeiros
70d73eab4c defer func on stats for scheduler 2021-10-17 12:04:09 -04:00
Andre Medeiros
f5d2fe5e81 check for stuck accounts every 2 minutes 2021-10-17 10:18:13 -04:00
Andre Medeiros
c8bec95bed add stuck notifications worker 2021-10-17 10:17:41 -04:00
Andre Medeiros
65792abd94 add subreddit trending posts watcher 2021-10-10 11:51:42 -04:00
Andre Medeiros
4955f74f52 user following 2021-10-09 10:59:20 -04:00
Andre Medeiros
9854c0ecc4 fix lint 2021-09-27 15:54:29 -04:00
Andre Medeiros
a26b1f6a32 delete devices heuristic fix 2021-09-25 14:56:14 -04:00
Andre Medeiros
3361403379 subreddit notifications 2021-09-25 12:56:01 -04:00
Andre Medeiros
fc1065deb5 fix ci 2021-09-25 09:19:42 -04:00
Andre Medeiros
9a5d699f66 Remove stale devices 2021-08-14 12:08:17 -04:00
Andre Medeiros
84e499a7af schedule stale and orphaned accounts 2021-08-14 11:59:13 -04:00
Andre Medeiros
f6e05a6fd8 clean orphaned accounts 2021-08-14 11:54:48 -04:00
Andre Medeiros
1249f54bf2 tweak accounts and batch size 2021-07-22 21:52:29 -04:00
Andre Medeiros
5848d9584d do 2000 accounts at a time 2021-07-22 21:42:06 -04:00