Commit graph

50 commits

Author SHA1 Message Date
Andre Medeiros
12435d7605 potentially fix redis script 2022-07-13 11:38:15 -04:00
Andre Medeiros
d1d00d158d fix field 2022-07-13 11:31:31 -04:00
Andre Medeiros
ffcc1e534e change how we refer to accounts 2022-07-13 11:28:25 -04:00
Andre Medeiros
ce944f92f7 lets prune accounts again 2022-06-30 09:56:38 -04:00
Andre Medeiros
8ae426a4de do not prune accounts 2022-06-25 14:45:05 -04:00
Andre Medeiros
221de1d2b6 back to no singleton mode, now that we're stable 2022-06-04 10:29:33 -04:00
Andre Medeiros
d243cebab6 better iteration 2022-06-04 10:24:22 -04:00
Andre Medeiros
084407a5f2 calculate batch size properly 2022-06-04 10:23:45 -04:00
Andre Medeiros
b23a158471 parallelize scheduler better 2022-06-04 10:21:29 -04:00
Andre Medeiros
6ece4c784a no singleton 2022-05-27 16:12:50 -04:00
Andre Medeiros
0938400dd7 Revert "try enqueue accounts in a loop instead"
This reverts commit 9b5829f549.
2022-05-27 15:02:57 -04:00
Andre Medeiros
01ad9f3d1e Revert "another experiment for scheduling"
This reverts commit c8dd76e1ab.
2022-05-27 15:02:47 -04:00
Andre Medeiros
c8dd76e1ab another experiment for scheduling 2022-05-27 14:55:59 -04:00
Andre Medeiros
9b5829f549 try enqueue accounts in a loop instead 2022-05-27 14:47:59 -04:00
Andre Medeiros
fb3f2d1433 more scheduler tweaks 2022-05-27 14:40:40 -04:00
Andre Medeiros
356402d631 Revert "tweak scheduler"
This reverts commit 38fef3c852.
2022-05-27 14:39:12 -04:00
Andre Medeiros
38fef3c852 tweak scheduler 2022-05-27 14:33:46 -04:00
Andre Medeiros
eb853710c4 Add profiling to scheduler 2022-05-27 13:27:28 -04:00
Andre Medeiros
079cc9a5c5 better variable name 2022-05-23 18:54:38 -04:00
Andre Medeiros
34e050daad tweak scheduler 2022-05-23 18:51:30 -04:00
Andre Medeiros
b1ed5fb71a Revert "optimize scheduler to reduce memory allocations"
This reverts commit f41dd925e4.
2022-05-23 18:46:39 -04:00
Andre Medeiros
f41dd925e4 optimize scheduler to reduce memory allocations 2022-05-23 18:43:53 -04:00
Andre Medeiros
bcce102388 more logging things 2022-05-23 14:29:15 -04:00
André Medeiros
b1f266bf91 migrate out of logrus (#76) 2022-05-23 14:17:25 -04:00
Andre Medeiros
6f8f93f3ab reduce account updates by half 2022-05-22 19:57:29 -04:00
Andre Medeiros
b92e3fc374 tweak scheduler 2022-05-22 19:35:03 -04:00
Andre Medeiros
fc94bef379 optimize queries 2022-05-21 17:15:24 -04:00
André Medeiros
f9b9c595cf Better testing (#62)
* some tests

* more tests

* tidy up go.mod

* more tests

* add postgres

* beep

* again

* Set up schema

* fix device test
2022-05-07 12:37:21 -04:00
Andre Medeiros
dbcda74ab8 Changes to schema 2022-03-28 17:05:01 -04:00
Andre Medeiros
70d73eab4c defer func on stats for scheduler 2021-10-17 12:04:09 -04:00
Andre Medeiros
f5d2fe5e81 check for stuck accounts every 2 minutes 2021-10-17 10:18:13 -04:00
Andre Medeiros
c8bec95bed add stuck notifications worker 2021-10-17 10:17:41 -04:00
Andre Medeiros
65792abd94 add subreddit trending posts watcher 2021-10-10 11:51:42 -04:00
Andre Medeiros
4955f74f52 user following 2021-10-09 10:59:20 -04:00
Andre Medeiros
9854c0ecc4 fix lint 2021-09-27 15:54:29 -04:00
Andre Medeiros
a26b1f6a32 delete devices heuristic fix 2021-09-25 14:56:14 -04:00
Andre Medeiros
3361403379 subreddit notifications 2021-09-25 12:56:01 -04:00
Andre Medeiros
fc1065deb5 fix ci 2021-09-25 09:19:42 -04:00
Andre Medeiros
9a5d699f66 Remove stale devices 2021-08-14 12:08:17 -04:00
Andre Medeiros
84e499a7af schedule stale and orphaned accounts 2021-08-14 11:59:13 -04:00
Andre Medeiros
f6e05a6fd8 clean orphaned accounts 2021-08-14 11:54:48 -04:00
Andre Medeiros
1249f54bf2 tweak accounts and batch size 2021-07-22 21:52:29 -04:00
Andre Medeiros
5848d9584d do 2000 accounts at a time 2021-07-22 21:42:06 -04:00
Andre Medeiros
424e27b068 run scheduler 5 times per second 2021-07-22 21:35:11 -04:00
Andre Medeiros
e0579fbcbd fix up for render 2021-07-22 20:22:46 -04:00
Andre Medeiros
71f04afb8a tweak scheduler to only run one enqueue at a time 2021-07-20 14:39:01 -04:00
Andre Medeiros
04d59f280d tweak connections on scheduler 2021-07-20 13:00:53 -04:00
Andre Medeiros
e46082949a tweak pool args 2021-07-15 13:47:22 -04:00
Andre Medeiros
8a777d2ee6 timeout reddit and increase batches 2021-07-13 20:16:38 -04:00
Andre Medeiros
9fa0257d84 reorganize commands to keep things more consistent 2021-07-13 13:14:25 -04:00
Renamed from cmd/apollo-scheduler/main.go (Browse further)