101 commits

Author	SHA1	Message	Date
Andre Medeiros	646dc0dd34	implement account soft delete	2022-11-01 12:45:11 -04:00
Andre Medeiros	98cafdfaed	make things better for the golang scheduler	2022-11-01 11:25:38 -04:00
Andre Medeiros	484876adab	revert queue redis	2022-11-01 09:53:09 -04:00
Andre Medeiros	61dc3b558f	get a separate redis connection for the queue itself	2022-10-31 22:41:41 -04:00
Andre Medeiros	a441d2723e	better use of context	2022-10-31 22:33:11 -04:00
Andre Medeiros	f01d305c57	explicitly pass context	2022-10-31 21:49:34 -04:00
Andre Medeiros	d9f7689d27	one context per goroutine	2022-10-31 21:48:47 -04:00
Andre Medeiros	eb1d904f86	change query	2022-10-31 21:32:43 -04:00
Andre Medeiros	d468a6e88b	change how we iterate over accounts	2022-10-31 21:30:12 -04:00
Andre Medeiros	683edbb091	dial down live activities	2022-10-31 20:58:02 -04:00
Andre Medeiros	df0860dd05	increase consumers and make choice more direct	2022-10-31 17:33:41 -04:00
Andre Medeiros	62df908b33	increase maxprocs	2022-10-31 16:09:03 -04:00
Andre Medeiros	3750374aa0	increase maxprocs	2022-10-31 16:04:08 -04:00
Andre Medeiros	00bd99b60e	add logging to the scheduler	2022-10-31 15:49:27 -04:00
Andre Medeiros	c9877879da	same timezone everywhere	2022-10-27 15:47:26 -04:00
Andre Medeiros	2c31a0df84	increase cron concurrent jobs	2022-10-27 10:09:40 -04:00
Andre Medeiros	030b73e493	increase live activity batch size	2022-10-26 22:55:08 -04:00
Andre Medeiros	c08de574e9	fix context usage in scheduler	2022-10-26 20:48:22 -04:00
Andre Medeiros	13bc85dc8d	report on live activities	2022-10-26 20:36:03 -04:00
Andre Medeiros	696f932baa	Live activities	2022-10-19 09:37:41 -04:00
Andre Medeiros	01a4ae9559	add pprof endpoints	2022-08-08 12:48:34 -04:00
Andre Medeiros	13af0d1b4a	use the right id field	2022-07-31 15:23:29 -04:00
Andre Medeiros	bb2f709259	fix batches	2022-07-31 15:12:31 -04:00
Andre Medeiros	1617bf88e1	less mutations on the accounts table	2022-07-31 15:07:14 -04:00
Andre Medeiros	f3814683b8	don't skimp out on redis connections	2022-07-15 12:55:56 -04:00
Andre Medeiros	f4fea41435	remove some load	2022-07-13 18:43:27 -04:00
Andre Medeiros	63cc67cd86	double pool	2022-07-13 17:45:48 -04:00
Andre Medeiros	fa8b75d728	tone down pool sizes	2022-07-13 17:14:13 -04:00
Andre Medeiros	ae764077b4	increase batch size on scheduler	2022-07-13 17:01:04 -04:00
Andre Medeiros	80bae7ff9f	get string slice straight from command result	2022-07-13 16:24:51 -04:00
Andre Medeiros	1f59a47880	increase pool size	2022-07-13 15:52:07 -04:00
Andre Medeiros	be7bd24ae1	increase multiplier	2022-07-13 15:30:39 -04:00
Andre Medeiros	b26140f190	test: less prefetch more workers at the same time	2022-07-13 15:08:21 -04:00
Andre Medeiros	a00e4405c7	tweak redis conns	2022-07-13 15:02:38 -04:00
Andre Medeiros	a3e69954c8	up the batch sizes	2022-07-13 12:39:37 -04:00
Andre Medeiros	2fe34ecc99	run in singleton mode	2022-07-13 12:21:12 -04:00
Andre Medeiros	e80579ed35	tweak batch sizes	2022-07-13 12:19:11 -04:00
André Medeiros	e8a8e5a5b3	chore: use reddit ids when enqueueing accounts (#87)	2022-07-13 11:50:13 -04:00
Andre Medeiros	ce944f92f7	lets prune accounts again	2022-06-30 09:56:38 -04:00
André Medeiros	d3c9e303ff	Update api.go	2022-06-27 18:47:07 -04:00
Andre Medeiros	523dce6300	tweak pool	2022-06-27 10:36:01 -04:00
Andre Medeiros	8ae426a4de	do not prune accounts	2022-06-25 14:45:05 -04:00
Andre Medeiros	f4e5d7e979	bump connections again	2022-06-25 14:04:03 -04:00
Andre Medeiros	aa92f1ec69	increase API connections	2022-06-25 14:01:03 -04:00
Andre Medeiros	221de1d2b6	back to no singleton mode, now that we're stable	2022-06-04 10:29:33 -04:00
Andre Medeiros	d243cebab6	better iteration	2022-06-04 10:24:22 -04:00
Andre Medeiros	084407a5f2	calculate batch size properly	2022-06-04 10:23:45 -04:00
Andre Medeiros	b23a158471	parallelize scheduler better	2022-06-04 10:21:29 -04:00
Andre Medeiros	6ece4c784a	no singleton	2022-05-27 16:12:50 -04:00
Andre Medeiros	0938400dd7	Revert "try enqueue accounts in a loop instead" ... This reverts commit 9b5829f549.	2022-05-27 15:02:57 -04:00