mirrors/apollo-backend
2
0
Fork 0
mirror of https://github.com/christianselig/apollo-backend synced 2024-06-02 23:57:15 +00:00
Code Issues Packages Projects Releases Wiki Activity
648 commits 25 branches 0 tags 2.6 MiB
Commit graph

448 commits

Author SHA1 Message Date
Andre Medeiros 2b03f4f884 be more forgiving with reddit errors 2022-10-26 18:28:11 -04:00
Andre Medeiros 840d644a4e handle threads with no comments 2022-10-26 13:15:59 -04:00
Andre Medeiros 6fdcd3540b send comment ID 2022-10-24 12:25:09 -04:00
Andre Medeiros 696f932baa Live activities 2022-10-19 09:37:41 -04:00
Andre Medeiros 01a4ae9559 add pprof endpoints 2022-08-08 12:48:34 -04:00
Andre Medeiros 13af0d1b4a use the right id field 2022-07-31 15:23:29 -04:00
Andre Medeiros bb2f709259 fix batches 2022-07-31 15:12:31 -04:00
Andre Medeiros 1617bf88e1 less mutations on the accounts table 2022-07-31 15:07:14 -04:00
Andre Medeiros f3814683b8 don't skimp out on redis connections 2022-07-15 12:55:56 -04:00
Andre Medeiros 4e453e0db2 measure reddit latency when we finish reading the body 2022-07-15 12:36:29 -04:00
Andre Medeiros 102cbb2ee2 setup timeouts on reddit http client 2022-07-15 12:34:28 -04:00
Andre Medeiros 547ab64c20 add request ids to logs 2022-07-15 12:19:27 -04:00
Andre Medeiros f4fea41435 remove some load 2022-07-13 18:43:27 -04:00
Andre Medeiros 3b08d6b8e4 fix stats name 2022-07-13 18:30:03 -04:00
Andre Medeiros 73da53ab70 measure runtime 2022-07-13 18:25:00 -04:00
Andre Medeiros 63cc67cd86 double pool 2022-07-13 17:45:48 -04:00
Andre Medeiros ceade8fe74 but for real this time 2022-07-13 17:29:40 -04:00
Andre Medeiros 3bdd348d50 reduce account updates 2022-07-13 17:28:46 -04:00
Andre Medeiros fa8b75d728 tone down pool sizes 2022-07-13 17:14:13 -04:00
Andre Medeiros ae764077b4 increase batch size on scheduler 2022-07-13 17:01:04 -04:00
Andre Medeiros da20e76d1b measure message age 2022-07-13 16:46:10 -04:00
Andre Medeiros 556c1dd9b2 test default http client 2022-07-13 16:38:10 -04:00
Andre Medeiros 94d3941005 measure dequeue latency 2022-07-13 16:28:54 -04:00
Andre Medeiros 80bae7ff9f get string slice straight from command result 2022-07-13 16:24:51 -04:00
Andre Medeiros 1f59a47880 increase pool size 2022-07-13 15:52:07 -04:00
Andre Medeiros 8156756e54 keep locks around longer 2022-07-13 15:44:50 -04:00
Andre Medeiros be7bd24ae1 increase multiplier 2022-07-13 15:30:39 -04:00
Andre Medeiros b26140f190 test: less prefetch more workers at the same time 2022-07-13 15:08:21 -04:00
Andre Medeiros a00e4405c7 tweak redis conns 2022-07-13 15:02:38 -04:00
Andre Medeiros 624cebf8ef higher prefetch 2022-07-13 14:54:27 -04:00
Andre Medeiros 071b0db010 higher reporting rate for queue delay stat 2022-07-13 13:55:45 -04:00
Andre Medeiros 5e573c831a should run tests 2022-07-13 13:47:52 -04:00
Andre Medeiros 131205a0cb better latency measurements 2022-07-13 13:42:21 -04:00
Andre Medeiros f785d1a3a4 log message acknowledgement 2022-07-13 13:24:32 -04:00
Andre Medeiros aaf1fbd98a 401 and 403 are forbidden and we'll delete account 2022-07-13 13:09:11 -04:00
Andre Medeiros a3e69954c8 up the batch sizes 2022-07-13 12:39:37 -04:00
Andre Medeiros 2fe34ecc99 run in singleton mode 2022-07-13 12:21:12 -04:00
Andre Medeiros e80579ed35 tweak batch sizes 2022-07-13 12:19:11 -04:00
André Medeiros e8a8e5a5b3 chore: use reddit ids when enqueueing accounts (#87) 2022-07-13 11:50:13 -04:00
Andre Medeiros 45793c9a1f tweak postgres connection 2022-07-13 11:09:06 -04:00
Andre Medeiros 9d0c5fb419 allow archived subreddits too 2022-07-12 14:45:19 -04:00
Andre Medeiros e0f194a7d1 allow following restricted subreddits too 2022-07-12 14:37:51 -04:00
Andre Medeiros f0c93a8bb9 fix trending 2022-07-04 09:49:30 -04:00
Andre Medeiros fdcb900297 be more forgiving with itunes receipt verification outages 2022-06-30 16:14:07 -04:00
Andre Medeiros 647995271e give us a bit more breahting room in case of an itunes receipt check outage 2022-06-30 16:03:47 -04:00
Andre Medeiros 655300682f watchers check subreddit info with authentication 2022-06-30 15:24:58 -04:00
Andre Medeiros d5affe36c1 more logging 2022-06-30 15:06:03 -04:00
Andre Medeiros 05cb97d412 be more specific about errors 2022-06-30 12:11:07 -04:00
Andre Medeiros ce944f92f7 lets prune accounts again 2022-06-30 09:56:38 -04:00
Andre Medeiros ee29fccaf9 chill logging 2022-06-29 13:25:59 -04:00
Andre Medeiros 6edb220d84 update reporting rate for API calls 2022-06-28 13:13:42 -04:00
Andre Medeiros 8fc0603735 add tags to api call metrics 2022-06-28 10:55:52 -04:00
André Medeiros d3c9e303ff Update api.go 2022-06-27 18:47:07 -04:00
Andre Medeiros 523dce6300 tweak pool 2022-06-27 10:36:01 -04:00
Andre Medeiros ad62000372 fix authenticated client call 2022-06-25 15:52:47 -04:00
Andre Medeiros 8ae426a4de do not prune accounts 2022-06-25 14:45:05 -04:00
Andre Medeiros 7234628428 add statsd to API responses 2022-06-25 14:12:56 -04:00
Andre Medeiros f4e5d7e979 bump connections again 2022-06-25 14:04:03 -04:00
Andre Medeiros aa92f1ec69 increase API connections 2022-06-25 14:01:03 -04:00
Andre Medeiros 6b7abe4eb0 fix nil pointer dereferrence on notification errors 2022-06-13 16:01:36 -04:00
Andre Medeiros fb01cf91bc stop notifying old server 2022-06-04 10:58:53 -04:00
Andre Medeiros 221de1d2b6 back to no singleton mode, now that we're stable 2022-06-04 10:29:33 -04:00
Andre Medeiros d243cebab6 better iteration 2022-06-04 10:24:22 -04:00
Andre Medeiros 084407a5f2 calculate batch size properly 2022-06-04 10:23:45 -04:00
Andre Medeiros b23a158471 parallelize scheduler better 2022-06-04 10:21:29 -04:00
Andre Medeiros b29f120eea always show media for subreddit requests 2022-05-30 14:22:21 -04:00
Andre Medeiros 6ece4c784a no singleton 2022-05-27 16:12:50 -04:00
Andre Medeiros 0938400dd7 Revert "try enqueue accounts in a loop instead" 
This reverts commit 9b5829f549.
 2022-05-27 15:02:57 -04:00
Andre Medeiros 01ad9f3d1e Revert "another experiment for scheduling" 
This reverts commit c8dd76e1ab.
 2022-05-27 15:02:47 -04:00
Andre Medeiros f7516a06b3 Revert "Mark account as seen" 
This reverts commit ac72c979a6.
 2022-05-27 15:02:39 -04:00
Andre Medeiros ac72c979a6 Mark account as seen 2022-05-27 14:58:41 -04:00
Andre Medeiros c8dd76e1ab another experiment for scheduling 2022-05-27 14:55:59 -04:00
Andre Medeiros 9b5829f549 try enqueue accounts in a loop instead 2022-05-27 14:47:59 -04:00
Andre Medeiros fb3f2d1433 more scheduler tweaks 2022-05-27 14:40:40 -04:00
Andre Medeiros 356402d631 Revert "tweak scheduler" 
This reverts commit 38fef3c852.
 2022-05-27 14:39:12 -04:00
Andre Medeiros 38fef3c852 tweak scheduler 2022-05-27 14:33:46 -04:00
Andre Medeiros eb853710c4 Add profiling to scheduler 2022-05-27 13:27:28 -04:00
Andre Medeiros dc9f42de8b be less noisy again 2022-05-27 09:51:59 -04:00
Andre Medeiros 80438dc1e2 fix median calculation by forcing a limit 2022-05-27 09:37:25 -04:00
Andre Medeiros f0353399e8 Revert "Don't log post titles anymore" 
This reverts commit e9a2f5b745.
 2022-05-27 09:22:04 -04:00
Andre Medeiros 2111cb4be6 Revert "Make median score log debug level" 
This reverts commit c3f7982882.
 2022-05-27 09:21:56 -04:00
Andre Medeiros c3f7982882 Make median score log debug level 2022-05-26 18:58:53 -04:00
Andre Medeiros e9a2f5b745 Don't log post titles anymore 2022-05-26 18:58:12 -04:00
Andre Medeiros d8bd6dfb37 show all to avoid hidden posts 2022-05-26 18:56:53 -04:00
Andre Medeiros be343deab8 try logging posts differently 2022-05-26 18:44:07 -04:00
Andre Medeiros e7faf73834 sort scores 2022-05-26 18:17:49 -04:00
André Medeiros 8dc4ac350e omg fix watchers and subreddit things (#79) 
* omg fix watchers and subreddit things

* don't send thumbnails for posts that are over 18
 2022-05-26 17:54:02 -04:00
Andre Medeiros 7da47176a2 Revert "token refresh mechanism" 
This reverts commit df96aaa768.
 2022-05-25 20:17:03 -04:00
Andre Medeiros df96aaa768 token refresh mechanism 2022-05-25 20:12:54 -04:00
Andre Medeiros 47a0aa47dd add logging for things 2022-05-25 19:55:51 -04:00
Andre Medeiros 5ede5d6987 more breahing room with tokens 2022-05-25 19:49:14 -04:00
Andre Medeiros 4f34e3927b add a bit of breathing room for token refresh 2022-05-25 19:44:29 -04:00
Andre Medeiros ca8fc6e991 tighten authenticated client params 2022-05-25 19:28:41 -04:00
Andre Medeiros dc54bb76df try referencing client instead of embedding 2022-05-25 19:22:05 -04:00
André Medeiros f018af7c73 Log post score 2022-05-25 16:05:49 -04:00
André Medeiros 3a5e504ba7 Update trending.go 2022-05-25 15:57:55 -04:00
Christian Selig ea9af069e8 Fix issue with not allow non-autorenewing subs 2022-05-24 21:58:28 -03:00
Andre Medeiros 571c6d60eb don't change account next notification check at, the scheduler does this for us 2022-05-23 19:47:48 -04:00
Andre Medeiros bbb3001544 tweak on receipt check 2022-05-23 19:05:31 -04:00
Andre Medeiros 079cc9a5c5 better variable name 2022-05-23 18:54:38 -04:00
Andre Medeiros 34e050daad tweak scheduler 2022-05-23 18:51:30 -04:00
Andre Medeiros b1ed5fb71a Revert "optimize scheduler to reduce memory allocations" 
This reverts commit f41dd925e4.
 2022-05-23 18:46:39 -04:00
Andre Medeiros f41dd925e4 optimize scheduler to reduce memory allocations 2022-05-23 18:43:53 -04:00
Andre Medeiros b6c7c58062 revert client change 2022-05-23 17:41:19 -04:00
Andre Medeiros 17c503e0e3 don't retry on 403 2022-05-23 17:37:51 -04:00
Andre Medeiros 5fa9bfaa45 distinguish between 401 and 403 2022-05-23 17:26:40 -04:00
Andre Medeiros be926f9118 calculate next check properly 2022-05-23 16:50:51 -04:00
Andre Medeiros bb3b4807ff add a bit more messaging to errors in account upsert 2022-05-23 16:27:38 -04:00
Andre Medeiros 1fca733818 typos-- 2022-05-23 15:15:46 -04:00
Andre Medeiros bcce102388 more logging things 2022-05-23 14:29:15 -04:00
Andre Medeiros ff9e32ef20 tweak logger verbosity 2022-05-23 14:20:45 -04:00
André Medeiros b1f266bf91 migrate out of logrus (#76) 2022-05-23 14:17:25 -04:00
Andre Medeiros ccba530255 fix tests 2022-05-23 11:51:22 -04:00
Andre Medeiros ef3f3ff18b fix error handling on postgres repositories 2022-05-23 11:49:48 -04:00
Andre Medeiros c35ec006f1 simplify reddit error handling 2022-05-23 11:33:15 -04:00
Andre Medeiros 6f8f93f3ab reduce account updates by half 2022-05-22 19:57:29 -04:00
Andre Medeiros b92e3fc374 tweak scheduler 2022-05-22 19:35:03 -04:00
Andre Medeiros fc94bef379 optimize queries 2022-05-21 17:15:24 -04:00
Andre Medeiros 413b46631c chill with the poll 2022-05-21 13:17:04 -04:00
Andre Medeiros 09d5457436 fix migrations 2022-05-21 13:08:30 -04:00
Andre Medeiros f6f13bbd2f Allow editing watcher subreddits too 2022-05-21 10:26:23 -04:00
Andre Medeiros 0afa10d64d HTTP code updates 2022-05-21 10:00:21 -04:00
Andre Medeiros 17a37a3b01 Fix test notification 2022-05-21 09:46:12 -04:00
Andre Medeiros adbaeb9e54 Tweak stuck notifications a bit mroe 2022-05-19 13:02:16 -04:00
Andre Medeiros af592c446f Fix watcher list endpoint 2022-05-19 12:43:37 -04:00
Andre Medeiros 8c5422af20 edge case for stuck notifications 2022-05-19 12:37:03 -04:00
Andre Medeiros cc6e862ba6 be less noisy about rate limits 2022-05-19 11:51:56 -04:00
Andre Medeiros 527552eb6d Use raw_json on all reddit calls 2022-05-17 17:36:59 -04:00
Andre Medeiros 6cfdc1ba74 Tweak username length 2022-05-13 10:29:09 -04:00
Andre Medeiros 69a9101499 Fix Subreddit length 2022-05-13 10:27:56 -04:00
Andre Medeiros 1919b36f57 fix subreddit watchers for 2 letter subreddits 2022-05-12 16:23:16 -04:00
Andre Medeiros 132374fb6b freaking sql types 2022-05-08 21:02:59 -04:00
Andre Medeiros 3803fea055 fix watcher creation 2022-05-08 20:56:04 -04:00
Andre Medeiros bc80526251 Send JSON body, not URL param 2022-05-07 19:30:07 -04:00
Andre Medeiros b55b52bf2c tweak a bit more 2022-05-07 15:16:04 -04:00
Andre Medeiros ebe7437bfa log errors on API 2022-05-07 15:10:57 -04:00
Andre Medeiros 10d2e77c4f use request context 2022-05-07 15:04:35 -04:00
Andre Medeiros b001a51a30 return after error 2022-05-07 13:38:23 -04:00
Andre Medeiros eaf6a707ca fix bugsnag exception 2022-05-07 13:38:04 -04:00
Andre Medeiros 5e2a846bc1 Fix header for old API 2022-05-07 13:36:23 -04:00
Andre Medeiros f8b6c062e8 Revert "Don't lowcase subreddits" 
This reverts commit b7e5d3860c.
 2022-05-07 13:31:52 -04:00
Andre Medeiros b7e5d3860c Don't lowcase subreddits 2022-05-07 13:30:05 -04:00
Andre Medeiros fe8baf7989 make watcher keywords more flexible 2022-05-07 13:22:06 -04:00
Andre Medeiros 53a4bbee25 Avoid Sandbox things 2022-05-07 13:01:57 -04:00
Andre Medeiros 596636ee60 formatting 2022-05-07 12:57:14 -04:00
Andre Medeiros a42ddbeeb3 add notification test endpoints 2022-05-07 12:53:42 -04:00
André Medeiros f9b9c595cf Better testing (#62) 
* some tests

* more tests

* tidy up go.mod

* more tests

* add postgres

* beep

* again

* Set up schema

* fix device test
 2022-05-07 12:37:21 -04:00
Andre Medeiros 17019cecfb fix grace period expiry check 2022-05-07 12:05:47 -04:00
André Medeiros a94aa11845 Merge pull request #66 from christianselig/chore/schema-changes 
Changes to schema
 2022-05-07 11:52:52 -04:00
Andre Medeiros 4fad10bade fix tests 2022-05-07 11:51:56 -04:00