RoundSparrow @ .ee@lemm.eeBanned from community · 2 years agoRedis, Memcached, dragonfly for Lemmy and 2010 presentation on scaling....plus-squaremessage-squaremessage-square2linkfedilinkarrow-up19arrow-down10
arrow-up19arrow-down1message-squareRedis, Memcached, dragonfly for Lemmy and 2010 presentation on scaling....plus-squareRoundSparrow @ .ee@lemm.eeBanned from community · 2 years agomessage-square2linkfedilink
RoundSparrow@lemmy.mlBannedM · 2 years agopost inclusion, a solid WHERE clause filter before any JOIN on SELECT post (listing of posts)message-squaremessage-square20linkfedilinkarrow-up14arrow-down10
arrow-up14arrow-down1message-squarepost inclusion, a solid WHERE clause filter before any JOIN on SELECT post (listing of posts)RoundSparrow@lemmy.mlBannedM · 2 years agomessage-square20linkfedilink
RoundSparrow @ BT@bulletintree.comM · 2 years agolemmy Server Performance backwards from PostgreSQL data to Rust code and TRIGGER FUNCTION logic, listed observationsplus-squaremessage-squaremessage-square0linkfedilinkarrow-up16arrow-down11
arrow-up15arrow-down1message-squarelemmy Server Performance backwards from PostgreSQL data to Rust code and TRIGGER FUNCTION logic, listed observationsplus-squareRoundSparrow @ BT@bulletintree.comM · 2 years agomessage-square0linkfedilink
RoundSparrow@lemmy.mlBannedM · edit-22 years agoLemmy Server Performance, PostgreSQL log_min_duration_statement - can big servers share logs? value 2500ms targeting "slow queries"plus-squaremessage-squaremessage-square1linkfedilinkarrow-up14arrow-down10
arrow-up14arrow-down1message-squareLemmy Server Performance, PostgreSQL log_min_duration_statement - can big servers share logs? value 2500ms targeting "slow queries"plus-squareRoundSparrow@lemmy.mlBannedM · edit-22 years agomessage-square1linkfedilink
RoundSparrow@lemmy.mlBannedM · edit-22 years agoCode to Stress Test Lemmy for performanceplus-squaremessage-squaremessage-square3linkfedilinkarrow-up112arrow-down11
arrow-up111arrow-down1message-squareCode to Stress Test Lemmy for performanceplus-squareRoundSparrow@lemmy.mlBannedM · edit-22 years agomessage-square3linkfedilink
RoundSparrow@lemmy.mlBannedM · edit-22 years agoHow lemmy.ca took on finding why PostgreSQL was at 100% CPU and crashing the Lemmy website this past weekend. PostgreSQL auto_explainplus-squaremessage-squaremessage-square6linkfedilinkarrow-up127arrow-down10
arrow-up127arrow-down1message-squareHow lemmy.ca took on finding why PostgreSQL was at 100% CPU and crashing the Lemmy website this past weekend. PostgreSQL auto_explainplus-squareRoundSparrow@lemmy.mlBannedM · edit-22 years agomessage-square6linkfedilink
RoundSparrow@lemmy.mlBannedM · 2 years agoLemmy Server optimization of PostgreSQL by focusing on community ownership of a post - and visibility of a post in a single control field. Also local flag transition to instance_id field, with value 1plus-squaremessage-squaremessage-square3linkfedilinkarrow-up13arrow-down10
arrow-up13arrow-down1message-squareLemmy Server optimization of PostgreSQL by focusing on community ownership of a post - and visibility of a post in a single control field. Also local flag transition to instance_id field, with value 1plus-squareRoundSparrow@lemmy.mlBannedM · 2 years agomessage-square3linkfedilink
RoundSparrow@lemmy.mlBannedM · edit-22 years agoLemmy Server Performance - is this Rust code reading the entire table of all site languages? Does it need to?plus-squaremessage-squaremessage-square1linkfedilinkarrow-up17arrow-down11
arrow-up16arrow-down1message-squareLemmy Server Performance - is this Rust code reading the entire table of all site languages? Does it need to?plus-squareRoundSparrow@lemmy.mlBannedM · edit-22 years agomessage-square1linkfedilink
RoundSparrow@lemmy.mlBannedM · edit-22 years agoLemmy Server Performance, two birds with one stone, mass deletes of content: Account Delete, Community Delete, User Ban - moving these operations to a linear queue and add undo support / grace periodplus-squaremessage-squaremessage-square8linkfedilinkarrow-up118arrow-down10
arrow-up118arrow-down1message-squareLemmy Server Performance, two birds with one stone, mass deletes of content: Account Delete, Community Delete, User Ban - moving these operations to a linear queue and add undo support / grace periodplus-squareRoundSparrow@lemmy.mlBannedM · edit-22 years agomessage-square8linkfedilink
RoundSparrow@lemmy.mlBannedM · edit-22 years agoLemmy Server and language choices on every individual comment, many rows in the database per-community, per-site, etc. Overheard of a comment INSERT SQLplus-squaremessage-squaremessage-square8linkfedilinkarrow-up18arrow-down11
arrow-up17arrow-down1message-squareLemmy Server and language choices on every individual comment, many rows in the database per-community, per-site, etc. Overheard of a comment INSERT SQLplus-squareRoundSparrow@lemmy.mlBannedM · edit-22 years agomessage-square8linkfedilink
RoundSparrow@lemmy.mlBannedM · edit-22 years agoREQUEST community review of Lemmy Server Performance on Post Votes, Comment Votes - the most frequent database writes. Optimize?plus-squaremessage-squaremessage-square2linkfedilinkarrow-up17arrow-down10
arrow-up17arrow-down1message-squareREQUEST community review of Lemmy Server Performance on Post Votes, Comment Votes - the most frequent database writes. Optimize?plus-squareRoundSparrow@lemmy.mlBannedM · edit-22 years agomessage-square2linkfedilink
RoundSparrow@lemmy.mlBannedM · edit-22 years agoGREAT NEWS about Lemmy Server Performance, another major SQL mistake has been discovered today: every single comment & post create (INSERT) is updating ~1700 rows in the site_aggregates tableplus-squaremessage-squaremessage-square32linkfedilinkarrow-up1242arrow-down12
arrow-up1240arrow-down1message-squareGREAT NEWS about Lemmy Server Performance, another major SQL mistake has been discovered today: every single comment & post create (INSERT) is updating ~1700 rows in the site_aggregates tableplus-squareRoundSparrow@lemmy.mlBannedM · edit-22 years agomessage-square32linkfedilink
RoundSparrow@lemmy.mlBannedM · 2 years agoLemmy scaling/performance: Move expensive PostgreSQL triggers to scheduled jobs. · GitHub Issue #3528 · LemmyNet/lemmyplus-squaregithub.comexternal-linkmessage-square2linkfedilinkarrow-up18arrow-down10
arrow-up18arrow-down1external-linkLemmy scaling/performance: Move expensive PostgreSQL triggers to scheduled jobs. · GitHub Issue #3528 · LemmyNet/lemmyplus-squaregithub.comRoundSparrow@lemmy.mlBannedM · 2 years agomessage-square2linkfedilink
RoundSparrow@lemmy.mlBannedM · 2 years agoInformation Overload - Beehaw style - Beehawplus-squarebeehaw.orgexternal-linkmessage-square0linkfedilinkarrow-up18arrow-down10cross-posted to: lemmyperformance@lemmy.ml
arrow-up18arrow-down1external-linkInformation Overload - Beehaw style - Beehawplus-squarebeehaw.orgRoundSparrow@lemmy.mlBannedM · 2 years agomessage-square0linkfedilinkcross-posted to: lemmyperformance@lemmy.ml
RoundSparrow@lemmy.mlBannedM · 2 years agolemmy_server Rust code now exposes internal metrics via Prometheus endpointplus-squaregithub.comexternal-linkmessage-square1linkfedilinkarrow-up18arrow-down10
arrow-up18arrow-down1external-linklemmy_server Rust code now exposes internal metrics via Prometheus endpointplus-squaregithub.comRoundSparrow@lemmy.mlBannedM · 2 years agomessage-square1linkfedilink
RoundSparrow@lemmy.mlBannedM · edit-22 years agoBig Lemmy server lemmy.world has put into production critical performance fixes from a runaway SQL query identified by analyzing pg_stat_statements output - and greatly reduced their server overload!plus-squarelemmy.worldexternal-linkmessage-square7linkfedilinkarrow-up1140arrow-down12
arrow-up1138arrow-down1external-linkBig Lemmy server lemmy.world has put into production critical performance fixes from a runaway SQL query identified by analyzing pg_stat_statements output - and greatly reduced their server overload!plus-squarelemmy.worldRoundSparrow@lemmy.mlBannedM · edit-22 years agomessage-square7linkfedilink
DreadTowel@lemmy.worldEnglish · 2 years agoDe-facto memory leakplus-squaremessage-squaremessage-square11linkfedilinkarrow-up126arrow-down10
arrow-up126arrow-down1message-squareDe-facto memory leakplus-squareDreadTowel@lemmy.worldEnglish · 2 years agomessage-square11linkfedilink
RoundSparrow@lemmy.mlBannedM · 2 years agolemmy PERFORMANCE CRISIS: Rust code in pull requests is starting to use moka caching crateplus-squaremessage-squaremessage-square2linkfedilinkarrow-up11arrow-down10
arrow-up11arrow-down1message-squarelemmy PERFORMANCE CRISIS: Rust code in pull requests is starting to use moka caching crateplus-squareRoundSparrow@lemmy.mlBannedM · 2 years agomessage-square2linkfedilink
RoundSparrow@lemmy.mlBannedM · edit-22 years agoLemmy PERFORMANCE CRISIS: popular instances with many remote instances following big communities could stop federating outbound for Votes on comments/posts - code path identifiedplus-squaremessage-squaremessage-square6linkfedilinkarrow-up14arrow-down10
arrow-up14arrow-down1message-squareLemmy PERFORMANCE CRISIS: popular instances with many remote instances following big communities could stop federating outbound for Votes on comments/posts - code path identifiedplus-squareRoundSparrow@lemmy.mlBannedM · edit-22 years agomessage-square6linkfedilink
