--- Log opened jue ago 04 00:00:10 2022 00:29 < fikabot_> 💬 > <@tio:matrix.trom.tf> this was a day and a half ago I think, now I have: 00:29 < fikabot_> 💬 > 00:30 < fikabot_> 💬 > ``` 00:30 < fikabot_> 💬 > Message queues 00:30 < fikabot_> 💬 > 3149 - 131441 00:30 < fikabot_> 💬 > ``` 00:30 < fikabot_> 💬 > 00:30 < fikabot_> 💬 > some 20k less....maybe, who knows, in the following days/weeks it will drop significantly 00:30 < fikabot_> 💬 00:30 < fikabot_> 💬 more progress: 00:30 < fikabot_> 💬 00:30 < fikabot_> 💬 `121331` now. 10k more burned for the past 5-6 hours. thats great 01:48 < bAvatar> Tio have you activated the search for new contacts in the Admin panel (site config, somewhere at the lower end of the page)? 01:48 < bAvatar> Could be that some discovery process was _really_ "successful" 01:49 < bAvatar> and those newly discovered potentially contacts need to be processed 01:50 < fikabot_> 💬 https://matrix.org/_matrix/media/v1/download/matrix.trom.tf/gehcQuaZvgTouYyyRPyMfLmd 01:50 < fikabot_> 💬 thats the setting i have for many months now 01:50 < fikabot_> 💬 if you can see the image 01:51 < fikabot_> 💬 i suppose you use a bridge 01:51 < fikabot_> 💬 have to go is almost 7am here need some sleep 🙂 01:52 < fikabot_> 💬 btw it is burning down many of the Message queues - even since my last update some 2h ago it burned some 7k more 01:52 < fikabot_> 💬 so it seems like we are on the right track 01:53 < fikabot_> 💬 ok going now 01:53 < fikabot_> 💬 🙂 02:03 < bAvatar> sleep well 02:04 < bAvatar> ok, a 6days period for inquireies should not cause such an explosion of queued jobs. 08:55 < fikabot_> 💬 I don't think it was an explosion per se more a long time period of accumulating backloged work tasks exacerbated by those stalled Remove queries 09:26 < fikabot_> 💬 yeah i suspect that too 09:26 < fikabot_> 💬 88629 today. less digits 🙂 09:28 < fikabot_> 💬 Yay! 09:29 < fikabot_> 💬 when i see them in the hundreds then i can work on a github issue for the ynh package to tell them to switch to daemon from cron and all that. makes a ton of difference from my experience at least 09:31 < fikabot_> 💬 Unless you are staring at it you probably won't see it in the 100s. It'll just be zero at that point but I get where you are going :) 09:33 < fikabot_> 💬 i want to have them in the hundreds at least, to make sure 🙂 and for my own comfort of my mind 09:35 < fikabot_> 💬 Agreed 09:55 < bAvatar> interesting, for me the deamon did not work as well as the cron job does... fascinating :) 10:02 < fikabot_> 💬 I never had a throughput problem with the cron job (I only have two users on my system although the Twitter bridge makes for a lot of traffic). I hated the ten minute delay with getting posts federated etc. Daemon made it instantaneous 10:07 < fikabot_> 💬 so we have around 800 users and a ton of posts coming in and out. Plus Twitter connect, several RSS sources and so on. With cron it took some time to process them all. Like lately making a post took 20-30 minutes to be sent to "the world". Now it is instant with daemon and everything seems to work fantastically great 10:08 < fikabot_> 💬 I'm guessing fastlane is what makes that work happen too 10:08 < fikabot_> 💬 instantaneously I mean 10:08 < fikabot_> 💬 but damn yeah....computers and machines....I has an old electric scooter with just a simple controller and such, and I am repairing it for the past 6 months and at times it works, at times it doesn't....replaced parts....I am baffled like wtf is wrong with it hahah. so i think we have to accept that we dont fully understand these machines and at times they make no sense. what wor 10:08 < fikabot_> 💬 ks for me may not work for you 10:09 < fikabot_> 💬 but damn yeah....computers and machines....I have an old electric scooter with just a simple controller and such, and I am repairing it for the past 6 months and at times it works, at times it doesn't....replaced parts....I am baffled like wtf is wrong with it hahah. so i think we have to accept that we dont fully understand these machines and at times they make no sense. what wo 10:09 < fikabot_> 💬 rks for me may not work for you 10:09 < fikabot_> 💬 a friend applied the same changes Hank sent to me 10:09 < fikabot_> 💬 moved from cron to daemon 10:10 < fikabot_> 💬 worked great for like a day now is back on CPU 99% and more Message queues 10:10 < fikabot_> 💬 are they using MySQL or MariaDB? 10:10 < fikabot_> 💬 he uses the same exact ynh package 10:10 < fikabot_> 💬 as me 10:10 < fikabot_> 💬 even the same server setup... 10:11 < fikabot_> 💬 ah 10:11 < fikabot_> 💬 It could be the Ping stuff thrashing his DB 10:11 < fikabot_> 💬 but it may be this bug for him https://github.com/friendica/friendica/issues/11778 10:11 < fikabot_> 💬 i checked his processes and they look like this 10:12 < fikabot_> 💬 I sound like a broken record but we need to go through the documentation, wikis, etc. and make it clear MariaDB is the only option 10:12 < fikabot_> 💬 https://matrix.org/_matrix/media/v1/download/matrix.trom.tf/ufPIRpoWAbscYHTiEGuPSTjA 10:12 < fikabot_> 💬 > <@hank:myportal.social> I sound like a broken record but we need to go through the documentation, wikis, etc. and make it clear MariaDB is the only option 10:12 < fikabot_> 💬 10:12 < fikabot_> 💬 is it difficult to move to that? 10:12 < fikabot_> 💬 Tio: that bug is exactly the queries your system got stuck on 10:13 < fikabot_> 💬 but that is develop not stable 10:13 < fikabot_> 💬 yeah but neither me or him are using the develop... 10:13 < fikabot_> 💬 thats weird 10:14 < fikabot_> 💬 could be a data artifact which is causing older code to lose its mind too 10:14 < fikabot_> 💬 Moving to MariaDB for me was shutting the site down, doing a SQL dump, tearing down the MySQL server software, Standing up MariaDB server software, and importing the SQL dump into the new DB 10:14 < fikabot_> 💬 It took a while but the steps were pretty standard/easy 10:15 < fikabot_> 💬 I see....sounds a bit sketchy for my server that has a few hundreds of users 10:16 < fikabot_> 💬 but maybe eventually I could do it too 10:18 < fikabot_> 💬 Bigger problem is that all of that is managed by YunoHost software 10:18 < fikabot_> 💬 I'd be willing to bet that changing out that stuff underneath of it is not advised 10:19 < fikabot_> 💬 true 10:19 < fikabot_> 💬 but if things work ok with mysql then why change? 10:20 < fikabot_> 💬 is the difference that huge? 10:22 < fikabot_> 💬 The Ping query issue alone is huge enough on my system 10:22 < fikabot_> 💬 turning that back on produced higher load but not the system thrashing under MariaDB that I had under MySQL 10:23 < fikabot_> 💬 I couldn't even get the database migration to finish when upgrading to the latest version of FRiendica when it was backed by MySQL so I kind of had no choice but to try moving it to MariaDb first 10:23 < fikabot_> 💬 and then it worked 10:26 < fikabot_> 💬 I see 10:26 < fikabot_> 💬 for us things work great, until this last issue now 10:26 < fikabot_> 💬 but will see in the future is things will go bad 10:54 < fikabot_> 💬 Isn't YunoHost already using mariadb in place of mysql? https://github.com/YunoHost/yunohost/blob/140e50253fac0d3c9aa6fcab9e392a462c914e98/conf/yunohost/services.yml#L16 10:54 < fikabot_> 💬 https://github.com/YunoHost-Apps/friendica_ynh/blob/d6742c2cca77771b9fac07087fe873c1a1bd8f5c/manifest.json#L27 10:57 < fikabot_> 💬 hmm... 10:57 < fikabot_> 💬 i am entirely confused by this i know mariadb is backward comaptible with mysql since it is a fork of it 10:58 < fikabot_> 💬 https://matrix.org/_matrix/media/v1/download/matrix.trom.tf/wizFPqeKZlliQUplKrqrhFCy 10:58 < fikabot_> 💬 i only see mariadb in my system admin 10:58 < fikabot_> 💬 and friendica is one of the databases there 11:01 < fikabot_> 💬 it is using mysql proper though IIRC from yoru process list 11:02 < fikabot_> 💬 When you go into the mysql CLI tool does the prompt read something like `MariaDB [(none)]>`? 11:05 < fikabot_> 💬 The question is when did you install yunohost? Maybe they have transitioned sometime and didn't want to migrate the databases of users. 11:09 < fikabot_> 💬 > <@hank:myportal.social> When you go into the mysql CLI tool does the prompt read something like `MariaDB [(none)]>`? 11:09 < fikabot_> 💬 11:09 < fikabot_> 💬 am not sure what you mean by this if you can be more specific I can try 11:09 < fikabot_> 💬 > <@bkil:grin.hu> The question is when did you install yunohost? Maybe they have transitioned sometime and didn't want to migrate the databases of users. 11:09 < fikabot_> 💬 11:09 < fikabot_> 💬 more than a year ago 11:09 < fikabot_> 💬 holy crap, tehy are using develop branch in the install script?!?! https://github.com/YunoHost-Apps/friendica_ynh/blob/master/scripts/install 11:10 < fikabot_> 💬 Sorry link to the line https://github.com/YunoHost-Apps/friendica_ynh/blob/b9dc626390f76c240e5762fb4dc4b71870cfc278/scripts/install#L101 11:10 < fikabot_> 💬 hm thats the addons isnt it? 11:10 < fikabot_> 💬 https://github.com/friendica/friendica-addons.git 11:11 < fikabot_> 💬 oh yeah 11:11 < fikabot_> 💬 still not good maybe some addon is the issue with the latest friendica CPU usage... 11:11 < fikabot_> 💬 I thought we were supposed to keep the heads of both in sync 11:11 < fikabot_> 💬 `git clone --quiet https://github.com/friendica/friendica-addons.git -b develop "$final_path/addon"` 11:12 < fikabot_> 💬 they should use the stable i'll push a change to that 11:14 < fikabot_> 💬 so we have the stable friendica but our addons are from development!? 11:14 < fikabot_> 💬 interesting... 11:24 < fikabot_> 💬 I'd go into the directory and use git to confirm the git branch status 11:41 < bAvatar> the branches used for the addons and Friendica core have to be the same, they should never be mixed 11:47 < bAvatar> how often does YNH update the repositories? If it is only triggered when a new release was done, then in effect the develop and stable branch are the same and no harm would have been caused. _BUT_ it should be changed to the same branch for both anyhow 11:52 < fikabot_> 💬 yeah this is not ok 11:52 < fikabot_> 💬 thanks Hank for noticing 13:57 < fikabot_> 💬 ok ynh fixed it already 13:58 < fikabot_> 💬 and they told me that it would have pulled from stable anyway, the code later down the line, forced it to be from stable 13:58 < fikabot_> 💬 in any case 13:58 < fikabot_> 💬 is great that we collaborate like this and help each other 14:05 < fikabot_> 💬 > <@tio:matrix.trom.tf> is great that we collaborate like this and help each other 14:05 < fikabot_> 💬 14:05 < fikabot_> 💬 Absolutely! 14:33 < fikabot_> 💬 Friendica Daemon Systemd tutorial post is up: https://nequalsonelifestyle.com/2022/08/04/setting-up-friendica-daemon-systemd-service/ 14:59 < fikabot_> 💬 super great i will have a look later on today 14:59 < fikabot_> 💬 thx a lot 17:53 < fikabot_> 💬 going through the tutorial 17:53 < fikabot_> 💬 so you say `'pidfile' => '/run/friendica/daemon.pid',` but the PID is created in `'/run/friendica.pid',` 17:53 < fikabot_> 💬 i checked that's how it was created for me 17:53 < fikabot_> 💬 so not in a "friendica" fulder under "run" 17:53 < fikabot_> 💬 so not in a "friendica" folder under "run" 17:53 < fikabot_> 💬 it must have serialized a value to your database settings 17:54 < fikabot_> 💬 ah well thats what you told me to do so it works anyway, ok continue readin 17:54 < fikabot_> 💬 if that is the value in your local.config.php file 17:54 < fikabot_> 💬 > We are putting the PID file in a sub-directory because we are going to setup systemd to run the process as the www-data user. 17:54 < fikabot_> 💬 well it will stop working when you get to the part where you make the systemd service run as www-data 17:54 < fikabot_> 💬 at least I'm pretty sure it will 17:54 < fikabot_> 💬 you can double check by doing `sudo -u www-data` when you run it 17:55 < fikabot_> 💬 yeah i am redoing it the way you wrote the tutorial so that i also get that systemd working on reboot 17:55 < fikabot_> 💬 changing the path in the file should work 17:56 < fikabot_> 💬 it did on my system anyway 17:57 < fikabot_> 💬 so can i simply add that file to a directory then change the path from the config friendica file and will wokr? 17:57 < fikabot_> 💬 no 17:58 < fikabot_> 💬 change it in the config file and when the daemon process starts the next time it should have the new setting 17:59 < fikabot_> 💬 yup makes sense 18:06 < fikabot_> 💬 ``` 18:06 < fikabot_> 💬 friendica-daemon.service - Friendica daemon 18:06 < fikabot_> 💬 Loaded: loaded (/etc/systemd/system/friendica-daemon.service; disabled; vendo 18:06 < fikabot_> 💬 Active: active (running) since Thu 2022-08-04 23:05:59 CEST; 9s ago 18:07 < fikabot_> 💬 Main PID: 29270 (php) 18:07 < fikabot_> 💬 Tasks: 3 (limit: 4915) 18:07 < fikabot_> 💬 Memory: 79.9M 18:07 < fikabot_> 💬 CGroup: /system.slice/friendica-daemon.service 18:07 < fikabot_> 💬 ├─29270 /usr/bin/php ./bin/daemon.php start 18:07 < fikabot_> 💬 ├─29273 php bin/worker.php 18:07 < fikabot_> 💬 └─29286 php bin/worker.php --no_cron 18:07 < fikabot_> 💬 18:07 < fikabot_> 💬 Aug 04 23:05:59 server.trom.tf systemd[1]: Started Friendica daemon. 18:07 < fikabot_> 💬 ``` 18:08 < fikabot_> 💬 so far so good 18:08 < fikabot_> 💬 i got more output for this part tho 18:08 < fikabot_> 💬 all fine? 18:08 < fikabot_> 💬 i see you got no `php bin/worker.php --no_cron` 18:08 < fikabot_> 💬 in your example 18:12 < fikabot_> 💬 done it all 18:12 < fikabot_> 💬 server rebooted 18:12 < fikabot_> 💬 all seems to work fine 18:13 < fikabot_> 💬 such a great tutorial 18:13 < fikabot_> 💬 so on point 18:13 < fikabot_> 💬 thank you so much 18:17 < fikabot_> 💬 am saving your page with the tutorial just in case 😄 18:23 < fikabot_> 💬 Thanks! glad it worked --- Log closed vie ago 05 00:00:11 2022