#archlinux32 | Logs for 2019-03-15

[00:31:54] -!- AndrevS has quit [Remote host closed the connection]
[01:23:30] -!- MrBIOS has quit [Quit: MrBIOS]
[03:38:29] -!- jason0597 has quit [Ping timeout: 252 seconds]
[04:54:28] -!- DCyrax has quit [Remote host closed the connection]
[05:09:41] -!- DepositePirate has quit [Ping timeout: 256 seconds]
[05:15:21] -!- DepositePirate has joined #archlinux32
[06:37:57] -!- DCyrax has joined #archlinux32
[07:11:05] -!- oaken-source has joined #archlinux32
[07:29:04] -!- oaken-source has quit [Ping timeout: 246 seconds]
[07:32:29] -!- abaumann has joined #archlinux32
[07:32:54] <abaumann> KitsuWhooa: Postgresql would help. Mariadb and Mysql is basically the same..
[07:33:10] -!- abaumann has quit [Client Quit]
[07:38:57] -!- abaumann has joined #archlinux32
[07:47:30] -!- Cthulu201 has quit [Ping timeout: 246 seconds]
[07:48:37] <abaumann> ./sanity-check -w
[07:48:38] <abaumann> I could not complete a mysql query!
[07:48:49] <abaumann> did a mysql -u root -p < database-2019-03-14-13\:50\:36
[07:49:30] <abaumann> aha ERROR 1045 (28000): Access denied for user 'buildmaster'@'localhost' (using password: YES)
[07:49:31] -!- Cthulu201 has joined #archlinux32
[07:49:42] <abaumann> So, where is this password stored?
[07:53:43] -!- oaken-source has joined #archlinux32
[07:57:27] <abaumann> ah. there is ~/.mysql_history
[08:03:28] <abaumann> so, that password was also wrong.. sorry, I cannot do anything if I lack half the credentials of half of the services..
[08:03:30] -!- abaumann has quit [Quit: leaving]
[08:04:49] <KitsuWhooa> abaumann you can start mysql with arguments to override the root password and then log in and set one for the buildmaster account, or make another temporary account
[08:05:29] <KitsuWhooa> and I wouldn't call them basically the same. Last I checked, MariaDB definitely had some improvements, but I haven't checked in a while. Been running it on websites 24/7 with no crashes, but it's obviously a personal experience, sooo
[08:08:18] -!- abaumann has joined #archlinux32
[08:08:27] <abaumann> KitsuWhooa: I know that. I'm working in IT. :->
[08:08:39] <KitsuWhooa> Ah, fair enough, sorry.
[08:08:44] <abaumann> This also means, I never, ever use Mysql, as it is not a stable database..
[08:08:52] <abaumann> ..implementing anything from the SQL standard correctly.
[08:08:58] <abaumann> it doesn't scale properly.
[08:09:08] <abaumann> it sacrifices ACID properties just to be a tad faster.
[08:09:24] <abaumann> It's good to manage 100 users in a web application, but to be frank, sqlite3 is better suited for that.
[08:10:10] <abaumann> From that point of view: it's good Oracle bought that thing. Imagine, the better database Postgresql would have been bought by Oracle. :->
[08:10:27] <KitsuWhooa> hah
[08:10:29] <abaumann> Also an experience of 25 years in IT: everything Oracle buys, gets destroyed.
[08:10:48] <abaumann> sorry. daily nervous rant about the state of the IT nation :-)
[08:11:19] <abaumann> the buildmaster insists to use a password for the 'buildmaster' user. But I fail to find any password set in the buildmaster scripts or config.
[08:13:20] <abaumann> so, mysql -u buildmaster -p buildmaster works, with the password I found in the .mysql-history file
[08:13:38] <abaumann> let's get for passwords on the machine. :->
[08:15:37] <abaumann> *grep
[08:17:31] -!- deep42thought has joined #archlinux32
[08:17:39] <abaumann> hi deep42thought
[08:17:50] <deep42thought> Hi abaumann!
[08:17:56] <deep42thought> let me dig through the log ...
[08:18:04] <abaumann> .. oho. :-)
[08:18:09] <abaumann> rants, mainly. :-)
[08:18:23] <deep42thought> the buildmaster looks clean - I didn't expect that :-)
[08:18:58] <deep42thought> I like to read the rants :-D
[08:19:43] <abaumann> Naeh. sanity-check threw errors about not being able to log in as buildmaster to mysql
[08:22:06] -!- buildmaster has joined #archlinux32
[08:22:40] <abaumann> hah. here he is. :-)
[08:22:50] <abaumann> buildmaster: hi, how are you?
[08:23:42] <deep42thought> KitsuWhooa: we _are_ running mariadb
[08:23:49] <deep42thought> (it's the default mysql implementation of arch)
[08:23:55] <KitsuWhooa> oh lol, I see
[08:24:00] <deep42thought> buildmaster: what's up?
[08:24:00] <buildmaster> up? I'm up for 16 hours, 20 minutes, load average: 0.95, 0.46, 0.28 ... and I'm insane :-D
[08:24:07] <deep42thought> buildmaster: say something funny!
[08:24:09] <deep42thought> hey!
[08:24:38] <deep42thought> buildmaster: say something random!
[08:24:38] <buildmaster> deep42thought: stchig
[08:24:43] <deep42thought> thx, buildmaster
[08:24:43] <buildmaster> np, deep42thought
[08:24:51] <abaumann> ui. errors inbound.
[08:24:55] <deep42thought> \o/
[08:25:12] <abaumann> https://buildmaster.archlinux32.org
[08:25:12] * deep42thought considers running `rm -rf /mnt/archlinux32`
[08:25:13] <phrik> Title: sanity of the buildmaster's mysql database (at buildmaster.archlinux32.org)
[08:25:33] <abaumann> db and mirror packages out of sync. to be expected.
[08:25:47] <abaumann> https://buildmaster.archlinux32.org
[08:25:48] <phrik> Title: result of archlinux32 build master's sanity checksanity of the buildmaster's mysql database (at buildmaster.archlinux32.org)
[08:25:59] <abaumann> >> ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/run/mysqld/mysqld.sock' (111)
[08:26:08] <abaumann> I don't like those errors.
[08:26:15] <deep42thought> yeah, the second one mostly copies the errors of the first
[08:26:23] <deep42thought> that error simply means, mysqld was not running
[08:26:28] <deep42thought> or not answering
[08:26:29] <abaumann> at least, there are no coredumps anymore. it seems.
[08:26:43] <deep42thought> we improved the type of crash?
[08:26:50] <abaumann> coredumpctl list
[08:26:50] <abaumann> No coredumps found.
[08:27:02] <abaumann> so, at least technically the database data seems to be sane.
[08:27:14] <abaumann> I would love to know, why this happened.
[08:27:26] <abaumann> A database loosing the data in such a brutal way is either a bad database..
[08:27:33] <abaumann> ..or something is wrong with the machine..
[08:27:45] <KitsuWhooa> memtest86+? :p
[08:27:54] <abaumann> it's a virtual machine. :-)
[08:28:06] <KitsuWhooa> Ah
[08:28:13] <abaumann> btw. we are not using this tmpfs thing for mysql data anymore, I hope.
[08:28:27] <abaumann> so, all data is really stored 100% in /var/lib/mysql
[08:29:59] -!- oaken-source has quit [Ping timeout: 252 seconds]
[08:32:57] -!- jason0597 has joined #archlinux32
[08:49:31] <abaumann> wow. quite a mess..
[08:49:42] <deep42thought> I'm on in
[08:49:43] <deep42thought> *it
[08:49:59] <abaumann> I thought so. :-)
[08:50:08] <abaumann> you fell so silent suddenly.
[08:50:24] <deep42thought> :-D
[08:50:34] <deep42thought> I warmed up by writing an angry mail to my ISP
[08:50:35] <abaumann> I'm sorry, but I tried yesterday to create a database dump, but when even mysqld is segfaulting on starting up..
[08:50:47] <abaumann> because of you internet connection.
[08:50:48] <deep42thought> np
[08:50:52] <deep42thought> yeah
[08:50:52] <abaumann> you are in Germandy.
[08:50:57] <abaumann> *Germany
[08:51:01] <deep42thought> so?
[08:51:05] <abaumann> the land of fast internet and good ISPs.. :->
[08:51:10] <deep42thought> LOL
[08:53:04] <deep42thought> the land of ISPs that try to sell you a bigger connection instead of helping in restoring your original one
[08:53:27] <abaumann> ah, that's customer service.
[08:53:40] <abaumann> your land line was too old, that's why it burned. ;-)
[08:53:59] <deep42thought> it was too slow - they don't offer that speed anymore, so they rounded down to 0
[08:54:22] <abaumann> !grab deep42thought
[08:54:23] <phrik> abaumann: Tada!
[08:54:23] <abaumann> LOL
[08:58:10] <deep42thought> oops, firefox is now in [core] according to the db :-D
[08:59:18] <abaumann> urgh..
[09:03:59] <deep42thought> which dump did you use?
[09:04:09] <deep42thought> (I need to re-bootstrap the web server(s), too)
[09:05:07] <abaumann> database-2019-03-14-13:50:36
[09:05:24] <deep42thought> thx
[09:05:25] <abaumann> it was the last one not bein 32 bytes big.
[09:05:31] <deep42thought> :-D
[09:05:40] <abaumann> and it looked reasonably ok to me.
[09:05:54] <abaumann> during import there was no error, but mysql is not very keen on reporting errors..
[09:14:38] <deep42thought> Access denied for user 'replikat'@'localhost' (using password: YES)
[09:14:40] <deep42thought> hmmm
[09:26:43] * buildmaster resumes sanity.
[09:28:01] <deep42thought> \o/
[09:28:54] <abaumann> buildmaster: hi there. :-)
[09:29:56] <buildmaster> Hi, abaumann!
[09:30:09] <buildmaster> nice to be sane, again
[09:32:03] <abaumann> LOL
[09:32:28] <deep42thought> oh, you short-circuted /usr/bin/dbsnapshot ...
[09:34:34] <abaumann> aeh. yes.
[09:34:36] <abaumann> sorry.
[09:34:53] <abaumann> fixed.
[09:35:16] <abaumann> it was faster to put an 'exit 0' there.. :-)
[09:35:21] <deep42thought> yeah, sure
[09:35:37] <deep42thought> the mysqldump user is currently missing
[09:37:22] <abaumann> unix user?
[09:37:27] <abaumann> I didn't change anything there..
[09:37:46] <deep42thought> mysql
[09:37:48] <deep42thought> user
[09:38:02] <deep42thought> the dump uses its own user
[09:38:05] <deep42thought> which is currently missing
[09:38:06] <abaumann> ah.
[09:38:20] <deep42thought> I pm'ed you the credentials
[10:25:23] <abaumann> https://status.archlinux32.org 502 Bad Gateway and https://archlinux32.org 504 Gateway Time-out
[10:25:28] <abaumann> is this on tyzoid's side?
[10:26:52] <deep42thought> first is uptimerobot
[10:26:59] <deep42thought> second is on polichronucci's server
[10:27:04] <abaumann> oh.
[10:50:31] * buildmaster failed to execute a mysql query - can you have a look at "tmp.mysql-functions.query.2019-03-15T09:48:06.TPlQGS.stdin"?.
[10:50:58] -!- thePiGrepper has joined #archlinux32
[10:55:18] <abaumann> ERROR 1305 (42000) at line 3: PROCEDURE buildmaster.blacklist_packages does not exist
[10:55:27] <deep42thought> I'm working on it
[10:55:37] <abaumann> aha. that one I saw in the create database script
[10:55:51] <deep42thought> I ran bootstrap-mysql -no-privileges to bootstrap all stored functions
[10:55:53] <abaumann> I thought, stored procedures are backuped?
[10:55:54] <deep42thought> looks good so far
[10:56:00] <abaumann> ok.
[10:56:03] <deep42thought> I thought so, too
[10:56:09] <deep42thought> but otoh also users were not backed up :-/
[10:56:31] <deep42thought> ok, the query succeeded, now
[10:56:55] <abaumann> don't trust mysql to store more in a dump than plain tables, prefereable with no cyclic dependencies :->
[10:57:29] <deep42thought> there is a dump in misc/database.dump, created by check-db-structure
[10:57:37] <deep42thought> we should verify, that this is sane
[10:57:45] <deep42thought> (this also contains the stored procedures)
[10:57:55] <deep42thought> but it's not intended for restoring from that dump
[10:58:39] <abaumann> ah. this is just a dump from older times and can be used to restore some of the missing artifacts. ok.
[10:58:52] <deep42thought> yes, this is stuff that should stay constant
[10:58:58] <deep42thought> e.g. available architectures
[10:59:03] <deep42thought> storet functions
[10:59:03] <abaumann> BTW: I currently have a lot of fun restoring the reputation of my private mail server.
[10:59:05] <deep42thought> repositories, etc.
[10:59:10] <abaumann> had an open relay *abaumann blushes*
[10:59:18] <deep42thought> I know how that feels
[10:59:27] <Vollzornbrot> All work and no play makes Vollzornbrot a dull boy!
[10:59:36] <deep42thought> !grab Vollzornbrot
[10:59:38] <phrik> deep42thought: Tada!
[10:59:39] <abaumann> hi Vollzornbrot
[10:59:42] <Vollzornbrot> *drop*
[10:59:45] <deep42thought> hi Vollzornbrot
[10:59:50] <Vollzornbrot> hey, all fine?
[11:00:06] <abaumann> sort of.. not.. :-)
[11:00:09] <deep42thought> yeah, we build up some hate against mysql/mariadb, but besides that: all fine
[11:00:25] <abaumann> :-)
[11:00:38] * buildmaster resumes sanity.
[11:00:39] <Vollzornbrot> mysql / mariadb is the best, but anyways you can use mongodb xD
[11:01:00] <deep42thought> we could go back one step and use the text files we had before :-D
[11:01:12] <abaumann> they don't corrupt so easily. ;-)
[11:01:25] <Vollzornbrot> mongodb is for ... dumbs?!
[11:01:26] <deep42thought> well, actually they do
[11:01:40] <Vollzornbrot> i use mariadb for the last 3 years, no problem
[11:01:51] <deep42thought> you just need to mix up some columns and merge on the wrong one and *tadaa* your table is empty :-D
[11:01:59] <deep42thought> Vollzornbrot: how many rows?
[11:02:04] <deep42thought> how complex queries?
[11:02:12] <Vollzornbrot> my db is ~22GB
[11:02:19] <deep42thought> hmm
[11:02:28] <abaumann> ah. ok.
[11:02:31] <deep42thought> maybe we should optimize my/the queries, then
[11:02:33] <abaumann> du -hs /var/lib/mysql/
[11:02:33] <abaumann> 1.7G /var/lib/mysql/
[11:02:48] <deep42thought> yeah, but some queries are intrinsically complex
[11:03:00] <deep42thought> e.g. "can I move package x without breaking anything?"
[11:03:27] <abaumann> the complexity is not really a problem.
[11:03:43] <deep42thought> well, some queries take several minutes to complete
[11:03:48] <abaumann> what worries me really is: why can mysqld corrypt the data in such ways, that restarting mysqld results in internal coredumps..
[11:03:50] <deep42thought> sounds like a problem to me
[11:04:03] <deep42thought> ah, well another thing, yeah
[11:04:18] <abaumann> complex queries last long or use a lot of ram or I/O.
[11:04:24] <abaumann> this can be EXPLAINed. :-)
[11:04:30] <deep42thought> yeah, right
[11:04:50] <abaumann> *abaumann regrets the terrible punt about EXPLAIN SQL statement..
[11:05:11] * deep42thought didn't notice anything - thanks for the hint :-)
[11:05:51] <deep42thought> what filesystem is on the buildmaster, anyways?
[11:06:06] <deep42thought> maybe some btrfs feature, that collides with mysqld i/o optimization?
[11:06:45] <deep42thought> ah, no: set up by an old-schooler: all ext4 :-D
[11:07:18] <abaumann> nope. all ext4. :-)
[11:07:32] <abaumann> database and swap and brtfs?
[11:07:45] <deep42thought> hmm?
[11:07:48] <abaumann> they are naturally not best friends. :-)
[11:08:16] <abaumann> newest kernels have some support for swap on btrfs?
[11:08:26] <abaumann> sounds weird to me. why not just have a swap partition..
[11:08:44] <abaumann> *abaumann coughs nervously, seeing a /data/swap none swap on the buildmaster..
[11:09:10] <abaumann> a swap on non-SSD.
[11:09:12] <abaumann> well.. :-)
[11:09:26] <abaumann> let's hope, it never gets used..
[11:09:27] <deep42thought> windows suggests swap on external usb sticks :-)
[11:09:34] <abaumann> !grab deep42thought
[11:09:35] <phrik> abaumann: Tada!
[11:09:36] <abaumann> LOL
[11:09:47] <deep42thought> sad thing: it really does ...
[11:10:06] <abaumann> can I suggest a RAID0 on external USB sticks?
[11:10:12] <deep42thought> or at least it did, when I last checked - which was in the windows vista era
[11:10:38] <deep42thought> well, I can create a useful scenario for raid0 on external usb sticks
[11:10:43] <abaumann> must be back in a time, when USB sticks already existsed and where actually faster than hard disk drives..
[11:10:57] <deep42thought> were they ever faster?
[11:11:10] <abaumann> there was a famous youtube video, IIRK from the 8-bit guy
[11:11:16] <abaumann> doing a RAID on USB sticks..
[11:11:44] <deep42thought> I have a raid1 on usb-sticks
[11:11:47] <deep42thought> in my eeepc
[11:11:59] <abaumann> well. that's not the worst idea, acutally.. :-)
[11:12:16] <deep42thought> yeah, it currently runs only on one stick, because the other is gone :-/
[11:12:29] <abaumann> mission of RAID1 accomplished :-)
[11:12:32] <abaumann> https://status.archlinux32.org is up again
[11:12:37] <Vollzornbrot> so now is all over!
[11:13:04] <Vollzornbrot> i think i spider
[11:13:28] <Vollzornbrot> i have on my backup storage 174,95 TB used...
[11:13:41] <deep42thought> :-D
[11:13:41] <buildmaster> i686/qcad is broken (says nlopc46).
[11:13:56] <deep42thought> thanks Vollzornbrot, then I don't feel so bad to have used 225TB
[11:13:56] <Vollzornbrot> deep42thought: from you VMs everyday a backup... lolz
[11:14:02] <deep42thought> O.o
[11:14:02] <deep42thought> oh
[11:14:06] * deep42thought feels bad again
[11:14:29] <Vollzornbrot> why? :D
[11:14:48] <Vollzornbrot> ROFL everyday sience 78days oO
[11:14:54] <Vollzornbrot> holy crab
[11:15:34] <Vollzornbrot> is a good idea to delete the old versions?
[11:15:50] <deep42thought> yeah
[11:16:11] * Vollzornbrot is deleting 84 TB of VM backups
[11:16:13] <deep42thought> everything older than a week is worthless
[11:16:49] <Vollzornbrot> renaming time ~19h 7m 19s
[11:17:40] <abaumann> there can also be too much backup.. :-)
[11:17:50] <Vollzornbrot> only a little :>
[11:18:00] <abaumann> 119G /data/borg/
[11:18:07] <Vollzornbrot> i have backups from my website ~2006 :D
[11:18:07] <abaumann> from the buildmaster, on my borg backup.
[11:18:12] <deep42thought> umm
[11:18:26] <abaumann> it's a 4 TB disk, so no sweat. :-)
[11:18:31] <Vollzornbrot> but i have no php4.1 installation anymore :D
[11:19:10] <Vollzornbrot> my first php version was 2.2.7 ^.^
[11:19:16] * Vollzornbrot is feeling very very old
[11:22:35] <buildmaster> i686/wire-desktop is broken (says eurobuild3).
[11:22:48] <abaumann> ok, tested that, failing packages works. :-)
[11:23:12] <abaumann> *abaumann puts his slaves back into production
[11:23:17] * Vollzornbrot is listen to: Fear of the Dark - Iron Mainden
[11:26:07] <abaumann> energizing music for energizing tasks ;-)
[11:37:17] <buildmaster> i686/remacs are broken (says rechenknecht).
[11:38:26] <abaumann> russian emacs?
[11:38:40] <deep42thought> emacs in rust?
[11:43:25] <abaumann> Emacs with parts of it written in Rust
[11:43:29] <abaumann> yeah. cool. there too.
[11:45:01] <abaumann> yeah. the mission there sound pretty much like gnome/librsvg
[11:49:12] -!- ofara_ has quit [Ping timeout: 245 seconds]
[11:54:42] -!- abaumann has quit [Quit: leaving]
[12:55:29] -!- Vollzornbrot has quit [Remote host closed the connection]
[13:35:34] -!- ofara_ has joined #archlinux32
[13:37:49] -!- ofara has quit [Ping timeout: 244 seconds]
[14:21:22] -!- deep42thought has quit [Remote host closed the connection]
[14:24:58] -!- deep42thought has joined #archlinux32
[14:24:58] <buildmaster> Hi deep42thought!
[14:24:58] <buildmaster> !rq deep42thought
[14:25:00] <phrik> buildmaster: <deep42thought> I like ignoring systemd, but: why?
[14:38:17] -!- deep42thought has quit [Quit: Leaving.]
[14:38:33] -!- deep42thought has joined #archlinux32
[14:38:33] <buildmaster> Hi deep42thought!
[14:38:33] <buildmaster> !rq deep42thought
[14:38:35] <phrik> buildmaster: <deep42thought> windows suggests swap on external usb sticks :-)
[15:05:03] <buildmaster> i686/virtualbox-modules-arch is broken (says nlopc46).
[15:15:53] -!- thePiGrepper has quit [Ping timeout: 252 seconds]
[15:30:04] -!- deep42thought has quit [Quit: Leaving.]
[15:47:54] -!- ofara has joined #archlinux32
[15:50:31] -!- MrBIOS has joined #archlinux32
[16:23:13] <buildmaster> i686/go is broken (says rechenknecht).
[17:50:36] -!- AndrevS has joined #archlinux32
[18:01:36] <buildmaster> i686/haskell-djinn-ghc is broken (says eurobuild3).
[18:08:17] -!- isacdaavid has joined #archlinux32
[18:12:50] -!- AndrevS has quit [Remote host closed the connection]
[18:17:15] -!- slacka123 has joined #archlinux32
[18:27:35] <slacka123> The other day, I asked why my system might be unresponsive when compiling apps. The problem went away after a reboot. So ¯\_(ツ)_/¯
[18:28:48] <slacka123> Guess something was causing it to thrash swap, alought 'free -h' looked good at the time. So happy to be back on Arch. Thanks everyone!
[18:41:09] -!- abaumann has joined #archlinux32
[18:41:09] <buildmaster> Hi abaumann!
[18:41:09] <buildmaster> !rq abaumann
[18:41:10] <phrik> buildmaster: <abaumann> * abaumann looks at his hands.. counts them.. shakes his head and sighs about the fact he cannot grow some more..
[18:41:26] <abaumann> slacka123: hi, happy we can help. :-)
[18:43:34] -!- abaumann has quit [Client Quit]
[18:47:17] <buildmaster> i686/haskell-data-default-instances-old-locale is broken (says eurobuild3).
[18:58:58] -!- isacdaavid has quit [Quit: Leaving.]
[19:07:00] -!- thePiGrepper has joined #archlinux32
[19:13:22] -!- thePiGrepper has quit [Ping timeout: 245 seconds]
[19:19:50] -!- thePiGrepper has joined #archlinux32
[20:13:24] <buildmaster> i686/haskell-colour is broken (says eurobuild3).
[20:17:32] -!- ofara_ has quit [Ping timeout: 245 seconds]
[20:18:32] -!- ofara_ has joined #archlinux32
[20:19:09] -!- slacka123 has quit [Remote host closed the connection]
[20:31:06] -!- oaken-source has joined #archlinux32
[21:20:03] <buildmaster> i686/c2hs are broken (says rechenknecht).
[21:30:37] <buildmaster> i686/haskell-zlib-bindings are broken (says eurobuild3).
[22:11:41] <buildmaster> i686/gnome-shell is broken (says eurobuild3).
[22:13:22] -!- samantaz_ has joined #archlinux32
[22:22:11] <buildmaster> i686/pulseeffects are broken (says nlopc46).
[22:38:02] <buildmaster> i686/gpaste is broken (says rechenknecht).
[22:45:57] -!- slacka123 has joined #archlinux32