#archlinux32 | Logs for 2019-07-12
Back
[00:11:58] <buildmaster> pentium4/dart is broken (says rechenknecht): https://archlinux32.org
[00:15:23] <buildmaster> pentium4/vulkan-tools are broken (says eurobuild6-1): https://archlinux32.org
[00:27:56] <buildmaster> pentium4/npm is broken (says eurobuild6-4): https://archlinux32.org
[00:30:12] <buildmaster> pentium4/libnice is broken (says eurobuild6-6): https://archlinux32.org
[00:37:58] -!- samantaz has quit [Ping timeout: 245 seconds]
[00:38:26] <buildmaster> pentium4/teamspeak3-server is broken (says eurobuild6-6): https://archlinux32.org
[00:40:11] -!- samantaz has joined #archlinux32
[00:46:11] <buildmaster> girls, please have a look at my dirty database
[00:46:11] * buildmaster goes insane.
[00:54:03] guys is now known as elibrokeit
[01:11:57] -!- isacdaavid has quit [Quit: Leaving.]
[01:17:38] -!- petris has quit [Quit: Bye bye.]
[01:23:34] -!- petris has joined #archlinux32
[01:28:10] -!- thePiGrepper has quit [Ping timeout: 272 seconds]
[02:12:34] -!- samantaz has quit [Read error: Connection reset by peer]
[03:19:41] -!- davor_ has joined #archlinux32
[03:20:01] -!- davor has quit [Ping timeout: 248 seconds]
[03:20:02] davor_ is now known as davor
[06:57:46] -!- quequotion has joined #archlinux32
[08:41:38] -!- deep42thought has joined #archlinux32
[08:41:38] <buildmaster> Hi deep42thought!
[08:41:38] <buildmaster> !rq deep42thought
[08:41:40] <phrik> buildmaster: <deep42thought> brtln: you're "the arch linux", we're "the other arch linux" and alarm is "arches linux", then?
[08:50:58] -!- abaumann has joined #archlinux32
[08:50:58] <buildmaster> Hi abaumann!
[08:50:58] <buildmaster> !rq abaumann
[08:51:00] <phrik> buildmaster: <abaumann> mmh.. my build slaves are on strike? Maybe I should pay them? ;-)
[08:51:03] <deep42thought> Hi abaumann!
[08:51:05] <abaumann> good morning deep42thought
[08:51:24] <deep42thought> same problem again as last time: so either something is broken now or the credentials are still missing ;-)
[08:51:56] <abaumann> wouldn't there be an error somewhere when it cannot reach the master mirror?
[08:52:09] <deep42thought> yes
[08:52:15] -!- quequotion has quit [Quit: quequotion]
[08:52:21] <deep42thought> but unfortunately only in the log of the slave
[08:52:30] <abaumann> ah, right.
[08:52:36] <deep42thought> last time it was nlopc43 - where I simply have a terminal running and no log is saved :-/
[08:53:16] <deep42thought> I'm currently repairing the filtering on log.php on the buildmaster so we can easily find out which build slave gave back the package which broke everything ...
[08:53:41] <abaumann> that's a good thing
[08:55:19] <abaumann> So, I did a manual 'ssh master@buildmaster.archlinux32.org
[08:55:23] <abaumann> on all my slaves
[08:55:49] <abaumann> if this results in Invalid command: "", then everything is fine, because known_hosts contains the buildmaster and the slave credentials are valid
[08:56:08] <abaumann> the same should apply for git.archlinux32.org and the master mirror, right?
[08:56:08] <deep42thought> yes
[08:56:35] <deep42thought> I'm not sure what an error on those should look like
[08:56:47] <deep42thought> probably something like "this is an sftp-only account" on the master mirror
[08:56:54] <deep42thought> but I'm really not sure about git.archlinux32.org
[08:56:58] <abaumann> exactly, or permission denied or so
[08:57:02] <deep42thought> yes
[08:57:14] <abaumann> I had errors of "please accept the shiny SSH key and press yes"
[08:57:22] <abaumann> which is a bad thing in a slave script to happen :-)
[08:57:22] <deep42thought> :-)
[08:57:26] <deep42thought> yes
[08:57:33] <abaumann> hope, I fixed those.
[08:57:36] <deep42thought> is there some --no-tty option we should add?
[08:57:47] <deep42thought> ... probably a good idea, isn't it?
[08:57:52] <abaumann> yeah
[08:58:57] <abaumann> rsync rsync://buildmaster@mirror.archlinux32.org:
[08:59:20] <deep42thought> no
[08:59:27] <deep42thought> I think the user is wrong
[08:59:30] <abaumann> ah
[08:59:45] <deep42thought> ah, no, it's right
[08:59:50] <deep42thought> it differs from the user on that maching
[08:59:54] <deep42thought> *machine
[08:59:56] <deep42thought> but it's right
[09:00:04] <abaumann> ah. It's in the config on the slave
[09:00:08] <deep42thought> found the bad slave: https://archlinux32.org
[09:01:55] <deep42thought> let's hope it still has its log ;-)
[09:02:59] <deep42thought> looks all good to me ...
[09:04:24] <deep42thought> the new package was added, but for some reason, the old package was not removed from the mirror and the database without emitting any error/warning
[09:04:48] <abaumann> mmh.
[09:09:20] <abaumann> building since 2019-07-12 10:08:24 ?
[09:09:31] <deep42thought> timezone?
[09:09:33] <abaumann> do we have a time problem?
[09:10:01] <deep42thought> we really should switch everything to utc ...
[09:10:17] <abaumann> ah, so the buildmaster is now on UTC and my slaves on localtime?
[09:10:20] <abaumann> mmh
[09:10:48] <abaumann> as long it's just a html thing, it's no problem - just confusing :-)
[09:10:51] <deep42thought> the timezone of the slave should be irrelevant
[09:10:55] <abaumann> ah, good
[09:11:13] <deep42thought> it is only used for the date in the build log, which uses -u iirc
[09:11:27] <deep42thought> archlinux32.org might have a weird time zone
[09:11:45] <abaumann> just seen, timesyncd was not running on the buildmaster
[09:11:53] <deep42thought> :-)
[09:11:55] <abaumann> and the munin plugins were just missing :-)
[09:13:01] <deep42thought> the time on archlinux32.org is really just a timezone issue on that server
[09:13:20] <deep42thought> /etc/localtime -> /usr/share/zoneinfo/Europe/Athens
[09:13:25] <deep42thought> I'll change that :-)
[09:13:39] <abaumann> well, technically it is even correct that way
[09:13:59] <deep42thought> oops
[09:14:06] * deep42thought just overwrote /usr/share/zoneinfo/UTC
[09:14:35] <abaumann> timedatectl is your friend..
[09:14:46] <deep42thought> `ln -sf` was my friend
[09:14:52] <deep42thought> or so it claimed to be
[09:43:51] <deep42thought> timezones on archlinux32.org are now in utc
[09:44:52] <abaumann> \o/
[09:50:49] <abaumann> mmh. all slaves are on uploading.. some bottleneck here?
[09:50:54] <abaumann> https://archlinux32.org
[09:50:56] <phrik> Title: Arch Linux 32 - List of Build Slaves (at archlinux32.org)
[09:50:58] <deep42thought> buildmaster: what's up?
[09:50:58] <buildmaster> up? I'm up for 1 day, 7 minutes, load average: 1.87, 1.89, 1.99 ... and I'm insane :-D
[09:51:07] <abaumann> :-)
[09:51:35] <deep42thought> some 100 packages had issues :-/
[09:51:43] <abaumann> oh, out of sync..
[09:52:08] <abaumann> so.. for the next migration maybe stopping all slaves would be a good idea?
[09:52:22] * abaumann hopes there will not be a next migration
[09:52:24] <deep42thought> I think the problem is something else
[09:52:38] <deep42thought> some error which is not properly fetched
[09:52:51] <deep42thought> and which simply did not occure on the old buildmaster
[09:54:00] <deep42thought> the buildmaster should get well soon
[09:54:06] <abaumann> a missing software packet?
[09:54:14] <abaumann> credentials?
[09:54:19] <abaumann> yeah, could be anything
[09:54:29] <deep42thought> missing software, missing credentials, missing directory, missing permissions on some file, ...
[09:54:36] <abaumann> I lately had a backup script which failed, because $HOME was suddently empty in bash
[09:54:42] <abaumann> worked for 10 years
[09:54:51] <abaumann> I blame a security fix in bash :-)
[09:54:55] <deep42thought> :-)
[09:55:10] <deep42thought> strange thing is, that it does not show up in the logs and that it seems to work when I do it manually
[09:55:32] <abaumann> sudo requiretty?
[09:56:03] <deep42thought> we don't need sudo, actually
[09:56:11] <abaumann> ah.
[09:58:07] <deep42thought> I'll add an extra dump around the query which I believe is the crux
[10:07:56] <deep42thought> I just imported some gpg keys from the old buildmaster - maybe they were the problem :-/
[10:08:08] <abaumann> oh
[10:09:03] <abaumann> so, the old munin graphs are back.. no I try to combine some of them..
[10:09:11] <deep42thought> thanks :-)
[10:09:37] <abaumann> I have to work with colors and multiple values per plugin.. let's see..
[10:19:02] * buildmaster resumes sanity.
[10:19:08] <deep42thought> ... finally
[10:21:21] <deep42thought> let's see, how long it lasts
[10:22:19] <abaumann> you found the bug?
[10:22:28] <deep42thought> I cleaned the buildmaster
[10:22:32] <abaumann> oh.
[10:22:35] <deep42thought> and I added debug info and copied the keys
[10:22:47] <deep42thought> and moved the mirror-synchronization to the end
[10:22:56] <deep42thought> (after removing duplicate packages)
[10:23:23] <abaumann> oj.
[10:33:38] <buildmaster> pentium4/filezilla is broken (says eurobuild3): https://archlinux32.org
[10:47:28] <buildmaster> girls, my database is dirty again ...
[10:47:28] * buildmaster goes insane.
[10:53:03] <deep42thought> somehow the build slave returned a package which is older than what we already have
[10:53:22] <abaumann> older in sense of the git revision?
[10:53:29] <abaumann> or in mtime
[10:53:30] <deep42thought> e.g. kibana 7.1.1-1.0 was built and injected into i686/community-staging, but we already had 7.2.0-1.0
[10:53:51] <deep42thought> then, the remove_old_package_versions logic fails, of course
[10:54:13] <abaumann> is this related to the bochs issue? It seems, the buildmaster sends old versions to the slaves..
[10:55:19] <deep42thought> might be, yes
[10:57:45] <deep42thought> the git HEAD is at the one from 2019-06-22
[10:57:49] <deep42thought> this is not right ...
[10:59:14] <deep42thought> aha! the repo is non-bare, thus triggers a different (and apparently buggy) code path for updating ...
[10:59:27] <abaumann> ah.
[10:59:31] <abaumann> that's an easy one..
[10:59:40] <deep42thought> it is?
[11:00:00] <abaumann> well.
[11:00:23] <abaumann> transform the git repo at the current head?
[11:00:32] <deep42thought> `git remote update` doesn't update as expected :-(
[11:03:04] <deep42thought> I'll use `git pull --ff-only` for now ...
[11:03:50] <abaumann> there should not be any merges..
[11:04:00] <deep42thought> yes
[11:04:04] <deep42thought> thus the --ff-only
[11:04:15] <deep42thought> in case *someone* changes the index/tree
[11:04:19] <deep42thought> :-D
[11:04:26] <deep42thought> to avoid any bad surprises
[11:04:29] * abaumann coughs..
[11:07:25] <deep42thought> you're not the only one who edits stuff in-situ
[11:08:28] <abaumann> :-)
[11:10:04] * buildmaster resumes sanity.
[11:25:23] -!- mode/#archlinux32 [+o deep42thought] by ChanServ
[11:25:51] -!- mode/#archlinux32 [-o deep42thought] by ChanServ
[11:26:15] -!- AndrevS has joined #archlinux32
[11:49:11] <deep42thought> there are 49k mails on the buildmaster O.o
[11:50:17] -!- nit-picker has quit [Remote host closed the connection]
[11:50:34] -!- nit-picker has joined #archlinux32
[12:04:11] -!- nit-picker has quit [Remote host closed the connection]
[12:04:24] -!- nit-picker has joined #archlinux32
[12:08:51] <abaumann> mails, hehe
[12:13:07] <deep42thought> can you properly configure that? I have no idea of such things, usually :-/
[12:15:42] -!- quequotion has joined #archlinux32
[12:46:09] -!- quequotion has quit [Quit: quequotion]
[12:51:07] -!- MannerMan has joined #archlinux32
[13:10:17] -!- nit-picker has quit [Remote host closed the connection]
[14:04:01] <abaumann> sure :-)
[14:04:16] <deep42thought> thanks
[14:06:22] <abaumann> so, this is local user 'master' who gets his mail delivered into a local spool mail folder
[14:06:42] <abaumann> let's send them to the list..
[14:06:42] <deep42thought> where does it come from?
[14:06:52] <deep42thought> uagh, 50k emails?
[14:07:00] <abaumann> YES ;-)
[14:07:34] <abaumann> most likely some user systemd logs..
[14:07:52] <deep42thought> hopefully, mail-digest will combine them into a single email :-D
[14:09:26] <abaumann> mmh. sanity checks are encrypted - for your eyes only :-)
[14:09:32] <abaumann> in the mail
[14:09:34] <deep42thought> for me?
[14:09:42] <deep42thought> should be encrypted for you, too
[14:16:10] <abaumann> ah.
[14:16:39] <abaumann> so, the mysql munin stuff is also working again..
[14:16:47] <deep42thought> cool
[14:17:08] <abaumann> maybe we can see some performance issue there
[14:17:18] <deep42thought> you expect issues?
[14:17:22] <abaumann> no :-)
[14:17:27] <deep42thought> :-)
[14:17:32] <abaumann> not on that machine, to be frank
[14:17:43] <abaumann> wow, we dropped to 546 build packages..
[14:17:48] <abaumann> ..to be built
[14:17:53] <deep42thought> get-package-updates is still running
[14:17:54] <deep42thought> ...
[14:18:02] <deep42thought> updating from 2019-06-22 ...
[14:18:08] <abaumann> ah, right.
[14:18:17] <deep42thought> (that's the time of the git commit, not when I started it)
[14:18:25] <abaumann> good :-)
[14:18:43] <deep42thought> it's already in the blacklisting step ... so should be done any minute now
[14:19:03] <abaumann> mmh. mysql uses one core
[14:19:09] <deep42thought> jupp
[14:19:30] <abaumann> well. one query, one core.
[14:21:32] <deep42thought> done!
[14:21:52] <abaumann> bochs x86_64 emulator, now running on 32-bit :-)
[14:22:52] -!- nit-picker has joined #archlinux32
[14:22:59] <nit-picker> commit bcfd74ba527ecf80d15513705e18f723166aaf9a a3a00a26083bed79a3d32359506e24cf45148e33 is missing from repository archlinux32
[14:23:04] <nit-picker> commit archlinux32 is missing from repository archlinux32
[14:23:04] <nit-picker> commit bcfd74ba527ecf80d15513705e18f723166aaf9a a3a00a26083bed79a3d32359506e24cf45148e33 is not an ancestor of HEAD archlinux32 in repository archlinux32
[14:23:05] -!- nit-picker has quit [Remote host closed the connection]
[14:23:23] <deep42thought> hmmm
[14:23:26] <abaumann> ah. nit-picker comes into the channel, croaks, then leaves fast ;-)
[14:23:53] <deep42thought> looks like I messed up something in nitpicker ...
[14:27:20] <buildmaster> pentium4/linux-firmware is broken (says eurobuild6-2): https://archlinux32.org
[14:29:12] -!- nit-picker has joined #archlinux32
[14:29:18] -!- nit-picker has quit [Remote host closed the connection]
[14:29:24] <deep42thought> wtf
[14:29:36] -!- nit-picker has joined #archlinux32
[14:29:42] -!- nit-picker has quit [Remote host closed the connection]
[14:30:01] -!- nit-picker has joined #archlinux32
[14:30:09] -!- nit-picker has quit [Remote host closed the connection]
[14:32:41] -!- nit-picker has joined #archlinux32
[14:33:00] <deep42thought> let's see if he stays longer this time ...
[14:33:29] <abaumann> .. he seems to have a jumpy nature. ;-)
[14:33:48] <deep42thought> `set -e` is a bad idea when your scripts are broken on all ends :-D
[14:55:49] <deep42thought> brouter sagt 31 min Reisezeit voraus
[14:57:52] <deep42thought> oops wrong window O.o
[14:59:21] -!- DCyrax has quit [Read error: Connection reset by peer]
[15:00:00] -!- _DCyrax has joined #archlinux32
[15:00:10] <abaumann> :-)
[15:04:35] <deep42thought> better here than in a root shell ...
[15:08:52] -!- nit-picker has quit [Remote host closed the connection]
[15:09:05] -!- nit-picker has joined #archlinux32
[15:34:33] -!- deep42thought has quit [Quit: Leaving.]
[15:55:54] <elibrokeit> Well, generally set -e isn't very advisable anyway :D
[16:04:47] -!- phrik has quit [Read error: Connection reset by peer]
[16:05:32] -!- phrik has joined #archlinux32
[16:05:32] <buildmaster> Hi phrik!
[16:05:32] <buildmaster> !rq phrik
[16:07:44] <phrik> buildmaster: <phrik> i am bot
[16:25:51] -!- MannerMan has quit [Quit: MannerMan]
[17:02:09] -!- nit-picker has quit [Remote host closed the connection]
[17:02:23] -!- nit-picker has joined #archlinux32
[17:03:53] <girls> the nitpicker is somewhat annoying: it sends me one pm per minute about packages where the dependencies in the database are wrong ...
[17:04:08] <girls> (there is a hard-coded 1 minute delay after such a report)
[17:05:39] -!- deep42thought has joined #archlinux32
[17:05:39] <buildmaster> Hi deep42thought!
[17:05:39] <buildmaster> !rq deep42thought
[17:05:41] <phrik> buildmaster: <deep42thought> documented => the bug becomes a feature
[17:05:48] <deep42thought> actually, it sends _me_ these pms
[17:24:05] <buildmaster> i686/expat is broken (says eurobuild6-2): https://archlinux32.org
[17:25:50] -!- eschwartz has quit [Quit: A random quit message]
[17:54:31] -!- nit-picker has quit [Remote host closed the connection]
[17:54:54] -!- nit-picker has joined #archlinux32
[17:59:56] <buildmaster> i686/expat is broken (says eurobuild6-2): https://archlinux32.org
[18:01:13] -!- eschwartz has joined #archlinux32
[18:06:43] -!- deep42thought has quit [Quit: Leaving.]
[18:09:00] -!- nit-picker has quit [Remote host closed the connection]
[18:09:20] -!- nit-picker has joined #archlinux32
[18:39:40] -!- nit-picker has quit [Remote host closed the connection]
[18:40:01] -!- nit-picker has joined #archlinux32
[19:00:26] -!- City-busz has quit [Quit: http://quassel-irc.org - Csevegjen kényelmesen. Bárhol.]
[19:00:26] -!- elibrokeit has quit [Quit: A random quit message]
[19:02:06] -!- City-busz has joined #archlinux32
[19:02:09] -!- City-busz has quit [Client Quit]
[19:02:10] -!- elibrokeit has joined #archlinux32
[19:02:12] -!- elibrokeit has quit [Client Quit]
[19:04:06] -!- elibrokeit has joined #archlinux32
[19:05:06] -!- City-busz has joined #archlinux32
[19:05:30] -!- isacdaavid has joined #archlinux32
[19:21:55] -!- abaumann has quit [Quit: leaving]
[19:42:20] -!- nit-picker has quit [Remote host closed the connection]
[19:42:40] -!- nit-picker has joined #archlinux32
[20:39:24] -!- samantaz has joined #archlinux32
[20:41:31] <bill-auger> girls: be mindful there - people with too many _me_'s end up visiting the funny farm
[21:44:37] -!- ofara has quit [Ping timeout: 245 seconds]
[21:45:07] -!- ofara has joined #archlinux32
[21:52:40] -!- deep42thought has joined #archlinux32
[21:52:41] <buildmaster> Hi deep42thought!
[21:52:41] <buildmaster> !rq deep42thought
[21:52:42] <phrik> buildmaster: <deep42thought> *mimimi* tyzoid *mimimimi*
[21:53:24] <deep42thought> elibrokeit: if your script works well, `set -e` is barely necessary - but it avoids major fuck-up in case /something/ is wrong and you forgot to implement the proper error checking somwehere else ...
[22:37:32] -!- deep42thought has quit [Quit: Leaving.]
[23:10:43] -!- samantaz has quit [Read error: Connection reset by peer]
[23:13:18] * buildmaster goes insane.