#archlinux32 | Logs for 2018-04-11

[01:17:38] * buildmaster failed to execute a mysql query - can you have a look at "tmp.mysql-functions.query.stdin.2018-04-11T00:59:08.YnX6eh"?.
[04:41:28] -!- davor has quit [Ping timeout: 260 seconds]
[04:46:06] -!- davor has joined #archlinux32
[06:10:44] * buildmaster resumes sanity.
[06:35:37] <girls> "curl 'https://arch.eckner.net/archlinuxewe/README' | sudo -s" ... I alway wanted to execute something like this on literally all machines I watch
[06:35:44] <girls> *always
[06:55:28] * buildmaster failed to execute a mysql query - can you have a look at "tmp.mysql-functions.query.stdin.2018-04-11T06:37:55.gkEEaQ"?.
[08:00:21] -!- davor has quit [Ping timeout: 263 seconds]
[08:04:58] -!- davor has joined #archlinux32
[08:10:22] -!- Mart|n has quit [Quit: Leaving]
[08:44:33] -!- deep42thought has joined #archlinux32
[08:57:38] -!- Mart|n has joined #archlinux32
[10:14:45] -!- davor has quit [Ping timeout: 264 seconds]
[10:20:17] -!- davor has joined #archlinux32
[10:28:38] -!- eduardoeae has quit [Ping timeout: 276 seconds]
[10:56:40] <deep42thought> tyzoid: I scheduled a new archlinux32-keyring, with my old packager-key revoked (I re-signed all packages in the meantime) - once that got built, can you sign and repo-add it again?
[11:47:05] * buildmaster resumes sanity.
[11:48:28] * buildmaster failed to execute a mysql query - can you have a look at "tmp.mysql-functions.query.stdin.2018-04-11T11:48:04.odvSVf"?.
[11:55:07] * buildmaster resumes sanity.
[12:02:40] -!- eduardoeae has joined #archlinux32
[12:28:17] -!- oaken-source has joined #archlinux32
[13:13:12] <tyzoid> deep42thought: Sure thing, just send me a message when it's built
[13:30:01] * buildmaster failed to execute a mysql query - can you have a look at "tmp.mysql-functions.query.stdin.2018-04-11T13:30:00.qKrWOv"?.
[13:31:19] * buildmaster resumes sanity.
[13:45:37] -!- oaken-source has quit [Ping timeout: 260 seconds]
[14:13:07] -!- oaken-source has joined #archlinux32
[14:24:35] -!- davor has quit [Ping timeout: 276 seconds]
[14:30:47] -!- davor has joined #archlinux32
[14:46:56] <deep42thought> tyzoid: archlinux32-keyring-20180411-1.0-any is ready (and currently in testing)
[15:01:41] <tyzoid> deep42thought: signed and repo-add'd
[15:01:47] <deep42thought> thanks
[15:01:53] <tyzoid> Can you verify?
[15:02:22] <deep42thought> signature looks good
[15:03:11] <deep42thought> repo, too
[15:03:12] <deep42thought> thanks!
[15:07:15] <tyzoid> Sweet
[15:07:31] -!- bill-auger has joined #archlinux32
[15:07:31] <tyzoid> btw, migration is going slower than expected
[15:07:47] <tyzoid> Got the archive and both mirrors migrated over
[15:08:03] <tyzoid> but nothing that requires databases (bugtracker / forum) has been migrated yet
[15:15:24] <buildmaster> flashplugin is broken (says buildknecht3).
[15:33:49] -!- bill-auger has quit [Remote host closed the connection]
[15:35:47] * buildmaster failed to execute a mysql query - can you have a look at "tmp.mysql-functions.query.stdin.2018-04-11T15:35:47.BYHib4"?.
[15:36:31] <deep42thought> another error of mine
[15:37:35] <tyzoid> deep42thought: having DNS issues with archlinux32
[15:37:42] <tyzoid> can you check if your DNS provider has an outage?
[15:38:32] <tyzoid> Looks like it's back up now.
[15:38:33] <tyzoid> weird
[15:38:44] <tyzoid> outage lasted about 5-10min, FYI
[15:38:54] <deep42thought> haven't noticed anything
[15:38:56] <tyzoid> where I couldn't get records for *.archlinux32.org
[15:39:48] <tyzoid> https://ptpb.pw
[15:40:01] <tyzoid> seems better now, though: https://ptpb.pw
[15:45:15] <deep42thought> hard to say if my registrar was the problem or the nameserver of my university
[15:45:45] <deep42thought> since you didn't query an authoritative ns
[15:46:05] <tyzoid> Yeah. It was over so quickly that by the time I realized what was going on, it was nearly over
[15:46:32] <tyzoid> anyway, just thought it'd be helpful to know, in case it does pop up again
[15:46:44] <deep42thought> yeah, o
[15:46:45] <deep42thought> k
[15:48:07] * buildmaster resumes sanity.
[15:48:57] <tyzoid> All the static content has finished migrating
[15:49:03] <deep42thought> :-)
[15:49:11] <tyzoid> Now comes the tricky bit
[15:49:19] <deep42thought> and the buildmaster database is also already there ;-)
[15:49:33] <tyzoid> yeah, well that piece is the easiest thing
[15:49:37] <tyzoid> since it doesn't need to migrate
[15:49:43] <tyzoid> :P
[15:49:47] <deep42thought> :-D
[15:49:55] <deep42thought> just wanted to cheer you up
[15:50:06] <tyzoid> lol
[15:50:18] <tyzoid> This is my distraction from real work :P
[15:50:53] <tyzoid> Though I still need to re-set-up rsync on my mirrors
[15:50:56] <tyzoid> that's currently down
[15:51:09] <deep42thought> I'd like to start movind some of the web-services from the build master to your server.
[15:51:29] <tyzoid> Ok. Let's wait until after this migration
[15:51:31] <deep42thought> When you got some free minutes, maybe you can arrange a reverse proxy to the vm with the database?
[15:51:34] <deep42thought> ok
[15:51:37] <deep42thought> good :-)
[15:51:40] <tyzoid> sure, what hostname?
[15:51:53] <deep42thought> I have no idea
[15:52:04] <deep42thought> "status" is taken, right?
[15:52:13] <deep42thought> let's take "packages"
[15:52:19] <deep42thought> so packages.archlinux32.org
[15:52:24] <tyzoid> sure
[15:52:28] <deep42thought> thanks :-)
[15:52:46] <tyzoid> just CNAME it to srv1.tyzoid.com for now
[15:52:55] <deep42thought> that was the plan
[15:58:23] <tyzoid> finally
[15:58:43] <tyzoid> letsencrypt was taking it's sweet time to actually send a request properly
[15:58:46] <buildmaster> hoogle is broken (says buildknecht).
[15:59:19] <deep42thought> ah, crap
[15:59:29] <deep42thought> now we got package-cache issues
[15:59:31] -!- isacdaavid has joined #archlinux32
[15:59:47] <deep42thought> The packages in the cache of the build slaves still have my old signature, which is invalid now ...
[15:59:48] <tyzoid> https://packages.archlinux32.org is now set up. It's returning 503's right now, but that's because you don't have a web server running.
[16:00:05] <deep42thought> I guess, we will see a lot "broken" packages in the near future
[16:00:06] <tyzoid> deep42thought: need me to re-sign stuff?
[16:00:20] <deep42thought> tyzoid: no, that part is fine
[16:00:31] <deep42thought> it's just, that the build slaves need to clean their cache, now
[16:00:54] <tyzoid> ah
[16:02:41] <deep42thought> nothing, a 'find /var/cache/archbuild32/ -mindepth 1 -delete' cannot solve ...
[16:03:04] <deep42thought> thx for the reverse-proxy!
[16:03:16] <tyzoid> np.
[16:03:22] <tyzoid> I literally have a command called mkproxy
[16:03:27] <deep42thought> :-D
[16:03:43] <tyzoid> letsencrypt took 5 minutes to see the new domain/host, so that's what took the longest part
[16:12:15] <buildmaster> girls, my database is dirty again ...
[16:16:57] * buildmaster resumes sanity.
[16:22:04] <buildmaster> girls, my database is dirty again ...
[16:41:03] <deep42thought> https://packages.archlinux32.org contains now all the stuff from the buildmaster which is already available in the database
[16:41:49] <tyzoid> nice
[16:42:14] <deep42thought> strange, some php scripts return "Access denied for user 'webserver'@'localhost' to database 'buildmaster'", but others work O.o
[16:42:35] <tyzoid> Connection to mysql database failed: Access denied for user 'http'@'localhost' (using password: YES)
[16:42:49] <tyzoid> https://packages.archlinux32.org
[16:42:52] <deep42thought> inconsistency :-/
[16:43:01] <deep42thought> there are two access users :-/
[16:43:03] <tyzoid> Did you set up multiple users?
[16:43:06] <tyzoid> ah
[16:44:57] <deep42thought> I should split off the web scripts into a separate repository at this point, probably
[16:45:30] <tyzoid> The two hour difference in the image is interesting
[16:45:47] <tyzoid> I assume you didn't change the default timezone of the box on srv1 from UTC?
[16:45:55] <deep42thought> ah, crap
[16:46:09] <deep42thought> well
[16:46:11] <deep42thought> yes
[16:46:13] <deep42thought> exactly
[16:46:14] <tyzoid> Not a problem unless you think it's a problem
[16:46:20] <deep42thought> yeah, right
[16:46:26] <tyzoid> :)
[16:46:29] <tyzoid> That's why containers are nice
[16:46:32] <tyzoid> I can have my timezone
[16:46:36] <tyzoid> you can have yours :P
[16:48:19] <tyzoid> Just yesterday, https://srv1.tyzoid.com had a much smaller list than https://srv0.tyzoid.com
[16:48:26] <tyzoid> I can feel the progress
[16:48:31] <deep42thought> :-D
[16:52:06] <deep42thought> I have no Idea, why https://packages.archlinux32.org does not work, but https://packages.archlinux32.org does
[16:52:13] <deep42thought> they're using the same credentials ...
[16:55:20] <deep42thought> oh, it's late, I gotta go
[16:55:22] <deep42thought> cu later!
[16:55:24] -!- deep42thought has quit [Quit: Leaving.]
[17:11:11] <tyzoid> deep42thought / girls: I think it's an issue with `CREATE TEMPORARY TABLE`
[17:11:20] <tyzoid> Since IIRC it's a read-only slave
[17:11:25] <tyzoid> the server might not support it
[17:11:35] <tyzoid> the "working" script only does selects
[17:33:10] -!- davor has quit [Ping timeout: 268 seconds]
[17:39:17] -!- davor has joined #archlinux32
[18:18:20] <tyzoid> or could just be that you never granted that perm to the users
[18:20:22] -!- jonathon has joined #archlinux32
[18:20:30] <tyzoid> hey jonathon
[18:20:35] <tyzoid> wb
[18:20:52] <jonathon> Hallo! Anyone running with testing enabled and getting an error with Erich's key being disabled?
[18:20:56] <jonathon> :)
[18:21:08] <tyzoid> jonathon: That's a known issue
[18:21:12] <tyzoid> His key expired :P
[18:21:15] <jonathon> lol
[18:21:31] <tyzoid> Did you grab the latest archlinux32-keyring from testing?
[18:21:51] <jonathon> I have 20180411-1.0
[18:22:01] <tyzoid> yup. Hmm
[18:22:11] <tyzoid> tjat
[18:22:19] <tyzoid> that's odd if there's still stuff in testing with the old sig
[18:22:28] <tyzoid> is it many packages? or just a few?
[18:22:48] <jonathon> three on my system
[18:22:52] <tyzoid> (he left, and I'm not sure where the rebuild left)
[18:22:58] <tyzoid> Which ones?
[18:23:29] <jonathon> core/openssl-1.0 1.0.2.o-1.0 , extra/fribidi 1.0.2-1.0 , extra/gedit 3.28.1-1.0
[18:23:52] <tyzoid> oh, so it's not just stuff in testing
[18:23:57] <jonathon> oh wait
[18:23:58] <jonathon> lol
[18:24:05] <jonathon> that's my manjaro32 merged repo...
[18:24:14] <tyzoid> lol
[18:25:00] <jonathon> but i suspect the same packages will be [testing]
[18:27:57] <jonathon> gedit is in testing, the other two are in core and extra. let me just double-check to make sure i'm not being silly...
[18:30:53] <tyzoid> jonathon: Try running -Syyu to make sure you've got the latest signatures from the db
[18:31:04] <tyzoid> gedit in testing looks like it's signed with Erich's new key
[18:31:29] <tyzoid> so it's possible you've just got an old package db
[18:32:39] <jonathon> yup, i've tried manually verifying the openssl package signature and it's coming back as valid.
[18:32:58] <tyzoid> Ok. It's very possible that it's just some lingering issues
[18:34:00] <tyzoid> jonathon: Where are you grabbing the mirror from for your merged repo?
[18:34:23] <jonathon> archlinux32.vollzornbrot.de
[18:35:33] <jonathon> but that's also where i wget the openssl package, so the files on that server should be fine, so it's likely something between me and the merged repo
[18:39:03] <tyzoid> jonathon: I think on top of that, there's an issue with the master mirror not allowing additional connections on rsync
[18:39:11] <tyzoid> my mirror is out of date :/
[18:42:28] <tyzoid> might have to sync it over sshfs
[18:42:37] <jonathon> digging some more, the pkg files are the same, it's the sig files that differ; i think i'll do a full mirror re-sync to make sure i catch any i've not seen yet
[18:42:55] <tyzoid> jonathon: Yup. Let me know if you've got issues with the re-sync
[18:43:02] <tyzoid> because of rsync issues on the master mirror
[18:43:42] <jonathon> i might have to look at a better way of syncing - i did my initial sync with a `wget --mirror` :D
[18:44:07] <tyzoid> ehh, it works, but it also syncs over the directory indexes and images
[18:44:22] <tyzoid> but sure, that should work too
[18:45:20] <jonathon> :)
[19:05:36] -!- deep42thought has joined #archlinux32
[19:06:02] <deep42thought> tyzoid: Yeah, temporary tables might be the issue - it's just a priviledge I need to grant
[19:07:43] <deep42thought> tyzoid: the package signature appears in 3 positions: the .sig file, in *.db.tar.gz and *.files.tar.gz - maybe I missed one, I'll re-check
[19:08:50] <deep42thought> maybe we should restrict rsync access to tier-1 mirrors, if the 50 allowed connections are exhausted?
[19:13:33] <deep42thought> yeah, with "create temporary tables" it works :-)
[19:20:16] <tyzoid> :)
[19:20:30] <tyzoid> deep42thought: just set up rsync on my system
[19:20:43] <tyzoid> so you can rsync://32.arlm.tyzoid.com again
[19:21:09] <deep42thought> I do?
[19:21:40] <tyzoid> No, not that you need to set it up
[19:21:48] <tyzoid> by "you can" I'm using the general "you"
[19:22:09] <tyzoid> "It's possible to use rsync://... again"
[19:22:15] <tyzoid> is what the intended meaning was
[19:24:41] <deep42thought> ah, sry for the confusion
[19:24:54] <tyzoid> no problem. My statement was a bit confusing
[19:24:59] <deep42thought> I was wondering if I synced my alarm mirror from yours
[19:25:09] <tyzoid> I don't have an alarm mirror :P
[19:25:26] <deep42thought> ah
[19:25:41] <deep42thought> I always get confused by the "arlm" part in your domain ...
[19:25:58] <tyzoid> arlm = ARch Linux Mirror
[19:26:04] <tyzoid> That's where the name came fom
[19:26:05] <deep42thought> btw: What do you think of an ip filter for rsync on the master mirror?
[19:26:21] <tyzoid> I'm down with it. Just make sure we capture all the mirrors that sync from us.
[19:26:27] <tyzoid> not sure if any of 'em have rotating IPs
[19:30:01] <deep42thought> yeah, I see quite some non-reverse-dns'able ips
[19:36:24] <tyzoid> deep42thought: Any ideas about how to get around the max connections issue for now?
[19:38:49] <deep42thought> whitelist our servers by ip
[19:39:56] <tyzoid> lol, I mean without doing that
[19:40:03] <tyzoid> syncing through sshfs would work, but it'd be a pain
[19:40:11] <deep42thought> gimme a sec
[19:40:15] <tyzoid> can rsync work on an sshfs-only connection?
[19:40:23] <deep42thought> I think not
[19:40:34] <deep42thought> it basically calls "rsync" on the other end
[19:40:58] <tyzoid> That's what I thought
[19:41:08] <tyzoid> Just looked it up, and that's what it says too
[19:41:16] <tyzoid> Thought there might be some way around it
[19:41:19] <tyzoid> but oh well
[19:41:58] <deep42thought> you want to sync from srv1?
[19:42:14] <tyzoid> Can you whitelist both IPs?
[19:42:19] <deep42thought> sure
[19:42:20] <tyzoid> srv0 and srv1?
[19:42:40] <tyzoid> I'll likely stick on srv1, but it's nice to have both
[19:57:40] <tyzoid> deep42thought: once we get this situated, do you want to direct most tier-2 traffic over to my system?
[20:00:59] <deep42thought> yeah, I might close rsync on the master mirror for all except our tier 1 mirrors
[20:01:15] <deep42thought> but first I need to finish that construction-site-puzzle here
[20:11:29] <tyzoid> jonathon: FYI, if you want to rsync, I've got my mirror set up for rsync access now.
[20:11:53] <tyzoid> we're working out the rest of the kinks with the master rsync server, but this should work for now.
[20:14:08] <jonathon> ah, cool; i'll have a look at rsync in a bit :)
[20:16:23] <jonathon> though it looks like my issue is with the Manjaro "boxit" server tool rather than my merged mirror; it will happily sync changed package files but ignores changed signature files so i suspect i need to file a bug
[20:17:00] <tyzoid> jonathon: The signatures (for pacman/aplm based tools) are actually in the *.db files
[20:17:13] <tyzoid> that's why -Syy grabs those, even if it "thinks" they're up to day
[20:17:14] <tyzoid> date*
[20:18:39] <jonathon> right... that would make sense
[20:19:23] <jonathon> the "boxit" tool grabs the package database, then package files, so it can rebuild the package database with the Manjaro-specific overlay files
[20:19:50] <tyzoid> deep42thought: Jerry-rigged rsync through sshfs to get a working sync one-time
[20:19:57] <jonathon> so if the package file hasn't changed, it won't re-sync the signature, even if it has changed in the database... i reckon
[20:20:04] <tyzoid> jonathon: Correct
[20:20:08] <tyzoid> And that's just the signature
[20:20:39] <jonathon> that's definitely a bug to file then...
[20:20:44] * jonathon heads off to GitHub
[20:20:48] <tyzoid> :)
[20:32:02] <tyzoid> deep42thought: Successful sync via sshfs
[20:38:17] <jonathon> oh sh... every synced package in the manjaro32 repos is signed with the expired key.. i need server-side intervention
[20:45:53] <tyzoid> :(
[20:46:09] <tyzoid> jonathon: There should be a bunch with abaumann's good key
[20:54:42] <deep42thought> jonathon: sry, I just resigned all packages which were originally signed with my key
[20:55:01] <jonathon> deep42thought: it's not your fault, it's an issue with the manjaro server software
[20:55:42] <jonathon> this won't have been thought of as a use-case ;)
[20:57:49] <tyzoid> deep42thought: Polichronucci's master key expires in 35 days
[20:58:21] <deep42thought> oh
[20:58:44] <tyzoid> At least we've increased our notice period from 3 days to 30 :P
[21:01:57] <tyzoid> deep42thought: IIRC rewby has a master key still.
[21:02:32] <tyzoid> So in theory, we'd only need to get him to sign your key
[21:04:21] <tyzoid> and maybe abaumann's key
[21:09:09] <deep42thought> I have 4 signatures already :-)
[21:09:28] <deep42thought> City-busz, Polichronucci, I and you
[21:10:55] <tyzoid> Ah, nice.
[21:11:04] <deep42thought> wait
[21:11:06] <deep42thought> no
[21:11:11] <deep42thought> rewbycraft
[21:11:17] <tyzoid> Does abaumann have three (excluding polichronucci)?
[21:11:19] <deep42thought> I lost track
[21:11:26] <deep42thought> I think, he has 5
[21:11:56] <tyzoid> I've got 2 excluding poli's key, but for some reason, pgp.mit.edu doesn't show that I've signed my own key :P
[21:12:08] <tyzoid> So once I do that, I'll be back up to three without his key
[21:12:32] <deep42thought> abaumann has 4
[21:17:42] -!- isacdaavid has quit [Quit: Leaving.]
[21:27:24] * buildmaster resumes sanity.
[21:28:02] <buildmaster> firefox-developer-edition is broken (says rechenknecht).
[21:35:46] -!- oaken-source has quit [Quit: leaving]
[22:14:02] -!- abaumann has joined #archlinux32
[22:14:19] <tyzoid> deep42thought: When I migrate the bugtracker over, should I stick with flyspray? Or should I look at migrating it to bugzilla now?
[22:14:26] <tyzoid> abaumann: ^ is a good one for you too
[22:14:30] <tyzoid> wb, btw
[22:14:32] <abaumann> aeh.. just in case there was a dramatic increase in downloads from certain rsync mirrors lately.. this was a script of mine running amok.
[22:14:35] <abaumann> hi
[22:14:48] <tyzoid> lol, we noticed
[22:15:09] <abaumann> I fought with network problems the whole evening just to find out. that a sync script was not checking and writting a lockfile as I thought it would.
[22:15:25] <abaumann> * abaumann feels like a real rookie at the moment..
[22:15:36] <tyzoid> lol
[22:15:57] <abaumann> mmh. bugzilla or flyspray.. mmmh.
[22:17:18] <abaumann> the bug reporting tool is not in heavy use. :-(
[22:17:44] <deep42thought> sry
[22:17:57] <abaumann> No.. not by us.. by actual users. :-)
[22:17:59] <deep42thought> I'm mostly busy reanimating the buildmaster
[22:18:16] <abaumann> mouth to mouth? ;-)
[22:19:23] <abaumann> well. I'm fine with both. and our flyspry looks quite nice compared to the upstream one *cough
[22:19:44] <tyzoid> you're thinking resuscitation. deep42thought is talking reanimation.
[22:19:54] <tyzoid> lol, our flyspray is default style
[22:19:59] <abaumann> not too many details. :-)
[22:20:12] <abaumann> * abaumann: more nervous coughing..
[22:20:44] <abaumann> aha, oaken-source did a Vala bootstrapping, nice.. will borrow there..
[22:20:55] <tyzoid> btw, abaumann: If you haven't seen, here's the migration progress https://srv0.tyzoid.com => https://srv1.tyzoid.com
[22:21:21] <tyzoid> All the arch/arch32 stuff used to be on srv0
[22:21:44] <abaumann> ah. and you are separating things now.
[22:21:58] <tyzoid> Well I
[22:22:02] <abaumann> BTW: the SSL checker is nice :-)
[22:22:18] <tyzoid> Yup. Just need to configure it sending out email alerts
[22:22:36] <tyzoid> but yeah, got a hypervisor on srv1, so I'm moving everything off srv0 so I can set up a hypervisor on that
[22:23:05] <abaumann> that's a good thing.
[22:23:12] <deep42thought> tyzoid: for email alerts you should check out ssl-cert-check or my fork crypt-expiry-check
[22:30:21] -!- abaumann has quit [Quit: leaving]
[22:31:07] <tyzoid> deep42thought: Is that in a repo you've got? Or in archlinux32 namespace?
[22:31:25] <deep42thought> crypt-expiry-check is in [archlinuxewe]
[22:31:39] <deep42thought> for ssl-cert-check I'd need to look ...
[22:32:51] <deep42thought> https://github.com
[22:33:41] <tyzoid> I see
[22:36:12] -!- jonathon has quit [Quit: Quit]
[22:50:11] -!- deep42thought has quit [Quit: Leaving.]
[23:11:05] -!- davor has quit [Ping timeout: 240 seconds]
[23:16:38] -!- davor has joined #archlinux32