#archlinux32 | Logs for 2022-07-27

Back
[01:35:57] -!- GNUtoo has quit [Ping timeout: 268 seconds]
[01:37:41] -!- GNUtoo has joined #archlinux32
[02:47:53] -!- GNUtoo has quit [Remote host closed the connection]
[02:47:54] -!- drathir_tor has quit [Remote host closed the connection]
[03:33:18] -!- GNUtoo has joined #archlinux32
[03:38:17] -!- drathir_tor has joined #archlinux32
[04:17:31] -!- GNUtoo has quit [Ping timeout: 268 seconds]
[04:19:31] -!- drathir_tor has quit [Remote host closed the connection]
[04:19:55] -!- drathir_tor has joined #archlinux32
[04:30:30] -!- GNUtoo has joined #archlinux32
[04:34:05] -!- drathir_tor has quit [Remote host closed the connection]
[04:39:38] -!- drathir_tor has joined #archlinux32
[04:46:05] -!- GNUtoo has quit [Remote host closed the connection]
[04:51:29] -!- GNUtoo has joined #archlinux32
[06:06:27] -!- GNUtoo has quit [Remote host closed the connection]
[06:07:22] -!- GNUtoo has joined #archlinux32
[06:32:34] -!- drathir_tor has quit [Ping timeout: 268 seconds]
[06:41:44] -!- drathir_tor has joined #archlinux32
[08:30:56] -!- drathir_tor has quit [Remote host closed the connection]
[08:37:55] -!- GNUtoo has quit [Read error: Connection reset by peer]
[08:43:10] -!- GNUtoo has joined #archlinux32
[08:46:21] -!- drathir_tor has joined #archlinux32
[09:38:20] -!- GNUtoo has quit [Remote host closed the connection]
[09:53:45] -!- GNUtoo has joined #archlinux32
[10:49:38] -!- GNUtoo has quit [Remote host closed the connection]
[11:03:17] -!- drathir_tor has quit [Ping timeout: 268 seconds]
[11:07:52] -!- GNUtoo has joined #archlinux32
[11:11:55] -!- drathir_tor has joined #archlinux32
[11:54:54] -!- drathir_tor has quit [Remote host closed the connection]
[11:55:26] -!- drathir_tor has joined #archlinux32
[12:12:58] -!- drathir_tor has quit [Ping timeout: 268 seconds]
[12:13:17] -!- titus_livius has joined #archlinux32
[12:29:29] -!- drathir_tor has joined #archlinux32
[12:36:24] -!- GNUtoo has quit [Ping timeout: 268 seconds]
[12:50:07] -!- GNUtoo has joined #archlinux32
[12:57:22] -!- GNUtoo has quit [Ping timeout: 268 seconds]
[13:07:49] -!- GNUtoo has joined #archlinux32
[14:30:20] -!- drathir_tor has quit [Remote host closed the connection]
[14:39:44] -!- GNUtoo has quit [Ping timeout: 268 seconds]
[14:40:49] -!- drathir_tor has joined #archlinux32
[14:40:57] -!- drathir_tor has quit [Remote host closed the connection]
[14:51:13] -!- drathir_tor has joined #archlinux32
[14:51:19] -!- GNUtoo has joined #archlinux32
[16:10:46] -!- GNUtoo has quit [Remote host closed the connection]
[16:11:03] -!- GNUtoo has joined #archlinux32
[16:17:06] -!- GNUtoo has quit [Remote host closed the connection]
[16:17:26] -!- GNUtoo has joined #archlinux32
[16:57:20] -!- titus_livius has joined #archlinux32
[16:58:29] -!- drathir_tor has quit [Ping timeout: 268 seconds]
[17:04:11] -!- drathir_tor has joined #archlinux32
[17:17:09] -!- drathir_tor has quit [Remote host closed the connection]
[17:17:37] -!- drathir_tor has joined #archlinux32
[18:51:42] -!- sunshavi has quit [Ping timeout: 245 seconds]
[18:51:57] -!- drathir_tor has quit [Ping timeout: 268 seconds]
[19:13:49] -!- sunshavi has joined #archlinux32
[19:32:45] -!- drathir_tor has joined #archlinux32
[19:34:21] -!- drathir_tor has quit [Remote host closed the connection]
[19:38:27] -!- abaumann has joined #archlinux32
[19:38:27] <buildmaster> Hi abaumann!
[19:38:27] <buildmaster> !rq abaumann
[19:38:28] <phrik> buildmaster: <abaumann> the better the lint tools of a language, the crappier the language ;-)
[19:38:43] <abaumann> buildmaster database and replication is completely broken at the moment..
[19:38:49] <abaumann> ..I'm trying to resync the slave
[19:38:59] <abaumann> the master had binlogs disabled, I don't understand that..
[19:39:29] <abaumann> executing intensions results in weird errors and then the file gets deleted.. ahem.. :-)
[19:57:37] -!- drathir_tor has joined #archlinux32
[20:26:56] -!- drathir_tor has quit [Remote host closed the connection]
[20:32:26] -!- drathir_tor has joined #archlinux32
[20:55:48] <girls> if the file gets deleted, the buildmaster considers it executed successfully
[21:03:22] <abaumann> Cool. Well, resynched the slave and I still get thinks like "Slave SQL: Could not execute Delete_rows_v1 event on table fluxbb.online; Can't find record in 'online', Error_code: 1032; handler error HA_ERR_KEY_NOT_FOUND; the event's master log mysql-bin.001532, end_log_pos 4705, Gtid 0-1-27235117, Internal MariaDB error code: 1032"
[21:03:28] <abaumann> This database taps on my nerves..
[21:03:41] <girls> fluxbb?
[21:03:45] <girls> this sounds like the forum
[21:03:57] <abaumann> mmh..
[21:05:10] <girls> the intentions don't work, currently, because the required directory is missing
[21:05:15] <girls> there's not much, which I can do
[21:05:22] -!- deep42thought has joined #archlinux32
[21:05:22] <buildmaster> Hi deep42thought!
[21:05:22] <buildmaster> !rq deep42thought
[21:05:23] <phrik> buildmaster: <deep42thought> well, we have too few hands to hold each user's hand ;-)
[21:06:48] <deep42thought> it's "just" some new staging packages - I would skip the intentions and see, what is really broken, then :)
[21:07:33] <abaumann> yeah. though about that too. and I might have to skip some binlog entries to get replication working again.
[21:07:56] <deep42thought> for replication, there's a bootstrap script
[21:08:03] <deep42thought> which copies the last db dump and starts from that
[21:08:06] <abaumann> yeah, did that twice.
[21:08:21] <deep42thought> devops/re-bootstrap-slave-db
[21:08:22] <abaumann> but, I think I have to stop all activity on the bbs, etc.
[21:08:23] <deep42thought> :-/
[21:08:40] <deep42thought> you should *not* do this on the master
[21:08:40] <abaumann> otherwise, online users write into fluxbb users and then things change again :-)
[21:08:49] <deep42thought> this script is intended for the mysql slaves
[21:08:52] <abaumann> no, but I have to stop httpd on the buildmater
[21:08:57] <deep42thought> ?
[21:08:59] <deep42thought> why?
[21:09:11] <deep42thought> this script does not sync the whole db
[21:09:14] <deep42thought> only the buildmaster part
[21:09:31] <abaumann> ah.
[21:09:35] <deep42thought> at least, that's the part, which the mysql slaves care about
[21:09:50] <deep42thought> actually it *might* copy the whole db, but the slaves only use the buildmaster part
[21:10:03] <deep42thought> interesting point, btw.
[21:10:16] <deep42thought> it might be a good idea to restrict this to the buildmaster db
[21:11:50] <deep42thought> buildmaster seems sane after removing the intentions
[21:12:03] <deep42thought> so the only thing will be some python-* package, that is missing from staging, now ...
[21:12:09] <abaumann> it just blocked today with something. no slaves where running..
[21:12:20] <abaumann> missing staging package is really harmless.. :-)
[21:12:28] <deep42thought> yeah, because the intention could not complete, because the tmpdir was gone
[21:12:34] <abaumann> ..especially python ones :->
[21:12:50] <deep42thought> well, some time, it will block the movement of more python packages >-:)
[21:12:51] <abaumann> you don't write the tmpfiles into /tmp, do you?
[21:12:58] <deep42thought> I don't
[21:12:59] <abaumann> they might be away after a reboot :-)
[21:13:06] <deep42thought> they're in ~/builder/work/
[21:13:16] <abaumann> tmp.* something?
[21:13:21] <deep42thought> exactly
[21:16:04] <abaumann> Jul 27 21:15:35 archlinux32 mariadbd[5636]: 2022-07-27 21:15:35 135 [ERROR] Slave I/O: Got fatal error 1236 from master when reading data from binary log: 'log event entry exceeded max_allowed_packet; Increase max_allowed_packet on master; the first event 'mysql-bin.001532' at 4477, the last event read from 'mysql-bin.001532' at 4477, the last byte read from 'mysql-bin.001532' at 4496.', Internal [22:17:31] -!- titus_livius has joined #archlinux32 [22:17:52] -!- titus_livius has joined #archlinux32
[22:19:13] -!- titus_livius has joined #archlinux32
[22:19:20] <abaumann> there there
[22:20:03] <KillerWasp> abaumann: xD
[22:20:15] <KillerWasp> very sure
[22:21:23] <abaumann> Could not find first log file name in binary log index file', Internal MariaDB error code: 1236
[22:21:31] <abaumann> grmlpflfpfhg
[22:23:43] <abaumann> Increase max_allowed_packet on master; the first event 'mysql-bin.001536
[22:23:48] <abaumann> and back to the original problem..
[22:24:38] <abaumann> Slave: Can't find record in 'ssh_log' Error_code: 1032
[22:24:40] <abaumann> aha.
[22:24:50] <abaumann> Jul 27 22:24:25 archlinux32 mariadbd[405]: 2022-07-27 22:24:25 95 [ERROR] Slave SQL: Could not execute Update_rows_v1 event on table buildmaster.ssh_log; Can't find record in 'ssh_log', Error_code: 1032; handler error HA_ERR_KEY_NOT_FOUND; the event's master log mysql-bin.001536, end_log_pos 17752, Gtid 0-1-27239471, Internal MariaDB error code: 1032
[22:25:22] <abaumann> it's quite hard: something is constantly writting into the ssh_log on the buildmaster (also known as build slaves).
[22:25:38] <abaumann> so this way you cannot do a conisistent resync of the database.
[22:25:47] <abaumann> switch off _all_ writer to mysql
[22:26:02] <abaumann> purge the binlogs (bonus points if you manage also to purge the _current
[22:26:06] <abaumann> _ one)
[22:26:08] <abaumann> then dump
[22:26:12] <abaumann> the reimport on the slave
[22:26:16] <abaumann> the reenable binlogs
[22:26:27] <abaumann> then reenable the slave, start syncing.
[22:26:33] <abaumann> then reenable all writers on the master
[22:26:35] <abaumann> uff
[22:26:54] <abaumann> no wonders you need consultants to use this kind of software.. :-)
[22:28:28] <abaumann> select count(*) from ssh_log;
[22:28:31] <abaumann> 23976978
[22:28:39] <abaumann> we should maybe keep logs in a - well - logfile? :-)
[22:53:01] <KillerWasp> yes, i find better a txt file for logs
[22:53:48] <KillerWasp> ssh_log sound like a output of ssh remote, if i'm correct
[22:54:14] <abaumann> it's used to see when the slave has connected to the build master and what operations what it did/
[22:56:46] <KillerWasp> still, mariadb generates too much garbage in the database for each line of output. Instead with a txt file it is cleaner. It is what is normally used even in the log output for httpd(apache). Which you can filter later if you want to search for something.
[22:58:28] <KillerWasp> The logs are usually separated by states, accesses, errors, or other options
[22:59:13] <KillerWasp> one for each file of logs
[23:01:02] <KillerWasp> for my server web i have separate in directories for each website, and a file log for each option of output
[23:02:04] <KillerWasp> for my program, i make a log of general, error, for each module, output of each channel, etc.
[23:03:13] <KillerWasp> Although for source code I have never used a complex build system. The most I've done is store the output of builds in different files, like config step, build step, and install step.
[23:05:24] <KillerWasp> For in your case I don't think it's that much of a problem, just delete mariadb, and store it in a txt file, and you can store much more than 23 million lines.
[23:06:55] <KillerWasp> although I find it more verbose to separate it into different output files.
[23:07:07] <KillerWasp> s/verbose/prolix/
[23:39:30] -!- abaumann has quit [Quit: leaving]