December 27, 2015 
< | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | 13 | 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | 22 | 23 | 24 | 25 | 26 | 27 | 28 | 29 | 30 | 31 | >
December 27, 2015 [00:09:26] *** Haza` is now known as Haza`Aw[00:40:23] *** qchris has quit IRC[01:18:41] *** mafi has quit IRC[01:19:10] *** xx4h has quit IRC[01:19:22] *** mafi has joined #gerrit[01:19:43] *** xx4h has joined #gerrit[01:47:06] <zifnab> anyone know why replication would be doing nothing?[01:47:20] <zifnab> its worked fine for a long time until this morning, now its just hanging on replication[01:47:37] <zifnab> (gerrit show-queue -w shows X tasks, count isn't going down, nothing has changed recently)[01:49:11] <zifnab> log shows absolutely nothing wrong, the user can ssh to remotes just fine[02:21:42] <yota> what did the logs said after a forced replication?[03:12:53] *** Vampire0 has joined #gerrit[03:16:23] *** Vampire0_ has quit IRC[03:31:01] <dougk> zifnab: sometimes, I've found issues related to a half-complete push (i.e. empty/corrupt objects on the remote)... running git fsck there helps me identify and remove those bad objects, then sometimes you have to push again.[03:31:27] <zifnab> yota: logs show absolutely nothing. swapping to https for the mirror appears to have partially fixed it, still hanging[03:31:27] <dougk> occasionally it'll result in "failed to lock" errors if you try the push from the master manually[03:32:17] <zifnab> i guess i've never seen this happen where there isn't a failure in the replication log[03:32:33] <zifnab> just...nothing. was wondering if maybe github had changed their ssh params and jsch wasn't working anymore[03:32:50] <dougk> ah, you're replicating to github?[03:32:53] <zifnab> yeah[03:32:56] <zifnab> about 1500 repos[03:33:00] <zifnab> (cyanogenmod project)[03:33:16] <dougk> oh wow XD[03:33:30] <dougk> hmmm... Luca might be able to tell you more, but I think github does have some rate-limiting stuff[03:34:05] <zifnab> it hasn't been a problem until today, oddly[03:34:32] <zifnab> and i've never seen it just hang like this (if github is ssh, all the mirrors hang as well. if its https, they all succeed)[03:35:08] <zifnab> usually there will be a (retry X) in show-queue if github is ratelimiting you (which i've had happen very rarely in the past)[03:35:30] <dougk> yeah, that'd make sense[03:35:45] <dougk> so, you're using the stock replication plugin, I take it?[03:36:22] <zifnab> in this case, yeah[03:36:35] <zifnab> maybe a gc fixed it, we will see[03:38:52] <dougk> the other thing I'd say... try the push command from the master's command line... frequently, when I have replication issues, that'll give me half a clue what the mirror is up to :)[03:39:39] <zifnab> worked fine, thats the confusing part[07:34:12] *** Tica2 has joined #gerrit[07:44:44] *** Tica2 has quit IRC[07:53:20] *** Tica2 has joined #gerrit[09:56:42] *** Haza`Aw is now known as Haza`[10:05:05] *** HeOS has quit IRC[11:09:10] *** zifnab has quit IRC[11:18:05] *** dborowitz has quit IRC[11:19:12] *** zifnab has joined #gerrit[11:31:54] *** dborowitz has joined #gerrit[11:38:30] *** zifnab has quit IRC[11:42:18] *** Haza` is now known as Haza`Aw[12:34:33] *** zifnab has joined #gerrit[12:39:44] *** zifnab has quit IRC[13:05:35] *** zifnab has joined #gerrit[14:05:36] *** doc_what has quit IRC[14:07:12] *** m0 has quit IRC[14:30:09] *** pamaury has joined #gerrit[15:03:14] *** docwhat has joined #gerrit[15:07:04] *** m0 has joined #gerrit[15:07:57] *** docwhat has quit IRC[15:11:38] *** m0 has quit IRC[15:16:44] *** Tica2 has quit IRC[15:22:58] *** qchris has joined #gerrit[15:47:15] *** docwhat has joined #gerrit[15:48:06] *** m0 has joined #gerrit[15:56:25] *** Juri_Agarin has quit IRC[15:57:13] *** Juri_Agarin has joined #gerrit[16:19:33] *** pamaury has quit IRC[16:30:34] *** kad has quit IRC[16:33:38] *** kad has joined #gerrit[17:01:29] *** Haza`Aw is now known as Haza`[17:21:17] *** pamaury has joined #gerrit[18:12:07] *** Tica2 has joined #gerrit[18:19:26] *** Tica2 has quit IRC[18:48:10] *** Tica2 has joined #gerrit[20:45:52] *** mafi has left #gerrit[20:59:34] *** zz_dimtruck is now known as dimtruck[21:08:40] *** HeOS has joined #gerrit[21:10:10] *** dimtruck is now known as zz_dimtruck[21:15:50] *** zz_dimtruck is now known as dimtruck[21:21:20] *** dimtruck is now known as zz_dimtruck[21:45:31] *** Tica2 has quit IRC[21:54:48] *** zz_dimtruck is now known as dimtruck[22:08:02] *** pamaury has quit IRC[22:23:52] *** dimtruck is now known as zz_dimtruck[22:57:41] *** Haza` is now known as Haza`Aw[23:22:31] *** mafi has joined #gerrit