March 30, 2019 
< | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | 13 | 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | 22 | 23 | 24 | 25 | 26 | 27 | 28 | 29 | 30 | 31 | >
March 30, 2019 [00:05:00] *** jimklimov <jimklimov!~jimklimov@ip-86-49-245-88.net.upcbroadband.cz> has joined #illumos[00:06:03] *** merzo <merzo!~merzo@178-49-133-95.pool.ukrtel.net> has joined #illumos[00:15:46] *** ruid <ruid!~ruid@unaffiliated/ruid> has quit IRC (Ping timeout: 250 seconds)[00:19:07] *** ruid <ruid!~ruid@unaffiliated/ruid> has joined #illumos[00:19:08] *** ruid <ruid!~ruid@unaffiliated/ruid> has quit IRC (Remote host closed the connection)[00:38:13] *** ruid <ruid!~ruid@unaffiliated/ruid> has joined #illumos[00:41:53] *** kkantor <kkantor!~kkantor@c-24-118-59-107.hsd1.mn.comcast.net> has joined #illumos[00:42:08] *** kkantor <kkantor!~kkantor@c-24-118-59-107.hsd1.mn.comcast.net> has quit IRC (Client Quit)[01:04:01] *** tomww <tomww!~tom@unaffiliated/tomww> has quit IRC (Remote host closed the connection)[01:07:40] *** tomww <tomww!~tom@unaffiliated/tomww> has joined #illumos[01:11:28] *** andy_js <andy_js!~andy@94.6.62.238> has quit IRC (Quit: andy_js)[01:23:30] *** khng300 <khng300!~khng300@unaffiliated/khng300> has quit IRC (Ping timeout: 250 seconds)[01:24:50] *** TheGreekOwl <TheGreekOwl!~Arkomeda@2a02:587:4826:700:8c52:8d48:6fd9:9119> has quit IRC (Quit: I must go, my planet needs me.)[01:36:04] *** merzo <merzo!~merzo@178-49-133-95.pool.ukrtel.net> has quit IRC (Ping timeout: 250 seconds)[02:08:34] *** ruid_ <ruid_!~ruid@unaffiliated/ruid> has joined #illumos[02:11:02] *** ruid <ruid!~ruid@unaffiliated/ruid> has quit IRC (Ping timeout: 250 seconds)[02:18:32] *** ruid_ <ruid_!~ruid@unaffiliated/ruid> has quit IRC (Remote host closed the connection)[02:19:04] *** ruid_ <ruid_!~ruid@unaffiliated/ruid> has joined #illumos[02:20:00] *** ed209 <ed209!~ed209@165.225.128.67> has quit IRC (Remote host closed the connection)[02:20:08] *** ed209 <ed209!~ed209@165.225.128.67> has joined #illumos[02:21:17] *** ruid_ <ruid_!~ruid@unaffiliated/ruid> has quit IRC (Read error: Connection reset by peer)[02:45:33] *** sinner <sinner!~themsay@149.254.235.9> has joined #illumos[02:46:08] *** sinner is now known as Guest54167[02:48:51] *** Guest41655 <Guest41655!~themsay@149.254.234.153> has quit IRC (Ping timeout: 246 seconds)[02:51:11] *** _mjg <_mjg!mjg@fook.org> has joined #illumos[03:02:33] *** khng300 <khng300!~khng300@unaffiliated/khng300> has joined #illumos[03:30:45] *** jimklimov <jimklimov!~jimklimov@ip-86-49-245-88.net.upcbroadband.cz> has quit IRC (Quit: Leaving.)[03:34:03] *** jcea <jcea!~Thunderbi@2001:41d0:1:8a82:7670:6e00:7670:6e00> has quit IRC (Quit: jcea)[04:55:14] *** kujira <kujira!~null@67-42-147-141.ptld.qwest.net> has joined #illumos[04:59:04] *** freakazoid0223 <freakazoid0223!~matt@pool-108-52-159-210.phlapa.fios.verizon.net> has quit IRC (Remote host closed the connection)[05:17:00] *** rzezeski <rzezeski!uid151901@gateway/web/irccloud.com/x-ktozuykcjujdtchd> has quit IRC (Quit: Connection closed for inactivity)[05:23:47] *** hemi770_ <hemi770_!~hemi666@unaffiliated/hemi770> has joined #illumos[05:26:22] *** hemi770 <hemi770!~hemi666@unaffiliated/hemi770> has quit IRC (Ping timeout: 272 seconds)[05:36:00] *** sarvet <sarvet!~sarvet@dslb-092-072-009-068.092.072.pools.vodafone-ip.de> has quit IRC (Quit: sarvet)[06:14:48] *** phyre__ <phyre__!~phyre___@31.211.191.164> has joined #illumos[06:21:17] *** phyre__ <phyre__!~phyre___@31.211.191.164> has quit IRC (Ping timeout: 245 seconds)[07:21:09] *** clapont <clapont!~clapont@unaffiliated/clapont> has quit IRC (Ping timeout: 246 seconds)[08:18:36] *** retpoline <retpoline!~retpoline@gateway/tor-sasl/retpoline> has joined #illumos[08:24:16] *** lewellyn <lewellyn!~lewellyn@about/windows/lewellyn> has quit IRC (Remote host closed the connection)[08:28:18] *** lewellyn <lewellyn!~lewellyn@about/windows/lewellyn> has joined #illumos[08:28:18] *** ChanServ sets mode: +o lewellyn[08:37:20] *** hemi770_ is now known as hemi770[08:49:38] *** alanc <alanc!~alanc@129.157.69.45> has quit IRC (Remote host closed the connection)[08:50:05] *** alanc <alanc!~alanc@129.157.69.45> has joined #illumos[09:11:29] *** merzo <merzo!~merzo@178-49-133-95.pool.ukrtel.net> has joined #illumos[09:26:06] *** merzo <merzo!~merzo@178-49-133-95.pool.ukrtel.net> has quit IRC (Ping timeout: 246 seconds)[10:06:31] *** gitomat <gitomat!~nodebot@165.225.148.18> has quit IRC (Remote host closed the connection)[10:06:42] *** gitomat <gitomat!~nodebot@165.225.148.18> has joined #illumos[11:01:34] *** lewellyn <lewellyn!~lewellyn@about/windows/lewellyn> has quit IRC (Ping timeout: 250 seconds)[11:04:30] *** _joes_ <_joes_!~Thunderbi@santoroj.plus.com> has joined #illumos[11:06:38] *** Guest54167 <Guest54167!~themsay@149.254.235.9> has quit IRC (Read error: Connection reset by peer)[11:07:03] *** sinner <sinner!~themsay@149.254.235.9> has joined #illumos[11:07:26] *** sinner is now known as Guest48028[11:12:35] *** Guest48028 <Guest48028!~themsay@149.254.235.9> has quit IRC (Read error: Connection reset by peer)[11:12:44] *** sinner <sinner!~themsay@149.254.235.9> has joined #illumos[11:13:08] *** sinner is now known as Guest23756[11:15:53] *** lewellyn <lewellyn!~lewellyn@about/windows/lewellyn> has joined #illumos[11:16:05] *** ChanServ sets mode: +o lewellyn[11:17:29] *** BH23 <BH23!~BH23@santoroj.plus.com> has joined #illumos[11:20:00] *** ed209 <ed209!~ed209@165.225.128.67> has quit IRC (Remote host closed the connection)[11:20:08] *** ed209 <ed209!~ed209@165.225.128.67> has joined #illumos[11:24:24] *** psarria <psarria!~psarria@98.red-79-150-188.dynamicip.rima-tde.net> has quit IRC (Ping timeout: 246 seconds)[11:27:23] *** psarria <psarria!~psarria@142.red-79-146-98.dynamicip.rima-tde.net> has joined #illumos[11:52:57] *** _joes_ <_joes_!~Thunderbi@santoroj.plus.com> has quit IRC (Ping timeout: 245 seconds)[11:54:12] *** BH23 <BH23!~BH23@santoroj.plus.com> has quit IRC (Ping timeout: 245 seconds)[12:16:42] *** khng300 <khng300!~khng300@unaffiliated/khng300> has quit IRC (*.net *.split)[12:16:43] *** AndrewG <AndrewG!~andrew@a20.cucumber.me.uk> has quit IRC (*.net *.split)[12:16:43] *** Zakureth <Zakureth!~IceChat9@66-190-248-86.dhcp.astr.or.charter.com> has quit IRC (*.net *.split)[12:16:43] *** sjorge <sjorge!~sjorge@unaffiliated/sjorge> has quit IRC (*.net *.split)[12:16:43] *** atrius <atrius!~atrius@99-160-139-232.lightspeed.nsvltn.sbcglobal.net> has quit IRC (*.net *.split)[12:16:43] *** nahamu <nahamu!~nahamu@165.225.132.70> has quit IRC (*.net *.split)[12:16:43] *** jeffpc <jeffpc!~jeffpc@josefsipek.net> has quit IRC (*.net *.split)[12:16:43] *** murr4y <murr4y!ali@11.0.196.35.bc.googleusercontent.com> has quit IRC (*.net *.split)[12:16:51] *** atrius <atrius!~atrius@2600:1700:22d1:518:39e3:9332:2309:f712> has joined #illumos[12:17:00] *** jeffpc <jeffpc!~jeffpc@josefsipek.net> has joined #illumos[12:17:07] *** khng300 <khng300!~khng300@unaffiliated/khng300> has joined #illumos[12:17:14] *** nahamu <nahamu!~nahamu@165.225.132.70> has joined #illumos[12:17:35] *** murr4y <murr4y!ali@11.0.196.35.bc.googleusercontent.com> has joined #illumos[12:18:14] *** Zakureth <Zakureth!~IceChat9@66-190-248-86.dhcp.astr.or.charter.com> has joined #illumos[12:19:03] *** sjorge <sjorge!~sjorge@unaffiliated/sjorge> has joined #illumos[12:19:31] *** joltman <joltman!~znc@unaffiliated/joltman> has quit IRC (Ping timeout: 255 seconds)[12:20:25] *** copec <copec!~copec@schrodbox.unaen.org> has quit IRC (Ping timeout: 255 seconds)[12:21:45] *** joltman <joltman!znc@gateway/vpn/privateinternetaccess/joltman> has joined #illumos[12:23:45] *** copec <copec!~copec@schrodbox.unaen.org> has joined #illumos[12:32:00] *** btibble <btibble!~brantibbl@c-69-94-200-89.hs.gigamonster.net> has quit IRC (Ping timeout: 250 seconds)[12:43:06] *** merzo <merzo!~merzo@178-49-133-95.pool.ukrtel.net> has joined #illumos[13:04:00] *** andy_js <andy_js!~andy@94.6.62.238> has joined #illumos[13:06:22] *** lewellyn <lewellyn!~lewellyn@about/windows/lewellyn> has quit IRC (Ping timeout: 250 seconds)[13:16:55] *** psarria <psarria!~psarria@142.red-79-146-98.dynamicip.rima-tde.net> has quit IRC (Remote host closed the connection)[13:24:52] *** lewellyn <lewellyn!~lewellyn@about/windows/lewellyn> has joined #illumos[13:24:52] *** ChanServ sets mode: +o lewellyn[13:29:22] *** snappy_ <snappy_!~snappy@50.29.175.228.res-cmts.sth3.ptd.net> has joined #illumos[13:31:08] *** snappy_ <snappy_!~snappy@50.29.175.228.res-cmts.sth3.ptd.net> has left #illumos ("Leaving")[13:35:19] *** jcea <jcea!~Thunderbi@2001:41d0:1:8a82:7670:6e00:7670:6e00> has joined #illumos[14:07:01] *** andy_js_ <andy_js_!~andy@94.6.62.238> has joined #illumos[14:18:37] *** slx86 <slx86!~Thunderbi@92-110-137-173.cable.dynamic.v4.ziggo.nl> has joined #illumos[14:19:34] *** mgerdts <mgerdts!~textual@96-41-228-208.dhcp.ftbg.wi.charter.com> has joined #illumos[14:26:31] *** clapont <clapont!~clapont@unaffiliated/clapont> has joined #illumos[14:26:44] *** slx86 <slx86!~Thunderbi@92-110-137-173.cable.dynamic.v4.ziggo.nl> has quit IRC (Quit: slx86)[14:39:01] *** clapont <clapont!~clapont@unaffiliated/clapont> has quit IRC (Ping timeout: 255 seconds)[14:46:30] *** clapont <clapont!~clapont@unaffiliated/clapont> has joined #illumos[14:50:37] *** andy_js <andy_js!~andy@94.6.62.238> has quit IRC (Quit: andy_js)[14:50:37] *** andy_js_ is now known as andy_js[15:04:13] *** lgtaube <lgtaube!~lgt@84.16.224.13> has quit IRC (Ping timeout: 245 seconds)[15:04:27] <clapont> hi everyone[15:10:56] <lewellyn> hi[15:13:02] *** andy_js_ <andy_js_!~andy@94.6.62.238> has joined #illumos[15:15:19] <gitomat> [illumos-gate] 10135 picl plugins need smatch fixes -- John Levon <john.levon at joyent dot com>[15:16:00] <jlevon> last of my queue... took a while...[15:17:16] *** btibble <btibble!~brantibbl@c-69-94-200-89.hs.gigamonster.net> has joined #illumos[15:21:59] *** lgtaube <lgtaube!~lgt@213-67-21-71-no84.tbcn.telia.com> has joined #illumos[15:25:59] *** lewellyn <lewellyn!~lewellyn@about/windows/lewellyn> has quit IRC (Read error: No route to host)[15:31:02] *** clapont <clapont!~clapont@unaffiliated/clapont> has quit IRC (Read error: Connection reset by peer)[15:31:25] *** clapont <clapont!~clapont@unaffiliated/clapont> has joined #illumos[15:32:25] *** lewellyn <lewellyn!~lewellyn@about/windows/lewellyn> has joined #illumos[15:32:25] *** ChanServ sets mode: +o lewellyn[15:39:33] *** freakazoid0223 <freakazoid0223!~matt@pool-108-52-159-210.phlapa.fios.verizon.net> has joined #illumos[15:43:33] *** khng300 <khng300!~khng300@unaffiliated/khng300> has quit IRC (Ping timeout: 250 seconds)[15:44:24] *** khng300 <khng300!~khng300@unaffiliated/khng300> has joined #illumos[16:01:00] *** tomoyat1 <tomoyat1!~tomoyat1@tomoyat1.com> has quit IRC (Quit: ZNC 1.6.5 - http://znc.in)[16:01:32] *** tomoyat1 <tomoyat1!~tomoyat1@tomoyat1.com> has joined #illumos[16:43:58] *** Kurlon <Kurlon!~Kurlon@98.13.72.207> has quit IRC (Remote host closed the connection)[16:51:21] *** wacki <wacki!~wacki@i577B8EC6.versanet.de> has joined #illumos[17:03:10] *** andy_js <andy_js!~andy@94.6.62.238> has quit IRC (Quit: andy_js)[17:03:10] *** andy_js_ is now known as andy_js[17:07:05] *** cantstanya <cantstanya!~chatting@gateway/tor-sasl/cantstanya> has quit IRC (Remote host closed the connection)[17:10:11] *** cantstanya <cantstanya!~chatting@gateway/tor-sasl/cantstanya> has joined #illumos[17:21:38] *** sarvet <sarvet!~sarvet@dslb-092-072-009-068.092.072.pools.vodafone-ip.de> has joined #illumos[17:38:13] *** pmooney <pmooney!~pmooney@50-93-251-200.fttp.usinternet.com> has quit IRC (Quit: WeeChat 2.4)[18:01:50] *** sinner <sinner!~themsay@149.254.235.9> has joined #illumos[18:02:13] *** sinner is now known as Guest2990[18:04:30] *** Guest23756 <Guest23756!~themsay@149.254.235.9> has quit IRC (Ping timeout: 250 seconds)[18:06:40] *** julian` <julian`!~julian@os.k/spectral> has joined #illumos[18:39:42] <toasterson> is there a good way to detect disk which have scsi delays?[18:40:09] <toasterson> i.e. those things that deadman likes to reap but just not long enough for it to trigger?[18:40:34] <toasterson> I have performance issues on a server and it seems to be the disk or controller. I would like to identify which[18:53:40] *** rsully <rsully!~rsully@unaffiliated/rsully> has joined #illumos[19:06:09] <LeftWing> So in SmartOS we've added a set of zone VFS-level kstats that aggregate per-operation I/O latencies into some coarse-grained buckets[19:06:51] <LeftWing> e.g., <10ms ops, 11-100ms ops, 101ms-1sec ops, >=10sec ops[19:07:05] <LeftWing> It seems like we could add something similar, but on a per-block device basis[19:12:16] <richlowe> iostat service times?[19:39:48] <toasterson> LeftWing yes I would like that[19:39:58] <toasterson> richlowe how would I do that?[19:47:32] <LeftWing> richlowe: They're only averages, though, right?[19:47:54] <LeftWing> Oh I suppose they're that integral thingy[19:50:50] <toasterson> iostat -d I guess?[19:52:24] <LeftWing> If you look at "iostat -xn 1"[19:53:32] <LeftWing> The asvc_t column will show you the average service time for requests in the previous second, basically[19:53:36] <LeftWing> On a per-device basis[19:53:59] * toasterson sent a long message: < http://192.168.10.17:8008/_matrix/media/v1/download/matrix.wegmueller.it/JLhlSoKMdIYiinMIsidHNdSX >[19:54:22] <LeftWing> err[19:54:26] * toasterson sent a long message: < http://192.168.10.17:8008/_matrix/media/v1/download/matrix.wegmueller.it/fvAKALkadZPwUtjAJRAWczuC >[19:54:26] *** merzo <merzo!~merzo@178-49-133-95.pool.ukrtel.net> has quit IRC (Ping timeout: 250 seconds)[19:54:43] <LeftWing> It looks like your Matrix thing is taking your long messages and making them available on an internal IP address[19:54:54] <LeftWing> You should paste multiline messages into gist.github.com or a pastebin[19:54:55] <toasterson> looool[19:55:04] <toasterson> yep will do[19:55:06] <LeftWing> Tah[19:55:48] <lewellyn> LeftWing: the matrix bridges are dumb about when to "sent a long messages" sometimes, sadly. not as bad as replying to a specific message, but still :P[19:56:30] <toasterson> Well I found the first thing bad about them so for the other good things they have I am quite happy with it.[19:56:39] <toasterson> Gist online https://gist.github.com/Toasterson/64a800c26448765c60aeb38a81755463 Leftwing[19:57:00] <toasterson> looks funny to mee. only the pool has the wait time really high[19:57:24] <LeftWing> Is that the first block of output from iostat[19:57:30] <toasterson> although uuuf the last disk 6.0 39.0 34.0 4227.7 0.0 1.1 0.0 24.1 0 91 c21t0d0[19:57:34] <toasterson> LeftWing yes[19:57:44] <toasterson> 24.1 wait time[19:58:15] <LeftWing> So the first block of output from iostat (and other *stat tools, generally) is the average values since _boot_[19:58:24] <LeftWing> Subsequent blocks will be the average values for the last time interval[19:59:30] <toasterson> ah. its the last of like twenty outputs[19:59:30] <LeftWing> https://gist.github.com/jclulow/cbe0ad51a098f06d177b85337bc7edc3 <-- e.g., I've asked for two samples, the first is the "from boot" one, always, the second here is the "for the last second" value[19:59:34] <LeftWing> Ah OK[20:00:05] <LeftWing> Is c4t0d0 a hot spare?[20:00:45] <LeftWing> Note that the pool-level entry is a bit special. The %b value for the pool is the percentage of time for which _any_ disk in the pool had an I/O in flight[20:01:29] <toasterson> c4t0d0 is rpool. and it's a seperate disk on a gluster backed kvm linux virtual machine host[20:01:44] <LeftWing> Ah OK. The other disks are in bkpool ?[20:01:56] <toasterson> only bkpool hangs if at all. updated the gist with the full output of iostat -xn 1[20:01:59] <toasterson> yes[20:02:27] <toasterson> it's a mut pool of one raidz2 and a currently resilvering threeway mirror[20:02:28] <LeftWing> c5t0d0 seems to have much higher averages than other things[20:02:39] <LeftWing> In terms of asvc_t and %b since boot[20:02:45] <toasterson> yeh that one was my candidate too[20:03:02] <LeftWing> In some of these samples c21t0d0 also looks a bit wonky[20:03:08] *** lewellyn <lewellyn!~lewellyn@about/windows/lewellyn> has quit IRC (Remote host closed the connection)[20:03:31] <toasterson> which is a disk veing currently resilvered into the three way mirror....[20:03:36] <LeftWing> If you "iostat -en", is every disk 0 in all columns?[20:03:40] <toasterson> used. and probably broken then[20:04:05] <toasterson> nope c5t0d0 has 164[20:04:21] <LeftWing> In which column[20:04:30] <toasterson> h/w and tot[20:04:33] <LeftWing> tot is the total of the others[20:05:00] <LeftWing> Can you add "iostat -En c5t0d0" output[20:05:25] <LeftWing> Also does "fmdump -e | tail" show anything recent[20:06:03] <toasterson> ou yep it show zfs checksumm error.[20:06:08] <toasterson> gist updated btw.[20:06:28] <toasterson> ah but they re from November[20:06:42] <toasterson> that was the oder failing disk in that server[20:07:20] <LeftWing> Does "zpool status" show you any non-zero values in the READ/WRITE/CKSUM columns right now?[20:07:36] <toasterson> nope all 0[20:07:40] <LeftWing> OK[20:07:45] <LeftWing> For what it's worth, c5t0d0 definitely feels wonky[20:08:11] <LeftWing> One of the rows shows zeroes for all devices except:[20:08:11] *** merzo <merzo!~merzo@62-36-132-95.pool.ukrtel.net> has joined #illumos[20:08:14] <LeftWing> 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0 100 c5t0d0[20:08:29] <LeftWing> 1.0 in the actv column means that there was, on average, 1 request in flight for the whole second[20:08:56] <toasterson> yep. can I offline that while the pool is resilvering? it is from a different vdev[20:09:14] <toasterson> I am hoping to speed up the resilver to manageable values again[20:09:16] <LeftWing> I think that's probably OK, but it will reduce redundancy[20:09:29] <toasterson> well that vdev is still raidz2[20:09:39] <LeftWing> OK so there'd still be another parity disk available[20:09:56] <LeftWing> Yeah you could try "zpool offline bkpool c5t0d0"[20:10:21] <toasterson> I added zpool status to the gist[20:10:49] <LeftWing> Oh it's all one big raidz2[20:10:50] <toasterson> i was actually hoping to replace c5t0d0 with c18t0d0 at some point[20:11:03] <toasterson> and the mirror[20:11:40] <LeftWing> So you can try offlining c5[20:11:51] <LeftWing> You can always online it again if it doesn't help[20:12:22] <toasterson> yep I gess that is the best course of action. Crossing fingers[20:12:37] <LeftWing> 19.8T is just a big pool, though -- resilvering is going to take some time either way[20:13:26] <toasterson> yes but hopefully it gets it's usuall performance of more tham 29Mb/s back after offlining c5[20:15:45] <toasterson> wohoo it worked[20:16:41] <toasterson> access time is still high but only in the resilvering vdev[20:18:39] <toasterson> but overall time is down[20:18:39] <LeftWing> Is performance going up?[20:18:43] <LeftWing> That's good[20:18:48] <toasterson> file access yes[20:20:07] <toasterson> and zfs rename has halfed from 24 seconds to 12 secods[20:20:12] <toasterson> estimated[20:20:39] <LeftWing> Are you trying to increase the resilver rate, or preserve interactive file system performance?[20:20:55] <LeftWing> (Like if you had to pick one or the other)[20:21:16] <toasterson> well in that case interactive filesystem performance[20:21:21] <LeftWing> OK[20:21:35] <toasterson> before the daily snapshotrun would take over 24h[20:21:40] <LeftWing> So I would arrange to replace c5t0d0 as soon as possible, by the way[20:21:47] <tsoome> can you test sorted scans?:)[20:22:02] <LeftWing> Because you're now operating with decreased redundancy[20:22:08] <toasterson> nope. very shared production machine[20:22:30] <tsoome> aww[20:22:32] <tsoome> ok[20:22:37] <toasterson> yes c18 in the mirror was supposed to replace c5[20:22:54] <toasterson> but i typod and added it as a single disk instead of spare[20:23:57] <toasterson> but we will be happy as users I guess.[20:24:11] <LeftWing> Oh I was misreading the pool topology[20:24:12] <toasterson> tsoome what do sorted scans improve?[20:24:27] <LeftWing> So c20t0d0 + c19t0d0 + (c18t0d0 / c21t0d0)[20:24:30] <LeftWing> That's a three way mirror?[20:24:31] <tsoome> scrub/resilver performance[20:24:49] *** Guest2990 <Guest2990!~themsay@149.254.235.9> has quit IRC (Read error: Connection reset by peer)[20:24:52] *** sinner <sinner!~themsay@149.254.235.9> has joined #illumos[20:24:55] <toasterson> Leftwing yes. making c18 redundant again[20:24:59] <LeftWing> OK[20:25:13] <tsoome> see the notes from https://www.illumos.org/rb/r/1226/[20:25:15] *** sinner is now known as Guest58976[20:25:24] <toasterson> and then finaly using c18 to replace c5[20:26:56] <toasterson> tsoome hmmm tempted..... but that system is causing enough trouble as it is without beta kernels :)[20:27:15] <tsoome> we have no beta;)[20:27:22] <tsoome> :D[20:28:15] <toasterson> Well yes. But still I guess compiling and installing with patches counts as beta.[20:28:22] <LeftWing> It does indeed.[20:29:22] <tsoome> true.[20:33:09] *** pmooney <pmooney!~pmooney@50-93-251-200.fttp.usinternet.com> has joined #illumos[20:33:14] <toasterson> in any case thanks for the assis Leftwing[20:34:34] <LeftWing> You're welcome! Sorry about your disk.[20:35:25] <LeftWing> tsoome: For this "usbftdi" thing, it feels like we also have to add an entry to "pkg/manifests/driver-serial-usbftdi.mf" that will cause an appropriate alias to be added, right?[20:35:27] *** Guest58976 <Guest58976!~themsay@149.254.235.9> has quit IRC (Ping timeout: 245 seconds)[20:35:48] <toasterson> well it was overused before and kept working for 1.5 years after showing badness so... had to come at some point[20:36:30] <toasterson> and using heavily used disks from a previous io heavy server is always risky[20:36:47] <tsoome> LeftWing: of but of course[20:36:55] <tsoome> oh*[20:36:58] <LeftWing> vendor FTDI = usb403 and product 232EX would be 6015[20:37:11] <LeftWing> I only see "alias=usb403,6001" in the pacakge[20:39:34] <tsoome> I do not know howcome I forgot about it:D[20:39:37] <LeftWing> It looks like it'd be enough to add alias=usb403,6015 in there[20:39:47] <LeftWing> Assuming it's a single port thing[20:41:56] <LeftWing> I have no idea how to buy one of these even if I wanted to haha[20:43:46] <tsoome> we have bunch of usb-serial dongles at work:)[20:44:46] <tsoome> need for serial ilom/xscf connections[20:45:13] <LeftWing> Yeah I have one for my laptop. I don't think it's this specific model though[20:46:08] <LeftWing> It sounds like the person who floated this part of the patch actually has one of these[20:47:15] <LeftWing> I wonder if they used: update_drv -a -i '"usb403,6001"' usbftdi[20:47:20] <LeftWing> In addition to the patch[20:48:01] <tsoome> could be, otherwise....[20:48:02] <tsoome> :D[20:48:30] <LeftWing> I suppose I'll send mail[20:53:00] <tsoome> um, btw, could you check on 10544?:)[20:53:31] <tsoome> it was posted for RTI and is blocking https://www.illumos.org/rb/r/1562/ :)[20:58:00] <LeftWing> When you say "Tested by setting the console devices and confirming the expected outcome" you mean, e.g., "set console=ttya" ?[21:02:35] *** sinner <sinner!~themsay@149.254.234.91> has joined #illumos[21:02:58] *** sinner is now known as Guest44744[21:12:26] *** merzo <merzo!~merzo@62-36-132-95.pool.ukrtel.net> has quit IRC (Ping timeout: 250 seconds)[21:17:57] <tsoome> yes, and attempted to set missing one[21:20:01] *** ed209 <ed209!~ed209@165.225.128.67> has quit IRC (Remote host closed the connection)[21:20:07] *** ed209 <ed209!~ed209@165.225.128.67> has joined #illumos[21:21:00] <gitomat> [illumos-gate] 10544 loader: console needs to test for failed devices -- Toomas Soome <tsoome at me dot com>[21:21:38] <tsoome> thanks:)[21:23:51] <LeftWing> You're welcome![21:26:29] *** pmooney <pmooney!~pmooney@50-93-251-200.fttp.usinternet.com> has quit IRC (Quit: WeeChat 2.4)[21:31:43] <toasterson> LeftWing are there any plans to upstream the kstats latency stuff you where talking about?[21:37:35] *** merzo <merzo!~merzo@62-36-132-95.pool.ukrtel.net> has joined #illumos[21:49:03] <LeftWing> So the kstat latency stuff we have in SmartOS won't help you here, but something similar might[21:49:16] <LeftWing> Ours is at the FS level, not at the disk level[21:49:47] <LeftWing> Absent any other information I would say we're eventually going to upstream what we have, it's just a matter of time and resources[21:51:50] <toasterson> well it would be interesting to have both in illumos upstream in any case. It's really good indocator of health and can tremendously help figuring out on what level performance is most likely being lost. and thus inform the admins better on what is happening.[21:56:43] *** Guest44744 <Guest44744!~themsay@149.254.234.91> has quit IRC (Ping timeout: 245 seconds)[21:59:12] *** julian` <julian`!~julian@os.k/spectral> has quit IRC (Ping timeout: 245 seconds)[22:18:32] <LeftWing> Yes. We added the VFS-level stats in particular so that we could come back after the fact and know whether or not a zone had experienced outlandishly long I/O times[22:18:42] <LeftWing> Which an average-since-boot can hide[22:23:25] *** julian` <julian`!~julian@static-176-139-89-213.ftth.abo.bbox.fr> has joined #illumos[22:23:26] *** julian` <julian`!~julian@static-176-139-89-213.ftth.abo.bbox.fr> has quit IRC (Changing host)[22:23:26] *** julian` <julian`!~julian@os.k/spectral> has joined #illumos[22:25:14] *** spectral` <spectral`!~julian@os.k/spectral> has joined #illumos[22:25:36] *** julian` <julian`!~julian@os.k/spectral> has quit IRC (Client Quit)[22:37:31] *** wacki <wacki!~wacki@i577B8EC6.versanet.de> has quit IRC (Quit: Lingo: www.lingoirc.com)[22:45:28] *** khng300 <khng300!~khng300@unaffiliated/khng300> has quit IRC (Ping timeout: 255 seconds)[22:47:38] *** khng300 <khng300!~khng300@unaffiliated/khng300> has joined #illumos[22:51:09] *** rsully <rsully!~rsully@unaffiliated/rsully> has quit IRC (Quit: rsully)[23:29:14] *** jubal <jubal!~jubal@226-5-237-24.gci.net> has joined #illumos