August 24, 2016 
< | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | 13 | 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | 22 | 23 | 24 | 25 | 26 | 27 | 28 | 29 | 30 | 31 | >
August 24, 2016 [00:04:09] *** tdowg1 <tdowg1!~quassel@c-69-250-24-50.hsd1.md.comcast.net> has quit IRC (Ping timeout: 244 seconds)[00:23:33] *** andy_js <andy_js!~andy@90.219.225.136> has quit IRC (Quit: andy_js)[00:30:12] *** nikolam <nikolam!~nikolam@unaffiliated/nikolam> has quit IRC (Ping timeout: 240 seconds)[01:14:14] *** dmip <dmip!~Thunderbi@84.51.125.126> has quit IRC (Ping timeout: 250 seconds)[02:58:03] *** v_a_b <v_a_b!~volker@p5B37128C.dip0.t-ipconnect.de> has quit IRC (Ping timeout: 264 seconds)[03:03:09] *** v_a_b <v_a_b!~volker@p5B3712EE.dip0.t-ipconnect.de> has joined #omnios[03:32:46] *** bahamat <bahamat!~bahamat@ip72-199-207-63.sd.sd.cox.net> has quit IRC (Quit: Leaving.)[04:04:27] *** xzi11a <xzi11a!~robert@pool-71-244-148-68.bltmmd.fios.verizon.net> has joined #omnios[04:05:33] *** Botanic <Botanic!~Botanic@tita/admin/Botanic> has quit IRC (Ping timeout: 265 seconds)[04:06:26] *** Botanic <Botanic!~Botanic@tita/admin/Botanic> has joined #omnios[04:10:24] *** bahamat <bahamat!~bahamat@ip72-199-207-63.sd.sd.cox.net> has joined #omnios[04:57:58] *** danmcd <danmcd!~danmcd@static-108-48-124-82.washdc.fios.verizon.net> has quit IRC (Quit: Quitting)[05:12:36] *** bahamat <bahamat!~bahamat@ip72-199-207-63.sd.sd.cox.net> has quit IRC (Quit: Leaving.)[05:40:34] *** bahamat <bahamat!~bahamat@ip72-199-207-63.sd.sd.cox.net> has joined #omnios[05:50:55] *** xzi11a <xzi11a!~robert@pool-71-244-148-68.bltmmd.fios.verizon.net> has quit IRC (Ping timeout: 265 seconds)[05:57:48] *** bahamat <bahamat!~bahamat@ip72-199-207-63.sd.sd.cox.net> has quit IRC (Quit: Leaving.)[06:38:08] *** nikolam <nikolam!~nikolam@unaffiliated/nikolam> has joined #omnios[06:39:18] *** bahamat <bahamat!~bahamat@ip72-199-207-63.sd.sd.cox.net> has joined #omnios[06:52:45] *** slx86 <slx86!~slx86@46-129-44-239.dynamic.upc.nl> has joined #omnios[08:05:23] *** slx86 <slx86!~slx86@46-129-44-239.dynamic.upc.nl> has quit IRC (Quit: leaving)[08:11:49] *** bahamat <bahamat!~bahamat@ip72-199-207-63.sd.sd.cox.net> has quit IRC (Quit: Leaving.)[08:14:34] *** Toasterson <Toasterson!~toast@68.30.150.83.dyn.dsl.as8758.net> has joined #omnios[08:32:10] *** nikolam <nikolam!~nikolam@unaffiliated/nikolam> has quit IRC (Excess Flood)[08:33:09] *** nikolam <nikolam!~nikolam@unaffiliated/nikolam> has joined #omnios[08:46:22] *** k0nsl <k0nsl!~k0nsl@unaffiliated/k0nsl> has quit IRC (Ping timeout: 265 seconds)[08:59:20] *** matejz <matejz!~matejz@element.planetq.org> has joined #omnios[09:01:39] *** matejz <matejz!~matejz@element.planetq.org> has quit IRC (Client Quit)[09:04:18] *** dmip <dmip!~Thunderbi@84.51.125.126> has joined #omnios[09:04:32] *** nikolam <nikolam!~nikolam@unaffiliated/nikolam> has quit IRC (Ping timeout: 240 seconds)[09:07:55] *** nikolam <nikolam!~nikolam@unaffiliated/nikolam> has joined #omnios[09:23:58] *** k0nsl <k0nsl!~k0nsl@unaffiliated/k0nsl> has joined #omnios[09:53:50] *** k0nsl <k0nsl!~k0nsl@unaffiliated/k0nsl> has quit IRC (Ping timeout: 244 seconds)[10:12:33] *** k0nsl <k0nsl!~k0nsl@unaffiliated/k0nsl> has joined #omnios[10:14:37] *** bolt <bolt!r00t@unaffiliated/bolt> has quit IRC (Quit: telnet irc.freenode.net 6667)[10:18:38] *** bolt <bolt!r00t@unaffiliated/bolt> has joined #omnios[10:30:45] *** dmip <dmip!~Thunderbi@84.51.125.126> has quit IRC (Ping timeout: 276 seconds)[10:31:27] *** ptribble <ptribble!~ptribble@cpc92320-cmbg19-2-0-cust3282.5-4.cable.virginm.net> has joined #omnios[10:49:51] *** slx86 <slx86!~slx86@46-129-44-239.dynamic.upc.nl> has joined #omnios[10:55:32] *** nikolam <nikolam!~nikolam@unaffiliated/nikolam> has quit IRC (Ping timeout: 240 seconds)[10:57:41] *** nikolam <nikolam!~nikolam@unaffiliated/nikolam> has joined #omnios[11:06:54] *** andy_js <andy_js!~andy@90.219.225.136> has joined #omnios[11:32:06] *** wiedi <wiedi!~wiedi@ip5b41bdb7.dynamic.kabel-deutschland.de> has quit IRC (Read error: Connection reset by peer)[12:13:52] *** dmip <dmip!~Thunderbi@95.143.115.50> has joined #omnios[12:49:52] *** nikolam <nikolam!~nikolam@unaffiliated/nikolam> has quit IRC (Ping timeout: 240 seconds)[12:52:14] *** nikolam <nikolam!~nikolam@unaffiliated/nikolam> has joined #omnios[13:57:48] *** matejz <matejz!~matejz@element.planetq.org> has joined #omnios[14:02:16] *** matejz <matejz!~matejz@element.planetq.org> has quit IRC (Client Quit)[14:27:35] *** shyu <shyu!~Frank@218.241.172.114> has joined #omnios[14:46:04] *** bahamat <bahamat!~bahamat@ip72-199-207-63.sd.sd.cox.net> has joined #omnios[15:01:10] *** slx86 <slx86!~slx86@46-129-44-239.dynamic.upc.nl> has quit IRC (Quit: leaving)[15:08:41] *** bahamat <bahamat!~bahamat@ip72-199-207-63.sd.sd.cox.net> has quit IRC (Quit: Leaving.)[15:23:49] *** zerkalo <zerkalo!myricae@ny1.hashbang.sh> has quit IRC (Ping timeout: 244 seconds)[15:24:53] *** zerkalo <zerkalo!myricae@ny1.hashbang.sh> has joined #omnios[15:48:37] *** jinx099 <jinx099!jinx@gateway/shell/openshells.net/x-hmyzynzpwoheocbn> has quit IRC (Ping timeout: 258 seconds)[15:49:39] *** k0nsl <k0nsl!~k0nsl@unaffiliated/k0nsl> has quit IRC (Ping timeout: 264 seconds)[15:50:48] *** tdowg1 <tdowg1!~quassel@pool-96-244-201-225.bltmmd.fios.verizon.net> has joined #omnios[15:51:33] *** k0nsl <k0nsl!~k0nsl@unaffiliated/k0nsl> has joined #omnios[16:03:25] *** paca <paca!~cahyna@UFP7237.ipp.cas.cz> has joined #omnios[16:03:49] <paca> hello[16:05:56] *** danmcd <danmcd!~danmcd@static-108-48-124-82.washdc.fios.verizon.net> has joined #omnios[16:06:36] *** jinx099 <jinx099!jinx@gateway/shell/openshells.net/x-hsxqnodconmogjyl> has joined #omnios[16:08:18] *** matejz <matejz!~matejz@element.planetq.org> has joined #omnios[17:07:02] *** v_a_b <v_a_b!~volker@p5B3712EE.dip0.t-ipconnect.de> has left #omnios[17:08:18] *** xzi11a <xzi11a!~robert@static-108-48-124-82.washdc.fios.verizon.net> has joined #omnios[17:13:52] *** nikolam <nikolam!~nikolam@unaffiliated/nikolam> has quit IRC (Ping timeout: 240 seconds)[17:17:32] *** nikolam <nikolam!~nikolam@unaffiliated/nikolam> has joined #omnios[17:36:03] *** happy-dude <happy-dude!uid62780@gateway/web/irccloud.com/x-yfnzkyzjgzjznxrx> has joined #omnios[17:46:03] *** Toasterson <Toasterson!~toast@68.30.150.83.dyn.dsl.as8758.net> has quit IRC (Ping timeout: 244 seconds)[17:58:59] *** matejz <matejz!~matejz@element.planetq.org> has quit IRC (Quit: matejz)[18:00:25] *** Izaac <Izaac!~izaac@janek.setec.org> has joined #omnios[18:02:30] *** thebug <thebug!~thebug@unaffiliated/thebug> has quit IRC (Ping timeout: 276 seconds)[18:04:04] *** thebug <thebug!~thebug@unaffiliated/thebug> has joined #omnios[18:19:47] *** slx86 <slx86!~slx86@46-129-44-239.dynamic.upc.nl> has joined #omnios[18:41:31] *** Toasterson <Toasterson!~toast@2a02:aa10:e100:4b00:3798:d028:fa3e:2cf8> has joined #omnios[18:56:29] *** Izaac <Izaac!~izaac@janek.setec.org> has quit IRC (Ping timeout: 250 seconds)[18:57:51] *** ptribble <ptribble!~ptribble@cpc92320-cmbg19-2-0-cust3282.5-4.cable.virginm.net> has quit IRC (Quit: Leaving)[18:58:38] *** paca <paca!~cahyna@UFP7237.ipp.cas.cz> has quit IRC (Quit: Leaving.)[19:00:55] *** bahamat <bahamat!~bahamat@ip72-199-207-63.sd.sd.cox.net> has joined #omnios[19:11:02] *** Izaac <Izaac!~izaac@janek.setec.org> has joined #omnios[19:11:45] *** Izaac <Izaac!~izaac@janek.setec.org> has quit IRC (Remote host closed the connection)[19:26:57] *** esproul <esproul!~Adium@static-108-48-124-82.washdc.fios.verizon.net> has joined #omnios[19:28:06] *** esproul <esproul!~Adium@static-108-48-124-82.washdc.fios.verizon.net> has quit IRC (Client Quit)[19:36:00] *** Izaac <Izaac!~izaac@janek.setec.org> has joined #omnios[19:37:42] *** danmcd <danmcd!~danmcd@static-108-48-124-82.washdc.fios.verizon.net> has quit IRC (Quit: Machine is asleep)[19:40:01] *** Kurlon <Kurlon!~Kurlon@cpe-104-228-216-170.maine.res.rr.com> has quit IRC (Remote host closed the connection)[19:40:41] *** Kurlon <Kurlon!~Kurlon@bidd-pub-03.gwi.net> has joined #omnios[19:46:28] *** danmcd <danmcd!~danmcd@static-108-48-124-82.washdc.fios.verizon.net> has joined #omnios[19:48:52] *** danmcd <danmcd!~danmcd@static-108-48-124-82.washdc.fios.verizon.net> has quit IRC (Client Quit)[19:49:24] *** danmcd <danmcd!~danmcd@static-108-48-124-82.washdc.fios.verizon.net> has joined #omnios[19:50:32] *** matejz <matejz!~matejz@element.planetq.org> has joined #omnios[19:51:18] *** slx86 <slx86!~slx86@46-129-44-239.dynamic.upc.nl> has quit IRC (Quit: leaving)[19:54:32] *** nikolam <nikolam!~nikolam@unaffiliated/nikolam> has quit IRC (Ping timeout: 240 seconds)[19:55:05] *** matejz <matejz!~matejz@element.planetq.org> has quit IRC (Client Quit)[19:55:34] *** danmcd <danmcd!~danmcd@static-108-48-124-82.washdc.fios.verizon.net> has quit IRC (Quit: Machine is asleep)[19:56:42] *** nikolam <nikolam!~nikolam@unaffiliated/nikolam> has joined #omnios[19:57:22] *** danmcd <danmcd!~danmcd@static-108-48-124-82.washdc.fios.verizon.net> has joined #omnios[19:59:17] *** danmcd <danmcd!~danmcd@static-108-48-124-82.washdc.fios.verizon.net> has quit IRC (Client Quit)[20:00:16] *** danmcd <danmcd!~danmcd@static-108-48-124-82.washdc.fios.verizon.net> has joined #omnios[20:07:49] *** danmcd <danmcd!~danmcd@static-108-48-124-82.washdc.fios.verizon.net> has quit IRC (Quit: Machine is asleep)[20:13:01] *** ENOMAD <ENOMAD!~nospam@lopsa/chartermember/ENOMAD> has joined #omnios[20:13:32] *** danmcd <danmcd!~danmcd@static-108-48-124-82.washdc.fios.verizon.net> has joined #omnios[20:17:39] <ENOMAD> hello. Can anyone help me with http://pastebin.com/hB5Jj6lr - ixgbe devices not plumbing up up in OmniOS 11.[20:17:53] * ENOMAD sighs[20:17:56] <ENOMAD> that ... didn't work.[20:18:20] <ENOMAD> http://pastebin.com/hB5Jj61r[20:18:22] <ENOMAD> that's better.[20:19:07] <ENOMAD> basically, I just installed two new dual-NIC cards in an old box. The devices show up when I do a prtdiag but not prtconf.[20:19:13] <ENOMAD> dmesg doesn't report them.[20:19:47] <ENOMAD> I've verified the BIOS doesn't allow devices over 4GB, so that particular issue isn't the problem.[20:21:17] <richlowe> run prtconf -d, do the IDs of the new devices match some for ixgbe in /etc/driver_aliases?[20:21:17] <richlowe> is anything logged in /var/adm/messages?[20:21:17] <richlowe> daleg: this sounds like something you'd know way more than me about...[20:24:10] <ENOMAD> Hmm. No, they don't seem to . http://pastebin.com/7zpad2kM[20:24:49] <ENOMAD> there are no references to 'gbe' in /var/adm/messages[20:26:51] *** synegy34 <synegy34!~gatekeep@2001:470:8b45:400:7578:bb49:4a1f:bf90> has joined #omnios[20:27:41] <ENOMAD> hmm. ok. I can't read. Yes, there is a match[20:27:51] <ENOMAD> ixgbe "pciex8086,1528"[20:30:31] *** gatekeep <gatekeep!~gatekeep@wls/staff/gatekeep> has quit IRC (Ping timeout: 250 seconds)[20:34:09] *** daleg_ <daleg_!~daleg@static-108-48-124-82.washdc.fios.verizon.net> has joined #omnios[20:37:34] *** \ask <\ask!~ask@oz.develooper.com> has joined #omnios[20:39:33] *** Botanic <Botanic!~Botanic@tita/admin/Botanic> has quit IRC (Ping timeout: 240 seconds)[20:46:37] *** Botanic <Botanic!~Botanic@107.150.184.246> has joined #omnios[20:46:37] *** Botanic <Botanic!~Botanic@107.150.184.246> has quit IRC (Changing host)[20:46:37] *** Botanic <Botanic!~Botanic@tita/admin/Botanic> has joined #omnios[20:47:30] <ENOMAD> any other clues?[20:55:41] <danmcd> Any ixgbe output in /var/adm/messages ?[20:55:48] <danmcd> grep ixgbe /var/adm/message*[20:57:07] <ENOMAD> there are no references to gbe in /var/adm/messages.[20:58:59] <danmcd> SHoot.[20:59:12] <danmcd> daleg is away at the moment, but he's best suited for this.[20:59:32] <ENOMAD> away for a bit or away for a week? :)[20:59:54] <danmcd> For a bit -- he's here, just on the phone or something.[20:59:59] * ENOMAD nods[21:00:06] <danmcd> Dumb question -- are these X540s on your motherboard?[21:00:20] <danmcd> And which OmniOS are you running (r1510xx, which xx?).[21:00:24] <danmcd> cat /etc/release[21:00:58] <ENOMAD> the working devices are on the motherboard. The not working ones are on two new cards I just installed.[21:01:07] <ENOMAD> r151014[21:01:40] <danmcd> Are your working devices also X540?!?[21:01:43] <ENOMAD> the X540-AT2 cards are newly installed.[21:01:52] <danmcd> Dale's here now, and was puzzled. What's on the mobo again?[21:02:11] <ENOMAD> no. They're showing up as igb not ixgbe[21:02:18] <danmcd> igb == GigE.[21:02:27] <ENOMAD> the on-mobo are dev_path=/pci@0,0/pci8086,1d10@1c/pci15d9,1521@0:igb0[21:02:27] <ENOMAD> dev_link=/dev/igb0[21:02:29] <ENOMAD> yes.[21:02:35] <ENOMAD> the new ones are 10Gig.[21:02:51] <danmcd> DUmb question #3, and you ight need to go to the bios for it.[21:03:07] <danmcd> illumos doesn't handle PCI-e address space outside the low 32-bits well.[21:03:19] <danmcd> There's a BIOS setting for this, and you may need to set it.[21:03:31] <ENOMAD> If I'm reading the output of ptrconf -d the working devices are I350 .[21:03:33] <danmcd> Something like "map IO into 32-bits" or something like that.[21:03:47] <danmcd> Correct, igb covers I350 and others (I210 as well).[21:03:56] <ENOMAD> I did see one about "above 4GB". It was disabled.[21:04:08] <ENOMAD> When I enabled it I got errors.[21:04:17] <danmcd> Huh... yeah... that should be disabled.[21:04:25] <danmcd> And "devfsadm" doesn't fix things?[21:05:19] <ENOMAD> I'm rarely deal with Solaris anymore. I'll give that command a try.[21:06:05] <ENOMAD> sudo devfsadm -i isgbe replied with "devfsadm: driver failed to attach: ixgbe"[21:06:24] <ENOMAD> er, the command was devfsadm -i ixgbe[21:06:24] <danmcd> Wait. You didn't do what I asked. I just wanted "devfsadm", but try this:[21:06:30] <danmcd> "devfsadm -v"[21:06:30] <ENOMAD> so much fun[21:06:32] <danmcd> That's it. run that.[21:06:53] <ENOMAD> I tried devfsadm first, it returned immediately so I decided to read the manpage. That's where I got the -i :)[21:07:03] <danmcd> Use -v, share the output.[21:07:11] <ENOMAD> it returned no output.[21:07:25] <ENOMAD> exited with 0.[21:07:33] <danmcd> Okay. WHat does "dladm show-phys" say?[21:08:23] <ENOMAD> http://pastebin.com/ipZXEGW8[21:09:34] <ENOMAD> the oce card is an Emulux card we're trying to retire, hence the new ixgbe cards.[21:09:59] <danmcd> So ixgbe, the driver isn't loading. You have done devfsadm, which should've worked (BTW, grep for "ixgbe" again in /var/adm/messages* at this point.)[21:10:40] <ENOMAD> grep returns nothing.[21:11:02] <danmcd> Run this please in the background:[21:11:25] <danmcd> dtrace -n 'ixgbe_attach:entry { stack(); }'[21:11:36] <danmcd> and then do "ifconfig ixgbe0 plumb"[21:11:47] <danmcd> That script should produce output once you do the plumb...[21:12:53] <ENOMAD> plumb done, no output seen.[21:13:10] <danmcd> The script output at least "1 probe enable" or something like that, right?[21:13:23] <ENOMAD> yes, "matched 1 probe"[21:13:27] <danmcd> Okay...[21:13:28] <ENOMAD> that was before I did the ifconfig[21:13:31] <danmcd> it's still running, right?[21:13:40] <danmcd> Try "devfsadm -v" again.[21:13:45] <ENOMAD> I've now done ifconfig with ixgbe{0,1,2,3} with no change.[21:13:49] <danmcd> Something is preventing the driver from attaching.[21:13:56] <danmcd> I have no damned idea what.[21:14:07] <ENOMAD> devfsadm -v executed, no change on probe.[21:14:27] <daleg_> hmm[21:14:28] <daleg_> hey[21:14:33] <daleg_> [daleg@daleg-dev]~$ prtconf -d /dev/ixgbe2[21:14:33] <daleg_> pci8086,2 (pciex8086,1528) [Intel Corporation Ethernet Controller 10-Gigabit X540-AT2], instance #2[21:14:36] <danmcd> "modinfo | grep ixgbe" => that should be empty, right?[21:14:58] <ENOMAD> no, not empty[21:15:16] <patdk-wk> if that was empty, showphys should not show igbx[21:15:34] <daleg_> so, there are no /dev/ixgbe* files?[21:15:34] <ENOMAD> http://pastebin.com/r1bBd5Nj[21:15:58] <ENOMAD> ls /dev/ixg*[21:16:02] <ENOMAD> No such file or directory[21:16:08] <daleg_> really odd[21:16:41] <danmcd> Try unloading the module then.[21:16:49] <daleg_> yeah, I was about to suggest that[21:16:50] <danmcd> modunload -i <number from modinfo output>[21:17:30] <danmcd> You'll have to kill the dtrace script first, though. Sorry.[21:17:51] <ENOMAD> sudo modunload -i 260[21:17:59] <ENOMAD> can't unload the module: Device busy[21:18:11] <ENOMAD> ah, yep, that worked.[21:18:18] <ENOMAD> I presume I should now load it again. :)[21:19:04] <ENOMAD> no change to prtconf -v output.[21:20:29] <daleg_> now run 'devfsadm -v' again[21:21:01] <ENOMAD> I have an older host (physically different motherboard) that I dropped two of these cards in 2 weeks ago. It is running the same OmniOS install. It is seeing the cards fine. I can't reboot it or do anything destructive but it is available for comparisons.[21:21:09] <ENOMAD> devfsadm -v returned without output.[21:21:16] <danmcd> Now "dladm show-phys"[21:21:29] <ENOMAD> same as previous output.[21:21:40] <daleg_> the fact that the driver is completely not attaching here to what looks like an otherwise fine card is really odd[21:22:14] <danmcd> And the dtrace script suggests the attach() routine isn't even being called, which makes me think the problem is outside ixgbe and related to devfs or some PCIe issue.[21:22:38] <danmcd> I keep wondering what other BIOS setting may be "odd" that's causing this.[21:23:02] <ENOMAD> I am hoping that since prtdiag sees the cards it isn't completely hopeless.[21:23:18] <daleg_> it's not hopeless, it however makes the situation a bit bizarre[21:23:23] <ENOMAD> indeed.[21:24:34] <ENOMAD> I didn't see anything else in the BIOS that was obviously related.[21:25:01] <ENOMAD> The cards show up on boot, offering ^S as a config option. I checked that and it seems to be entirely PXE-related.[21:25:16] <daleg_> yeah, that's the boot option ROM[21:25:19] <ENOMAD> the BIOS itself doesn't list them but that isn't surprising.[21:25:22] <ENOMAD> yep.[21:25:54] <daleg_> hmm[21:26:09] <daleg_> so you say you have some existing emulex cards stuffed into this box, right?[21:26:18] <daleg_> and then you added 2x X540s?[21:26:31] <ENOMAD> There is one dual-port emulex card, yes.[21:26:33] <ENOMAD> yes[21:27:18] <ENOMAD> 2 in use PCI Exp. Gen 3 x4 CPU1 SLOT2 PCI-E 3.0 X4 (IN X8 SLOT), Emulex Corporation OneConnect 10Gb NIC (be3) (oce)[21:27:19] <daleg_> hmm. this is a really long-shot, but I'm wondering if there some sort of bus configuration contention going on... maybe with slots that are physically ok for the card, but pcie lanes are not available[21:27:32] *** nikolam <nikolam!~nikolam@unaffiliated/nikolam> has quit IRC (Ping timeout: 240 seconds)[21:27:42] <ENOMAD> I had to add a second CPU to light up the bus the new cards were installed in. That was done this morning.[21:28:03] <patdk-wk> ENOMAD, if that was the case[21:28:08] <patdk-wk> nothing would see those cards[21:28:23] <patdk-wk> you saw those cards in prtdiag and show-phys[21:28:25] <patdk-wk> so that isn't the case[21:28:32] <ENOMAD> prtdiag sees them, and the boot option ROM runs, so I presume they're being seen.[21:28:41] <ENOMAD> no, I didn't see them in prtdiag or show-phys.[21:28:49] <ENOMAD> I _only_ see them in prtdiag.[21:28:54] <ENOMAD> http://pastebin.com/hB5Jj61r\[21:28:58] <ENOMAD> er, http://pastebin.com/hB5Jj61r[21:29:05] <daleg_> do you have lspci installed?[21:29:06] <danmcd> But not prtconf?[21:29:11] <danmcd> "pkg install pci-utils"[21:29:12] <ENOMAD> danmcd, correct.[21:29:17] <patdk-wk> http://pastebin.com/ipZXEGW8[21:29:26] <daleg_> ok[21:29:34] <daleg_> prtdiag gets its info from SMBIOS[21:29:42] <daleg_> not the actual bus[21:29:50] *** nikolam <nikolam!~nikolam@unaffiliated/nikolam> has joined #omnios[21:29:54] <ENOMAD> pci-utils did not match any allowable packages[21:29:55] <daleg_> and the SMBIOS tables are assembled by the BIOS on boot[21:30:20] <daleg_> ENOMAD: he meant without the -[21:30:25] <daleg_> pkg install pciutils[21:30:35] <daleg_> that will install 'lspci'[21:30:38] <ENOMAD> that seems to be happier :)[21:30:46] <daleg_> and then you can run: 'lspci -nn'[21:31:37] <daleg_> here's another question: are you sure that omnios is also seeing this new cpu you plonked in?[21:31:43] <ENOMAD> lcpci does not see them.[21:31:58] <daleg_> ah ha, ok so these are completely invisible to the OS[21:32:00] <ENOMAD> daleg_, I am not 100% certain, though the BIOS says it is seeing it.[21:32:23] <daleg_> ENOMAD: 'psrinfo -vp'[21:32:26] <ENOMAD> ah, wait, yes, I saw something earlier that said 2.[21:32:37] <ENOMAD> yea, that was it :)[21:32:54] <ENOMAD> yes, it reports two physical processors with 6 cores and 12 virtual processors.[21:33:04] <daleg_> ok so here's what we see so far:[21:33:40] <daleg_> we know the bios is picking up the cards because they're mentioned in the SMBIOS tables it assembles during BIOS init, and are used by prtdiag to produce its output[21:34:13] <daleg_> the OS isn't seeing them at all because prtconf/lspci doesn't see them, and those utilities directly probe the PCI busses[21:34:59] <daleg_> given the oddness that can happen when putting in a new CPU, I'm wondering if you've tried resetting the BIOS to its defaults[21:35:15] <daleg_> I've had odd problems magically fixed by doing that in the past[21:35:24] <daleg_> such as openbsd not being able to find a CPU[21:35:31] *** dmip <dmip!~Thunderbi@95.143.115.50> has quit IRC (Ping timeout: 250 seconds)[21:35:31] <daleg_> in a box straight from the factory[21:35:35] <ENOMAD> daleg_, I haven't. I've been reluctant to do that since I don't know how the host was originally configured. However, I can certainly give it a try.[21:35:57] * ENOMAD inherited the host from long-gone admins.[21:36:07] <daleg_> it's something to consider... this is definitely a OS-no-seeing-that-new-PCI-bus problem[21:36:17] <ENOMAD> yes, agreed.[21:36:34] <ENOMAD> the older host had both CPUs installed when I got here so I didn't have to do anything special.[21:36:47] <ENOMAD> I guess I'll head down to the server room and do a BIOS reset. Back in ~15.[21:48:31] *** synegy34 <synegy34!~gatekeep@2001:470:8b45:400:7578:bb49:4a1f:bf90> has quit IRC (Read error: Network is unreachable)[21:48:56] *** synegy34 <synegy34!~gatekeep@2001:470:8b45:400:7578:bb49:4a1f:bf90> has joined #omnios[21:52:28] <ENOMAD> There is no joy in Mudville.[21:53:21] <daleg_> so in a situation like this, I tend to try to make A/B comparisons[21:53:49] <daleg_> in this case, what I would do is establish whether this is really a general hardware issue, or is an OS issue[21:54:18] <daleg_> and to help establish that, I would take a different OS, such as alpine linux or freebsd, and just boot the livecd version of it[21:54:34] <daleg_> and then see if they recognize the cards, or not[21:54:51] <daleg_> if they do, it's probably a OS issue of some sort and the investigation goes down that path[21:55:06] <daleg_> if they don't see the cards as well, then clearly it's a hardware issue[21:55:25] <ENOMAD> yeah, I was already getting out my CentOS 6 install CD. I won't install it but recovery mode should be sufficient.[21:55:51] <daleg_> yeah, that would work. I tend to reach for things that offer some additional utility[21:56:11] <daleg_> I've got a meeting to head off to... if you have the time or inclination, give the above a shot[21:56:32] <ENOMAD> I'm heading downstairs now to give it a go[21:59:38] *** synegi <synegi!~gatekeep@2001:470:8b45:400:7578:bb49:4a1f:bf90> has joined #omnios[22:03:15] *** synegy34 <synegy34!~gatekeep@2001:470:8b45:400:7578:bb49:4a1f:bf90> has quit IRC (Ping timeout: 250 seconds)[22:24:31] <ENOMAD> well, CentOS 6 sees them just fine thankyouverymuch :/[22:25:42] <ENOMAD> I've confirmed /kernel/drv/ixgbe is the same on the working and non-working hosts. Also, ixgbe.conf is fully commented out on both hosts.[22:33:31] *** Toasterson <Toasterson!~toast@2a02:aa10:e100:4b00:3798:d028:fa3e:2cf8> has quit IRC (Quit: Leaving)[22:44:33] <danmcd> /kernel/drv/amd64/ixgbe...[22:45:03] <danmcd> <sigh> I suppose ixgbe isn't visible now after you've re-re-rebooted into OmniOS?[22:45:22] <danmcd> One other thing to check: See if the OmniOS bloody installation disk (just updated today) sees them?[22:45:48] <danmcd> You can enter a shell from the OmniOS installer and use "dladm show-phys" to see if ixgbe* is there or not.[22:53:34] *** dmip <dmip!~Thunderbi@84.51.125.126> has joined #omnios[22:55:09] <ENOMAD> danmcd, ...amd64/ixgb* match also.[22:55:21] <danmcd> Had to ask. Try the bloody install ISO.[22:55:40] <ENOMAD> bloody? <sigh>[22:57:07] <ENOMAD> evidently the dl is going to take a while.[23:02:39] <danmcd> SOrry about that. It's the last thing I can think of to try.[23:02:59] * ENOMAD nods[23:03:04] <danmcd> If the installer sees the boards, then there's something off about r151014.[23:03:08] <ENOMAD> I just did a pkg update -v and am rebooting.[23:03:13] <danmcd> Oh good.[23:03:14] <ENOMAD> if that doesn't show it I'll give bloody a try.[23:03:16] *** pjy <pjy!~pjy@pool-108-45-119-127.washdc.fios.verizon.net> has joined #omnios[23:03:27] <ENOMAD> er, I'll give the bloody thing a try.[23:03:38] <danmcd> Heh.[23:03:48] <ENOMAD> perhaps relinking the kernel will be the magic.[23:04:09] <ENOMAD> Blue is not a good color for my face so I guess I shouldn't hold my breath.[23:06:14] <ENOMAD> firefox estimates a mere 12 minutes left to download the usb-dd image.[23:07:24] <ENOMAD> (no joy on the update -v && reboot fix)[23:10:09] <danmcd> Shoot.[23:10:32] <ENOMAD> Is there a config file that tells Solaris which bus slots to look at?[23:10:52] <ENOMAD> I'm wondering if my predecessors disabled the lanes since there wasn't a CPU to drive them.[23:13:03] <danmcd> There is no such config file.[23:13:05] <danmcd> AFAIK.[23:13:45] <danmcd> Unless they did something super-stupid and modified /kernel/drv/pcieb.conf.[23:13:53] <danmcd> (I highly doubt it.)[23:14:12] <ENOMAD> hmm.... should there be entries for ixbge in /etc/path_to_inst regardless of driver state?[23:14:17] <danmcd> 4e3b9f..[23:14:22] <danmcd> Don't touch path_to_inst.[23:14:37] <danmcd> But ixgbe existing there should be expected.[23:14:59] <ENOMAD> the only non-comment-line in pcieb.conf is the same on both working and non-working hosts.[23:15:18] <ENOMAD> there are no references to ixgbe in /etc/path_to_inst on non-working host.[23:15:35] <danmcd> It just means devfsadm didn't find them. devfsadm updates that file.[23:15:56] * ENOMAD nods[23:17:23] <ENOMAD> I presume the number in name_to_major is also host-dependent and as long as there is one it's ok.[23:17:33] <danmcd> Correct.[23:18:14] <ENOMAD> ... and the download fails because I wasn't paying attention to disk space in my home directory. Can you tell I'm having A Day?[23:18:16] * ENOMAD restarts.[23:18:38] <danmcd> BTW, I have to warn you, I'm gone in 40 mins. I've a flight to catch.[23:19:36] <ENOMAD> thanks[23:30:39] <ENOMAD> well, in theory the USB key is ready. Once more into the server room I go.[23:36:57] <danmcd> GOod luck...[23:39:51] <ENOMAD> very interesting .. no, it doesn't see them.[23:40:14] <patdk-lap> did you try a linux iso to see if that saw them?[23:40:17] <ENOMAD> I'm going to go see if I can find someone to help me pull the box out of the rack and swap the emulux card and one of these new ones to see what I see.[23:40:23] <ENOMAD> patdk-lap, yes and yes it did.[23:40:28] <patdk-lap> ah[23:40:37] <patdk-lap> just wanted to make sure before you tore it apart :)[23:40:43] <ENOMAD> yeah, I appreciate that :)[23:41:28] <ENOMAD> I was even able to have linux blink the link lights on the NICs so I can map them to MAC addresses so it was able to talk with the cards.[23:41:43] <ENOMAD> meanwhile, I expect danmcd is about to leave ... so thanks for the assist![23:41:49] <ENOMAD> I'll be back after I've swapped cards.[23:41:57] <danmcd> Sorry.[23:42:07] <patdk-lap> I can't imagine swapping pcie slots would help[23:42:17] <patdk-lap> used to for pci, but totally different beast :)[23:47:32] *** danmcd <danmcd!~danmcd@static-108-48-124-82.washdc.fios.verizon.net> has quit IRC (Quit: Quitting)[23:49:23] *** daleg_ <daleg_!~daleg@static-108-48-124-82.washdc.fios.verizon.net> has quit IRC ()