February 2, 2014 
< | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | 13 | 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | 22 | 23 | 24 | 25 | 26 | 27 | 28 | >
February 2, 2014 [00:59:14] *** hugo has quit IRC[01:54:08] <Licenser> trentster I think I found the bug with the snapshot sizes[02:17:06] <Licenser> killfill you're around?[03:07:07] <Licenser> So pretty close to the 0.4.3 release I think[03:45:59] <trentster> Licenser: cool! what was it?[03:46:09] <Licenser> trentster me deleting code that was still in use :P[03:46:27] <trentster> heh, I can see how that might be a problem ;-)[03:46:35] <Licenser> 3 lines[03:46:49] <trentster> Licenser: is the group perms stuff fixed yet..?[03:46:49] <Licenser> the one that say 'when you get the update snapshots event please update the snapshots'[03:47:01] <trentster> I was waiting for that, to cover briefly in the screencast[03:47:20] <Licenser> trentster remind me what exactly was wrong there?[03:47:43] <trentster> I noticed somewhere during the pkg update process some of my previous snapshots from a week ago have dissapeared in the ui.[03:48:05] <trentster> I think it happened when killfill seperated out the snapshots abck into their own section again.[03:48:53] <trentster> Licenser: remember we were going through together the roles eprmissions workflows, in our training session, and you said dont worry about it now, it looks like its broken again and you have to fix it.[03:49:37] <Licenser> I'll look at that stuff[03:49:53] *** bixu_ has joined #project-FiFo[03:51:14] <trentster> Licenser: btw some good news, chunter has not gone into maintenance since I applied your test fix 2 weeks ago[03:51:22] <Licenser> nice![03:52:22] <Licenser> I should push that change to the overall binary then[03:52:49] *** bixu has quit IRC[03:54:55] <trentster> yeah, this was it. https://gist.github.com/trentster/8762365[03:56:57] <trentster> Licenser: cool, I can confirm my snapshot sizes are now back again, thanks mate :^)[03:57:02] <Licenser> :D[04:03:17] <trentster> Licenser: hmmm, maybe its me being stupid, but have we never thought of including used disk usage stats for zone machines?[04:03:28] <trentster> or is it already there somewhere in the ui that I am not seeing?[04:03:58] <Licenser> trentster it might be us both being stupid since I am not sure where to look for it either, let me check the RAW data[04:04:32] <Licenser> nope it simply is not there[04:05:02] <Licenser> we have services monitored to see if you have SMF in maintainace but you can't see if your VM is using disk :)[04:07:29] <trentster> lol, yeah, not sure, how we all managed to miss that one for so long :-P[04:07:57] <Licenser> trentster will add it if you make a ticket but rather in 0.4.5 then in 0.4.3 I want to come to a close with this[04:08:09] <trentster> sure no problemmo.[04:08:26] <Licenser> otherwise we're never going to get beyond 0.4.2 and there are so many important improvements in 0.4.3 that I don't want stable to stay outdated for much longer[04:08:34] <Licenser> think about it, anyone using stable still has the old UI![04:08:41] <Licenser> I don't evnen remember how that looks[04:09:54] <Licenser> trentster snapshots not showing and group permissions were two different things right?[04:10:07] <trentster> I will add a ticket now. We should also probably have some alert indication somewhere that machine is out of swapspace. That is very useful, and does tend to bite people semi oftenish.[04:10:24] <Licenser> indeed it does[04:11:06] <trentster> Licenser: yeah, remember you were demoing the elofs stuff to em, and I asked you to show me the roles and permissions etc workflow, when you were showing me you realised it was broken, and said dont worry about it for now you need to fix it.[04:11:19] <trentster> you said you have not tested it in a long time and there have been many updates.[04:12:10] <trentster> * darn mac keyboard! is getting a bit dodgy these days *[04:13:02] <Licenser> heh[04:13:29] <Licenser> Oh the org stuff?[04:15:23] <trentster> yup[04:15:42] <Licenser> fixed that :)[04:17:19] <trentster> cool![04:30:55] <Licenser> so quickly closing towards the finish line for 0.4.3 :D[04:31:20] <Licenser> I'll try the group/org stuff fully next week and once that is done plus two more things on the UI we're good I think[04:34:28] <trentster> ok cool, what are the 2 things?[04:43:43] *** conan_the_destro has quit IRC[04:46:51] <Licenser> trentster VM removal from a hypervisor but not removing it from fifo and redeployment to a different hypervisor[05:41:14] *** vsv_ has joined #project-FiFo[06:08:31] *** vsv has quit IRC[06:57:21] *** masked has quit IRC[11:36:11] *** mattroni1 has joined #project-FiFo[11:41:24] *** mattronix has quit IRC[11:47:50] *** wiedi has joined #project-FiFo[11:53:57] *** wiedi has quit IRC[11:59:35] *** bayoda has quit IRC[12:13:05] *** bayoda has joined #project-FiFo[14:27:51] *** bayoda has quit IRC[14:38:16] *** bayoda has joined #project-FiFo[14:43:32] <mattroni1> Licenser: so everything is almost working[14:43:49] <mattroni1> Licenser: we can proviosion new debian machines but anything else gets stuck on creating[15:14:51] *** mattroni1 is now known as mattronix[17:52:55] <mattronix> Licenser: ubuntu and debian provision fine but not smartos or base64 machines[18:07:19] <MerlinDMC> mattronix, but the dsapid image did provision right?[18:07:28] <MerlinDMC> that's also a minimal smartos based image[18:10:47] <mattronix> MerlinDMC: no imported it on the hypervisor host[18:11:41] <MerlinDMC> so it does provision without using fifo :P[18:12:21] <MerlinDMC> is weird tho cause fifo should also just use vmadm to spin up new stuff[19:23:24] *** bayoda has quit IRC[19:26:45] *** bayoda has joined #project-FiFo[20:11:54] *** bayoda has quit IRC[20:20:21] *** bayoda has joined #project-FiFo[20:24:23] *** bayoda has quit IRC[20:27:06] *** bayoda has joined #project-FiFo[22:05:14] <Licenser> mattronix check the chunter logs it usually tells you quite well what happend[22:07:08] <Licenser> if it provisions KVM I wold guess that there is something saying ewww no thanks you[22:07:30] <mattronix> otherway around[22:07:38] <mattronix> seems at the moment only kvm provision is working[22:09:04] <mattronix> the debug log should show me when a machine is provisoned correct?[22:09:39] <mattronix> i provisoned a new debian machine it provisioned fine but nothing in debug log (tail -f)[22:10:04] <mattronix> last log was 5 days ago[22:10:17] <mattronix> that seems odd[22:10:26] <mattronix> 2014-01-27 00:01:36.034 [warning] <0.222.0>@chunter_vm_fsm:init_zonedoor:576 [zonedoor] Starting with cmd: /opt/chunter/lib/chunter-0.3.12p1/priv/zonedoor b7f37e0e-3bc2-4616-b401-916b64507c0a _joyent_sshd_key_is_authorized[22:10:58] <mattronix> that zone uuid is the fifo zone[22:11:03] <mattronix> btw[22:11:25] <mattronix> b7f37e0e-3bc2-4616-b401-916b64507c0a = fifo zone[22:12:41] <Licenser> mattronix I've to run to a appointment but the date of that log suggests debug logging is turned off, look at the console.log :)[22:12:55] <mattronix> ok[22:13:07] <Licenser> also just to be sure try imgadm to install the dataset that you want to provision, it might be that something is icky with that[22:13:08] <mattronix> thx[22:13:11] <mattronix> its in here :)[22:13:21] <mattronix> oooooooo[22:13:25] <mattronix> i will give that a shot[22:13:58] <Licenser> the result from the vmadm will propably tell you exactly what happend, I should propably attatch it to the VM log so people don't have to look at the console[22:14:51] <mattronix> hrrm[22:14:58] <mattronix> 2014-02-02 22:13:41.005 [error] <0.5604.82> CRASH REPORT Process <0.5604.82> with 0 neighbours exited with reason: not_found in gen_fsm:terminate/7 line 611[22:15:01] <mattronix> thats it[22:15:20] <mattronix> the image is imported on that server[22:15:40] <Licenser> is it on the hypervisor too?[22:15:44] <mattronix> yes[22:15:44] <Licenser> does imgadm list show it?[22:15:48] <mattronix> thats where i checked[22:16:15] <Licenser> okay then it's not that, then something in VMADM is upset, any chance of a doublicated IP or something?[22:16:36] <mattronix> hrrm[22:16:38] <mattronix> wait a moment[22:16:39] <Licenser> btw, if you run out of ideas tar up /var/log/chunter and mail it to me? I'll look at it tonight[22:16:41] <mattronix> its thier but[22:16:50] <Licenser> ?[22:16:51] <mattronix> 74c3b232-7961-11e3-a7a7-935768270b93 - - - -[22:16:56] <Licenser> yea that's OK[22:17:11] <mattronix> ok then its installed[22:17:24] <Licenser> well that was OK up to the last tested SmartOS release :P Joyent might have figured to be funny and change behaviour agian[22:17:48] <mattronix> 2014-02-02 22:13:40.482 [info] <0.5619.82>@chunter_vmadm:create:147 Creation of VM '89d67a98-4c4f-4b41-af63-8f80103c788b' started.[22:17:51] <mattronix> 2014-02-02 22:13:40.482 [info] <0.5619.82>@chunter_vmadm:create:149 vmadm:create[22:17:54] <mattronix> 2014-02-02 22:13:40.483 [info] <0.5619.82>@chunter_vmadm:create:156 vmadm:create - handed to vmadm, waiting ...[22:17:57] <mattronix> 2014-02-02 22:13:40.925 [info] <0.5619.82>@chunter_vmadm:create:161 vmadm:create - vmadm returned sucessfully.[22:18:00] <mattronix> 2014-02-02 22:13:40.925 [info] <0.5619.82>@chunter_vmadm:create:175 vmadm:create - updating memory.[22:18:03] <mattronix> 2014-02-02 22:13:41.005 [warning] <0.5604.82>@chunter_vm_fsm:terminate:768 Terminating vm fsm.[22:18:06] <mattronix> 2014-02-02 22:13:41.005 [warning] <0.5604.82>@chunter_vm_fsm:terminate:771 console not running[22:18:09] <mattronix> 2014-02-02 22:13:41.005 [warning] <0.5604.82>@chunter_vm_fsm:terminate:778 ssh door not running[22:18:12] <mattronix> 2014-02-02 22:13:41.005 [error] <0.5604.82> gen_fsm {vm,<<56,57,100,54,55,97,57,56,45,52,99,52,102,45,52,98,52,49,45,97,102,54,51,45,56,102,56,48,49,48,51,99,55,56,56,98>>} in state creating terminated with reason: not_found[22:18:16] <mattronix> 2014-02-02 22:13:41.005 [error] <0.5604.82> CRASH REPORT Process <0.5604.82> with 0 neighbours exited with reason: not_found in gen_fsm:terminate/7 line 611[22:18:19] <mattronix> sorry for the overload of lines[22:18:22] <mattronix> 10 in total[22:18:28] <Licenser> mattronix okay that looks like VMADM said it created the VM but did not[22:18:34] <mattronix> yeah[22:18:41] <mattronix> it did get handed off to the hyper visor[22:18:43] <Licenser> you'll have to look at VMADM's log[22:18:49] <mattronix> got it[22:18:53] * Licenser has to run[22:19:03] <mattronix> ok later[22:19:04] <mattronix> thx[22:19:06] <Licenser> sorry mate MerlinDMC might be able to help with the vmadm logs ;)[22:21:25] <mattronix> :)[22:56:08] *** wiedi has joined #project-FiFo[23:01:14] <mattronix> Licenser: http://sprunge.us/YAch[23:01:43] <mattronix> it complains over invalid values[23:04:26] <mattronix> max_swap and,time[23:04:42] <mattronix> now the configs from a machine that provisoned fine (debian) http://sprunge.us/GiYW[23:04:52] <mattronix> not config vmadm logs*[23:06:09] <mattronix> the first was vmadm log from the smartos machine provisoned with fifo and the second the vmadm logs from a machine being provsioned with fifo and working both where made 5 mins ago for testing.[23:16:58] <mattronix> i can however confirm all the provisioning requests are hitting the hypervisor[23:17:36] <MerlinDMC> mattronix, it complains because max_swap needs to be >= 256M[23:18:00] <MerlinDMC> https://github.com/joyent/smartos-live/blob/master/src/vm/node_modules/VM.js#L1356