March 26, 2019 
< | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | 13 | 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | 22 | 23 | 24 | 25 | 26 | 27 | 28 | 29 | 30 | 31 | >
March 26, 2019 [00:59:21] <bgilbert> dustymabe: re ignition-dracut #61, I'm okay merging to unblock people, but we should find out what's going on there[01:25:07] *** basvdlei <basvdlei!~basvdlei@2001:980:a4c3:1:ecd:2292:1c9f:b1c5> has quit IRC (Ping timeout: 240 seconds)[01:35:28] *** ajeddeloh <ajeddeloh!~andrew@c-24-130-175-45.hsd1.ca.comcast.net> has quit IRC (Ping timeout: 245 seconds)[02:26:48] *** zhangks98 <zhangks98!~zhangks98@192.122.131.14> has joined #fedora-coreos[02:33:23] *** zhangks98 <zhangks98!~zhangks98@192.122.131.14> has quit IRC (Quit: My MacBook has gone to sleep. ZZZzzz…)[02:34:01] *** zhangks98 <zhangks98!~zhangks98@192.122.131.14> has joined #fedora-coreos[02:34:37] *** zhangks98 <zhangks98!~zhangks98@192.122.131.14> has quit IRC (Client Quit)[02:35:41] *** zhangks98 <zhangks98!~zhangks98@192.122.131.14> has joined #fedora-coreos[02:38:09] *** zhangks98 <zhangks98!~zhangks98@192.122.131.14> has quit IRC (Client Quit)[02:40:28] *** mnguyen_ <mnguyen_!~mnguyen@209.6.78.102> has quit IRC (Read error: Connection reset by peer)[02:50:18] *** jlebon <jlebon!~jlebon@107-190-106-197.cpe.teksavvy.com> has quit IRC (Ping timeout: 250 seconds)[02:52:22] *** jlebon <jlebon!~jlebon@107.190.106.197> has joined #fedora-coreos[04:14:04] *** zhangks98 <zhangks98!~zhangks98@192.122.131.97> has joined #fedora-coreos[04:22:01] *** Son_Goku <Son_Goku!~King_InuY@fedora/ngompa> has joined #fedora-coreos[04:37:52] <zhangks98> hey guys! my name is Kaishuo (zhangks98), i'm a current undergraduate at nanyang technological university, singapore.[04:37:57] <zhangks98> i was introduced to this project by ksinny during a hackathon[04:38:14] <zhangks98> it has been a real pleasure working with you guys on my first pr, shout out to dustymabe, bgilbert and cgwalters for their help and suggestions[04:38:34] <zhangks98> i'm currently trying to get a sense of the whole picture through cosa, and looking into some papercuts project to see if i can help[04:38:55] <zhangks98> if you have any project that need some help, feel free to ping me or email me at zhangks98 at gmail dot com when i'm away[04:42:05] <bgilbert> zhangks98: thank you for contributing![04:43:02] *** jlebon <jlebon!~jlebon@107.190.106.197> has quit IRC (Ping timeout: 244 seconds)[05:14:55] *** Son_Goku <Son_Goku!~King_InuY@fedora/ngompa> has quit IRC (Quit: My MacBook has gone to sleep. ZZZzzz…)[05:15:27] *** bgilbert <bgilbert!~bgilbert@cpe-98-14-241-92.nyc.res.rr.com> has quit IRC (Ping timeout: 245 seconds)[05:27:34] *** paragan <paragan!~paragan@unaffiliated/paragan> has joined #fedora-coreos[05:30:33] *** bgilbert <bgilbert!~bgilbert@cpe-98-14-241-92.nyc.res.rr.com> has joined #fedora-coreos[05:30:33] *** ChanServ sets mode: +o bgilbert[05:42:09] *** bgilbert <bgilbert!~bgilbert@cpe-98-14-241-92.nyc.res.rr.com> has quit IRC (Ping timeout: 246 seconds)[06:12:21] <ksinny> zhangks98++[07:03:37] *** zhangks98 <zhangks98!~zhangks98@192.122.131.97> has quit IRC (Ping timeout: 255 seconds)[07:21:04] *** kdas_ <kdas_!~hopless@fedora/kushal> has joined #fedora-coreos[07:21:11] *** kushal <kushal!~hopless@fedora/kushal> has quit IRC (Ping timeout: 256 seconds)[07:31:45] *** basvdlei <basvdlei!~basvdlei@2001:980:a4c3:1:ecd:2292:1c9f:b1c5> has joined #fedora-coreos[08:14:55] *** zhangks98 <zhangks98!~zhangks98@192.122.131.97> has joined #fedora-coreos[08:45:02] *** salasrod <salasrod!~salasrod@ec2-52-24-37-95.us-west-2.compute.amazonaws.com> has quit IRC (Remote host closed the connection)[08:46:00] *** salasrod <salasrod!~salasrod@ec2-52-24-37-95.us-west-2.compute.amazonaws.com> has joined #fedora-coreos[08:51:29] *** michelmno <michelmno!normand@nat/ibm/x-gbhvjlvliwrtzvxa> has joined #fedora-coreos[08:57:09] *** hbrueckner <hbrueckner!brueckner@nat/ibm/x-wcvbficwxefysptv> has joined #fedora-coreos[08:58:35] *** basvdlei <basvdlei!~basvdlei@2001:980:a4c3:1:ecd:2292:1c9f:b1c5> has quit IRC (Quit: basvdlei)[09:19:42] *** kaeso <kaeso!lucab@gateway/shell/elitebnc/x-vlchtomanyijxuoi> has joined #fedora-coreos[09:27:03] *** kdas_ is now known as kushal[09:36:03] *** tmhoang <tmhoang!tmhoang@unaffiliated/tmhoang> has joined #fedora-coreos[09:52:50] *** jcajka <jcajka!~jcajka@ip-78-45-65-107.net.upcbroadband.cz> has quit IRC (Quit: Leaving)[10:35:53] *** jcajka <jcajka!jcajka@nat/redhat/x-aoajobrrwoioxdwl> has joined #fedora-coreos[10:39:40] *** zhangks98 <zhangks98!~zhangks98@192.122.131.97> has quit IRC (Quit: Leaving)[10:58:48] *** hbrueckner <hbrueckner!brueckner@nat/ibm/x-wcvbficwxefysptv> has quit IRC (Ping timeout: 245 seconds)[11:03:13] *** jcajka <jcajka!jcajka@nat/redhat/x-aoajobrrwoioxdwl> has quit IRC (Ping timeout: 246 seconds)[11:10:48] *** Son_Goku <Son_Goku!~King_InuY@fedora/ngompa> has joined #fedora-coreos[11:12:34] *** jcajka <jcajka!~jcajka@ip-78-45-65-107.net.upcbroadband.cz> has joined #fedora-coreos[11:18:37] *** jbrooks <jbrooks!~Jason@c-67-160-216-164.hsd1.ca.comcast.net> has quit IRC (Ping timeout: 246 seconds)[11:20:40] *** jbrooks <jbrooks!~Jason@c-67-160-216-164.hsd1.ca.comcast.net> has joined #fedora-coreos[11:28:39] *** hbrueckner <hbrueckner!brueckner@nat/ibm/x-ltfmwczvcgoeylfq> has joined #fedora-coreos[13:02:41] *** Son_Goku <Son_Goku!~King_InuY@fedora/ngompa> has quit IRC (Quit: My MacBook has gone to sleep. ZZZzzz…)[13:30:44] *** Son_Goku <Son_Goku!~King_InuY@fedora/ngompa> has joined #fedora-coreos[13:40:42] *** mnguyen_ <mnguyen_!~mnguyen@209.6.78.102> has joined #fedora-coreos[13:42:03] *** Son_Goku <Son_Goku!~King_InuY@fedora/ngompa> has quit IRC (Quit: My MacBook has gone to sleep. ZZZzzz…)[13:56:01] *** jlebon <jlebon!~jlebon@107-190-106-197.cpe.teksavvy.com> has joined #fedora-coreos[14:04:16] *** nalind <nalind!~nalin@144.121.20.162> has joined #fedora-coreos[14:09:02] *** dm0 <dm0!~dm0@12.133.141.2> has joined #fedora-coreos[14:10:52] *** yzhang <yzhang!~yzhang@toroon0247w-lp140-02-65-94-197-117.dsl.bell.ca> has joined #fedora-coreos[14:14:16] <jlebon> walters: any other concerns re. https://github.com/projectatomic/rpm-ostree/pull/1795 ? will merge otherwise and we can get a release out[14:14:42] <jlebon> 🆕 📦[14:14:53] *** mheon <mheon!~mheon@pool-71-117-146-79.prvdri.fios.verizon.net> has joined #fedora-coreos[14:16:41] *** jistr is now known as jistr|afk[14:18:45] <walters> lgtm, but it's not going to be the end of the story for sure[14:21:12] <jlebon> yeah definitely[15:09:26] *** dm0 <dm0!~dm0@12.133.141.2> has quit IRC (Ping timeout: 250 seconds)[15:15:49] *** jistr|afk is now known as jistr[15:16:24] *** Son_Goku <Son_Goku!~King_InuY@fedora/ngompa> has joined #fedora-coreos[15:18:56] *** yuvalt <yuvalt!yturgema@nat/redhat/x-hqytuhmzzyfvcium> has joined #fedora-coreos[15:24:57] *** tachoknight <tachoknight!~tachoknig@205.178.20.7> has quit IRC (Remote host closed the connection)[15:41:59] <yuvalt> dustymabe: hi again, the initrd that ships in the qcow2 image for openstack is missing the /usr/lib/udev/rules.d/60-cdrom_id.rules, so the openstack provider for ignition fails to mount /dev/disk/by-label/config-2[15:42:39] *** bgilbert <bgilbert!~bgilbert@cpe-98-14-241-92.nyc.res.rr.com> has joined #fedora-coreos[15:42:39] *** ChanServ sets mode: +o bgilbert[15:50:58] <dustymabe> yuvalt: interesting - can you open an issue against https://github.com/coreos/fedora-coreos-tracker ?[15:51:35] <yuvalt> dustymabe: sure, we tested this in downstream - does it make a difference ?[15:51:59] <dustymabe> yuvalt: it would be a good datapoint to know if it happens in FCOS[15:52:22] <yuvalt> dustymabe: are there any images for fcos ?'[15:52:33] <dustymabe> any chance you could try with the openstack image from https://ci.centos.org/artifacts/fedora-coreos/prod/builds/latest/ ?[15:53:01] <yuvalt> dustymabe: sure thing[15:53:08] <dustymabe> yuvalt: i can confirm that if I lsinitrd the initramfs I don't see that rule in the initrd on my local built FCOS[15:53:32] <dustymabe> but would be nice to confirm that you see the same problem with the fcos image from the pipeline[15:53:46] <dustymabe> sayan: around ?[15:56:04] *** Son_Goku <Son_Goku!~King_InuY@fedora/ngompa> has quit IRC (Quit: My MacBook has gone to sleep. ZZZzzz…)[15:57:01] <yuvalt> dustymabe: we can just boot it with rd.break and attach an iso, but if the rule is missing, it probably wont work, though[15:57:44] <walters> looks like it should come from `/usr/lib/dracut/modules.d/95udev-rules/module-setup.sh`[15:57:48] <yuvalt> dustymabe: other than that, nice work - it boots in ovirt[15:59:54] <kaeso> yuvalt: I seem to remember the udev rules in initramfs are located in a different (at least in ContainerLinux), did you check if that file exists somewhere else in the initramfs?[16:00:06] <kaeso> *different place[16:00:33] <dustymabe> kaeso: i did an lsinitrd - didn't find it anywhere[16:00:40] <yuvalt> kaeso: nope, just searched in /usr and /etc[16:00:53] <yuvalt> s/usr/lib/[16:01:46] *** jcajka <jcajka!~jcajka@ip-78-45-65-107.net.upcbroadband.cz> has quit IRC (Quit: Leaving)[16:01:47] *** tachoknight <tachoknight!~tachoknig@205.178.20.7> has joined #fedora-coreos[16:02:03] <sayan> dustymabe: hi[16:02:06] <sayan> dustymabe: pm[16:02:18] *** jcajka <jcajka!~jcajka@ip-78-45-65-107.net.upcbroadband.cz> has joined #fedora-coreos[16:04:58] <sayan> dustymabe: the script would generate the list everytime[16:05:07] <sayan> but since we are running for the first time now[16:05:28] <sayan> it might be possible that it might contain some AMIs that are part of the released ones[16:05:49] <dustymabe> sayan: this is the https://pagure.io/releng/blob/master/f/scripts/clean-amis.py script ?[16:06:06] <sayan> dustymabe: yes[16:06:25] <dustymabe> sayan: I don't understand the 'it might be possible that it might contain some AMIs that are part of the released ones' statement[16:06:43] <dustymabe> i thought you did a manual check to make sure the script wasn't touching any of those AMIs[16:07:08] <sayan> dustymabe: oh! yes, I did[16:07:17] <dustymabe> so what is the concern?[16:07:57] <sayan> but by that I meant I manually filtered the AMIs[16:08:51] <sayan> suppose the script generated a file x.txt and the one I generated from the fedora-website is y.txt[16:10:05] <dustymabe> ok[16:11:55] * dustymabe assumes sayan is typing[16:12:39] <sayan> dustymabe: there were couple of images of y.txt that were in x.txt[16:13:10] <sayan> though there was no intersection with the list of Fedora Atomic Host images[16:13:34] <dustymabe> sayan: do we know why? i.e. could our filtering in the script be made better?[16:13:48] <dustymabe> It would definitely make me feel more comfortable if no images from y.txt were in x.txt[16:15:09] <sayan> dustymabe: I understand but since this script will not have a huge amount of work after we release the plume code, because plume supports tagging[16:15:20] *** dm0 <dm0!~dm0@c-73-175-137-55.hsd1.pa.comcast.net> has joined #fedora-coreos[16:15:23] <sayan> and we can easy tag, different dev and prod images[16:15:51] <sayan> the script would again need some changes then, and changes for the good[16:16:31] <dustymabe> how many images were in y.txt? Did we ever look at why they were selected to be deleted ?[16:16:59] <sayan> around 30k, iirc[16:18:04] <dustymabe> y.txt was the list from fedora-website and AH releases[16:18:23] <dustymabe> if it was 30k then something is really wrong[16:18:49] <sayan> oh sorry[16:18:57] <sayan> misread[16:20:16] <sayan> i'll just tell you the number wait[16:21:10] <sayan> 556[16:21:13] <sayan> dustymabe: ^^[16:22:10] <dustymabe> yeah that number is high - i'd really like to understand why our multiple levels of detection don't properly pick those up[16:22:25] <dustymabe> can you share the list ? fpaste ?[16:22:54] <dustymabe> oh wait y.txt is just the list, it's not the intersection[16:23:01] <dustymabe> correct?[16:23:05] <sayan> dustymabe: yes[16:23:09] <sayan> not the intersection[16:23:24] <dustymabe> so if you find amis that are common to both x.txt and y.txt how many do you get ?[16:23:32] <sayan> dustymabe: wait[16:23:51] <sayan> the number was not that high though iirc[16:24:50] <sayan> dustymabe: 13[16:24:56] <dustymabe> ok cool[16:24:58] <dustymabe> can you share that list ?[16:25:31] <sayan> dustymabe: yes, wait[16:28:34] *** jcajka <jcajka!~jcajka@ip-78-45-65-107.net.upcbroadband.cz> has quit IRC (Quit: Leaving)[16:28:42] <yuvalt> after cosa run how do i login ?[16:28:56] <dustymabe> yuvalt: `cosa run` should start up a VM and auto log you in[16:29:12] <dustymabe> if you get a login prompt something went wrong[16:29:37] <yuvalt> it says something timed out after 60 seconds, i'll check what i did wrong[16:31:39] <walters> usually means Ignition didn't run[16:32:08] <sayan> dustymabe: https://paste.fedoraproject.org/paste/tvPBR7WwjeHy-xRfQyU9Hw[16:32:10] <walters> look for Ignition in the logs, if you don't see it, be sure you've pulled the latest config, done a `coreos-assembler fetch` etc[16:32:25] <sayan> dustymabe: btw, it's 12, last line was empty line in the file[16:32:31] <yuvalt> walters: will do, thanks ![16:34:48] <dustymabe> sayan: did I share that script with you I wrote recently to iterate through regions to find AMI info ?[16:35:05] <sayan> dustymabe: yes[16:35:18] <dustymabe> mind sharing it back with me?[16:35:28] <sayan> dustymabe: but it's on the other laptop, which has a broken screen[16:35:35] <sayan> :([16:35:46] <dustymabe> no worries[16:45:11] <dustymabe> ok I just ran it[16:45:37] <dustymabe> https://paste.fedoraproject.org/paste/-rvrbGwYgLywa-RNZoCkhw[16:45:40] <dustymabe> sayan: ^^[16:47:21] <sayan> dustymabe: okay[16:47:50] <dustymabe> sayan: it's a bit odd the last AMI returns nothing[16:48:13] <dustymabe> so honestly let's see[16:48:31] <dustymabe> one thing that is interesting is can we try to detect beta images better ?[16:48:50] <dustymabe> we do actually want to delete beta images but we probably don't want to delete them within 15 days[16:49:04] <dustymabe> as for the other ones that are in that list right now I'm not too worried about them[16:50:04] <dustymabe> sayan WDYT ?[16:51:05] *** jligon <jligon!textual@nat/redhat/x-faakdrijxysvwkyd> has joined #fedora-coreos[16:51:06] <sayan> dustymabe: I would say let's do that manually[16:51:22] <dustymabe> do what manually ?[16:51:41] <sayan> delete the beta images manually[16:51:47] <sayan> the older betas[16:52:18] <dustymabe> sayan: the mere fact that they are in the intersection of x.txt and y.txt means they will get cleaned up by the script[16:52:25] <dustymabe> which I think is a good thing[16:52:35] <sayan> dustymabe: yes[16:52:50] <dustymabe> but... i'm saying we might want to leave them around for longer[16:52:51] <sayan> but if they are left out, so should I just run the script?[16:52:53] <dustymabe> like a month[16:53:18] <dustymabe> so right now y.txt contains amis that are from F29 beta[16:53:28] <sayan> dustymabe: yeah[16:53:29] <dustymabe> and i'm totally +1 for cleaning those up[16:53:49] <dustymabe> i'm just saying that when we set this script on autopilot maybe we should crank the time up to 20 days or something[16:54:03] <dustymabe> so that f30 beta amis will last until final release or something[16:54:06] <sayan> dustymabe: ah[16:54:08] <sayan> okay[16:54:22] <sayan> I was thinking if we could add a step to releng to tag those AMIs[16:54:28] <sayan> and then filter them in the script[16:54:36] <dustymabe> anywho I think the summary is that the script looks good to run for now[16:54:52] <dustymabe> so we should follow those steps I laid out in the email[16:55:09] <dustymabe> send email stating X days, remove perms, wait x days, perform delete[16:55:24] <dustymabe> and then at a later time we'll add cron job[16:55:39] <sayan> Okay[16:56:42] *** mskarbek <mskarbek!~Thunderbi@95.155.110.145> has joined #fedora-coreos[16:58:16] <sayan> dustymabe: next regarding the PR, how much time will it take to get vmdk produced through compose[16:58:30] <sayan> the stream optimized vmdks[16:58:39] <sayan> is it a lot of work? I can look into it[16:59:24] <sayan> Because I can prepare the PR today, and hopefully slowrie would not have any more comments on the PR[17:01:17] <sayan> we can have the PR merged, and at the same time if we can have compose get the vmdks[17:04:15] <dustymabe> sayan: i really don't know how much work it is but releng is frozen right now and it won't be easy to get changes in[17:04:25] <sayan> dustymabe: hmm[17:04:42] <dustymabe> and I'm also about to be AFK for a few weeks time so I'd say let's stick with raw images for now and we'll revisit after F30 release[17:05:03] <sayan> dustymabe: sure[17:05:08] <sayan> no issues with me[17:05:18] <dustymabe> sayan: if you want to pursue it I would talk with ian mcleod to ask him about stream optimized vmdk and imagefactory[17:06:30] <sayan> dustymabe: sure, I can get this PR to merge with raw images, and on sidelines see what needs to get stream optimized vmdk in[17:10:47] <slowrie> uploading raw or vmdk images are fine, we just don't want the conversion code[17:11:01] <slowrie> so if we're blocked on having the vmdk's just switch it to upload the raw image[17:11:26] <sayan> slowrie: Yeah[17:11:39] <sayan> I will remove the conversion code and just upload the raw image[17:12:04] *** paragn <paragn!~paragn@fedora/paragn> has quit IRC (Ping timeout: 250 seconds)[17:12:31] *** paragn <paragn!~paragn@fedora/paragn> has joined #fedora-coreos[17:12:36] <sayan> and when we have vmdk as a produced artifact through koji, we will upload the vmdk's[17:25:34] <dustymabe> bgilbert: what do you think of my proposal in: https://github.com/coreos/fedora-coreos-tracker/issues/79#issuecomment-475256937[17:25:44] <dustymabe> i'd like to open a FESCO ticket soon[17:29:29] * dustymabe goes AFK for a bit[17:30:01] *** yuvalt <yuvalt!yturgema@nat/redhat/x-hqytuhmzzyfvcium> has quit IRC (Ping timeout: 255 seconds)[17:41:02] *** paragan <paragan!~paragan@unaffiliated/paragan> has quit IRC (Remote host closed the connection)[17:41:56] *** tmhoang <tmhoang!tmhoang@unaffiliated/tmhoang> has quit IRC (Quit: Leaving)[17:47:30] *** hbrueckner <hbrueckner!brueckner@nat/ibm/x-ltfmwczvcgoeylfq> has quit IRC (Remote host closed the connection)[17:54:51] *** ajeddeloh <ajeddeloh!~andrew@12.133.141.2> has joined #fedora-coreos[18:07:15] *** basvdlei <basvdlei!~basvdlei@109.69.228.221> has joined #fedora-coreos[18:09:57] *** basvdlei <basvdlei!~basvdlei@109.69.228.221> has quit IRC (Client Quit)[18:27:23] *** jligon <jligon!textual@nat/redhat/x-faakdrijxysvwkyd> has quit IRC (Quit: /me waves goodbye)[18:50:29] *** Son_Goku <Son_Goku!~King_InuY@fedora/ngompa> has joined #fedora-coreos[18:50:44] <bgilbert> dustymabe: commented[19:03:23] *** Son_Goku <Son_Goku!~King_InuY@fedora/ngompa> has quit IRC (Quit: My MacBook has gone to sleep. ZZZzzz…)[19:15:53] *** michelmno <michelmno!normand@nat/ibm/x-gbhvjlvliwrtzvxa> has quit IRC (Ping timeout: 245 seconds)[20:09:52] *** shardy <shardy!~shardy@145.96.2.81.in-addr.arpa> has quit IRC (Ping timeout: 250 seconds)[22:11:55] *** yzhang <yzhang!~yzhang@toroon0247w-lp140-02-65-94-197-117.dsl.bell.ca> has quit IRC (Quit: Leaving)[22:45:47] *** nalind <nalind!~nalin@144.121.20.162> has quit IRC (Quit: bye)[23:01:20] *** dm0 <dm0!~dm0@c-73-175-137-55.hsd1.pa.comcast.net> has quit IRC (Quit: Leaving.)[23:07:04] *** bgilbert <bgilbert!~bgilbert@cpe-98-14-241-92.nyc.res.rr.com> has quit IRC (Ping timeout: 255 seconds)[23:37:15] *** mheon <mheon!~mheon@pool-71-117-146-79.prvdri.fios.verizon.net> has quit IRC (Quit: WeeChat 2.2)