June 23, 2010 
< | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | 13 | 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | 22 | 23 | 24 | 25 | 26 | 27 | 28 | 29 | 30 | >
June 23, 2010 NOTICE: This channel is no longer actively logged.
[00:00:28] *** TheSHAD0W has quit IRC[00:11:00] *** TheSHAD0W has joined #bittorrent[00:14:09] *** TheSHAD0W has quit IRC[00:15:57] *** TheSHAD0W has joined #bittorrent[00:20:18] *** TheSHAD0W has quit IRC[00:24:57] *** TheSHAD0W has joined #bittorrent[00:36:32] *** Andrius has quit IRC[02:02:20] *** ajaya has quit IRC[03:15:45] *** init0 has quit IRC[03:17:33] *** init0 has joined #bittorrent[03:36:57] *** ajaya has joined #bittorrent[03:58:40] *** edigaryev has joined #bittorrent[03:59:43] *** goussx has quit IRC[04:02:04] *** The_8472 has quit IRC[04:06:29] *** The_8472 has joined #bittorrent[04:08:53] *** ajaya has quit IRC[04:35:46] *** goussx has joined #bittorrent[06:25:56] *** MassaRoddel has quit IRC[06:43:22] *** ajaya has joined #bittorrent[07:06:22] *** ajaya has quit IRC[07:15:27] *** MassaRoddel has joined #bittorrent[07:36:04] *** hydri has joined #bittorrent[07:55:57] *** Andrius has joined #bittorrent[08:36:06] *** edigaryev has quit IRC[08:40:20] *** edigaryev has joined #bittorrent[09:15:21] *** cyb2063 has joined #bittorrent[09:18:59] *** cyb2063_ has joined #bittorrent[09:21:39] *** cyb2063 has quit IRC[09:26:03] *** e-manuel has joined #bittorrent[09:26:55] *** e-manuel has quit IRC[09:29:59] *** e-manuel has joined #bittorrent[09:43:45] *** cyb2063_ has quit IRC[09:48:29] *** cyb2063 has joined #bittorrent[10:00:53] *** e-manuel has quit IRC[11:27:06] *** cyb2063 has quit IRC[11:32:42] *** cyb2063 has joined #bittorrent[11:32:42] *** cyb2063 has quit IRC[11:32:42] *** cyb2063 has joined #bittorrent[11:44:45] *** goussx has quit IRC[12:16:08] *** Ersan has joined #bittorrent[12:16:23] <Ersan> hey what do you think the best filesystem/raid setup would be for a lot of torrent activity[12:17:13] <kjetilho> OS?[12:17:59] <Ersan> linux[12:18:25] <Ersan> cause right now i have a raid0 with a rather small block size on ext3 and it's god-awful[12:18:33] <Ersan> chunk size*[12:18:51] <Ersan> small chunk size is terrible cause of random reads[12:18:57] <Ersan> and i think raid0 is as well?[12:19:26] <kjetilho> I don't think chunk size matters much[12:19:34] <kjetilho> BT requests in small blocks anyway[12:19:53] <kjetilho> so unless it was smaller than 64 KiB...[12:20:03] <Ersan> alot of torrents have upwards of 4MB chunks no?[12:20:10] <Ersan> and it was 4KB, which was bad[12:20:17] <kjetilho> yes, but the request size is small[12:20:28] <kjetilho> ouch. 4 KiB is not good :)[12:20:32] <Ersan> yeah :P[12:20:40] <Ersan> so you think 64KiB or even larger?[12:20:53] <kjetilho> the only thing helping random reads is more RAM. or SSD[12:21:24] <kjetilho> with a truly random load, you want each I/O request to only need one disk to do a seek[12:21:26] <Ersan> well i have ssd's in this server now and i wrote a program to move the fastest torrents among every user to the SSD[12:21:33] <kjetilho> at least that's my philosophy[12:21:35] <Ersan> every hour or so[12:21:46] <Ersan> but i need to get enough performance out of the archive spindle drives[12:21:53] <Ersan> that they aren't bringing down the whole server y'know[12:22:13] <kjetilho> you know, ZFS on OpenSolaris would exploit your SSDs automatically[12:22:31] <Ersan> how about for the spindle drives though[12:22:39] <Ersan> and i can't really use solaris :\[12:22:49] <kjetilho> it would use the SSD for caching (it's called L2ARC)[12:22:56] <Ersan> oh, thats cool[12:23:14] <Ersan> but yeah.. stuck with linux[12:23:19] <Ersan> for now at least[12:23:36] <Ersan> alot of the software i wrote sort of depends on it[12:23:51] <Ersan> what about filesystem?[12:23:56] <Ersan> and JBOD or RAID0?[12:24:14] <kjetilho> JBOD is a lot of hassle, isn't it?[12:24:23] <kjetilho> at least if you use JBOD in its original meaning[12:24:59] <Ersan> jbod as in it just writes to one drive until it fills up then goes to the next one[12:25:05] <Ersan> and shows up as one large disk in linux[12:25:28] <kjetilho> ok. I think that's RAID0, too :-p[12:25:35] <kjetilho> although concat, not striped[12:25:40] <Ersan> yeah concat[12:26:02] <Ersan> which doesnt rely on 3 drives seek time to retrieve data[12:26:05] <kjetilho> I would go for RAID1 no matter what[12:26:17] <Ersan> eh the data itself isnt important i just need performance[12:26:21] <kjetilho> since you get twice the read I/O, *and* you don't get in problem WHEN a disk fails[12:27:02] <Ersan> hows it give you more read I/O?[12:27:08] <Ersan> i thought it was the same as a single drive[12:27:48] <kjetilho> you can read from either side of the mirror[12:28:02] <kjetilho> simultaneously[12:28:14] <kjetilho> of course, for a single linear test, you won't notice it much[12:28:14] <Ersan> ah interesting[12:32:54] <Ersan> how about filesystem[12:34:52] <kjetilho> my shortlist would be ext4 and XFS[12:35:07] <kjetilho> but I don't have any experience running a large torrent server :-p[12:35:57] <Ersan> what about reiserfs[12:36:44] <Ersan> it says it works very well with small files[12:36:53] <Ersan> i mean technically the files are large but[12:43:10] <Ersan> blah this kernel doesnt support reiserfs... hate recompiling[13:29:42] <alus> obligatory murder joke[13:29:54] <The_8472> ext3 should be fine. just mount it with noatime[13:29:58] <The_8472> and tweak the block sizes[13:30:03] <The_8472> and disable journaling[13:30:06] <alus> yeah atime is for sissies[13:30:50] <The_8472> 16KiB block sizes should be best for bittorrent i think[13:31:01] <The_8472> mhh... well... probably not[13:31:14] <The_8472> since bittorrent-blocks aren't aligned with FS-blocks[13:31:20] <The_8472> except for the first file[13:31:36] <alus> testing is the answer[13:31:51] <alus> testing will protect you from the terrible secret of space[13:32:00] <The_8472> hehe[13:32:29] <The_8472> btw, some newer harddrives have larger blocks too, not just 512 bytes anymore. they make some with 4k blocks i think[13:39:27] <Ersan> so[13:39:32] <Ersan> 16KiB fs blocks?[13:41:04] <The_8472> at least. but like alus said... testing[13:41:50] <The_8472> do you have mostly single file torrents or plenty of multifile torrents too?[13:42:08] <Ersan> mostly multifile[13:42:16] <Ersan> im testing[13:42:31] <Ersan> random read performance w/ 2MB reads using iozone[13:42:36] <The_8472> mhh, then idk. since blocks aren't aligned for multifile torrents[13:42:38] <Ersan> with a few different filesystems[13:42:50] <Ersan> and block sizes and stripe sizes[13:42:55] <The_8472> but a good client should do read-aheads anyway[13:43:24] <The_8472> if you want to use SSDs you need a kernel with TRIM support[13:44:18] <Ersan> this kernel's got tht[13:44:19] <Ersan> that*[13:45:12] <Ersan> actually no it hasn't[13:45:48] <Ersan> i installed wiper.sh[14:17:42] <Ersan> using 256KB raid0 stripes and 4k kernel blocks with reiserfs and everything seems good so far[14:17:51] <Ersan> filesystem blocks*[14:19:44] <DeHackEd> well, not NEED but it's recommended...[14:20:43] <The_8472> it's needed if he wants to retain performance ^^[14:21:33] <kjetilho> The_8472: depends on the SSD firmware, really.[14:21:44] <DeHackEd> I have an intel x25-M. should I?[14:21:56] <kjetilho> DeHackEd: 2nd generation?[14:22:19] <DeHackEd> It's a week old relative to when I bought it... yes?[14:22:26] <kjetilho> 2nd gen retains performance pretty well without TRIM[14:22:47] <Ersan> this isnt the SSD[14:22:49] <DeHackEd> yeah, I'm not going to have bumped into the point where I need trim yet[14:23:00] <Ersan> oh you're talking about trim nvm[14:23:30] <Ersan> it has X25-E's[14:28:25] <The_8472> kjetilho, afaik some of the older ones can be upgraded to support trim too[14:28:57] <The_8472> and no, even with newer firmwares performance will degrade eventually without TRIM as it fills up[14:29:08] <The_8472> simply because the firmware won't know about any "free" sectors anymore[14:29:31] <The_8472> so it'll always have to do read-modify-erase-write cycle instead of just writing to an empty block[14:29:57] <The_8472> TRIM allows the firmware to pre-erase empty blocks for future writes[14:30:16] <kjetilho> The_8472: there is quite a bit of spare capacity to enable more efficient GC[14:34:16] <The_8472> question is if that helps with bulk operations[14:34:23] <The_8472> moving several GB onto or off the SSD[14:59:08] *** Ersan has quit IRC[15:24:13] *** ivan` has quit IRC[15:30:36] *** ivan` has joined #bittorrent[16:00:32] *** cyb2063 has quit IRC[16:04:10] *** goussx has joined #bittorrent[16:12:42] *** Switeck has joined #bittorrent[16:36:50] *** IRConan has quit IRC[16:36:59] *** IRConan has joined #bittorrent[16:49:29] *** e-manuel has joined #bittorrent[17:11:43] *** e-manuel has quit IRC[17:45:09] *** ajaya has joined #bittorrent[17:58:47] *** ajaya has quit IRC[18:12:51] *** Switeck has quit IRC[18:13:03] *** Switeck has joined #bittorrent[18:20:08] <TheSHAD0W> http://www.bunniestudios.com/blog/?p=1140[19:37:07] *** MassaRoddel has quit IRC[19:44:47] *** MassaRoddel has joined #bittorrent[19:46:27] *** MassaRoddel has quit IRC[19:58:45] *** MassaRoddel has joined #bittorrent[20:24:24] <burris> that thing is sweet for under $200[21:16:55] <TheSHAD0W> http://qdb.us/302899[21:24:29] <The_8472> quite an old trick[21:47:08] *** Switeck has quit IRC[22:32:00] *** ajaya has joined #bittorrent[22:44:17] *** Saphira4598 has joined #bittorrent[22:55:41] <Saphira4598> We're certainly quiet...[23:04:37] *** edigaryev has quit IRC[23:06:46] * The_8472 emits high frequency gravitational waves that induce mechanical vibrations into matter, perceivable as sound[23:09:57] *** ajaya has quit IRC[23:10:46] *** Saphira4598 has quit IRC[23:30:45] *** K`Tetch has quit IRC[23:32:12] <The_8472> http://arstechnica.com/tech-policy/2010/06/google-beats-viacom-in-billion-dollar-lawsuit.ars[23:35:17] *** K`Tetch has joined #bittorrent