# iscsi for vm's

**URL:** <https://forums.suse.com/t/iscsi-for-vms/22311>\
**Category:** SLES Virtualization\
**Created:** [March 7, 2012, 3:43pm UTC](https://forums.suse.com/t/iscsi-for-vms/22311 "2012-03-07T15:43:02Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![System1](https://avatars.discourse-cdn.com/v4/letter/s/51bf81/32.png) [@System1](https://forums.suse.com/u/System1)\
**Post date:** [March 7, 2012, 3:43pm UTC](https://forums.suse.com/t/iscsi-for-vms/22311/1 "2012-03-07T15:43:02Z")

</div>

I have been doing reading on iscsi for hosting domu’s. I have been doing  
ocfs2 for a couple years hosting the vm’s as file based. I am trying now to  
redesign this now to use iscsi: based raw disks I suppose it would be put.  
What I need to know is if anyone has done any real world number differences  
between the 2. I would migrate all the vm’s that direction if that will  
increase the performance of the file system for the domu’s.

Thanks for any advice.

---

<div class="post-metadata">

**Author:** ![Willem1](https://avatars.discourse-cdn.com/v4/letter/w/c57346/32.png) [@Willem1](https://forums.suse.com/u/Willem1)\
**Post date:** [March 13, 2012, 10:09am UTC](https://forums.suse.com/t/iscsi-for-vms/22311/2 "2012-03-13T10:09:21Z")

</div>

> [@Rick B;2880](#):
>
> What I need to know is if anyone has done any real world number differences between the 2.

No real numbers that I can give you. Back in the SLES 10.1 / 10.2 days I did do allot of comparison between file based VM’s on OCFS2 and plain LVM / raw disk (over iSCSI as also fiber) access for the domU’s. I found OCFS2 to be slower and less stable. There has been enough development on OCFS2 since then, but I still prefer setting up the domU pointing to an LVM volume for the OS disk (so LVM snapshots can be made on the OS volume disk) and phy access to all the datadisks (as these are on a SAN in our case we can then leverage SAN snapshots for the DATA volumes).

As we don’t use the HAE pack in SLES 11, we don’t have cLVM. So to make sure that one domU does not get loaded twice across our Xen cluster, we use the Xen dom0 locking mechanism where each Xen host writes to a shared NFS share. Management of the clusters is mainly done through the open source Convirt solution (which also helps prevent accidental dual start).

That has been working very well for us for the last two/three years.

-Willem

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/flex022/uploads/suse/original/2X/5/5012ba89e3ffb5220dac47d5ea0ba032e2fe1cb6.png) [@system](https://forums.suse.com/u/system)\
**Post date:** [March 21, 2012, 7:59pm UTC](https://forums.suse.com/t/iscsi-for-vms/22311/3 "2012-03-21T19:59:11Z")

</div>

Magic31 wrote:  
[color=blue]

> Rick B;2880 Wrote:[color=green]
> 
> > What I need to know is if anyone has done any real world number  
> > differences between the 2.[/color]
> 
> No real numbers that I can give you. Back in the SLES 10.1 / 10.2  
> days I did do allot of comparison between file based VM’s on OCFS2 and  
> plain LVM / raw disk (over iSCSI as also fiber) access for the domU’s.  
> I found OCFS2 to be slower and less stable. There has been enough  
> development on OCFS2 since then, but I still prefer setting up the domU  
> pointing to an LVM volume for the OS disk (so LVM snapshots can be made  
> on the OS volume disk) and phy access to all the datadisks (as these are  
> on a SAN in our case we can then leverage SAN snapshots for the DATA  
> volumes).
> 
> As we don’t use the HAE pack in SLES 11, we don’t have cLVM. So to  
> make sure that one domU does not get loaded twice across our Xen  
> cluster, we use the Xen dom0 locking mechanism where each Xen host  
> writes to a shared NFS share. Management of the clusters is mainly done  
> through the open source Convirt solution (which also helps prevent  
> accidental dual start).
> 
> That has been working very well for us for the last two/three years.
> 
> -Willem
> 
> [/color]

Hi Willem,

Can you elaborate a little more please. I have the new iscsi san in place  
and have been trying to use iscsi:iqn,lun to attach but virt mgr does not  
like the ,lun at the end. it only we access the first lun by not specifying  
a lun. I guess I need to know if anyone else is actually doing it this way.  
This is SLES 11 SP1.

Does that have to be an nfs volume for the tracking of the node it is  
sitting on?

Thanks

---

<div class="post-metadata">

**Author:** ![Jens-U](https://avatars.discourse-cdn.com/v4/letter/j/d78d45/32.png) [@Jens-U](https://forums.suse.com/u/Jens-U)\
**Post date:** [March 22, 2012, 1:33pm UTC](https://forums.suse.com/t/iscsi-for-vms/22311/4 "2012-03-22T13:33:23Z")

</div>

Rick,

to answer that NFS part of your questions:

> > [COLOR=blue] As we don’t use the HAE pack in SLES 11, we don’t have cLVM. So to  
> > make sure that one domU does not get loaded twice across our Xen  
> > cluster, we use the Xen dom0 locking mechanism where each Xen host  
> > writes to a shared NFS share.[/COLOR]  
> > Does that have to be an nfs volume for the tracking of the node it is sitting on?

Nope, all you need is shared access to that “file space” from all Dom0s, and with locking support.

We’re using SLESS11SP1+HAE with OCFS2 via FC for /etc/xen/vm on currently only two Dom0 and have a subdir /etc/xen/vm/vm\_locks for all those xend DomU lock files. While it does work generally, we do see some severe hickups that we believe to come from somewhere in the OCFS2 layer (which seems not to cope well with all the locking going on). We’ve had that part on NFS for some time (without any problems) but switched back to OCFS2 for reasons beyond the scope of this discussion.

Regards,  
Jens

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/flex022/uploads/suse/original/2X/5/5012ba89e3ffb5220dac47d5ea0ba032e2fe1cb6.png) [@system](https://forums.suse.com/u/system)\
**Post date:** [March 23, 2012, 4:05pm UTC](https://forums.suse.com/t/iscsi-for-vms/22311/5 "2012-03-23T16:05:03Z")

</div>

Magic31 wrote:  
[color=blue]

> Rick B;2880 Wrote:[color=green]
> 
> > What I need to know is if anyone has done any real world number  
> > differences between the 2.[/color]
> 
> No real numbers that I can give you. Back in the SLES 10.1 / 10.2  
> days I did do allot of comparison between file based VM’s on OCFS2 and  
> plain LVM / raw disk (over iSCSI as also fiber) access for the domU’s.  
> I found OCFS2 to be slower and less stable. There has been enough  
> development on OCFS2 since then, but I still prefer setting up the domU  
> pointing to an LVM volume for the OS disk (so LVM snapshots can be made  
> on the OS volume disk) and phy access to all the datadisks (as these are  
> on a SAN in our case we can then leverage SAN snapshots for the DATA  
> volumes).
> 
> As we don’t use the HAE pack in SLES 11, we don’t have cLVM. So to  
> make sure that one domU does not get loaded twice across our Xen  
> cluster, we use the Xen dom0 locking mechanism where each Xen host  
> writes to a shared NFS share. Management of the clusters is mainly done  
> through the open source Convirt solution (which also helps prevent  
> accidental dual start).
> 
> That has been working very well for us for the last two/three years.
> 
> -Willem
> 
> [/color]

Willem do you know if Convirt will work with sles 11 sp2?
