Bonding vs Teaming: Any advice, benchmarks, gotchas, replication performance?

October 27, 2016, 7:14 am

≫ Next: ROCKONS - and uninstalling them (noob)

≪ Previous: Unknown internal error doing a PUT to /api/pools/Storage/remove

TLDR
I have two HP microservers: one runs Rockstor under ESXi with the drives passed through as RAW devices (RDMs); the other runs Rockstor natively. Both have 3 LAN-facing network adapters (NICs). Does anyone have any experience of bonding or teaming NICs, and what options are best to get the most speed out of replication?

Details
Originally both appliances were running under ESXi with each using just one NIC. When replicating shares between the boxes I was getting about 35-40MB/s. I tried using NIC-teaming in ESXi and the replication rate dropped to 20MB/s - possibly because my switch doesn't support 802.3ad link aggregation.

I have now rebuilt the second appliance to run natively, removed NIC-teaming from the ESXi Rockstor appliance and given both access to three LAN facing NICs.

I have about 3TB of data to replicate across my GB network and I'd like it to run as quickly as possible. Plus I'd like to get teaming / bonding to work because why not.

ESXi appliance has 4x3GB WD Red running in RAID10 plus an SSD for Rockstor (and the other ESXi VMs). The native appliance has 7 disks of various sizes totalling 3.5TB, setup as a "single" pool, and a USB stick for Rockstor. I would really like to max out the network for replication.

Does anyone have any advice as on:

Whether to choose bonding or teaming?

Which options to choose within the above - loadbalance, round robin etc?

Which would work best (if at all) for three NICs?

Note, my switch doe NOT support 802.3ad, but I would consider upgrading it if there was evidence to suggest it would give me a major speed bump under a particular setup. Both appliances are running 3.8-14.

Posts: 3

Participants: 2

Read full topic

↧

ROCKONS - and uninstalling them (noob)

October 27, 2016, 10:19 am

≫ Next: HDD containing Rockstor OS died

≪ Previous: Bonding vs Teaming: Any advice, benchmarks, gotchas, replication performance?

@semnell wrote:

So well after installing rockstor yesterday i noticed that pressing the uninstall doesn't do anything.
I'd like to remove some rockons seeing as they aren't working.

Posts: 1

Participants: 1

Read full topic

↧

HDD containing Rockstor OS died

October 27, 2016, 9:24 pm

≫ Next: Rockstor keeps mailing me about a smart error

≪ Previous: ROCKONS - and uninstalling them (noob)

@gangerx05 wrote:

I have 3 disks installed on the NAS. 1 for OS and 2 for data. My problem is that the disk just died and I'm wondering if I can reinstall Rockstor on a new disk but I'm a little bit scare that I will lose all my data.

Can it be done?

Posts: 3

Participants: 2

Read full topic

↧

Rockstor keeps mailing me about a smart error

October 27, 2016, 11:32 pm

≫ Next: Importing a BTRFS array from a different server

≪ Previous: HDD containing Rockstor OS died

@KarstenV wrote:

One of my disks has had a SMART error:

Pasted image1227x27 920 Bytes

Rockstor has kindly send me an email, and I am now aware of the problem (I think its insignificant, but will keep an eye on it).

But now I get a mail every hour or so about this, and its getting annoying. Is there a way to tell Rockstor I'm aware of this, so it doesn't spam me with e-mails?

Posts: 1

Participants: 1

Read full topic

↧

Importing a BTRFS array from a different server

October 28, 2016, 6:42 am

≫ Next: Rockstor will only boot when in recovery mode

≪ Previous: Rockstor keeps mailing me about a smart error

@philtrick wrote:

Hi,

I have installed Rockstor on a HP Microserver Gen8, and I had a question with regard to a BTRFS array I have from a previous server, which isn't BTRFS based.

I set up a BTRFS RAID array of 4 x 4TB disks previously, and upon the new install, they show up under physical disks, and they give the option to import them.

I click the arrow, and they show up as a pool of "none" and are mounted on /mnt2/none

Details:
[root@nas ~]# btrfs fi df /mnt2/none/
Data, single: total=7.31TiB, used=7.31TiB
System, RAID1: total=32.00MiB, used=800.00KiB
Metadata, RAID1: total=12.00GiB, used=10.36GiB
GlobalReserve, single: total=512.00MiB, used=0.00B
[root@nas ~]# btrfs fi show
Label: 'rockstor_rockstor'  uuid: 02381824-7e07-4c1c-8506-b0d9c715650e
Total devices 1 FS bytes used 1.62GiB
devid    1 size 25.58GiB used 4.04GiB path /dev/sdd3
Label: none  uuid: b7ee4b72-afe8-4ccc-99db-fe737ab52b10
Total devices 4 FS bytes used 7.32TiB
devid    1 size 3.64TiB used 1.83TiB path /dev/sda
devid    2 size 3.64TiB used 1.83TiB path /dev/sdb
devid    3 size 3.64TiB used 1.83TiB path /dev/sdc
devid    4 size 3.64TiB used 1.83TiB path /dev/sdf
However, the pool does not seem to persist, am I missing something here, or is there a way I can add these drives as a pool permanently, and maybe even change the name of the pool?
Thanks,
Phil

Posts: 3

Participants: 3

Read full topic

↧

Rockstor will only boot when in recovery mode

October 28, 2016, 8:05 am

≫ Next: Exception while running command(['/usr/bin/hostnamectl', '--static']): [Errno 24] Too many open files

≪ Previous: Importing a BTRFS array from a different server

@semnell wrote:

open ctree failed
and afterwards it just says emergency mode

when in recovery mode however it boots normally

?????

Posts: 1

Participants: 1

Read full topic

↧

Exception while running command(['/usr/bin/hostnamectl', '--static']): [Errno 24] Too many open files

November 1, 2016, 2:59 pm

≫ Next: Have converted my pool from RAID6 to RAID1, but still some RAID 6 on disk?

≪ Previous: Rockstor will only boot when in recovery mode

@semnell wrote:

        Traceback (most recent call last):
File "/opt/rockstor/src/rockstor/rest_framework_custom/generic_view.py", line 40, in handleexception
yield
File "/opt/rockstor/src/rockstor/storageadmin/views/appliances.py", line 42, in get_queryset
self.updatehostname()
File "/opt/rockstor/eggs/Django-1.6.11-py2.7.egg/django/db/transaction.py", line 371, in inner
return func(*args, **kwargs)
File "/opt/rockstor/src/rockstor/storageadmin/views/appliances.py", line 49, in updatehostname
cur_hostname = gethostname()
File "/opt/rockstor/src/rockstor/system/osi.py", line 362, in gethostname
o, e, rc = run_command([HOSTNAMECTL, '--static'])
File "/opt/rockstor/src/rockstor/system/osi.py", line 90, in run_command
raise Exception(msg)
Exception: Exception while running command(['/usr/bin/hostnamectl', '--static']): [Errno 24] Too many open files
whilst entering the web ui

Posts: 2

Participants: 2

Read full topic

↧

Have converted my pool from RAID6 to RAID1, but still some RAID 6 on disk?

November 2, 2016, 4:14 am

≫ Next: The new disk activity widget, possible enhancements

≪ Previous: Exception while running command(['/usr/bin/hostnamectl', '--static']): [Errno 24] Too many open files

@KarstenV wrote:

I have been doing some drive replacement, and afterwards a conversion from RAID6 to RAID1.

All of these things went without problems, my data now resides on RAID1 and I feel more secure now that my pool is recoverable in case of a failure.

But I do get this when running "btrfs fi us":
Pasted image533x769 5.98 KB

Note the warning about RAID56 being detected, and that there is actually a 104 GB RAID6 array on the disks.

What could this be? Some kind of metadata that did not get converted? Something else? How do I get the 104 Gb data back?

I don't see the RAID6 array anywhere in Rockstor's UI.

Posts: 2

Participants: 1

Read full topic

↧

The new disk activity widget, possible enhancements

November 3, 2016, 2:11 am

≫ Next: Setup External Acces

≪ Previous: Have converted my pool from RAID6 to RAID1, but still some RAID 6 on disk?

@KarstenV wrote:

With the latest updates to the testing channel the Dashboard widgets have been massively improved, to a point where they never crash my browsers. Good job!

The disk activity also got a "facelift".

I really like the new widget, but there is room for improvement (I think):

The colour of a disk should allways remain the same, so that its easier to follow in the graphical view at the top of the widget. As it is now it is almost impossible to see which disk is active, and when you find it, another one has taken its colour due to the automatic sorting. This way you could also eliminate disks from the view, by choosing them in the list (as of now it just eliminates the colour, which is not very usefull).

In the bottom disk activity bar, I would like a selection that shows a graph for all the drives (where their activities are added together). Prefereably with the same colours as above.

Hope my explenations are understandable

Posts: 7

Participants: 3

Read full topic

↧

Setup External Acces

November 3, 2016, 5:46 am

≫ Next: Grub install fails

≪ Previous: The new disk activity widget, possible enhancements

@ViciousNAS wrote:

Hi

First off English is not my first language is I will apologies for multiple grammar mistakes in advance.

I have been struggling with setting up Rockstor NAS for a couple of days now. And now i have finally found my ways to the forums i am usually to block headed to go there. I have a file server up and running right now and I can access data and write to it via my own LAN. But i would really like to set up my NAS for external use so that when I am on school I can access it from there. Now i have been reading on the subject and it should be possible to do using SFTP and port forwarding port 80 and 22. But i don't know what to do after that and I can't find much on the forums and internet. I did read a post about External Access on this forum about VPNing to the NAS if that could work it would be fine too.If someone knows how to fix this it would be AWESOME

Posts: 1

Participants: 1

Read full topic

↧

Grub install fails

November 3, 2016, 8:26 am

≫ Next: Pre-seeding replication partner

≪ Previous: Setup External Acces

@g6094199 wrote:

He Guys!

I'm facing a major problem while trying to install on a 200GB disk.

beside the "dm-raid module not found" problem, which can be resolved by adding an centos mirror at install time, there are many hickups in the installer, which are not logical to even experienced users. (I'm using gnu/linux systems exclusivly for over 10 years now, so i would call me experienced user).

I know that you simply reuse the centos installer, but afaik your build is based on a system at least one year old. so imho an importand update should be a rebase the installer to the current one from centos where many of the install problems around might be fixed out of the box.

My current problem is as follows:
I try to install a non raid btrfs plain system to an 200gb disk.
just ext4 boot partition, / and /home on subvolumes and a small swap partition, but the installer fails while finishing (installing grub) the installation. i checked the uuid's fron the partition and what the grub conf contains. they are ok. imho.

IMG_20161102_171806.jpg4249x2390 2.46 MB

IMG_20161102_171816.jpg4249x2390 1.93 MB

IMG_20161102_171835.jpg5312x2988 1.87 MB

IMG_20161102_171844.jpg5312x2988 2.49 MB

IMG_20161102_171905.jpg5312x2988 2.05 MB

Posts: 1

Participants: 1

Read full topic

↧

Pre-seeding replication partner

November 3, 2016, 12:11 pm

≫ Next: No network after router reboots

≪ Previous: Grub install fails

@clawes wrote:

I wish to setup 2 Rockstor appliances to replicate shares. The appliances will be different cities and will connected over a VPN tunnel.

I have over 1TB of data that I wish to replicate/synchronize between the two. My question is this:

Is it possible to pre-seed the remote partner and avoid sending all that data over the slow and costly VPN tunnel?

Posts: 4

Participants: 2

Read full topic

↧

No network after router reboots

November 3, 2016, 8:09 pm

≫ Next: Installation doesn't detect my USB flash drive

≪ Previous: Pre-seeding replication partner

@xirian wrote:

Whenever my server loses its network connection if my router gets rebooted I can no longer connect to it without plugging a keyboard in and hitting ctrl alt delete to reboot rockstor. How can I make fix this?

Posts: 3

Participants: 2

Read full topic

↧

Installation doesn't detect my USB flash drive

November 3, 2016, 8:39 pm

≫ Next: [SOLVED] New System Shell under 3.8.15-0 not working

≪ Previous: No network after router reboots

@Flandry wrote:

I've been trying to overcome what seems should be a simple problem if the installer weren't so simple that it doesn't let you tell it what to do. I'm installing from a 16 GB USB flash drive (prepared with dd from linux) to an 8 GB flash drive (if it matters i'm using the smaller one because it's much faster and AFAIK only 8 GB are necessary). The problem is, when i get into the install it doesn't show either USB drive as a potential destination (i wouldn't necessarily expect it to show the installation media anyway, but i don't know if that's normal or not). I verified that both the USB drives are detected devices by checking /dev/sd* and identified that /dev/sde is the 8 GB drive using print devices in parted from the console in the install session.

If there were a way to say "install to /dev/sde whether you think it's there or not" it would be great, but i can't find a way to do that.

Things i've checked:
both usb drives automount fine when i boot into my debian install on the same box i'm trying to convert to a Rockstor NAS.
i've twiddled all the USB-related BIOS options
i've deleted the existing partition and repartitioned the target drive FAT32 using gparted
I'm not sure it would help but i think i may have banged my head against it, too.

I'm not familiar with the rpm side of the divide so maybe i've missed an install parameter i could use. If not is there an alternative way to install, sort of a live disk setup? I'm really excited for a btrfs/linux NAS but i'm not sure what else to try here. Thanks.

ETA: I've discovered if i unplug and reconnect the 8GB drive after entering Install, it will show up (sometimes) as an install drive option, but then the install program will crash. It almost seems like the program will only recognize one USB drive at a time, so doing that makes it lose track of the install media.

Posts: 1

Participants: 1

Read full topic

↧

[SOLVED] New System Shell under 3.8.15-0 not working

November 4, 2016, 1:52 am

≫ Next: Unknown internal error doing a GET to /api/users

≪ Previous: Installation doesn't detect my USB flash drive

@glenngould wrote:

After the silent upgrade to stable 3.8.15-0 and a reboot I wanted to try the new "system shell" that has been also requested by me...pressing the button/link, nothing happens (only spinning blue arrows appear, like after pressing update rock-ons button).

Any idea?

thx

Posts: 4

Participants: 2

Read full topic

↧

Unknown internal error doing a GET to /api/users

November 4, 2016, 3:34 am

≫ Next: Auto error report forum link from the GUI broken

≪ Previous: [SOLVED] New System Shell under 3.8.15-0 not working

@g6094199 wrote:

Hola,

found a bug.
I have an install with only one local user. Now i added a ADS connection and afterwards i get this error message on several pages:

Bildschirmfoto vom 2016-11-04 11-28-43.png1280x1024 174 KB

e.g. when i try to add a samba share

Posts: 2

Participants: 2

Read full topic

↧

Auto error report forum link from the GUI broken

November 4, 2016, 3:41 am

≫ Next: Unable to check update due to a system error: Error running a command. cmd

≪ Previous: Unknown internal error doing a GET to /api/users

@g6094199 wrote:

He,

2nd small bug today.
when i try to auto report this bug:

Bildschirmfoto vom 2016-11-04 11-28-43.png1280x1024 174 KB

i hit "3. Create a support topic with information from above two steps here."
the link connected with "here" brings up:

Bildschirmfoto vom 2016-11-04 11-35-53.png1280x1024 429 KB

which is somehow broken i guess.

regards

Posts: 1

Participants: 1

Read full topic

↧

Unable to check update due to a system error: Error running a command. cmd

November 4, 2016, 3:09 pm

≫ Next: Failed to start: Crash recover kernel arming

≪ Previous: Auto error report forum link from the GUI broken

@Glock24 wrote:

[Please complete the below template with details of the problem reported on your Web-UI. Be as detailed as possible. Community members, including developers, shall try and help. Thanks for your time in reporting this issue! We recommend purchasing commercial support for expedited support directly from the developers.]

Brief description of the problem

Tired to activate unstable updates and error is shown

Detailed step by step instructions to reproduce the problem

Go to System -> Sowftware Updates -> Select activate unstable updates

Web-UI screenshot

[Drag and drop the image here]

Error Traceback provided on the Web-UI
            Traceback (most recent call last):
File "/opt/rockstor/src/rockstor/storageadmin/views/command.py", line 177, in post
return Response(update_check(subscription=subo))
File "/opt/rockstor/src/rockstor/system/pkg_mgmt.py", line 155, in update_check
o, e, rc = run_command([YUM, 'changelog', date, pkg])
File "/opt/rockstor/src/rockstor/system/osi.py", line 98, in run_command
raise CommandException(cmd, out, err, rc)
CommandException: Error running a command. cmd = ['/usr/bin/yum', 'changelog', '2016-Jun-20', 'rockstor']. rc = 1. stdout = ['Loaded plugins: changelog, fastestmirror', '']. stderr = ['http://updates.rockstor.com:8999/rockstor-testing/repodata/repomd.xml: [Errno 14] HTTP Error 404 - Not Found', 'Trying other mirror.', 'To address this issue please refer to the below knowledge base article ', '', 'https://access.redhat.com/articles/1320623', '', "If above article doesn't help to resolve this issue please create a bug on https://bugs.centos.org/", '', '', '', ' One of the configured repositories failed (Subscription channel for testing updates),', " and yum doesn't have enough cached data to continue. At this point the only", ' safe thing yum can do is fail. There are a few ways to work "fix" this:', '', ' 1. Contact the upstream for the repository and get them to fix the problem.', '', ' 2. Reconfigure the baseurl/etc. for the repository, to point to a working', ' upstream. This is most often useful if you are using a newer', ' distribution release than is supported by the repository (and the', ' packages for the previous distribution release still work).', '', " 3. Disable the repository, so yum won't use it by default. Yum will then", ' just ignore the repository until you permanently enable it again or use', ' --enablerepo for temporary usage:', '', ' yum-config-manager --disable Rockstor-Testing', '', ' 4. Configure the failing repository to be skipped, if it is unavailable.', ' Note that yum will try to contact the repo. when it runs most commands,', ' so will have to try and fail each time (and thus. yum will be be much', ' slower). If it is a very temporary problem though, this is often a nice', ' compromise:', '', ' yum-config-manager --save --setopt=Rockstor-Testing.skip_if_unavailable=true', '', 'failure: repodata/repomd.xml from Rockstor-Testing: [Errno 256] No more mirrors to try.', 'http://updates.rockstor.com:8999/rockstor-testing/repodata/repomd.xml: [Errno 14] HTTP Error 404 - Not Found', '']

Posts: 2

Participants: 2

Read full topic

↧

Failed to start: Crash recover kernel arming

November 6, 2016, 5:51 pm

≫ Next: Enhancement: enlage field size on shares page

≪ Previous: Unable to check update due to a system error: Error running a command. cmd

@William212 wrote:

Help!

All of a sudden I can't connect to the UI URL and when I rebooted my rockstor server I get the message "[34.543182 systemd[1]: Failed to Start: Crash recovery kernel arming"

Posts: 3

Participants: 2

Read full topic

↧

Enhancement: enlage field size on shares page

November 7, 2016, 4:58 am

≫ Next: Stuck in read-only after drive failure (raid6, drive didn't fail)

≪ Previous: Failed to start: Crash recover kernel arming

@g6094199 wrote:

hi

the size of the "share size" field is much to small to display all digits.
plz enlarge.

Bildschirmfoto vom 2016-11-07 13-51-20.png1280x1024 178 KB