BeeGFS Lustre WEKA File System

BeeGFS Lustre WEKA File System


Sven Breuner designed BeeGFS and now works with VAST

VAST doesn't offer Tiering but WEKA does

Vast requires some kernel modifications to enable multipathing. They are also selling a software platform with support and no longer build their own hardware
Performance wise Weka is the fastest


WEKA started as a Parallel File system, the other two didn’t.

Vast is based on proprietary hardware and it starts at 0.5PB. Dedup and compression are always on. You have a frontend and backend network. The GUI is very nice and easy for part-time storage admins. 

WEKA is based on standard x86 servers. The services are running in LXC containers. Scaling is more granular and you need some experience to size the servers. Every server gives you storage capacity and network bandwidth. Min. size 8 servers for a cluster (even if it runs on a single server too). 


On the parallel file system front you have WEKA, GPFS, Lustre, Quobyte, BeeGFS as solutions that run more or less on commodity hardware. One major difference between the file systems is the fault tolerance (Lustre and to some degree BeeGFS require hardware redundancy) and only some (GPFS, Quobyte) offer non-disruptive updates. 

WEKA runs only on flash, the others support both flash and HDD.


 GPUDirect Storage to provide a direct path between storage and GPU memory, avoiding extra copies through a bounce buffer in the CPU's 

    • Related Articles

    • How to use official ThinkParQ script to collect detailed BeeGFS Logs

      1. Purpose This document describes how to collect a full BeeGFS diagnostic bundle using the official ThinkParQ script. Applicable for environments running: BeeGFS This procedure is typically requested by: BeeGFS / ThinkParQ Support NetApp (when ...

    • BeeGFS Metadata Check Before Large File Ingest

      1. Purpose To validate metadata and inode capacity before ingesting a very large number of small files into a BeeGFS filesystem. Step 1 - Check Metadata Inodes Run beegfs-df on any BeeGFS client This checks if the nodes have enough Inode capacity for ...

    • Mount NTFS File System Flash Drive in Centos7.

      To Mount NTFS File System USB Drive/Pen Drive/Flash Drive execute following Commands: - Install NTFS Package. sudo yum install -y epel-release ntfs-3g Now mount Pen Drive. mkdir /mnt/pendrive sudo mount -t ntfs-3g /dev/sdd1 /mnt/pendrive Note: ...

    • How to collect diagnostic logs using the NetApp Log Collection Script

      1. Purpose This document describes the procedure to collect diagnostic logs using the NetApp Log Collection Script in environments running: BeeGFS NetApp E-Series backend storage HA cluster using Pacemaker and Corosync This script is typically ...

    • Permanent Mount Devices/File System in Linux

      How to mount Devices/File System in Linux This guide only covers NTFS partitions, for other file systems you will need to change the commands or types as needed. Mounting makes file systems, files, directories, devices, and special files available ...

    • Popular Articles

    • CP Plus Camera and NVR Configuration

      NVR Configuration The CP Plus Pro Series of NVRs have been meticulously designed for providing you with upgraded performance and higher recording quality in your IP video surveillance solution. The robust processor that has been inculcated in this ...

    • Kerberos Authentication – Overview

      What is Kerberos? Kerberos is a secure authentication method used in our Active Directory (AD) environment (mbuzztech.com). It allows users to: Access multiple systems without re-entering passwords (Single Sign-On – SSO) Log in once Where We Use It ...

    • How to Remove and Reinstall NVIDIA Drivers on Ubuntu

      This article provides step by step guide to completely remove existing NVIDIA drivers and reinstall specific version of the NVIDIA driver on the Ubuntu system Prerequisites Administrative (sudo) access to the Ubuntu system. Internet access to ...

    • Personal Computers and Servers - Classification and Point of Contact

      We can classify the computers that MBUZZ handles based on their form-factor as below: Tower Workstations, Desktops, Gaming PCs and SFF (Small form factor) PCs fall under this category. These are computers people would use on a desk and rarely move. ...

    • M.2 SSD Tier List

      The sequential read and write speeds, which are usually the most advertised number, are not a proper benchmark of real-world performance or the quality of an SSD. This article categorizes and tiers SSDs based on factors like the type of NAND flash, ...