Mirantis OpenStack

  • Download

    Mirantis OpenStack is the zero lock-in distro that makes deploying your cloud easier, and more flexible, and more reliable.

  • On-Demand

    Mirantis OpenStack Express is on demand Private-Cloud-as-a-Service. Fire up your own cloud and deploy your workloads immediately.

Solutions Engineering

Services offerings for all phases of the OpenStack lifecycle, from green-field to migration to scale-out optimization, including Migration, Self-service IT as a Service (ITaaS), CI/CD. Learn More

Deployment and Operations

The deep bench of OpenStack infrrastructure experts has the proven experience across scores of deployments and uses cases, to ensure you get OpenStack running fast and delivering continuous ROI.

Driver Testing and Certification

Mirantis provides coding, testing and maintenance for OpenStack drivers to help infrastructure companies integrate with OpenStack and deliver innovation to cloud customers and operators. Learn More

Certification Exam

Know OpenStack? Prove it. An IT professional who has earned the Mirantis® Certificate of Expertise in OpenStack has demonstrated the skills, knowledge, and abilities needed to create, configure, and manage OpenStack environments.

OpenStack Bootcamp

New to OpenStack and need the skills to run an OpenStack cluster yourself? Our bestselling 3 day course gives you the hands-on knowledge you need.

OpenStack: Now

Your one stop for the latest news and technical updates from across OpenStack ecosystem and marketplace, for all the information you need stay on top of rapid the pace innovation.

Read the Latest

The #1 Pure Play OpenStack Company

Some vendors choose to “improve” OpenStack by salting it with their own exclusive technology. At Mirantis, we’re totally committed to keeping production open source clouds free of proprietary hooks or opaque packaging. When you choose to work with us, you stay in full control of your infrastructure roadmap.

Learn about Our Philosophy

Integrating OpenStack Cloud Nova Volume storage with Isilon

on October 15, 2012

What do you use to store your OpenStack volumes? If you’re building an OpenStack cloud, you’ll need that block level storage to give to your instances through an iSCSI session by default. If  you want to have intelligent, flexible, scalable, and reliable physical storage for this purpose, one alternative you might consider is the Isilon IQ clustered storage system. We’ve created a driver you can use with it.

Now a part of EMC, Isilon was created to meet the needs of high-performance computing environments to provide both scalability and performance. The core of this uses an intelligent OneFS distributed file system. Key features:

  • 60-second on-the-fly scaling of capacity and performance
  • A single file system with a single global namespace
  • The ability to place mission-critical, latency-sensitive data on SSDs
  • High utilization rates going up to 80%.
So, it’s a great piece of gear. (In fact, if you already use Isilon but haven’t started with OpenStack, it’s a great foundation to use in building out your cloud). But to use any kind of volume Nova always needs a way to communicate with its driver. For example, there are the following backends for the nova-volume service:
  • iSCSI
  • Xen Storage Manager
  • Nexenta
  • SAN-style (Solaris-hosted iSCSI, SolidFire)

Let’s look at how this driver works.

Nova Volume driver

Nova uses the volume manager to control attachable block storage devices (volumes) and this control strategy is seen in the driver used:

This is a simplified scheme, but it does a good job of describing what happens. Volume creation, attaching, and detaching tasks go through the volume driver to physical storage—which is how the latter understands calls that come through Nova API. But there was no Isilon driver for OpenStack until we decided to change that.

Rationale for running OpenStack Nova on Isilon

Reliable and scalable storage solution is the base of any kind of cloud deployment and Isilon is an good example of such storage. Deploying a cloud system means not only running virtual machines but also storage for vital data such as databases and application data sets. All this data should be stored in a reliable/redundant way that allows it to be always available above minimum I/O requirements. That makes Isilon and OpenStack an effective combination.

By using this driver, OpenStack Compute virtual machine volumes support the following Isilon features:

  • Single, shared global namespace
  • Isilon IQ Storage seamlessly scaled to 15.5 petabytes
  • Support for InfiniBand or Gigabyte Ethernet for intracluster communication
  • Unmatched aggregate throughput from a single file system up to 100 gigabytes per second
  • Industry-leading high availability for clustered storage systems
  • Powerful, easy-to-use, web-based management
  • 60-second scaling of both capacity and performance
  • Unlimited snapshots and clones

How the OpenStack Nova Volume Isilon driver works

When you use our driver (download link at the end of the post) with Isilon for OpenStack, the workflow looks something like this:

 

  1. Nova-compute tells nova-volume to create a volume through the queue.
  2. Nova-volume goes to the nova.conf file and finds out what driver to use (the Isilon driver in this case).
  3. Nova-volume forwards the Isilon driver all information needed for the volume creation.
  4. The Isilon driver changes nova API calls to the calls Isilon IQ Storage can understand—there are some group of flags in the nova.conf file that help this process.
  5. Isilon creates a volume (a logical unit in Isilon’s terms) and the ISCSI target for it and returns a response back to the driver.
  6. The driver sends information about volume creation (successful or not) to the nova-volume.
  7. Nova-volume writes data and creates a volume in the DB.

You can download the driver here. We look forward to your comments.

3 comments

3 Responses

Continuing the Discussion

  1. OpenStack Community Weekly Newsletter (Oct 12-19) » The OpenStack Blog

    [...] By Mirantis: Integrating OpenStack Cloud Nova Volume storage with Isilon [...]

    October 19, 201214:45
  2. Technology Short Take

    [...] Mirantis has a post about some Nova Volume integration with Isilon. I’ve often said that I think scale-out platforms like Isilon (among others) are an important foundation for future storage solutions. [...]

    October 29, 201206:01
  3. OpenStack Community Weekly Newsletter (Oct 12-19) > Massif Monitor

    [...] By Mirantis: Integrating OpenStack Cloud Nova Volume storage with Isilon [...]

    November 4, 201223:43

Some HTML is OK


or, reply to this post via trackback.