Breaking the Mold:

OpenStack Swift

+

GlusterFS

John Dickinson

PTL, OpenStack Swift

Director of Technology, SwiftStack

@notmyname


Luis Pabón

PTL, Gluster-Swift

Principal Software Engineer, Red Hat

Data consumption models have changed

Source: IDC

Parts of swift

Content on the Web

Video Streaming

  • Migration from SAN
  • Move from tape archive to high availability

Scientific Research

  • Massive data sets
  • Multiple data centers

Swift Users

Around the world (and beyond)

integration with openstack

storage policies

Swift Extensibility

Swift Extensibility: Volumes

GlusterFS

as a

Backend for Swift

Introduction to GlusterFS

Use Case:

Multiple protocol access

April 2012

  • GlusterFS patch applied to OpenStack Swift
  • No automated testing
  • 0 developers on OpenStack Swift
  • 1 developer on patch for Swift

Great idea,

bad executio

n

April 2013

  • Created gluster-swift repo
  • Better integration with OpenStack Swift
  • Full CI automated testing
  • 2 developers on OpenStack Swift
  • 6 developers on gluster-swift

Extended Volume Interface

Red Hat worked with the OpenStack Swift community to improve the volume interface in the object server. The interface is used by gluster-swift as well as other community members for their own backend storage systems.

Source: https://review.openstack.org/#/c/30051/

Great idea,

well executed

...but we can

do better

April 2014

  • Increased participation in OpenStack Swift
  • Identified gluster-swift technology is based on POSIX file semantics
  • gluster-swift project renamed to Swift-on-File
  • 5 developers on OpenStack Swift
  • 3 of the developers to also work on Swift-on-File

Swiftonfile as a Storage Policy

Innovation through collaboration

“In general, open source projects, products, or initiatives are those that embrace and celebrate open exchange, collaborative participation, rapid prototyping, transparency, meritocracy, and community development.”

Source: http://opensource.com/resources/what-open-source

This is as awesome as...

Credit: Christopher Hastings ( http://www.drmcninja.com )

Come join us

This is how to work together in the community

  • Take advantage of existing extensibility
  • Contribute back where more is needed