Hybrid-Cloud File Storage with AWS

Organizations can now take full advantage of their file data and create faster business outcomes leveraging the cloud.



I had the opportunity to meet with Molly Presley, Global Product Marketing, Ben Gitenstein, VP of Product, Barry Russell, SVP and GM of Cloud, and Sudhesh Suresh, Principal Technical Product Manager at Qumulo during the 35th IT Press Tour.


Qumulo strives to provide simple and scalable flash and cloud file storage. Their philosophy is a file system is only as valuable as the applications it enables and the data it serves. Data must be near the users and compute that will leverage the data and it must be accessible to the applications that use it. Value is in enabling applications, not storing data. Enable people to use data when and where they want.


Enterprises have been evolving how they store and use data. They began by consolidating all of their data on one platform for real-time data analytics, share data across applications, with built-in data protection. Then they extended their infrastructure to the cloud as they accelerated digital transformation, with the agility of burst computing, and content distribution. Now they are transforming their business reinventing to meet consumers’ needs and looking for opportunities to disrupt their industry. There’s integration into DevOps automation, the enablement of remote works, and leveraging cloud applications and tools.


The product focus is to enable customers to move and create cloud file workloads, democratize flash for file, provide great user experience, and make it simple for customers to buy, consume, and integrate. The software provides data access and authorization, management and programmability, data services, file system, platform, and scalable block store. Their solution consolidates all data and applications, provides massive and efficient scale, single-tier simplicity, automates everything, full data availability, and streamline cloud strategies.


Case Studies

  • Capsilon, acquired by EllieMae, is a mortgage automated cloud transaction processing company with billions of files in a single namespace. They are able to serve up and store documents and data as needed.

  • The Institute for Health Metrics and Evaluation (IHME) is an independent health research center at the University of Washington that creates research models for diseases and death that public health officials use to track diseases and plan responses. They take large data sets, store them, and serve data and models to analytics applications when needed. They are resilient, high-performance, highly accurate.

  • CineSite puts elements of movies in locations used by artists to create final edits of movies and shows which are then rendered to create the final footage. On-premises storage was not keeping pace. They took their applications from on-prem and moved them to the public cloud so artists could create on the public cloud elastically. This fulfilled their need for a cloud-based file system that mirrors their on-prem environment.

During our presentation, the team introduced Qumulo Shift for AWS in response to the ever-growing amount of widely distributed unstructured data that organizations are producing to drive innovation. This is the first native cloud service that enables organizations to move file data from any on-prem or public cloud cluster into Amazon Simple Storage Service (S3) and transform that data to object in an open and non-proprietary format. With Shift, Qumulo file customers can leverage the full ecosystem of cloud-native applications and services attached to Amazon S3. Shift is included for free with the Qumulo file system. Qumulo also announced that its cloud software has achieved the Amazon Well-Architected designation, enabling organizations to run Qumulo’s validated architecture on AWS.


To date, enterprises have been unable to easily move critical file data to the cloud, stranding their data from the applications and services they need to use. Complicating cloud adoption even further, enterprises have been forced to completely re-architect their application workflows in order to utilize data in the cloud. Traditional legacy file systems are limited in their ability to help customers leverage the cloud, causing expensive and time-consuming application refactoring and forcing customers into proprietary data formats. With a few clicks, organizations can now move their file data to Amazon S3, providing absolute data freedom.


Leveraging Qumulo’s API and cloud-native architecture, developers now can quickly connect applications to file data and integrate with native cloud services, giving developers control to choose how they want applications and services to process file data at any scale.


Shift Use Cases

  • Innovate with file data -- move data to the cloud by API, leverage innovative cloud services and applications, without refactoring applications.

  • Collaborate -- share data with collaborators directly from S3.

  • Enable DevOps -- API-first makes it easy to integrate into automation and connect directly to cloud services; AWS tools and Qumulo APIs enable the creation, management, and destruction of a namespace.

  • Automated cloud backup of file data -- a durable copy of data on the cloud; useful for compliance and disaster recovery planning.

  • Archive for cost savings -- programmatically move projects to AWS S3 storage for long-term retention; frees space in performance clusters.

Testimonials

  • “As a national leader in the NIPT (Non-Invasive Prenatal Testing) and Hereditary Cancer testing market, Progenity has significant regulatory retention requirements. Amazon S3 with Bucket Lifecycle Policies is our top choice for a cost-effective, secure, and compliant environment,” said David Meiser, Solutions Architect at Progenity. “Qumulo is the best choice for managing our data as it enables us to innovate with cloud-native services and applications while also providing the ability to securely store our data in a non-proprietary format while in S3.”

  • “For Shell, Qumulo is a key component for the migration of subsurface applications and related data from on-premise to a cloud-based set-up,” said Johan Krebbers, GM Digital & Emerging Technologies / VP Innovation, Shell. “Using Qumulo, we have been able to accelerate the processing of large file data sets with their highly performant NFS and SMB support.”

Drop Me a Line, Let Me Know What You Think

© 2020 by Tom Smith | ctsmithiii@gmail.com | @ctsmithiii