CWIQ FS
Flexible File System
With Complete User
Access Control
BENEFITS
DATA STORAGEData is stored in a content-addressable convention to a key/value store such as S3 or disk-files. This allows for straightforward distribution and caching. Data can be located close to the client, with no danger of it being stale.
MASSIVELY SCALABLEBy leveraging cloud infrastructure we can easily scale to petabytes & thousands of high-throughput nodes.
FILE PATTERN BASED ACLSLimit users to particular date-ranges & datasets.
DATA-HIDINGDirectories & files unreadable by the users do not show up in the directory listing.
AUDIT LOGGINGFor filesystem access (you can see what data are actually used, by who and how often).
MULTI-REGION/CLOUD/COLO DEPLOYMENTMultiple file storage backends, S3, GCS, Azure Storage, GPFS.
DEDUPLICATIONSince we use content based hashing we automatically deduplicate files (massive savings on storage).
PLUG & PLAYCW CWIQ-FS runs on your existing on-prem or shared on-prem or public cloud.
The Problem
The Head of Data Strategy of a growing hedge fund requested the ability to be able to permission the various PODs to access specific data and not be able to see what other PODs are using or accessing. The internal file system they were previously using was not capable of performing this task, so they started replicating the data and sending it to the individual PODs, which was time-consuming and costly, requiring them to store multiple copies of the same data.
The Challenge
Many firms have similar challenges which keep the compliance team up at night with multiple copies of data being updated and delivered daily to multiple PODs or individual users. This is costly from both a computing and storage standpoint.
The Solution
Code Willing’s CWIQ FS is a clustered file system that provides a single global file system. It is capable of spanning hundreds of machines, managing billions of files and petabytes of data, all while delivering the full aggregate bandwidth of managed object stores, such as S3. Metadata is updated in real-time across all machines so the cluster can see a consistent view of the world. CWIQ FS provides for data hiding and even date-range restrictions, not only on the POD level, but also on the user level.
The Result
CWIQ FS not only met the requirement for data hiding as requested by the Head of Data Strategy, but it also reduced both compute and storage costs close to 50%. The permissible file system has achieved the original objective and is now utilized to deliver out of sample data for internal users conducting research and evaluation of various data products, enhancing the funds data research process.
CWIQ Central
Complete User Management and Compliance solution. Manage permissions, budget and see data usage for individual users, teams and the larger firm. Insights and metrics will provide budgetary, compliance and management insights to further streamline processes and optimize the data and compute budget. .
Request Demo learn more
CWIQ Code
Licensed and CWIQ Store Data Coded and Mapped to the Security Identifier for quick multi-data connection for analysis and seamless integration into your processes. Connected Exchange, Traditional and ALTData in a single platform including data capture on request. .
Request Demo learn more
CWIQ Feed
We offer feed handlers to capture market data for a variety of global markets and data providers. This can be used for a variety of applications ranging from raw data capture to live trading decision support. .
Request Demo learn more