Options Announces Partnership With Code Willing

Options Technology, the leading provider of global trading infrastructure to Capital Markets firms, has announced a new partnership with Code Willing, a leading financial data management service in the fintech industry. This partnership will bring to market a new quantitative trading service intended to help clients better control their data analysis costs.

From the press release:

“Code Willing’s technology – ranging from file systems with granular file-based permissioning to high-performance raw data capture services – plays a key role in a number of unique new solutions for the financial services industry that Options will be bringing to market over the coming months, as we continue to build out our global financial ecosystem.”

About Options:

Options Technology is the No. 1 provider of IT infrastructure to global Capital Markets firms, supporting their operations and ecosystems. Founded in 1993, the firm began life as a hedge fund technology services provider. Today, the company provides high-performance managed trading infrastructure and cloud-enabled managed services to over 200 firms globally. For more information, please visit www.options-it.com.

About Code Willing:

Code Willing is a leader in data management solutions for the financial industry. Built on 20+ years of experience in fintech and trading, Code Willing offers data management services, cloud analysis tools, low latency market data feed handlers and scalable high-performance file storage. For more information, please visit www.codewilling.com.

Common Challenges in Managing Data When Turning to the Cloud

As businesses grow and technology advances, it is inevitable you will need to consider more efficient ways to manage your data. This could be in the form of additional on-premise servers, but could also be where you take the leap into cloud data management.

Here we will talk about a few common challenges you may face when turning to cloud computing and ways in which you can overcome them.

Possible Incompatibility

When changing over from the system you have always used to a new cloud-computing platform, there is the possibility of code changes in order for you to work in the new system. For some, this may not be too much of an issue, but for those businesses looking to transfer with as little downtime as possible, this could be a hurdle.

As you are looking through your options, it would be in your best interest to find a cloud platform that requires little to no changes in your code. This can ensure a smooth transfer and won’t require your staff to learn a new form of code.

Financial Costs

We all know nothing is free, but when you are talking about moving your entire business’ data from one platform to another, the cost can appear daunting and disheartening. However, cloud computing is something you will stick with in the future, so you should be looking at this transfer as an investment. The end result in switching to the cloud will end up with you effectively reducing funds spent, as well as providing a more efficient platform for your team.

Although the upfront cost in switching to the cloud is there, the long term costs will greatly benefit you and your business. The wonderful thing about the cloud is the infinite space available for your data. Whereas, when working on an on-premise platform, as your business grows, you will need to purchase additional servers, and you also need to consider how often your hardware will become outdated and needs to be replaced or upgraded.

Resistance to Change

If there is one thing most of us can agree on or have witnessed before, it’s that no one likes change. When things change, what’s next is unknown. Your team has their rhythm, and throwing in a change this permanent can come with some resistance. The important thing to remember is that once in place, your team will be able to work more efficiently and effectively.

There may be a slight learning curve, but if you take note of number one challenge on this list, that change should go smoothly for you and your business. Nothing is perfect, but it can be way better. And with transferring to a solid cloud-computing platform, you will be able to experience a better work day and better work flow.

Conclusion

The team at Code Willing knows the struggle and created the solution for a simpler way to migrate to the cloud. Taking into account these challenges, we have built our own cloud-based file system and cloud workspace so that our clients can more efficiently conduct their business. 

Called CASFS+, not only has this migration been positive for our clients, we are also confident that our product will benefit businesses all across the board. Are you weighing your options with cloud computing? Click here to learn more about what CASFS+ can do in getting your business on the right cloud migration path.

 

Why Cloud Scalability Matters

When it comes to the nuts and bolts of running a business, a lot has changed over the past 40+ years. It’s hard to believe we used to physically write everything down: appointment times, receipts, data, calculations, the list could go on. And then walked in the personal computer.

Now we had a way to drop the pencil and put our fingers to work. Now we had the ease of locating what you are working on rather than flipping through hundreds of pages. Once computers made it into the mainstream, it allowed businesses to instantly find what they needed and eliminated the possibility of wasted time.

Of course, there was eventually going to be something that would go beyond what a personal computer could do. That’s when cloud computing began to make its debut in the business market.

But what makes cloud computing better than what businesses have been using for 40 years? The answer: scalability.

Here, we will discuss why scalability in cloud computing matters to your business and how turning to cloud computing will be the best decision you ever made for your business.

Maintains Growth of Business

By definition, scalability is the capacity to be changed in size or scale. With scalability in cloud computing, it means having a system in place to easily scale up or down, depending on your business. And you can do all of it instantaneously.

Before the cloud, businesses wholly relied on servers to keep up with their growing business. While this method can essentially get the job done, it’s cloud computing that can do it faster and more efficiently.

As your business grows, there will come a point in time when the infrastructure you have in place to hold all your data will be at capacity. For years, the answer was to add another server to the system (on-premise environment). But this takes time. A budget has to be considered, the equipment has to be bought, the time has to be set aside to set up and connect this server to the ones you already have.

And when you are done with the set-up, the server (along with all the others) also has to be maintained by your IT staff. Murphy’s Law states if something can go wrong, it will. Troubleshooting will be a major component of maintaining your servers. This can take away time people can get their work done, and it takes your IT staff away from being able to work on other important projects.

Scalability in cloud computing keeps up with the size of your business and can do it now, not in weeks. As your business grows, so to will the storage capacity available for your business. Should you choose to downscale, scalability in cloud computing gives you the freedom to reduce your level of storage, so you are not wasting any space, time, or money.

Reduce Cost Without Sacrificing Progress

That brings us to the next reason cloud scalability matters for your business. When it comes to servers and an on-premise environment, if your business is growing, the cost to run your business is ever-expanding.

As you grow, additional servers will need to be filed into your office. For most businesses, there is an entire room dedicated to the servers that run their business. Not only is this hardware taking up physical space, but it also takes a good chunk of change to maintain.

Let’s say you have 7 servers. At any given time, two or three could be down. That takes at least two IT employees away from their everyday responsibilities so that they can fix the servers, get them back up and running, and everyone can continue working. Not only does it cost you money, the downtime means you are usually losing money too.

By using cloud computing services, there is no need for all the hardware or the extra room. There is no need to take your IT staff away from what they need to be doing.

Cloud computing can be as big as you need it to be without taking much time and absolutely no physical space. On-premise environments can also be as big as you want them to be. The difference is that with on-premise, you will continue to buy hardware to hold all of your data. And to keep your business running, you will have to continue to need to buy better hardware when the ones you already have become outdated or break.

On-premise is never a one-and-done kind of thing, there will always be upgrades and updates. When you have an update in cloud computing, it can be done automatically and not interfere with work. No hardware required. No cost needed.

It can be difficult to change what you are used to. You have your system and it works. But what if it could work better and grow faster, all while costing you less? That is what scalability in cloud computing can do for you.

Ready to see how cloud computing can make your business more efficient? Click here to learn more about Code Willing’s cloud-based file system and resource manager, CASFS+.

Code Willing’s Client Featured in Online Article about Reducing Compute Costs by 90%

Risk.net, a website dedicated to risk management in complex markets, recently published an article highlighting Quantbot Technologies’ innovative strides in Big Data when utilizing Code Willing’s CASFS+ product.

Quantbot presently uses this product to effectively and efficiently run a version of its quantitative investing platform on the cloud. By implementing CASFS+ into their strategy, they discovered a 90% reduction in cost to run their jobs. The article discusses the algorithm used in order to reduce their spending, along with some additional, effective tools available in CASFS+

And it’s not “Quants only.”. Having built something that can provide multiple businesses with a faster and more cost-efficient way to run jobs, Code Willing is currently in the works to offer CASFS+ to other businesses in the AWS Marketplace. You can even contact them here to set up a demo and learn more about the product.

Link to the news article here:

https://www.risk.net/investing/7856556/this-quant-firm-cut-90-of-its-compute-costs-heres-how

Increasing Upload Speed With CASFS

100x Faster Database Inserts by Code Willing

Code Willing has determined the most efficient way to upload large amounts of data into a database hosted on their custom-built file system.

Following extensive research, Code Willing greatly decreased the time it takes to insert massive amounts of data into a TimescaleDB SQL database hosted on their file system, CASFS.

During their experiment, Code Willing used two different types of uploading methods: upserting data using Pangres and copying the data by using Timescale-parallel-copy.

The data being used in this research was time-sequential financial data daily files, with each of them having 2,229,120 rows and 19 columns.

The control variables during the course of the investigation were the size of the financial data files remaining identical for both uploading tests and using Pandas to process the data before inserting the data into the database.

While using the Pangres method, it allowed for easy insertion from Pandas dataframes into PostgreSQL databases using their upsert method. The upsert method takes advantage of Postgres’ insert function and handles issues like duplicates, adding missing columns, and datatypes.

By using the Pangres method, the upload time for inserting the data was 14.23 minutes (853.8 seconds).

 

Upload Origin Cores Ram Workers Upload Method Parallel Processing Server_data relationship Time (minutes)
Python Notebook 8 64 1 Pangres No none 14.23

Following this result, Code Willing wanted to find a quicker and more efficient way to upload their data. That is where the second uploading method came in.

Timescale-parallel-copy is, “a command-line program for parallelizing PostgreSQL’s built-in `copy` functionality for bulk inserting data into TimescaleDB.”

Code Willing performed three different ways to insert their data using Timescale-parallel-copy.

The first test was where the server-data relationship was local. The result led to an upload time of 1 minute (60 seconds).

 

Upload Origin Cores Ram Workers Upload Method Parallel Processing Server_data relationship Time (minutes)
Command Line 8 64 1 Timescale-parallel-copy No local 1.00

 

For their second trial, they considered using parallel processing and increasing workers by 1 to decrease the upload time further.

This resulted in an upload time of .35 minutes (21 seconds). 

 

Upload Origin Cores Ram Workers Upload Method Parallel Processing Server_data relationship Time (minutes)
Command Line 8 64 2 Timescale-parallel-copy Yes local 0.35 

 

During the third trial, Code Willing set up a TimescaleDB on a separate server and ran it continuously. This is described in the variable “Server_data relationship” as “not local.”

With this change in place, everything else remained the same, including parallel processing, except for changing the number of workers. After testing 1, 2, 4, 6, and 8 workers, they determined 8 workers were the most efficient. The upload time with 8 workers showed .13 minutes (8 seconds).

 

Upload Origin Cores Ram Workers Upload Method Parallel Processing Server_data relationship Time (minutes)
Command Line 8 64 8 Timescale-parallel-copy Yes Not local 0.13 

 

Through this research, Code Willing improved Pangres’ upsert method 99.1%, going from 14.23 minutes to 0.13 minutes, by using TimescaleDB’s parallel copy functionality and implementing Ray’s parallel processing.

To break it down even further, this new method allowed them to copy 278,640 rows per second.

In the end, Code Willing’s experiment determined when uploading copious amounts of data, the most efficient and quickest way is by using the built-in “copy” function (like Timescale-parallel-copy), as well as parallel processing with large amounts of workers to decrease the upload time of time-sequential data into a Postgres database (TimescaleDB).