Recently in The Cloud Category

The Good News

Today you can readily port your current quantitative, algorithmic and automated trade platforms over to The Cloud.

The Bad News

Your trading platform's current architecture will not automatically allow you to take advantage of the massive processing power that The Cloud avails of itself.

The biggest challenge is that proprietary strategies or algorithms will require an additional translation to be executed so that your algorithmic instructions can be parsed out to multiple processors simultaneously.

Your current platform does not have this instruction set embedded in it....Bummer.

We will be publishing a post shortly on this and will give you an overview of two different approaches to solving this problem either via an ad hoc overlay of parsing services or from a code base that was built from the ground up with parallel processing in mind.

More Bad News

Cloud Based Historical Tick Data Stores for back-testing are not yet online.

The first offerings will be offered not by data vendors, or the exchanges, but as a service available only by proprietary Cloud based algo/quant trading platforms - with access to the Historical Tick Data store only by their own platform using their own API.

What's Next?

We are currently speaking with trading software vendors, data vendors and exchanges about their intended Cloud Tick Data Store offerings and will be publishing a post on the state of their upcoming offerings and their pros and cons.

Where's the Sunshine?

Though the infrastructure and the technology to enable The Cloud today is here today the Algo/Quant tool-kits and their supporting services are not yet in place....But the first offerings are entering Beta as we speak.

So now is the time to start rolling up your sleeves, to start figuring out how best to lean into The Cloud to improve your trading organization and have some fun with a new technology.

If you have any facet of a Cloud Trading offering, either in development, beta or production, please feel free to ping us to chat.

carl at algofutures 

How do you actually begin building Trading Systems in The Cloud?

The cloud and understanding how to benefit from it can be confusing. 

In this post we will attempt to avoid over complicating things and instead lay out a simple framework that you can to use to map your existing analytical IP and your historical tick data to The Cloud. 

In the near future, we anticipate that Cloud based historical tick level data stores will be available for back-testing on a 'pay-as-you-crunch' model.

There will also be approaches to creating data layers using the cloud service API and/or virtual data arrays. 

Until then consider this structure:

Logical-Cloud-Architecture-Simple.jpg

How does this really work?

At a high level the the cloud service API provides two things. 

The wrapper for your application services to take advantage of The Cloud and a layer of memory that can load any run time supported by the cloud when the application is launched.

Note - This is a critical nuance as this is what really happens between the application layer and The Cloud service API.

Think about these things:

  1. What programming language is your Intellectual Property (application layer code) written in? This is important when choosing a Cloud service. Make sure the service supports your code.

  2. Can your proprietary data be moved to the cloud? It is important to make sure your data warehouse can scale with your cloud applications and be accessible by your cloud applications. The importance of this will be obvious in the upcoming articles three dimensional data stores (virtual data arrays).

  3. What is a simple but high value component of your application that would provide you with Trading Nuggets if you could run massive back-tests against it.  If you don't already have any, we bet that it wouldn't take you long to conjure something up considering that with The Cloud you now have unlimited processing power at your fingertips.  This may be were you want to start wrapping your IP into a cloud service API.  Once you have completed this first pass it will give you the knowledge and momentum to Start simple and build your library of Algo and Quant Cloud Srvices.

This is just the beginning and things do get more complex but the first step is just changing the way you think about your applications and intellectual property. In future posts we will de-construct an application and show the next level of detail in the cloud revolution.

Some folks have written me saying that The Cloud does not have application in the Trading Industry because of latency issues.

Some of you may already be familiar with my thoughts on The Latency Hype so I won't delve into them here.

For this blog post, let's put Trade Execution Services within The Cloud aside for the time being and focus solely on the R&D side of your trading business.

The Cloud harmonizes the intrinsic elasticity of the Demand for Processing Cycles with the inelasticity of the Supply of Processing Cycles

One of the great advantages of The Cloud is that you can ramp up processing power without having to provision and/or commit to servers.  Once you are done with your calculations you release your leased processing cycles back into the pool of The Cloud and forget about them.

All of the hardware, software, rack space, electricity, etc. that it took to run your calculations are now offered on a pay-as-you-go model via The Cloud.

Gone are the days of provisioning your data processing resources for your projected peak load.

With The Cloud's real-time scalable pay-as-you-go model you can spin up 1,000 servers and run them for an hour for the same cost as spinning up 1 server and running it for 1,000 hours.

How cool is that?

...and the cycle time is cheap.  Below are cycle costs from Amazon's Web Offering (EC2):


Amazon EC2 On-Demand Instances

Standard On-Demand Instances

Linux/UNIX Usage

Windows Usage

Small (Default)

$0.10 per hour

$0.125 per hour

Large

$0.40 per hour

$0.50 per hour

Extra Large

$0.80 per hour

$1.00 per hour

High CPU On-Demand Instances

Linux/UNIX Usage

Windows Usage

Medium

$0.20 per hour

$0.30 per hour

Extra Large

$0.80 per hour

$1.20 per hour

 

Note - we are Vendor Neutral and are only quoting Amazon's pricing as an example,  not an endorsement.

There are different types of Cloud offerings and depending upon the type of number crunching that you do, or would like to do, and the composure of your current Intellectual Property code base, Amazon may not be the best offering for you.

In our next post about Algo and Quant Trading in The Cloud, Tim Kraska will document a Logical Design for Cloud Services that will enable you to port your current IP to The Cloud.

About this Archive

This page is a archive of recent entries in the The Cloud category.

Technical Analysis is the previous category.

Trade Setups is the next category.

Find recent content on the main index or look in the archives to find all content.

April 2009: Monthly Archives