CSI Data LME Nickel contract error

Discussions about the testing and simulation of mechanical trading systems using historical data and other methods. Trading Blox Customers should post Trading Blox specific questions in the Customer Support forum.
Post Reply
scrubolio
Senior Member
Senior Member
Posts: 26
Joined: Sun Jul 19, 2009 2:19 am

CSI Data LME Nickel contract error

Post by scrubolio »

If you guys see a huge cliff around 20020203 in your tests and include the LME nickel contract then this may be why:

notice the extra zeros...I have contacted CSI about this almost 2 weeks ago and was told that they would put it in the correction file...however I just updated my data a few seconds ago and checked the file again and sure enough it wasn't corrected. I was looking through the help file and it seems that if it was put in the correction file it should have been automatically correct upon update correct?

Makes me want to devise a method to check all the data I am using...

CSI #: 2074, 2078

20060202,13800.00000000,13800.00000000,13800.00000000,13800.00000000, 12150, 57011, 54,13800.00000000

20060203,139550.00000000,139550.00000000,139550.00000000,139550.00000000, 11073, 57108, 54,139550.00000000

20060206,13925.00000000,13925.00000000,13925.00000000,13925.00000000, 8959, 56815, 54,13925.00000000
sluggo
Roundtable Knight
Roundtable Knight
Posts: 2987
Joined: Fri Jun 11, 2004 2:50 pm

Post by sluggo »

Have you tried the CSI commands
  • Database / Refresh History
    Database / Integrity Search
    Database / Download Replacement Fact Files
Maybe if you give your CSI setup a vigorous and thorough Lower Intestinal Cleanse, it will reload the newly corrected data from their servers.

In my experience it often takes two or three market-days of downloads, to get corrections into your on-disk copy of the CSI database. So when CSI's data purity technician sends you email on Tuesday saying "X has been fixed", you may not see the corrected X until after Thursday evening's download. I wish it weren't so

It may also take another phone call or email to them saying "You fixed CSI #2074 but you didn't fix CSI #2078 which had the same mistake."

By the way, I trade LME nickel but I use the 3 month forwards; you're discussing the 27 month contracts. CSI's data for the 3 month guys doesn't have the price spike you're seeing.

Here is free software that finds this sort of error: viewtopic.php?t=3993
scrubolio
Senior Member
Senior Member
Posts: 26
Joined: Sun Jul 19, 2009 2:19 am

Post by scrubolio »

thank you sluggo, as always your posts are very informative and appreciated :)

I was just in the midst of coding a program to look for these discrepancies, but i won't try to reinvent the wheel

Thanks again for the link and creating that blox. While it irks me (and i'm sure everyone else) to find these errors, i'm glad i found them before going live...
scrubolio
Senior Member
Senior Member
Posts: 26
Joined: Sun Jul 19, 2009 2:19 am

Post by scrubolio »

well another heads up, i was just looking into the 3 month contracts for aluminum and sure enough i found some more "errors" that were confirmed by CSI (I wonder if they are still giving out those free pens).

the errors this time were in contract #2096 on the following dates:

20020815
20021002
20030217
20040330
20040910
20060904
20090224

CSI said that they corrections would be in 3/1/2010's correction file.
Post Reply