secsy


Total Posts: 10 
Joined: Mar 2019 


Been working on a model for currencies and wanted to know if anyone has tried something like this before. Given a history of prices, I create scaled instances of a certain length (around 60 points per instance), then cluster them by cosine similarity. The idea of clustering is simply to reduce the computation time required to compare arrays to find similar instances. The strategy relies on the assumption that "similar" price instances will reliably produce similar outcomes. The clustering, which I am doing with agglomerative clustering and then fitting with a classifier, speeds up the process significantly (~5x compared to array comparison for all instances). Would be interested to know if anyone has thoughts on this/experience doing this. 




I have not done exactly what you are saying, but if the clustering itself is somewhat consistent, you could just pickle your fitted model with some lag t (1h, 1day), load the latest model at t+1 and transform on the fly. this alone will greatly reduce computation time regardless.
agglomerative clustering works with the added benefit of dendrograms to visualize (often a struggle with ML stuff) but i don't know enough about your problem.


