May 22, 2015
Big Data in Python: out of core processing
Recently we were presented with the opportunity to explore a big dataset in the Social Finance space. The size of the dataset was substantial: an order of magnitude greater than the core memory our computers. As a result, we couldn’t employ many of the usual methods for using Python’s Pandas with data that fits in memory. In fact, even if your data fits in core memory, if it is big enough you…
View On WordPress