Nani!!!

So the creators of the code finally got back to us. They recommended us to run the code on a machine with 20 CPU cores and 256GB RAM. I’m so confused how would providing more resources fix missing values errors. Seems like that is a dead end. I’m beginning to doubt how accurate the results they presented are. Nevertheless that is a problem for a later point.

We continue to clean some of the data on the sample data since we relalize it’s not possible to run the full data on our own machines since the files are too large to be loaded into RAM properly. Seems like at least 32GB of RAM would be needed to load and manipulate some of the files. Maybe even as much as 64GB may be needed. Hopefully we find a solution for that soon. Seems like Chrome has some competition for RAM.

Leave a comment

Design a site like this with WordPress.com
Get started