ECO Converter is being made at this repository.
Few problems that were solved
Problems: Memory Error and Slow Algorithm
As mentioned earlier, too much memory and too less resources were allocated. Some approaches to solving this:
-
As suggested by Nipun sir, I implemented an appending function to the existing HDF5file. Hence in this scenario, we would not merge the concatinated dataframe all at once but append it for every file. This made the speed of the program predictable, error-free and executed perfectly.
-
This was also the time when I upgraded my laptop to a new one. Although I had to install and run nilmtk and its all dependencies from scratch, it made execution faster and I had more RAM and CPU speed to allot. This also helped in the process.