Search found 1 match

by melbahenry
Thu Aug 25, 2016 5:32 am
Forum: Other languages
Topic: Python
Replies: 36
Views: 10855
Gender: None specified

Re: Python

If you use Pandas read_tables with chunking enabled you can load ASCII data fast while saving it to another format (e.g., HDF5). This helps you get around the memory issue when dealing with GBs of ASCII files especially. I did this for a 2 TB ASCII, while converting it to an SQL database and it work...

Go to advanced search