Search found 1 match

by melbahenry
3 years ago
Forum: Other languages
Topic: Python
Replies: 36
Views: 26779
Gender: None specified

Re: Python

If you use Pandas read_tables with chunking enabled you can load ASCII data fast while saving it to another format (e.g., HDF5). This helps you get around the memory issue when dealing with GBs of ASCII files especially. I did this for a 2 TB ASCII, while converting it to an SQL database and it work...

Go to advanced search