table_indices.RdReturns indices to process large tables
table_indices(path, size)
| path | Path to tabular data file. |
|---|---|
| size | Numeric element specifying the max. data volume (in Mb). |
list object with indices
This function helps process tables that are larger
than memory. Given a file path, the function infers the
storage size of the input file and determines an optimal number
of runs. To do, the argument size is used, which determines
the maximum amount of RAM that should be occupied in a single read.
Then, for each of the n runs, the function determines the corresponding
start and end rows, which are reported as a list. The output can be used
in combination with, e.g., read_delim, which allows
users to specify starting and ending rows when importing a file.