97:cf159c14882a
|
2011-02-14 |
Paul Boddie |
changeset
files
shortlog
graph
|
Moved the IndexReader to the terms module, renaming it to MultipleReader.
Introduced information file indexing in order to support go_to_term methods
which can seek to terms or nearest following neighbours.
Removed a redundant reset method invocation from the files module.
Added an optimisation in itermerge where only one iterator is being managed. |
|
|
iixr/files.py iixr/filesystem.py iixr/index.py iixr/terms.py itermerge.py test.py
|
|
96:6542c54d115b
|
2011-02-13 |
Paul Boddie |
changeset
files
shortlog
graph
|
Removed numerous classes, simplifying the package and focusing on combined term
and position files which can be merged using fewer processing operations. |
|
|
iixr/data.py iixr/fields.py iixr/files.py iixr/filesystem.py iixr/index.py iixr/merging.py iixr/positions.py iixr/terms.py itermerge.py test.py
|
|
95:b75bd39cf61f
|
2011-02-12 |
Paul Boddie |
changeset
files
shortlog
graph
|
Changed cache slicing to record pointer updating. |
|
|
iixr/files.py
|
|
94:2b56cb8c1947
|
2011-02-12 |
Paul Boddie |
changeset
files
shortlog
graph
|
Removed unnecessary recursion when flushing records/caches. |
|
|
iixr/files.py
|
|
93:74e2e30aabea
|
2011-02-11 |
Paul Boddie |
changeset
files
shortlog
graph
|
Introduced read and write caches in order to investigate performance changes. |
|
|
iixr/files.py
|
|
92:158d0a4400c1
|
2011-02-11 |
Paul Boddie |
changeset
files
shortlog
graph
|
Removed redundant data attribute. |
|
|
iixr/files.py
|
|
91:218fd6522891
|
2011-02-10 |
Paul Boddie |
changeset
files
shortlog
graph
|
Introduced size declarations for sequences employed by readers and writers.
Added a begin method which is used to acquire sequence size information in
readers and to set such information in writers.
Changed readers to call the begin method upon initialisation and for readers and
writers to not call reset upon initialisation, although this could potentially
change for readers in future.
Changed the itermerge iterator to permit access to the first element in an
iteration sequence in order to support data sampling for sequence size
information.
Added a sizeof function to determine sequence/value lengths.
Added some potentially useful sequence conversion functions. |
|
|
iixr/data.py iixr/fields.py iixr/files.py iixr/index.py iixr/positions.py iixr/terms.py itermerge.py test.py
|
|
90:fc0e9882717b
|
2011-02-08 |
Paul Boddie |
changeset
files
shortlog
graph
|
Moved the record handling into reset methods in order to have records encompass
entire "pages" of stored data, rather than individual entries.
Changed the term dictionary index to refer to the start of each "page" of term
dictionary entries rather than the second entry. This is done so that the entire
"page" or record can be loaded when such a "page" is requested, although it
effectively prohibits direct traversal of the term dictionary without having to
refer to the term dictionary index.
Introduced a test for array exhaustion when reading variable-length integers
from a particular starting position. |
|
|
iixr/data.py iixr/fields.py iixr/files.py iixr/positions.py iixr/terms.py
|
|
89:1f3986bca1a3
|
2011-02-07 |
Paul Boddie |
changeset
files
shortlog
graph
|
Introduced record-oriented reading and writing of files where an array is
populated in a single read from a file or flushed to a buffer in a single write
operation.
Moved various data representation operations into the data module, removing
explicit object size concerns from the higher-level modules, replacing them with
usage of adder and subtractor functions where appropriate.
Made the vint caches lists instead of dictionaries.
Enforced tuples as the input representation of serialised sequence values. |
|
|
iixr/data.py iixr/fields.py iixr/files.py iixr/positions.py iixr/terms.py test.py
|
|
88:4c35f0aa339c
|
2011-02-03 |
Paul Boddie |
changeset
files
shortlog
graph
|
Changed the files to have an internal array for reading and writing data. |
|
|
iixr/fields.py iixr/files.py iixr/positions.py iixr/terms.py test.py
|
|