99:a0cec1caf0f0
|
2011-02-14 |
Paul Boddie |
changeset
files
shortlog
graph
|
Introduced last term/positions caching for all iterators.
Fixed reader state adjustments around the last term read. |
|
|
iixr/terms.py
|
|
98:52bfb08d5b2f
|
2011-02-14 |
Paul Boddie |
changeset
files
shortlog
graph
|
Fix the index bisection and attempt to prevent unnecessary seeking and scanning. |
|
|
iixr/terms.py
|
|
97:cf159c14882a
|
2011-02-14 |
Paul Boddie |
changeset
files
shortlog
graph
|
Moved the IndexReader to the terms module, renaming it to MultipleReader.
Introduced information file indexing in order to support go_to_term methods
which can seek to terms or nearest following neighbours.
Removed a redundant reset method invocation from the files module.
Added an optimisation in itermerge where only one iterator is being managed. |
|
|
iixr/files.py iixr/filesystem.py iixr/index.py iixr/terms.py itermerge.py test.py
|
|
96:6542c54d115b
|
2011-02-13 |
Paul Boddie |
changeset
files
shortlog
graph
|
Removed numerous classes, simplifying the package and focusing on combined term
and position files which can be merged using fewer processing operations. |
|
|
iixr/data.py iixr/fields.py iixr/files.py iixr/filesystem.py iixr/index.py iixr/merging.py iixr/positions.py iixr/terms.py itermerge.py test.py
|
|
95:b75bd39cf61f
|
2011-02-12 |
Paul Boddie |
changeset
files
shortlog
graph
|
Changed cache slicing to record pointer updating. |
|
|
iixr/files.py
|
|
94:2b56cb8c1947
|
2011-02-12 |
Paul Boddie |
changeset
files
shortlog
graph
|
Removed unnecessary recursion when flushing records/caches. |
|
|
iixr/files.py
|
|
93:74e2e30aabea
|
2011-02-11 |
Paul Boddie |
changeset
files
shortlog
graph
|
Introduced read and write caches in order to investigate performance changes. |
|
|
iixr/files.py
|
|
92:158d0a4400c1
|
2011-02-11 |
Paul Boddie |
changeset
files
shortlog
graph
|
Removed redundant data attribute. |
|
|
iixr/files.py
|
|
91:218fd6522891
|
2011-02-10 |
Paul Boddie |
changeset
files
shortlog
graph
|
Introduced size declarations for sequences employed by readers and writers.
Added a begin method which is used to acquire sequence size information in
readers and to set such information in writers.
Changed readers to call the begin method upon initialisation and for readers and
writers to not call reset upon initialisation, although this could potentially
change for readers in future.
Changed the itermerge iterator to permit access to the first element in an
iteration sequence in order to support data sampling for sequence size
information.
Added a sizeof function to determine sequence/value lengths.
Added some potentially useful sequence conversion functions. |
|
|
iixr/data.py iixr/fields.py iixr/files.py iixr/index.py iixr/positions.py iixr/terms.py itermerge.py test.py
|
|
90:fc0e9882717b
|
2011-02-08 |
Paul Boddie |
changeset
files
shortlog
graph
|
Moved the record handling into reset methods in order to have records encompass
entire "pages" of stored data, rather than individual entries.
Changed the term dictionary index to refer to the start of each "page" of term
dictionary entries rather than the second entry. This is done so that the entire
"page" or record can be loaded when such a "page" is requested, although it
effectively prohibits direct traversal of the term dictionary without having to
refer to the term dictionary index.
Introduced a test for array exhaustion when reading variable-length integers
from a particular starting position. |
|
|
iixr/data.py iixr/fields.py iixr/files.py iixr/positions.py iixr/terms.py
|
|