100:892f694ba76f
|
2011-02-15 |
Paul Boddie |
changeset
files
shortlog
graph
|
Fixed the itermerge optimisation for single element collections of iterators.
Removed the common iterator support in the terms module since the features are
really only relevant for the combined iterator.
Fixed the seeking and state resetting logic in the combined iterator, retaining
the last returned values only in this class.
Introduced usage of the combined iterator as index reader only where a single
pair of files is present. |
|
|
iixr/index.py iixr/terms.py itermerge.py
|
|
99:a0cec1caf0f0
|
2011-02-14 |
Paul Boddie |
changeset
files
shortlog
graph
|
Introduced last term/positions caching for all iterators.
Fixed reader state adjustments around the last term read. |
|
|
iixr/terms.py
|
|
98:52bfb08d5b2f
|
2011-02-14 |
Paul Boddie |
changeset
files
shortlog
graph
|
Fix the index bisection and attempt to prevent unnecessary seeking and scanning. |
|
|
iixr/terms.py
|
|
97:cf159c14882a
|
2011-02-14 |
Paul Boddie |
changeset
files
shortlog
graph
|
Moved the IndexReader to the terms module, renaming it to MultipleReader.
Introduced information file indexing in order to support go_to_term methods
which can seek to terms or nearest following neighbours.
Removed a redundant reset method invocation from the files module.
Added an optimisation in itermerge where only one iterator is being managed. |
|
|
iixr/files.py iixr/filesystem.py iixr/index.py iixr/terms.py itermerge.py test.py
|
|
96:6542c54d115b
|
2011-02-13 |
Paul Boddie |
changeset
files
shortlog
graph
|
Removed numerous classes, simplifying the package and focusing on combined term
and position files which can be merged using fewer processing operations. |
|
|
iixr/data.py iixr/fields.py iixr/files.py iixr/filesystem.py iixr/index.py iixr/merging.py iixr/positions.py iixr/terms.py itermerge.py test.py
|
|
95:b75bd39cf61f
|
2011-02-12 |
Paul Boddie |
changeset
files
shortlog
graph
|
Changed cache slicing to record pointer updating. |
|
|
iixr/files.py
|
|
94:2b56cb8c1947
|
2011-02-12 |
Paul Boddie |
changeset
files
shortlog
graph
|
Removed unnecessary recursion when flushing records/caches. |
|
|
iixr/files.py
|
|
93:74e2e30aabea
|
2011-02-11 |
Paul Boddie |
changeset
files
shortlog
graph
|
Introduced read and write caches in order to investigate performance changes. |
|
|
iixr/files.py
|
|
92:158d0a4400c1
|
2011-02-11 |
Paul Boddie |
changeset
files
shortlog
graph
|
Removed redundant data attribute. |
|
|
iixr/files.py
|
|
91:218fd6522891
|
2011-02-10 |
Paul Boddie |
changeset
files
shortlog
graph
|
Introduced size declarations for sequences employed by readers and writers.
Added a begin method which is used to acquire sequence size information in
readers and to set such information in writers.
Changed readers to call the begin method upon initialisation and for readers and
writers to not call reset upon initialisation, although this could potentially
change for readers in future.
Changed the itermerge iterator to permit access to the first element in an
iteration sequence in order to support data sampling for sequence size
information.
Added a sizeof function to determine sequence/value lengths.
Added some potentially useful sequence conversion functions. |
|
|
iixr/data.py iixr/fields.py iixr/files.py iixr/index.py iixr/positions.py iixr/terms.py itermerge.py test.py
|
|