1 Introduction
2 ------------
3
4 XSLTools is a collection of modules and packages facilitating the development
5 of applications based on XML, XSL stylesheets and transformations, notably Web
6 applications involving complicated Web forms potentially consisting of
7 editable hierarchical structures and potentially involving "live" or "in-page"
8 dynamic updates to portions of those Web forms.
9
10 Quick Start
11 -----------
12
13 Try running the demo:
14
15 python tools/demo.py
16
17 An introductory guide to creating applications can be found in the docs
18 directory - see docs/index.html for the start page.
19
20 Contact, Copyright and Licence Information
21 ------------------------------------------
22
23 The current Web page for XSLTools at the time of release is:
24
25 http://www.boddie.org.uk/python/XSLTools.html
26
27 Copyright and licence information can be found in the docs directory - see
28 docs/COPYING.txt, docs/lgpl-3.0.txt, docs/gpl-3.0.txt,
29 docs/LICENCE-Sarissa-lgpl.txt and docs/LICENCE-Sarissa-gpl.txt for more
30 information.
31
32 Additional Software
33 -------------------
34
35 The XSLTools examples make use of sarissa.js from the Sarissa distribution,
36 release 0.9.8.1. Copies of this file are found in the Resources/scripts
37 directory within each example's package.
38
39 Dependencies
40 ------------
41
42 XSLTools has the following basic dependencies:
43
44 Packages Release Information
45 -------- -------------------
46
47 libxml2dom 0.4.3
48 libxml2 and libxslt Some combinations may not be reliable!
49 Tested with libxml2 2.6.17 and libxslt 1.1.12
50 Tested with libxml2 2.6.27 and libxslt 1.1.20
51 libxslt 1.1.17 should be avoided
52
53 The example Web applications require WebStack (release 1.2.3 or later).
54 The example PyQt applications have been tested with PyQt 3.15.
55
56 New in XSLTools 0.5.1 (Changes since XSLTools 0.5)
57 --------------------------------------------------
58
59 * Added modular request handling methods to XSLFormsResource, altering some
60 of the examples to demonstrate the usage and overriding of these methods
61 in preference to overriding respond_to_form.
62 * Added methods to the Form class to support modular request handling.
63 * Added information about XSLT extension function usage to the advanced
64 template design document, linking to the housekeeping annotations section
65 of the template attribute reference guide.
66
67 New in XSLTools 0.5 (Changes since XSLTools 0.4.6)
68 --------------------------------------------------
69
70 * Renamed template:id to template:section in order to get around problems
71 and potential future problems with browsers (such as Konqueror 3.5.6)
72 which get confused loading documents with multiple id attributes, even if
73 only one is unprefixed. WARNING! This change is not backwards compatible.
74 * Added Ubuntu Feisty (7.04) package support.
75 * Tidied the documentation HTML.
76
77 New in XSLTools 0.4.6 (Changes since XSLTools 0.4.5)
78 ----------------------------------------------------
79
80 * Improved the Login module, enabling the VerySimpleWithLogin example for
81 various frameworks.
82 * Relicensed under the LGPL version 3 or later.
83 * Upgraded to Sarissa 0.9.7.8 (compatible with LGPL/GPL version 3), removing
84 a test around DOMParser so that Konqueror 3.4.0 is still supported.
85
86 New in XSLTools 0.4.5 (Changes since XSLTools 0.4.4)
87 ----------------------------------------------------
88
89 * Fixed the result of transformations in XSLOutput: proper document nodes
90 are now produced.
91 * Added an XSLForms.Resources.Login module which provides resources to
92 support login screens and redirects.
93 * Fixed newlines in the attributes created from fields in XSLForms: CR
94 characters are no longer included since this caused the doubling up of
95 newlines in Firefox.
96
97 New in XSLTools 0.4.4 (Changes since XSLTools 0.4.3)
98 ----------------------------------------------------
99
100 * Fixed translation selection for the template:i18n annotation attribute,
101 not just for the template:i18n extension function - more apologies for
102 resulting output changes!
103 * Improved the template fixing stylesheet and added some documentation for
104 the script and the related expr-prefix attribute.
105 * Introduced WebStack 1.2.2 EncodingSelector and encoding changes.
106 * Added docstring and return value for the write_month_to_document function
107 in XSLTools.XMLCalendar.
108
109 New in XSLTools 0.4.3 (Changes since XSLTools 0.4.2)
110 ----------------------------------------------------
111
112 * Fixed translation selection when an unsupported locale is specified,
113 choosing the first locale as the default (rather than exposing the values
114 themselves as translations). Note that this is an unfortunate and subtle
115 change which may affect application output - apologies are hereby offered!
116
117 New in XSLTools 0.4.2 (Changes since XSLTools 0.4.1)
118 ----------------------------------------------------
119
120 * Added a content type check in the XSLFormsResource class, permitting
121 non-form-based resources to access the raw request data, rather than have
122 the data processed unsuccessfully and consequently discarded.
123 * Added a script and a function to fix template namespaces after editing in
124 a careless editor.
125 * Changed libxml2mod and libxsltmod import details to try libxmlmods -
126 suggested by Lucian Wischik for libxml2dom.
127
128 New in XSLTools 0.4.1 (Changes since XSLTools 0.4)
129 --------------------------------------------------
130
131 * Made translations specified using the template:i18n annotation take
132 priority over template:value annotations.
133 * Added expression-based template:i18n annotations, and provided fallback
134 output for such translations based on the value of the evaluated
135 expression.
136
137 New in XSLTools 0.4 (Changes since XSLTools 0.3.1)
138 --------------------------------------------------
139
140 * Changed the preparation of templates to produce rule-based output
141 stylesheets, thus permitting recursive templates. This requires an extra
142 expr-prefix annotation to be used in certain kinds of templates.
143 * Added a recursive template example application.
144 * Changed fragment production to use original template documents instead of
145 output stylesheets.
146 * Changed the in_page_resources attribute to provide the output identifier,
147 thus changing the prepare_fragment method in Web resources so that only
148 the fragment identifier needs to be supplied.
149 * Added the XSLForms.Resources.WebResources.prepare_resources method for the
150 preparation of initialiser and output stylesheets before an application is
151 run.
152 * Changed selectors to not automatically create elements in the form data
153 document unless requested to do so. Introduced a Form.get_selector
154 method in XSLForms.Fields.
155 * Permitted the creation of hierarchies of elements in
156 XSLForms.Utils.add_elements.
157 * Introduced dynamic parameter evaluation for multiple-choice fields in
158 order to support sources of multiple-choice values which reside in the
159 form data document itself.
160 * Added the FixNamespace.xsl stylesheet to correct documents saved by HTML
161 editors which strip namespace prefixes.
162 * Fixed filesystem encoding issues in the Candidate example; fixed language
163 preference access in the Configurator and VerySimple examples.
164 * Changed the BaseHTTPRequestHandler version of the Candidate example to
165 store data in a subdirectory of the current working directory, thus
166 allowing the demonstration application to work after package installation.
167
168 New in XSLTools 0.3.1 (Changes since XSLTools 0.3)
169 --------------------------------------------------
170
171 * Fixed copyright and licensing information.
172
173 New in XSLTools 0.3 (Changes since XSLTools 0.2)
174 ------------------------------------------------
175
176 * Introduced copying of multiple-choice value element contents so that
177 option element labels can differ from the underlying values.
178 * Added internationalisation support, providing the template:i18n annotation
179 and the template:i18n extension function.
180 * Updated the documentation to cover the above new features.
181 * Fixed non-GET/POST request method handling in WebResources.
182 * Added the xslform_preparemacro.py script.
183 * Added an experimental template:range extension function.
184
185 New in XSLTools 0.2 (Changes since XSLTools 0.1)
186 ------------------------------------------------
187
188 * Made a new XSLTools package and moved XSLOutput into it.
189 * Improved serialisation of transformation results so that output options
190 are observed (in some cases, at least).
191 * Fixed stylesheet and reference document paths so that libxslt should not
192 now become confused by ambiguous relative paths.
193 * Added expression parameters to XSLOutput.Processor so that in-document
194 data can be used to, for example, initialise multiple-choice field values.
195 * Added input/initialiser support so that input documents can be tidied or
196 initialised using information from the template.
197 * Added template:init for use with template:element in XSLForms to control
198 element initialisation where necessary.
199 * Added special high-level "macro" attributes (eg. template:attribute-field)
200 which should make templates easier to write and maintain.
201 * Added template:if to XSLForms, providing conditional output of annotated
202 elements.
203 * Added set_document to XSLForms.Fields.Form.
204 * Added prepare_parameters to the XSLFormsResource class in the
205 XSLForms.Resources.WebResources module.
206 * Added element-path, url-encode and choice XSLForms extension functions.
207 * Improved Unicode support in the XSLForms extension functions.
208 * Changed in-page requests to contain proper POST data.
209 * Fixed checkbox and radiobutton value detection in XSLForms.js.
210 * Updated the code to work with WebStack 1.0 changes and adopted the
211 new-style WebStack demonstration mechanism.
212 * Added XMLCalendar and XMLTable (to the XSLTools package).
213 * Added a dictionary (or word lookup) example application.
214 * Added a job candidate profile (or CV editor) example application.
215 * Added a template attribute reference and an XSLFormsResource guide to the
216 documentation.
217 * Added Debian package support (specifically Ubuntu package support).
218 * Added missing COPYING.txt file.
219 * Renamed the scripts to avoid naming issues in system-wide installations.
220 * Added a PyQt example based on the system configurator example, with the
221 form prepared in Qt Designer. This example runs in PyQt and in a Web
222 environment without any changes to the application code. In-page updates
223 are currently not implemented in the Web version, however.
224
225 Notes on In-Page Update Functionality
226 -------------------------------------
227
228 Special note #1: Konqueror seems in certain cases to remember replaced form
229 content (when replaceChild is used to replace regions of the page which
230 include form elements). This causes the browser to believe that more form
231 fields exist on the page than actually do so, and subsequent form submissions
232 thus include the values of such removed fields. A special hack is in place to
233 disable form fields by changing their names, thus causing Konqueror to not
234 associate such fields with the real, active fields; this hack does not seem to
235 cause problems for Mozilla. This needs some investigation to determine in
236 exactly which circumstances the problem arises.
237
238 Special note #2: Konqueror also seems to crash if asked to find elements using
239 an empty 'id' attribute string. This needs some investigation to see if it
240 really is the getElementById call that causes the crash.
241
242 Special note #3: Konqueror's XMLHttpRequest seems to append null characters to
243 the end of field values. Attempting to prune them before the request is sent
244 fails with a function like the following:
245
246 function fixValue(fieldValue) {
247 if (fieldValue.length == 0) {
248 return fieldValue;
249 } else if (fieldValue[fieldValue.length - 1] == '\0') {
250 return fieldValue.substr(0, fieldValue.length - 1);
251 } else {
252 return fieldValue;
253 }
254 }
255
256 This may be because it is the entire message that is terminated with the null
257 character, and that this happens only upon sending the message. Consequently,
258 some frameworks (notably mod_python) do not support in-page functionality when
259 used from Konqueror.
260
261 Various browsers (eg. Mozilla/Firefox, Konqueror) will not allow the
262 XMLHttpRequest in-page updates to function unless the URL used in the
263 requestUpdate JavaScript function is compatible with the URL at which the
264 browser finds the application. Currently, relative URLs are in use to avoid
265 this issue of compatibility, but should an absolute URL be deduced using the
266 WebStack API and then used, it may be possible that the values returned by
267 that API do not match the actual addresses entered into the address bar of the
268 browser.
269
270 To check the behaviour of the applications, it is possible to view the
271 document source of the pages served by applications and to verify that the
272 URLs mentioned in the JavaScript function calls (to 'requestUpdate') either be
273 a relative link or involve a URL similar to that which appears in the
274 browser's address bar. In some environments, the use of 'localhost' addresses
275 often confuses the browser and server; one workaround is to use real host
276 names or addresses instead of 'localhost'.
277
278 Choosing an element-path:
279
280 When specifying the "context" of the in-page update, one must imagine which
281 element the template fragment should operate within. If the template:id
282 attribute marks a particular section, then the element-path should be a path
283 to the applicable context element for that section in the complete template
284 document. Note that if a template:element attribute appears on the same
285 element as the template:id attribute then the element-path should refer to the
286 element specified in the template:element attribute.
287
288 Choosing where to put template:attribute, template:id and id:
289
290 When specifying the extent of a template fragment, one must be sure not to put
291 the template:id attribute on the same element as a template:attribute
292 annotation; otherwise, the generated code will be improperly extracted as a
293 fragment producing two versions of the element - one for when the specified
294 attribute is present, and one for when it is not present. Generally,
295 template:id and id can be placed on the same node, however.
296
297 Stable element ordering and element-path:
298
299 Within the element-path, the numbering of the elements will start at 1.
300 Therefore it is vital to choose a region of the form data structure with the
301 element-path which is isolated from surrounding elements whose positions would
302 otherwise be dependent on a stable ordering of elements, and whose processing
303 would be disrupted if some new elements suddenly appeared claiming the same
304 positions in the document. For example:
305
306 <item value=""> .../item$1/value
307 <type value=""/> .../item$1/type$1/value
308 <comment value=""/> .../item$1/comment$2/value
309 </item>
310
311 In-page update...
312
313 <comment value=""/> .../item$1/comment$1/value
314
315 Notes on XSL
316 ------------
317
318 libxslt seems to be quite liberal on the definition of runtime parameters, in
319 that there is no apparent need to explicitly declare the corresponding global
320 variables in stylesheets. Whilst this is nice, we may eventually need to
321 detect such variables and add them in the preparation process.
322
323 Release Procedures
324 ------------------
325
326 Update the XSLTools/__init__.py and XSLForms/__init__.py __version__
327 attributes.
328 Change the version number and package filename/directory in the documentation.
329 Change code examples in the documentation if appropriate.
330 Update the release notes (see above).
331 Check the setup.py file and ensure that all package directories are mentioned.
332 Check the release information in the PKG-INFO file and in the package
333 changelog (and other files).
334 Tag, export.
335 Generate the example resources.
336 Generate the API documentation.
337 Remove generated .pyc files: find . -name "*.pyc" | xargs rm
338 Archive, upload.
339 Upload the introductory documentation.
340 Update PyPI, PythonInfo Wiki, Vaults of Parnassus entries.
341
342 Generating the Example Resources
343 --------------------------------
344
345 In order to prepare the example resources, the prepare_demo.py script must be
346 run as follows:
347
348 python tools/prepare_demo.py
349
350 This will ensure that all initialiser and output stylesheets are created and
351 are thus installed by packages.
352
353 Generating the API Documentation
354 --------------------------------
355
356 In order to prepare the API documentation, it is necessary to generate some
357 Web pages from the Python source code. For this, the epydoc application must
358 be available on your system. Then, inside the distribution directory, run the
359 apidocs.sh tool script as follows:
360
361 ./tools/apidocs.sh
362
363 Some warnings may be generated by the script, but the result should be a new
364 apidocs directory within the distribution directory.
365
366 Making Packages
367 ---------------
368
369 To make Debian-based packages:
370
371 1. Create new package directories under packages if necessary.
372 2. Make a symbolic link in the distribution's root directory to keep the
373 Debian tools happy. Try one of the following:
374
375 ln -s packages/ubuntu-hoary/python2.4-xsltools/debian/
376 ln -s packages/ubuntu-feisty/python-xsltools/debian/
377
378 3. Run the package builder:
379
380 dpkg-buildpackage -rfakeroot
381
382 4. Locate and tidy up the packages in the parent directory of the
383 distribution's root directory.