[Libreoffice-qa] [documentliberation-discuss] ODF compatibility tests

[Friedrich W. H. Kossebau]

Hi Jay,

Am Freitag, 2. Mai 2014, 16:21:32 schrieb Jay Philips:
> I was curious what compatibility tests are being run to ensure that LibO
> displays ODF accurately. I had asked a similar question a few days back
> on the LibO QA mailing list but never got a response. Is there an
> archive of standard compliant odf 1.0/1.1 and 1.2 files that is
> available? Alternatively, is there an ODF test to validate if a ODF file
> outputted by an ODF compatible software complies to the ODF standard and
> can output the file as a pdf to show how it should be rendered, somewhat
> similar to the Acid test for CSS.
> 
> As part of my extensive testing of .docx files in LibO, i'm currently
> testing ODF outputted by LibO to see how well its imported into Word
> 2010 and 2013, as well as testing ODF outputted by Word 2010 and 2013 to
> see how well its imported into LibO. It would be nice to have a ODF
> software that i could use its output as a reference to compare these
> results against, as i've found ODF outputted by word 2010 that doesnt
> open correctly in LibO but did in Calligra Words and i've also found ODF
> files on libreoffice.org that displayed differences in LibO 4.1 and 4.2.
> Currently if a .doc, .docx or .rtf loads different between LibO and ms
> word, i report these bugs, but if there are load differences for .odt
> files its difficult to know if its a LibO or ms word problem.

Many months ago Jos van den Oever has started a project called OdfAutoTests, 
which is "simple software project for easily testing OpenDocument format 
implementations". Code is at
	https://gitorious.org/odfautotests.

The tests are basically XML files which contain ODF fragments and the expected 
results after a roundtrip or on export to PDF. Expected results can be ODF 
fragments again, but there is also inital support to test rendering, by 
describing areas on a page where non-white content is expected in the PDF 
export.

See here for an example report:
	http://oeba.nl/odfautotests/report.html

Development is currently stalled, but would be great to see this picked up and 
get developed further, as well as put into use at LO, AOO, Calligra and 
elsewhere (he, WebODF even :) ).

Some more info is in this presentation: 
http://conference.libreoffice.org/talks/2013/content/sessions/010/files/010.odp

Cheers
Friedrich