[Libreoffice-qa] Test case naming

[Petr Mladek]

Rimas Kudelis píše v Út 15. 11. 2011 v 18:21 +0200:
> 2011.11.15 17:30, Petr Mladek rašė:
> I didn't say they have to be translated word-to-word. They should be
> *localized*, and I would expect a localized testcase to suggest
> localized number and date formats and other stuff.

I see.

Well another question is how it appears in the test run. The language
independent tests are proceed once. The language dependent tests need to
be proceed for every localization.

> RTL, on the other hand, might probably need a few additional testcases.
> Though not many, I would guess.

I agree.

> > BTW: How is the localization used during test run?
> >
> > If I select "de", will I see only the "de" test cases from the l10n
> > branch? I am not sure if it is important but it would be nice.
> 
> No, currently you will still see all testcases.
> 
> My idea with localizable testcases though is pretty much about this. If
> testcase X was localized instead of duplicated, it would only be shown
> once, in user's preferred locale (I don't know yet how exactly the user
> would "prefer" that locale though and what a user who would want to test
> more than one locale would do).

Yes, it sounds great.

> >> My suggestion is to have a single branch, but carry Priority, Locale and
> >> Component information in the Testgroup, and to represent test type by a
> >> subgroup. That is, what is now a branch, would become a subgroup, and
> >> everything else would become a testgroup (see the attached PDF file).
> > Hmm, I am afraid that we would get too many testgroups. It produces 7
> > (General, Base, Calc, Draw, Impress, Math, Writer) testgroups for one
> > language. We have 109 localizations in sources => we could end up with
> > more than 700 test groups.
> 
> Which I guess is not realistic, at least in the short term.  ;) Right
> now we only have four languages into which testcases are translated.
> With 50, it's of course a different story, but with 4 to 10... it's
> probably still manageable enough.

I hope that 10+ is quite realistic. If people provide translation. They
might want to do also testing. I think that we have more than 10 active
l10n teams. Maybe, they just do not know how to work with Litmus.

> >> * share the same General Functional Tests subgroup between testgroups
> >> designated for different locales (that is, you would create this
> >> subgroup once, and add it to all locale groups)
> > I am not sure what you mean with this. Could we share subgroups between
> > test groups in Litmus? Is it clearly visible or is hard to maintain and
> > see?
> 
> Like I mentioned before, when you create/edit a testgroup, you can add
> the subgroups you want to it. So subgroups can be shared, yes.

Heh, it is interesting feature. I need to think if we could somehow use
it.

I am slightly afraid to use it because you will see the same text in
different context. You will not know how your changes affect other
locations.

It is hard to visualize. Heh, I just might be too tired today ;-)

> > BTW: What do you mean with the "Basis Functional Test"? We do not have
> > this subgroup in the current structure.
> 
> Don't we?
> https://tcm.documentfoundation.org/manage_testgroups.cgi?testgroup_id=58

I guess that it comes from the older structure and is used only in the
obsolete branches.

In each case, it does not fit the current approach. "Basic tests" is
something that should go the "P1" or "P2" group of the functional or
l10n tests.


> >> * drop 75% of the testgroups (there would be about 28 of them initially)
> >> if/when proper testcase localization is implemented, still not rendering
> >> the remaining testgroups useless.
> > I am not sure if we really could drop them. Well, the question is if we
> > need to split between lang-dependent and lang-independent on the top
> > level.
> 
> I don't think there are many lang-dependent testcases. Desired result
> may depend on the language, yes, but the testcase itself?

I see the point. The logic should be the same for all languages.

The Right-to-Left stuff will be tested only in some locales but it still
can be described in all languages.

Well, we still do not have this support, so we need to split the
languages in the group names.


Best Regards,
Petr