Eric Blake <ebl...@redhat.com> writes: > On 10/07/2015 10:15 AM, Markus Armbruster wrote: >> Eric Blake <ebl...@redhat.com> writes: >> >>> The alternate-good.json test was already covered by >>> qapi-schema-test.json. As future commits will be tweaking >>> how alternates are laid out, removing the duplicate test now >>> reduces churn. >> >> Do we have more positive tests? They should probably all live in >> qapi-schema-test.json, because there their generated code actually gets >> compiled. > > Hmm, any test that has an empty .err and non-empty .out, but which does > not also have an TODO/FIXME stating that it is a bug, is worth checking. > So first, here's the list of non-empty .out files: > > empty.out [1] > enum-empty.out > event-case.out [4] > union-empty.out [2] > include-simple.out > include-repetition.out > include-relpath.out > comments.out > alternate-empty.out [2] > returns-int.out > struct-base-clash-base.out [3] > flat-union-empty.out [2] > indented-expr.out > union-clash-data.out [3] > ident-with-escape.out > args-member-array.out > flat-union-reverse-define.out > > [1] must stay separate, because we can't really make qapi-schema-test > empty :) > [2] marked FIXME, and turns into proper error message later in the v5 series > [3] marked FIXME, and already removed later in the v5 series once a > positive test is inlined into qapi-schema-test > [4] marked TODO > > For the ones I didn't tag with a footnote, we could probably cover > things directly in qapi-schema-test instead; the question then becomes > which ones are already covered, and which ones need content moved.
Actually, the point isn't to move the positive test to qapi-schema-test.json, the point is to compile-test its generated code. Moving it to qapi-schema-test.json accomplishes that. However, we may not want a single, monolithic positive test. Should we split up qapi-schema-test.json instead? I don't know. Anyway, let's flush our queue first. Third case: the generated code isn't worth compile-testing; comparing actual to expected .out suffices. Let's sort your untagged tests into buckets: Not worth compile-testing: * comments.json * include-simple.json * include-repetition.json * include-relpath.json * indented-expr.json * ident-with-escape.json Not (completely) covered in qapi-schema-test.json: * enum-empty.json Not covered, but should be. * flat-union-reverse-define.json UserDefOne covers forward reference to struct base, UserDefFlatUnion covers forward reference to union base, and UserDefFlatUnion2 covers forward reference to member. We may want to cover forward reference to the tag member's type. Covered: * returns-int.json 'user_def_cmd3' does the job. * args-member-array.json '__org.qemu_x-command' seems good enough.
