Release 0.16.1: Reorganize tests and add negative test coverage
Summary
This release improves test organization and adds comprehensive negative test coverage for all validators.
Test directory reorganization
- Move positive tests to
test/positive/(golden-simple, golden-extra, import-deduplicate, module-test) - Move negative tests to
test/negative/(strict-inputs, flake-lock, flake-show) - Makes test organization clearer and more maintainable
Add flake-lock negative test
- Tests that validator correctly detects outdated flake.lock files
- Uses child pipeline with artifact-based verification
- Child pipeline has validation job (allow_failure) + verify job that confirms it failed
Add flake-show negative test
- Tests that validator correctly detects evaluation errors
- Uses child pipeline with artifact-based verification
- Child pipeline has validation job (allow_failure) + verify job that confirms it failed
Update strict-inputs-negative-test.nix
- Add all three negative tests as child pipelines (strict-inputs, flake-lock, flake-show)
- Consolidated negative test configuration in one place
Changes
- Reorganize test directory structure with positive/ and negative/ subdirectories
- Add test/negative/flake-lock/ with outdated flake.lock
- Add test/negative/flake-show/ with evaluation error (nonExistentPackage)
- Update test/negative/strict-inputs/ path (from strict-inputs-should-fail)
- Update nix/configuration/strict-inputs-negative-test.nix to include all three negative tests
- Update ChangeLog to 0.16.1