-
Notifications
You must be signed in to change notification settings - Fork 84
Fetch and run CRuby tests with exclusions #352
Description
For a long time, we have had an unholy mix of our own custom tests and copied tests from the CRuby test suite. This has led to at minimum some diverging behaviors, and at worst a lot of duplicated effort and missed regressions as the separate test suites have advanced.
At the same time, we do run against the actual CRuby suite in the JRuby tests, using exclusions to maintain a level of compatibility.
Seems like maybe it is time to set up a similar test harness for jossl so that we can verify changes and improvements here immediately without having to separately package a gem and test it on the JRuby side.
There's a number of ways we could fetch the tests, but I think initially I will experiment with pushing a maven artifact from the JRuby repository that includes all of the test files. It should be an easy matter then to unpack that, excludes and all, and run with JRuby directly in our jossl suite. We may already be pushing these files as part of source artifacts, but I will look into that and see if we're pushing enough to basically duplicate a subset of that testing in this repository.