--1924321787Content-Type: multipart/alternative; boundary=001a1143ddaaf6603705464acb96

--001a1143ddaaf6603705464acb96
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

Thank you for the great summary Naruse-san!

On Mon, Jan 16, 2017 at 4:27 PM, NARUSE, Yui <naruse / airemix.jp> wrote:
> But
> mspec doesn have enough utility in envutil, like assert_separately.

That can be added of course.
There is ruby_exe("some code"), but it's more limited as it does not
require the test framework.

> Like above mspec is not as robust as miniunit.
> Even though ruby/spec example is smaller than test-all,
> mspec has more abstraction layers than minitest+test-unit wrapper.

Maybe we can make mspec simpler, I would be glad to see that.
I do not think there is necessarily a much larger abstraction needed for
spec-style.

There are also counter examples, such as test-all using refinements
and complex code in setup or utilities, which make them really hard to run
for other implementations.

> If it hits mysterious SEGV, it makes hard to debug.
> (I experienced such hard debugging some times through the experience)

Could you expand on what is hard to debug?
Is it the assertion code, going from one test to another or something else?
Debugging at the C level when going through quite a bit of Ruby code is
hard,
I usually make a minimal reproducible example when the bug is not obvious.

> Just as a note
> * test-all also has tag feature; JRuby uses that for these days

Yes, but it does not work well.
The most common case is an alternative implementation
passes everything except 1 of the 10 assertions in that test method,
and then everything must be excluded for the CI to stay green.

--001a1143ddaaf6603705464acb96
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir="ltr">Thank you for the great summary Naruse-san!<br><br>On Mon,an 16, 2017 at 4:27 PM, NARUSE, Yui &lt;naruse / airemix.jp&gt; wrote:<br>&gt; But<br>&gt; mspec doesn have enough utility in envutil, like assert_separately.<br><br>That can be added of course.<br>There is ruby_exe(&quot;some code&quot;), but it&#39;s more limited as it does not require the test framework.<br><br>&gt; Like above mspec is not as robust as miniunit.<br>&gt; Even though ruby/spec example is smaller than test-all,<br>&gt; mspec has more abstraction layers than minitest+test-unit wrapper.<br><br>Maybe we can make mspecimpler, I would be glad to see that.<br>I do not think there is necessarily a much larger abstraction needed for spec-style.<div><br><div><div>Therere also counter examples, such as test-all using refinements</div><div>and complex code in setup or utilities, which make them really hard to run for other implementations.</div><div><br>&gt; If it hits mysterious SEGV, it makes hard to debug.<br>&gt; (I experienced such hard debugging some times through the experience)<br><br>Could you expand on what is hard to debug?<br>Is it the assertion code, going from one test to another or something else?<div>Debugging at the C level when going through quite a bit of Ruby codes hard,</div><div>I usually make a minimal reproducible example when the bug is not obvious.<br><br>&gt; Just as a note<br>&gt; * test-all also has tag feature; JRuby uses that for these days</div><div><br></div><div>Yes, but it does not work well.</div><div>The most common case is an alternative implementation</div><div>passes everything except 1 of the 10 assertions inhat test method,</div><div>and then everything must be excluded for the CI to stay green.</div><div><br></div></div></div></div></div>

--001a1143ddaaf6603705464acb96--

--1924321787Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: inline


Unsubscribe: <mailto:ruby-core-request / ruby-lang.org?subjectsubscribe>
<http://lists.ruby-lang.org/cgi-bin/mailman/options/ruby-core>

--1924321787-