Hugh Sasse Staff Elec Eng [mailto:hgs / dmu.ac.uk] wrote:

> Maybe worth reporting on results obtained with Rubicon:
> http://www.pragmaticprogrammer.com/ruby/downloads/rubicon.html

I just tried it (see output below). rubicon 0.1.4 and RubyUnit 1.3.0. Seems
that there is still some work left. :-( And I always thought ruby would work
flawlessly for me... ;-)

Roland


TestGC: S.S.S.S.
Time: 0.001999
OK (4/4 tests  0 asserts)

TestArray:
................E.........E...................S......................
Time: 0.057991
FAILURES!!!
Test Results:
 Run: 66/66(456 asserts) Failures: 0 Errors: 2
Errors: 2
./TestArray.rb:249:in `taint'(TestArray): can't modify frozen object
(TypeError)
	from ./TestArray.rb:249:in `test_clone'
	from ./TestArray.rb:246:in `each'
	from ./TestArray.rb:246:in `test_clone'
	from ./TestArray.rb:245:in `each'
	from ./TestArray.rb:245:in `test_clone'
	from ../rubicon.rb:443:in `run'
	from ../rubicon.rb:434:in `each'
	from ../rubicon.rb:434:in `run'
	from AllBuiltinTests.rb:26
./TestArray.rb:385:in `taint'(TestArray): can't modify frozen object
(TypeError)
	from ./TestArray.rb:385:in `test_dup'
	from ./TestArray.rb:382:in `each'
	from ./TestArray.rb:382:in `test_dup'
	from ./TestArray.rb:381:in `each'
	from ./TestArray.rb:381:in `test_dup'
	from ../rubicon.rb:443:in `run'
	from ../rubicon.rb:434:in `each'
	from ../rubicon.rb:434:in `run'
	from AllBuiltinTests.rb:26

TestBignum: ............................
Time: 0.102984
OK (28/28 tests  1431 asserts)

TestBinding:
Time: 0.0
OK (0/0 tests  0 asserts)

TestClass: .....
Time: 0.002999
OK (5/5 tests  16 asserts)

TestContinuation: .....
Time: 0.005999
OK (5/5 tests  5 asserts)

TestDir: ......S......S......E.E.
Time: 0.314952
FAILURES!!!
Test Results:
 Run: 20/20(93 asserts) Failures: 0 Errors: 2
Errors: 2
./TestDir.rb:198:in `tell'(TestDir): The tell() function is unimplemented on
this machine (NotImplementedError)
	from ./TestDir.rb:198:in `test_seek'
	from ../rubicon.rb:443:in `run'
	from ../rubicon.rb:434:in `each'
	from ../rubicon.rb:434:in `run'
	from AllBuiltinTests.rb:26
./TestDir.rb:208:in `tell'(TestDir): The tell() function is unimplemented on
this machine (NotImplementedError)
	from ./TestDir.rb:208:in `test_tell'
	from ../rubicon.rb:443:in `run'
	from ../rubicon.rb:434:in `each'
	from ../rubicon.rb:434:in `run'
	from AllBuiltinTests.rb:26

TestException: .....
Time: 0.002999
OK (5/5 tests  14 asserts)

TestFalseClass: ......
Time: 0.002
OK (6/6 tests  17 asserts)

TestFile: ..S..E.......S.....E.....F............
Time: 0.857869
FAILURES!!!
Test Results:
 Run: 33/33(264 asserts) Failures: 1 Errors: 2
Failures: 1
./TestFile.rb:244:in `test_s_open'(TestFile): expected:<koala
> but was:<wombat> (RUNIT::AssertionFailedError)
	from ./TestFile.rb:239:in `open'
	from ./TestFile.rb:239:in `test_s_open'
	from ./TestFile.rb:216:in `each'
	from ./TestFile.rb:216:in `test_s_open'
	from ../rubicon.rb:443:in `run'
	from ../rubicon.rb:434:in `each'
	from ../rubicon.rb:434:in `run'
	from AllBuiltinTests.rb:26
Errors: 2
./TestFile.rb:438:in `flock'(TestFile): Bad file descriptor - "_file1"
(Errno::EBADF)
	from ./TestFile.rb:438:in `test_flock'
	from ./TestFile.rb:437:in `open'
	from ./TestFile.rb:437:in `test_flock'
	from ../rubicon.rb:443:in `run'
	from ../rubicon.rb:434:in `each'
	from ../rubicon.rb:434:in `run'
	from AllBuiltinTests.rb:26
./TestFile.rb:122:in `open'(TestFile): No such file or directory -
"socket(2)" (Errno::ENOENT)
	from ./TestFile.rb:122:in `test_s_ftype'
	from ../rubicon.rb:443:in `run'
	from ../rubicon.rb:434:in `each'
	from ../rubicon.rb:434:in `run'
	from AllBuiltinTests.rb:26

TestFixnum: .F..............pow(0,neg): DOMAIN error
F....................
Time: 0.027995
FAILURES!!!
Test Results:
 Run: 35/35(437 asserts) Failures: 2 Errors: 0
Failures: 2
../rubicon.rb:102:in `checkBits'(TestFixnum): bit 32 expected:<0> but
was:<1> (RUNIT::AssertionFailedError)
	from ../rubicon.rb:100:in `upto'
	from ../rubicon.rb:100:in `checkBits'
	from ./TestFixnum.rb:30:in `test_AREF'
	from ../rubicon.rb:443:in `run'
	from ../rubicon.rb:434:in `each'
	from ../rubicon.rb:434:in `run'
	from AllBuiltinTests.rb:26
./TestFixnum.rb:203:in `test_POW'(TestFixnum): expected:<Infinity> but
was:<0.0> (RUNIT::AssertionFailedError)
	from ../rubicon.rb:443:in `run'
	from ../rubicon.rb:434:in `each'
	from ../rubicon.rb:434:in `run'
	from AllBuiltinTests.rb:26

TestFloat: ...........F.....log: DOMAIN error
F...log: DOMAIN error
F......log: DOMAIN error
F..
Time: 0.017997
FAILURES!!!
Test Results:
 Run: 27/27(141 asserts) Failures: 4 Errors: 0
Failures: 4
./TestFloat.rb:170:in `test_POW'(TestFloat): The condition is <nil:NilClass>
(RUNIT::AssertionFailedError)
	from ../rubicon.rb:443:in `run'
	from ../rubicon.rb:434:in `each'
	from ../rubicon.rb:434:in `run'
	from AllBuiltinTests.rb:26
./TestFloat.rb:75:in `test_finite?'(TestFloat): The condition is
<false:FalseClass> (RUNIT::AssertionFailedError)
	from ../rubicon.rb:443:in `run'
	from ../rubicon.rb:434:in `each'
	from ../rubicon.rb:434:in `run'
	from AllBuiltinTests.rb:26
./TestFloat.rb:58:in `test_nan?'(TestFloat): The condition is
<false:FalseClass> (RUNIT::AssertionFailedError)
	from ../rubicon.rb:443:in `run'
	from ../rubicon.rb:434:in `each'
	from ../rubicon.rb:434:in `run'
	from AllBuiltinTests.rb:26
./TestFloat.rb:250:in `test_to_s'(TestFloat): expected:<NaN> but
was:<-3.402823466e+38> (RUNIT::AssertionFailedError)
	from ../rubicon.rb:443:in `run'
	from ../rubicon.rb:434:in `each'
	from ../rubicon.rb:434:in `run'
	from AllBuiltinTests.rb:26

TestHash: ....E.....E..................................
Time: 0.026996
FAILURES!!!
Test Results:
 Run: 43/43(270 asserts) Failures: 0 Errors: 2
Errors: 2
./TestHash.rb:140:in `taint'(TestHash): can't modify frozen object
(TypeError)
	from ./TestHash.rb:140:in `test_clone'
	from ../rubicon.rb:443:in `run'
	from ../rubicon.rb:434:in `each'
	from ../rubicon.rb:434:in `run'
	from AllBuiltinTests.rb:26
./TestHash.rb:220:in `taint'(TestHash): can't modify frozen object
(TypeError)
	from ./TestHash.rb:220:in `test_dup'
	from ../rubicon.rb:443:in `run'
	from ../rubicon.rb:434:in `each'
	from ../rubicon.rb:434:in `run'
	from AllBuiltinTests.rb:26

TestIO: .S..........S.....S........................F............
Time: 0.991848
FAILURES!!!
Test Results:
 Run: 52/52(1242 asserts) Failures: 1 Errors: 0
Failures: 1
./TestIO.rb:239:in `test_s_select'(TestIO): expected:<[[#<File:0x819f030>],
[#<IO:0x807518c>, #<IO:0x8075178>], []]> but was:<[[], [#<IO:0x807518c>],
[]]> (RUNIT::AssertionFailedError)
	from ./TestIO.rb:237:in `open'
	from ./TestIO.rb:237:in `test_s_select'
	from ../rubicon.rb:443:in `run'
	from ../rubicon.rb:434:in `each'
	from ../rubicon.rb:434:in `run'
	from AllBuiltinTests.rb:26

TestFileTest: ..S.F.
Time: 0.193971
FAILURES!!!
Test Results:
 Run: 4/4(41 asserts) Failures: 1 Errors: 0
Failures: 1
./TestFileTest.rb:49:in `test_test'(TestFileTest): expected:<0> but
was:<32512> (RUNIT::AssertionFailedError)
	from ../rubicon.rb:443:in `run'
	from ../rubicon.rb:434:in `each'
	from ../rubicon.rb:434:in `run'
	from AllBuiltinTests.rb:26

TestInteger: .........
Time: 0.039994
OK (9/9 tests  347 asserts)

TestMatchData: ...........
Time: 0.004999
OK (11/11 tests  18 asserts)

TestMarshal: ....
Time: 0.007999
OK (4/4 tests  27 asserts)

TestMethod: ....
Time: 0.001
OK (4/4 tests  11 asserts)

TestModule: .........................
Time: 0.036994
OK (25/25 tests  93 asserts)

TestNilClass: .......
Time: 0.003
OK (7/7 tests  20 asserts)

TestNumeric: S.S..S..S.....
Time: 0.005
OK (10/10 tests  21 asserts)

TestObject:
Time: 0.0
OK (0/0 tests  0 asserts)

TestProc: .F...
Time: 0.004999
FAILURES!!!
Test Results:
 Run: 4/4(6 asserts) Failures: 1 Errors: 0
Failures: 1
./TestProc.rb:25:in `test_arity'(TestProc): expected:<-1> but was:<0>
(RUNIT::AssertionFailedError)
	from ./TestProc.rb:16:in `each'
	from ./TestProc.rb:16:in `test_arity'
	from ../rubicon.rb:443:in `run'
	from ../rubicon.rb:434:in `each'
	from ../rubicon.rb:434:in `run'
	from AllBuiltinTests.rb:26

TestRange: ..........
Time: 0.005999
OK (10/10 tests  54 asserts)

TestRegexp: .....E.........
Time: 0.008999
FAILURES!!!
Test Results:
 Run: 14/14(35 asserts) Failures: 0 Errors: 1
Errors: 1
./TestRegexp.rb:50:in `taint'(TestRegexp): can't modify frozen object
(TypeError)
	from ./TestRegexp.rb:50:in `test_clone'
	from ./TestRegexp.rb:47:in `each'
	from ./TestRegexp.rb:47:in `test_clone'
	from ./TestRegexp.rb:46:in `each'
	from ./TestRegexp.rb:46:in `test_clone'
	from ../rubicon.rb:443:in `run'
	from ../rubicon.rb:434:in `each'
	from ../rubicon.rb:434:in `run'
	from AllBuiltinTests.rb:26

TestThread: ................pow(0,0): DOMAIN error
neg**non-integral: DOMAIN error

[--- 20192 lines deleted ---]

neg**non-integral: DOMAIN error
................
Time: 9.236587
OK (32/32 tests  80 asserts)

TestString:
F..................E.........E.............../usr/local/lib/ruby/1.6/observe
r.rb:40: [BUG] Segmentation fault
ruby 1.6.4 (2001-06-04) [x86-nto-qnx]
Abort (core dumped)