How to Interpret

Installation

Tinderbox starts by installing a gem and all of its dependencies in a sandbox: 

### installing yahoo-1.1.1 + dependencies
### yahoo-1.1.1
### hoe-1.1.7
### rubyforge-0.4.0
### rake-0.7.1
### rc-rest-2.1.0

Tinderbox also checks if you have a Rakefile, and if you do it downloads a Rakefile for you: 

!!! HAS Rakefile, DOES NOT DEPEND ON RAKE!  NEEDS s.add_dependency 'rake'
### rake installed, even though you claim not to need it

Running Tests

Next Tinderbox runs the tests: 

### testing yahoo-1.1.1
### rake test

Tinderbox looks for a Rakefile, Makefile, test directory or spec directory and tries to do something sensible to run the tests. The gem developers page describes how Tinderbox looks for tests. For yahoo-1.1.1 a Rakefile was found, so Tinderbox ran rake test. 

/usr/local/bin/ruby -w -Ilib:ext:bin:test -e 'require "test/test_yahoo.rb"; require "test/unit"' 
(in /Users/drbrain/tinderbox/sandbox/gems/yahoo-1.1.1)
Loaded suite -e
Started
..
Finished in 0.00145 seconds.

2 tests, 2 assertions, 0 failures, 0 errors

No Tests?

### testing coderay-0.7.4.215
!!! could not figure out how to test coderay-0.7.4.215

Tinderbox says so! If you really do have tests, the gem developers page describes how Tinderbox looks for tests.

Errors

(in /Users/drbrain/tinderbox/sandbox/gems/svp-0.1.2)
rake aborted!
no such file to load -- ./test/../lib/svp
/Users/drbrain/tinderbox/sandbox/gems/svp-0.1.2/rakefile:34
(See full trace by running task with --trace)
!!! No test output indicating success found

Is tinderbox reporting an error, but you can't reproduce it on your system? Try running your gem in Tinderbox's sandbox as described on the gem developers page.

No Cheating!

Tinderbox checks the output of the test command it ran for test/unit output. Tinderbox won't let you cheat by simple exiting with a succesful status: 

/usr/local/bin/ruby -Ilib:lib "/Users/drbrain/tinderbox/sandbox/gems/rake-0.7.1/lib/rake/rake_test_loader.rb"  
(in /Users/drbrain/tinderbox/sandbox/gems/contacts-1.0.1)
!!! No test output indicating success found

or even run no tests: 

Loaded suite test
Started

Finished in 0.000154 seconds.

0 tests, 0 assertions, 0 failures, 0 errors
!!! No test output indicating success found