If said executable jar is also provided with programming API docs of some variety, then the quick answer is "yes". You will write your own test classes and make calls the whatever is that jar file to create "fixture objects" and then do method calls on them, then assert some return value / system state / exception.