Is it possible to change the icon in the title bar of a JFileChooser?

JFileChooser is not a Dialog itself. Therefore you could add the JFileChooser to your own JDialog (whose icon can be controlled though its owner frame).

(NOTE: The showDialog methods of the JFileChooser give it an appearance of being a dialog by placing it in a managed dialog.)