How can I implement Bulleted lists using JTextPane?

The JTextPane is also a JEditorPanel. Therefore you could do

tp.setContentType("text/html");

and then use the HTML unordered list syntax to achive the desired result.

In fact you can use most of the html syntax including images etc.