Can I hide the grey TextField border in an applet while still displaying the text?

You can't. You have no control over the display of the AWT components. They use the native widget set (are drawn outside Java).