Do I need to create a new DatagramPacket object for each datagram I send?

No. You should reuse your DatagramPackets. Object creation is an expensive operation. If you are going to be sending many packets, it is much more efficient to simply reset the contents of the packet using the setData method.