Does JMS provide load balancing, fault tolerance, scalability, and so on?

The JMS specification does not address these issues; hence, vendors are free to implement their own support, and many vendors do provide these services.