How can I connect to multiple databases using CMP

Theoretically you can achieve it with CMP, but using 6 different instances of the application server, or 6 'applications' on your application server (if it will allow you). Each application will connect to one of your 6 databases.
Based on the login of your customer, you get the correct InitialContext().