Should I really read the Java Language Specification and the Java Virtual Machine Specification?

Yes, if you really want to know how the language and the virtual machine are really supposed to work then you should read their actual specifications.