My company doesn`t build management products, is there any reason we should be looking into the Java Management extensions ("JMX") specification?

If your company builds applications or devices that would benefit from being manageable then the answer is yes. Making these elements manageable increases their value to yourself and your clients. It makes them easier to install, configure, and maintain. And because is relatively easy to do, making your products manageable through JMX technology is something you should definitely consider.