For anyone else looking, this feature is now available in 2.38.7. I call the new infoWindows ‘infoBoxes’. They can be styled using CSS and also extend beyond the map boundaries – handy for widgets and other smaller maps.
If you don’t see 2.38.7 in your account, please contact me using the contact form.