There are very few things I do not hot-plug.
The warning label is specific in the way that it is “consult manual before operating equipment”.
To me it is not obvious a headphone amp can not handle or even endangers the users health when hot plugging the single ended connection.