Only use noexcept in public headers on >= C++11

Only use noexcept in public headers on >= C++11 #865