Their permanent exhibition has some pretty rare early stuff (mostly from grave-robbings) and their current exhibition is a review of a southern Chinese painting movement that became part of the international network of the Nationalist resistance during the 20th century, on loan from Hong Kong. This is rare stuff to see outside of Taiwan, and probably rare in Hong Kong these days.
Another sometimes amazing spot is the Institut du Monde Arabe, which had a brilliant exhibition on the Orient Express train lines last year. http://www.imarabe.org/
[1] http://www.arts-et-metiers.net