John,
You are correct about the kirimon and chrysanthemum and yes there is a portrait scroll in the Memorial Museum, Nagoya showing Hideyoshi wearing an armour decorated with the 5-7-5 kirimon. However there is also a sword stand in Tokugawa Art Museum, Nagoya with the same kirimon and the aoimon of the Tokugawa family that is supposed to have been Ieyasu's.
There is also another intriguing little mystery about Hideyoshi's use of the kirimon. In the tensho mission to Europe of 1582, some gifts to Philip II of Spain were sent by Hideyoshi, including one of the famous kagamusha armours, another of which is in the Tokugawa Art Museum. Both of these are decorated with the same 5-7-5 kirimon. On Philip II's death his son, Philip III, sold two armours to Rudolph of Bohemia. These appear in an inventory of 1607 of Prague Castle. Now the intriguing thing is why was Hideyoshi sending gifts whilst he was a vassal of Nobunaga (and was busy in Honshu and didn't attack Kyushu, where the trip was planned, until 1587) and why was he using the kirimon two years before it was granted to him by the emperor? Bit of a mystery here.
Ian