The characters in the second picture:
□□□□二十三番飾磨懸 – something + No.23, Shikama-ken
Shikama-ken existed from 1871 to 1876, and the prefecture is now southwest part of Hyogo-ken.
The 3rd and 4th character might be 報国 (hokoku), then it may mean Service Corps in the context.