The plural of supremum is suprema, although the (incorrect) form supremums can occasionally be found if you look hard enough.