You could get a sound card if it's a desktop computer. There are also Usb sound 'cards' if it's a laptop.
Which is why I suggested sugru,it's not a liquid glue and you mold it around the jack and port.It can be removed.I don't think gluing a headset into a jack is a good idea.
If the headset breaks, then you have 2 broken items: the jack/port and the headset glued there.
I probably try a USB headset if the 2.5mm port doesn't seem to get a good connection.
https://sugru.com/moldable glue? It's the word glue that is misleading. Perhaps it should have been explained that it is not glue.