It can feel awkward to ask, so here it is out loud. Can doing pelvic exercises change sexual function?
What the research says
A page hosted at pmc.ncbi.nlm.nih.gov states: "Studies have shown that pelvic physical therapy programs can both improve pelvic floor dysfunctions and sexual function."
Read that closely. The source talks about pelvic physical therapy programs, not a few squeezes done on your own.
Cheap first steps, and where they stop
The low-cost move is reading. Cleveland Clinic's page on pelvic floor dysfunction, the MedlinePlus page on pelvic support problems and NICHD's pelvic floor disorders overview explain the basics in plain language. Note what you recognize and what you do not.
What is not a do-it-yourself matter is deciding that you have a problem and picking a program for it. A clinician can tell you whether a pelvic physical therapy program fits your situation.
Bring the question to someone licensed
You do not need the right vocabulary. Say what you notice and what you hope will change, and let a licensed clinician take it from there.