Are my new puppy's urinary issues a genuine health problem?

Go to the vet. Hopefully it is something simple that can be cleared up with a round of antibiotics. BTW, many antibiotics are free at Publix and your vet can call them in there. It's worth checking out. Good luck.