Your kidneys are part of your urinary tract. Certain bacteria in your bladder can spread to them and cause an infection.