This phase III trial studies how well standard systemic therapy with or without definitive treatment (prostate removal surgery or radiation therapy) works in treating participants with prostate cancer that has spread to other places in the body. Addition of prostate removal surgery or radiation therapy to standard systemic therapy for prostate cancer may lower the chance of the cancer growing or spreading.