Keep Physicians Serving Patients Act of 2023 This bill requires the Centers for Medicare & Medicaid Services to use specified data regarding physician wages and office rent when determining certain geographic adjustment factors for the payment of physician services under Medicare. With respect to such payment, the bill also makes permanent certain minimum adjustments to the work geographic index and extends to all localities certain minimum adjustments to the practice expense index.