Access to Family Building Act This bill provides a statutory right to access assisted reproductive technology (e.g., in vitro fertilization). Specifically, under the bill, individuals have the right to access assisted reproductive technology, and to retain all rights with respect to the use or disposition of reproductive genetic materials (e.g., eggs or sperm), without prohibitions or unreasonable restrictions. Health care providers and insurers also have the right to provide and cover these services, respectively. The bill does not affect state or local health and safety regulations that achieve their purpose in the least restrictive manner possible. The Department of Justice may bring civil actions against states, localities, or government officials or entities that enact or enforce limitations or requirements that violate this bill. Individuals and health care providers who are affected by violations may also bring civil actions for relief.