Goldman Sachs, known for its hard-working bankers, is becoming a family friendly firm.

The Wall Street giant is expanding its parental leave policy, offering new fathers and other "non-primary caregivers" more paid time off when they have a baby.

As of Friday, Goldman is offering four weeks off, with pay, to employees following the birth or legal adoption of a child, according to an internal announcement. It previously offered them two weeks off.

Goldman (GS) currently offers 16 weeks of paid maternity leave for employees in the United States. In 2012, the company began offering parents who adopt a child the same amount of time off. One year later it extended the benefit to parents who use a surrogate.

The new time off policy will also apply to partners in same-sex couples, according to a spokeswoman.

The change is part of "the firm's ongoing commitment to working families," Goldman's top human resources executive, Edith Cooper, wrote in a memo to employes.