The Justice Department is investigating allegations of sexual assault against former Congressman Eric Swalwell, a source familiar with the matter told The Post Thursday.