The Southwest Harbor Public Library is the public library serving Southwest Harbor Maine. The Southwest Harbor Public Library was built in 1895. On March 17 1888 the Tremont Public Library Association was formed for the purpose of looking after books and raising funds for a permanent building.