The Secretary of Agriculture shall have charge, in the building and premises appropriated to the department, of the library, furniture, fixtures, records, and other property appertaining to it, or acquired for use in its business.