Visitor chair with armrests