Over half of office workers would feel more comfortable and be more productive with their departmental manager sitting away from them, suggests research.