while I could see his canon self scanning as a Gryffindor, the read I get off him is much more that he was trying to pull through to do his job and fulfill his duty as a loyal subject! than be daring.
He's a thinker who hangs back, observes, processes, and pontificates on what he sees, but the more active and what-he-shows part of him is very dutiful, soft-spoken, and loyal Hufflepuff.