Summary: This hopefull we deflake the jenkins build a bit.

Test Plan: Jenkins

Reviewers: vihang, oazizi

Reviewed By: vihang, oazizi

Differential Revision: https://phab.corp.pixielabs.ai/D7745

GitOrigin-RevId: a6f4669381bb54bd5ca0f1089a546ef040c0c7d9