What would you do if your own literary agent secretly held back your book?

What would you do if your own literary agent secretly held back your book?