Finished vest didn't hold it's shape

I am new to knitting and have finished a vest using silk/bamboo thread; however, after hand washing and drying flat as the directions indicated, the sweater is stretched out and droopy. It is currently unwearable. Did I do something wrong? Did I knit too loosely? The pattern is called "Lacy Top" by Patons. I'm very frustrated. Thanks. Jane