Combined needle case & thimble holder