Random Riddle: I Have One, You Have One

I have one, you have one. If you remove the first letter, a bit remains. If you remove the second, bit still remains. After much trying, you might be able to remove the third one also, but it remains. It dies hard!
 
Random Riddle: I Have One, You Have One