Close’n Forget is a Firefox which enables you to delete private browsing data (History & Cookies) for the current website just by a simple mouse click.
Though, there are several other add-ons for private browsing mode, but still this add-on worths a try. Install it and then move to the toolbar customization (by a right click on the toolbar area). Drag the Close’n forget button to toolbar area. Now, You can delete the private data and close the current tab by hitting this button.
You can set the option for deleting the only the history or cookies. Hence, you are not totally in private browsing mode and can delete your information according to your requirements.
Link : Close’n Forget (Firefox add-on) :)
Read More Articles:

One question : Will I be able to delete the private data of a particular website using this ?? Or it will delete the Whole private data ??
If latter is true then we can achieve that Using “always clear my Private data when i close firefox” or manually by hitting “Clear Now”
@Amit : It deletes the data of the particular website (current tab). I have already mentioned it in the post. :)