What is a Favicon? Where can I get it? How add favicon to my site?

Most website have favicon and it's great to have one. It helps your user to find your page easier between his/hers bookmarks or opened browser's tabs. Generally favicon means favorite icon, you can find it here: