SharePoint: Error creating Enterprise Search Center Site in SharePoint 2010

I tried to create a site based on Enterprise Search Center template and got this not so user friendly error message:
An unexpected error has occurred.

It turns out that  SharePoint Server Publishing Infrastructure feature need to be activated at site collection level in order to create sites from Enterprise Search Center template.