The city of Cuttack is the socio-cultural center of the state of Odisha. The earliest Durga Puja was reportedly held in the Kazi Bajaar area of the city in 1832 by both Odias and Bengalis, employees of the East India Company. The local people participated in the festivities enthusiastically. However, due to differences which cropped up later, the Oriyas decided to organise the Puja on their own.
Now the silver and gold jewellary clad Durga is seen in many lanes and pandals. The pandal is permanent throughout the year in the suburbs of Cuttack, where regular worship is done for the divine mother, and idols are made only during Dussehra time and immersed after that.
Another opinion is that Chaitanya Deb Mahaprabhu started the Pujas in the year of 1505, when he visited Cuttack, on his way to Puri to the temple of Lord Jagannath. (Source – Wikipedia)